2024-09-18T01:50:44.124 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T01:50:44.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T01:50:44.231 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909769 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7909769' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f rgw: ec-data-pool: false frontend: beast thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9034 sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIC8y/Xf1ouM8T6aTl/TC0plAp1akAuqyy07AQIrhUuuywQBPrC788FSA1R+wu0Yz9rdODl6UVeZR7txz7niY0w= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBGdbuQVrqnG7q1mj8l25ZhARALA+UhlKOguPUXpkoDIENCt7S5bONMtcCoZ/Rqh4MTRU+rb4rOSyIv4ZrFSeY4= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_21:40:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-18T01:50:44.231 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa; will attempt to use it 2024-09-18T01:50:44.231 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa/tasks 2024-09-18T01:50:44.232 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T01:50:44.233 INFO:teuthology.task.internal:Checking packages... 2024-09-18T01:50:44.254 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'c2ddf9721ef254645201cdbabd9c8f49c30a586f' 2024-09-18T01:50:44.254 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T01:50:44.254 INFO:teuthology.packaging:ref: None 2024-09-18T01:50:44.254 INFO:teuthology.packaging:tag: None 2024-09-18T01:50:44.254 INFO:teuthology.packaging:branch: squid 2024-09-18T01:50:44.254 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T01:50:44.255 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-18T01:50:44.453 INFO:teuthology.task.internal:Found packages for ceph version 19.2.0-1jammy 2024-09-18T01:50:44.454 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T01:50:44.461 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T01:50:44.461 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T01:50:44.508 INFO:teuthology.task.internal:Saving configuration 2024-09-18T01:50:44.520 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T01:50:44.534 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T01:50:44.555 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909769', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 01:45:01.122121', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBVGKzv7iPz+BQo2tek8JXAHxMa7swnPAKG/f1VmfgjO'} 2024-09-18T01:50:44.574 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909769', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 01:45:01.120643', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINN9POI9wds5AOcU27KzrIb7TfAoSfSmbyiyHc54QP7V'} 2024-09-18T01:50:44.574 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T01:50:44.580 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-18T01:50:44.580 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-18T01:50:44.580 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T01:50:44.660 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdce1b36f80>, signals=[15]) 2024-09-18T01:50:44.660 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T01:50:44.665 INFO:teuthology.task.internal:Opening connections... 2024-09-18T01:50:44.665 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T01:50:44.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:50:44.746 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T01:50:44.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:50:44.825 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T01:50:44.831 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-18T01:50:44.836 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-18T01:50:44.836 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-18T01:50:44.883 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-18T01:50:44.883 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2024-09-18T01:50:44.883 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="22.04" 2024-09-18T01:50:44.883 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-18T01:50:44.883 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=jammy 2024-09-18T01:50:44.883 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2024-09-18T01:50:44.883 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2024-09-18T01:50:44.884 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-18T01:50:44.884 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-18T01:50:44.884 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-18T01:50:44.884 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-18T01:50:44.884 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=jammy 2024-09-18T01:50:44.884 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-18T01:50:44.909 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-09-18T01:50:44.914 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-09-18T01:50:44.914 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-09-18T01:50:44.961 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-18T01:50:44.961 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2024-09-18T01:50:44.961 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="22.04" 2024-09-18T01:50:44.961 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-18T01:50:44.961 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=jammy 2024-09-18T01:50:44.961 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2024-09-18T01:50:44.962 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2024-09-18T01:50:44.962 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-18T01:50:44.962 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-18T01:50:44.962 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-18T01:50:44.962 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-18T01:50:44.962 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=jammy 2024-09-18T01:50:44.962 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-09-18T01:50:44.984 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T01:50:44.992 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T01:50:45.017 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T01:50:45.017 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-18T01:50:45.020 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-09-18T01:50:45.024 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T01:50:45.041 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T01:50:45.042 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-18T01:50:45.068 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-09-18T01:50:45.078 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T01:50:45.132 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T01:50:45.146 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T01:50:45.146 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T01:50:45.146 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T01:50:45.147 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T01:50:45.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:50:45.151 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-18T01:50:45.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:50:45.152 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-18T01:50:45.199 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-56-generic 2024-09-18T01:50:45.200 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.15.0-56-generic 2024-09-18T01:50:45.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-09-18T01:50:45.201 INFO:teuthology.orchestra.run.smithi167.stdout:5.15.0-56-generic 2024-09-18T01:50:45.201 INFO:teuthology.task.kernel:Running kernel on smithi167: 5.15.0-56-generic 2024-09-18T01:50:45.202 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get clean 2024-09-18T01:50:45.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-18T01:50:45.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get update 2024-09-18T01:50:45.462 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T01:50:45.464 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-18T01:50:45.466 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-18T01:50:45.469 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T01:50:45.469 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-18T01:50:45.471 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-18T01:50:45.541 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-18T01:50:45.549 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-18T01:50:45.686 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-18T01:50:45.711 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-18T01:50:45.757 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-18T01:50:45.757 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-18T01:50:45.783 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-18T01:50:45.795 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-18T01:50:45.798 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-18T01:50:45.798 INFO:teuthology.orchestra.run.smithi167.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-18T01:50:45.798 INFO:teuthology.orchestra.run.smithi167.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-18T01:50:45.811 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-18T01:50:45.816 INFO:teuthology.orchestra.run.smithi167.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-18T01:50:45.817 INFO:teuthology.orchestra.run.smithi167.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-18T01:50:45.818 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-18T01:50:45.819 INFO:teuthology.orchestra.run.smithi167.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-18T01:50:45.820 INFO:teuthology.orchestra.run.smithi167.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-18T01:50:45.821 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-18T01:50:45.822 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-18T01:50:45.823 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-18T01:50:45.824 INFO:teuthology.orchestra.run.smithi167.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-18T01:50:45.829 INFO:teuthology.orchestra.run.smithi167.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-18T01:50:45.844 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-18T01:50:45.850 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-18T01:50:45.853 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-18T01:50:45.853 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-18T01:50:45.859 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-18T01:50:45.862 INFO:teuthology.orchestra.run.smithi167.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-18T01:50:45.862 INFO:teuthology.orchestra.run.smithi167.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-18T01:50:45.862 INFO:teuthology.orchestra.run.smithi167.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-18T01:50:45.862 INFO:teuthology.orchestra.run.smithi167.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-18T01:50:45.863 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-18T01:50:45.863 INFO:teuthology.orchestra.run.smithi167.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-18T01:50:45.864 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-18T01:50:45.867 INFO:teuthology.orchestra.run.smithi167.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-18T01:50:45.867 INFO:teuthology.orchestra.run.smithi167.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-18T01:50:45.867 INFO:teuthology.orchestra.run.smithi167.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-18T01:50:45.868 INFO:teuthology.orchestra.run.smithi167.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-18T01:50:45.909 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-18T01:50:45.909 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-18T01:50:45.909 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-18T01:50:45.910 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-18T01:50:45.910 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-18T01:50:45.916 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-18T01:50:45.916 INFO:teuthology.orchestra.run.smithi167.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-18T01:50:45.917 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-18T01:50:45.920 INFO:teuthology.orchestra.run.smithi167.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-18T01:50:45.920 INFO:teuthology.orchestra.run.smithi167.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-18T01:50:45.927 INFO:teuthology.orchestra.run.smithi167.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-18T01:50:45.932 INFO:teuthology.orchestra.run.smithi167.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-18T01:50:45.934 INFO:teuthology.orchestra.run.smithi167.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-18T01:50:45.934 INFO:teuthology.orchestra.run.smithi167.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-18T01:50:45.935 INFO:teuthology.orchestra.run.smithi167.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-18T01:50:45.949 INFO:teuthology.orchestra.run.smithi167.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-18T01:50:45.949 INFO:teuthology.orchestra.run.smithi167.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-18T01:50:45.952 INFO:teuthology.orchestra.run.smithi167.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-18T01:50:45.952 INFO:teuthology.orchestra.run.smithi167.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-18T01:50:45.953 INFO:teuthology.orchestra.run.smithi167.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-18T01:50:45.953 INFO:teuthology.orchestra.run.smithi167.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-18T01:50:45.956 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-18T01:50:45.968 INFO:teuthology.orchestra.run.smithi167.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-18T01:50:45.969 INFO:teuthology.orchestra.run.smithi167.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-18T01:50:45.969 INFO:teuthology.orchestra.run.smithi167.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-18T01:50:45.969 INFO:teuthology.orchestra.run.smithi167.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-18T01:50:45.982 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-18T01:50:45.989 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-18T01:50:45.992 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-18T01:50:46.010 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-18T01:50:46.022 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-18T01:50:46.031 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-18T01:50:46.036 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-18T01:50:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-18T01:50:46.047 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-18T01:50:46.048 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-18T01:50:46.048 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-18T01:50:46.049 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-18T01:50:46.050 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-18T01:50:46.053 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-18T01:50:46.070 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-18T01:50:46.071 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-18T01:50:46.071 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-18T01:50:46.072 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-18T01:50:52.053 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 16.2 MB in 2s (7,461 kB/s) 2024-09-18T01:50:52.232 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 16.2 MB in 2s (7,639 kB/s) 2024-09-18T01:50:53.393 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-18T01:50:53.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-18T01:50:53.478 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-18T01:50:53.668 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-18T01:50:53.669 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-18T01:50:53.837 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T01:50:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T01:50:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T01:50:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T01:50:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-18T01:50:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: python2.7-minimal 2024-09-18T01:50:53.838 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T01:50:53.839 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-09-18T01:50:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-18T01:50:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-18T01:50:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-18T01:50:53.841 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-09-18T01:50:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-18T01:50:53.841 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-09-18T01:50:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: thermald 2024-09-18T01:50:53.886 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-09-18T01:50:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-18T01:50:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-18T01:50:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-18T01:50:53.887 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2024-09-18T01:50:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-18T01:50:53.911 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-18T01:50:53.930 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-18T01:50:53.939 INFO:teuthology.orchestra.run.smithi081.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-18T01:50:53.939 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 113 MB of archives. 2024-09-18T01:50:53.939 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-18T01:50:53.939 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-18T01:50:53.993 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-18T01:50:54.203 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2024-09-18T01:50:54.204 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2024-09-18T01:50:54.385 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T01:50:54.385 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T01:50:54.385 INFO:teuthology.orchestra.run.smithi167.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T01:50:54.386 INFO:teuthology.orchestra.run.smithi167.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T01:50:54.386 INFO:teuthology.orchestra.run.smithi167.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-18T01:50:54.386 INFO:teuthology.orchestra.run.smithi167.stdout: python2.7-minimal 2024-09-18T01:50:54.386 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T01:50:54.387 INFO:teuthology.orchestra.run.smithi167.stdout:The following additional packages will be installed: 2024-09-18T01:50:54.387 INFO:teuthology.orchestra.run.smithi167.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-18T01:50:54.387 INFO:teuthology.orchestra.run.smithi167.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-18T01:50:54.387 INFO:teuthology.orchestra.run.smithi167.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-18T01:50:54.389 INFO:teuthology.orchestra.run.smithi167.stdout:Suggested packages: 2024-09-18T01:50:54.389 INFO:teuthology.orchestra.run.smithi167.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-18T01:50:54.389 INFO:teuthology.orchestra.run.smithi167.stdout:Recommended packages: 2024-09-18T01:50:54.389 INFO:teuthology.orchestra.run.smithi167.stdout: thermald 2024-09-18T01:50:54.391 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-18T01:50:54.436 INFO:teuthology.orchestra.run.smithi167.stdout:The following NEW packages will be installed: 2024-09-18T01:50:54.436 INFO:teuthology.orchestra.run.smithi167.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-18T01:50:54.436 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-18T01:50:54.437 INFO:teuthology.orchestra.run.smithi167.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-18T01:50:54.438 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages will be upgraded: 2024-09-18T01:50:54.438 INFO:teuthology.orchestra.run.smithi167.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-18T01:50:54.494 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-18T01:50:54.617 INFO:teuthology.orchestra.run.smithi167.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-18T01:50:54.617 INFO:teuthology.orchestra.run.smithi167.stdout:Need to get 113 MB of archives. 2024-09-18T01:50:54.617 INFO:teuthology.orchestra.run.smithi167.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-18T01:50:54.618 INFO:teuthology.orchestra.run.smithi167.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-18T01:50:55.329 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-18T01:50:55.329 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-18T01:50:55.329 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-18T01:50:55.454 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-18T01:50:55.476 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-18T01:50:55.848 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 113 MB in 2s (71.6 MB/s) 2024-09-18T01:50:56.015 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-18T01:50:56.022 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-18T01:50:56.361 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-18T01:50:58.113 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-18T01:50:58.117 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T01:50:58.287 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:50:58.566 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-18T01:50:58.566 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-18T01:50:58.566 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-18T01:50:58.915 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-18T01:50:59.000 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-18T01:50:59.414 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 113 MB in 5s (24.9 MB/s) 2024-09-18T01:50:59.593 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-18T01:51:00.730 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-18T01:51:00.751 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T01:51:00.829 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:01.308 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-18T01:51:01.329 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T01:51:01.366 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:01.625 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-18T01:51:01.631 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T01:51:01.733 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:03.902 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-18T01:51:03.923 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T01:51:04.017 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:04.575 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-18T01:51:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T01:51:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:07.894 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T01:51:08.004 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T01:51:08.363 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T01:51:08.491 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T01:51:08.811 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-18T01:51:08.833 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-18T01:51:08.885 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-18T01:51:11.702 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T01:51:11.810 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T01:51:12.151 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T01:51:12.263 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T01:51:12.558 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-18T01:51:12.580 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-18T01:51:12.625 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-18T01:51:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-18T01:51:14.522 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T01:51:14.560 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:17.308 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T01:51:17.431 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T01:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-18T01:51:17.895 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:17.996 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-18T01:51:18.099 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:18.384 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-18T01:51:18.421 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-18T01:51:18.459 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:19.411 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-18T01:51:19.412 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-18T01:51:19.412 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-18T01:51:19.412 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-18T01:51:19.584 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:20.977 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-18T01:51:21.987 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-18T01:51:22.496 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-18T01:51:22.798 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-18T01:51:23.182 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-18T01:51:23.303 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:23.421 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-18T01:51:23.568 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:23.848 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-18T01:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-18T01:51:24.884 INFO:teuthology.orchestra.run.smithi167.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-18T01:51:24.885 INFO:teuthology.orchestra.run.smithi167.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-18T01:51:24.885 INFO:teuthology.orchestra.run.smithi167.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-18T01:51:24.885 INFO:teuthology.orchestra.run.smithi167.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-18T01:51:25.043 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:26.478 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-18T01:51:26.579 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-18T01:51:26.705 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:28.291 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-18T01:51:28.375 INFO:teuthology.orchestra.run.smithi167.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-18T01:51:28.375 INFO:teuthology.orchestra.run.smithi167.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-18T01:51:38.463 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-18T01:51:38.464 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub' 2024-09-18T01:51:38.469 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-18T01:51:38.491 INFO:teuthology.orchestra.run.smithi081.stdout:Generating grub configuration file ... 2024-09-18T01:51:38.841 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-18T01:51:38.864 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-18T01:51:39.251 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-18T01:51:39.257 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-18T01:51:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-18T01:51:39.328 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-18T01:51:39.489 INFO:teuthology.orchestra.run.smithi081.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-18T01:51:39.489 INFO:teuthology.orchestra.run.smithi081.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-18T01:51:39.490 INFO:teuthology.orchestra.run.smithi081.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-18T01:51:39.528 INFO:teuthology.orchestra.run.smithi081.stdout:done 2024-09-18T01:51:40.006 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-09-18T01:51:40.026 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-09-18T01:51:40.026 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-09-18T01:51:40.026 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-09-18T01:51:40.026 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-09-18T01:51:40.026 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-09-18T01:51:40.026 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-09-18T01:51:40.027 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-09-18T01:51:40.027 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-09-18T01:51:40.027 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.122.122 2024-09-18T01:51:40.027 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-18T01:51:40.027 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-18T01:51:40.027 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-09-18T01:51:40.027 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-09-18T01:51:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-09-18T01:51:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-09-18T01:51:40.027 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-18T01:51:40.028 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T01:51:40.028 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T01:51:40.028 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-18T01:51:40.028 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T01:51:40.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-09-18T01:51:40.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-18T01:51:40.343 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T01:51:40.352 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-18T01:51:40.355 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-18T01:51:40.369 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-18T01:51:41.777 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-18T01:51:41.795 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-18T01:51:41.858 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-18T01:51:42.068 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-18T01:51:42.069 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-18T01:51:42.262 INFO:teuthology.orchestra.run.smithi081.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-18T01:51:42.262 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T01:51:42.262 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T01:51:42.262 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T01:51:42.262 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T01:51:42.263 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-18T01:51:42.263 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-18T01:51:42.263 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T01:51:42.302 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-18T01:51:42.304 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-09-18T01:51:42.311 INFO:teuthology.orchestra.run.smithi167.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-18T01:51:42.311 INFO:teuthology.orchestra.run.smithi167.stdout:Sourcing file `/etc/default/grub' 2024-09-18T01:51:42.319 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-09-18T01:51:42.319 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-09-18T01:51:42.319 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-09-18T01:51:42.320 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-09-18T01:51:42.320 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-09-18T01:51:42.321 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-09-18T01:51:42.321 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-09-18T01:51:42.321 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-09-18T01:51:42.321 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.122.122 2024-09-18T01:51:42.321 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-18T01:51:42.321 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-18T01:51:42.321 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-09-18T01:51:42.321 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-09-18T01:51:42.321 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-09-18T01:51:42.321 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-09-18T01:51:42.322 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-18T01:51:42.322 INFO:teuthology.orchestra.run.smithi167.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-18T01:51:42.343 INFO:teuthology.orchestra.run.smithi167.stdout:Generating grub configuration file ... 2024-09-18T01:51:42.366 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.lxhYGwalpf 2024-09-18T01:51:42.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lxhYGwalpf 2024-09-18T01:51:42.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.lxhYGwalpf 2024-09-18T01:51:42.542 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.lxhYGwalpf is 10KB 2024-09-18T01:51:42.555 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.lxhYGwalpf 2024-09-18T01:51:42.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-18T01:51:42.614 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T01:51:42.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-18T01:51:42.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-18T01:51:42.678 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-18T01:51:42.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo update-grub 2024-09-18T01:51:42.705 INFO:teuthology.orchestra.run.smithi167.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-18T01:51:42.721 INFO:teuthology.orchestra.run.smithi167.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-18T01:51:43.127 INFO:teuthology.orchestra.run.smithi167.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-18T01:51:43.132 INFO:teuthology.orchestra.run.smithi167.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-18T01:51:43.201 INFO:teuthology.orchestra.run.smithi167.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-18T01:51:43.207 INFO:teuthology.orchestra.run.smithi167.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-18T01:51:43.352 INFO:teuthology.orchestra.run.smithi167.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-18T01:51:43.353 INFO:teuthology.orchestra.run.smithi167.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-18T01:51:43.353 INFO:teuthology.orchestra.run.smithi167.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-18T01:51:43.395 INFO:teuthology.orchestra.run.smithi167.stdout:done 2024-09-18T01:51:43.884 DEBUG:teuthology.orchestra.run.smithi167:> dpkg -s linux-image-generic 2024-09-18T01:51:43.913 INFO:teuthology.orchestra.run.smithi167.stdout:Package: linux-image-generic 2024-09-18T01:51:43.913 INFO:teuthology.orchestra.run.smithi167.stdout:Status: install ok installed 2024-09-18T01:51:43.913 INFO:teuthology.orchestra.run.smithi167.stdout:Priority: optional 2024-09-18T01:51:43.913 INFO:teuthology.orchestra.run.smithi167.stdout:Section: kernel 2024-09-18T01:51:43.913 INFO:teuthology.orchestra.run.smithi167.stdout:Installed-Size: 21 2024-09-18T01:51:43.913 INFO:teuthology.orchestra.run.smithi167.stdout:Maintainer: Ubuntu Kernel Team 2024-09-18T01:51:43.913 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: amd64 2024-09-18T01:51:43.913 INFO:teuthology.orchestra.run.smithi167.stdout:Source: linux-meta 2024-09-18T01:51:43.914 INFO:teuthology.orchestra.run.smithi167.stdout:Version: 5.15.0.122.122 2024-09-18T01:51:43.914 INFO:teuthology.orchestra.run.smithi167.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-18T01:51:43.914 INFO:teuthology.orchestra.run.smithi167.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-18T01:51:43.914 INFO:teuthology.orchestra.run.smithi167.stdout:Recommends: thermald 2024-09-18T01:51:43.914 INFO:teuthology.orchestra.run.smithi167.stdout:Description: Generic Linux kernel image 2024-09-18T01:51:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: This package will always depend on the latest generic kernel image 2024-09-18T01:51:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: available. 2024-09-18T01:51:43.914 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-18T01:51:43.914 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T01:51:43.914 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T01:51:43.914 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-18T01:51:43.914 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T01:51:43.915 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get clean 2024-09-18T01:51:43.919 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub' 2024-09-18T01:51:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-18T01:51:43.922 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-18T01:51:44.057 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get update 2024-09-18T01:51:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-18T01:51:44.109 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-18T01:51:44.299 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T01:51:44.300 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-18T01:51:44.372 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-18T01:51:44.388 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-18T01:51:44.393 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-18T01:51:44.436 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-18T01:51:44.441 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-18T01:51:44.559 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-18T01:51:44.560 INFO:teuthology.orchestra.run.smithi081.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-18T01:51:44.560 INFO:teuthology.orchestra.run.smithi081.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-18T01:51:44.586 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-18T01:51:44.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-18T01:51:44.730 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-18T01:51:44.929 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 257 kB in 1s (353 kB/s) 2024-09-18T01:51:45.947 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-18T01:51:45.965 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-18T01:51:46.024 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-18T01:51:46.220 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2024-09-18T01:51:46.221 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2024-09-18T01:51:46.388 INFO:teuthology.orchestra.run.smithi167.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-18T01:51:46.388 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T01:51:46.388 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T01:51:46.388 INFO:teuthology.orchestra.run.smithi167.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T01:51:46.388 INFO:teuthology.orchestra.run.smithi167.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T01:51:46.389 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-18T01:51:46.389 INFO:teuthology.orchestra.run.smithi167.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-18T01:51:46.389 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T01:51:46.430 INFO:teuthology.orchestra.run.smithi167.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-18T01:51:46.432 DEBUG:teuthology.orchestra.run.smithi167:> dpkg -s linux-image-generic 2024-09-18T01:51:46.444 INFO:teuthology.orchestra.run.smithi167.stdout:Package: linux-image-generic 2024-09-18T01:51:46.444 INFO:teuthology.orchestra.run.smithi167.stdout:Status: install ok installed 2024-09-18T01:51:46.444 INFO:teuthology.orchestra.run.smithi167.stdout:Priority: optional 2024-09-18T01:51:46.444 INFO:teuthology.orchestra.run.smithi167.stdout:Section: kernel 2024-09-18T01:51:46.444 INFO:teuthology.orchestra.run.smithi167.stdout:Installed-Size: 21 2024-09-18T01:51:46.444 INFO:teuthology.orchestra.run.smithi167.stdout:Maintainer: Ubuntu Kernel Team 2024-09-18T01:51:46.444 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: amd64 2024-09-18T01:51:46.445 INFO:teuthology.orchestra.run.smithi167.stdout:Source: linux-meta 2024-09-18T01:51:46.445 INFO:teuthology.orchestra.run.smithi167.stdout:Version: 5.15.0.122.122 2024-09-18T01:51:46.445 INFO:teuthology.orchestra.run.smithi167.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-18T01:51:46.445 INFO:teuthology.orchestra.run.smithi167.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-18T01:51:46.445 INFO:teuthology.orchestra.run.smithi167.stdout:Recommends: thermald 2024-09-18T01:51:46.445 INFO:teuthology.orchestra.run.smithi167.stdout:Description: Generic Linux kernel image 2024-09-18T01:51:46.445 INFO:teuthology.orchestra.run.smithi167.stdout: This package will always depend on the latest generic kernel image 2024-09-18T01:51:46.445 INFO:teuthology.orchestra.run.smithi167.stdout: available. 2024-09-18T01:51:46.445 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-18T01:51:46.492 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.F6d9uPgwDJ 2024-09-18T01:51:46.492 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub/grub.cfg /tmp/tmp.F6d9uPgwDJ 2024-09-18T01:51:46.542 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.F6d9uPgwDJ 2024-09-18T01:51:46.651 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.F6d9uPgwDJ is 10KB 2024-09-18T01:51:46.702 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.F6d9uPgwDJ 2024-09-18T01:51:46.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-18T01:51:46.760 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T01:51:46.760 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-18T01:51:46.760 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-18T01:51:46.836 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-18T01:51:46.836 DEBUG:teuthology.orchestra.run.smithi167:> sudo update-grub 2024-09-18T01:51:48.115 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub' 2024-09-18T01:51:48.115 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-18T01:51:48.117 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2024-09-18T01:51:48.298 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-18T01:51:48.304 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-18T01:51:48.617 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-18T01:51:48.623 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-18T01:51:48.666 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-18T01:51:48.671 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-18T01:51:48.785 INFO:teuthology.orchestra.run.smithi167.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-18T01:51:48.785 INFO:teuthology.orchestra.run.smithi167.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-18T01:51:48.785 INFO:teuthology.orchestra.run.smithi167.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-18T01:51:48.808 INFO:teuthology.orchestra.run.smithi167.stderr:done 2024-09-18T01:51:48.817 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2024-09-18T01:52:14.605 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-18T01:52:14.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T01:52:14.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:52:18.821 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-18T01:52:18.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T01:52:18.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:52:53.309 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-18T01:53:02.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T01:53:02.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:53:14.621 DEBUG:teuthology.orchestra.remote:timed out 2024-09-18T01:53:20.705 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-18T01:53:23.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T01:53:23.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:53:24.073 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-18T01:53:24.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T01:53:24.800 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-18T01:53:24.801 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-18T01:53:24.846 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-122-generic 2024-09-18T01:53:24.846 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-18T01:53:24.846 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T01:53:24.846 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-18T01:53:25.847 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-18T01:53:25.847 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T01:53:26.027 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-09-18T01:53:26.052 DEBUG:teuthology.parallel:result is None 2024-09-18T01:53:32.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T01:53:32.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:53:32.708 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-18T01:53:47.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T01:53:47.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:53:48.012 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-18T01:53:48.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T01:53:48.635 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-122-generic"... 2024-09-18T01:53:48.635 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-18T01:53:48.682 INFO:teuthology.orchestra.run.smithi167.stdout:5.15.0-122-generic 2024-09-18T01:53:48.683 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-18T01:53:48.683 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T01:53:48.683 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-18T01:53:49.684 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-18T01:53:49.684 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T01:53:50.049 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2024-09-18T01:53:50.076 DEBUG:teuthology.parallel:result is None 2024-09-18T01:53:50.076 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T01:53:50.084 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T01:53:50.085 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T01:53:50.087 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T01:53:50.093 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T01:53:50.124 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T01:53:50.157 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T01:53:50.157 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T01:53:50.160 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T01:53:50.187 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T01:53:50.193 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T01:53:50.194 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T01:53:50.214 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T01:53:50.233 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:53:50.237 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:53:50.241 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:53:50.247 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:53:50.248 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T01:53:50.255 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T01:53:50.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T01:53:50.286 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T01:53:50.305 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T01:53:50.317 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T01:53:50.317 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T01:53:50.346 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T01:53:50.351 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T01:53:50.398 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T01:53:50.447 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T01:53:50.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T01:53:50.592 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T01:53:50.598 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T01:53:50.648 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T01:53:50.648 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T01:53:50.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-18T01:53:50.714 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-09-18T01:53:50.793 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T01:53:50.807 INFO:teuthology.task.internal:Starting timer... 2024-09-18T01:53:50.807 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T01:53:50.848 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T01:53:50.885 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2024-09-18T01:53:50.885 DEBUG:teuthology.task.selinux:Excluding smithi167: OS 'ubuntu' does not support SELinux 2024-09-18T01:53:50.885 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T01:53:50.885 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-18T01:53:50.885 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T01:53:50.885 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T01:53:50.914 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T01:53:50.925 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T01:53:50.926 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T02:01:18.725 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2024-09-18T02:01:18.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T02:01:18.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T02:01:18.809 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-18T02:01:18.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T02:01:18.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T02:01:18.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T02:01:18.965 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-18T02:01:19.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T02:01:19.041 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T02:01:19.051 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T02:01:19.051 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T02:01:19.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T02:01:19.054 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T02:01:19.054 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T02:01:19.082 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-18T02:01:19.083 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: Command line: ntpd -gq 2024-09-18T02:01:19.083 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: ---------------------------------------------------- 2024-09-18T02:01:19.083 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: ntp-4 is maintained by Network Time Foundation, 2024-09-18T02:01:19.083 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-18T02:01:19.083 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: corporation. Support and training for ntp-4 are 2024-09-18T02:01:19.083 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: available at https://www.nwtime.org/support 2024-09-18T02:01:19.083 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: ---------------------------------------------------- 2024-09-18T02:01:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: proto: precision = 0.060 usec (-24) 2024-09-18T02:01:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: basedate set to 2022-02-04 2024-09-18T02:01:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: gps base set to 2022-02-06 (week 2196) 2024-09-18T02:01:19.085 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-18T02:01:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-18T02:01:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: restrict ::: KOD does nothing without LIMITED. 2024-09-18T02:01:19.085 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-18T02:01:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: Listen and drop on 0 v6wildcard [::]:123 2024-09-18T02:01:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-18T02:01:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: Listen normally on 2 lo 127.0.0.1:123 2024-09-18T02:01:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2024-09-18T02:01:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: Listen normally on 4 lo [::1]:123 2024-09-18T02:01:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2024-09-18T02:01:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:19 ntpd[18462]: Listening on routing socket on fd #22 for interface updates 2024-09-18T02:01:19.109 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-18T02:01:19.110 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: Command line: ntpd -gq 2024-09-18T02:01:19.110 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: ---------------------------------------------------- 2024-09-18T02:01:19.110 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: ntp-4 is maintained by Network Time Foundation, 2024-09-18T02:01:19.110 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-18T02:01:19.110 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: corporation. Support and training for ntp-4 are 2024-09-18T02:01:19.110 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: available at https://www.nwtime.org/support 2024-09-18T02:01:19.110 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: ---------------------------------------------------- 2024-09-18T02:01:19.112 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: proto: precision = 0.063 usec (-24) 2024-09-18T02:01:19.113 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: basedate set to 2022-02-04 2024-09-18T02:01:19.113 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: gps base set to 2022-02-06 (week 2196) 2024-09-18T02:01:19.113 INFO:teuthology.orchestra.run.smithi167.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-18T02:01:19.113 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-18T02:01:19.113 INFO:teuthology.orchestra.run.smithi167.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-18T02:01:19.115 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: restrict ::: KOD does nothing without LIMITED. 2024-09-18T02:01:19.115 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: Listen and drop on 0 v6wildcard [::]:123 2024-09-18T02:01:19.115 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-18T02:01:19.115 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: Listen normally on 2 lo 127.0.0.1:123 2024-09-18T02:01:19.116 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: Listen normally on 3 enp3s0f1 172.21.15.167:123 2024-09-18T02:01:19.116 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: Listen normally on 4 lo [::1]:123 2024-09-18T02:01:19.116 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7309%5]:123 2024-09-18T02:01:19.116 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:19 ntpd[18455]: Listening on routing socket on fd #22 for interface updates 2024-09-18T02:01:20.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:20.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:20.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:20.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:20.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:20.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:20 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:20.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:20.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:20.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:20.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:20.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:20.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:20.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:20.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:20.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:20.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:20.113 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:20.113 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:20 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:22.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:22.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:22 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:22.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:22 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:24 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:24.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:24.113 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:24.113 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.113 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.113 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:24.113 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:24.113 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:24.113 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:24.113 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:24.113 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:24 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:26.083 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:26.085 INFO:teuthology.orchestra.run.smithi081.stdout:18 Sep 02:01:26 ntpd[18462]: ntpd: time slew -0.003800 s 2024-09-18T02:01:26.085 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time slew -0.003800s 2024-09-18T02:01:26.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-18T02:01:26.085 INFO:teuthology.orchestra.run.smithi081.stderr:18 Sep 02:01:26 ntpd[18462]: can't open /var/log/ntpstats/loopstats.20240918: Permission denied 2024-09-18T02:01:26.110 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:26.110 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:26.110 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:26.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:26.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:26.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:26.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T02:01:26.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T02:01:26.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T02:01:26.111 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T02:01:26.111 INFO:teuthology.orchestra.run.smithi167.stdout:18 Sep 02:01:26 ntpd[18455]: ntpd: time slew -0.003392 s 2024-09-18T02:01:26.111 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd: time slew -0.003392s 2024-09-18T02:01:26.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-18T02:01:26.112 INFO:teuthology.orchestra.run.smithi167.stderr:18 Sep 02:01:26 ntpd[18455]: can't open /var/log/ntpstats/loopstats.20240918: Permission denied 2024-09-18T02:01:26.132 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-09-18T02:01:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-09-18T02:01:26.132 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T02:01:26.132 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T02:01:26.132 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T02:01:26.132 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T02:01:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: remote refid st t when poll reach delay offset jitter 2024-09-18T02:01:26.156 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================== 2024-09-18T02:01:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T02:01:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T02:01:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T02:01:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T02:01:26.158 INFO:teuthology.run_tasks:Running task install... 2024-09-18T02:01:26.173 DEBUG:teuthology.task.install:project ceph 2024-09-18T02:01:26.173 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}} 2024-09-18T02:01:26.173 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-18T02:01:26.173 INFO:teuthology.task.install:Using flavor: default 2024-09-18T02:01:26.179 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T02:01:26.179 INFO:teuthology.task.install:extra packages: [] 2024-09-18T02:01:26.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2024-09-18T02:01:26.180 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-key list | grep Ceph 2024-09-18T02:01:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-18T02:01:26.262 INFO:teuthology.orchestra.run.smithi167.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-18T02:01:26.263 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-18T02:01:26.263 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2024-09-18T02:01:26.264 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-18T02:01:26.265 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T02:01:26.298 INFO:teuthology.orchestra.run.smithi167.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-18T02:01:26.298 INFO:teuthology.orchestra.run.smithi167.stdout:uid [ unknown] Ceph.com (release key) 2024-09-18T02:01:26.298 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-18T02:01:26.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T02:01:26.404 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default/ 2024-09-18T02:01:26.404 INFO:teuthology.task.install.deb:Package version is 19.1.1-330-gc2ddf972-1jammy 2024-09-18T02:01:26.436 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default/ 2024-09-18T02:01:26.437 INFO:teuthology.task.install.deb:Package version is 19.1.1-330-gc2ddf972-1jammy 2024-09-18T02:01:26.515 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:01:26.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-18T02:01:26.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-18T02:01:26.546 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:01:26.546 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-18T02:01:26.560 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get update 2024-09-18T02:01:26.695 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-18T02:01:26.750 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-18T02:01:26.771 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-18T02:01:26.783 INFO:teuthology.orchestra.run.smithi167.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-18T02:01:26.792 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-18T02:01:26.805 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-18T02:01:26.814 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-18T02:01:26.828 INFO:teuthology.orchestra.run.smithi167.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-18T02:01:26.836 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T02:01:26.842 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-09-18T02:01:26.858 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-18T02:01:26.858 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-18T02:01:26.858 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-09-18T02:01:26.887 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-18T02:01:26.918 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-18T02:01:26.930 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-18T02:01:27.000 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-18T02:01:27.013 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-18T02:01:27.140 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 28.9 kB in 0s (67.8 kB/s) 2024-09-18T02:01:27.239 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 28.9 kB in 0s (59.0 kB/s) 2024-09-18T02:01:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-18T02:01:28.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-330-gc2ddf972-1jammy cephadm=19.1.1-330-gc2ddf972-1jammy ceph-mds=19.1.1-330-gc2ddf972-1jammy ceph-mgr=19.1.1-330-gc2ddf972-1jammy ceph-common=19.1.1-330-gc2ddf972-1jammy ceph-fuse=19.1.1-330-gc2ddf972-1jammy ceph-test=19.1.1-330-gc2ddf972-1jammy ceph-volume=19.1.1-330-gc2ddf972-1jammy radosgw=19.1.1-330-gc2ddf972-1jammy python3-rados=19.1.1-330-gc2ddf972-1jammy python3-rgw=19.1.1-330-gc2ddf972-1jammy python3-cephfs=19.1.1-330-gc2ddf972-1jammy python3-rbd=19.1.1-330-gc2ddf972-1jammy libcephfs2=19.1.1-330-gc2ddf972-1jammy libcephfs-dev=19.1.1-330-gc2ddf972-1jammy librados2=19.1.1-330-gc2ddf972-1jammy librbd1=19.1.1-330-gc2ddf972-1jammy rbd-fuse=19.1.1-330-gc2ddf972-1jammy 2024-09-18T02:01:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-18T02:01:28.304 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-18T02:01:28.321 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-330-gc2ddf972-1jammy cephadm=19.1.1-330-gc2ddf972-1jammy ceph-mds=19.1.1-330-gc2ddf972-1jammy ceph-mgr=19.1.1-330-gc2ddf972-1jammy ceph-common=19.1.1-330-gc2ddf972-1jammy ceph-fuse=19.1.1-330-gc2ddf972-1jammy ceph-test=19.1.1-330-gc2ddf972-1jammy ceph-volume=19.1.1-330-gc2ddf972-1jammy radosgw=19.1.1-330-gc2ddf972-1jammy python3-rados=19.1.1-330-gc2ddf972-1jammy python3-rgw=19.1.1-330-gc2ddf972-1jammy python3-cephfs=19.1.1-330-gc2ddf972-1jammy python3-rbd=19.1.1-330-gc2ddf972-1jammy libcephfs2=19.1.1-330-gc2ddf972-1jammy libcephfs-dev=19.1.1-330-gc2ddf972-1jammy librados2=19.1.1-330-gc2ddf972-1jammy librbd1=19.1.1-330-gc2ddf972-1jammy rbd-fuse=19.1.1-330-gc2ddf972-1jammy 2024-09-18T02:01:28.376 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-09-18T02:01:28.413 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-18T02:01:28.414 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-18T02:01:28.563 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2024-09-18T02:01:28.564 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2024-09-18T02:01:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T02:01:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T02:01:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T02:01:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T02:01:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-18T02:01:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-18T02:01:28.626 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T02:01:28.626 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-09-18T02:01:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-18T02:01:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-18T02:01:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-18T02:01:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-18T02:01:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-18T02:01:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-18T02:01:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-18T02:01:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-18T02:01:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-18T02:01:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-18T02:01:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-18T02:01:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-18T02:01:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet zip 2024-09-18T02:01:28.630 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-09-18T02:01:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-18T02:01:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-18T02:01:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-18T02:01:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-18T02:01:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-18T02:01:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-18T02:01:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-18T02:01:28.631 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-09-18T02:01:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: btrfs-tools 2024-09-18T02:01:28.733 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-09-18T02:01:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-18T02:01:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-18T02:01:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-18T02:01:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-18T02:01:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-18T02:01:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-18T02:01:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-18T02:01:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-18T02:01:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-18T02:01:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-18T02:01:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-18T02:01:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-18T02:01:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-18T02:01:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-18T02:01:28.749 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T02:01:28.749 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-18T02:01:28.749 INFO:teuthology.orchestra.run.smithi167.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-18T02:01:28.749 INFO:teuthology.orchestra.run.smithi167.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-18T02:01:28.750 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-18T02:01:28.750 INFO:teuthology.orchestra.run.smithi167.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-18T02:01:28.750 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T02:01:28.750 INFO:teuthology.orchestra.run.smithi167.stdout:The following additional packages will be installed: 2024-09-18T02:01:28.750 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-18T02:01:28.751 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-18T02:01:28.751 INFO:teuthology.orchestra.run.smithi167.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-18T02:01:28.751 INFO:teuthology.orchestra.run.smithi167.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-18T02:01:28.752 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-18T02:01:28.752 INFO:teuthology.orchestra.run.smithi167.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-18T02:01:28.752 INFO:teuthology.orchestra.run.smithi167.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-18T02:01:28.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-18T02:01:28.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-18T02:01:28.752 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-18T02:01:28.753 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet zip 2024-09-18T02:01:28.754 INFO:teuthology.orchestra.run.smithi167.stdout:Suggested packages: 2024-09-18T02:01:28.754 INFO:teuthology.orchestra.run.smithi167.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-18T02:01:28.754 INFO:teuthology.orchestra.run.smithi167.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-18T02:01:28.754 INFO:teuthology.orchestra.run.smithi167.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-18T02:01:28.754 INFO:teuthology.orchestra.run.smithi167.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-18T02:01:28.754 INFO:teuthology.orchestra.run.smithi167.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-18T02:01:28.754 INFO:teuthology.orchestra.run.smithi167.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-18T02:01:28.754 INFO:teuthology.orchestra.run.smithi167.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-18T02:01:28.754 INFO:teuthology.orchestra.run.smithi167.stdout:Recommended packages: 2024-09-18T02:01:28.754 INFO:teuthology.orchestra.run.smithi167.stdout: btrfs-tools 2024-09-18T02:01:28.793 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-18T02:01:28.793 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 181 MB of archives. 2024-09-18T02:01:28.793 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-18T02:01:28.793 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-18T02:01:28.856 INFO:teuthology.orchestra.run.smithi167.stdout:The following NEW packages will be installed: 2024-09-18T02:01:28.856 INFO:teuthology.orchestra.run.smithi167.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-18T02:01:28.856 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-18T02:01:28.856 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-18T02:01:28.856 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-18T02:01:28.856 INFO:teuthology.orchestra.run.smithi167.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-18T02:01:28.856 INFO:teuthology.orchestra.run.smithi167.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-18T02:01:28.857 INFO:teuthology.orchestra.run.smithi167.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-18T02:01:28.858 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-18T02:01:28.859 INFO:teuthology.orchestra.run.smithi167.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-18T02:01:28.859 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-18T02:01:28.859 INFO:teuthology.orchestra.run.smithi167.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-18T02:01:28.859 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-18T02:01:28.859 INFO:teuthology.orchestra.run.smithi167.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-18T02:01:28.873 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-330-gc2ddf972-1jammy [3,591 kB] 2024-09-18T02:01:28.880 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-18T02:01:28.883 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-18T02:01:28.900 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-18T02:01:28.959 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-18T02:01:28.963 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-18T02:01:28.975 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-18T02:01:28.979 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-18T02:01:28.980 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-18T02:01:28.981 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-18T02:01:28.989 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-18T02:01:28.991 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-18T02:01:28.993 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-18T02:01:28.995 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-18T02:01:28.997 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-18T02:01:29.000 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-18T02:01:29.009 INFO:teuthology.orchestra.run.smithi167.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-18T02:01:29.009 INFO:teuthology.orchestra.run.smithi167.stdout:Need to get 181 MB of archives. 2024-09-18T02:01:29.009 INFO:teuthology.orchestra.run.smithi167.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-18T02:01:29.009 INFO:teuthology.orchestra.run.smithi167.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-330-gc2ddf972-1jammy [3,591 kB] 2024-09-18T02:01:29.013 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-18T02:01:29.014 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-18T02:01:29.015 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-18T02:01:29.015 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-18T02:01:29.016 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-18T02:01:29.017 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-18T02:01:29.017 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-18T02:01:29.017 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-18T02:01:29.031 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-18T02:01:29.032 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-18T02:01:29.045 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-18T02:01:29.048 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-18T02:01:29.051 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-18T02:01:29.053 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-18T02:01:29.053 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-18T02:01:29.053 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-18T02:01:29.054 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-18T02:01:29.054 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-18T02:01:29.054 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-18T02:01:29.061 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-330-gc2ddf972-1jammy [3,242 kB] 2024-09-18T02:01:29.066 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-18T02:01:29.066 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-18T02:01:29.082 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-18T02:01:29.088 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-18T02:01:29.088 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-18T02:01:29.088 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-18T02:01:29.089 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-18T02:01:29.090 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-18T02:01:29.092 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-18T02:01:29.093 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-18T02:01:29.099 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-18T02:01:29.100 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-18T02:01:29.112 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-330-gc2ddf972-1jammy [719 kB] 2024-09-18T02:01:29.116 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-18T02:01:29.117 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-18T02:01:29.118 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-18T02:01:29.120 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-18T02:01:29.123 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-330-gc2ddf972-1jammy [356 kB] 2024-09-18T02:01:29.129 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-330-gc2ddf972-1jammy [32.8 kB] 2024-09-18T02:01:29.130 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-330-gc2ddf972-1jammy [180 kB] 2024-09-18T02:01:29.133 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-330-gc2ddf972-1jammy [67.8 kB] 2024-09-18T02:01:29.137 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-330-gc2ddf972-1jammy [333 kB] 2024-09-18T02:01:29.143 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-330-gc2ddf972-1jammy [6,875 kB] 2024-09-18T02:01:29.173 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-18T02:01:29.174 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-18T02:01:29.175 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-18T02:01:29.175 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-18T02:01:29.176 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-18T02:01:29.193 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-18T02:01:29.195 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-18T02:01:29.195 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-18T02:01:29.209 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-18T02:01:29.210 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-18T02:01:29.210 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-18T02:01:29.211 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-18T02:01:29.211 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-18T02:01:29.211 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-18T02:01:29.226 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-18T02:01:29.227 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-18T02:01:29.230 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-18T02:01:29.243 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-18T02:01:29.245 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-18T02:01:29.245 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-18T02:01:29.248 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-18T02:01:29.250 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-18T02:01:29.251 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-18T02:01:29.251 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-18T02:01:29.260 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-18T02:01:29.261 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-18T02:01:29.263 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-18T02:01:29.275 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-330-gc2ddf972-1jammy [112 kB] 2024-09-18T02:01:29.277 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-18T02:01:29.277 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-330-gc2ddf972-1jammy [472 kB] 2024-09-18T02:01:29.278 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-18T02:01:29.278 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-18T02:01:29.279 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-18T02:01:29.280 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-18T02:01:29.284 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-330-gc2ddf972-1jammy [25.9 MB] 2024-09-18T02:01:29.286 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-18T02:01:29.286 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-18T02:01:29.294 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-18T02:01:29.296 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-18T02:01:29.297 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-18T02:01:29.464 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-18T02:01:29.476 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-18T02:01:29.529 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-330-gc2ddf972-1jammy [3,242 kB] 2024-09-18T02:01:29.557 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-18T02:01:29.786 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-18T02:01:29.797 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-18T02:01:29.827 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-18T02:01:29.835 INFO:teuthology.orchestra.run.smithi167.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-18T02:01:29.836 INFO:teuthology.orchestra.run.smithi167.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-18T02:01:29.838 INFO:teuthology.orchestra.run.smithi167.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-18T02:01:29.844 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-330-gc2ddf972-1jammy [5,145 kB] 2024-09-18T02:01:29.851 INFO:teuthology.orchestra.run.smithi167.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-330-gc2ddf972-1jammy [719 kB] 2024-09-18T02:01:29.856 INFO:teuthology.orchestra.run.smithi167.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-18T02:01:29.860 INFO:teuthology.orchestra.run.smithi167.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-18T02:01:29.864 INFO:teuthology.orchestra.run.smithi167.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-18T02:01:29.868 INFO:teuthology.orchestra.run.smithi167.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-18T02:01:29.885 INFO:teuthology.orchestra.run.smithi167.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-330-gc2ddf972-1jammy [356 kB] 2024-09-18T02:01:29.899 INFO:teuthology.orchestra.run.smithi167.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-330-gc2ddf972-1jammy [32.8 kB] 2024-09-18T02:01:29.900 INFO:teuthology.orchestra.run.smithi167.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-330-gc2ddf972-1jammy [180 kB] 2024-09-18T02:01:29.906 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-330-gc2ddf972-1jammy [245 kB] 2024-09-18T02:01:29.909 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-330-gc2ddf972-1jammy [124 kB] 2024-09-18T02:01:29.910 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-330-gc2ddf972-1jammy [1,555 kB] 2024-09-18T02:01:29.918 INFO:teuthology.orchestra.run.smithi167.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-330-gc2ddf972-1jammy [67.8 kB] 2024-09-18T02:01:29.924 INFO:teuthology.orchestra.run.smithi167.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-330-gc2ddf972-1jammy [333 kB] 2024-09-18T02:01:29.929 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-330-gc2ddf972-1jammy [6,143 kB] 2024-09-18T02:01:29.944 INFO:teuthology.orchestra.run.smithi167.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-330-gc2ddf972-1jammy [6,875 kB] 2024-09-18T02:01:29.949 INFO:teuthology.orchestra.run.smithi167.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-18T02:01:29.953 INFO:teuthology.orchestra.run.smithi167.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-18T02:01:29.957 INFO:teuthology.orchestra.run.smithi167.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-18T02:01:29.960 INFO:teuthology.orchestra.run.smithi167.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-18T02:01:29.961 INFO:teuthology.orchestra.run.smithi167.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-18T02:01:29.962 INFO:teuthology.orchestra.run.smithi167.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-18T02:01:29.964 INFO:teuthology.orchestra.run.smithi167.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-18T02:01:29.964 INFO:teuthology.orchestra.run.smithi167.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-18T02:01:29.965 INFO:teuthology.orchestra.run.smithi167.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-18T02:01:30.032 INFO:teuthology.orchestra.run.smithi167.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-18T02:01:30.048 INFO:teuthology.orchestra.run.smithi167.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-18T02:01:30.048 INFO:teuthology.orchestra.run.smithi167.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-18T02:01:30.049 INFO:teuthology.orchestra.run.smithi167.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-18T02:01:30.053 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-330-gc2ddf972-1jammy [22.8 MB] 2024-09-18T02:01:30.054 INFO:teuthology.orchestra.run.smithi167.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-18T02:01:30.055 INFO:teuthology.orchestra.run.smithi167.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-18T02:01:30.114 INFO:teuthology.orchestra.run.smithi167.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-18T02:01:30.114 INFO:teuthology.orchestra.run.smithi167.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-18T02:01:30.116 INFO:teuthology.orchestra.run.smithi167.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-18T02:01:30.117 INFO:teuthology.orchestra.run.smithi167.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-18T02:01:30.195 INFO:teuthology.orchestra.run.smithi167.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-18T02:01:30.197 INFO:teuthology.orchestra.run.smithi167.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-18T02:01:30.199 INFO:teuthology.orchestra.run.smithi167.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-18T02:01:30.199 INFO:teuthology.orchestra.run.smithi167.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-18T02:01:30.210 INFO:teuthology.orchestra.run.smithi167.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-18T02:01:30.277 INFO:teuthology.orchestra.run.smithi167.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-18T02:01:30.278 INFO:teuthology.orchestra.run.smithi167.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-18T02:01:30.279 INFO:teuthology.orchestra.run.smithi167.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-18T02:01:30.282 INFO:teuthology.orchestra.run.smithi167.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-18T02:01:30.285 INFO:teuthology.orchestra.run.smithi167.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-18T02:01:30.358 INFO:teuthology.orchestra.run.smithi167.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-18T02:01:30.361 INFO:teuthology.orchestra.run.smithi167.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-18T02:01:30.362 INFO:teuthology.orchestra.run.smithi167.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-18T02:01:30.367 INFO:teuthology.orchestra.run.smithi167.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-18T02:01:30.368 INFO:teuthology.orchestra.run.smithi167.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-18T02:01:30.440 INFO:teuthology.orchestra.run.smithi167.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-18T02:01:30.444 INFO:teuthology.orchestra.run.smithi167.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-18T02:01:30.505 INFO:teuthology.orchestra.run.smithi167.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-330-gc2ddf972-1jammy [112 kB] 2024-09-18T02:01:30.507 INFO:teuthology.orchestra.run.smithi167.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-330-gc2ddf972-1jammy [472 kB] 2024-09-18T02:01:30.538 INFO:teuthology.orchestra.run.smithi167.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-330-gc2ddf972-1jammy [25.9 MB] 2024-09-18T02:01:30.608 INFO:teuthology.orchestra.run.smithi167.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-18T02:01:30.609 INFO:teuthology.orchestra.run.smithi167.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-18T02:01:30.612 INFO:teuthology.orchestra.run.smithi167.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-18T02:01:30.613 INFO:teuthology.orchestra.run.smithi167.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-18T02:01:30.616 INFO:teuthology.orchestra.run.smithi167.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-18T02:01:30.634 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-330-gc2ddf972-1jammy [14.1 kB] 2024-09-18T02:01:30.634 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-330-gc2ddf972-1jammy [877 kB] 2024-09-18T02:01:30.649 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-330-gc2ddf972-1jammy [2,462 kB] 2024-09-18T02:01:30.654 INFO:teuthology.orchestra.run.smithi167.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-18T02:01:30.657 INFO:teuthology.orchestra.run.smithi167.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-18T02:01:30.657 INFO:teuthology.orchestra.run.smithi167.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-18T02:01:30.685 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-330-gc2ddf972-1jammy [794 kB] 2024-09-18T02:01:30.695 INFO:teuthology.orchestra.run.smithi081.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-330-gc2ddf972-1jammy [152 kB] 2024-09-18T02:01:30.697 INFO:teuthology.orchestra.run.smithi081.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-330-gc2ddf972-1jammy [2,275 kB] 2024-09-18T02:01:30.715 INFO:teuthology.orchestra.run.smithi167.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-18T02:01:30.715 INFO:teuthology.orchestra.run.smithi167.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-18T02:01:30.733 INFO:teuthology.orchestra.run.smithi081.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-330-gc2ddf972-1jammy [8,625 kB] 2024-09-18T02:01:30.775 INFO:teuthology.orchestra.run.smithi167.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-18T02:01:30.776 INFO:teuthology.orchestra.run.smithi167.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-18T02:01:30.777 INFO:teuthology.orchestra.run.smithi167.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-18T02:01:30.778 INFO:teuthology.orchestra.run.smithi167.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-18T02:01:30.779 INFO:teuthology.orchestra.run.smithi167.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-18T02:01:30.780 INFO:teuthology.orchestra.run.smithi167.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-18T02:01:30.787 INFO:teuthology.orchestra.run.smithi167.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-18T02:01:30.856 INFO:teuthology.orchestra.run.smithi167.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-18T02:01:30.860 INFO:teuthology.orchestra.run.smithi167.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-18T02:01:30.861 INFO:teuthology.orchestra.run.smithi167.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-18T02:01:30.936 INFO:teuthology.orchestra.run.smithi081.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-330-gc2ddf972-1jammy [14.2 kB] 2024-09-18T02:01:30.937 INFO:teuthology.orchestra.run.smithi081.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-330-gc2ddf972-1jammy [51.4 MB] 2024-09-18T02:01:30.938 INFO:teuthology.orchestra.run.smithi167.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-18T02:01:30.945 INFO:teuthology.orchestra.run.smithi167.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-18T02:01:30.947 INFO:teuthology.orchestra.run.smithi167.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-18T02:01:30.949 INFO:teuthology.orchestra.run.smithi167.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-18T02:01:30.959 INFO:teuthology.orchestra.run.smithi167.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-18T02:01:30.961 INFO:teuthology.orchestra.run.smithi167.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-18T02:01:30.969 INFO:teuthology.orchestra.run.smithi167.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-18T02:01:31.019 INFO:teuthology.orchestra.run.smithi167.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-18T02:01:31.021 INFO:teuthology.orchestra.run.smithi167.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-18T02:01:31.022 INFO:teuthology.orchestra.run.smithi167.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-18T02:01:31.101 INFO:teuthology.orchestra.run.smithi167.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-18T02:01:31.103 INFO:teuthology.orchestra.run.smithi167.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-18T02:01:31.120 INFO:teuthology.orchestra.run.smithi167.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-18T02:01:31.121 INFO:teuthology.orchestra.run.smithi167.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-18T02:01:31.121 INFO:teuthology.orchestra.run.smithi167.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-18T02:01:31.127 INFO:teuthology.orchestra.run.smithi167.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-18T02:01:31.128 INFO:teuthology.orchestra.run.smithi167.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-18T02:01:31.624 INFO:teuthology.orchestra.run.smithi167.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-330-gc2ddf972-1jammy [5,145 kB] 2024-09-18T02:01:31.727 INFO:teuthology.orchestra.run.smithi167.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-330-gc2ddf972-1jammy [245 kB] 2024-09-18T02:01:31.732 INFO:teuthology.orchestra.run.smithi167.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-330-gc2ddf972-1jammy [124 kB] 2024-09-18T02:01:31.735 INFO:teuthology.orchestra.run.smithi167.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-330-gc2ddf972-1jammy [1,555 kB] 2024-09-18T02:01:31.763 INFO:teuthology.orchestra.run.smithi167.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-330-gc2ddf972-1jammy [6,143 kB] 2024-09-18T02:01:31.951 INFO:teuthology.orchestra.run.smithi167.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-330-gc2ddf972-1jammy [22.8 MB] 2024-09-18T02:01:32.648 INFO:teuthology.orchestra.run.smithi167.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-330-gc2ddf972-1jammy [14.1 kB] 2024-09-18T02:01:32.648 INFO:teuthology.orchestra.run.smithi167.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-330-gc2ddf972-1jammy [877 kB] 2024-09-18T02:01:32.660 INFO:teuthology.orchestra.run.smithi167.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-330-gc2ddf972-1jammy [2,462 kB] 2024-09-18T02:01:32.693 INFO:teuthology.orchestra.run.smithi167.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-330-gc2ddf972-1jammy [794 kB] 2024-09-18T02:01:32.709 INFO:teuthology.orchestra.run.smithi167.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-330-gc2ddf972-1jammy [152 kB] 2024-09-18T02:01:32.711 INFO:teuthology.orchestra.run.smithi167.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-330-gc2ddf972-1jammy [2,275 kB] 2024-09-18T02:01:32.773 INFO:teuthology.orchestra.run.smithi167.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-330-gc2ddf972-1jammy [8,625 kB] 2024-09-18T02:01:32.959 INFO:teuthology.orchestra.run.smithi167.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-330-gc2ddf972-1jammy [14.2 kB] 2024-09-18T02:01:32.959 INFO:teuthology.orchestra.run.smithi167.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-330-gc2ddf972-1jammy [51.4 MB] 2024-09-18T02:01:33.075 INFO:teuthology.orchestra.run.smithi081.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-330-gc2ddf972-1jammy [130 kB] 2024-09-18T02:01:33.077 INFO:teuthology.orchestra.run.smithi081.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-330-gc2ddf972-1jammy [39.0 kB] 2024-09-18T02:01:33.079 INFO:teuthology.orchestra.run.smithi081.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-330-gc2ddf972-1jammy [13.6 MB] 2024-09-18T02:01:33.560 INFO:teuthology.orchestra.run.smithi081.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-330-gc2ddf972-1jammy [91.4 kB] 2024-09-18T02:01:34.137 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 181 MB in 5s (37.6 MB/s) 2024-09-18T02:01:34.239 INFO:teuthology.orchestra.run.smithi167.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-330-gc2ddf972-1jammy [130 kB] 2024-09-18T02:01:34.241 INFO:teuthology.orchestra.run.smithi167.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-330-gc2ddf972-1jammy [39.0 kB] 2024-09-18T02:01:34.242 INFO:teuthology.orchestra.run.smithi167.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-330-gc2ddf972-1jammy [13.6 MB] 2024-09-18T02:01:34.310 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-18T02:01:34.408 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-18T02:01:34.413 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-18T02:01:34.432 INFO:teuthology.orchestra.run.smithi167.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-330-gc2ddf972-1jammy [91.4 kB] 2024-09-18T02:01:34.501 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-18T02:01:34.804 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-18T02:01:34.819 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-18T02:01:34.854 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-18T02:01:35.002 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 181 MB in 6s (32.5 MB/s) 2024-09-18T02:01:35.157 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-18T02:01:35.183 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-18T02:01:35.208 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-18T02:01:35.223 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-18T02:01:35.310 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-18T02:01:35.316 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-18T02:01:35.415 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-18T02:01:35.661 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-18T02:01:35.687 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T02:01:35.736 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:01:35.835 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-18T02:01:35.861 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-18T02:01:35.910 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-18T02:01:36.105 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-18T02:01:36.131 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T02:01:36.164 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:01:36.330 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-18T02:01:36.356 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-18T02:01:36.422 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-18T02:01:36.509 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-18T02:01:36.535 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T02:01:36.575 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:01:36.859 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-18T02:01:36.885 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T02:01:36.933 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:01:36.937 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-18T02:01:36.963 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-18T02:01:37.003 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-18T02:01:37.306 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librados2. 2024-09-18T02:01:37.320 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-18T02:01:37.321 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-librados2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:37.346 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T02:01:37.356 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:37.386 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:01:37.690 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-18T02:01:37.716 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-18T02:01:37.756 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:01:37.784 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librbd1. 2024-09-18T02:01:37.810 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-librbd1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:37.851 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:38.151 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-18T02:01:38.177 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-18T02:01:38.217 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-18T02:01:38.287 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2024-09-18T02:01:38.313 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:38.353 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:38.537 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librados2. 2024-09-18T02:01:38.563 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../007-librados2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:38.603 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:38.631 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2024-09-18T02:01:38.646 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-python3-rados_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:38.689 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-18T02:01:38.993 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:01:38.998 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librbd1. 2024-09-18T02:01:39.024 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../008-librbd1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:39.034 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:39.065 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:39.287 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2024-09-18T02:01:39.313 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:39.353 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:39.509 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libcephfs2. 2024-09-18T02:01:39.536 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:39.577 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:39.664 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-18T02:01:39.690 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:01:39.731 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:39.836 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rados. 2024-09-18T02:01:39.851 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../010-python3-rados_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:39.895 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:40.109 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-18T02:01:40.135 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-18T02:01:40.147 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-18T02:01:40.163 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:01:40.175 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-18T02:01:40.197 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:40.433 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cephfs. 2024-09-18T02:01:40.448 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:40.453 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2024-09-18T02:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-18T02:01:40.492 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-18T02:01:40.790 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2024-09-18T02:01:40.803 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-18T02:01:40.817 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:40.830 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:01:40.856 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:40.869 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:41.181 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-18T02:01:41.192 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-18T02:01:41.207 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-18T02:01:41.219 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-18T02:01:41.247 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-18T02:01:41.259 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-18T02:01:41.537 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-18T02:01:41.563 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-18T02:01:41.583 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-prettytable. 2024-09-18T02:01:41.603 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-18T02:01:41.609 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-18T02:01:41.650 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-18T02:01:41.877 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rbd. 2024-09-18T02:01:41.889 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-18T02:01:41.892 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:41.905 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-18T02:01:41.927 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:41.948 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-18T02:01:42.218 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua5.1. 2024-09-18T02:01:42.233 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-18T02:01:42.268 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-18T02:01:42.506 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-18T02:01:42.532 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-18T02:01:42.571 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-any. 2024-09-18T02:01:42.572 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-18T02:01:42.586 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-18T02:01:42.629 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-18T02:01:42.849 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-18T02:01:42.865 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-18T02:01:42.873 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package zip. 2024-09-18T02:01:42.889 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-18T02:01:42.908 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-18T02:01:42.932 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking zip (3.0-12build2) ... 2024-09-18T02:01:43.202 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-18T02:01:43.210 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package unzip. 2024-09-18T02:01:43.226 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-18T02:01:43.229 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-18T02:01:43.260 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-18T02:01:43.269 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-18T02:01:43.572 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua5.1. 2024-09-18T02:01:43.598 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-18T02:01:43.614 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package luarocks. 2024-09-18T02:01:43.639 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-18T02:01:43.640 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-18T02:01:43.681 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-18T02:01:43.958 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua-any. 2024-09-18T02:01:43.984 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-18T02:01:44.025 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-18T02:01:44.055 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2024-09-18T02:01:44.083 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-librgw2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:44.122 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:44.294 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package zip. 2024-09-18T02:01:44.320 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-18T02:01:44.361 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking zip (3.0-12build2) ... 2024-09-18T02:01:44.664 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package unzip. 2024-09-18T02:01:44.692 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-18T02:01:44.693 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2024-09-18T02:01:44.706 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:44.722 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-18T02:01:44.749 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:45.036 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-18T02:01:45.062 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-18T02:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-18T02:01:45.101 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package luarocks. 2024-09-18T02:01:45.127 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-18T02:01:45.159 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-18T02:01:45.422 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2024-09-18T02:01:45.449 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:45.489 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:45.542 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librgw2. 2024-09-18T02:01:45.568 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../025-librgw2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:45.609 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:45.909 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2024-09-18T02:01:45.936 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-ceph-common_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:45.975 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:46.178 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rgw. 2024-09-18T02:01:46.204 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:46.244 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:46.547 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-18T02:01:46.574 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-18T02:01:46.614 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-18T02:01:46.925 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libradosstriper1. 2024-09-18T02:01:46.951 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:46.992 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:47.570 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-common. 2024-09-18T02:01:47.596 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../029-ceph-common_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:47.711 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:47.898 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2024-09-18T02:01:47.921 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-ceph-base_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:48.527 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-18T02:01:48.553 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-18T02:01:48.585 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-18T02:01:48.863 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cheroot. 2024-09-18T02:01:48.889 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-18T02:01:48.930 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-18T02:01:49.009 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-base. 2024-09-18T02:01:49.035 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../030-ceph-base_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:49.085 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:49.249 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-18T02:01:49.276 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-18T02:01:49.316 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-18T02:01:49.594 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-18T02:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-18T02:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-18T02:01:49.713 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-18T02:01:49.739 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-18T02:01:49.788 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-18T02:01:49.947 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-18T02:01:49.973 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-18T02:01:50.013 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-18T02:01:50.166 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cheroot. 2024-09-18T02:01:50.192 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-18T02:01:50.241 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-18T02:01:50.316 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempora. 2024-09-18T02:01:50.343 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-18T02:01:50.383 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-18T02:01:50.585 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-18T02:01:50.612 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-18T02:01:50.652 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-18T02:01:50.694 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-portend. 2024-09-18T02:01:50.721 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-18T02:01:50.761 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-18T02:01:51.005 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-18T02:01:51.022 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-18T02:01:51.031 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-18T02:01:51.037 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-18T02:01:51.072 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-18T02:01:51.079 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-18T02:01:51.375 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-18T02:01:51.401 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-18T02:01:51.441 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-18T02:01:51.449 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-18T02:01:51.475 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-18T02:01:51.524 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-18T02:01:51.787 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-natsort. 2024-09-18T02:01:51.802 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-tempora. 2024-09-18T02:01:51.813 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-18T02:01:51.828 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-18T02:01:51.854 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-18T02:01:51.860 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-18T02:01:52.113 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-portend. 2024-09-18T02:01:52.139 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-18T02:01:52.190 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2024-09-18T02:01:52.201 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-18T02:01:52.217 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-18T02:01:52.257 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-18T02:01:52.499 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-18T02:01:52.526 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-18T02:01:52.543 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-18T02:01:52.566 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-18T02:01:52.569 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-18T02:01:52.610 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-18T02:01:52.913 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2024-09-18T02:01:52.939 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-18T02:01:52.979 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-18T02:01:53.036 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-18T02:01:53.061 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-18T02:01:53.102 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-18T02:01:53.316 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-18T02:01:53.342 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-18T02:01:53.383 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-18T02:01:53.472 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-natsort. 2024-09-18T02:01:53.499 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-18T02:01:53.539 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-18T02:01:53.694 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-18T02:01:53.721 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-18T02:01:53.761 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-18T02:01:53.850 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-logutils. 2024-09-18T02:01:53.877 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-18T02:01:53.917 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-18T02:01:54.013 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2024-09-18T02:01:54.029 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-18T02:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-18T02:01:54.195 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-18T02:01:54.221 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-18T02:01:54.261 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-18T02:01:54.358 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2024-09-18T02:01:54.385 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-18T02:01:54.428 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-18T02:01:54.514 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-mako. 2024-09-18T02:01:54.540 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-18T02:01:54.580 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-18T02:01:54.753 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2024-09-18T02:01:54.780 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-18T02:01:54.819 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-18T02:01:54.909 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-18T02:01:54.935 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-18T02:01:54.975 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-18T02:01:55.122 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2024-09-18T02:01:55.149 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-18T02:01:55.189 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-18T02:01:55.286 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-18T02:01:55.313 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-18T02:01:55.353 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-18T02:01:55.500 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-18T02:01:55.516 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-18T02:01:55.558 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-18T02:01:55.631 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-webob. 2024-09-18T02:01:55.646 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-18T02:01:55.681 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-18T02:01:55.854 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-18T02:01:55.880 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-18T02:01:55.920 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-18T02:01:56.009 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-waitress. 2024-09-18T02:01:56.035 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-18T02:01:56.070 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-18T02:01:56.215 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2024-09-18T02:01:56.242 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-18T02:01:56.273 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-18T02:01:56.353 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-tempita. 2024-09-18T02:01:56.381 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-18T02:01:56.420 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-18T02:01:56.534 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2024-09-18T02:01:56.561 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-18T02:01:56.601 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-18T02:01:56.723 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-paste. 2024-09-18T02:01:56.749 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-18T02:01:56.789 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-18T02:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-certifi. 2024-09-18T02:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-18T02:01:56.989 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-18T02:01:57.067 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-18T02:01:57.082 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-18T02:01:57.126 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-18T02:01:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-idna. 2024-09-18T02:01:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-18T02:01:57.375 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-18T02:01:57.429 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-18T02:01:57.455 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-18T02:01:57.495 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-18T02:01:57.807 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-webtest. 2024-09-18T02:01:57.833 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-18T02:01:57.873 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-18T02:01:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-urllib3. 2024-09-18T02:01:57.905 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-18T02:01:57.945 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-18T02:01:58.193 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pecan. 2024-09-18T02:01:58.221 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-18T02:01:58.259 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-18T02:01:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests. 2024-09-18T02:01:58.300 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-18T02:01:58.340 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-18T02:01:58.614 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-certifi. 2024-09-18T02:01:58.626 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-18T02:01:58.641 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-18T02:01:58.652 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-18T02:01:58.681 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-18T02:01:58.692 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-18T02:01:58.967 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-idna. 2024-09-18T02:01:58.971 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-18T02:01:58.982 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-18T02:01:58.986 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:01:59.017 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-18T02:01:59.029 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:59.311 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-urllib3. 2024-09-18T02:01:59.338 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-18T02:01:59.376 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-18T02:01:59.394 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-18T02:01:59.403 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:01:59.445 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:01:59.706 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-requests. 2024-09-18T02:01:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-18T02:01:59.733 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-18T02:01:59.747 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-18T02:01:59.773 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-18T02:01:59.820 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-18T02:02:00.084 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-18T02:02:00.111 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-18T02:02:00.132 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2024-09-18T02:02:00.158 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-18T02:02:00.167 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-18T02:02:00.198 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-18T02:02:00.428 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-18T02:02:00.455 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:02:00.495 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:00.534 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2024-09-18T02:02:00.561 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:00.601 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:00.883 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-18T02:02:00.910 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:00.950 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:00.954 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2024-09-18T02:02:00.970 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:01.004 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:01.252 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-18T02:02:01.268 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-18T02:02:01.302 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-18T02:02:01.580 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-openssl. 2024-09-18T02:02:01.594 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2024-09-18T02:02:01.601 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-18T02:02:01.625 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:01.646 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-18T02:02:01.658 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:02.592 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr. 2024-09-18T02:02:02.619 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:02.892 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:03.403 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2024-09-18T02:02:03.430 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:03.469 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:03.478 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mon. 2024-09-18T02:02:03.505 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:03.545 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:03.814 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2024-09-18T02:02:03.841 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:03.880 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:04.141 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-osd. 2024-09-18T02:02:04.167 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:04.207 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:04.242 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2024-09-18T02:02:04.269 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:04.308 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:04.670 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2024-09-18T02:02:04.696 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-cephadm_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:04.736 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:05.056 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-18T02:02:05.083 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-18T02:02:05.122 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-18T02:02:05.210 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph. 2024-09-18T02:02:05.226 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../066-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:05.268 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:05.392 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-18T02:02:05.407 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-18T02:02:05.450 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-18T02:02:05.571 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-fuse. 2024-09-18T02:02:05.598 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:05.629 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:06.008 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mds. 2024-09-18T02:02:06.035 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:06.074 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:06.469 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephadm. 2024-09-18T02:02:06.489 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-babel. 2024-09-18T02:02:06.495 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../069-cephadm_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:06.515 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-18T02:02:06.552 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:06.555 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-18T02:02:06.863 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-18T02:02:06.883 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2024-09-18T02:02:06.890 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-18T02:02:06.910 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-18T02:02:06.929 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-18T02:02:06.950 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-18T02:02:07.240 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-18T02:02:07.256 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-18T02:02:07.294 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-18T02:02:07.298 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-18T02:02:07.321 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:02:07.361 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-18T02:02:07.733 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-18T02:02:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-18T02:02:08.017 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2024-09-18T02:02:08.044 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-18T02:02:08.075 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-18T02:02:08.320 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-babel. 2024-09-18T02:02:08.347 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-18T02:02:08.386 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-18T02:02:08.429 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-18T02:02:08.456 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:02:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:08.706 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jinja2. 2024-09-18T02:02:08.733 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-18T02:02:08.781 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-18T02:02:09.084 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-18T02:02:09.100 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:02:09.134 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:09.471 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-18T02:02:09.498 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-18T02:02:09.537 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-18T02:02:09.701 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-18T02:02:09.717 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-18T02:02:09.759 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-18T02:02:09.792 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-routes. 2024-09-18T02:02:09.819 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-18T02:02:09.858 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-18T02:02:10.195 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-18T02:02:10.222 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:02:10.246 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2024-09-18T02:02:10.261 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:10.273 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-18T02:02:10.312 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-18T02:02:10.633 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-18T02:02:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-18T02:02:10.691 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-18T02:02:10.977 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2024-09-18T02:02:11.004 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-18T02:02:11.043 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-18T02:02:11.550 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-18T02:02:11.578 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-18T02:02:11.617 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-18T02:02:11.754 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-18T02:02:11.770 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:02:11.881 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:12.080 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-joblib. 2024-09-18T02:02:12.095 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-18T02:02:12.129 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-18T02:02:12.482 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-18T02:02:12.509 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-18T02:02:12.549 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-18T02:02:12.860 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-sklearn. 2024-09-18T02:02:12.885 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cachetools. 2024-09-18T02:02:12.887 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-18T02:02:12.912 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-18T02:02:12.926 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-18T02:02:12.951 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-18T02:02:13.455 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-18T02:02:13.482 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-18T02:02:13.521 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-18T02:02:13.627 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-18T02:02:13.655 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:02:13.833 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-18T02:02:13.860 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-18T02:02:13.899 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-18T02:02:13.954 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:14.212 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2024-09-18T02:02:14.238 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-18T02:02:14.277 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-18T02:02:14.590 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-google-auth. 2024-09-18T02:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-18T02:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-18T02:02:14.875 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cachetools. 2024-09-18T02:02:14.902 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-18T02:02:14.950 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-18T02:02:14.951 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-18T02:02:14.967 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-18T02:02:15.001 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-18T02:02:15.253 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-18T02:02:15.280 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-18T02:02:15.287 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2024-09-18T02:02:15.314 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-18T02:02:15.319 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-18T02:02:15.354 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-18T02:02:15.648 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-18T02:02:15.675 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-18T02:02:15.691 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-18T02:02:15.714 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-18T02:02:15.718 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-18T02:02:15.757 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-18T02:02:16.026 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rsa. 2024-09-18T02:02:16.053 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-18T02:02:16.093 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-18T02:02:16.354 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-18T02:02:16.370 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:02:16.388 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-google-auth. 2024-09-18T02:02:16.413 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:16.415 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-18T02:02:16.455 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-18T02:02:16.732 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-18T02:02:16.733 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-18T02:02:16.759 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-18T02:02:16.760 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-18T02:02:16.791 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-18T02:02:16.799 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-18T02:02:17.111 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-websocket. 2024-09-18T02:02:17.135 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-18T02:02:17.138 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-18T02:02:17.162 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-18T02:02:17.177 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-18T02:02:17.202 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-18T02:02:17.429 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2024-09-18T02:02:17.445 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-18T02:02:17.480 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-18T02:02:17.523 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-18T02:02:17.550 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-18T02:02:17.589 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-18T02:02:17.724 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2024-09-18T02:02:17.740 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-18T02:02:17.782 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-18T02:02:18.102 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2024-09-18T02:02:18.118 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-18T02:02:18.160 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-18T02:02:18.211 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-18T02:02:18.227 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:02:18.261 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:18.507 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2024-09-18T02:02:18.534 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-ceph-test_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:18.565 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-18T02:02:18.573 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:18.592 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-18T02:02:18.631 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-18T02:02:18.934 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-18T02:02:18.950 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-18T02:02:18.984 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-18T02:02:19.237 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package jq. 2024-09-18T02:02:19.264 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-18T02:02:19.304 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-18T02:02:19.557 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package socat. 2024-09-18T02:02:19.584 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-18T02:02:19.639 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-18T02:02:19.952 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package xmlstarlet. 2024-09-18T02:02:19.979 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-18T02:02:20.018 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-18T02:02:20.372 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-test. 2024-09-18T02:02:20.388 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../097-ceph-test_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:20.430 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-volume. 2024-09-18T02:02:20.822 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:02:20.861 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:21.173 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-18T02:02:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:21.559 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-18T02:02:21.587 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-18T02:02:21.626 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-18T02:02:21.914 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-18T02:02:21.930 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-18T02:02:21.964 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-18T02:02:22.327 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2024-09-18T02:02:22.465 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-18T02:02:22.465 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-18T02:02:22.727 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-volume. 2024-09-18T02:02:22.755 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-18T02:02:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package pkg-config. 2024-09-18T02:02:22.892 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-18T02:02:22.931 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-18T02:02:23.097 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-18T02:02:23.125 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:23.164 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:23.176 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-18T02:02:23.192 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-18T02:02:23.226 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-18T02:02:23.625 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-18T02:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-18T02:02:23.653 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-18T02:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-18T02:02:23.692 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-18T02:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-18T02:02:23.982 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2024-09-18T02:02:24.009 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-18T02:02:24.030 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-18T02:02:24.048 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-18T02:02:24.058 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-18T02:02:24.096 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-18T02:02:24.368 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2024-09-18T02:02:24.396 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-18T02:02:24.400 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package nvme-cli. 2024-09-18T02:02:24.431 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-18T02:02:24.435 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-18T02:02:24.484 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-18T02:02:24.746 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-psutil. 2024-09-18T02:02:24.774 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-18T02:02:24.813 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-18T02:02:24.872 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package pkg-config. 2024-09-18T02:02:24.901 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-18T02:02:24.939 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-18T02:02:25.133 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2024-09-18T02:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-18T02:02:25.192 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-18T02:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-18T02:02:25.220 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-18T02:02:25.258 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-18T02:02:25.486 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pygments. 2024-09-18T02:02:25.514 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-18T02:02:25.544 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-18T02:02:25.662 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-18T02:02:25.689 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-18T02:02:25.728 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-18T02:02:26.007 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-18T02:02:26.031 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pastescript. 2024-09-18T02:02:26.034 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-18T02:02:26.059 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-18T02:02:26.073 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-18T02:02:26.097 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-18T02:02:26.326 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-toml. 2024-09-18T02:02:26.354 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-18T02:02:26.392 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-18T02:02:26.418 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pluggy. 2024-09-18T02:02:26.445 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-18T02:02:26.493 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-18T02:02:26.720 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2024-09-18T02:02:26.749 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-18T02:02:26.762 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-psutil. 2024-09-18T02:02:26.787 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-18T02:02:26.790 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-18T02:02:26.821 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-18T02:02:27.082 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2024-09-18T02:02:27.098 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-18T02:02:27.132 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-18T02:02:27.149 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-py. 2024-09-18T02:02:27.177 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-18T02:02:27.215 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-18T02:02:27.376 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-18T02:02:27.404 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-18T02:02:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-18T02:02:27.511 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pygments. 2024-09-18T02:02:27.539 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-18T02:02:27.569 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-18T02:02:28.006 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-18T02:02:28.045 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-18T02:02:28.073 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-18T02:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2024-09-18T02:02:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../116-radosgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:28.375 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-toml. 2024-09-18T02:02:28.404 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-18T02:02:28.442 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-18T02:02:28.729 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pytest. 2024-09-18T02:02:28.756 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-18T02:02:28.795 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-18T02:02:29.140 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-simplejson. 2024-09-18T02:02:29.168 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-18T02:02:29.183 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2024-09-18T02:02:29.200 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:29.206 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-18T02:02:29.241 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:29.530 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-18T02:02:29.797 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-18T02:02:29.801 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-18T02:02:29.817 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-18T02:02:29.860 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-18T02:02:29.923 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-18T02:02:30.193 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-18T02:02:30.504 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-18T02:02:30.555 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package radosgw. 2024-09-18T02:02:30.583 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../116-radosgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:30.622 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:30.932 INFO:teuthology.orchestra.run.smithi081.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-18T02:02:31.234 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:31.441 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package rbd-fuse. 2024-09-18T02:02:31.458 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-18T02:02:31.500 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:31.776 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2024-09-18T02:02:31.821 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-18T02:02:31.932 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-18T02:02:32.055 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-18T02:02:32.181 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-18T02:02:32.217 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-18T02:02:32.438 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-18T02:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-18T02:02:32.594 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-18T02:02:32.793 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-18T02:02:32.837 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-18T02:02:33.080 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-18T02:02:33.206 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-18T02:02:33.268 INFO:teuthology.orchestra.run.smithi167.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-18T02:02:33.333 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:33.508 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-18T02:02:33.825 INFO:teuthology.orchestra.run.smithi167.stdout:Adding system user cephadm....done 2024-09-18T02:02:33.951 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-18T02:02:33.956 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-18T02:02:34.210 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-18T02:02:34.224 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-18T02:02:34.476 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-18T02:02:34.486 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-18T02:02:34.602 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-18T02:02:34.755 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-18T02:02:34.853 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-18T02:02:35.015 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-18T02:02:35.104 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-18T02:02:35.247 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-18T02:02:35.290 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-18T02:02:35.549 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-18T02:02:35.550 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:35.818 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-18T02:02:35.909 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-18T02:02:35.944 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-18T02:02:36.062 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-18T02:02:36.169 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-18T02:02:36.171 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-18T02:02:36.414 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-18T02:02:36.445 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-18T02:02:36.688 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-18T02:02:36.790 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-18T02:02:36.820 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-18T02:02:36.876 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-18T02:02:36.931 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-18T02:02:37.002 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-18T02:02:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-18T02:02:37.362 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-18T02:02:37.433 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:37.471 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-18T02:02:37.709 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-18T02:02:37.730 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-18T02:02:37.844 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-18T02:02:37.970 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-18T02:02:38.007 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-18T02:02:38.079 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-18T02:02:38.300 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up zip (3.0-12build2) ... 2024-09-18T02:02:38.313 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-18T02:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-18T02:02:38.705 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-18T02:02:38.736 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-18T02:02:38.817 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-18T02:02:38.943 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-18T02:02:39.078 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-18T02:02:39.286 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-18T02:02:39.329 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-18T02:02:39.396 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-18T02:02:39.438 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-18T02:02:39.564 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-18T02:02:39.647 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-18T02:02:39.857 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-18T02:02:39.914 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-18T02:02:40.234 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-18T02:02:40.241 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up zip (3.0-12build2) ... 2024-09-18T02:02:40.367 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-18T02:02:40.476 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-18T02:02:40.856 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-18T02:02:41.094 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-18T02:02:41.121 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-18T02:02:41.345 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-18T02:02:41.446 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-18T02:02:41.464 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-18T02:02:41.547 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-18T02:02:41.724 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-18T02:02:41.833 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:41.840 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-18T02:02:42.134 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-18T02:02:42.225 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-18T02:02:42.461 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-18T02:02:42.467 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-18T02:02:42.844 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-18T02:02:43.129 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-18T02:02:43.464 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-18T02:02:43.667 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-18T02:02:43.706 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-18T02:02:43.832 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:43.919 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:02:44.053 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-18T02:02:44.125 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-18T02:02:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-18T02:02:44.430 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-18T02:02:44.452 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-18T02:02:44.573 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-18T02:02:44.874 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-18T02:02:45.125 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-18T02:02:45.377 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:02:45.503 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-18T02:02:45.599 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-18T02:02:45.796 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-18T02:02:45.842 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:02:45.994 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-18T02:02:46.064 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-18T02:02:46.270 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-18T02:02:46.340 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-18T02:02:46.396 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-18T02:02:46.522 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-18T02:02:46.591 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-18T02:02:46.815 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-18T02:02:46.842 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-18T02:02:47.066 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-18T02:02:47.110 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-18T02:02:47.236 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-18T02:02:47.292 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:02:47.419 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-18T02:02:47.495 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-18T02:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-18T02:02:47.720 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-18T02:02:47.915 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-18T02:02:47.980 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-18T02:02:48.199 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-18T02:02:48.239 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-18T02:02:48.467 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-18T02:02:48.490 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-18T02:02:48.593 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-18T02:02:48.719 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-18T02:02:48.749 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-18T02:02:48.808 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-18T02:02:49.009 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-18T02:02:49.038 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-18T02:02:49.127 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-18T02:02:49.155 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-18T02:02:49.411 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-18T02:02:49.562 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-18T02:02:49.854 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-18T02:02:49.855 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-18T02:02:50.116 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-18T02:02:50.148 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-18T02:02:50.243 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-18T02:02:50.399 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-18T02:02:50.501 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-18T02:02:50.502 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:02:50.610 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-18T02:02:50.620 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-18T02:02:50.691 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-18T02:02:50.928 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-18T02:02:50.929 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-18T02:02:51.054 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-18T02:02:51.231 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-18T02:02:51.439 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-18T02:02:51.498 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-18T02:02:51.608 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-18T02:02:51.698 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-18T02:02:51.825 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-18T02:02:51.884 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-18T02:02:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-18T02:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-18T02:02:52.194 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-18T02:02:52.497 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-18T02:02:52.503 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-18T02:02:52.804 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-18T02:02:52.890 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-18T02:02:53.089 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-18T02:02:53.175 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-18T02:02:53.240 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-18T02:02:53.508 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-18T02:02:53.511 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-18T02:02:53.654 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:53.759 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-18T02:02:53.780 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:53.906 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-18T02:02:54.089 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-18T02:02:54.225 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:54.352 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:54.478 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-18T02:02:54.482 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-18T02:02:54.738 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:54.751 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-18T02:02:54.855 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:54.981 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:55.062 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-18T02:02:55.194 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-18T02:02:55.194 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-18T02:02:55.196 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:55.323 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:55.449 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-18T02:02:55.683 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:55.726 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:55.853 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:55.935 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:55.987 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-18T02:02:56.061 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-18T02:02:56.264 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:56.393 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:56.516 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:56.730 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-18T02:02:56.730 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-18T02:02:57.243 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:57.265 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:57.369 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:57.495 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:57.569 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:57.621 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-18T02:02:57.695 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:57.824 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:58.330 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2024-09-18T02:02:58.699 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2024-09-18T02:02:58.833 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:58.867 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2024-09-18T02:02:58.879 INFO:teuthology.orchestra.run.smithi081.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-18T02:02:58.934 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:59.014 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-18T02:02:59.052 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:59.178 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:59.313 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:02:59.328 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-18T02:02:59.873 INFO:teuthology.orchestra.run.smithi167.stdout:Adding group ceph....done 2024-09-18T02:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:00.023 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:00.232 INFO:teuthology.orchestra.run.smithi167.stdout:Adding system user ceph....done 2024-09-18T02:03:00.471 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-18T02:03:00.471 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-18T02:03:00.735 INFO:teuthology.orchestra.run.smithi167.stdout:Setting system user ceph properties....done 2024-09-18T02:03:00.750 INFO:teuthology.orchestra.run.smithi167.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-18T02:03:00.886 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-18T02:03:00.900 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:01.186 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-18T02:03:01.266 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-18T02:03:01.727 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:01.939 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-18T02:03:01.939 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-18T02:03:01.990 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:02.167 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:02.379 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:02.589 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-18T02:03:02.589 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-18T02:03:02.629 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-18T02:03:02.629 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-18T02:03:03.072 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:03.160 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:03.341 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-18T02:03:03.341 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-18T02:03:03.639 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-18T02:03:03.799 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:03.925 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:04.076 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:04.121 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:04.286 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-18T02:03:04.286 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-18T02:03:04.354 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-18T02:03:04.354 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-18T02:03:04.752 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:04.831 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:05.013 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:05.029 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-18T02:03:05.029 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-18T02:03:05.189 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:05.524 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:05.550 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-18T02:03:05.785 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-18T02:03:05.812 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-18T02:03:05.812 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-18T02:03:05.945 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-18T02:03:06.325 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:06.435 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:06.578 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:06.787 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-18T02:03:06.788 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-18T02:03:07.030 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-18T02:03:07.271 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:07.422 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:07.573 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:07.650 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-18T02:03:07.656 DEBUG:teuthology.parallel:result is None 2024-09-18T02:03:07.724 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-18T02:03:08.060 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-18T02:03:08.161 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-18T02:03:08.313 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-18T02:03:09.432 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-18T02:03:10.072 INFO:teuthology.orchestra.run.smithi167.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-18T02:03:10.076 DEBUG:teuthology.parallel:result is None 2024-09-18T02:03:10.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T02:03:10.222 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2024-09-18T02:03:10.241 INFO:teuthology.orchestra.run.smithi081.stdout:19.1.1-330-gc2ddf972-1jammy 2024-09-18T02:03:10.242 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330-gc2ddf972-1jammy 2024-09-18T02:03:10.242 INFO:teuthology.task.install:The correct ceph version 19.1.1-330-gc2ddf972-1jammy is installed. 2024-09-18T02:03:10.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T02:03:10.380 DEBUG:teuthology.orchestra.run.smithi167:> dpkg-query -W -f '${Version}' ceph 2024-09-18T02:03:10.398 INFO:teuthology.orchestra.run.smithi167.stdout:19.1.1-330-gc2ddf972-1jammy 2024-09-18T02:03:10.399 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330-gc2ddf972-1jammy 2024-09-18T02:03:10.399 INFO:teuthology.task.install:The correct ceph version 19.1.1-330-gc2ddf972-1jammy is installed. 2024-09-18T02:03:10.401 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T02:03:10.401 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:10.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T02:03:10.415 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:10.416 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T02:03:10.454 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T02:03:10.454 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:10.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T02:03:10.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T02:03:10.525 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:10.525 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T02:03:10.539 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T02:03:10.593 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T02:03:10.594 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:10.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T02:03:10.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T02:03:10.662 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:10.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T02:03:10.674 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T02:03:10.729 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T02:03:10.729 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:10.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T02:03:10.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T02:03:10.797 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:10.797 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T02:03:10.811 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T02:03:10.866 INFO:teuthology.run_tasks:Running task ceph... 2024-09-18T02:03:10.946 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-18T02:03:10.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-09-18T02:03:10.949 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2024-09-18T02:03:10.962 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-18T02:03:10.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T02:03:11.004 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T02:03:11.017 INFO:tasks.ceph:Creating extra log directories... 2024-09-18T02:03:11.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T02:03:11.060 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T02:03:11.081 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-18T02:03:11.081 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-18T02:03:11.081 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909769', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7909769', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9034, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7', 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIC8y/Xf1ouM8T6aTl/TC0plAp1akAuqyy07AQIrhUuuywQBPrC788FSA1R+wu0Yz9rdODl6UVeZR7txz7niY0w=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBGdbuQVrqnG7q1mj8l25ZhARALA+UhlKOguPUXpkoDIENCt7S5bONMtcCoZ/Rqh4MTRU+rb4rOSyIv4ZrFSeY4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_21:40:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-18T02:03:11.081 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T02:03:11.112 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T02:03:11.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T02:03:11.160 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T02:03:11.178 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:11.178 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T02:03:11.218 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T02:03:11.219 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-18T02:03:11.267 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T02:03:11.267 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T02:03:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-09-18T02:03:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T02:03:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 01:57:47.437150860 +0000 2024-09-18T02:03:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 01:57:47.197153003 +0000 2024-09-18T02:03:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 01:57:47.197153003 +0000 2024-09-18T02:03:11.267 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-18T02:03:11.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T02:03:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T02:03:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T02:03:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000407042 s, 1.3 MB/s 2024-09-18T02:03:11.322 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T02:03:11.376 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-18T02:03:11.423 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T02:03:11.423 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T02:03:11.423 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-18T02:03:11.423 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T02:03:11.423 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 01:57:47.937146394 +0000 2024-09-18T02:03:11.423 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 01:57:47.681148680 +0000 2024-09-18T02:03:11.423 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 01:57:47.681148680 +0000 2024-09-18T02:03:11.423 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-18T02:03:11.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T02:03:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T02:03:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T02:03:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00040405 s, 1.3 MB/s 2024-09-18T02:03:11.478 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T02:03:11.528 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-18T02:03:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T02:03:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T02:03:11.575 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-18T02:03:11.575 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T02:03:11.575 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 01:57:48.449141821 +0000 2024-09-18T02:03:11.575 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 01:57:48.189144143 +0000 2024-09-18T02:03:11.575 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 01:57:48.189144143 +0000 2024-09-18T02:03:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-18T02:03:11.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T02:03:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T02:03:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T02:03:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000419041 s, 1.2 MB/s 2024-09-18T02:03:11.630 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T02:03:11.680 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-18T02:03:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T02:03:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T02:03:11.727 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 944 Links: 1 2024-09-18T02:03:11.727 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T02:03:11.727 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 01:57:48.937137461 +0000 2024-09-18T02:03:11.727 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 01:57:48.697139605 +0000 2024-09-18T02:03:11.727 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 01:57:48.697139605 +0000 2024-09-18T02:03:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-18T02:03:11.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T02:03:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T02:03:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T02:03:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000310163 s, 1.7 MB/s 2024-09-18T02:03:11.782 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T02:03:11.832 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-18T02:03:11.832 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:11.832 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T02:03:11.838 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T02:03:11.838 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-09-18T02:03:11.887 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T02:03:11.887 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T02:03:11.887 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-09-18T02:03:11.887 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T02:03:11.887 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-18 01:57:46.888170364 +0000 2024-09-18T02:03:11.887 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-18 01:57:46.648172508 +0000 2024-09-18T02:03:11.887 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-18 01:57:46.648172508 +0000 2024-09-18T02:03:11.887 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2024-09-18T02:03:11.887 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T02:03:11.941 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-18T02:03:11.941 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-18T02:03:11.941 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000462417 s, 1.1 MB/s 2024-09-18T02:03:11.942 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T02:03:11.992 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-09-18T02:03:12.038 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T02:03:12.038 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T02:03:12.038 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-18T02:03:12.039 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T02:03:12.039 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-18 01:57:47.312166577 +0000 2024-09-18T02:03:12.039 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-18 01:57:47.092168542 +0000 2024-09-18T02:03:12.039 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-18 01:57:47.092168542 +0000 2024-09-18T02:03:12.039 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2024-09-18T02:03:12.039 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T02:03:12.093 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-18T02:03:12.093 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-18T02:03:12.093 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000406883 s, 1.3 MB/s 2024-09-18T02:03:12.094 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T02:03:12.143 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-09-18T02:03:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T02:03:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T02:03:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-09-18T02:03:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T02:03:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-18 01:57:47.792162290 +0000 2024-09-18T02:03:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-18 01:57:47.536164576 +0000 2024-09-18T02:03:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-18 01:57:47.536164576 +0000 2024-09-18T02:03:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2024-09-18T02:03:12.191 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T02:03:12.245 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-18T02:03:12.245 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-18T02:03:12.245 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.00042756 s, 1.2 MB/s 2024-09-18T02:03:12.246 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T02:03:12.296 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-09-18T02:03:12.343 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T02:03:12.343 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T02:03:12.343 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-09-18T02:03:12.343 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T02:03:12.343 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-18 01:57:48.292157823 +0000 2024-09-18T02:03:12.343 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-18 01:57:48.024160218 +0000 2024-09-18T02:03:12.343 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-18 01:57:48.024160218 +0000 2024-09-18T02:03:12.344 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2024-09-18T02:03:12.344 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T02:03:12.397 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-18T02:03:12.397 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-18T02:03:12.397 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000418893 s, 1.2 MB/s 2024-09-18T02:03:12.398 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T02:03:12.448 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T02:03:12.448 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-18T02:03:12.448 INFO:tasks.ceph:Generating config... 2024-09-18T02:03:12.449 INFO:tasks.ceph:[client] debug ms = 1 2024-09-18T02:03:12.449 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-18T02:03:12.449 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-18T02:03:12.449 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-18T02:03:12.449 INFO:tasks.ceph:[client] setuser = ceph 2024-09-18T02:03:12.449 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-18T02:03:12.449 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-18T02:03:12.450 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-18T02:03:12.451 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-18T02:03:12.451 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-18T02:03:12.451 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-18T02:03:12.451 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-18T02:03:12.451 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-18T02:03:12.451 INFO:tasks.ceph:Setting up mon.a... 2024-09-18T02:03:12.451 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-18T02:03:12.486 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-09-18T02:03:12.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-18T02:03:12.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T02:03:12.625 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81')] 2024-09-18T02:03:12.625 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-18T02:03:12.626 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:12.626 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T02:03:12.671 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-18T02:03:12.748 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:03:12.748 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:03:12.749 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-18T02:03:12.749 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid ecc0241d-08c6-448c-b756-3dfc0b24e44a 2024-09-18T02:03:12.749 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-09-18T02:03:12.749 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-09-18T02:03:12.749 INFO:teuthology.orchestra.run.smithi081.stdout:fsid ecc0241d-08c6-448c-b756-3dfc0b24e44a 2024-09-18T02:03:12.749 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-09-18T02:03:12.747760+0000 2024-09-18T02:03:12.749 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T02:03:12.747760+0000 2024-09-18T02:03:12.749 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 17 (quincy) 2024-09-18T02:03:12.749 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2024-09-18T02:03:12.750 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-18T02:03:12.750 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-18T02:03:12.751 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T02:03:12.803 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ecc0241d-08c6-448c-b756-3dfc0b24e44a... 2024-09-18T02:03:12.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T02:03:12.848 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T02:03:12.876 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-18T02:03:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-18T02:03:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T02:03:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-18T02:03:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-18T02:03:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-18T02:03:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-18T02:03:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-18T02:03:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-18T02:03:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-18T02:03:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-18T02:03:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-18T02:03:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-18T02:03:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-18T02:03:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T02:03:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T02:03:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-18T02:03:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T02:03:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-18T02:03:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-18T02:03:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-18T02:03:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-18T02:03:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-18T02:03:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = 172.21.15.81 2024-09-18T02:03:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = ecc0241d-08c6-448c-b756-3dfc0b24e44a 2024-09-18T02:03:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.880 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-18T02:03:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-09-18T02:03:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: debug objclass = 20 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore allocator = bitmap 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2024-09-18T02:03:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-18T02:03:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-18T02:03:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-18T02:03:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: rgw gc obj min wait = 15 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: debug rgw = 20 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: setgroup = ceph 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: setuser = ceph 2024-09-18T02:03:12.887 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-18T02:03:12.888 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-09-18T02:03:12.888 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-09-18T02:03:12.888 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T02:03:12.888 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-09-18T02:03:12.888 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.888 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.889 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T02:03:12.890 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = 172.21.15.81 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = ecc0241d-08c6-448c-b756-3dfc0b24e44a 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.891 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-09-18T02:03:12.892 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.893 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: debug objclass = 20 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: bdev async discard = True 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: bdev enable discard = True 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore allocator = bitmap 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 1/20 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 1/20 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 4/10 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T02:03:12.894 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-09-18T02:03:12.895 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.896 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T02:03:12.897 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-09-18T02:03:12.898 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-09-18T02:03:12.898 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-09-18T02:03:12.898 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-09-18T02:03:12.898 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T02:03:12.898 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T02:03:12.898 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-18T02:03:12.898 INFO:teuthology.orchestra.run.smithi167.stdout: rgw gc obj min wait = 15 2024-09-18T02:03:12.898 INFO:teuthology.orchestra.run.smithi167.stdout: debug rgw = 20 2024-09-18T02:03:12.898 INFO:teuthology.orchestra.run.smithi167.stdout: setgroup = ceph 2024-09-18T02:03:12.898 INFO:teuthology.orchestra.run.smithi167.stdout: setuser = ceph 2024-09-18T02:03:12.898 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-09-18T02:03:12.900 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-18T02:03:12.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-18T02:03:12.991 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-18T02:03:12.991 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:12.991 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-18T02:03:12.996 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:12.996 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-18T02:03:13.042 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T02:03:13.042 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:13.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T02:03:13.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T02:03:13.107 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:13.107 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T02:03:13.155 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T02:03:13.155 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:13.155 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T02:03:13.155 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T02:03:13.179 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:13.179 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T02:03:13.227 INFO:tasks.ceph:Setting up mon nodes... 2024-09-18T02:03:13.227 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-18T02:03:13.227 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T02:03:13.312 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T02:03:13.324 INFO:tasks.ceph:Setting up mds nodes... 2024-09-18T02:03:13.325 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-18T02:03:13.325 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T02:03:13.400 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-18T02:03:13.412 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-18T02:03:13.412 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-18T02:03:13.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-18T02:03:13.426 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-18T02:03:13.427 INFO:tasks.ceph:role: osd.0 2024-09-18T02:03:13.427 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T02:03:13.427 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T02:03:13.490 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T02:03:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T02:03:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T02:03:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T02:03:13.491 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T02:03:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-18T02:03:13.491 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T02:03:13.491 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T02:03:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T02:03:13.491 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T02:03:13.971 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-18T02:03:13.974 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-18T02:03:13.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-18T02:03:14.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-18T02:03:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T02:03:14.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T02:03:14.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T02:03:14.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:14.231+0000 7fefeec127c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-18T02:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:14.235+0000 7fefeec127c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-18T02:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:14.239+0000 7fefeec127c0 -1 bdev(0x559752089800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-18T02:03:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:14.239+0000 7fefeec127c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-18T02:03:17.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T02:03:17.411 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-18T02:03:17.426 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T02:03:17.426 INFO:tasks.ceph:role: osd.1 2024-09-18T02:03:17.426 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T02:03:17.427 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T02:03:17.490 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T02:03:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T02:03:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T02:03:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T02:03:17.490 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T02:03:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-18T02:03:17.490 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T02:03:17.490 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T02:03:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T02:03:17.490 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T02:03:17.943 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-18T02:03:17.945 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-18T02:03:17.945 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-18T02:03:18.031 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-18T02:03:18.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T02:03:18.041 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T02:03:18.041 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-18T02:03:18.092 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T02:03:18.092 INFO:tasks.ceph:role: osd.2 2024-09-18T02:03:18.092 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T02:03:18.092 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T02:03:18.153 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T02:03:18.153 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T02:03:18.153 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T02:03:18.153 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T02:03:18.153 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T02:03:18.153 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-18T02:03:18.153 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T02:03:18.153 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T02:03:18.154 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T02:03:18.154 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T02:03:18.618 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-18T02:03:18.620 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-18T02:03:18.620 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-18T02:03:18.776 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-18T02:03:18.788 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T02:03:18.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T02:03:18.789 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-18T02:03:18.842 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T02:03:18.842 INFO:tasks.ceph:role: osd.3 2024-09-18T02:03:18.842 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T02:03:18.842 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T02:03:18.906 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T02:03:18.906 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T02:03:18.906 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T02:03:18.907 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-18T02:03:18.907 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T02:03:18.907 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-18T02:03:18.907 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T02:03:18.907 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T02:03:18.907 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T02:03:18.907 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T02:03:19.386 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-18T02:03:19.388 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-18T02:03:19.388 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-18T02:03:19.538 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-18T02:03:19.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T02:03:19.551 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T02:03:19.551 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T02:03:19.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:19.652+0000 7f7b44f087c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-18T02:03:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:19.656+0000 7f7b44f087c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-18T02:03:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:19.656+0000 7f7b44f087c0 -1 bdev(0x5610010bd800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-18T02:03:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:19.656+0000 7f7b44f087c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-18T02:03:22.811 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T02:03:22.825 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T02:03:22.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:22.900+0000 7f607e2de7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-18T02:03:22.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:22.900+0000 7f607e2de7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-18T02:03:22.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:22.900+0000 7f607e2de7c0 -1 bdev(0x564e63deb800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-18T02:03:22.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:22.900+0000 7f607e2de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-18T02:03:26.041 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T02:03:26.099 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T02:03:26.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:26.176+0000 7f9dd6dc67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-18T02:03:26.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:26.176+0000 7f9dd6dc67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-18T02:03:26.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:26.176+0000 7f9dd6dc67c0 -1 bdev(0x55d357a8d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-18T02:03:26.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:26.176+0000 7f9dd6dc67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-18T02:03:29.349 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T02:03:29.407 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-18T02:03:29.407 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:29.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-18T02:03:29.421 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:29.422 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-18T02:03:29.467 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:29.467 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-18T02:03:29.521 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:29.522 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-18T02:03:29.577 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:29.577 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-18T02:03:29.630 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:29.630 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-18T02:03:29.678 INFO:tasks.ceph:Adding keys to all mons... 2024-09-18T02:03:29.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T02:03:29.690 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-09-18T02:03:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDiNOpmqqH0DRAA5YAVby05IECpWIyNhDvgWg== 2024-09-18T02:03:29.690 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-09-18T02:03:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDhNOpmgOeNEhAATkCZmxuGKbQtSLLpILBQow== 2024-09-18T02:03:29.690 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-09-18T02:03:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDnNOpmaVwNJxAAjxn41Z+39pSPtPtPSJk5vQ== 2024-09-18T02:03:29.691 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-09-18T02:03:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDqNOpm4HTDNRAAORU+EmR8ELY9vExlqHln8g== 2024-09-18T02:03:29.691 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-09-18T02:03:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDuNOpmkQi4ChAA4xNVPQCz1CJ8P6JYDJp+0g== 2024-09-18T02:03:29.691 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-18T02:03:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDhNOpmNCLPFxAAb/zVUMd1G6ac+6OCm3qXzA== 2024-09-18T02:03:29.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T02:03:29.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T02:03:29.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T02:03:29.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T02:03:29.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T02:03:30.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T02:03:30.197 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-18T02:03:30.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-18T02:03:30.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T02:03:30.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-18T02:03:30.311 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T02:03:30.358 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-18T02:03:30.358 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-18T02:03:30.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-18T02:03:30.403 INFO:tasks.ceph.mon.a:Started 2024-09-18T02:03:30.404 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-18T02:03:30.404 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-18T02:03:30.404 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-18T02:03:30.406 INFO:tasks.ceph.mgr.x:Started 2024-09-18T02:03:30.406 INFO:tasks.ceph:Setting crush tunables to default 2024-09-18T02:03:30.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-09-18T02:03:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.523+0000 7f89dc6d3640 1 Processor -- start 2024-09-18T02:03:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.523+0000 7f89dc6d3640 1 -- start start 2024-09-18T02:03:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.523+0000 7f89dc6d3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89d412f390 0x7f89d4133a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.523+0000 7f89dc6d3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d4098d50 con 0x7f89d412e6f0 2024-09-18T02:03:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.523+0000 7f89dc6d3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f89d406eba0 con 0x7f89d412f390 2024-09-18T02:03:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.523+0000 7f89d9c6e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89d412f390 0x7f89d4133a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.523+0000 7f89d9c6e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89d412f390 0x7f89d4133a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36984/0 (socket says 172.21.15.81:36984) 2024-09-18T02:03:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.523+0000 7f89d9c6e640 1 -- 172.21.15.81:0/1763207892 learned_addr learned my addr 172.21.15.81:0/1763207892 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.527+0000 7f89d9c6e640 1 -- 172.21.15.81:0/1763207892 >> v2:172.21.15.81:3300/0 conn(0x7f89d412f390 msgr2=0x7f89d4133a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-18T02:03:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.527+0000 7f89d9c6e640 1 -- 172.21.15.81:0/1763207892 >> v2:172.21.15.81:3300/0 conn(0x7f89d412f390 msgr2=0x7f89d4133a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-18T02:03:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.527+0000 7f89d9c6e640 1 --2- 172.21.15.81:0/1763207892 >> v2:172.21.15.81:3300/0 conn(0x7f89d412f390 0x7f89d4133a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-18T02:03:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.527+0000 7f89d9c6e640 1 --2- 172.21.15.81:0/1763207892 >> v2:172.21.15.81:3300/0 conn(0x7f89d412f390 0x7f89d4133a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-18T02:03:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89d946d640 1 -- 172.21.15.81:0/1763207892 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341286546 0 0) 0x7f89d0001120 con 0x7f89d412e6f0 2024-09-18T02:03:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89d946d640 1 -- 172.21.15.81:0/1763207892 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c0003530 con 0x7f89d412e6f0 2024-09-18T02:03:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89d946d640 1 -- 172.21.15.81:0/1763207892 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3702160748 0 0) 0x7f89c0003530 con 0x7f89d412e6f0 2024-09-18T02:03:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89d946d640 1 -- 172.21.15.81:0/1763207892 >> v2:172.21.15.81:3300/0 conn(0x7f89d412f390 msgr2=0x7f89d4133a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-18T02:03:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89d946d640 1 --2- 172.21.15.81:0/1763207892 >> v2:172.21.15.81:3300/0 conn(0x7f89d412f390 0x7f89d4133a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89d946d640 1 -- 172.21.15.81:0/1763207892 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d406ed60 con 0x7f89d412e6f0 2024-09-18T02:03:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89d946d640 1 -- 172.21.15.81:0/1763207892 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1972425487 0 0) 0x7f89d0001780 con 0x7f89d412e6f0 2024-09-18T02:03:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89d946d640 1 -- 172.21.15.81:0/1763207892 >> v1:172.21.15.81:6789/0 conn(0x7f89d412e6f0 legacy=0x7f89d412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89d946d640 1 --2- 172.21.15.81:0/1763207892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 0x7f89c0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89d946d640 1 -- 172.21.15.81:0/1763207892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89c0004580 con 0x7f89c0003a10 2024-09-18T02:03:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89da46f640 1 --2- 172.21.15.81:0/1763207892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 0x7f89c0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.543+0000 7f89da46f640 1 -- 172.21.15.81:0/1763207892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c0003530 con 0x7f89c0003a10 2024-09-18T02:03:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89da46f640 1 --2- 172.21.15.81:0/1763207892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 0x7f89c0003e10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f89d000c110 tx=0x7f89d001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764ad96c7ee72072 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89d946d640 1 -- 172.21.15.81:0/1763207892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d00b2070 con 0x7f89c0003a10 2024-09-18T02:03:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89d946d640 1 -- 172.21.15.81:0/1763207892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d00a57e0 con 0x7f89c0003a10 2024-09-18T02:03:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89d946d640 1 -- 172.21.15.81:0/1763207892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d0007cc0 con 0x7f89c0003a10 2024-09-18T02:03:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89dc6d3640 1 -- 172.21.15.81:0/1763207892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 msgr2=0x7f89c0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89dc6d3640 1 --2- 172.21.15.81:0/1763207892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 0x7f89c0003e10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f89d000c110 tx=0x7f89d001ca40 comp rx=0 tx=0).stop 2024-09-18T02:03:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89dc6d3640 1 -- 172.21.15.81:0/1763207892 shutdown_connections 2024-09-18T02:03:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89dc6d3640 1 --2- 172.21.15.81:0/1763207892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 0x7f89c0003e10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89dc6d3640 1 --2- 172.21.15.81:0/1763207892 >> v2:172.21.15.81:3300/0 conn(0x7f89d412f390 0x7f89d4133a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89dc6d3640 1 -- 172.21.15.81:0/1763207892 >> 172.21.15.81:0/1763207892 conn(0x7f89d40a1030 msgr2=0x7f89d40a1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89dc6d3640 1 -- 172.21.15.81:0/1763207892 shutdown_connections 2024-09-18T02:03:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89dc6d3640 1 -- 172.21.15.81:0/1763207892 wait complete. 2024-09-18T02:03:30.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.575+0000 7f89dc6d3640 1 Processor -- start 2024-09-18T02:03:30.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89dc6d3640 1 -- start start 2024-09-18T02:03:30.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89dc6d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 0x7f89d40972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:30.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89dc6d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4136b70 con 0x7f89c0003a10 2024-09-18T02:03:30.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89da46f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 0x7f89d40972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:30.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89da46f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 0x7f89d40972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37014/0 (socket says 172.21.15.81:37014) 2024-09-18T02:03:30.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89da46f640 1 -- 172.21.15.81:0/3860860814 learned_addr learned my addr 172.21.15.81:0/3860860814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:30.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89da46f640 1 -- 172.21.15.81:0/3860860814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d4131310 con 0x7f89c0003a10 2024-09-18T02:03:30.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89da46f640 1 --2- 172.21.15.81:0/3860860814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 0x7f89d40972f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f89d0019650 tx=0x7f89d00197e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89caffd640 1 -- 172.21.15.81:0/3860860814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d00bb070 con 0x7f89c0003a10 2024-09-18T02:03:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89caffd640 1 -- 172.21.15.81:0/3860860814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d00050b0 con 0x7f89c0003a10 2024-09-18T02:03:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89dc6d3640 1 -- 172.21.15.81:0/3860860814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d41321e0 con 0x7f89c0003a10 2024-09-18T02:03:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89caffd640 1 -- 172.21.15.81:0/3860860814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d00b2040 con 0x7f89c0003a10 2024-09-18T02:03:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89dc6d3640 1 -- 172.21.15.81:0/3860860814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d4097830 con 0x7f89c0003a10 2024-09-18T02:03:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89caffd640 1 -- 172.21.15.81:0/3860860814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f89d00be070 con 0x7f89c0003a10 2024-09-18T02:03:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89caffd640 1 -- 172.21.15.81:0/3860860814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f89d0003a80 con 0x7f89c0003a10 2024-09-18T02:03:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.579+0000 7f89dc6d3640 1 -- 172.21.15.81:0/3860860814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d412ec80 con 0x7f89c0003a10 2024-09-18T02:03:30.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.583+0000 7f89caffd640 1 -- 172.21.15.81:0/3860860814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f89d4098d50 con 0x7f89c0003a10 2024-09-18T02:03:30.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.647+0000 7f89dc6d3640 1 -- 172.21.15.81:0/3860860814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f89d4131f00 con 0x7f89c0003a10 2024-09-18T02:03:30.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.651+0000 7f89caffd640 1 -- 172.21.15.81:0/3860860814 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f89d00053b0 con 0x7f89c0003a10 2024-09-18T02:03:30.655 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-18T02:03:30.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.651+0000 7f89dc6d3640 1 -- 172.21.15.81:0/3860860814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 msgr2=0x7f89d40972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:30.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.651+0000 7f89dc6d3640 1 --2- 172.21.15.81:0/3860860814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 0x7f89d40972f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f89d0019650 tx=0x7f89d00197e0 comp rx=0 tx=0).stop 2024-09-18T02:03:30.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.651+0000 7f89dc6d3640 1 -- 172.21.15.81:0/3860860814 shutdown_connections 2024-09-18T02:03:30.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.651+0000 7f89dc6d3640 1 --2- 172.21.15.81:0/3860860814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c0003a10 0x7f89d40972f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:30.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.651+0000 7f89dc6d3640 1 -- 172.21.15.81:0/3860860814 >> 172.21.15.81:0/3860860814 conn(0x7f89d40a1030 msgr2=0x7f89d409a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:30.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.651+0000 7f89dc6d3640 1 -- 172.21.15.81:0/3860860814 shutdown_connections 2024-09-18T02:03:30.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:30.651+0000 7f89dc6d3640 1 -- 172.21.15.81:0/3860860814 wait complete. 2024-09-18T02:03:30.672 INFO:tasks.ceph:check_enable_crimson: False 2024-09-18T02:03:30.672 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-18T02:03:30.673 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T02:03:30.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-18T02:03:30.685 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:30.685 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-18T02:03:30.697 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:30.697 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-18T02:03:30.753 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T02:03:30.753 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-18T02:03:30.805 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:30.800+0000 7fb946e6b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-18T02:03:30.806 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new b17845b8-f230-4bb1-b552-c6d3048d5a45 0 2024-09-18T02:03:30.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f301a53a640 1 Processor -- start 2024-09-18T02:03:30.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f301a53a640 1 -- start start 2024-09-18T02:03:30.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f301a53a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f301411acf0 0x7f301411d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:30.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f301a53a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f301411d620 con 0x7f3014112010 2024-09-18T02:03:30.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f301a53a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f301411e800 con 0x7f301411acf0 2024-09-18T02:03:30.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f3013fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3014112010 0x7f30141123f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:51934/0 (socket says 172.21.15.167:51934) 2024-09-18T02:03:30.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f3013fff640 1 -- 172.21.15.167:0/2482026096 learned_addr learned my addr 172.21.15.167:0/2482026096 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:03:30.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f30137fe640 1 --2- 172.21.15.167:0/2482026096 >> v2:172.21.15.81:3300/0 conn(0x7f301411acf0 0x7f301411d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:30.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f3012ffd640 1 -- 172.21.15.167:0/2482026096 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895598895 0 0) 0x7f301411d620 con 0x7f3014112010 2024-09-18T02:03:30.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f3012ffd640 1 -- 172.21.15.167:0/2482026096 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ffc003530 con 0x7f3014112010 2024-09-18T02:03:30.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f30137fe640 1 -- 172.21.15.167:0/2482026096 >> v1:172.21.15.81:6789/0 conn(0x7f3014112010 legacy=0x7f30141123f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:30.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.968+0000 7f30137fe640 1 -- 172.21.15.167:0/2482026096 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301411e980 con 0x7f301411acf0 2024-09-18T02:03:30.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.972+0000 7f30137fe640 1 --2- 172.21.15.167:0/2482026096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301411acf0 0x7f301411d0e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3008009740 tx=0x7f300801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520eb0283c64fffa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:30.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.972+0000 7f3012ffd640 1 -- 172.21.15.167:0/2482026096 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30080b1070 con 0x7f301411acf0 2024-09-18T02:03:30.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.972+0000 7f3012ffd640 1 -- 172.21.15.167:0/2482026096 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30080ac520 con 0x7f301411acf0 2024-09-18T02:03:30.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.972+0000 7f3012ffd640 1 -- 172.21.15.167:0/2482026096 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30080ac800 con 0x7f301411acf0 2024-09-18T02:03:30.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.972+0000 7f301a53a640 1 -- 172.21.15.167:0/2482026096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301411acf0 msgr2=0x7f301411d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:30.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.972+0000 7f301a53a640 1 --2- 172.21.15.167:0/2482026096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301411acf0 0x7f301411d0e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3008009740 tx=0x7f300801c370 comp rx=0 tx=0).stop 2024-09-18T02:03:30.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.972+0000 7f301a53a640 1 -- 172.21.15.167:0/2482026096 shutdown_connections 2024-09-18T02:03:30.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.972+0000 7f301a53a640 1 --2- 172.21.15.167:0/2482026096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301411acf0 0x7f301411d0e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:30.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.972+0000 7f301a53a640 1 -- 172.21.15.167:0/2482026096 >> 172.21.15.167:0/2482026096 conn(0x7f301406e660 msgr2=0x7f301406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:30.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.972+0000 7f301a53a640 1 -- 172.21.15.167:0/2482026096 shutdown_connections 2024-09-18T02:03:30.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.972+0000 7f301a53a640 1 -- 172.21.15.167:0/2482026096 wait complete. 2024-09-18T02:03:30.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f301a53a640 1 Processor -- start 2024-09-18T02:03:30.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f301a53a640 1 -- start start 2024-09-18T02:03:30.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f301a53a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3014112010 0x7f30141aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:30.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f301a53a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f301411e520 con 0x7f3014112010 2024-09-18T02:03:30.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f3013fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3014112010 0x7f30141aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:30.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f3013fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3014112010 0x7f30141aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:47254/0 (socket says 172.21.15.167:47254) 2024-09-18T02:03:30.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f3013fff640 1 -- 172.21.15.167:0/1878780446 learned_addr learned my addr 172.21.15.167:0/1878780446 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:30.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f3013fff640 1 -- 172.21.15.167:0/1878780446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30141af2e0 con 0x7f3014112010 2024-09-18T02:03:30.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f3013fff640 1 --2- 172.21.15.167:0/1878780446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3014112010 0x7f30141aed10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f300400c3d0 tx=0x7f300400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:30.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f3010ff9640 1 -- 172.21.15.167:0/1878780446 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3004017070 con 0x7f3014112010 2024-09-18T02:03:30.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f3010ff9640 1 -- 172.21.15.167:0/1878780446 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3004005ce0 con 0x7f3014112010 2024-09-18T02:03:30.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f301a53a640 1 -- 172.21.15.167:0/1878780446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30141af570 con 0x7f3014112010 2024-09-18T02:03:30.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f3010ff9640 1 -- 172.21.15.167:0/1878780446 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30040070d0 con 0x7f3014112010 2024-09-18T02:03:30.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f301a53a640 1 -- 172.21.15.167:0/1878780446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30141a8f80 con 0x7f3014112010 2024-09-18T02:03:30.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f3010ff9640 1 -- 172.21.15.167:0/1878780446 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f300401a070 con 0x7f3014112010 2024-09-18T02:03:30.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f3010ff9640 1 -- 172.21.15.167:0/1878780446 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f3004012740 con 0x7f3014112010 2024-09-18T02:03:30.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.976+0000 7f301a53a640 1 -- 172.21.15.167:0/1878780446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3014112470 con 0x7f3014112010 2024-09-18T02:03:30.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:30.984+0000 7f3010ff9640 1 -- 172.21.15.167:0/1878780446 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3004021020 con 0x7f3014112010 2024-09-18T02:03:31.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.052+0000 7f301a53a640 1 -- 172.21.15.167:0/1878780446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b17845b8-f230-4bb1-b552-c6d3048d5a45", "id": 0} v 0) -- 0x7f30141af7a0 con 0x7f3014112010 2024-09-18T02:03:31.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.056+0000 7f3010ff9640 1 -- 172.21.15.167:0/1878780446 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b17845b8-f230-4bb1-b552-c6d3048d5a45", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f300401c510 con 0x7f3014112010 2024-09-18T02:03:31.060 INFO:teuthology.orchestra.run.smithi167.stdout:0 2024-09-18T02:03:31.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.056+0000 7f301a53a640 1 -- 172.21.15.167:0/1878780446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3014112010 msgr2=0x7f30141aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.056+0000 7f301a53a640 1 --2- 172.21.15.167:0/1878780446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3014112010 0x7f30141aed10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f300400c3d0 tx=0x7f300400c890 comp rx=0 tx=0).stop 2024-09-18T02:03:31.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.056+0000 7f301a53a640 1 -- 172.21.15.167:0/1878780446 shutdown_connections 2024-09-18T02:03:31.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.056+0000 7f301a53a640 1 --2- 172.21.15.167:0/1878780446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3014112010 0x7f30141aed10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:31.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.056+0000 7f301a53a640 1 -- 172.21.15.167:0/1878780446 >> 172.21.15.167:0/1878780446 conn(0x7f301406e660 msgr2=0x7f301410f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:31.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.056+0000 7f301a53a640 1 -- 172.21.15.167:0/1878780446 shutdown_connections 2024-09-18T02:03:31.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.056+0000 7f301a53a640 1 -- 172.21.15.167:0/1878780446 wait complete. 2024-09-18T02:03:31.078 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 85eae91e-91f0-4bbd-a025-16ef101df8d6 1 2024-09-18T02:03:31.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd90ba40640 1 Processor -- start 2024-09-18T02:03:31.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd90ba40640 1 -- start start 2024-09-18T02:03:31.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd90ba40640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd904115d40 0x7fd904116120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:31.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd90ba40640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9041167e0 con 0x7fd90410fda0 2024-09-18T02:03:31.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd90ba40640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd904110960 con 0x7fd904115d40 2024-09-18T02:03:31.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd9097dc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd904115d40 0x7fd904116120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:31.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd9097dc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd904115d40 0x7fd904116120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:47260/0 (socket says 172.21.15.167:47260) 2024-09-18T02:03:31.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd908fdb640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd90410fda0 0x7fd904110250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:51944/0 (socket says 172.21.15.167:51944) 2024-09-18T02:03:31.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd9097dc640 1 -- 172.21.15.167:0/3593773282 learned_addr learned my addr 172.21.15.167:0/3593773282 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:31.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd8fbfff640 1 -- 172.21.15.167:0/3593773282 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1950865157 0 0) 0x7fd9041167e0 con 0x7fd90410fda0 2024-09-18T02:03:31.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd8fbfff640 1 -- 172.21.15.167:0/3593773282 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8f0003530 con 0x7fd90410fda0 2024-09-18T02:03:31.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd9097dc640 1 -- 172.21.15.167:0/3593773282 >> v1:172.21.15.81:6789/0 conn(0x7fd90410fda0 legacy=0x7fd904110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.188+0000 7fd9097dc640 1 -- 172.21.15.167:0/3593773282 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd904110b10 con 0x7fd904115d40 2024-09-18T02:03:31.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.192+0000 7fd9097dc640 1 --2- 172.21.15.167:0/3593773282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd904115d40 0x7fd904116120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd900009e50 tx=0x7fd90001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed88b51b9e35323c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:31.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.192+0000 7fd8fbfff640 1 -- 172.21.15.167:0/3593773282 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd900009200 con 0x7fd904115d40 2024-09-18T02:03:31.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.192+0000 7fd8fbfff640 1 -- 172.21.15.167:0/3593773282 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9000a57e0 con 0x7fd904115d40 2024-09-18T02:03:31.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.192+0000 7fd8fbfff640 1 -- 172.21.15.167:0/3593773282 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9000a5ac0 con 0x7fd904115d40 2024-09-18T02:03:31.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.192+0000 7fd90ba40640 1 -- 172.21.15.167:0/3593773282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd904115d40 msgr2=0x7fd904116120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.192+0000 7fd90ba40640 1 --2- 172.21.15.167:0/3593773282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd904115d40 0x7fd904116120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd900009e50 tx=0x7fd90001c980 comp rx=0 tx=0).stop 2024-09-18T02:03:31.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.192+0000 7fd90ba40640 1 -- 172.21.15.167:0/3593773282 shutdown_connections 2024-09-18T02:03:31.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.192+0000 7fd90ba40640 1 --2- 172.21.15.167:0/3593773282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd904115d40 0x7fd904116120 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:31.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.192+0000 7fd90ba40640 1 -- 172.21.15.167:0/3593773282 >> 172.21.15.167:0/3593773282 conn(0x7fd904071160 msgr2=0x7fd904073580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:31.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.192+0000 7fd90ba40640 1 -- 172.21.15.167:0/3593773282 shutdown_connections 2024-09-18T02:03:31.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.192+0000 7fd90ba40640 1 -- 172.21.15.167:0/3593773282 wait complete. 2024-09-18T02:03:31.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd90ba40640 1 Processor -- start 2024-09-18T02:03:31.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd90ba40640 1 -- start start 2024-09-18T02:03:31.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd90ba40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90410fda0 0x7fd9041a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:31.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd90ba40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd90411e610 con 0x7fd90410fda0 2024-09-18T02:03:31.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd9097dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90410fda0 0x7fd9041a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:31.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd9097dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90410fda0 0x7fd9041a6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:47274/0 (socket says 172.21.15.167:47274) 2024-09-18T02:03:31.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd9097dc640 1 -- 172.21.15.167:0/2952137265 learned_addr learned my addr 172.21.15.167:0/2952137265 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:31.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd9097dc640 1 -- 172.21.15.167:0/2952137265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9041a7360 con 0x7fd90410fda0 2024-09-18T02:03:31.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd9097dc640 1 --2- 172.21.15.167:0/2952137265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90410fda0 0x7fd9041a6e20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd90001a5b0 tx=0x7fd900019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:31.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd8f9ffb640 1 -- 172.21.15.167:0/2952137265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9000bc020 con 0x7fd90410fda0 2024-09-18T02:03:31.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd8f9ffb640 1 -- 172.21.15.167:0/2952137265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd900004040 con 0x7fd90410fda0 2024-09-18T02:03:31.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd90ba40640 1 -- 172.21.15.167:0/2952137265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9041a75f0 con 0x7fd90410fda0 2024-09-18T02:03:31.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd8f9ffb640 1 -- 172.21.15.167:0/2952137265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd900009510 con 0x7fd90410fda0 2024-09-18T02:03:31.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd90ba40640 1 -- 172.21.15.167:0/2952137265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9041ab5b0 con 0x7fd90410fda0 2024-09-18T02:03:31.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd8f9ffb640 1 -- 172.21.15.167:0/2952137265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd9000bf020 con 0x7fd90410fda0 2024-09-18T02:03:31.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd8f9ffb640 1 -- 172.21.15.167:0/2952137265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fd9000b67f0 con 0x7fd90410fda0 2024-09-18T02:03:31.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.196+0000 7fd90ba40640 1 -- 172.21.15.167:0/2952137265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9041161a0 con 0x7fd90410fda0 2024-09-18T02:03:31.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.204+0000 7fd8f9ffb640 1 -- 172.21.15.167:0/2952137265 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd9000c6030 con 0x7fd90410fda0 2024-09-18T02:03:31.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.276+0000 7fd90ba40640 1 -- 172.21.15.167:0/2952137265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "85eae91e-91f0-4bbd-a025-16ef101df8d6", "id": 1} v 0) -- 0x7fd904115d40 con 0x7fd90410fda0 2024-09-18T02:03:31.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.280+0000 7fd8f9ffb640 1 -- 172.21.15.167:0/2952137265 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "85eae91e-91f0-4bbd-a025-16ef101df8d6", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd900016600 con 0x7fd90410fda0 2024-09-18T02:03:31.283 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-09-18T02:03:31.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.280+0000 7fd90ba40640 1 -- 172.21.15.167:0/2952137265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90410fda0 msgr2=0x7fd9041a6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.280+0000 7fd90ba40640 1 --2- 172.21.15.167:0/2952137265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90410fda0 0x7fd9041a6e20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd90001a5b0 tx=0x7fd900019720 comp rx=0 tx=0).stop 2024-09-18T02:03:31.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.280+0000 7fd90ba40640 1 -- 172.21.15.167:0/2952137265 shutdown_connections 2024-09-18T02:03:31.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.280+0000 7fd90ba40640 1 --2- 172.21.15.167:0/2952137265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90410fda0 0x7fd9041a6e20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:31.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.280+0000 7fd90ba40640 1 -- 172.21.15.167:0/2952137265 >> 172.21.15.167:0/2952137265 conn(0x7fd904071160 msgr2=0x7fd904111b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:31.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.280+0000 7fd90ba40640 1 -- 172.21.15.167:0/2952137265 shutdown_connections 2024-09-18T02:03:31.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.280+0000 7fd90ba40640 1 -- 172.21.15.167:0/2952137265 wait complete. 2024-09-18T02:03:31.301 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 35bf8e14-6400-40c9-9d6c-a228b047458b 2 2024-09-18T02:03:31.341 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:31.336+0000 7fb946e6b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-18T02:03:31.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.412+0000 7f5902266640 1 Processor -- start 2024-09-18T02:03:31.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.412+0000 7f5902266640 1 -- start start 2024-09-18T02:03:31.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.412+0000 7f5902266640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58fc114bf0 0x7f58fc114fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:31.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.412+0000 7f5902266640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58fc115660 con 0x7f58fc06c4e0 2024-09-18T02:03:31.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.412+0000 7f5902266640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f58fc06d060 con 0x7f58fc114bf0 2024-09-18T02:03:31.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.412+0000 7f58fbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58fc114bf0 0x7f58fc114fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:31.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.412+0000 7f58fbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58fc114bf0 0x7f58fc114fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:47286/0 (socket says 172.21.15.167:47286) 2024-09-18T02:03:31.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.412+0000 7f58fbfff640 1 -- 172.21.15.167:0/2379281876 learned_addr learned my addr 172.21.15.167:0/2379281876 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:31.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.412+0000 7f58fbfff640 1 -- 172.21.15.167:0/2379281876 >> v1:172.21.15.81:6789/0 conn(0x7f58fc06c4e0 legacy=0x7f58fc06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.412+0000 7f58fbfff640 1 -- 172.21.15.167:0/2379281876 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc06d210 con 0x7f58fc114bf0 2024-09-18T02:03:31.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f58fbfff640 1 --2- 172.21.15.167:0/2379281876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc114bf0 0x7f58fc114fd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0097f0 tx=0x7f58ec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f321941876a2fdc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:31.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f58faffd640 1 -- 172.21.15.167:0/2379281876 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec0ab580 con 0x7f58fc114bf0 2024-09-18T02:03:31.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f58faffd640 1 -- 172.21.15.167:0/2379281876 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec0b0070 con 0x7f58fc114bf0 2024-09-18T02:03:31.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f58faffd640 1 -- 172.21.15.167:0/2379281876 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec0ab870 con 0x7f58fc114bf0 2024-09-18T02:03:31.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f5902266640 1 -- 172.21.15.167:0/2379281876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc114bf0 msgr2=0x7f58fc114fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f5902266640 1 --2- 172.21.15.167:0/2379281876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc114bf0 0x7f58fc114fd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0097f0 tx=0x7f58ec01c430 comp rx=0 tx=0).stop 2024-09-18T02:03:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f5902266640 1 -- 172.21.15.167:0/2379281876 shutdown_connections 2024-09-18T02:03:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f5902266640 1 --2- 172.21.15.167:0/2379281876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc114bf0 0x7f58fc114fd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f5902266640 1 -- 172.21.15.167:0/2379281876 >> 172.21.15.167:0/2379281876 conn(0x7f58fc06fff0 msgr2=0x7f58fc072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f5902266640 1 -- 172.21.15.167:0/2379281876 shutdown_connections 2024-09-18T02:03:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f5902266640 1 -- 172.21.15.167:0/2379281876 wait complete. 2024-09-18T02:03:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f5902266640 1 Processor -- start 2024-09-18T02:03:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f5902266640 1 -- start start 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f5902266640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc06c4e0 0x7f58fc10ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f5902266640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc11e6b0 con 0x7f58fc06c4e0 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f58fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc06c4e0 0x7f58fc10ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f58fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc06c4e0 0x7f58fc10ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:47302/0 (socket says 172.21.15.167:47302) 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.416+0000 7f58fbfff640 1 -- 172.21.15.167:0/517472977 learned_addr learned my addr 172.21.15.167:0/517472977 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.420+0000 7f58fbfff640 1 -- 172.21.15.167:0/517472977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc10f3a0 con 0x7f58fc06c4e0 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.420+0000 7f58fbfff640 1 --2- 172.21.15.167:0/517472977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc06c4e0 0x7f58fc10ee60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0ad040 tx=0x7f58ec01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.420+0000 7f58f8ff9640 1 -- 172.21.15.167:0/517472977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec0aa7f0 con 0x7f58fc06c4e0 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.420+0000 7f5902266640 1 -- 172.21.15.167:0/517472977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58fc10f5d0 con 0x7f58fc06c4e0 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.420+0000 7f58f8ff9640 1 -- 172.21.15.167:0/517472977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec0aa990 con 0x7f58fc06c4e0 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.420+0000 7f58f8ff9640 1 -- 172.21.15.167:0/517472977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec0aac70 con 0x7f58fc06c4e0 2024-09-18T02:03:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.420+0000 7f5902266640 1 -- 172.21.15.167:0/517472977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58fc10fa90 con 0x7f58fc06c4e0 2024-09-18T02:03:31.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.420+0000 7f58f8ff9640 1 -- 172.21.15.167:0/517472977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f58ec0c77d0 con 0x7f58fc06c4e0 2024-09-18T02:03:31.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.420+0000 7f58f8ff9640 1 -- 172.21.15.167:0/517472977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f58ec0aae10 con 0x7f58fc06c4e0 2024-09-18T02:03:31.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.420+0000 7f5902266640 1 -- 172.21.15.167:0/517472977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58fc115050 con 0x7f58fc06c4e0 2024-09-18T02:03:31.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.424+0000 7f58f8ff9640 1 -- 172.21.15.167:0/517472977 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f58ec0160b0 con 0x7f58fc06c4e0 2024-09-18T02:03:31.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.496+0000 7f5902266640 1 -- 172.21.15.167:0/517472977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "35bf8e14-6400-40c9-9d6c-a228b047458b", "id": 2} v 0) -- 0x7f58fc119180 con 0x7f58fc06c4e0 2024-09-18T02:03:31.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.496+0000 7f58f8ff9640 1 -- 172.21.15.167:0/517472977 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35bf8e14-6400-40c9-9d6c-a228b047458b", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f58ec0be3f0 con 0x7f58fc06c4e0 2024-09-18T02:03:31.501 INFO:teuthology.orchestra.run.smithi167.stdout:2 2024-09-18T02:03:31.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.496+0000 7f5902266640 1 -- 172.21.15.167:0/517472977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc06c4e0 msgr2=0x7f58fc10ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.496+0000 7f5902266640 1 --2- 172.21.15.167:0/517472977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc06c4e0 0x7f58fc10ee60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0ad040 tx=0x7f58ec01ac70 comp rx=0 tx=0).stop 2024-09-18T02:03:31.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.496+0000 7f5902266640 1 -- 172.21.15.167:0/517472977 shutdown_connections 2024-09-18T02:03:31.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.496+0000 7f5902266640 1 --2- 172.21.15.167:0/517472977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc06c4e0 0x7f58fc10ee60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:31.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.496+0000 7f5902266640 1 -- 172.21.15.167:0/517472977 >> 172.21.15.167:0/517472977 conn(0x7f58fc06fff0 msgr2=0x7f58fc113720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:31.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.496+0000 7f5902266640 1 -- 172.21.15.167:0/517472977 shutdown_connections 2024-09-18T02:03:31.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.496+0000 7f5902266640 1 -- 172.21.15.167:0/517472977 wait complete. 2024-09-18T02:03:31.517 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 9280ccbf-551d-432d-94c2-41fdb665034e 3 2024-09-18T02:03:31.564 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:31.560+0000 7fb946e6b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-18T02:03:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.676+0000 7f78b7808640 1 Processor -- start 2024-09-18T02:03:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.676+0000 7f78b7808640 1 -- start start 2024-09-18T02:03:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.676+0000 7f78b7808640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f78b01170b0 0x7f78b01194a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.676+0000 7f78b7808640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b0119a70 con 0x7f78b01144a0 2024-09-18T02:03:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.676+0000 7f78b7808640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f78b011ac70 con 0x7f78b01170b0 2024-09-18T02:03:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78b4da3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f78b01170b0 0x7f78b01194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78b55a4640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f78b01144a0 0x7f78b0114880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:51952/0 (socket says 172.21.15.167:51952) 2024-09-18T02:03:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78b55a4640 1 -- 172.21.15.167:0/2418741349 learned_addr learned my addr 172.21.15.167:0/2418741349 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:03:31.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78a7fff640 1 -- 172.21.15.167:0/2418741349 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610300516 0 0) 0x7f78b0119a70 con 0x7f78b01144a0 2024-09-18T02:03:31.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78a7fff640 1 -- 172.21.15.167:0/2418741349 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f789c003530 con 0x7f78b01144a0 2024-09-18T02:03:31.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78b4da3640 1 -- 172.21.15.167:0/2418741349 >> v1:172.21.15.81:6789/0 conn(0x7f78b01144a0 legacy=0x7f78b0114880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78b4da3640 1 -- 172.21.15.167:0/2418741349 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b011ae20 con 0x7f78b01170b0 2024-09-18T02:03:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78b4da3640 1 --2- 172.21.15.167:0/2418741349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b01170b0 0x7f78b01194a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009740 tx=0x7f78a001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973e1f9882249f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78a7fff640 1 -- 172.21.15.167:0/2418741349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78a00b1070 con 0x7f78b01170b0 2024-09-18T02:03:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78a7fff640 1 -- 172.21.15.167:0/2418741349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a00ac520 con 0x7f78b01170b0 2024-09-18T02:03:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78a7fff640 1 -- 172.21.15.167:0/2418741349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78a00ac800 con 0x7f78b01170b0 2024-09-18T02:03:31.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78b7808640 1 -- 172.21.15.167:0/2418741349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b01170b0 msgr2=0x7f78b01194a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.680+0000 7f78b7808640 1 --2- 172.21.15.167:0/2418741349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b01170b0 0x7f78b01194a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009740 tx=0x7f78a001c370 comp rx=0 tx=0).stop 2024-09-18T02:03:31.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 -- 172.21.15.167:0/2418741349 shutdown_connections 2024-09-18T02:03:31.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 --2- 172.21.15.167:0/2418741349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b01170b0 0x7f78b01194a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:31.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 -- 172.21.15.167:0/2418741349 >> 172.21.15.167:0/2418741349 conn(0x7f78b006f840 msgr2=0x7f78b0071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:31.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 -- 172.21.15.167:0/2418741349 shutdown_connections 2024-09-18T02:03:31.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 -- 172.21.15.167:0/2418741349 wait complete. 2024-09-18T02:03:31.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 Processor -- start 2024-09-18T02:03:31.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 -- start start 2024-09-18T02:03:31.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b01144a0 0x7f78b01acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:31.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78b011a970 con 0x7f78b01144a0 2024-09-18T02:03:31.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b55a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b01144a0 0x7f78b01acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:31.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b55a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b01144a0 0x7f78b01acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:47324/0 (socket says 172.21.15.167:47324) 2024-09-18T02:03:31.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b55a4640 1 -- 172.21.15.167:0/2256529314 learned_addr learned my addr 172.21.15.167:0/2256529314 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:31.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b55a4640 1 -- 172.21.15.167:0/2256529314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b01ad0f0 con 0x7f78b01144a0 2024-09-18T02:03:31.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b55a4640 1 --2- 172.21.15.167:0/2256529314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b01144a0 0x7f78b01acb20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c3a0 tx=0x7f78ac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:31.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78a5ffb640 1 -- 172.21.15.167:0/2256529314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78ac017070 con 0x7f78b01144a0 2024-09-18T02:03:31.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 -- 172.21.15.167:0/2256529314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b01ad380 con 0x7f78b01144a0 2024-09-18T02:03:31.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78a5ffb640 1 -- 172.21.15.167:0/2256529314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ac005c40 con 0x7f78b01144a0 2024-09-18T02:03:31.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78a5ffb640 1 -- 172.21.15.167:0/2256529314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78ac0070d0 con 0x7f78b01144a0 2024-09-18T02:03:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 -- 172.21.15.167:0/2256529314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b01a6e10 con 0x7f78b01144a0 2024-09-18T02:03:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78a5ffb640 1 -- 172.21.15.167:0/2256529314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f78ac01a070 con 0x7f78b01144a0 2024-09-18T02:03:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78a5ffb640 1 -- 172.21.15.167:0/2256529314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f78ac007270 con 0x7f78b01144a0 2024-09-18T02:03:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.684+0000 7f78b7808640 1 -- 172.21.15.167:0/2256529314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b006c010 con 0x7f78b01144a0 2024-09-18T02:03:31.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.692+0000 7f78a5ffb640 1 -- 172.21.15.167:0/2256529314 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f78ac021070 con 0x7f78b01144a0 2024-09-18T02:03:31.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.760+0000 7f78b7808640 1 -- 172.21.15.167:0/2256529314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9280ccbf-551d-432d-94c2-41fdb665034e", "id": 3} v 0) -- 0x7f78b01ad5b0 con 0x7f78b01144a0 2024-09-18T02:03:31.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.764+0000 7f78a5ffb640 1 -- 172.21.15.167:0/2256529314 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9280ccbf-551d-432d-94c2-41fdb665034e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f78ac007610 con 0x7f78b01144a0 2024-09-18T02:03:31.766 INFO:teuthology.orchestra.run.smithi167.stdout:3 2024-09-18T02:03:31.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.764+0000 7f78b7808640 1 -- 172.21.15.167:0/2256529314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b01144a0 msgr2=0x7f78b01acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.764+0000 7f78b7808640 1 --2- 172.21.15.167:0/2256529314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b01144a0 0x7f78b01acb20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c3a0 tx=0x7f78ac00c860 comp rx=0 tx=0).stop 2024-09-18T02:03:31.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.764+0000 7f78b7808640 1 -- 172.21.15.167:0/2256529314 shutdown_connections 2024-09-18T02:03:31.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.764+0000 7f78b7808640 1 --2- 172.21.15.167:0/2256529314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b01144a0 0x7f78b01acb20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:31.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.764+0000 7f78b7808640 1 -- 172.21.15.167:0/2256529314 >> 172.21.15.167:0/2256529314 conn(0x7f78b006f840 msgr2=0x7f78b006fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:31.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.764+0000 7f78b7808640 1 -- 172.21.15.167:0/2256529314 shutdown_connections 2024-09-18T02:03:31.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:31.764+0000 7f78b7808640 1 -- 172.21.15.167:0/2256529314 wait complete. 2024-09-18T02:03:31.782 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-18T02:03:31.783 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-18T02:03:31.785 INFO:tasks.ceph.osd.0:Started 2024-09-18T02:03:31.785 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-18T02:03:31.785 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-18T02:03:31.787 INFO:tasks.ceph.osd.1:Started 2024-09-18T02:03:31.787 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-18T02:03:31.787 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-18T02:03:31.789 INFO:tasks.ceph.osd.2:Started 2024-09-18T02:03:31.789 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-18T02:03:31.789 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-18T02:03:31.791 INFO:tasks.ceph.osd.3:Started 2024-09-18T02:03:31.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T02:03:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f7271b74640 1 Processor -- start 2024-09-18T02:03:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f7271b74640 1 -- start start 2024-09-18T02:03:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f7271b74640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f726c0952d0 0x7f726c0956b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f7271b74640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f726c098790 con 0x7f726c095bf0 2024-09-18T02:03:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f7271b74640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f726c098db0 con 0x7f726c0952d0 2024-09-18T02:03:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f726b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f726c0952d0 0x7f726c0956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f7262ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f726c095bf0 0x7f726c0964e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49304/0 (socket says 172.21.15.81:49304) 2024-09-18T02:03:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f7262ffd640 1 -- 172.21.15.81:0/939503407 learned_addr learned my addr 172.21.15.81:0/939503407 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f726b7fe640 1 --2- 172.21.15.81:0/939503407 >> v2:172.21.15.81:3300/0 conn(0x7f726c0952d0 0x7f726c0956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37038/0 (socket says 172.21.15.81:37038) 2024-09-18T02:03:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f726b7fe640 1 -- 172.21.15.81:0/939503407 >> v1:172.21.15.81:6789/0 conn(0x7f726c095bf0 legacy=0x7f726c0964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f726b7fe640 1 -- 172.21.15.81:0/939503407 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c098aa0 con 0x7f726c0952d0 2024-09-18T02:03:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f726b7fe640 1 --2- 172.21.15.81:0/939503407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c0952d0 0x7f726c0956b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f725c009740 tx=0x7f725c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbb6a567f996dd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f726affd640 1 -- 172.21.15.81:0/939503407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c0b1070 con 0x7f726c0952d0 2024-09-18T02:03:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f726affd640 1 -- 172.21.15.81:0/939503407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c0ac520 con 0x7f726c0952d0 2024-09-18T02:03:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.907+0000 7f726affd640 1 -- 172.21.15.81:0/939503407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c0ac820 con 0x7f726c0952d0 2024-09-18T02:03:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 -- 172.21.15.81:0/939503407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c0952d0 msgr2=0x7f726c0956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 --2- 172.21.15.81:0/939503407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c0952d0 0x7f726c0956b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f725c009740 tx=0x7f725c01c370 comp rx=0 tx=0).stop 2024-09-18T02:03:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 -- 172.21.15.81:0/939503407 shutdown_connections 2024-09-18T02:03:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 --2- 172.21.15.81:0/939503407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c0952d0 0x7f726c0956b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 -- 172.21.15.81:0/939503407 >> 172.21.15.81:0/939503407 conn(0x7f726c09cd50 msgr2=0x7f726c09d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 -- 172.21.15.81:0/939503407 shutdown_connections 2024-09-18T02:03:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 -- 172.21.15.81:0/939503407 wait complete. 2024-09-18T02:03:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 Processor -- start 2024-09-18T02:03:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 -- start start 2024-09-18T02:03:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c0952d0 0x7f726c06e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f726c097790 con 0x7f726c0952d0 2024-09-18T02:03:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f726b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c0952d0 0x7f726c06e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f726b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c0952d0 0x7f726c06e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37050/0 (socket says 172.21.15.81:37050) 2024-09-18T02:03:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f726b7fe640 1 -- 172.21.15.81:0/2181702745 learned_addr learned my addr 172.21.15.81:0/2181702745 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f726b7fe640 1 -- 172.21.15.81:0/2181702745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c094a30 con 0x7f726c0952d0 2024-09-18T02:03:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f726b7fe640 1 --2- 172.21.15.81:0/2181702745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c0952d0 0x7f726c06e1b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f725c01aa20 tx=0x7f725c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7268ff9640 1 -- 172.21.15.81:0/2181702745 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c0b1050 con 0x7f726c0952d0 2024-09-18T02:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7268ff9640 1 -- 172.21.15.81:0/2181702745 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c0b2040 con 0x7f726c0952d0 2024-09-18T02:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 -- 172.21.15.81:0/2181702745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c06ecd0 con 0x7f726c0952d0 2024-09-18T02:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7268ff9640 1 -- 172.21.15.81:0/2181702745 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c0b6930 con 0x7f726c0952d0 2024-09-18T02:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 -- 172.21.15.81:0/2181702745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c0718c0 con 0x7f726c0952d0 2024-09-18T02:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7268ff9640 1 -- 172.21.15.81:0/2181702745 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f725c0bf030 con 0x7f726c0952d0 2024-09-18T02:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7268ff9640 1 -- 172.21.15.81:0/2181702745 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f725c0bd070 con 0x7f726c0952d0 2024-09-18T02:03:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.911+0000 7f7271b74640 1 -- 172.21.15.81:0/2181702745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c0956b0 con 0x7f726c0952d0 2024-09-18T02:03:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.915+0000 7f7268ff9640 1 -- 172.21.15.81:0/2181702745 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f725c0c6020 con 0x7f726c0952d0 2024-09-18T02:03:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.971+0000 7f7271b74640 1 -- 172.21.15.81:0/2181702745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f726c075bf0 con 0x7f726c0952d0 2024-09-18T02:03:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.975+0000 7f7268ff9640 1 -- 172.21.15.81:0/2181702745 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f725c0a9070 con 0x7f726c0952d0 2024-09-18T02:03:31.979 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:31.979 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":6,"fsid":"ecc0241d-08c6-448c-b756-3dfc0b24e44a","created":"2024-09-18T02:03:30.533838+0000","modified":"2024-09-18T02:03:31.763486+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T02:03:31.763486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b17845b8-f230-4bb1-b552-c6d3048d5a45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"85eae91e-91f0-4bbd-a025-16ef101df8d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"35bf8e14-6400-40c9-9d6c-a228b047458b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9280ccbf-551d-432d-94c2-41fdb665034e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T02:03:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.975+0000 7f7271b74640 1 -- 172.21.15.81:0/2181702745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c0952d0 msgr2=0x7f726c06e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.975+0000 7f7271b74640 1 --2- 172.21.15.81:0/2181702745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c0952d0 0x7f726c06e1b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f725c01aa20 tx=0x7f725c01abb0 comp rx=0 tx=0).stop 2024-09-18T02:03:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.975+0000 7f7271b74640 1 -- 172.21.15.81:0/2181702745 shutdown_connections 2024-09-18T02:03:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.975+0000 7f7271b74640 1 --2- 172.21.15.81:0/2181702745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c0952d0 0x7f726c06e1b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.975+0000 7f7271b74640 1 -- 172.21.15.81:0/2181702745 >> 172.21.15.81:0/2181702745 conn(0x7f726c09cd50 msgr2=0x7f726c128f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.975+0000 7f7271b74640 1 -- 172.21.15.81:0/2181702745 shutdown_connections 2024-09-18T02:03:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:31.975+0000 7f7271b74640 1 -- 172.21.15.81:0/2181702745 wait complete. 2024-09-18T02:03:31.996 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-18T02:03:31.996 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-18T02:03:32.130 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:32.124+0000 7fb946e6b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-18T02:03:32.184 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:32.180+0000 7fb946e6b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-18T02:03:32.236 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:32.232+0000 7fb946e6b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-18T02:03:32.313 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:32.308+0000 7fb946e6b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-18T02:03:32.364 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:32.360+0000 7fb946e6b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-18T02:03:32.400 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T02:03:32.441 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:32.436+0000 7fb946e6b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-18T02:03:32.493 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:32.488+0000 7fb946e6b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-18T02:03:32.522 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.519+0000 7febcc435640 1 Processor -- start 2024-09-18T02:03:32.523 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.519+0000 7febcc435640 1 -- start start 2024-09-18T02:03:32.524 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.519+0000 7febcc435640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7febc4131810 0x7febc4133c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:32.524 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.519+0000 7febcc435640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc4098270 con 0x7febc4097780 2024-09-18T02:03:32.524 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.519+0000 7febcc435640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7febc409af60 con 0x7febc4131810 2024-09-18T02:03:32.524 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.519+0000 7febc99d0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7febc4131810 0x7febc4133c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:32.524 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.519+0000 7febca1d1640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7febc4097780 0x7febc4097b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49312/0 (socket says 172.21.15.81:49312) 2024-09-18T02:03:32.524 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.519+0000 7febca1d1640 1 -- 172.21.15.81:0/994595352 learned_addr learned my addr 172.21.15.81:0/994595352 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:32.524 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.519+0000 7febc99d0640 1 -- 172.21.15.81:0/994595352 >> v1:172.21.15.81:6789/0 conn(0x7febc4097780 legacy=0x7febc4097b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:32.524 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.519+0000 7febc91cf640 1 -- 172.21.15.81:0/994595352 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967306169 0 0) 0x7febc4098270 con 0x7febc4097780 2024-09-18T02:03:32.524 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.519+0000 7febc99d0640 1 -- 172.21.15.81:0/994595352 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc409b440 con 0x7febc4131810 2024-09-18T02:03:32.526 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febc99d0640 1 --2- 172.21.15.81:0/994595352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc4131810 0x7febc4133c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7febb4009740 tx=0x7febb401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a19b3b4129142 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:32.526 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febc91cf640 1 -- 172.21.15.81:0/994595352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febb40b1070 con 0x7febc4131810 2024-09-18T02:03:32.526 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febc91cf640 1 -- 172.21.15.81:0/994595352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb40ac520 con 0x7febc4131810 2024-09-18T02:03:32.526 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febc91cf640 1 -- 172.21.15.81:0/994595352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febb40ac820 con 0x7febc4131810 2024-09-18T02:03:32.529 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 -- 172.21.15.81:0/994595352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc4131810 msgr2=0x7febc4133c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:32.529 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 --2- 172.21.15.81:0/994595352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc4131810 0x7febc4133c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7febb4009740 tx=0x7febb401c370 comp rx=0 tx=0).stop 2024-09-18T02:03:32.530 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 -- 172.21.15.81:0/994595352 shutdown_connections 2024-09-18T02:03:32.530 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 --2- 172.21.15.81:0/994595352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc4131810 0x7febc4133c00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:32.530 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 -- 172.21.15.81:0/994595352 >> 172.21.15.81:0/994595352 conn(0x7febc40a0fd0 msgr2=0x7febc40a13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:32.530 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 -- 172.21.15.81:0/994595352 shutdown_connections 2024-09-18T02:03:32.530 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 -- 172.21.15.81:0/994595352 wait complete. 2024-09-18T02:03:32.530 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 Processor -- start 2024-09-18T02:03:32.530 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 -- start start 2024-09-18T02:03:32.530 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc4097780 0x7febc41c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:32.530 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7febc4136ae0 con 0x7febc4097780 2024-09-18T02:03:32.530 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febca1d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc4097780 0x7febc41c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:32.530 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febca1d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc4097780 0x7febc41c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37066/0 (socket says 172.21.15.81:37066) 2024-09-18T02:03:32.531 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febca1d1640 1 -- 172.21.15.81:0/4214414206 learned_addr learned my addr 172.21.15.81:0/4214414206 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:32.531 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febca1d1640 1 -- 172.21.15.81:0/4214414206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc40728a0 con 0x7febc4097780 2024-09-18T02:03:32.531 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febca1d1640 1 --2- 172.21.15.81:0/4214414206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc4097780 0x7febc41c5f80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7febc000c420 tx=0x7febc000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:32.531 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febbaffd640 1 -- 172.21.15.81:0/4214414206 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febc0018070 con 0x7febc4097780 2024-09-18T02:03:32.531 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febbaffd640 1 -- 172.21.15.81:0/4214414206 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc00074d0 con 0x7febc4097780 2024-09-18T02:03:32.531 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 -- 172.21.15.81:0/4214414206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc4126720 con 0x7febc4097780 2024-09-18T02:03:32.531 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febbaffd640 1 -- 172.21.15.81:0/4214414206 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febc0004960 con 0x7febc4097780 2024-09-18T02:03:32.531 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 -- 172.21.15.81:0/4214414206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc41c64c0 con 0x7febc4097780 2024-09-18T02:03:32.531 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febbaffd640 1 -- 172.21.15.81:0/4214414206 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7febc001b070 con 0x7febc4097780 2024-09-18T02:03:32.531 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febbaffd640 1 -- 172.21.15.81:0/4214414206 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7febc001c8c0 con 0x7febc4097780 2024-09-18T02:03:32.531 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.523+0000 7febcc435640 1 -- 172.21.15.81:0/4214414206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc4097be0 con 0x7febc4097780 2024-09-18T02:03:32.532 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.527+0000 7febbaffd640 1 -- 172.21.15.81:0/4214414206 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7febc0022020 con 0x7febc4097780 2024-09-18T02:03:32.591 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.587+0000 7febcc435640 1 -- 172.21.15.81:0/4214414206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7febc4073a50 con 0x7febc4097780 2024-09-18T02:03:32.591 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.587+0000 7febbaffd640 1 -- 172.21.15.81:0/4214414206 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7febc001cb90 con 0x7febc4097780 2024-09-18T02:03:32.591 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-18T02:03:32.592 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":6,"fsid":"ecc0241d-08c6-448c-b756-3dfc0b24e44a","created":"2024-09-18T02:03:30.533838+0000","modified":"2024-09-18T02:03:31.763486+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T02:03:31.763486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b17845b8-f230-4bb1-b552-c6d3048d5a45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"85eae91e-91f0-4bbd-a025-16ef101df8d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"35bf8e14-6400-40c9-9d6c-a228b047458b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9280ccbf-551d-432d-94c2-41fdb665034e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T02:03:32.592 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.587+0000 7febcc435640 1 -- 172.21.15.81:0/4214414206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc4097780 msgr2=0x7febc41c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:32.592 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.587+0000 7febcc435640 1 --2- 172.21.15.81:0/4214414206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc4097780 0x7febc41c5f80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7febc000c420 tx=0x7febc000c8e0 comp rx=0 tx=0).stop 2024-09-18T02:03:32.592 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.587+0000 7febcc435640 1 -- 172.21.15.81:0/4214414206 shutdown_connections 2024-09-18T02:03:32.593 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.587+0000 7febcc435640 1 --2- 172.21.15.81:0/4214414206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc4097780 0x7febc41c5f80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:32.593 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.587+0000 7febcc435640 1 -- 172.21.15.81:0/4214414206 >> 172.21.15.81:0/4214414206 conn(0x7febc40a0fd0 msgr2=0x7febc41306b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:32.593 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.587+0000 7febcc435640 1 -- 172.21.15.81:0/4214414206 shutdown_connections 2024-09-18T02:03:32.593 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:32.587+0000 7febcc435640 1 -- 172.21.15.81:0/4214414206 wait complete. 2024-09-18T02:03:32.607 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-18T02:03:32.643 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:32.640+0000 7fb946e6b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-18T02:03:32.704 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:32.700+0000 7fb946e6b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-18T02:03:32.876 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T02:03:32.871+0000 7f80145f57c0 -1 Falling back to public interface 2024-09-18T02:03:33.372 INFO:tasks.ceph.osd.1.smithi167.stderr:2024-09-18T02:03:33.368+0000 7fe787b587c0 -1 Falling back to public interface 2024-09-18T02:03:33.387 INFO:tasks.ceph.mgr.x.smithi167.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-18T02:03:33.387 INFO:tasks.ceph.mgr.x.smithi167.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-18T02:03:33.388 INFO:tasks.ceph.mgr.x.smithi167.stderr: from numpy import show_config as show_numpy_config 2024-09-18T02:03:33.404 INFO:tasks.ceph.osd.3.smithi167.stderr:2024-09-18T02:03:33.400+0000 7fcf46f5a7c0 -1 Falling back to public interface 2024-09-18T02:03:33.434 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:33.432+0000 7fb946e6b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-18T02:03:33.577 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:33.572+0000 7fb946e6b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-18T02:03:33.664 INFO:tasks.ceph.osd.2.smithi167.stderr:2024-09-18T02:03:33.660+0000 7f579cbcc7c0 -1 Falling back to public interface 2024-09-18T02:03:33.733 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:33.728+0000 7fb946e6b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-18T02:03:33.796 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:33.792+0000 7fb946e6b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-18T02:03:33.931 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:33.928+0000 7fb946e6b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-18T02:03:34.534 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:34.528+0000 7fb946e6b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-18T02:03:34.609 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:34.604+0000 7fb946e6b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-18T02:03:34.790 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:34.784+0000 7fb946e6b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-18T02:03:34.862 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:34.860+0000 7fb946e6b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-18T02:03:35.151 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:35.148+0000 7fb946e6b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-18T02:03:35.212 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:35.208+0000 7fb946e6b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-18T02:03:36.245 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T02:03:36.240+0000 7fb8edaa0640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-18T02:03:37.473 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T02:03:37.467+0000 7f80145f57c0 -1 osd.0 0 log_to_monitors true 2024-09-18T02:03:37.749 INFO:tasks.ceph.osd.3.smithi167.stderr:2024-09-18T02:03:37.744+0000 7fcf46f5a7c0 -1 osd.3 0 log_to_monitors true 2024-09-18T02:03:37.988 INFO:tasks.ceph.osd.1.smithi167.stderr:2024-09-18T02:03:37.984+0000 7fe787b587c0 -1 osd.1 0 log_to_monitors true 2024-09-18T02:03:38.178 INFO:tasks.ceph.osd.2.smithi167.stderr:2024-09-18T02:03:38.176+0000 7f579cbcc7c0 -1 osd.2 0 log_to_monitors true 2024-09-18T02:03:39.011 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T02:03:39.134 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.127+0000 7f118ee3e640 1 Processor -- start 2024-09-18T02:03:39.134 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.127+0000 7f118ee3e640 1 -- start start 2024-09-18T02:03:39.134 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.127+0000 7f118ee3e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1188093470 0x7f1188093850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:39.134 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.127+0000 7f118ee3e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1188096130 con 0x7f1188128f50 2024-09-18T02:03:39.134 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.127+0000 7f118ee3e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1188096760 con 0x7f1188093470 2024-09-18T02:03:39.134 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f118cbda640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1188093470 0x7f1188093850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:39.135 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f1187fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1188128f50 0x7f11881293c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45002/0 (socket says 172.21.15.81:45002) 2024-09-18T02:03:39.135 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f1187fff640 1 -- 172.21.15.81:0/2661257448 learned_addr learned my addr 172.21.15.81:0/2661257448 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:39.135 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f118cbda640 1 -- 172.21.15.81:0/2661257448 >> v1:172.21.15.81:6789/0 conn(0x7f1188128f50 legacy=0x7f11881293c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:39.135 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f118cbda640 1 -- 172.21.15.81:0/2661257448 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1188098be0 con 0x7f1188093470 2024-09-18T02:03:39.136 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f118cbda640 1 --2- 172.21.15.81:0/2661257448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188093470 0x7f1188093850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f117c009770 tx=0x7f117c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7533cee963dd0c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:39.136 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f11877fe640 1 -- 172.21.15.81:0/2661257448 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f117c0b0070 con 0x7f1188093470 2024-09-18T02:03:39.136 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f11877fe640 1 -- 172.21.15.81:0/2661257448 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c0ab530 con 0x7f1188093470 2024-09-18T02:03:39.136 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f11877fe640 1 -- 172.21.15.81:0/2661257448 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f117c0ab830 con 0x7f1188093470 2024-09-18T02:03:39.137 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f118ee3e640 1 -- 172.21.15.81:0/2661257448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188093470 msgr2=0x7f1188093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:39.137 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f118ee3e640 1 --2- 172.21.15.81:0/2661257448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188093470 0x7f1188093850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f117c009770 tx=0x7f117c01c370 comp rx=0 tx=0).stop 2024-09-18T02:03:39.137 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f118ee3e640 1 -- 172.21.15.81:0/2661257448 shutdown_connections 2024-09-18T02:03:39.137 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f118ee3e640 1 --2- 172.21.15.81:0/2661257448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188093470 0x7f1188093850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:39.138 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f118ee3e640 1 -- 172.21.15.81:0/2661257448 >> 172.21.15.81:0/2661257448 conn(0x7f1188099c40 msgr2=0x7f118809a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:39.138 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f118ee3e640 1 -- 172.21.15.81:0/2661257448 shutdown_connections 2024-09-18T02:03:39.138 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.131+0000 7f118ee3e640 1 -- 172.21.15.81:0/2661257448 wait complete. 2024-09-18T02:03:39.139 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118ee3e640 1 Processor -- start 2024-09-18T02:03:39.139 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118ee3e640 1 -- start start 2024-09-18T02:03:39.139 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118ee3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188128f50 0x7f11881cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:39.139 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118ee3e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1188135160 con 0x7f1188128f50 2024-09-18T02:03:39.140 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118cbda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188128f50 0x7f11881cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:39.140 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118cbda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188128f50 0x7f11881cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59050/0 (socket says 172.21.15.81:59050) 2024-09-18T02:03:39.140 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118cbda640 1 -- 172.21.15.81:0/2374885102 learned_addr learned my addr 172.21.15.81:0/2374885102 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:39.140 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118cbda640 1 -- 172.21.15.81:0/2374885102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118806f540 con 0x7f1188128f50 2024-09-18T02:03:39.140 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118cbda640 1 --2- 172.21.15.81:0/2374885102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188128f50 0x7f11881cacf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f117c01c3b0 tx=0x7f117c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:39.140 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f11857fa640 1 -- 172.21.15.81:0/2374885102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f117c0b0050 con 0x7f1188128f50 2024-09-18T02:03:39.140 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f11857fa640 1 -- 172.21.15.81:0/2374885102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c0bc070 con 0x7f1188128f50 2024-09-18T02:03:39.140 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118ee3e640 1 -- 172.21.15.81:0/2374885102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11881320e0 con 0x7f1188128f50 2024-09-18T02:03:39.140 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f11857fa640 1 -- 172.21.15.81:0/2374885102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f117c0aa8b0 con 0x7f1188128f50 2024-09-18T02:03:39.140 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118ee3e640 1 -- 172.21.15.81:0/2374885102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118806e880 con 0x7f1188128f50 2024-09-18T02:03:39.141 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f11857fa640 1 -- 172.21.15.81:0/2374885102 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f117c0aaa50 con 0x7f1188128f50 2024-09-18T02:03:39.141 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f118ee3e640 1 -- 172.21.15.81:0/2374885102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1188093850 con 0x7f1188128f50 2024-09-18T02:03:39.141 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f11857fa640 1 --2- 172.21.15.81:0/2374885102 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1174035d20 0x7f11740381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:39.141 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f11857fa640 1 -- 172.21.15.81:0/2374885102 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1339+0+0 (secure 0 0 0) 0x7f117c0a4e00 con 0x7f1188128f50 2024-09-18T02:03:39.141 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.135+0000 7f1187fff640 1 --2- 172.21.15.81:0/2374885102 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1174035d20 0x7f11740381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:39.142 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.139+0000 7f1187fff640 1 --2- 172.21.15.81:0/2374885102 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1174035d20 0x7f11740381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f11780012f0 tx=0x7f1178001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:39.145 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.139+0000 7f11857fa640 1 -- 172.21.15.81:0/2374885102 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f117c015ff0 con 0x7f1188128f50 2024-09-18T02:03:39.308 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.303+0000 7f118ee3e640 1 -- 172.21.15.81:0/2374885102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1188097210 con 0x7f1188128f50 2024-09-18T02:03:39.308 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.303+0000 7f11857fa640 1 -- 172.21.15.81:0/2374885102 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f117c0b4e20 con 0x7f1188128f50 2024-09-18T02:03:39.308 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-18T02:03:39.309 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":8,"fsid":"ecc0241d-08c6-448c-b756-3dfc0b24e44a","created":"2024-09-18T02:03:30.533838+0000","modified":"2024-09-18T02:03:39.287957+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T02:03:31.763486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b17845b8-f230-4bb1-b552-c6d3048d5a45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"85eae91e-91f0-4bbd-a025-16ef101df8d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"35bf8e14-6400-40c9-9d6c-a228b047458b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9280ccbf-551d-432d-94c2-41fdb665034e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T02:03:39.310 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.307+0000 7f118ee3e640 1 -- 172.21.15.81:0/2374885102 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1174035d20 msgr2=0x7f11740381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:39.310 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.307+0000 7f118ee3e640 1 --2- 172.21.15.81:0/2374885102 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1174035d20 0x7f11740381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f11780012f0 tx=0x7f1178001640 comp rx=0 tx=0).stop 2024-09-18T02:03:39.311 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.307+0000 7f118ee3e640 1 -- 172.21.15.81:0/2374885102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188128f50 msgr2=0x7f11881cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:39.311 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.307+0000 7f118ee3e640 1 --2- 172.21.15.81:0/2374885102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188128f50 0x7f11881cacf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f117c01c3b0 tx=0x7f117c01abb0 comp rx=0 tx=0).stop 2024-09-18T02:03:39.311 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.307+0000 7f118ee3e640 1 -- 172.21.15.81:0/2374885102 shutdown_connections 2024-09-18T02:03:39.311 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.307+0000 7f118ee3e640 1 --2- 172.21.15.81:0/2374885102 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1174035d20 0x7f11740381e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:39.311 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.307+0000 7f118ee3e640 1 --2- 172.21.15.81:0/2374885102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188128f50 0x7f11881cacf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:39.311 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.307+0000 7f118ee3e640 1 -- 172.21.15.81:0/2374885102 >> 172.21.15.81:0/2374885102 conn(0x7f1188099c40 msgr2=0x7f118812af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:39.311 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.307+0000 7f118ee3e640 1 -- 172.21.15.81:0/2374885102 shutdown_connections 2024-09-18T02:03:39.311 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:39.307+0000 7f118ee3e640 1 -- 172.21.15.81:0/2374885102 wait complete. 2024-09-18T02:03:39.326 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-18T02:03:40.233 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T02:03:40.227+0000 7f800fd7b640 -1 osd.0 0 waiting for initial osdmap 2024-09-18T02:03:40.250 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T02:03:40.247+0000 7f80083c2640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T02:03:41.002 INFO:tasks.ceph.osd.1.smithi167.stderr:2024-09-18T02:03:41.000+0000 7fe7832de640 -1 osd.1 0 waiting for initial osdmap 2024-09-18T02:03:41.026 INFO:tasks.ceph.osd.1.smithi167.stderr:2024-09-18T02:03:41.024+0000 7fe77b925640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T02:03:41.076 INFO:tasks.ceph.osd.2.smithi167.stderr:2024-09-18T02:03:41.072+0000 7f5798352640 -1 osd.2 0 waiting for initial osdmap 2024-09-18T02:03:41.077 INFO:tasks.ceph.osd.3.smithi167.stderr:2024-09-18T02:03:41.072+0000 7fcf426e0640 -1 osd.3 0 waiting for initial osdmap 2024-09-18T02:03:41.094 INFO:tasks.ceph.osd.3.smithi167.stderr:2024-09-18T02:03:41.092+0000 7fcf3ad27640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T02:03:41.106 INFO:tasks.ceph.osd.2.smithi167.stderr:2024-09-18T02:03:41.104+0000 7f5790999640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T02:03:45.730 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T02:03:45.854 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.847+0000 7f7dcbbec640 1 Processor -- start 2024-09-18T02:03:45.854 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.847+0000 7f7dcbbec640 1 -- start start 2024-09-18T02:03:45.854 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.847+0000 7f7dcbbec640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7dc412a6a0 0x7f7dc412aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:45.854 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.847+0000 7f7dcbbec640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dc4098be0 con 0x7f7dc4096ff0 2024-09-18T02:03:45.854 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.847+0000 7f7dcbbec640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7dc412a2e0 con 0x7f7dc412a6a0 2024-09-18T02:03:45.854 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.847+0000 7f7dc9988640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7dc412a6a0 0x7f7dc412aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:45.854 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.847+0000 7f7dc9988640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7dc412a6a0 0x7f7dc412aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59062/0 (socket says 172.21.15.81:59062) 2024-09-18T02:03:45.854 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.847+0000 7f7dc9988640 1 -- 172.21.15.81:0/3923544797 learned_addr learned my addr 172.21.15.81:0/3923544797 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:45.855 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.847+0000 7f7dc9187640 1 --1- 172.21.15.81:0/3923544797 >> v1:172.21.15.81:6789/0 conn(0x7f7dc4096ff0 0x7f7dc4129260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45004/0 (socket says 172.21.15.81:45004) 2024-09-18T02:03:45.855 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dc9988640 1 -- 172.21.15.81:0/3923544797 >> v1:172.21.15.81:6789/0 conn(0x7f7dc4096ff0 legacy=0x7f7dc4129260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:45.855 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dc9988640 1 -- 172.21.15.81:0/3923544797 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc4096560 con 0x7f7dc412a6a0 2024-09-18T02:03:45.856 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dc9988640 1 --2- 172.21.15.81:0/3923544797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc412a6a0 0x7f7dc412aa80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7db40097f0 tx=0x7f7db401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e109f5d2a5af7f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:45.856 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dc8986640 1 -- 172.21.15.81:0/3923544797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db40b0070 con 0x7f7dc412a6a0 2024-09-18T02:03:45.856 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dc8986640 1 -- 172.21.15.81:0/3923544797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db40ab530 con 0x7f7dc412a6a0 2024-09-18T02:03:45.856 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dc8986640 1 -- 172.21.15.81:0/3923544797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db40ab830 con 0x7f7dc412a6a0 2024-09-18T02:03:45.857 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dcbbec640 1 -- 172.21.15.81:0/3923544797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc412a6a0 msgr2=0x7f7dc412aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:45.858 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dcbbec640 1 --2- 172.21.15.81:0/3923544797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc412a6a0 0x7f7dc412aa80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7db40097f0 tx=0x7f7db401c460 comp rx=0 tx=0).stop 2024-09-18T02:03:45.858 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dcbbec640 1 -- 172.21.15.81:0/3923544797 shutdown_connections 2024-09-18T02:03:45.858 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dcbbec640 1 --2- 172.21.15.81:0/3923544797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc412a6a0 0x7f7dc412aa80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:45.858 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dcbbec640 1 -- 172.21.15.81:0/3923544797 >> 172.21.15.81:0/3923544797 conn(0x7f7dc4099c40 msgr2=0x7f7dc409a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:45.858 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dcbbec640 1 -- 172.21.15.81:0/3923544797 shutdown_connections 2024-09-18T02:03:45.858 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.851+0000 7f7dcbbec640 1 -- 172.21.15.81:0/3923544797 wait complete. 2024-09-18T02:03:45.858 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dcbbec640 1 Processor -- start 2024-09-18T02:03:45.858 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dcbbec640 1 -- start start 2024-09-18T02:03:45.860 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dcbbec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc4096ff0 0x7f7dc41c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:45.860 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dcbbec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc4094630 con 0x7f7dc4096ff0 2024-09-18T02:03:45.860 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dc9988640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc4096ff0 0x7f7dc41c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:45.860 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dc9988640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc4096ff0 0x7f7dc41c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59068/0 (socket says 172.21.15.81:59068) 2024-09-18T02:03:45.860 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dc9988640 1 -- 172.21.15.81:0/466036752 learned_addr learned my addr 172.21.15.81:0/466036752 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:45.860 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dc9988640 1 -- 172.21.15.81:0/466036752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc4126650 con 0x7f7dc4096ff0 2024-09-18T02:03:45.860 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dc9988640 1 --2- 172.21.15.81:0/466036752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc4096ff0 0x7f7dc41c6780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7db401a0f0 tx=0x7f7db401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:45.860 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dba7fc640 1 -- 172.21.15.81:0/466036752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db40ba020 con 0x7f7dc4096ff0 2024-09-18T02:03:45.860 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dba7fc640 1 -- 172.21.15.81:0/466036752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db40b6420 con 0x7f7dc4096ff0 2024-09-18T02:03:45.861 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dcbbec640 1 -- 172.21.15.81:0/466036752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc4127fb0 con 0x7f7dc4096ff0 2024-09-18T02:03:45.861 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dba7fc640 1 -- 172.21.15.81:0/466036752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db40b0040 con 0x7f7dc4096ff0 2024-09-18T02:03:45.861 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dcbbec640 1 -- 172.21.15.81:0/466036752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc4127740 con 0x7f7dc4096ff0 2024-09-18T02:03:45.861 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dba7fc640 1 -- 172.21.15.81:0/466036752 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f7db40bd020 con 0x7f7dc4096ff0 2024-09-18T02:03:45.861 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dcbbec640 1 -- 172.21.15.81:0/466036752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc40008e0 con 0x7f7dc4096ff0 2024-09-18T02:03:45.861 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dba7fc640 1 --2- 172.21.15.81:0/466036752 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7da8035d20 0x7f7da80381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:45.861 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dba7fc640 1 -- 172.21.15.81:0/466036752 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7f7db40e2740 con 0x7f7dc4096ff0 2024-09-18T02:03:45.861 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dc9187640 1 --2- 172.21.15.81:0/466036752 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7da8035d20 0x7f7da80381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:45.862 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.855+0000 7f7dc9187640 1 --2- 172.21.15.81:0/466036752 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7da8035d20 0x7f7da80381e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0001600 tx=0x7f7dc0007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:45.865 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:45.859+0000 7f7dba7fc640 1 -- 172.21.15.81:0/466036752 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7db40c4030 con 0x7f7dc4096ff0 2024-09-18T02:03:46.032 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.027+0000 7f7dcbbec640 1 -- 172.21.15.81:0/466036752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dc4128250 con 0x7f7dc4096ff0 2024-09-18T02:03:46.033 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.027+0000 7f7dba7fc640 1 -- 172.21.15.81:0/466036752 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7987 (secure 0 0 0) 0x7f7db40160b0 con 0x7f7dc4096ff0 2024-09-18T02:03:46.033 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-18T02:03:46.033 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":12,"fsid":"ecc0241d-08c6-448c-b756-3dfc0b24e44a","created":"2024-09-18T02:03:30.533838+0000","modified":"2024-09-18T02:03:44.238584+0000","last_up_change":"2024-09-18T02:03:41.233979+0000","last_in_change":"2024-09-18T02:03:31.763486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T02:03:41.319245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b17845b8-f230-4bb1-b552-c6d3048d5a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6801","nonce":3087415523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6803","nonce":3087415523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6807","nonce":3087415523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6805","nonce":3087415523}]},"public_addr":"172.21.15.81:6801/3087415523","cluster_addr":"172.21.15.81:6803/3087415523","heartbeat_back_addr":"172.21.15.81:6807/3087415523","heartbeat_front_addr":"172.21.15.81:6805/3087415523","state":["exists","up"]},{"osd":1,"uuid":"85eae91e-91f0-4bbd-a025-16ef101df8d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6801","nonce":15864359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6803","nonce":15864359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6807","nonce":15864359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6805","nonce":15864359}]},"public_addr":"172.21.15.167:6801/15864359","cluster_addr":"172.21.15.167:6803/15864359","heartbeat_back_addr":"172.21.15.167:6807/15864359","heartbeat_front_addr":"172.21.15.167:6805/15864359","state":["exists","up"]},{"osd":2,"uuid":"35bf8e14-6400-40c9-9d6c-a228b047458b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6817","nonce":2055439504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6819","nonce":2055439504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6823","nonce":2055439504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6821","nonce":2055439504}]},"public_addr":"172.21.15.167:6817/2055439504","cluster_addr":"172.21.15.167:6819/2055439504","heartbeat_back_addr":"172.21.15.167:6823/2055439504","heartbeat_front_addr":"172.21.15.167:6821/2055439504","state":["exists","up"]},{"osd":3,"uuid":"9280ccbf-551d-432d-94c2-41fdb665034e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6809","nonce":2476454287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6811","nonce":2476454287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6815","nonce":2476454287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6813","nonce":2476454287}]},"public_addr":"172.21.15.167:6809/2476454287","cluster_addr":"172.21.15.167:6811/2476454287","heartbeat_back_addr":"172.21.15.167:6815/2476454287","heartbeat_front_addr":"172.21.15.167:6813/2476454287","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.444853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.997062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:39.149505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.755822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T02:03:46.036 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.031+0000 7f7dcbbec640 1 -- 172.21.15.81:0/466036752 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7da8035d20 msgr2=0x7f7da80381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:46.036 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.031+0000 7f7dcbbec640 1 --2- 172.21.15.81:0/466036752 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7da8035d20 0x7f7da80381e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0001600 tx=0x7f7dc0007a50 comp rx=0 tx=0).stop 2024-09-18T02:03:46.036 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.031+0000 7f7dcbbec640 1 -- 172.21.15.81:0/466036752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc4096ff0 msgr2=0x7f7dc41c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:46.036 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.031+0000 7f7dcbbec640 1 --2- 172.21.15.81:0/466036752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc4096ff0 0x7f7dc41c6780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7db401a0f0 tx=0x7f7db401ad00 comp rx=0 tx=0).stop 2024-09-18T02:03:46.036 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.031+0000 7f7dcbbec640 1 -- 172.21.15.81:0/466036752 shutdown_connections 2024-09-18T02:03:46.036 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.031+0000 7f7dcbbec640 1 --2- 172.21.15.81:0/466036752 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7da8035d20 0x7f7da80381e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:46.036 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.031+0000 7f7dcbbec640 1 --2- 172.21.15.81:0/466036752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc4096ff0 0x7f7dc41c6780 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:46.036 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.031+0000 7f7dcbbec640 1 -- 172.21.15.81:0/466036752 >> 172.21.15.81:0/466036752 conn(0x7f7dc4099c40 msgr2=0x7f7dc4072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:46.036 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.031+0000 7f7dcbbec640 1 -- 172.21.15.81:0/466036752 shutdown_connections 2024-09-18T02:03:46.036 INFO:teuthology.misc.health.smithi081.stderr:2024-09-18T02:03:46.031+0000 7f7dcbbec640 1 -- 172.21.15.81:0/466036752 wait complete. 2024-09-18T02:03:46.051 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-18T02:03:46.051 INFO:tasks.ceph:Creating RBD pool 2024-09-18T02:03:46.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-18T02:03:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce2280e640 1 Processor -- start 2024-09-18T02:03:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce2280e640 1 -- start start 2024-09-18T02:03:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce2280e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce1c12e6f0 0x7fce1c12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce2280e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce1c098d50 con 0x7fce1c12f1c0 2024-09-18T02:03:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce2280e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fce1c06eba0 con 0x7fce1c12e6f0 2024-09-18T02:03:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce1bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce1c12e6f0 0x7fce1c12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce1b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fce1c12f1c0 0x7fce1c12b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45014/0 (socket says 172.21.15.81:45014) 2024-09-18T02:03:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce1b7fe640 1 -- 172.21.15.81:0/1702066739 learned_addr learned my addr 172.21.15.81:0/1702066739 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce1bfff640 1 -- 172.21.15.81:0/1702066739 >> v1:172.21.15.81:6789/0 conn(0x7fce1c12f1c0 legacy=0x7fce1c12b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce1bfff640 1 -- 172.21.15.81:0/1702066739 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c06ed60 con 0x7fce1c12e6f0 2024-09-18T02:03:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce1affd640 1 -- 172.21.15.81:0/1702066739 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750194627 0 0) 0x7fce10001120 con 0x7fce1c12f1c0 2024-09-18T02:03:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce1bfff640 1 --2- 172.21.15.81:0/1702066739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1c12e6f0 0x7fce1c12ec80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fce14009d90 tx=0x7fce1401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847ce572358b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce1affd640 1 -- 172.21.15.81:0/1702066739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce140a6560 con 0x7fce1c12e6f0 2024-09-18T02:03:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce1affd640 1 -- 172.21.15.81:0/1702066739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce140a6700 con 0x7fce1c12e6f0 2024-09-18T02:03:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.175+0000 7fce1affd640 1 -- 172.21.15.81:0/1702066739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce140a6a00 con 0x7fce1c12e6f0 2024-09-18T02:03:46.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 -- 172.21.15.81:0/1702066739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1c12e6f0 msgr2=0x7fce1c12ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:46.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 --2- 172.21.15.81:0/1702066739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1c12e6f0 0x7fce1c12ec80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fce14009d90 tx=0x7fce1401c8c0 comp rx=0 tx=0).stop 2024-09-18T02:03:46.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 -- 172.21.15.81:0/1702066739 shutdown_connections 2024-09-18T02:03:46.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 --2- 172.21.15.81:0/1702066739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1c12e6f0 0x7fce1c12ec80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 -- 172.21.15.81:0/1702066739 >> 172.21.15.81:0/1702066739 conn(0x7fce1c0a1030 msgr2=0x7fce1c0a1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 -- 172.21.15.81:0/1702066739 shutdown_connections 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 -- 172.21.15.81:0/1702066739 wait complete. 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 Processor -- start 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 -- start start 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1c12e6f0 0x7fce1c130980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c137610 con 0x7fce1c12e6f0 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1c12e6f0 0x7fce1c130980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1c12e6f0 0x7fce1c130980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59090/0 (socket says 172.21.15.81:59090) 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce1bfff640 1 -- 172.21.15.81:0/827779136 learned_addr learned my addr 172.21.15.81:0/827779136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce1bfff640 1 -- 172.21.15.81:0/827779136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c132ed0 con 0x7fce1c12e6f0 2024-09-18T02:03:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce1bfff640 1 --2- 172.21.15.81:0/827779136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1c12e6f0 0x7fce1c130980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fce1401a4f0 tx=0x7fce14019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:46.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce18ff9640 1 -- 172.21.15.81:0/827779136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce140a7750 con 0x7fce1c12e6f0 2024-09-18T02:03:46.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce18ff9640 1 -- 172.21.15.81:0/827779136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce140c0070 con 0x7fce1c12e6f0 2024-09-18T02:03:46.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 -- 172.21.15.81:0/827779136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1c133390 con 0x7fce1c12e6f0 2024-09-18T02:03:46.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce18ff9640 1 -- 172.21.15.81:0/827779136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce140a7a20 con 0x7fce1c12e6f0 2024-09-18T02:03:46.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 -- 172.21.15.81:0/827779136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce1c130ec0 con 0x7fce1c12e6f0 2024-09-18T02:03:46.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce2280e640 1 -- 172.21.15.81:0/827779136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1c131af0 con 0x7fce1c12e6f0 2024-09-18T02:03:46.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce18ff9640 1 -- 172.21.15.81:0/827779136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7fce140a7bc0 con 0x7fce1c12e6f0 2024-09-18T02:03:46.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce18ff9640 1 --2- 172.21.15.81:0/827779136 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fce08035d20 0x7fce080381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:46.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce18ff9640 1 -- 172.21.15.81:0/827779136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7fce140e3980 con 0x7fce1c12e6f0 2024-09-18T02:03:46.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.179+0000 7fce1b7fe640 1 --2- 172.21.15.81:0/827779136 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fce08035d20 0x7fce080381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:46.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.183+0000 7fce1b7fe640 1 --2- 172.21.15.81:0/827779136 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fce08035d20 0x7fce080381e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fce100013c0 tx=0x7fce10001330 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:46.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.183+0000 7fce18ff9640 1 -- 172.21.15.81:0/827779136 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fce140ac030 con 0x7fce1c12e6f0 2024-09-18T02:03:46.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.247+0000 7fce18ff9640 1 -- 172.21.15.81:0/827779136 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fce140baaf0 con 0x7fce1c12e6f0 2024-09-18T02:03:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:46.355+0000 7fce2280e640 1 -- 172.21.15.81:0/827779136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fce1c132260 con 0x7fce1c12e6f0 2024-09-18T02:03:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.259+0000 7fce18ff9640 1 -- 172.21.15.81:0/827779136 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) ==== 109+0+0 (secure 0 0 0) 0x7fce14016540 con 0x7fce1c12e6f0 2024-09-18T02:03:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'rbd' created 2024-09-18T02:03:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.263+0000 7fce2280e640 1 -- 172.21.15.81:0/827779136 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fce08035d20 msgr2=0x7fce080381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.263+0000 7fce2280e640 1 --2- 172.21.15.81:0/827779136 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fce08035d20 0x7fce080381e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fce100013c0 tx=0x7fce10001330 comp rx=0 tx=0).stop 2024-09-18T02:03:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.263+0000 7fce2280e640 1 -- 172.21.15.81:0/827779136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1c12e6f0 msgr2=0x7fce1c130980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.263+0000 7fce2280e640 1 --2- 172.21.15.81:0/827779136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1c12e6f0 0x7fce1c130980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fce1401a4f0 tx=0x7fce14019660 comp rx=0 tx=0).stop 2024-09-18T02:03:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.263+0000 7fce2280e640 1 -- 172.21.15.81:0/827779136 shutdown_connections 2024-09-18T02:03:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.263+0000 7fce2280e640 1 --2- 172.21.15.81:0/827779136 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fce08035d20 0x7fce080381e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.263+0000 7fce2280e640 1 --2- 172.21.15.81:0/827779136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1c12e6f0 0x7fce1c130980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.263+0000 7fce2280e640 1 -- 172.21.15.81:0/827779136 >> 172.21.15.81:0/827779136 conn(0x7fce1c0a1030 msgr2=0x7fce1c09b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.263+0000 7fce2280e640 1 -- 172.21.15.81:0/827779136 shutdown_connections 2024-09-18T02:03:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.263+0000 7fce2280e640 1 -- 172.21.15.81:0/827779136 wait complete. 2024-09-18T02:03:47.289 DEBUG:teuthology.orchestra.run.smithi081:> rbd --cluster ceph pool init rbd 2024-09-18T02:03:47.364 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:03:47.364 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:03:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.359+0000 7f4cfe5fbf80 1 Processor -- start 2024-09-18T02:03:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.359+0000 7f4cfe5fbf80 1 -- start start 2024-09-18T02:03:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cfe5fbf80 1 --2- >> v2:172.21.15.81:3300/0 conn(0x555c665f8f50 0x555c665f9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cfe5fbf80 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x555c663edea0 con 0x555c665f9870 2024-09-18T02:03:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cfe5fbf80 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x555c663e2e20 con 0x555c665f8f50 2024-09-18T02:03:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cfd10f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x555c665f8f50 0x555c665f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cfd10f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x555c665f8f50 0x555c665f9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39092/0 (socket says 172.21.15.81:39092) 2024-09-18T02:03:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cfd10f640 1 -- 172.21.15.81:0/2821379139 learned_addr learned my addr 172.21.15.81:0/2821379139 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cfd10f640 1 -- 172.21.15.81:0/2821379139 >> v1:172.21.15.81:6789/0 conn(0x555c665f9870 legacy=0x555c6654e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cf7fff640 1 -- 172.21.15.81:0/2821379139 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2355099501 0 0) 0x555c663edea0 con 0x555c665f9870 2024-09-18T02:03:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cfd10f640 1 -- 172.21.15.81:0/2821379139 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c663d4180 con 0x555c665f8f50 2024-09-18T02:03:47.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cfd10f640 1 --2- 172.21.15.81:0/2821379139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c665f8f50 0x555c665f9330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800a5c0 tx=0x7f4ce801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fdc66f8de92129 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:47.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cf7fff640 1 -- 172.21.15.81:0/2821379139 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ce80af070 con 0x555c665f8f50 2024-09-18T02:03:47.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cf7fff640 1 -- 172.21.15.81:0/2821379139 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce80aa530 con 0x555c665f8f50 2024-09-18T02:03:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.363+0000 7f4cf7fff640 1 -- 172.21.15.81:0/2821379139 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ce80aa830 con 0x555c665f8f50 2024-09-18T02:03:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/2821379139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c665f8f50 msgr2=0x555c665f9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 --2- 172.21.15.81:0/2821379139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c665f8f50 0x555c665f9330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800a5c0 tx=0x7f4ce801b340 comp rx=0 tx=0).stop 2024-09-18T02:03:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/2821379139 shutdown_connections 2024-09-18T02:03:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 --2- 172.21.15.81:0/2821379139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c665f8f50 0x555c665f9330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/2821379139 >> 172.21.15.81:0/2821379139 conn(0x555c6656abf0 msgr2=0x555c66567030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/2821379139 shutdown_connections 2024-09-18T02:03:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/2821379139 wait complete. 2024-09-18T02:03:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 Processor -- start 2024-09-18T02:03:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 -- start start 2024-09-18T02:03:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c665f8f50 0x555c665fdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555c66439800 con 0x555c665f8f50 2024-09-18T02:03:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfd10f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c665f8f50 0x555c665fdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfd10f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c665f8f50 0x555c665fdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39100/0 (socket says 172.21.15.81:39100) 2024-09-18T02:03:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfd10f640 1 -- 172.21.15.81:0/577147587 learned_addr learned my addr 172.21.15.81:0/577147587 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfd10f640 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c663be990 con 0x555c665f8f50 2024-09-18T02:03:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfd10f640 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c665f8f50 0x555c665fdec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8018f70 tx=0x7f4ce80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ce80ba070 con 0x555c665f8f50 2024-09-18T02:03:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce80b5650 con 0x555c665f8f50 2024-09-18T02:03:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c665fcd60 con 0x555c665f8f50 2024-09-18T02:03:47.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ce80af040 con 0x555c665f8f50 2024-09-18T02:03:47.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.367+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c665fe610 con 0x555c665f8f50 2024-09-18T02:03:47.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.371+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4ce80bd070 con 0x555c665f8f50 2024-09-18T02:03:47.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.371+0000 7f4cf57fa640 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ce00346a0 0x7f4ce0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:47.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.371+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3471+0+0 (secure 0 0 0) 0x7f4ce80a3e00 con 0x555c665f8f50 2024-09-18T02:03:47.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.371+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x555c665feaa0 con 0x555c665f8f50 2024-09-18T02:03:47.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.371+0000 7f4cfc90e640 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ce00346a0 0x7f4ce0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:47.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:47.371+0000 7f4cfc90e640 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ce00346a0 0x7f4ce0036b60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0000f70 tx=0x7f4cf0001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.259+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v14) ==== 141+0+0 (secure 0 0 0) 0x7f4ce8014fc0 con 0x555c665f8f50 2024-09-18T02:03:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.259+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ce80aa530 con 0x555c665f8f50 2024-09-18T02:03:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.263+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f4ce8006750 con 0x555c665f8f50 2024-09-18T02:03:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.263+0000 7f4cf77fe640 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7f4cd8002af0 con 0x555c665f8f50 2024-09-18T02:03:48.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.271+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 8 ==== osd_map(14..14 src has 1..14) ==== 650+0+0 (secure 0 0 0) 0x7f4ce80a97c0 con 0x555c665f8f50 2024-09-18T02:03:48.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.271+0000 7f4cfe5fbf80 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555c665f9870 0x555c66562ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:48.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.271+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x555c66612130 con 0x555c665f9870 2024-09-18T02:03:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.271+0000 7f4cfe371640 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555c665f9870 0x555c66562ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:48.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.271+0000 7f4cfe371640 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555c665f9870 0x555c66562ac0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:48.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.275+0000 7f4cfe371640 1 -- 172.21.15.81:0/577147587 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(1 rbd_trash [create] v14'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f4cf800a4d0 con 0x555c665f9870 2024-09-18T02:03:48.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.279+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x555c666633c0 con 0x555c665f9870 2024-09-18T02:03:48.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.279+0000 7f4cfe371640 1 -- 172.21.15.81:0/577147587 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4cf800a4d0 con 0x555c665f9870 2024-09-18T02:03:48.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.283+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x555c666624d0 con 0x555c665f9870 2024-09-18T02:03:48.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.283+0000 7f4cfe371640 1 -- 172.21.15.81:0/577147587 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4cf800a4d0 con 0x555c665f9870 2024-09-18T02:03:48.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:48.283+0000 7f4cf6ffd640 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f4cdc001f10 con 0x555c665f8f50 2024-09-18T02:03:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:49.271+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v15) ==== 55+0+0 (secure 0 0 0) 0x7f4ce80b5950 con 0x555c665f8f50 2024-09-18T02:03:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:49.271+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f4ce003a1a0 con 0x555c665f8f50 2024-09-18T02:03:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:49.271+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 10 ==== osd_map(15..15 src has 1..15) ==== 626+0+0 (secure 0 0 0) 0x7f4ce80e01b0 con 0x555c665f8f50 2024-09-18T02:03:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:49.275+0000 7f4cf77fe640 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7f4cd8005690 con 0x555c665f9870 2024-09-18T02:03:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:49.279+0000 7f4cfe371640 1 -- 172.21.15.81:0/577147587 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v15'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4cf800a4d0 con 0x555c665f9870 2024-09-18T02:03:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:49.279+0000 7f4cf6ffd640 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v15) -- 0x7f4cdc003360 con 0x555c665f8f50 2024-09-18T02:03:50.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.279+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v16) ==== 43+0+0 (secure 0 0 0) 0x7f4ce80bd360 con 0x555c665f8f50 2024-09-18T02:03:50.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.279+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f4ce003a420 con 0x555c665f8f50 2024-09-18T02:03:50.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.279+0000 7f4cf57fa640 1 -- 172.21.15.81:0/577147587 <== mon.0 v2:172.21.15.81:3300/0 12 ==== osd_map(16..16 src has 1..16) ==== 654+0+0 (secure 0 0 0) 0x7f4ce80bdc80 con 0x555c665f8f50 2024-09-18T02:03:50.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.279+0000 7f4cf77fe640 1 -- 172.21.15.81:0/577147587 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f4cd8005a30 con 0x555c665f9870 2024-09-18T02:03:50.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.283+0000 7f4cfe371640 1 -- 172.21.15.81:0/577147587 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(7 rbd_info [write 0~19] v16'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf800a4d0 con 0x555c665f9870 2024-09-18T02:03:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555c665f9870 msgr2=0x555c66562ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555c665f9870 0x555c66562ac0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ce00346a0 msgr2=0x7f4ce0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ce00346a0 0x7f4ce0036b60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0000f70 tx=0x7f4cf0001400 comp rx=0 tx=0).stop 2024-09-18T02:03:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c665f8f50 msgr2=0x555c665fdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c665f8f50 0x555c665fdec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8018f70 tx=0x7f4ce80180e0 comp rx=0 tx=0).stop 2024-09-18T02:03:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 shutdown_connections 2024-09-18T02:03:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555c665f9870 0x555c66562ac0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ce00346a0 0x7f4ce0036b60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 --2- 172.21.15.81:0/577147587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c665f8f50 0x555c665fdec0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 >> 172.21.15.81:0/577147587 conn(0x555c6656abf0 msgr2=0x555c665f5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 shutdown_connections 2024-09-18T02:03:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.287+0000 7f4cfe5fbf80 1 -- 172.21.15.81:0/577147587 wait complete. 2024-09-18T02:03:50.299 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-18T02:03:50.300 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T02:03:50.300 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-18T02:03:50.300 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-18T02:03:50.301 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-18T02:03:50.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.427+0000 7fcecc614640 1 Processor -- start 2024-09-18T02:03:50.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.427+0000 7fcecc614640 1 -- start start 2024-09-18T02:03:50.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcecc614640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcec4096d80 0x7fcec4133ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:50.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcecc614640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec409ab90 con 0x7fcec4096290 2024-09-18T02:03:50.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcecc614640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fcec40982c0 con 0x7fcec4096d80 2024-09-18T02:03:50.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcec9baf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcec4096d80 0x7fcec4133ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:50.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fceca3b0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcec4096290 0x7fcec4096670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36394/0 (socket says 172.21.15.81:36394) 2024-09-18T02:03:50.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fceca3b0640 1 -- 172.21.15.81:0/3221944167 learned_addr learned my addr 172.21.15.81:0/3221944167 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:50.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcec9baf640 1 -- 172.21.15.81:0/3221944167 >> v1:172.21.15.81:6789/0 conn(0x7fcec4096290 legacy=0x7fcec4096670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:50.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcec9baf640 1 -- 172.21.15.81:0/3221944167 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec40976f0 con 0x7fcec4096d80 2024-09-18T02:03:50.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcec93ae640 1 -- 172.21.15.81:0/3221944167 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1260183107 0 0) 0x7fcec409ab90 con 0x7fcec4096290 2024-09-18T02:03:50.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcec9baf640 1 --2- 172.21.15.81:0/3221944167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcec4096d80 0x7fcec4133ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009740 tx=0x7fceb401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41e2a7e607a7e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:50.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcec93ae640 1 -- 172.21.15.81:0/3221944167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb40b0070 con 0x7fcec4096d80 2024-09-18T02:03:50.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcec93ae640 1 -- 172.21.15.81:0/3221944167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb40ab530 con 0x7fcec4096d80 2024-09-18T02:03:50.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcec93ae640 1 -- 172.21.15.81:0/3221944167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb40ab830 con 0x7fcec4096d80 2024-09-18T02:03:50.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcecc614640 1 -- 172.21.15.81:0/3221944167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcec4096d80 msgr2=0x7fcec4133ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcecc614640 1 --2- 172.21.15.81:0/3221944167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcec4096d80 0x7fcec4133ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009740 tx=0x7fceb401c370 comp rx=0 tx=0).stop 2024-09-18T02:03:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcecc614640 1 -- 172.21.15.81:0/3221944167 shutdown_connections 2024-09-18T02:03:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcecc614640 1 --2- 172.21.15.81:0/3221944167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcec4096d80 0x7fcec4133ec0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcecc614640 1 -- 172.21.15.81:0/3221944167 >> 172.21.15.81:0/3221944167 conn(0x7fcec409bbc0 msgr2=0x7fcec409bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcecc614640 1 -- 172.21.15.81:0/3221944167 shutdown_connections 2024-09-18T02:03:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.431+0000 7fcecc614640 1 -- 172.21.15.81:0/3221944167 wait complete. 2024-09-18T02:03:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcecc614640 1 Processor -- start 2024-09-18T02:03:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcecc614640 1 -- start start 2024-09-18T02:03:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcecc614640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcec4096290 0x7fcec4092710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcecc614640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4098080 con 0x7fcec4096290 2024-09-18T02:03:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fceca3b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcec4096290 0x7fcec4092710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fceca3b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcec4096290 0x7fcec4092710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39128/0 (socket says 172.21.15.81:39128) 2024-09-18T02:03:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fceca3b0640 1 -- 172.21.15.81:0/4203343267 learned_addr learned my addr 172.21.15.81:0/4203343267 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:50.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fceca3b0640 1 -- 172.21.15.81:0/4203343267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec4094ce0 con 0x7fcec4096290 2024-09-18T02:03:50.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fceca3b0640 1 --2- 172.21.15.81:0/4203343267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcec4096290 0x7fcec4092710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c840 tx=0x7fcebc00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcebaffd640 1 -- 172.21.15.81:0/4203343267 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcebc018070 con 0x7fcec4096290 2024-09-18T02:03:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcebaffd640 1 -- 172.21.15.81:0/4203343267 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc00a660 con 0x7fcec4096290 2024-09-18T02:03:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcecc614640 1 -- 172.21.15.81:0/4203343267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec4124310 con 0x7fcec4096290 2024-09-18T02:03:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcebaffd640 1 -- 172.21.15.81:0/4203343267 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcebc00a850 con 0x7fcec4096290 2024-09-18T02:03:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcecc614640 1 -- 172.21.15.81:0/4203343267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec40951a0 con 0x7fcec4096290 2024-09-18T02:03:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcecc614640 1 -- 172.21.15.81:0/4203343267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec4096670 con 0x7fcec4096290 2024-09-18T02:03:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcebaffd640 1 -- 172.21.15.81:0/4203343267 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcebc01b070 con 0x7fcec4096290 2024-09-18T02:03:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcebaffd640 1 --2- 172.21.15.81:0/4203343267 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fcea8035db0 0x7fcea8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcebaffd640 1 -- 172.21.15.81:0/4203343267 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fcebc047dc0 con 0x7fcec4096290 2024-09-18T02:03:50.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.435+0000 7fcec9baf640 1 --2- 172.21.15.81:0/4203343267 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fcea8035db0 0x7fcea8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:50.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.439+0000 7fcec9baf640 1 --2- 172.21.15.81:0/4203343267 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fcea8035db0 0x7fcea8038270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fceb40ad000 tx=0x7fceb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.439+0000 7fcebaffd640 1 -- 172.21.15.81:0/4203343267 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcec4124310 con 0x7fcec4096290 2024-09-18T02:03:50.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.643+0000 7fcecc614640 1 -- 172.21.15.81:0/4203343267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fcec4098d10 con 0x7fcec4096290 2024-09-18T02:03:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.647+0000 7fcebaffd640 1 -- 172.21.15.81:0/4203343267 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+84177 (secure 0 0 0) 0x7fcebc0368f0 con 0x7fcec4096290 2024-09-18T02:03:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:50.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.647+0000 7fcecc614640 1 -- 172.21.15.81:0/4203343267 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fcea8035db0 msgr2=0x7fcea8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:50.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.647+0000 7fcecc614640 1 --2- 172.21.15.81:0/4203343267 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fcea8035db0 0x7fcea8038270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fceb40ad000 tx=0x7fceb4008040 comp rx=0 tx=0).stop 2024-09-18T02:03:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.647+0000 7fcecc614640 1 -- 172.21.15.81:0/4203343267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcec4096290 msgr2=0x7fcec4092710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.647+0000 7fcecc614640 1 --2- 172.21.15.81:0/4203343267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcec4096290 0x7fcec4092710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c840 tx=0x7fcebc00cd00 comp rx=0 tx=0).stop 2024-09-18T02:03:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.647+0000 7fcecc614640 1 -- 172.21.15.81:0/4203343267 shutdown_connections 2024-09-18T02:03:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.647+0000 7fcecc614640 1 --2- 172.21.15.81:0/4203343267 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fcea8035db0 0x7fcea8038270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.647+0000 7fcecc614640 1 --2- 172.21.15.81:0/4203343267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcec4096290 0x7fcec4092710 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.647+0000 7fcecc614640 1 -- 172.21.15.81:0/4203343267 >> 172.21.15.81:0/4203343267 conn(0x7fcec409bbc0 msgr2=0x7fcec406ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.647+0000 7fcecc614640 1 -- 172.21.15.81:0/4203343267 shutdown_connections 2024-09-18T02:03:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.647+0000 7fcecc614640 1 -- 172.21.15.81:0/4203343267 wait complete. 2024-09-18T02:03:50.670 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":909474575},{"type":"v1","addr":"172.21.15.167:6825","nonce":909474575}]},"active_addr":"172.21.15.167:6825/909474575","active_change":"2024-09-18T02:03:35.231218+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":3675979802}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":175269800}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":3291185669}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":1098226255}]}]} 2024-09-18T02:03:50.672 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-18T02:03:50.672 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T02:03:50.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T02:03:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.791+0000 7ff9c8f2d640 1 Processor -- start 2024-09-18T02:03:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.791+0000 7ff9c8f2d640 1 -- start start 2024-09-18T02:03:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.791+0000 7ff9c8f2d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9c406dbd0 0x7ff9c4131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.791+0000 7ff9c8f2d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c4071c10 con 0x7ff9c406d0e0 2024-09-18T02:03:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.791+0000 7ff9c8f2d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c4072230 con 0x7ff9c406dbd0 2024-09-18T02:03:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.791+0000 7ff9c1d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9c406dbd0 0x7ff9c4131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.791+0000 7ff9c259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff9c406d0e0 0x7ff9c406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36402/0 (socket says 172.21.15.81:36402) 2024-09-18T02:03:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.791+0000 7ff9c259c640 1 -- 172.21.15.81:0/2733415550 learned_addr learned my addr 172.21.15.81:0/2733415550 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c1d9b640 1 -- 172.21.15.81:0/2733415550 >> v1:172.21.15.81:6789/0 conn(0x7ff9c406d0e0 legacy=0x7ff9c406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c1d9b640 1 -- 172.21.15.81:0/2733415550 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c40709e0 con 0x7ff9c406dbd0 2024-09-18T02:03:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c1d9b640 1 --2- 172.21.15.81:0/2733415550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c406dbd0 0x7ff9c4131e60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009740 tx=0x7ff9b801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f28b9d058dccffa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c159a640 1 -- 172.21.15.81:0/2733415550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b80b0070 con 0x7ff9c406dbd0 2024-09-18T02:03:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c159a640 1 -- 172.21.15.81:0/2733415550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b80ab530 con 0x7ff9c406dbd0 2024-09-18T02:03:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c159a640 1 -- 172.21.15.81:0/2733415550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b80ab830 con 0x7ff9c406dbd0 2024-09-18T02:03:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/2733415550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c406dbd0 msgr2=0x7ff9c4131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c8f2d640 1 --2- 172.21.15.81:0/2733415550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c406dbd0 0x7ff9c4131e60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009740 tx=0x7ff9b801c370 comp rx=0 tx=0).stop 2024-09-18T02:03:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/2733415550 shutdown_connections 2024-09-18T02:03:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c8f2d640 1 --2- 172.21.15.81:0/2733415550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c406dbd0 0x7ff9c4131e60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/2733415550 >> 172.21.15.81:0/2733415550 conn(0x7ff9c4099a50 msgr2=0x7ff9c40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/2733415550 shutdown_connections 2024-09-18T02:03:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.795+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/2733415550 wait complete. 2024-09-18T02:03:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c8f2d640 1 Processor -- start 2024-09-18T02:03:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c8f2d640 1 -- start start 2024-09-18T02:03:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c8f2d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c406d0e0 0x7ff9c406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c8f2d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c4134d40 con 0x7ff9c406d0e0 2024-09-18T02:03:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c406d0e0 0x7ff9c406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c406d0e0 0x7ff9c406e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39148/0 (socket says 172.21.15.81:39148) 2024-09-18T02:03:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c259c640 1 -- 172.21.15.81:0/780233786 learned_addr learned my addr 172.21.15.81:0/780233786 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c259c640 1 -- 172.21.15.81:0/780233786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c408b730 con 0x7ff9c406d0e0 2024-09-18T02:03:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c259c640 1 --2- 172.21.15.81:0/780233786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c406d0e0 0x7ff9c406e1f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c3a0 tx=0x7ff9b400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9b2ffd640 1 -- 172.21.15.81:0/780233786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b4017070 con 0x7ff9c406d0e0 2024-09-18T02:03:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9b2ffd640 1 -- 172.21.15.81:0/780233786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b4005c20 con 0x7ff9c406d0e0 2024-09-18T02:03:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/780233786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c4129fd0 con 0x7ff9c406d0e0 2024-09-18T02:03:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9b2ffd640 1 -- 172.21.15.81:0/780233786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b40070d0 con 0x7ff9c406d0e0 2024-09-18T02:03:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/780233786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c408b9d0 con 0x7ff9c406d0e0 2024-09-18T02:03:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9b2ffd640 1 -- 172.21.15.81:0/780233786 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9b401a070 con 0x7ff9c406d0e0 2024-09-18T02:03:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/780233786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c406d4c0 con 0x7ff9c406d0e0 2024-09-18T02:03:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9b2ffd640 1 --2- 172.21.15.81:0/780233786 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff9a4035db0 0x7ff9a4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9b2ffd640 1 -- 172.21.15.81:0/780233786 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7ff9b4047970 con 0x7ff9c406d0e0 2024-09-18T02:03:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c1d9b640 1 --2- 172.21.15.81:0/780233786 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff9a4035db0 0x7ff9a4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.799+0000 7ff9c1d9b640 1 --2- 172.21.15.81:0/780233786 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff9a4035db0 0x7ff9a4038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80ad000 tx=0x7ff9b80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:50.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.803+0000 7ff9b2ffd640 1 -- 172.21.15.81:0/780233786 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff9c408b730 con 0x7ff9c406d0e0 2024-09-18T02:03:50.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.967+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/780233786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9c4073790 con 0x7ff9c406d0e0 2024-09-18T02:03:50.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.967+0000 7ff9b2ffd640 1 -- 172.21.15.81:0/780233786 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9887 (secure 0 0 0) 0x7ff9b4007270 con 0x7ff9c406d0e0 2024-09-18T02:03:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:50.974 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"fsid":"ecc0241d-08c6-448c-b756-3dfc0b24e44a","created":"2024-09-18T02:03:30.533838+0000","modified":"2024-09-18T02:03:50.273428+0000","last_up_change":"2024-09-18T02:03:41.233979+0000","last_in_change":"2024-09-18T02:03:31.763486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T02:03:41.319245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T02:03:46.394794+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b17845b8-f230-4bb1-b552-c6d3048d5a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6801","nonce":3087415523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6803","nonce":3087415523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6807","nonce":3087415523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6805","nonce":3087415523}]},"public_addr":"172.21.15.81:6801/3087415523","cluster_addr":"172.21.15.81:6803/3087415523","heartbeat_back_addr":"172.21.15.81:6807/3087415523","heartbeat_front_addr":"172.21.15.81:6805/3087415523","state":["exists","up"]},{"osd":1,"uuid":"85eae91e-91f0-4bbd-a025-16ef101df8d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6801","nonce":15864359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6803","nonce":15864359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6807","nonce":15864359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6805","nonce":15864359}]},"public_addr":"172.21.15.167:6801/15864359","cluster_addr":"172.21.15.167:6803/15864359","heartbeat_back_addr":"172.21.15.167:6807/15864359","heartbeat_front_addr":"172.21.15.167:6805/15864359","state":["exists","up"]},{"osd":2,"uuid":"35bf8e14-6400-40c9-9d6c-a228b047458b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6817","nonce":2055439504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6819","nonce":2055439504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6823","nonce":2055439504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6821","nonce":2055439504}]},"public_addr":"172.21.15.167:6817/2055439504","cluster_addr":"172.21.15.167:6819/2055439504","heartbeat_back_addr":"172.21.15.167:6823/2055439504","heartbeat_front_addr":"172.21.15.167:6821/2055439504","state":["exists","up"]},{"osd":3,"uuid":"9280ccbf-551d-432d-94c2-41fdb665034e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6809","nonce":2476454287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6811","nonce":2476454287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6815","nonce":2476454287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6813","nonce":2476454287}]},"public_addr":"172.21.15.167:6809/2476454287","cluster_addr":"172.21.15.167:6811/2476454287","heartbeat_back_addr":"172.21.15.167:6815/2476454287","heartbeat_front_addr":"172.21.15.167:6813/2476454287","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.444853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.997062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:39.149505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.755822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T02:03:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.971+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/780233786 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff9a4035db0 msgr2=0x7ff9a4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.971+0000 7ff9c8f2d640 1 --2- 172.21.15.81:0/780233786 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff9a4035db0 0x7ff9a4038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80ad000 tx=0x7ff9b80a6000 comp rx=0 tx=0).stop 2024-09-18T02:03:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.971+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/780233786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c406d0e0 msgr2=0x7ff9c406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.971+0000 7ff9c8f2d640 1 --2- 172.21.15.81:0/780233786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c406d0e0 0x7ff9c406e1f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c3a0 tx=0x7ff9b400c860 comp rx=0 tx=0).stop 2024-09-18T02:03:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.971+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/780233786 shutdown_connections 2024-09-18T02:03:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.971+0000 7ff9c8f2d640 1 --2- 172.21.15.81:0/780233786 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff9a4035db0 0x7ff9a4038270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.971+0000 7ff9c8f2d640 1 --2- 172.21.15.81:0/780233786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c406d0e0 0x7ff9c406e1f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.971+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/780233786 >> 172.21.15.81:0/780233786 conn(0x7ff9c4099a50 msgr2=0x7ff9c409b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.971+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/780233786 shutdown_connections 2024-09-18T02:03:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:50.971+0000 7ff9c8f2d640 1 -- 172.21.15.81:0/780233786 wait complete. 2024-09-18T02:03:50.993 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T02:03:50.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T02:03:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.099+0000 7f75287db640 1 Processor -- start 2024-09-18T02:03:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.099+0000 7f75287db640 1 -- start start 2024-09-18T02:03:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.099+0000 7f75287db640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f752012e760 0x7f752012ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.099+0000 7f75287db640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75200984f0 con 0x7f752012f1c0 2024-09-18T02:03:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.099+0000 7f75287db640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7520098dc0 con 0x7f752012e760 2024-09-18T02:03:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.103+0000 7f7526577640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f752012e760 0x7f752012ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.103+0000 7f7525d76640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f752012f1c0 0x7f752012b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36406/0 (socket says 172.21.15.81:36406) 2024-09-18T02:03:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.103+0000 7f7525d76640 1 -- 172.21.15.81:0/1425251556 learned_addr learned my addr 172.21.15.81:0/1425251556 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.103+0000 7f7525575640 1 -- 172.21.15.81:0/1425251556 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1921171748 0 0) 0x7f75200984f0 con 0x7f752012f1c0 2024-09-18T02:03:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.103+0000 7f7525575640 1 -- 172.21.15.81:0/1425251556 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f750c003530 con 0x7f752012f1c0 2024-09-18T02:03:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.103+0000 7f7526577640 1 -- 172.21.15.81:0/1425251556 >> v1:172.21.15.81:6789/0 conn(0x7f752012f1c0 legacy=0x7f752012b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.103+0000 7f7526577640 1 -- 172.21.15.81:0/1425251556 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752012f5a0 con 0x7f752012e760 2024-09-18T02:03:51.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7526577640 1 --2- 172.21.15.81:0/1425251556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752012e760 0x7f752012ec80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7510009740 tx=0x7f751001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4dc03701d5eb934 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7525575640 1 -- 172.21.15.81:0/1425251556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75100b0070 con 0x7f752012e760 2024-09-18T02:03:51.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7525575640 1 -- 172.21.15.81:0/1425251556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75100ab530 con 0x7f752012e760 2024-09-18T02:03:51.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7525575640 1 -- 172.21.15.81:0/1425251556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75100ab810 con 0x7f752012e760 2024-09-18T02:03:51.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 -- 172.21.15.81:0/1425251556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752012e760 msgr2=0x7f752012ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 --2- 172.21.15.81:0/1425251556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752012e760 0x7f752012ec80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7510009740 tx=0x7f751001c400 comp rx=0 tx=0).stop 2024-09-18T02:03:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 -- 172.21.15.81:0/1425251556 shutdown_connections 2024-09-18T02:03:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 --2- 172.21.15.81:0/1425251556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752012e760 0x7f752012ec80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 -- 172.21.15.81:0/1425251556 >> 172.21.15.81:0/1425251556 conn(0x7f75200a10a0 msgr2=0x7f75200a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 -- 172.21.15.81:0/1425251556 shutdown_connections 2024-09-18T02:03:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 -- 172.21.15.81:0/1425251556 wait complete. 2024-09-18T02:03:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 Processor -- start 2024-09-18T02:03:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 -- start start 2024-09-18T02:03:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752012e760 0x7f75201c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7520136e30 con 0x7f752012e760 2024-09-18T02:03:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7526577640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752012e760 0x7f75201c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7526577640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752012e760 0x7f75201c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39158/0 (socket says 172.21.15.81:39158) 2024-09-18T02:03:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7526577640 1 -- 172.21.15.81:0/2963322447 learned_addr learned my addr 172.21.15.81:0/2963322447 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7526577640 1 -- 172.21.15.81:0/2963322447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752009e490 con 0x7f752012e760 2024-09-18T02:03:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7526577640 1 --2- 172.21.15.81:0/2963322447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752012e760 0x7f75201c64a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f751001a030 tx=0x7f751001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7516ffd640 1 -- 172.21.15.81:0/2963322447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75100b0050 con 0x7f752012e760 2024-09-18T02:03:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7516ffd640 1 -- 172.21.15.81:0/2963322447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75100b1040 con 0x7f752012e760 2024-09-18T02:03:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 -- 172.21.15.81:0/2963322447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75201321a0 con 0x7f752012e760 2024-09-18T02:03:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f7516ffd640 1 -- 172.21.15.81:0/2963322447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75100b75a0 con 0x7f752012e760 2024-09-18T02:03:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 -- 172.21.15.81:0/2963322447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f752009dc00 con 0x7f752012e760 2024-09-18T02:03:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.107+0000 7f75287db640 1 -- 172.21.15.81:0/2963322447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7520131550 con 0x7f752012e760 2024-09-18T02:03:51.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.111+0000 7f7516ffd640 1 -- 172.21.15.81:0/2963322447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f75100be030 con 0x7f752012e760 2024-09-18T02:03:51.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.111+0000 7f7516ffd640 1 --2- 172.21.15.81:0/2963322447 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7504035db0 0x7f7504038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.111+0000 7f7516ffd640 1 -- 172.21.15.81:0/2963322447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f75100bc070 con 0x7f752012e760 2024-09-18T02:03:51.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.111+0000 7f7525d76640 1 --2- 172.21.15.81:0/2963322447 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7504035db0 0x7f7504038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.111+0000 7f7525d76640 1 --2- 172.21.15.81:0/2963322447 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7504035db0 0x7f7504038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f751c007fd0 tx=0x7f751c007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.115+0000 7f7516ffd640 1 -- 172.21.15.81:0/2963322447 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f75100c5060 con 0x7f752012e760 2024-09-18T02:03:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.279+0000 7f75287db640 1 -- 172.21.15.81:0/2963322447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f752012ec80 con 0x7f752012e760 2024-09-18T02:03:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.283+0000 7f7516ffd640 1 -- 172.21.15.81:0/2963322447 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9887 (secure 0 0 0) 0x7f7510015ff0 con 0x7f752012e760 2024-09-18T02:03:51.287 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:51.287 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"fsid":"ecc0241d-08c6-448c-b756-3dfc0b24e44a","created":"2024-09-18T02:03:30.533838+0000","modified":"2024-09-18T02:03:50.273428+0000","last_up_change":"2024-09-18T02:03:41.233979+0000","last_in_change":"2024-09-18T02:03:31.763486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T02:03:41.319245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T02:03:46.394794+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b17845b8-f230-4bb1-b552-c6d3048d5a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6801","nonce":3087415523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6803","nonce":3087415523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6807","nonce":3087415523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6805","nonce":3087415523}]},"public_addr":"172.21.15.81:6801/3087415523","cluster_addr":"172.21.15.81:6803/3087415523","heartbeat_back_addr":"172.21.15.81:6807/3087415523","heartbeat_front_addr":"172.21.15.81:6805/3087415523","state":["exists","up"]},{"osd":1,"uuid":"85eae91e-91f0-4bbd-a025-16ef101df8d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6801","nonce":15864359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6803","nonce":15864359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6807","nonce":15864359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6805","nonce":15864359}]},"public_addr":"172.21.15.167:6801/15864359","cluster_addr":"172.21.15.167:6803/15864359","heartbeat_back_addr":"172.21.15.167:6807/15864359","heartbeat_front_addr":"172.21.15.167:6805/15864359","state":["exists","up"]},{"osd":2,"uuid":"35bf8e14-6400-40c9-9d6c-a228b047458b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6817","nonce":2055439504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6819","nonce":2055439504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6823","nonce":2055439504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6821","nonce":2055439504}]},"public_addr":"172.21.15.167:6817/2055439504","cluster_addr":"172.21.15.167:6819/2055439504","heartbeat_back_addr":"172.21.15.167:6823/2055439504","heartbeat_front_addr":"172.21.15.167:6821/2055439504","state":["exists","up"]},{"osd":3,"uuid":"9280ccbf-551d-432d-94c2-41fdb665034e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6809","nonce":2476454287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6811","nonce":2476454287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6815","nonce":2476454287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6813","nonce":2476454287}]},"public_addr":"172.21.15.167:6809/2476454287","cluster_addr":"172.21.15.167:6811/2476454287","heartbeat_back_addr":"172.21.15.167:6815/2476454287","heartbeat_front_addr":"172.21.15.167:6813/2476454287","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.444853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.997062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:39.149505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.755822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T02:03:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.283+0000 7f75287db640 1 -- 172.21.15.81:0/2963322447 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7504035db0 msgr2=0x7f7504038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.283+0000 7f75287db640 1 --2- 172.21.15.81:0/2963322447 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7504035db0 0x7f7504038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f751c007fd0 tx=0x7f751c007980 comp rx=0 tx=0).stop 2024-09-18T02:03:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.283+0000 7f75287db640 1 -- 172.21.15.81:0/2963322447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752012e760 msgr2=0x7f75201c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.283+0000 7f75287db640 1 --2- 172.21.15.81:0/2963322447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752012e760 0x7f75201c64a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f751001a030 tx=0x7f751001ac40 comp rx=0 tx=0).stop 2024-09-18T02:03:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.283+0000 7f75287db640 1 -- 172.21.15.81:0/2963322447 shutdown_connections 2024-09-18T02:03:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.283+0000 7f75287db640 1 --2- 172.21.15.81:0/2963322447 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7504035db0 0x7f7504038270 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.283+0000 7f75287db640 1 --2- 172.21.15.81:0/2963322447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752012e760 0x7f75201c64a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.283+0000 7f75287db640 1 -- 172.21.15.81:0/2963322447 >> 172.21.15.81:0/2963322447 conn(0x7f75200a10a0 msgr2=0x7f752012c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.283+0000 7f75287db640 1 -- 172.21.15.81:0/2963322447 shutdown_connections 2024-09-18T02:03:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.283+0000 7f75287db640 1 -- 172.21.15.81:0/2963322447 wait complete. 2024-09-18T02:03:51.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T02:03:51.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T02:03:51.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T02:03:51.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-18T02:03:51.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7f570492b640 1 Processor -- start 2024-09-18T02:03:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7f570492b640 1 -- start start 2024-09-18T02:03:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7f570492b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f570006e180 0x7f5700133de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7f570492b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f570006f8a0 con 0x7f570012ed70 2024-09-18T02:03:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7f570492b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f570006eac0 con 0x7f570006e180 2024-09-18T02:03:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7f56fdd9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f570006e180 0x7f5700133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7f56fe59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f570012ed70 0x7f570012f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36412/0 (socket says 172.21.15.81:36412) 2024-09-18T02:03:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7f56fe59c640 1 -- 172.21.15.81:0/1559772221 learned_addr learned my addr 172.21.15.81:0/1559772221 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7f56fdd9b640 1 -- 172.21.15.81:0/1559772221 >> v1:172.21.15.81:6789/0 conn(0x7f570012ed70 legacy=0x7f570012f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7f56fdd9b640 1 -- 172.21.15.81:0/1559772221 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570006fbb0 con 0x7f570006e180 2024-09-18T02:03:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7efd93e41640 1 Processor -- start 2024-09-18T02:03:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.407+0000 7efd93e41640 1 -- start start 2024-09-18T02:03:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd93e41640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd8c12f8e0 0x7efd8c131cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd93e41640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8c06c360 con 0x7efd8c12cba0 2024-09-18T02:03:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd93e41640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7efd8c06beb0 con 0x7efd8c12f8e0 2024-09-18T02:03:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd913dc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd8c12f8e0 0x7efd8c131cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd91bdd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efd8c12cba0 0x7efd8c12cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36426/0 (socket says 172.21.15.81:36426) 2024-09-18T02:03:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd913dc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd8c12f8e0 0x7efd8c131cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39172/0 (socket says 172.21.15.81:39172) 2024-09-18T02:03:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd91bdd640 1 -- 172.21.15.81:0/3776935952 learned_addr learned my addr 172.21.15.81:0/3776935952 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd913dc640 1 -- 172.21.15.81:0/3776935952 >> v1:172.21.15.81:6789/0 conn(0x7efd8c12cba0 legacy=0x7efd8c12cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd913dc640 1 -- 172.21.15.81:0/3776935952 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c12c750 con 0x7efd8c12f8e0 2024-09-18T02:03:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f56fdd9b640 1 --2- 172.21.15.81:0/1559772221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f570006e180 0x7f5700133de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009740 tx=0x7f56f401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5945a04fef2aa94b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f56fd59a640 1 -- 172.21.15.81:0/1559772221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56f40ab550 con 0x7f570006e180 2024-09-18T02:03:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f56fd59a640 1 -- 172.21.15.81:0/1559772221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f40b0070 con 0x7f570006e180 2024-09-18T02:03:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f56fd59a640 1 -- 172.21.15.81:0/1559772221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56f40ab840 con 0x7f570006e180 2024-09-18T02:03:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f570492b640 1 -- 172.21.15.81:0/1559772221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f570006e180 msgr2=0x7f5700133de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f570492b640 1 --2- 172.21.15.81:0/1559772221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f570006e180 0x7f5700133de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009740 tx=0x7f56f401c400 comp rx=0 tx=0).stop 2024-09-18T02:03:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f570492b640 1 -- 172.21.15.81:0/1559772221 shutdown_connections 2024-09-18T02:03:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f570492b640 1 --2- 172.21.15.81:0/1559772221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f570006e180 0x7f5700133de0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f570492b640 1 -- 172.21.15.81:0/1559772221 >> 172.21.15.81:0/1559772221 conn(0x7f570009cd30 msgr2=0x7f570009d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f570492b640 1 -- 172.21.15.81:0/1559772221 shutdown_connections 2024-09-18T02:03:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f9d99768640 1 Processor -- start 2024-09-18T02:03:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f9d99768640 1 -- start start 2024-09-18T02:03:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f570492b640 1 -- 172.21.15.81:0/1559772221 wait complete. 2024-09-18T02:03:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f9d99768640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9d9409c680 0x7f9d94137fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f9d99768640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9409c1d0 con 0x7f9d940933a0 2024-09-18T02:03:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f9d99768640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9d94096af0 con 0x7f9d9409c680 2024-09-18T02:03:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f9d92ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9d940933a0 0x7f9d94093780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36432/0 (socket says 172.21.15.81:36432) 2024-09-18T02:03:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f9d927fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9d9409c680 0x7f9d94137fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f9d92ffd640 1 -- 172.21.15.81:0/3844505723 learned_addr learned my addr 172.21.15.81:0/3844505723 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f9d927fc640 1 -- 172.21.15.81:0/3844505723 >> v1:172.21.15.81:6789/0 conn(0x7f9d940933a0 legacy=0x7f9d94093780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f9d927fc640 1 -- 172.21.15.81:0/3844505723 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d94093e90 con 0x7f9d9409c680 2024-09-18T02:03:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726fca1640 1 Processor -- start 2024-09-18T02:03:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726fca1640 1 -- start start 2024-09-18T02:03:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726fca1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f726812c510 0x7f726812c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726fca1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72680927a0 con 0x7f726812ce30 2024-09-18T02:03:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726fca1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7268096e80 con 0x7f726812c510 2024-09-18T02:03:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd913dc640 1 --2- 172.21.15.81:0/3776935952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c12f8e0 0x7efd8c131cd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009740 tx=0x7efd7c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea509268f645dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726d23c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f726812ce30 0x7f72681291f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36442/0 (socket says 172.21.15.81:36442) 2024-09-18T02:03:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726d23c640 1 -- 172.21.15.81:0/183663048 learned_addr learned my addr 172.21.15.81:0/183663048 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726da3d640 1 --2- 172.21.15.81:0/183663048 >> v2:172.21.15.81:3300/0 conn(0x7f726812c510 0x7f726812c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f570492b640 1 Processor -- start 2024-09-18T02:03:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd90bdb640 1 -- 172.21.15.81:0/3776935952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd7c0b0070 con 0x7efd8c12f8e0 2024-09-18T02:03:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd90bdb640 1 -- 172.21.15.81:0/3776935952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7c0ab530 con 0x7efd8c12f8e0 2024-09-18T02:03:51.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726ca3b640 1 -- 172.21.15.81:0/183663048 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459213014 0 0) 0x7f72680927a0 con 0x7f726812ce30 2024-09-18T02:03:51.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726ca3b640 1 -- 172.21.15.81:0/183663048 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7254003530 con 0x7f726812ce30 2024-09-18T02:03:51.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726da3d640 1 -- 172.21.15.81:0/183663048 >> v1:172.21.15.81:6789/0 conn(0x7f726812ce30 legacy=0x7f72681291f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f726da3d640 1 -- 172.21.15.81:0/183663048 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726812d240 con 0x7f726812c510 2024-09-18T02:03:51.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7efd90bdb640 1 -- 172.21.15.81:0/3776935952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd7c0ab830 con 0x7efd8c12f8e0 2024-09-18T02:03:51.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.411+0000 7f570492b640 1 -- start start 2024-09-18T02:03:51.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f570492b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f570006e180 0x7f57001c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f570492b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5700136ed0 con 0x7f570006e180 2024-09-18T02:03:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 -- 172.21.15.81:0/3776935952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c12f8e0 msgr2=0x7efd8c131cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 --2- 172.21.15.81:0/3776935952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c12f8e0 0x7efd8c131cd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009740 tx=0x7efd7c01c370 comp rx=0 tx=0).stop 2024-09-18T02:03:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56fe59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f570006e180 0x7f57001c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56fe59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f570006e180 0x7f57001c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39206/0 (socket says 172.21.15.81:39206) 2024-09-18T02:03:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56fe59c640 1 -- 172.21.15.81:0/2681003181 learned_addr learned my addr 172.21.15.81:0/2681003181 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 -- 172.21.15.81:0/3776935952 shutdown_connections 2024-09-18T02:03:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 --2- 172.21.15.81:0/3776935952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c12f8e0 0x7efd8c131cd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 -- 172.21.15.81:0/3776935952 >> 172.21.15.81:0/3776935952 conn(0x7efd8c09ac70 msgr2=0x7efd8c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 -- 172.21.15.81:0/3776935952 shutdown_connections 2024-09-18T02:03:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 -- 172.21.15.81:0/3776935952 wait complete. 2024-09-18T02:03:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56fe59c640 1 -- 172.21.15.81:0/2681003181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5700093f70 con 0x7f570006e180 2024-09-18T02:03:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f9d927fc640 1 --2- 172.21.15.81:0/3844505723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d9409c680 0x7f9d94137fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009740 tx=0x7f9d8801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7268eed8c60990 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56fe59c640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f570006e180 0x7f57001c61e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56f000c480 tx=0x7f56f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f9d91ffb640 1 -- 172.21.15.81:0/3844505723 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d880b1070 con 0x7f9d9409c680 2024-09-18T02:03:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f9d91ffb640 1 -- 172.21.15.81:0/3844505723 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d880ac570 con 0x7f9d9409c680 2024-09-18T02:03:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 Processor -- start 2024-09-18T02:03:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f9d91ffb640 1 -- 172.21.15.81:0/3844505723 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d880ac870 con 0x7f9d9409c680 2024-09-18T02:03:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56eeffd640 1 -- 172.21.15.81:0/2681003181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56f0017070 con 0x7f570006e180 2024-09-18T02:03:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56eeffd640 1 -- 172.21.15.81:0/2681003181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f0005c20 con 0x7f570006e180 2024-09-18T02:03:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56eeffd640 1 -- 172.21.15.81:0/2681003181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56f0007070 con 0x7f570006e180 2024-09-18T02:03:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f570492b640 1 -- 172.21.15.81:0/2681003181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5700094740 con 0x7f570006e180 2024-09-18T02:03:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f570492b640 1 -- 172.21.15.81:0/2681003181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57001c6720 con 0x7f570006e180 2024-09-18T02:03:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f9d99768640 1 -- 172.21.15.81:0/3844505723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d9409c680 msgr2=0x7f9d94137fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f9d99768640 1 --2- 172.21.15.81:0/3844505723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d9409c680 0x7f9d94137fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009740 tx=0x7f9d8801c400 comp rx=0 tx=0).stop 2024-09-18T02:03:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 -- start start 2024-09-18T02:03:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c12cba0 0x7efd8c1267a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c134dc0 con 0x7efd8c12cba0 2024-09-18T02:03:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd91bdd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c12cba0 0x7efd8c1267a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd91bdd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c12cba0 0x7efd8c1267a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39218/0 (socket says 172.21.15.81:39218) 2024-09-18T02:03:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd91bdd640 1 -- 172.21.15.81:0/1929606977 learned_addr learned my addr 172.21.15.81:0/1929606977 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f726da3d640 1 --2- 172.21.15.81:0/183663048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726812c510 0x7f726812c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7264009740 tx=0x7f726401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1d0cbf7bef7543 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f9d99768640 1 -- 172.21.15.81:0/3844505723 shutdown_connections 2024-09-18T02:03:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f9d99768640 1 --2- 172.21.15.81:0/3844505723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d9409c680 0x7f9d94137fb0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009740 tx=0x7f9d8801c400 comp rx=0 tx=0).stop 2024-09-18T02:03:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f9d99768640 1 -- 172.21.15.81:0/3844505723 >> 172.21.15.81:0/3844505723 conn(0x7f9d9409b450 msgr2=0x7f9d9409b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56eeffd640 1 -- 172.21.15.81:0/2681003181 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f56f001a070 con 0x7f570006e180 2024-09-18T02:03:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f570492b640 1 -- 172.21.15.81:0/2681003181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5700074a40 con 0x7f570006e180 2024-09-18T02:03:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd91bdd640 1 -- 172.21.15.81:0/1929606977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c126dc0 con 0x7efd8c12cba0 2024-09-18T02:03:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f9d99768640 1 -- 172.21.15.81:0/3844505723 shutdown_connections 2024-09-18T02:03:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56eeffd640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f56e0035e00 0x7f56e00382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd91bdd640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c12cba0 0x7efd8c1267a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c380 tx=0x7efd8800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f726ca3b640 1 -- 172.21.15.81:0/183663048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72640b0070 con 0x7f726812c510 2024-09-18T02:03:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f726ca3b640 1 -- 172.21.15.81:0/183663048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72640ab530 con 0x7f726812c510 2024-09-18T02:03:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f726ca3b640 1 -- 172.21.15.81:0/183663048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72640ab830 con 0x7f726812c510 2024-09-18T02:03:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56eeffd640 1 -- 172.21.15.81:0/2681003181 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f56f0047930 con 0x7f570006e180 2024-09-18T02:03:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f9d99768640 1 -- 172.21.15.81:0/3844505723 wait complete. 2024-09-18T02:03:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd827fc640 1 -- 172.21.15.81:0/1929606977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd88017070 con 0x7efd8c12cba0 2024-09-18T02:03:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56eeffd640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7f56e003b580 0x7f56e003da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56eeffd640 1 -- 172.21.15.81:0/2681003181 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56f0013e50 con 0x7f56e003b580 2024-09-18T02:03:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56eeffd640 1 -- 172.21.15.81:0/2681003181 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f56f00192c0 con 0x7f570006e180 2024-09-18T02:03:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd827fc640 1 -- 172.21.15.81:0/1929606977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd88005c20 con 0x7efd8c12cba0 2024-09-18T02:03:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 -- 172.21.15.81:0/1929606977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8c097e50 con 0x7efd8c12cba0 2024-09-18T02:03:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56fed9d640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7f56e003b580 0x7f56e003da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd93e41640 1 -- 172.21.15.81:0/1929606977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8c06e850 con 0x7efd8c12cba0 2024-09-18T02:03:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7efd827fc640 1 -- 172.21.15.81:0/1929606977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd880070d0 con 0x7efd8c12cba0 2024-09-18T02:03:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.415+0000 7f56fdd9b640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f56e0035e00 0x7f56e00382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f56fed9d640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7f56e003b580 0x7f56e003da00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7efd93e41640 1 -- 172.21.15.81:0/1929606977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd74000f90 con 0x7efd8c12cba0 2024-09-18T02:03:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d99768640 1 Processor -- start 2024-09-18T02:03:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d99768640 1 -- start start 2024-09-18T02:03:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7efd827fc640 1 -- 172.21.15.81:0/1929606977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efd8801a070 con 0x7efd8c12cba0 2024-09-18T02:03:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d99768640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d940933a0 0x7f9d9408afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d99768640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d94124bc0 con 0x7f9d940933a0 2024-09-18T02:03:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7efd827fc640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efd70035db0 0x7efd70038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d940933a0 0x7f9d9408afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7efd827fc640 1 -- 172.21.15.81:0/1929606977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7efd88047ac0 con 0x7efd8c12cba0 2024-09-18T02:03:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d940933a0 0x7f9d9408afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39220/0 (socket says 172.21.15.81:39220) 2024-09-18T02:03:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d92ffd640 1 -- 172.21.15.81:0/373628520 learned_addr learned my addr 172.21.15.81:0/373628520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7efd827fc640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efd7003b530 0x7efd7003d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 -- 172.21.15.81:0/183663048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726812c510 msgr2=0x7f726812c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 --2- 172.21.15.81:0/183663048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726812c510 0x7f726812c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7264009740 tx=0x7f726401c370 comp rx=0 tx=0).stop 2024-09-18T02:03:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f56eeffd640 1 -- 172.21.15.81:0/2681003181 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f56f0013e50 con 0x7f56e003b580 2024-09-18T02:03:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7efd827fc640 1 -- 172.21.15.81:0/1929606977 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd7003e080 con 0x7efd7003b530 2024-09-18T02:03:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7efd827fc640 1 -- 172.21.15.81:0/1929606977 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7efd8804c2a0 con 0x7efd8c12cba0 2024-09-18T02:03:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 -- 172.21.15.81:0/183663048 shutdown_connections 2024-09-18T02:03:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 --2- 172.21.15.81:0/183663048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726812c510 0x7f726812c8f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 -- 172.21.15.81:0/183663048 >> 172.21.15.81:0/183663048 conn(0x7f726809d4c0 msgr2=0x7f726809d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d92ffd640 1 -- 172.21.15.81:0/373628520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d94072ea0 con 0x7f9d940933a0 2024-09-18T02:03:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 -- 172.21.15.81:0/183663048 shutdown_connections 2024-09-18T02:03:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7efd913dc640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efd70035db0 0x7efd70038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 -- 172.21.15.81:0/183663048 wait complete. 2024-09-18T02:03:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7efd923de640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efd7003b530 0x7efd7003d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d92ffd640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d940933a0 0x7f9d9408afd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9d8401d380 tx=0x7f9d8401d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d7b7fe640 1 -- 172.21.15.81:0/373628520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d84016c30 con 0x7f9d940933a0 2024-09-18T02:03:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d7b7fe640 1 -- 172.21.15.81:0/373628520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d84016dd0 con 0x7f9d940933a0 2024-09-18T02:03:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d99768640 1 -- 172.21.15.81:0/373628520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d94097200 con 0x7f9d940933a0 2024-09-18T02:03:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d99768640 1 -- 172.21.15.81:0/373628520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d9408d700 con 0x7f9d940933a0 2024-09-18T02:03:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d7b7fe640 1 -- 172.21.15.81:0/373628520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d84015930 con 0x7f9d940933a0 2024-09-18T02:03:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7efd923de640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efd7003b530 0x7efd7003d9b0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7efd913dc640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efd70035db0 0x7efd70038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0ad000 tx=0x7efd7c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 Processor -- start 2024-09-18T02:03:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 -- start start 2024-09-18T02:03:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d99768640 1 -- 172.21.15.81:0/373628520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d74000f90 con 0x7f9d940933a0 2024-09-18T02:03:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726812c510 0x7f726812da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7268135480 con 0x7f726812c510 2024-09-18T02:03:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726da3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726812c510 0x7f726812da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726da3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726812c510 0x7f726812da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39228/0 (socket says 172.21.15.81:39228) 2024-09-18T02:03:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726da3d640 1 -- 172.21.15.81:0/3825388318 learned_addr learned my addr 172.21.15.81:0/3825388318 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726da3d640 1 -- 172.21.15.81:0/3825388318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7268093d50 con 0x7f726812c510 2024-09-18T02:03:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726da3d640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726812c510 0x7f726812da20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f72640ae040 tx=0x7f7264019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f725e7fc640 1 -- 172.21.15.81:0/3825388318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72640b8020 con 0x7f726812c510 2024-09-18T02:03:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f725e7fc640 1 -- 172.21.15.81:0/3825388318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72640b4410 con 0x7f726812c510 2024-09-18T02:03:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f725e7fc640 1 -- 172.21.15.81:0/3825388318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72640b0040 con 0x7f726812c510 2024-09-18T02:03:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d7b7fe640 1 -- 172.21.15.81:0/373628520 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9d8402b020 con 0x7f9d940933a0 2024-09-18T02:03:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d7b7fe640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9d80035db0 0x7f9d80038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d7b7fe640 1 -- 172.21.15.81:0/373628520 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f9d84058df0 con 0x7f9d940933a0 2024-09-18T02:03:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d7b7fe640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f9d8003b530 0x7f9d8003d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d7b7fe640 1 -- 172.21.15.81:0/373628520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d8003e080 con 0x7f9d8003b530 2024-09-18T02:03:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d7b7fe640 1 -- 172.21.15.81:0/373628520 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f9d8405b4a0 con 0x7f9d940933a0 2024-09-18T02:03:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 -- 172.21.15.81:0/3825388318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72681242f0 con 0x7f726812c510 2024-09-18T02:03:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f726fca1640 1 -- 172.21.15.81:0/3825388318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726812f7a0 con 0x7f726812c510 2024-09-18T02:03:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d927fc640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9d80035db0 0x7f9d80038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f9d937fe640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f9d8003b530 0x7f9d8003d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.419+0000 7f56fdd9b640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f56e0035e00 0x7f56e00382c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009740 tx=0x7f56f40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f726fca1640 1 -- 172.21.15.81:0/3825388318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f726812c8f0 con 0x7f726812c510 2024-09-18T02:03:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7efd827fc640 1 -- 172.21.15.81:0/1929606977 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd7003e080 con 0x7efd7003b530 2024-09-18T02:03:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f9d927fc640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9d80035db0 0x7f9d80038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9d880ae000 tx=0x7f9d880a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f9d937fe640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f9d8003b530 0x7f9d8003d9b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f725e7fc640 1 -- 172.21.15.81:0/3825388318 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f72640bb020 con 0x7f726812c510 2024-09-18T02:03:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f725e7fc640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f724c035e50 0x7f724c038310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f725e7fc640 1 -- 172.21.15.81:0/3825388318 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f72640e24c0 con 0x7f726812c510 2024-09-18T02:03:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f725e7fc640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f724c03b650 0x7f724c03dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f725e7fc640 1 -- 172.21.15.81:0/3825388318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f726400af30 con 0x7f724c03b650 2024-09-18T02:03:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f725e7fc640 1 -- 172.21.15.81:0/3825388318 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f72640e9050 con 0x7f726812c510 2024-09-18T02:03:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f726d23c640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f724c035e50 0x7f724c038310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f726e23e640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f724c03b650 0x7f724c03dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f726d23c640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f724c035e50 0x7f724c038310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7258007fd0 tx=0x7f7258007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f726e23e640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f724c03b650 0x7f724c03dad0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.423+0000 7f9d7b7fe640 1 -- 172.21.15.81:0/373628520 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d8003e080 con 0x7f9d8003b530 2024-09-18T02:03:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.427+0000 7f725e7fc640 1 -- 172.21.15.81:0/3825388318 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f726400af30 con 0x7f724c03b650 2024-09-18T02:03:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 -- 172.21.15.81:0/2681003181 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f57001c6a10 con 0x7f56e003b580 2024-09-18T02:03:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f56eeffd640 1 -- 172.21.15.81:0/2681003181 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f57001c6a10 con 0x7f56e003b580 2024-09-18T02:03:51.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 -- 172.21.15.81:0/2681003181 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7f56e003b580 msgr2=0x7f56e003da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7f56e003b580 0x7f56e003da00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 -- 172.21.15.81:0/2681003181 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f56e0035e00 msgr2=0x7f56e00382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f56e0035e00 0x7f56e00382c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009740 tx=0x7f56f40a7000 comp rx=0 tx=0).stop 2024-09-18T02:03:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 -- 172.21.15.81:0/2681003181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f570006e180 msgr2=0x7f57001c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f570006e180 0x7f57001c61e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56f000c480 tx=0x7f56f000c940 comp rx=0 tx=0).stop 2024-09-18T02:03:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 -- 172.21.15.81:0/2681003181 shutdown_connections 2024-09-18T02:03:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7f56e003b580 0x7f56e003da00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f56e0035e00 0x7f56e00382c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 --2- 172.21.15.81:0/2681003181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f570006e180 0x7f57001c61e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 -- 172.21.15.81:0/2681003181 >> 172.21.15.81:0/2681003181 conn(0x7f570009cd30 msgr2=0x7f570012fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 -- 172.21.15.81:0/2681003181 shutdown_connections 2024-09-18T02:03:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.435+0000 7f570492b640 1 -- 172.21.15.81:0/2681003181 wait complete. 2024-09-18T02:03:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 -- 172.21.15.81:0/3825388318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f726812ce30 con 0x7f724c03b650 2024-09-18T02:03:51.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f725e7fc640 1 -- 172.21.15.81:0/3825388318 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f726812ce30 con 0x7f724c03b650 2024-09-18T02:03:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 -- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f724c03b650 msgr2=0x7f724c03dad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f724c03b650 0x7f724c03dad0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 -- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f724c035e50 msgr2=0x7f724c038310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f724c035e50 0x7f724c038310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7258007fd0 tx=0x7f7258007980 comp rx=0 tx=0).stop 2024-09-18T02:03:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 -- 172.21.15.81:0/3825388318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726812c510 msgr2=0x7f726812da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726812c510 0x7f726812da20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f72640ae040 tx=0x7f7264019110 comp rx=0 tx=0).stop 2024-09-18T02:03:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 -- 172.21.15.81:0/3825388318 shutdown_connections 2024-09-18T02:03:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f724c03b650 0x7f724c03dad0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f724c035e50 0x7f724c038310 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 --2- 172.21.15.81:0/3825388318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726812c510 0x7f726812da20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 -- 172.21.15.81:0/3825388318 >> 172.21.15.81:0/3825388318 conn(0x7f726809d4c0 msgr2=0x7f7268092ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 -- 172.21.15.81:0/3825388318 shutdown_connections 2024-09-18T02:03:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.439+0000 7f726fca1640 1 -- 172.21.15.81:0/3825388318 wait complete. 2024-09-18T02:03:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 -- 172.21.15.81:0/1929606977 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd74002c80 con 0x7efd7003b530 2024-09-18T02:03:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd827fc640 1 -- 172.21.15.81:0/1929606977 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efd74002c80 con 0x7efd7003b530 2024-09-18T02:03:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 -- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efd7003b530 msgr2=0x7efd7003d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efd7003b530 0x7efd7003d9b0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 -- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efd70035db0 msgr2=0x7efd70038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efd70035db0 0x7efd70038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0ad000 tx=0x7efd7c0a6000 comp rx=0 tx=0).stop 2024-09-18T02:03:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 -- 172.21.15.81:0/1929606977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c12cba0 msgr2=0x7efd8c1267a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c12cba0 0x7efd8c1267a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c380 tx=0x7efd8800c840 comp rx=0 tx=0).stop 2024-09-18T02:03:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 -- 172.21.15.81:0/1929606977 shutdown_connections 2024-09-18T02:03:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efd7003b530 0x7efd7003d9b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efd70035db0 0x7efd70038270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 --2- 172.21.15.81:0/1929606977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c12cba0 0x7efd8c1267a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 -- 172.21.15.81:0/1929606977 >> 172.21.15.81:0/1929606977 conn(0x7efd8c09ac70 msgr2=0x7efd8c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 -- 172.21.15.81:0/1929606977 shutdown_connections 2024-09-18T02:03:51.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.447+0000 7efd93e41640 1 -- 172.21.15.81:0/1929606977 wait complete. 2024-09-18T02:03:51.472 INFO:teuthology.orchestra.run.smithi081.stdout:38654705668 2024-09-18T02:03:51.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T02:03:51.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 -- 172.21.15.81:0/373628520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9d74002c80 con 0x7f9d8003b530 2024-09-18T02:03:51.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d7b7fe640 1 -- 172.21.15.81:0/373628520 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9d74002c80 con 0x7f9d8003b530 2024-09-18T02:03:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 -- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f9d8003b530 msgr2=0x7f9d8003d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f9d8003b530 0x7f9d8003d9b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 -- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9d80035db0 msgr2=0x7f9d80038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9d80035db0 0x7f9d80038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9d880ae000 tx=0x7f9d880a6070 comp rx=0 tx=0).stop 2024-09-18T02:03:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 -- 172.21.15.81:0/373628520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d940933a0 msgr2=0x7f9d9408afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d940933a0 0x7f9d9408afd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9d8401d380 tx=0x7f9d8401d840 comp rx=0 tx=0).stop 2024-09-18T02:03:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 -- 172.21.15.81:0/373628520 shutdown_connections 2024-09-18T02:03:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f9d8003b530 0x7f9d8003d9b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9d80035db0 0x7f9d80038270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 --2- 172.21.15.81:0/373628520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d940933a0 0x7f9d9408afd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 -- 172.21.15.81:0/373628520 >> 172.21.15.81:0/373628520 conn(0x7f9d9409b450 msgr2=0x7f9d94131a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 -- 172.21.15.81:0/373628520 shutdown_connections 2024-09-18T02:03:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.451+0000 7f9d99768640 1 -- 172.21.15.81:0/373628520 wait complete. 2024-09-18T02:03:51.478 INFO:teuthology.orchestra.run.smithi081.stdout:38654705669 2024-09-18T02:03:51.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T02:03:51.480 INFO:teuthology.orchestra.run.smithi081.stdout:38654705670 2024-09-18T02:03:51.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T02:03:51.481 INFO:teuthology.orchestra.run.smithi081.stdout:38654705669 2024-09-18T02:03:51.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T02:03:51.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.619+0000 7fb891410640 1 Processor -- start 2024-09-18T02:03:51.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.619+0000 7fb891410640 1 -- start start 2024-09-18T02:03:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.619+0000 7fb891410640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb88c12e760 0x7fb88c12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.619+0000 7fb891410640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb88c0984f0 con 0x7fb88c12f1c0 2024-09-18T02:03:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.619+0000 7fb891410640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb88c098dc0 con 0x7fb88c12e760 2024-09-18T02:03:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.619+0000 7fb88affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb88c12e760 0x7fb88c12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.619+0000 7fb88a7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb88c12f1c0 0x7fb88c12b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36450/0 (socket says 172.21.15.81:36450) 2024-09-18T02:03:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.619+0000 7fb88a7fc640 1 -- 172.21.15.81:0/2270175849 learned_addr learned my addr 172.21.15.81:0/2270175849 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb88affd640 1 -- 172.21.15.81:0/2270175849 >> v1:172.21.15.81:6789/0 conn(0x7fb88c12f1c0 legacy=0x7fb88c12b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb889ffb640 1 -- 172.21.15.81:0/2270175849 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1674998478 0 0) 0x7fb88c0984f0 con 0x7fb88c12f1c0 2024-09-18T02:03:51.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb88affd640 1 -- 172.21.15.81:0/2270175849 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c12f5a0 con 0x7fb88c12e760 2024-09-18T02:03:51.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f609ee4e640 1 Processor -- start 2024-09-18T02:03:51.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f609ee4e640 1 -- start start 2024-09-18T02:03:51.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7efff4b97640 1 Processor -- start 2024-09-18T02:03:51.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7efff4b97640 1 -- start start 2024-09-18T02:03:51.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f609ee4e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60980952d0 0x7f60980956b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f609ee4e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6098098790 con 0x7f6098095bf0 2024-09-18T02:03:51.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f609ee4e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6098098db0 con 0x7f60980952d0 2024-09-18T02:03:51.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f609cbea640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60980952d0 0x7f60980956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f609cbea640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60980952d0 0x7f60980956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39254/0 (socket says 172.21.15.81:39254) 2024-09-18T02:03:51.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7efff4b97640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efff0070d70 0x7efff0071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f6097fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6098095bf0 0x7f60980964e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36456/0 (socket says 172.21.15.81:36456) 2024-09-18T02:03:51.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f609cbea640 1 -- 172.21.15.81:0/3071218575 learned_addr learned my addr 172.21.15.81:0/3071218575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:51.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7efff4b97640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efff006c6b0 con 0x7efff006be20 2024-09-18T02:03:51.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7efff4b97640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7efff006c8d0 con 0x7efff0070d70 2024-09-18T02:03:51.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7effedd9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efff006be20 0x7efff0122c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36464/0 (socket says 172.21.15.81:36464) 2024-09-18T02:03:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7effedd9b640 1 -- 172.21.15.81:0/432244900 learned_addr learned my addr 172.21.15.81:0/432244900 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f609cbea640 1 -- 172.21.15.81:0/3071218575 >> v1:172.21.15.81:6789/0 conn(0x7f6098095bf0 legacy=0x7f60980964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f609cbea640 1 -- 172.21.15.81:0/3071218575 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6098098aa0 con 0x7f60980952d0 2024-09-18T02:03:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7effee59c640 1 --2- 172.21.15.81:0/432244900 >> v2:172.21.15.81:3300/0 conn(0x7efff0070d70 0x7efff0071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7effed59a640 1 -- 172.21.15.81:0/432244900 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697134717 0 0) 0x7efff006c6b0 con 0x7efff006be20 2024-09-18T02:03:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7effed59a640 1 -- 172.21.15.81:0/432244900 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effd8003530 con 0x7efff006be20 2024-09-18T02:03:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7effee59c640 1 -- 172.21.15.81:0/432244900 >> v1:172.21.15.81:6789/0 conn(0x7efff006be20 legacy=0x7efff0122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7effee59c640 1 -- 172.21.15.81:0/432244900 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff0071690 con 0x7efff0070d70 2024-09-18T02:03:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb119e78640 1 Processor -- start 2024-09-18T02:03:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb119e78640 1 -- start start 2024-09-18T02:03:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb88affd640 1 --2- 172.21.15.81:0/2270175849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c12e760 0x7fb88c12ec80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009740 tx=0x7fb87c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4407458de2b2cfc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb119e78640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb114074ef0 0x7fb114133b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb1137fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb11412ed50 0x7fb11412f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36472/0 (socket says 172.21.15.81:36472) 2024-09-18T02:03:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb1137fe640 1 -- 172.21.15.81:0/1681540424 learned_addr learned my addr 172.21.15.81:0/1681540424 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb119e78640 1 -- 172.21.15.81:0/1681540424 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb11412e900 con 0x7fb11412ed50 2024-09-18T02:03:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb119e78640 1 -- 172.21.15.81:0/1681540424 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb114091b40 con 0x7fb114074ef0 2024-09-18T02:03:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb889ffb640 1 -- 172.21.15.81:0/2270175849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb87c0b0070 con 0x7fb88c12e760 2024-09-18T02:03:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb889ffb640 1 -- 172.21.15.81:0/2270175849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb87c0ab530 con 0x7fb88c12e760 2024-09-18T02:03:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb1127fc640 1 -- 172.21.15.81:0/1681540424 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1628810389 0 0) 0x7fb11412e900 con 0x7fb11412ed50 2024-09-18T02:03:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7fb1127fc640 1 -- 172.21.15.81:0/1681540424 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0fc003530 con 0x7fb11412ed50 2024-09-18T02:03:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.623+0000 7f609cbea640 1 --2- 172.21.15.81:0/3071218575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60980952d0 0x7f60980956b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f608c0097f0 tx=0x7f608c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c606bdc6b12582e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb889ffb640 1 -- 172.21.15.81:0/2270175849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb87c0ab830 con 0x7fb88c12e760 2024-09-18T02:03:51.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7effee59c640 1 --2- 172.21.15.81:0/432244900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff0070d70 0x7efff0071150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7effe0009740 tx=0x7effe001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4fe527e75f7912 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1127fc640 1 -- 172.21.15.81:0/1681540424 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1213529296 0 0) 0x7fb0fc003530 con 0x7fb11412ed50 2024-09-18T02:03:51.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1127fc640 1 -- 172.21.15.81:0/1681540424 >> v2:172.21.15.81:3300/0 conn(0x7fb114074ef0 msgr2=0x7fb114133b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-18T02:03:51.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1127fc640 1 --2- 172.21.15.81:0/1681540424 >> v2:172.21.15.81:3300/0 conn(0x7fb114074ef0 0x7fb114133b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f60977fe640 1 -- 172.21.15.81:0/3071218575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c0ab580 con 0x7f60980952d0 2024-09-18T02:03:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1127fc640 1 -- 172.21.15.81:0/1681540424 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb114075320 con 0x7fb11412ed50 2024-09-18T02:03:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1127fc640 1 -- 172.21.15.81:0/1681540424 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1972425487 0 0) 0x7fb1040015b0 con 0x7fb11412ed50 2024-09-18T02:03:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7effed59a640 1 -- 172.21.15.81:0/432244900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe00b0070 con 0x7efff0070d70 2024-09-18T02:03:51.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1127fc640 1 -- 172.21.15.81:0/1681540424 >> v1:172.21.15.81:6789/0 conn(0x7fb11412ed50 legacy=0x7fb11412f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1127fc640 1 --2- 172.21.15.81:0/1681540424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0fc0039c0 0x7fb0fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1127fc640 1 -- 172.21.15.81:0/1681540424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb114091b40 con 0x7fb0fc0039c0 2024-09-18T02:03:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7effed59a640 1 -- 172.21.15.81:0/432244900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff0071b30 con 0x7efff0070d70 2024-09-18T02:03:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f60977fe640 1 -- 172.21.15.81:0/3071218575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f608c0b0070 con 0x7f60980952d0 2024-09-18T02:03:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f60977fe640 1 -- 172.21.15.81:0/3071218575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c0ab870 con 0x7f60980952d0 2024-09-18T02:03:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7effed59a640 1 -- 172.21.15.81:0/432244900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe00ab680 con 0x7efff0070d70 2024-09-18T02:03:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1137fe640 1 --2- 172.21.15.81:0/1681540424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0fc0039c0 0x7fb0fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 -- 172.21.15.81:0/2270175849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c12e760 msgr2=0x7fb88c12ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 --2- 172.21.15.81:0/2270175849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c12e760 0x7fb88c12ec80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009740 tx=0x7fb87c01c400 comp rx=0 tx=0).stop 2024-09-18T02:03:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 -- 172.21.15.81:0/2270175849 shutdown_connections 2024-09-18T02:03:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 --2- 172.21.15.81:0/2270175849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c12e760 0x7fb88c12ec80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 -- 172.21.15.81:0/2270175849 >> 172.21.15.81:0/2270175849 conn(0x7fb88c0a10a0 msgr2=0x7fb88c0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 -- 172.21.15.81:0/2270175849 shutdown_connections 2024-09-18T02:03:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1137fe640 1 -- 172.21.15.81:0/1681540424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb114075320 con 0x7fb0fc0039c0 2024-09-18T02:03:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 -- 172.21.15.81:0/2270175849 wait complete. 2024-09-18T02:03:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609ee4e640 1 -- 172.21.15.81:0/3071218575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60980952d0 msgr2=0x7f60980956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609ee4e640 1 --2- 172.21.15.81:0/3071218575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60980952d0 0x7f60980956b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f608c0097f0 tx=0x7f608c01c430 comp rx=0 tx=0).stop 2024-09-18T02:03:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7efff4b97640 1 -- 172.21.15.81:0/432244900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff0070d70 msgr2=0x7efff0071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7efff4b97640 1 --2- 172.21.15.81:0/432244900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff0070d70 0x7efff0071150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7effe0009740 tx=0x7effe001c330 comp rx=0 tx=0).stop 2024-09-18T02:03:51.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609ee4e640 1 -- 172.21.15.81:0/3071218575 shutdown_connections 2024-09-18T02:03:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609ee4e640 1 --2- 172.21.15.81:0/3071218575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60980952d0 0x7f60980956b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609ee4e640 1 -- 172.21.15.81:0/3071218575 >> 172.21.15.81:0/3071218575 conn(0x7f609809cd50 msgr2=0x7f609809d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7efff4b97640 1 -- 172.21.15.81:0/432244900 shutdown_connections 2024-09-18T02:03:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7efff4b97640 1 --2- 172.21.15.81:0/432244900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff0070d70 0x7efff0071150 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7efff4b97640 1 -- 172.21.15.81:0/432244900 >> 172.21.15.81:0/432244900 conn(0x7efff009ac70 msgr2=0x7efff006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609ee4e640 1 -- 172.21.15.81:0/3071218575 shutdown_connections 2024-09-18T02:03:51.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609ee4e640 1 -- 172.21.15.81:0/3071218575 wait complete. 2024-09-18T02:03:51.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7efff4b97640 1 -- 172.21.15.81:0/432244900 shutdown_connections 2024-09-18T02:03:51.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7efff4b97640 1 -- 172.21.15.81:0/432244900 wait complete. 2024-09-18T02:03:51.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 Processor -- start 2024-09-18T02:03:51.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 -- start start 2024-09-18T02:03:51.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609ee4e640 1 Processor -- start 2024-09-18T02:03:51.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609ee4e640 1 -- start start 2024-09-18T02:03:51.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7efff4b97640 1 Processor -- start 2024-09-18T02:03:51.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7efff4b97640 1 -- start start 2024-09-18T02:03:51.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c12e760 0x7fb88c130990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c136e30 con 0x7fb88c12e760 2024-09-18T02:03:51.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb88affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c12e760 0x7fb88c130990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb88affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c12e760 0x7fb88c130990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39294/0 (socket says 172.21.15.81:39294) 2024-09-18T02:03:51.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb88affd640 1 -- 172.21.15.81:0/3197492070 learned_addr learned my addr 172.21.15.81:0/3197492070 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:51.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7efff4b97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff006be20 0x7efff00972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7efff4b97640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efff0135490 con 0x7efff006be20 2024-09-18T02:03:51.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609ee4e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6098095bf0 0x7f609812ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609ee4e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6098097790 con 0x7f6098095bf0 2024-09-18T02:03:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb88affd640 1 -- 172.21.15.81:0/3197492070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c132f20 con 0x7fb88c12e760 2024-09-18T02:03:51.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609cbea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6098095bf0 0x7f609812ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609cbea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6098095bf0 0x7f609812ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39326/0 (socket says 172.21.15.81:39326) 2024-09-18T02:03:51.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609cbea640 1 -- 172.21.15.81:0/1872228935 learned_addr learned my addr 172.21.15.81:0/1872228935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7effee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff006be20 0x7efff00972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7effee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff006be20 0x7efff00972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39310/0 (socket says 172.21.15.81:39310) 2024-09-18T02:03:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7effee59c640 1 -- 172.21.15.81:0/3050391588 learned_addr learned my addr 172.21.15.81:0/3050391588 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609cbea640 1 -- 172.21.15.81:0/1872228935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609806d620 con 0x7f6098095bf0 2024-09-18T02:03:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1137fe640 1 --2- 172.21.15.81:0/1681540424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0fc0039c0 0x7fb0fc003dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c1e0 tx=0x7fb10401cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29ce6316b28a336 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb88affd640 1 --2- 172.21.15.81:0/3197492070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c12e760 0x7fb88c130990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb87c01a030 tx=0x7fb87c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7effee59c640 1 -- 172.21.15.81:0/3050391588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff0126e80 con 0x7efff006be20 2024-09-18T02:03:51.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1127fc640 1 -- 172.21.15.81:0/1681540424 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb104007d10 con 0x7fb0fc0039c0 2024-09-18T02:03:51.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1127fc640 1 -- 172.21.15.81:0/1681540424 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1040a9070 con 0x7fb0fc0039c0 2024-09-18T02:03:51.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb1127fc640 1 -- 172.21.15.81:0/1681540424 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1040a5cc0 con 0x7fb0fc0039c0 2024-09-18T02:03:51.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f609cbea640 1 --2- 172.21.15.81:0/1872228935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6098095bf0 0x7f609812ed50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f608c0097f0 tx=0x7f608c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb8737fe640 1 -- 172.21.15.81:0/3197492070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb87c0bb070 con 0x7fb88c12e760 2024-09-18T02:03:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb8737fe640 1 -- 172.21.15.81:0/3197492070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb87c0abe40 con 0x7fb88c12e760 2024-09-18T02:03:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb8737fe640 1 -- 172.21.15.81:0/3197492070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb87c0b0040 con 0x7fb88c12e760 2024-09-18T02:03:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 -- 172.21.15.81:0/3197492070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88c1333e0 con 0x7fb88c12e760 2024-09-18T02:03:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7fb891410640 1 -- 172.21.15.81:0/3197492070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88c1310a0 con 0x7fb88c12e760 2024-09-18T02:03:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7effee59c640 1 --2- 172.21.15.81:0/3050391588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff006be20 0x7efff00972f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7effe00ae040 tx=0x7effe00190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f60957fa640 1 -- 172.21.15.81:0/1872228935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c0b4600 con 0x7f6098095bf0 2024-09-18T02:03:51.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.627+0000 7f60957fa640 1 -- 172.21.15.81:0/1872228935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f608c0b47a0 con 0x7f6098095bf0 2024-09-18T02:03:51.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7f609ee4e640 1 -- 172.21.15.81:0/1872228935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609806d8c0 con 0x7f6098095bf0 2024-09-18T02:03:51.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7f609ee4e640 1 -- 172.21.15.81:0/1872228935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6098131650 con 0x7f6098095bf0 2024-09-18T02:03:51.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7effdeffd640 1 -- 172.21.15.81:0/3050391588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe00b8020 con 0x7efff006be20 2024-09-18T02:03:51.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7effdeffd640 1 -- 172.21.15.81:0/3050391588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe00abe10 con 0x7efff006be20 2024-09-18T02:03:51.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7effdeffd640 1 -- 172.21.15.81:0/3050391588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe00b0040 con 0x7efff006be20 2024-09-18T02:03:51.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7efff4b97640 1 -- 172.21.15.81:0/3050391588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff0130570 con 0x7efff006be20 2024-09-18T02:03:51.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7efff4b97640 1 -- 172.21.15.81:0/3050391588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff0130f90 con 0x7efff006be20 2024-09-18T02:03:51.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7f60957fa640 1 -- 172.21.15.81:0/1872228935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c0b4ac0 con 0x7f6098095bf0 2024-09-18T02:03:51.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb891410640 1 -- 172.21.15.81:0/3197492070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88c1322b0 con 0x7fb88c12e760 2024-09-18T02:03:51.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 -- 172.21.15.81:0/1681540424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0fc0039c0 msgr2=0x7fb0fc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 --2- 172.21.15.81:0/1681540424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0fc0039c0 0x7fb0fc003dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c1e0 tx=0x7fb10401cce0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 -- 172.21.15.81:0/1681540424 shutdown_connections 2024-09-18T02:03:51.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 --2- 172.21.15.81:0/1681540424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0fc0039c0 0x7fb0fc003dc0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c1e0 tx=0x7fb10401cce0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 --2- 172.21.15.81:0/1681540424 >> v2:172.21.15.81:3300/0 conn(0x7fb114074ef0 0x7fb114133b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 -- 172.21.15.81:0/1681540424 >> 172.21.15.81:0/1681540424 conn(0x7fb11409d4c0 msgr2=0x7fb11409d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 -- 172.21.15.81:0/1681540424 shutdown_connections 2024-09-18T02:03:51.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 -- 172.21.15.81:0/1681540424 wait complete. 2024-09-18T02:03:51.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7f609ee4e640 1 -- 172.21.15.81:0/1872228935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6078005090 con 0x7f6098095bf0 2024-09-18T02:03:51.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7f60957fa640 1 -- 172.21.15.81:0/1872228935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f608c0b4c60 con 0x7f6098095bf0 2024-09-18T02:03:51.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7f60957fa640 1 --2- 172.21.15.81:0/1872228935 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f607c035db0 0x7f607c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7f60957fa640 1 -- 172.21.15.81:0/1872228935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f608c0e31e0 con 0x7f6098095bf0 2024-09-18T02:03:51.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7effdeffd640 1 -- 172.21.15.81:0/3050391588 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7effe00bb020 con 0x7efff006be20 2024-09-18T02:03:51.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb8737fe640 1 -- 172.21.15.81:0/3197492070 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb87c004150 con 0x7fb88c12e760 2024-09-18T02:03:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 Processor -- start 2024-09-18T02:03:51.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 -- start start 2024-09-18T02:03:51.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7effdeffd640 1 --2- 172.21.15.81:0/3050391588 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effd0035e00 0x7effd00382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7f6097fff640 1 --2- 172.21.15.81:0/1872228935 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f607c035db0 0x7f607c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb8737fe640 1 --2- 172.21.15.81:0/3197492070 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb878035e00 0x7fb8780382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7effdeffd640 1 -- 172.21.15.81:0/3050391588 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7effe00e23e0 con 0x7efff006be20 2024-09-18T02:03:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb8737fe640 1 -- 172.21.15.81:0/3197492070 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fb87c0e38f0 con 0x7fb88c12e760 2024-09-18T02:03:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7effedd9b640 1 --2- 172.21.15.81:0/3050391588 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effd0035e00 0x7effd00382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb114074ef0 0x7fb1141c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb119e78640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb114136c00 con 0x7fb114074ef0 2024-09-18T02:03:51.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7efff4b97640 1 -- 172.21.15.81:0/3050391588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd4005090 con 0x7efff006be20 2024-09-18T02:03:51.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb88a7fc640 1 --2- 172.21.15.81:0/3197492070 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb878035e00 0x7fb8780382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb1137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb114074ef0 0x7fb1141c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb1137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb114074ef0 0x7fb1141c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39338/0 (socket says 172.21.15.81:39338) 2024-09-18T02:03:51.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb1137fe640 1 -- 172.21.15.81:0/2791426239 learned_addr learned my addr 172.21.15.81:0/2791426239 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:51.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7f6097fff640 1 --2- 172.21.15.81:0/1872228935 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f607c035db0 0x7f607c038270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6084001600 tx=0x7f6084007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb1137fe640 1 -- 172.21.15.81:0/2791426239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11406d9c0 con 0x7fb114074ef0 2024-09-18T02:03:51.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb1137fe640 1 --2- 172.21.15.81:0/2791426239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb114074ef0 0x7fb1141c6030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb104000c10 tx=0x7fb0fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7effedd9b640 1 --2- 172.21.15.81:0/3050391588 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effd0035e00 0x7effd00382c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7effe4000f70 tx=0x7effe4007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.631+0000 7fb88a7fc640 1 --2- 172.21.15.81:0/3197492070 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb878035e00 0x7fb8780382c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb880007fd0 tx=0x7fb880007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.635+0000 7fb8737fe640 1 -- 172.21.15.81:0/3197492070 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb87c015ff0 con 0x7fb88c12e760 2024-09-18T02:03:51.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.639+0000 7fb0fbfff640 1 -- 172.21.15.81:0/2791426239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb104007140 con 0x7fb114074ef0 2024-09-18T02:03:51.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.639+0000 7fb119e78640 1 -- 172.21.15.81:0/2791426239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb11406d780 con 0x7fb114074ef0 2024-09-18T02:03:51.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.639+0000 7fb119e78640 1 -- 172.21.15.81:0/2791426239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb11406e410 con 0x7fb114074ef0 2024-09-18T02:03:51.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.639+0000 7f60957fa640 1 -- 172.21.15.81:0/1872228935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f609806d620 con 0x7f6098095bf0 2024-09-18T02:03:51.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.643+0000 7fb119e78640 1 -- 172.21.15.81:0/2791426239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb114094090 con 0x7fb114074ef0 2024-09-18T02:03:51.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.643+0000 7fb0fbfff640 1 -- 172.21.15.81:0/2791426239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1040a9020 con 0x7fb114074ef0 2024-09-18T02:03:51.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.643+0000 7fb0fbfff640 1 -- 172.21.15.81:0/2791426239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb104007df0 con 0x7fb114074ef0 2024-09-18T02:03:51.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.643+0000 7effdeffd640 1 -- 172.21.15.81:0/3050391588 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7effe00c2030 con 0x7efff006be20 2024-09-18T02:03:51.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.647+0000 7fb0fbfff640 1 -- 172.21.15.81:0/2791426239 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb1040072e0 con 0x7fb114074ef0 2024-09-18T02:03:51.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.647+0000 7fb0fbfff640 1 --2- 172.21.15.81:0/2791426239 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb100035e00 0x7fb1000382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:51.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.647+0000 7fb0fbfff640 1 -- 172.21.15.81:0/2791426239 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fb1040b4070 con 0x7fb114074ef0 2024-09-18T02:03:51.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.647+0000 7fb112ffd640 1 --2- 172.21.15.81:0/2791426239 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb100035e00 0x7fb1000382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:51.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.647+0000 7fb112ffd640 1 --2- 172.21.15.81:0/2791426239 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb100035e00 0x7fb1000382c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb108009730 tx=0x7fb108006cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:51.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.651+0000 7fb0fbfff640 1 -- 172.21.15.81:0/2791426239 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb1040168d0 con 0x7fb114074ef0 2024-09-18T02:03:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.803+0000 7fb891410640 1 -- 172.21.15.81:0/3197492070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb88c12ec80 con 0x7fb88c12e760 2024-09-18T02:03:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.803+0000 7fb8737fe640 1 -- 172.21.15.81:0/3197492070 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb87c0ca430 con 0x7fb88c12e760 2024-09-18T02:03:51.810 INFO:teuthology.orchestra.run.smithi081.stdout:38654705666 2024-09-18T02:03:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.807+0000 7fb891410640 1 -- 172.21.15.81:0/3197492070 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb878035e00 msgr2=0x7fb8780382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.807+0000 7fb891410640 1 --2- 172.21.15.81:0/3197492070 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb878035e00 0x7fb8780382c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb880007fd0 tx=0x7fb880007980 comp rx=0 tx=0).stop 2024-09-18T02:03:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.807+0000 7fb891410640 1 -- 172.21.15.81:0/3197492070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c12e760 msgr2=0x7fb88c130990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.807+0000 7fb891410640 1 --2- 172.21.15.81:0/3197492070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c12e760 0x7fb88c130990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb87c01a030 tx=0x7fb87c01ac40 comp rx=0 tx=0).stop 2024-09-18T02:03:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.807+0000 7fb891410640 1 -- 172.21.15.81:0/3197492070 shutdown_connections 2024-09-18T02:03:51.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.807+0000 7fb891410640 1 --2- 172.21.15.81:0/3197492070 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb878035e00 0x7fb8780382c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.807+0000 7fb891410640 1 --2- 172.21.15.81:0/3197492070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c12e760 0x7fb88c130990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.807+0000 7fb891410640 1 -- 172.21.15.81:0/3197492070 >> 172.21.15.81:0/3197492070 conn(0x7fb88c0a10a0 msgr2=0x7fb88c12c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.807+0000 7fb891410640 1 -- 172.21.15.81:0/3197492070 shutdown_connections 2024-09-18T02:03:51.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.807+0000 7fb891410640 1 -- 172.21.15.81:0/3197492070 wait complete. 2024-09-18T02:03:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.807+0000 7fb119e78640 1 -- 172.21.15.81:0/2791426239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb11406eed0 con 0x7fb114074ef0 2024-09-18T02:03:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.811+0000 7fb0fbfff640 1 -- 172.21.15.81:0/2791426239 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb1040048a0 con 0x7fb114074ef0 2024-09-18T02:03:51.814 INFO:teuthology.orchestra.run.smithi081.stdout:38654705668 2024-09-18T02:03:51.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.811+0000 7fb119e78640 1 -- 172.21.15.81:0/2791426239 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb100035e00 msgr2=0x7fb1000382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.811+0000 7fb119e78640 1 --2- 172.21.15.81:0/2791426239 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb100035e00 0x7fb1000382c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb108009730 tx=0x7fb108006cb0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.811+0000 7fb119e78640 1 -- 172.21.15.81:0/2791426239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb114074ef0 msgr2=0x7fb1141c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.811+0000 7fb119e78640 1 --2- 172.21.15.81:0/2791426239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb114074ef0 0x7fb1141c6030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb104000c10 tx=0x7fb0fc005840 comp rx=0 tx=0).stop 2024-09-18T02:03:51.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.811+0000 7fb119e78640 1 -- 172.21.15.81:0/2791426239 shutdown_connections 2024-09-18T02:03:51.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.811+0000 7fb119e78640 1 --2- 172.21.15.81:0/2791426239 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb100035e00 0x7fb1000382c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.811+0000 7fb119e78640 1 --2- 172.21.15.81:0/2791426239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb114074ef0 0x7fb1141c6030 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.811+0000 7fb119e78640 1 -- 172.21.15.81:0/2791426239 >> 172.21.15.81:0/2791426239 conn(0x7fb11409d4c0 msgr2=0x7fb114092010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.811+0000 7fb119e78640 1 -- 172.21.15.81:0/2791426239 shutdown_connections 2024-09-18T02:03:51.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.811+0000 7fb119e78640 1 -- 172.21.15.81:0/2791426239 wait complete. 2024-09-18T02:03:51.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.0 2024-09-18T02:03:51.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.2 2024-09-18T02:03:51.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f609ee4e640 1 -- 172.21.15.81:0/1872228935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6078005380 con 0x7f6098095bf0 2024-09-18T02:03:51.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f60957fa640 1 -- 172.21.15.81:0/1872228935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f608c0160b0 con 0x7f6098095bf0 2024-09-18T02:03:51.883 INFO:teuthology.orchestra.run.smithi081.stdout:38654705667 2024-09-18T02:03:51.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7efff4b97640 1 -- 172.21.15.81:0/3050391588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7effd4005380 con 0x7efff006be20 2024-09-18T02:03:51.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7effdeffd640 1 -- 172.21.15.81:0/3050391588 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7effe0015fb0 con 0x7efff006be20 2024-09-18T02:03:51.883 INFO:teuthology.orchestra.run.smithi081.stdout:38654705667 2024-09-18T02:03:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f609ee4e640 1 -- 172.21.15.81:0/1872228935 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f607c035db0 msgr2=0x7f607c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f609ee4e640 1 --2- 172.21.15.81:0/1872228935 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f607c035db0 0x7f607c038270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6084001600 tx=0x7f6084007a50 comp rx=0 tx=0).stop 2024-09-18T02:03:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f609ee4e640 1 -- 172.21.15.81:0/1872228935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6098095bf0 msgr2=0x7f609812ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f609ee4e640 1 --2- 172.21.15.81:0/1872228935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6098095bf0 0x7f609812ed50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f608c0097f0 tx=0x7f608c01ac70 comp rx=0 tx=0).stop 2024-09-18T02:03:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f609ee4e640 1 -- 172.21.15.81:0/1872228935 shutdown_connections 2024-09-18T02:03:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f609ee4e640 1 --2- 172.21.15.81:0/1872228935 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f607c035db0 0x7f607c038270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f609ee4e640 1 --2- 172.21.15.81:0/1872228935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6098095bf0 0x7f609812ed50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f609ee4e640 1 -- 172.21.15.81:0/1872228935 >> 172.21.15.81:0/1872228935 conn(0x7f609809cd50 msgr2=0x7f6098128f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f609ee4e640 1 -- 172.21.15.81:0/1872228935 shutdown_connections 2024-09-18T02:03:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7f609ee4e640 1 -- 172.21.15.81:0/1872228935 wait complete. 2024-09-18T02:03:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7efff4b97640 1 -- 172.21.15.81:0/3050391588 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effd0035e00 msgr2=0x7effd00382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7efff4b97640 1 --2- 172.21.15.81:0/3050391588 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effd0035e00 0x7effd00382c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7effe4000f70 tx=0x7effe4007970 comp rx=0 tx=0).stop 2024-09-18T02:03:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7efff4b97640 1 -- 172.21.15.81:0/3050391588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff006be20 msgr2=0x7efff00972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7efff4b97640 1 --2- 172.21.15.81:0/3050391588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff006be20 0x7efff00972f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7effe00ae040 tx=0x7effe00190d0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7efff4b97640 1 -- 172.21.15.81:0/3050391588 shutdown_connections 2024-09-18T02:03:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7efff4b97640 1 --2- 172.21.15.81:0/3050391588 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effd0035e00 0x7effd00382c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7efff4b97640 1 --2- 172.21.15.81:0/3050391588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff006be20 0x7efff00972f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7efff4b97640 1 -- 172.21.15.81:0/3050391588 >> 172.21.15.81:0/3050391588 conn(0x7efff009ac70 msgr2=0x7efff0127090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7efff4b97640 1 -- 172.21.15.81:0/3050391588 shutdown_connections 2024-09-18T02:03:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:51.879+0000 7efff4b97640 1 -- 172.21.15.81:0/3050391588 wait complete. 2024-09-18T02:03:51.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.3 2024-09-18T02:03:51.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.1 2024-09-18T02:03:52.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T02:03:52.839 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T02:03:52.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T02:03:52.909 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T02:03:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.955+0000 7fca2aa42640 1 Processor -- start 2024-09-18T02:03:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.955+0000 7fca2aa42640 1 -- start start 2024-09-18T02:03:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.955+0000 7fca2aa42640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fca24096180 0x7fca24096560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.955+0000 7fca2aa42640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca2406c620 con 0x7fca24096aa0 2024-09-18T02:03:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.955+0000 7fca2aa42640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fca2406ca70 con 0x7fca24096180 2024-09-18T02:03:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.955+0000 7fca23fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fca24096180 0x7fca24096560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.955+0000 7fca237fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fca24096aa0 0x7fca2412ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36484/0 (socket says 172.21.15.81:36484) 2024-09-18T02:03:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.955+0000 7fca237fe640 1 -- 172.21.15.81:0/1768291506 learned_addr learned my addr 172.21.15.81:0/1768291506 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.959+0000 7fca23fff640 1 -- 172.21.15.81:0/1768291506 >> v1:172.21.15.81:6789/0 conn(0x7fca24096aa0 legacy=0x7fca2412ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.959+0000 7fca22ffd640 1 -- 172.21.15.81:0/1768291506 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1429417062 0 0) 0x7fca2406c620 con 0x7fca24096aa0 2024-09-18T02:03:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.959+0000 7fca23fff640 1 -- 172.21.15.81:0/1768291506 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2406beb0 con 0x7fca24096180 2024-09-18T02:03:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.959+0000 7fca23fff640 1 --2- 172.21.15.81:0/1768291506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24096180 0x7fca24096560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca14009740 tx=0x7fca1401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eaca5cfd6c2114d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.959+0000 7fca22ffd640 1 -- 172.21.15.81:0/1768291506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca140b0070 con 0x7fca24096180 2024-09-18T02:03:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.959+0000 7fca22ffd640 1 -- 172.21.15.81:0/1768291506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca140ab530 con 0x7fca24096180 2024-09-18T02:03:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.959+0000 7fca22ffd640 1 -- 172.21.15.81:0/1768291506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca140ab830 con 0x7fca24096180 2024-09-18T02:03:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca2aa42640 1 -- 172.21.15.81:0/1768291506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24096180 msgr2=0x7fca24096560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca2aa42640 1 --2- 172.21.15.81:0/1768291506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24096180 0x7fca24096560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca14009740 tx=0x7fca1401c370 comp rx=0 tx=0).stop 2024-09-18T02:03:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca2aa42640 1 -- 172.21.15.81:0/1768291506 shutdown_connections 2024-09-18T02:03:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca2aa42640 1 --2- 172.21.15.81:0/1768291506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24096180 0x7fca24096560 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca2aa42640 1 -- 172.21.15.81:0/1768291506 >> 172.21.15.81:0/1768291506 conn(0x7fca2409a700 msgr2=0x7fca2409aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca2aa42640 1 -- 172.21.15.81:0/1768291506 shutdown_connections 2024-09-18T02:03:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca2aa42640 1 -- 172.21.15.81:0/1768291506 wait complete. 2024-09-18T02:03:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca2aa42640 1 Processor -- start 2024-09-18T02:03:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca2aa42640 1 -- start start 2024-09-18T02:03:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca2aa42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24096180 0x7fca241c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:52.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca2aa42640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca241371f0 con 0x7fca24096180 2024-09-18T02:03:52.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24096180 0x7fca241c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:52.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24096180 0x7fca241c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39348/0 (socket says 172.21.15.81:39348) 2024-09-18T02:03:52.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca23fff640 1 -- 172.21.15.81:0/3323007665 learned_addr learned my addr 172.21.15.81:0/3323007665 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca23fff640 1 -- 172.21.15.81:0/3323007665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2406eb50 con 0x7fca24096180 2024-09-18T02:03:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca23fff640 1 --2- 172.21.15.81:0/3323007665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24096180 0x7fca241c69c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fca14019fa0 tx=0x7fca1401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.963+0000 7fca20ff9640 1 -- 172.21.15.81:0/3323007665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca140b0050 con 0x7fca24096180 2024-09-18T02:03:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.967+0000 7fca20ff9640 1 -- 172.21.15.81:0/3323007665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca140b1040 con 0x7fca24096180 2024-09-18T02:03:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.967+0000 7fca20ff9640 1 -- 172.21.15.81:0/3323007665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca140b5740 con 0x7fca24096180 2024-09-18T02:03:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.967+0000 7fca2aa42640 1 -- 172.21.15.81:0/3323007665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca24093830 con 0x7fca24096180 2024-09-18T02:03:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.967+0000 7fca2aa42640 1 -- 172.21.15.81:0/3323007665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2406f740 con 0x7fca24096180 2024-09-18T02:03:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.967+0000 7fca2aa42640 1 -- 172.21.15.81:0/3323007665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2406fa70 con 0x7fca24096180 2024-09-18T02:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.967+0000 7fca20ff9640 1 -- 172.21.15.81:0/3323007665 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fca140be030 con 0x7fca24096180 2024-09-18T02:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.967+0000 7fca20ff9640 1 --2- 172.21.15.81:0/3323007665 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fca10035db0 0x7fca10038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.967+0000 7fca20ff9640 1 -- 172.21.15.81:0/3323007665 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fca140bc070 con 0x7fca24096180 2024-09-18T02:03:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.967+0000 7fca237fe640 1 --2- 172.21.15.81:0/3323007665 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fca10035db0 0x7fca10038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.967+0000 7fca237fe640 1 --2- 172.21.15.81:0/3323007665 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fca10035db0 0x7fca10038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fca18007fd0 tx=0x7fca18007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.971+0000 7fca20ff9640 1 -- 172.21.15.81:0/3323007665 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fca140c5020 con 0x7fca24096180 2024-09-18T02:03:52.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.995+0000 7f79b02d0640 1 Processor -- start 2024-09-18T02:03:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.995+0000 7f79b02d0640 1 -- start start 2024-09-18T02:03:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.995+0000 7f79b02d0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79a8096c70 0x7f79a8134320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.995+0000 7f79b02d0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a806beb0 con 0x7f79a8096180 2024-09-18T02:03:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.995+0000 7f79b02d0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f79a806cb20 con 0x7f79a8096c70 2024-09-18T02:03:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.995+0000 7f79ad86b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79a8096c70 0x7f79a8134320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.995+0000 7f79ae06c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f79a8096180 0x7f79a8096560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36498/0 (socket says 172.21.15.81:36498) 2024-09-18T02:03:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.995+0000 7f79ad86b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79a8096c70 0x7f79a8134320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39358/0 (socket says 172.21.15.81:39358) 2024-09-18T02:03:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.995+0000 7f79ae06c640 1 -- 172.21.15.81:0/874935328 learned_addr learned my addr 172.21.15.81:0/874935328 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.995+0000 7f79ad86b640 1 -- 172.21.15.81:0/874935328 >> v1:172.21.15.81:6789/0 conn(0x7f79a8096180 legacy=0x7f79a8096560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.995+0000 7f79ad86b640 1 -- 172.21.15.81:0/874935328 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a8097440 con 0x7f79a8096c70 2024-09-18T02:03:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79ad86b640 1 --2- 172.21.15.81:0/874935328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79a8096c70 0x7f79a8134320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7998009740 tx=0x7f799801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0089dcb2b40359e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79ad06a640 1 -- 172.21.15.81:0/874935328 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79980b0070 con 0x7f79a8096c70 2024-09-18T02:03:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79ad06a640 1 -- 172.21.15.81:0/874935328 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79980ab530 con 0x7f79a8096c70 2024-09-18T02:03:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79ad06a640 1 -- 172.21.15.81:0/874935328 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79980ab830 con 0x7f79a8096c70 2024-09-18T02:03:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79b02d0640 1 -- 172.21.15.81:0/874935328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79a8096c70 msgr2=0x7f79a8134320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79b02d0640 1 --2- 172.21.15.81:0/874935328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79a8096c70 0x7f79a8134320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7998009740 tx=0x7f799801c370 comp rx=0 tx=0).stop 2024-09-18T02:03:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79b02d0640 1 -- 172.21.15.81:0/874935328 shutdown_connections 2024-09-18T02:03:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79b02d0640 1 --2- 172.21.15.81:0/874935328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79a8096c70 0x7f79a8134320 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79b02d0640 1 -- 172.21.15.81:0/874935328 >> 172.21.15.81:0/874935328 conn(0x7f79a809a700 msgr2=0x7f79a809aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79b02d0640 1 -- 172.21.15.81:0/874935328 shutdown_connections 2024-09-18T02:03:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79b02d0640 1 -- 172.21.15.81:0/874935328 wait complete. 2024-09-18T02:03:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79b02d0640 1 Processor -- start 2024-09-18T02:03:53.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79b02d0640 1 -- start start 2024-09-18T02:03:53.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79b02d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79a8096180 0x7f79a806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:53.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79b02d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f79a8137410 con 0x7f79a8096180 2024-09-18T02:03:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79ae06c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79a8096180 0x7f79a806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79ae06c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79a8096180 0x7f79a806d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39374/0 (socket says 172.21.15.81:39374) 2024-09-18T02:03:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79ae06c640 1 -- 172.21.15.81:0/1315997692 learned_addr learned my addr 172.21.15.81:0/1315997692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:52.999+0000 7f79ae06c640 1 -- 172.21.15.81:0/1315997692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a806f2c0 con 0x7f79a8096180 2024-09-18T02:03:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f79ae06c640 1 --2- 172.21.15.81:0/1315997692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79a8096180 0x7f79a806d360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c480 tx=0x7f79a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f799effd640 1 -- 172.21.15.81:0/1315997692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a4017070 con 0x7f79a8096180 2024-09-18T02:03:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f799effd640 1 -- 172.21.15.81:0/1315997692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a4005c20 con 0x7f79a8096180 2024-09-18T02:03:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f79b02d0640 1 -- 172.21.15.81:0/1315997692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a806fd10 con 0x7f79a8096180 2024-09-18T02:03:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f799effd640 1 -- 172.21.15.81:0/1315997692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a4007070 con 0x7f79a8096180 2024-09-18T02:03:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f79b02d0640 1 -- 172.21.15.81:0/1315997692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a80705b0 con 0x7f79a8096180 2024-09-18T02:03:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f799effd640 1 -- 172.21.15.81:0/1315997692 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79a401a070 con 0x7f79a8096180 2024-09-18T02:03:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f799effd640 1 --2- 172.21.15.81:0/1315997692 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f798c035d40 0x7f798c038200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f799effd640 1 -- 172.21.15.81:0/1315997692 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f79a404b120 con 0x7f79a8096180 2024-09-18T02:03:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f799cff9640 1 -- 172.21.15.81:0/1315997692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7984005090 con 0x7f79a8096180 2024-09-18T02:03:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f79ad86b640 1 --2- 172.21.15.81:0/1315997692 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f798c035d40 0x7f798c038200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.003+0000 7f79ad86b640 1 --2- 172.21.15.81:0/1315997692 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f798c035d40 0x7f798c038200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f79980ad000 tx=0x7f79980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:53.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.011+0000 7f799effd640 1 -- 172.21.15.81:0/1315997692 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f79a40466e0 con 0x7f79a8096180 2024-09-18T02:03:53.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.035+0000 7ff234a3d640 1 Processor -- start 2024-09-18T02:03:53.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.035+0000 7ff234a3d640 1 -- start start 2024-09-18T02:03:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.035+0000 7ff234a3d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff23012cd50 0x7ff23012d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.035+0000 7ff234a3d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff23009e860 con 0x7ff230071c60 2024-09-18T02:03:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.035+0000 7ff234a3d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff23012d670 con 0x7ff23012cd50 2024-09-18T02:03:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.035+0000 7ff22e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff23012cd50 0x7ff23012d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7ff22dd9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff230071c60 0x7ff23006f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36506/0 (socket says 172.21.15.81:36506) 2024-09-18T02:03:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7ff22e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff23012cd50 0x7ff23012d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39386/0 (socket says 172.21.15.81:39386) 2024-09-18T02:03:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7ff22dd9b640 1 -- 172.21.15.81:0/2601175288 learned_addr learned my addr 172.21.15.81:0/2601175288 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7ff22e59c640 1 -- 172.21.15.81:0/2601175288 >> v1:172.21.15.81:6789/0 conn(0x7ff230071c60 legacy=0x7ff23006f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7ff22d59a640 1 -- 172.21.15.81:0/2601175288 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885136332 0 0) 0x7ff23009e860 con 0x7ff230071c60 2024-09-18T02:03:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7ff22e59c640 1 -- 172.21.15.81:0/2601175288 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23012d820 con 0x7ff23012cd50 2024-09-18T02:03:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7fd7dc3ac640 1 Processor -- start 2024-09-18T02:03:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7fd7dc3ac640 1 -- start start 2024-09-18T02:03:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7fd7dc3ac640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd7d4098e10 0x7fd7d4096450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7fd7dc3ac640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d4097f50 con 0x7fd7d4096990 2024-09-18T02:03:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7fd7dc3ac640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd7d4097af0 con 0x7fd7d4098e10 2024-09-18T02:03:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7fd7da148640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd7d4098e10 0x7fd7d4096450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7fd7d9947640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd7d4096990 0x7fd7d4132e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36516/0 (socket says 172.21.15.81:36516) 2024-09-18T02:03:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7fd7d9947640 1 -- 172.21.15.81:0/2084693991 learned_addr learned my addr 172.21.15.81:0/2084693991 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7fd7da148640 1 -- 172.21.15.81:0/2084693991 >> v1:172.21.15.81:6789/0 conn(0x7fd7d4096990 legacy=0x7fd7d4132e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7fd7d9146640 1 -- 172.21.15.81:0/2084693991 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440900714 0 0) 0x7fd7d4097f50 con 0x7fd7d4096990 2024-09-18T02:03:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7fd7da148640 1 -- 172.21.15.81:0/2084693991 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d4096da0 con 0x7fd7d4098e10 2024-09-18T02:03:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7ff22e59c640 1 --2- 172.21.15.81:0/2601175288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23012cd50 0x7ff23012d130 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff220009740 tx=0x7ff22001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af58573ae44b5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7ff22d59a640 1 -- 172.21.15.81:0/2601175288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2200ab550 con 0x7ff23012cd50 2024-09-18T02:03:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7ff22d59a640 1 -- 172.21.15.81:0/2601175288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2200b0070 con 0x7ff23012cd50 2024-09-18T02:03:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.039+0000 7ff22d59a640 1 -- 172.21.15.81:0/2601175288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2200ab840 con 0x7ff23012cd50 2024-09-18T02:03:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7da148640 1 --2- 172.21.15.81:0/2084693991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d4098e10 0x7fd7d4096450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009740 tx=0x7fd7d001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0fdcdda69cd527 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 -- 172.21.15.81:0/2601175288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23012cd50 msgr2=0x7ff23012d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 --2- 172.21.15.81:0/2601175288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23012cd50 0x7ff23012d130 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff220009740 tx=0x7ff22001c400 comp rx=0 tx=0).stop 2024-09-18T02:03:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 -- 172.21.15.81:0/2601175288 shutdown_connections 2024-09-18T02:03:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 --2- 172.21.15.81:0/2601175288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23012cd50 0x7ff23012d130 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 -- 172.21.15.81:0/2601175288 >> 172.21.15.81:0/2601175288 conn(0x7ff23009cd30 msgr2=0x7ff23009d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7d9146640 1 -- 172.21.15.81:0/2084693991 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d00b0070 con 0x7fd7d4098e10 2024-09-18T02:03:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7d9146640 1 -- 172.21.15.81:0/2084693991 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d00ab530 con 0x7fd7d4098e10 2024-09-18T02:03:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7d9146640 1 -- 172.21.15.81:0/2084693991 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d00ab830 con 0x7fd7d4098e10 2024-09-18T02:03:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 -- 172.21.15.81:0/2601175288 shutdown_connections 2024-09-18T02:03:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 -- 172.21.15.81:0/2601175288 wait complete. 2024-09-18T02:03:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 Processor -- start 2024-09-18T02:03:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/2084693991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d4098e10 msgr2=0x7fd7d4096450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7dc3ac640 1 --2- 172.21.15.81:0/2084693991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d4098e10 0x7fd7d4096450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009740 tx=0x7fd7d001c400 comp rx=0 tx=0).stop 2024-09-18T02:03:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 -- start start 2024-09-18T02:03:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/2084693991 shutdown_connections 2024-09-18T02:03:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7dc3ac640 1 --2- 172.21.15.81:0/2084693991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d4098e10 0x7fd7d4096450 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009740 tx=0x7fd7d001c400 comp rx=0 tx=0).stop 2024-09-18T02:03:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/2084693991 >> 172.21.15.81:0/2084693991 conn(0x7fd7d409cd50 msgr2=0x7fd7d409d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:53.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff230071c60 0x7ff2300986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:53.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff230070b10 con 0x7ff230071c60 2024-09-18T02:03:53.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/2084693991 shutdown_connections 2024-09-18T02:03:53.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/2084693991 wait complete. 2024-09-18T02:03:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff22e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff230071c60 0x7ff2300986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff22e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff230071c60 0x7ff2300986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39398/0 (socket says 172.21.15.81:39398) 2024-09-18T02:03:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff22e59c640 1 -- 172.21.15.81:0/2284466701 learned_addr learned my addr 172.21.15.81:0/2284466701 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff22e59c640 1 -- 172.21.15.81:0/2284466701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23006f010 con 0x7ff230071c60 2024-09-18T02:03:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff22e59c640 1 --2- 172.21.15.81:0/2284466701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff230071c60 0x7ff2300986d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff220019010 tx=0x7ff22001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff21effd640 1 -- 172.21.15.81:0/2284466701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2200abe30 con 0x7ff230071c60 2024-09-18T02:03:53.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff21effd640 1 -- 172.21.15.81:0/2284466701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff220004020 con 0x7ff230071c60 2024-09-18T02:03:53.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff21effd640 1 -- 172.21.15.81:0/2284466701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff220004300 con 0x7ff230071c60 2024-09-18T02:03:53.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7dc3ac640 1 Processor -- start 2024-09-18T02:03:53.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7fd7dc3ac640 1 -- start start 2024-09-18T02:03:53.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.043+0000 7ff234a3d640 1 -- 172.21.15.81:0/2284466701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff230072cd0 con 0x7ff230071c60 2024-09-18T02:03:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7ff234a3d640 1 -- 172.21.15.81:0/2284466701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff23012a2d0 con 0x7ff230071c60 2024-09-18T02:03:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7fd7dc3ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d4096990 0x7fd7d40903d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7fd7dc3ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d4098730 con 0x7fd7d4096990 2024-09-18T02:03:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7fd7da148640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d4096990 0x7fd7d40903d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7fd7da148640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d4096990 0x7fd7d40903d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39404/0 (socket says 172.21.15.81:39404) 2024-09-18T02:03:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7fd7da148640 1 -- 172.21.15.81:0/459503017 learned_addr learned my addr 172.21.15.81:0/459503017 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7fd7da148640 1 -- 172.21.15.81:0/459503017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d40731d0 con 0x7fd7d4096990 2024-09-18T02:03:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7ff234a3d640 1 -- 172.21.15.81:0/2284466701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff230129c40 con 0x7ff230071c60 2024-09-18T02:03:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7fd7da148640 1 --2- 172.21.15.81:0/459503017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d4096990 0x7fd7d40903d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00ab500 tx=0x7fd7d001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7fd7caffd640 1 -- 172.21.15.81:0/459503017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d00bc070 con 0x7fd7d4096990 2024-09-18T02:03:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/459503017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d4093980 con 0x7fd7d4096990 2024-09-18T02:03:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/459503017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d4090910 con 0x7fd7d4096990 2024-09-18T02:03:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7ff21effd640 1 -- 172.21.15.81:0/2284466701 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff220003620 con 0x7ff230071c60 2024-09-18T02:03:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7ff21effd640 1 --2- 172.21.15.81:0/2284466701 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff210035db0 0x7ff210038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7ff21effd640 1 -- 172.21.15.81:0/2284466701 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7ff2200e3580 con 0x7ff230071c60 2024-09-18T02:03:53.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.047+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/459503017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d4096450 con 0x7fd7d4096990 2024-09-18T02:03:53.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.051+0000 7ff22dd9b640 1 --2- 172.21.15.81:0/2284466701 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff210035db0 0x7ff210038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:53.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.051+0000 7ff22dd9b640 1 --2- 172.21.15.81:0/2284466701 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff210035db0 0x7ff210038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff224007fd0 tx=0x7ff224007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:53.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.051+0000 7fd7caffd640 1 -- 172.21.15.81:0/459503017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d00b1040 con 0x7fd7d4096990 2024-09-18T02:03:53.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.051+0000 7fd7caffd640 1 -- 172.21.15.81:0/459503017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d00b0050 con 0x7fd7d4096990 2024-09-18T02:03:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.051+0000 7ff21effd640 1 -- 172.21.15.81:0/2284466701 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff220015ff0 con 0x7ff230071c60 2024-09-18T02:03:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.051+0000 7fd7caffd640 1 -- 172.21.15.81:0/459503017 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd7d00bf070 con 0x7fd7d4096990 2024-09-18T02:03:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.051+0000 7fd7caffd640 1 --2- 172.21.15.81:0/459503017 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7b8035db0 0x7fd7b8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.051+0000 7fd7caffd640 1 -- 172.21.15.81:0/459503017 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fd7d00e2bf0 con 0x7fd7d4096990 2024-09-18T02:03:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.051+0000 7fd7d9947640 1 --2- 172.21.15.81:0/459503017 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7b8035db0 0x7fd7b8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.051+0000 7fd7d9947640 1 --2- 172.21.15.81:0/459503017 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7b8035db0 0x7fd7b8038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4007fd0 tx=0x7fd7c4007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.055+0000 7fd7caffd640 1 -- 172.21.15.81:0/459503017 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd7d00c6020 con 0x7fd7d4096990 2024-09-18T02:03:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.139+0000 7fca2aa42640 1 -- 172.21.15.81:0/3323007665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fca24096560 con 0x7fca24096180 2024-09-18T02:03:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.139+0000 7fca20ff9640 1 -- 172.21.15.81:0/3323007665 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca14015ff0 con 0x7fca24096180 2024-09-18T02:03:53.144 INFO:teuthology.orchestra.run.smithi081.stdout:38654705666 2024-09-18T02:03:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.143+0000 7fca2aa42640 1 -- 172.21.15.81:0/3323007665 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fca10035db0 msgr2=0x7fca10038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.143+0000 7fca2aa42640 1 --2- 172.21.15.81:0/3323007665 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fca10035db0 0x7fca10038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fca18007fd0 tx=0x7fca18007920 comp rx=0 tx=0).stop 2024-09-18T02:03:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.143+0000 7fca2aa42640 1 -- 172.21.15.81:0/3323007665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24096180 msgr2=0x7fca241c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.143+0000 7fca2aa42640 1 --2- 172.21.15.81:0/3323007665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24096180 0x7fca241c69c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fca14019fa0 tx=0x7fca1401abb0 comp rx=0 tx=0).stop 2024-09-18T02:03:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.143+0000 7fca2aa42640 1 -- 172.21.15.81:0/3323007665 shutdown_connections 2024-09-18T02:03:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.143+0000 7fca2aa42640 1 --2- 172.21.15.81:0/3323007665 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fca10035db0 0x7fca10038270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.143+0000 7fca2aa42640 1 --2- 172.21.15.81:0/3323007665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca24096180 0x7fca241c69c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.143+0000 7fca2aa42640 1 -- 172.21.15.81:0/3323007665 >> 172.21.15.81:0/3323007665 conn(0x7fca2409a700 msgr2=0x7fca24099490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.143+0000 7fca2aa42640 1 -- 172.21.15.81:0/3323007665 shutdown_connections 2024-09-18T02:03:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.143+0000 7fca2aa42640 1 -- 172.21.15.81:0/3323007665 wait complete. 2024-09-18T02:03:53.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.0 2024-09-18T02:03:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.175+0000 7f799cff9640 1 -- 172.21.15.81:0/1315997692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7984005650 con 0x7f79a8096180 2024-09-18T02:03:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.175+0000 7f799effd640 1 -- 172.21.15.81:0/1315997692 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f79a4007210 con 0x7f79a8096180 2024-09-18T02:03:53.181 INFO:teuthology.orchestra.run.smithi081.stdout:38654705668 2024-09-18T02:03:53.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.179+0000 7f799cff9640 1 -- 172.21.15.81:0/1315997692 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f798c035d40 msgr2=0x7f798c038200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.179+0000 7f799cff9640 1 --2- 172.21.15.81:0/1315997692 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f798c035d40 0x7f798c038200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f79980ad000 tx=0x7f79980a6000 comp rx=0 tx=0).stop 2024-09-18T02:03:53.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.179+0000 7f799cff9640 1 -- 172.21.15.81:0/1315997692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79a8096180 msgr2=0x7f79a806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.179+0000 7f799cff9640 1 --2- 172.21.15.81:0/1315997692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79a8096180 0x7f79a806d360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c480 tx=0x7f79a400c940 comp rx=0 tx=0).stop 2024-09-18T02:03:53.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.179+0000 7f799cff9640 1 -- 172.21.15.81:0/1315997692 shutdown_connections 2024-09-18T02:03:53.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.179+0000 7f799cff9640 1 --2- 172.21.15.81:0/1315997692 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f798c035d40 0x7f798c038200 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:53.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.179+0000 7f799cff9640 1 --2- 172.21.15.81:0/1315997692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79a8096180 0x7f79a806d360 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.179+0000 7f799cff9640 1 -- 172.21.15.81:0/1315997692 >> 172.21.15.81:0/1315997692 conn(0x7f79a809a700 msgr2=0x7f79a812e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.179+0000 7f799cff9640 1 -- 172.21.15.81:0/1315997692 shutdown_connections 2024-09-18T02:03:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.179+0000 7f799cff9640 1 -- 172.21.15.81:0/1315997692 wait complete. 2024-09-18T02:03:53.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.2 2024-09-18T02:03:53.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff234a3d640 1 -- 172.21.15.81:0/2284466701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff23012abb0 con 0x7ff230071c60 2024-09-18T02:03:53.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff21effd640 1 -- 172.21.15.81:0/2284466701 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff2200044a0 con 0x7ff230071c60 2024-09-18T02:03:53.215 INFO:teuthology.orchestra.run.smithi081.stdout:38654705667 2024-09-18T02:03:53.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff234a3d640 1 -- 172.21.15.81:0/2284466701 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff210035db0 msgr2=0x7ff210038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff234a3d640 1 --2- 172.21.15.81:0/2284466701 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff210035db0 0x7ff210038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff224007fd0 tx=0x7ff224007920 comp rx=0 tx=0).stop 2024-09-18T02:03:53.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff234a3d640 1 -- 172.21.15.81:0/2284466701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff230071c60 msgr2=0x7ff2300986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff234a3d640 1 --2- 172.21.15.81:0/2284466701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff230071c60 0x7ff2300986d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff220019010 tx=0x7ff22001ac40 comp rx=0 tx=0).stop 2024-09-18T02:03:53.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff234a3d640 1 -- 172.21.15.81:0/2284466701 shutdown_connections 2024-09-18T02:03:53.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff234a3d640 1 --2- 172.21.15.81:0/2284466701 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff210035db0 0x7ff210038270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:53.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff234a3d640 1 --2- 172.21.15.81:0/2284466701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff230071c60 0x7ff2300986d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:53.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff234a3d640 1 -- 172.21.15.81:0/2284466701 >> 172.21.15.81:0/2284466701 conn(0x7ff23009cd30 msgr2=0x7ff230099600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:53.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff234a3d640 1 -- 172.21.15.81:0/2284466701 shutdown_connections 2024-09-18T02:03:53.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.211+0000 7ff234a3d640 1 -- 172.21.15.81:0/2284466701 wait complete. 2024-09-18T02:03:53.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.223+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/459503017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd7d4091ca0 con 0x7fd7d4096990 2024-09-18T02:03:53.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.227+0000 7fd7caffd640 1 -- 172.21.15.81:0/459503017 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd7d40731d0 con 0x7fd7d4096990 2024-09-18T02:03:53.230 INFO:teuthology.orchestra.run.smithi081.stdout:38654705667 2024-09-18T02:03:53.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.3 2024-09-18T02:03:53.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.227+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/459503017 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7b8035db0 msgr2=0x7fd7b8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.227+0000 7fd7dc3ac640 1 --2- 172.21.15.81:0/459503017 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7b8035db0 0x7fd7b8038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4007fd0 tx=0x7fd7c4007980 comp rx=0 tx=0).stop 2024-09-18T02:03:53.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.227+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/459503017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d4096990 msgr2=0x7fd7d40903d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:53.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.227+0000 7fd7dc3ac640 1 --2- 172.21.15.81:0/459503017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d4096990 0x7fd7d40903d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00ab500 tx=0x7fd7d001ac40 comp rx=0 tx=0).stop 2024-09-18T02:03:53.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.227+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/459503017 shutdown_connections 2024-09-18T02:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.227+0000 7fd7dc3ac640 1 --2- 172.21.15.81:0/459503017 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7b8035db0 0x7fd7b8038270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.227+0000 7fd7dc3ac640 1 --2- 172.21.15.81:0/459503017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d4096990 0x7fd7d40903d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.227+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/459503017 >> 172.21.15.81:0/459503017 conn(0x7fd7d409cd50 msgr2=0x7fd7d409a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.227+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/459503017 shutdown_connections 2024-09-18T02:03:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:53.227+0000 7fd7dc3ac640 1 -- 172.21.15.81:0/459503017 wait complete. 2024-09-18T02:03:53.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.1 2024-09-18T02:03:54.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T02:03:54.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T02:03:54.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T02:03:54.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T02:03:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.283+0000 7f0a91b37640 1 Processor -- start 2024-09-18T02:03:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.283+0000 7f0a91b37640 1 -- start start 2024-09-18T02:03:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.287+0000 7f0a91b37640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a8c12f490 0x7f0a8c133fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.287+0000 7f0a91b37640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a8c097c50 con 0x7f0a8c06bc50 2024-09-18T02:03:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.287+0000 7f0a91b37640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0a8c0500e0 con 0x7f0a8c12f490 2024-09-18T02:03:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.287+0000 7f0a8affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a8c12f490 0x7f0a8c133fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.287+0000 7f0a8b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0a8c06bc50 0x7f0a8c12ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36526/0 (socket says 172.21.15.81:36526) 2024-09-18T02:03:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.287+0000 7f0a8b7fe640 1 -- 172.21.15.81:0/3532996217 learned_addr learned my addr 172.21.15.81:0/3532996217 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.287+0000 7f0a8affd640 1 -- 172.21.15.81:0/3532996217 >> v1:172.21.15.81:6789/0 conn(0x7f0a8c06bc50 legacy=0x7f0a8c12ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.287+0000 7f0a8affd640 1 -- 172.21.15.81:0/3532996217 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c06c440 con 0x7f0a8c12f490 2024-09-18T02:03:54.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a8affd640 1 --2- 172.21.15.81:0/3532996217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8c12f490 0x7f0a8c133fc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009740 tx=0x7f0a8001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76247e2ad3467db server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a8a7fc640 1 -- 172.21.15.81:0/3532996217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a800b1070 con 0x7f0a8c12f490 2024-09-18T02:03:54.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a8a7fc640 1 -- 172.21.15.81:0/3532996217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a800ac570 con 0x7f0a8c12f490 2024-09-18T02:03:54.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a8a7fc640 1 -- 172.21.15.81:0/3532996217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a800ac870 con 0x7f0a8c12f490 2024-09-18T02:03:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a91b37640 1 -- 172.21.15.81:0/3532996217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8c12f490 msgr2=0x7f0a8c133fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a91b37640 1 --2- 172.21.15.81:0/3532996217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8c12f490 0x7f0a8c133fc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009740 tx=0x7f0a8001c400 comp rx=0 tx=0).stop 2024-09-18T02:03:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a91b37640 1 -- 172.21.15.81:0/3532996217 shutdown_connections 2024-09-18T02:03:54.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a91b37640 1 --2- 172.21.15.81:0/3532996217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8c12f490 0x7f0a8c133fc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a91b37640 1 -- 172.21.15.81:0/3532996217 >> 172.21.15.81:0/3532996217 conn(0x7f0a8c09ab00 msgr2=0x7f0a8c09af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:54.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a91b37640 1 -- 172.21.15.81:0/3532996217 shutdown_connections 2024-09-18T02:03:54.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a91b37640 1 -- 172.21.15.81:0/3532996217 wait complete. 2024-09-18T02:03:54.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a91b37640 1 Processor -- start 2024-09-18T02:03:54.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a91b37640 1 -- start start 2024-09-18T02:03:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a91b37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8c06bc50 0x7f0a8c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a91b37640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c136f30 con 0x7f0a8c06bc50 2024-09-18T02:03:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8c06bc50 0x7f0a8c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8c06bc50 0x7f0a8c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39416/0 (socket says 172.21.15.81:39416) 2024-09-18T02:03:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.291+0000 7f0a8b7fe640 1 -- 172.21.15.81:0/1702642430 learned_addr learned my addr 172.21.15.81:0/1702642430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a8b7fe640 1 -- 172.21.15.81:0/1702642430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c094410 con 0x7f0a8c06bc50 2024-09-18T02:03:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a8b7fe640 1 --2- 172.21.15.81:0/1702642430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8c06bc50 0x7f0a8c06d7e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c380 tx=0x7f0a7c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a73fff640 1 -- 172.21.15.81:0/1702642430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a7c017070 con 0x7f0a8c06bc50 2024-09-18T02:03:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a73fff640 1 -- 172.21.15.81:0/1702642430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7c005c20 con 0x7f0a8c06bc50 2024-09-18T02:03:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a91b37640 1 -- 172.21.15.81:0/1702642430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8c070110 con 0x7f0a8c06bc50 2024-09-18T02:03:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a73fff640 1 -- 172.21.15.81:0/1702642430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a7c0070d0 con 0x7f0a8c06bc50 2024-09-18T02:03:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a91b37640 1 -- 172.21.15.81:0/1702642430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8c0707f0 con 0x7f0a8c06bc50 2024-09-18T02:03:54.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a91b37640 1 -- 172.21.15.81:0/1702642430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a8c12ed80 con 0x7f0a8c06bc50 2024-09-18T02:03:54.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a73fff640 1 -- 172.21.15.81:0/1702642430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a7c01a070 con 0x7f0a8c06bc50 2024-09-18T02:03:54.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a73fff640 1 --2- 172.21.15.81:0/1702642430 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a78035db0 0x7f0a78038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a73fff640 1 -- 172.21.15.81:0/1702642430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f0a7c047960 con 0x7f0a8c06bc50 2024-09-18T02:03:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a8affd640 1 --2- 172.21.15.81:0/1702642430 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a78035db0 0x7f0a78038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.295+0000 7f0a8affd640 1 --2- 172.21.15.81:0/1702642430 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a78035db0 0x7f0a78038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0a800ae000 tx=0x7f0a80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.303+0000 7f0a73fff640 1 -- 172.21.15.81:0/1702642430 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a7c007270 con 0x7f0a8c06bc50 2024-09-18T02:03:54.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.327+0000 7fa0ec14e640 1 Processor -- start 2024-09-18T02:03:54.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.327+0000 7fa0ec14e640 1 -- start start 2024-09-18T02:03:54.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.331+0000 7fa0ec14e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa0e412f890 0x7fa0e4131c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.331+0000 7fa0ec14e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e4094ea0 con 0x7fa0e40943b0 2024-09-18T02:03:54.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.331+0000 7fa0ec14e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e40500e0 con 0x7fa0e412f890 2024-09-18T02:03:54.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.331+0000 7fa0e96e9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa0e412f890 0x7fa0e4131c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.331+0000 7fa0e9eea640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa0e40943b0 0x7fa0e4094790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36532/0 (socket says 172.21.15.81:36532) 2024-09-18T02:03:54.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.331+0000 7fa0e9eea640 1 -- 172.21.15.81:0/714437467 learned_addr learned my addr 172.21.15.81:0/714437467 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:54.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.331+0000 7fa0e96e9640 1 -- 172.21.15.81:0/714437467 >> v1:172.21.15.81:6789/0 conn(0x7fa0e40943b0 legacy=0x7fa0e4094790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.331+0000 7fa0e96e9640 1 -- 172.21.15.81:0/714437467 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e4098070 con 0x7fa0e412f890 2024-09-18T02:03:54.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.331+0000 7fa0e96e9640 1 --2- 172.21.15.81:0/714437467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e412f890 0x7fa0e4131c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009740 tx=0x7fa0d401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7f25d98d1ffeb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0e8ee8640 1 -- 172.21.15.81:0/714437467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0d40b1070 con 0x7fa0e412f890 2024-09-18T02:03:54.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0e8ee8640 1 -- 172.21.15.81:0/714437467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d40ac570 con 0x7fa0e412f890 2024-09-18T02:03:54.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0e8ee8640 1 -- 172.21.15.81:0/714437467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0d40ac870 con 0x7fa0e412f890 2024-09-18T02:03:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 -- 172.21.15.81:0/714437467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e412f890 msgr2=0x7fa0e4131c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 --2- 172.21.15.81:0/714437467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e412f890 0x7fa0e4131c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009740 tx=0x7fa0d401c400 comp rx=0 tx=0).stop 2024-09-18T02:03:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 -- 172.21.15.81:0/714437467 shutdown_connections 2024-09-18T02:03:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 --2- 172.21.15.81:0/714437467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e412f890 0x7fa0e4131c80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 -- 172.21.15.81:0/714437467 >> 172.21.15.81:0/714437467 conn(0x7fa0e409ab00 msgr2=0x7fa0e409af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 -- 172.21.15.81:0/714437467 shutdown_connections 2024-09-18T02:03:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 -- 172.21.15.81:0/714437467 wait complete. 2024-09-18T02:03:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 Processor -- start 2024-09-18T02:03:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 -- start start 2024-09-18T02:03:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40943b0 0x7fa0e406d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4134d70 con 0x7fa0e40943b0 2024-09-18T02:03:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0e9eea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40943b0 0x7fa0e406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0e9eea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40943b0 0x7fa0e406d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39434/0 (socket says 172.21.15.81:39434) 2024-09-18T02:03:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0e9eea640 1 -- 172.21.15.81:0/2376531218 learned_addr learned my addr 172.21.15.81:0/2376531218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0e9eea640 1 -- 172.21.15.81:0/2376531218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e412ea20 con 0x7fa0e40943b0 2024-09-18T02:03:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0e9eea640 1 --2- 172.21.15.81:0/2376531218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40943b0 0x7fa0e406d130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000c480 tx=0x7fa0e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0da7fc640 1 -- 172.21.15.81:0/2376531218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0e0017070 con 0x7fa0e40943b0 2024-09-18T02:03:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0da7fc640 1 -- 172.21.15.81:0/2376531218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e0005c20 con 0x7fa0e40943b0 2024-09-18T02:03:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 -- 172.21.15.81:0/2376531218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e4070db0 con 0x7fa0e40943b0 2024-09-18T02:03:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0da7fc640 1 -- 172.21.15.81:0/2376531218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0e0007070 con 0x7fa0e40943b0 2024-09-18T02:03:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.335+0000 7fa0ec14e640 1 -- 172.21.15.81:0/2376531218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e406d670 con 0x7fa0e40943b0 2024-09-18T02:03:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.339+0000 7fa0c7fff640 1 -- 172.21.15.81:0/2376531218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c0005090 con 0x7fa0e40943b0 2024-09-18T02:03:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.339+0000 7fa0da7fc640 1 -- 172.21.15.81:0/2376531218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa0e001a070 con 0x7fa0e40943b0 2024-09-18T02:03:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.339+0000 7fa0da7fc640 1 --2- 172.21.15.81:0/2376531218 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0c8035db0 0x7fa0c8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.339+0000 7fa0da7fc640 1 -- 172.21.15.81:0/2376531218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fa0e0047970 con 0x7fa0e40943b0 2024-09-18T02:03:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.339+0000 7fa0e96e9640 1 --2- 172.21.15.81:0/2376531218 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0c8035db0 0x7fa0c8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.339+0000 7fa0e96e9640 1 --2- 172.21.15.81:0/2376531218 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0c8035db0 0x7fa0c8038270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40ae000 tx=0x7fa0d40a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.343+0000 7fa0da7fc640 1 -- 172.21.15.81:0/2376531218 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa0e001a760 con 0x7fa0e40943b0 2024-09-18T02:03:54.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f43091ab640 1 Processor -- start 2024-09-18T02:03:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f43091ab640 1 -- start start 2024-09-18T02:03:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f43091ab640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f430412e760 0x7f430412ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f43091ab640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43040984f0 con 0x7f430412f1c0 2024-09-18T02:03:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f43091ab640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4304098dc0 con 0x7f430412e760 2024-09-18T02:03:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f430259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f430412f1c0 0x7f430412b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36540/0 (socket says 172.21.15.81:36540) 2024-09-18T02:03:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f4302d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f430412e760 0x7f430412ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f430259c640 1 -- 172.21.15.81:0/743066712 learned_addr learned my addr 172.21.15.81:0/743066712 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f4302d9d640 1 -- 172.21.15.81:0/743066712 >> v1:172.21.15.81:6789/0 conn(0x7f430412f1c0 legacy=0x7f430412b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f4302d9d640 1 -- 172.21.15.81:0/743066712 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430412f5a0 con 0x7f430412e760 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e7c42640 1 Processor -- start 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e7c42640 1 -- start start 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e7c42640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd7e006f860 0x7fd7e0130cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e7c42640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e0070ac0 con 0x7fd7e0071be0 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e7c42640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e0070c90 con 0x7fd7e006f860 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e59de640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd7e0071be0 0x7fd7e0071fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36552/0 (socket says 172.21.15.81:36552) 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e59de640 1 -- 172.21.15.81:0/3752983135 learned_addr learned my addr 172.21.15.81:0/3752983135 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e51dd640 1 --2- 172.21.15.81:0/3752983135 >> v2:172.21.15.81:3300/0 conn(0x7fd7e006f860 0x7fd7e0130cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e49dc640 1 -- 172.21.15.81:0/3752983135 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097763535 0 0) 0x7fd7e0070ac0 con 0x7fd7e0071be0 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e49dc640 1 -- 172.21.15.81:0/3752983135 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7cc005740 con 0x7fd7e0071be0 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e51dd640 1 -- 172.21.15.81:0/3752983135 >> v1:172.21.15.81:6789/0 conn(0x7fd7e0071be0 legacy=0x7fd7e0071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7fd7e51dd640 1 -- 172.21.15.81:0/3752983135 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e00726d0 con 0x7fd7e006f860 2024-09-18T02:03:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f4302d9d640 1 --2- 172.21.15.81:0/743066712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f430412e760 0x7f430412ec80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009740 tx=0x7f42f401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3cc804b7ec66d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f4301d9b640 1 -- 172.21.15.81:0/743066712 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f40b0070 con 0x7f430412e760 2024-09-18T02:03:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f4301d9b640 1 -- 172.21.15.81:0/743066712 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f40ab530 con 0x7f430412e760 2024-09-18T02:03:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.363+0000 7f4301d9b640 1 -- 172.21.15.81:0/743066712 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f40ab830 con 0x7f430412e760 2024-09-18T02:03:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 -- 172.21.15.81:0/743066712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f430412e760 msgr2=0x7f430412ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 --2- 172.21.15.81:0/743066712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f430412e760 0x7f430412ec80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009740 tx=0x7f42f401c400 comp rx=0 tx=0).stop 2024-09-18T02:03:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e51dd640 1 --2- 172.21.15.81:0/3752983135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7e006f860 0x7fd7e0130cf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009740 tx=0x7fd7d001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a406e72cf24d8f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 -- 172.21.15.81:0/743066712 shutdown_connections 2024-09-18T02:03:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 --2- 172.21.15.81:0/743066712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f430412e760 0x7f430412ec80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 -- 172.21.15.81:0/743066712 >> 172.21.15.81:0/743066712 conn(0x7f43040a10a0 msgr2=0x7f43040a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 -- 172.21.15.81:0/743066712 shutdown_connections 2024-09-18T02:03:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 -- 172.21.15.81:0/743066712 wait complete. 2024-09-18T02:03:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e49dc640 1 -- 172.21.15.81:0/3752983135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d00b1070 con 0x7fd7e006f860 2024-09-18T02:03:54.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e49dc640 1 -- 172.21.15.81:0/3752983135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d00ac570 con 0x7fd7e006f860 2024-09-18T02:03:54.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e49dc640 1 -- 172.21.15.81:0/3752983135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d00ac870 con 0x7fd7e006f860 2024-09-18T02:03:54.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e7c42640 1 -- 172.21.15.81:0/3752983135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7e006f860 msgr2=0x7fd7e0130cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e7c42640 1 --2- 172.21.15.81:0/3752983135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7e006f860 0x7fd7e0130cf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009740 tx=0x7fd7d001c400 comp rx=0 tx=0).stop 2024-09-18T02:03:54.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 Processor -- start 2024-09-18T02:03:54.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e7c42640 1 -- 172.21.15.81:0/3752983135 shutdown_connections 2024-09-18T02:03:54.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e7c42640 1 --2- 172.21.15.81:0/3752983135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7e006f860 0x7fd7e0130cf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e7c42640 1 -- 172.21.15.81:0/3752983135 >> 172.21.15.81:0/3752983135 conn(0x7fd7e009ac70 msgr2=0x7fd7e006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:54.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 -- start start 2024-09-18T02:03:54.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e7c42640 1 -- 172.21.15.81:0/3752983135 shutdown_connections 2024-09-18T02:03:54.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e7c42640 1 -- 172.21.15.81:0/3752983135 wait complete. 2024-09-18T02:03:54.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f430412e760 0x7f430409c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4304136e30 con 0x7f430412e760 2024-09-18T02:03:54.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f4302d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f430412e760 0x7f430409c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f4302d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f430412e760 0x7f430409c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39466/0 (socket says 172.21.15.81:39466) 2024-09-18T02:03:54.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f4302d9d640 1 -- 172.21.15.81:0/1716981966 learned_addr learned my addr 172.21.15.81:0/1716981966 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:54.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f4302d9d640 1 -- 172.21.15.81:0/1716981966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4304130510 con 0x7f430412e760 2024-09-18T02:03:54.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f4302d9d640 1 --2- 172.21.15.81:0/1716981966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f430412e760 0x7f430409c920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f42f401a030 tx=0x7f42f401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f42eb7fe640 1 -- 172.21.15.81:0/1716981966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f40b0050 con 0x7f430412e760 2024-09-18T02:03:54.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 -- 172.21.15.81:0/1716981966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4304130c10 con 0x7f430412e760 2024-09-18T02:03:54.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 -- 172.21.15.81:0/1716981966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430409ce60 con 0x7f430412e760 2024-09-18T02:03:54.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f42eb7fe640 1 -- 172.21.15.81:0/1716981966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f40b1040 con 0x7f430412e760 2024-09-18T02:03:54.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e7c42640 1 Processor -- start 2024-09-18T02:03:54.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f42eb7fe640 1 -- 172.21.15.81:0/1716981966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f40b0050 con 0x7f430412e760 2024-09-18T02:03:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e7c42640 1 -- start start 2024-09-18T02:03:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e7c42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7e006f860 0x7fd7e01c2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e7c42640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e006c7f0 con 0x7fd7e006f860 2024-09-18T02:03:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e59de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7e006f860 0x7fd7e01c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e59de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7e006f860 0x7fd7e01c2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39472/0 (socket says 172.21.15.81:39472) 2024-09-18T02:03:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7fd7e59de640 1 -- 172.21.15.81:0/1390248529 learned_addr learned my addr 172.21.15.81:0/1390248529 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.367+0000 7f43091ab640 1 -- 172.21.15.81:0/1716981966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e4005090 con 0x7f430412e760 2024-09-18T02:03:54.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.371+0000 7fd7e59de640 1 -- 172.21.15.81:0/1390248529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e00968d0 con 0x7fd7e006f860 2024-09-18T02:03:54.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.371+0000 7f42eb7fe640 1 -- 172.21.15.81:0/1716981966 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f42f40be030 con 0x7f430412e760 2024-09-18T02:03:54.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.371+0000 7f42eb7fe640 1 --2- 172.21.15.81:0/1716981966 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f42f0035f40 0x7f42f0038400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.371+0000 7f42eb7fe640 1 -- 172.21.15.81:0/1716981966 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f42f40bc070 con 0x7f430412e760 2024-09-18T02:03:54.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.371+0000 7f430259c640 1 --2- 172.21.15.81:0/1716981966 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f42f0035f40 0x7f42f0038400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.371+0000 7f430259c640 1 --2- 172.21.15.81:0/1716981966 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f42f0035f40 0x7f42f0038400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f42f8005890 tx=0x7f42f8007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.371+0000 7fd7e59de640 1 --2- 172.21.15.81:0/1390248529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7e006f860 0x7fd7e01c2080 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00c450 tx=0x7fd7dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.375+0000 7fd7d67fc640 1 -- 172.21.15.81:0/1390248529 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7dc017070 con 0x7fd7e006f860 2024-09-18T02:03:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.375+0000 7fd7d67fc640 1 -- 172.21.15.81:0/1390248529 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7dc005c20 con 0x7fd7e006f860 2024-09-18T02:03:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.375+0000 7fd7e7c42640 1 -- 172.21.15.81:0/1390248529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e0097600 con 0x7fd7e006f860 2024-09-18T02:03:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.375+0000 7fd7d67fc640 1 -- 172.21.15.81:0/1390248529 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7dc007070 con 0x7fd7e006f860 2024-09-18T02:03:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.375+0000 7f42eb7fe640 1 -- 172.21.15.81:0/1716981966 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f42f40c5020 con 0x7f430412e760 2024-09-18T02:03:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.375+0000 7fd7e7c42640 1 -- 172.21.15.81:0/1390248529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e01c2790 con 0x7fd7e006f860 2024-09-18T02:03:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.375+0000 7fd7d67fc640 1 -- 172.21.15.81:0/1390248529 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd7dc01a070 con 0x7fd7e006f860 2024-09-18T02:03:54.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.375+0000 7fd7e7c42640 1 -- 172.21.15.81:0/1390248529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e0096e80 con 0x7fd7e006f860 2024-09-18T02:03:54.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.375+0000 7fd7d67fc640 1 --2- 172.21.15.81:0/1390248529 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7c4035e00 0x7fd7c40382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.375+0000 7fd7d67fc640 1 -- 172.21.15.81:0/1390248529 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fd7dc047a20 con 0x7fd7e006f860 2024-09-18T02:03:54.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.375+0000 7fd7e51dd640 1 --2- 172.21.15.81:0/1390248529 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7c4035e00 0x7fd7c40382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.379+0000 7fd7e51dd640 1 --2- 172.21.15.81:0/1390248529 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7c4035e00 0x7fd7c40382c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00ae000 tx=0x7fd7d00a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.387+0000 7fd7d67fc640 1 -- 172.21.15.81:0/1390248529 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd7dc046830 con 0x7fd7e006f860 2024-09-18T02:03:54.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.467+0000 7f0a91b37640 1 -- 172.21.15.81:0/1702642430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0a8c06c0d0 con 0x7f0a8c06bc50 2024-09-18T02:03:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.467+0000 7f0a73fff640 1 -- 172.21.15.81:0/1702642430 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a7c012400 con 0x7f0a8c06bc50 2024-09-18T02:03:54.472 INFO:teuthology.orchestra.run.smithi081.stdout:38654705668 2024-09-18T02:03:54.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.471+0000 7f0a91b37640 1 -- 172.21.15.81:0/1702642430 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a78035db0 msgr2=0x7f0a78038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.471+0000 7f0a91b37640 1 --2- 172.21.15.81:0/1702642430 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a78035db0 0x7f0a78038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0a800ae000 tx=0x7f0a80008040 comp rx=0 tx=0).stop 2024-09-18T02:03:54.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.471+0000 7f0a91b37640 1 -- 172.21.15.81:0/1702642430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8c06bc50 msgr2=0x7f0a8c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.471+0000 7f0a91b37640 1 --2- 172.21.15.81:0/1702642430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8c06bc50 0x7f0a8c06d7e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c380 tx=0x7f0a7c00c840 comp rx=0 tx=0).stop 2024-09-18T02:03:54.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.471+0000 7f0a91b37640 1 -- 172.21.15.81:0/1702642430 shutdown_connections 2024-09-18T02:03:54.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.471+0000 7f0a91b37640 1 --2- 172.21.15.81:0/1702642430 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a78035db0 0x7f0a78038270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.471+0000 7f0a91b37640 1 --2- 172.21.15.81:0/1702642430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8c06bc50 0x7f0a8c06d7e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.471+0000 7f0a91b37640 1 -- 172.21.15.81:0/1702642430 >> 172.21.15.81:0/1702642430 conn(0x7f0a8c09ab00 msgr2=0x7f0a8c098e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:54.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.471+0000 7f0a91b37640 1 -- 172.21.15.81:0/1702642430 shutdown_connections 2024-09-18T02:03:54.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.471+0000 7f0a91b37640 1 -- 172.21.15.81:0/1702642430 wait complete. 2024-09-18T02:03:54.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-09-18T02:03:54.495 DEBUG:teuthology.parallel:result is None 2024-09-18T02:03:54.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.503+0000 7fa0c7fff640 1 -- 172.21.15.81:0/2376531218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa0c0005380 con 0x7fa0e40943b0 2024-09-18T02:03:54.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.503+0000 7fa0da7fc640 1 -- 172.21.15.81:0/2376531218 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa0e0007210 con 0x7fa0e40943b0 2024-09-18T02:03:54.510 INFO:teuthology.orchestra.run.smithi081.stdout:38654705670 2024-09-18T02:03:54.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.507+0000 7fa0c7fff640 1 -- 172.21.15.81:0/2376531218 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0c8035db0 msgr2=0x7fa0c8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.507+0000 7fa0c7fff640 1 --2- 172.21.15.81:0/2376531218 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0c8035db0 0x7fa0c8038270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40ae000 tx=0x7fa0d40a6070 comp rx=0 tx=0).stop 2024-09-18T02:03:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.507+0000 7fa0c7fff640 1 -- 172.21.15.81:0/2376531218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40943b0 msgr2=0x7fa0e406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.507+0000 7fa0c7fff640 1 --2- 172.21.15.81:0/2376531218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40943b0 0x7fa0e406d130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000c480 tx=0x7fa0e000c940 comp rx=0 tx=0).stop 2024-09-18T02:03:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.507+0000 7fa0c7fff640 1 -- 172.21.15.81:0/2376531218 shutdown_connections 2024-09-18T02:03:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.507+0000 7fa0c7fff640 1 --2- 172.21.15.81:0/2376531218 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0c8035db0 0x7fa0c8038270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.507+0000 7fa0c7fff640 1 --2- 172.21.15.81:0/2376531218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40943b0 0x7fa0e406d130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.507+0000 7fa0c7fff640 1 -- 172.21.15.81:0/2376531218 >> 172.21.15.81:0/2376531218 conn(0x7fa0e409ab00 msgr2=0x7fa0e4128f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.507+0000 7fa0c7fff640 1 -- 172.21.15.81:0/2376531218 shutdown_connections 2024-09-18T02:03:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.507+0000 7fa0c7fff640 1 -- 172.21.15.81:0/2376531218 wait complete. 2024-09-18T02:03:54.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-09-18T02:03:54.527 DEBUG:teuthology.parallel:result is None 2024-09-18T02:03:54.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.543+0000 7fd7e7c42640 1 -- 172.21.15.81:0/1390248529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd7e00961f0 con 0x7fd7e006f860 2024-09-18T02:03:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7fd7d67fc640 1 -- 172.21.15.81:0/1390248529 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd7dc012400 con 0x7fd7e006f860 2024-09-18T02:03:54.550 INFO:teuthology.orchestra.run.smithi081.stdout:38654705669 2024-09-18T02:03:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7fd7e7c42640 1 -- 172.21.15.81:0/1390248529 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7c4035e00 msgr2=0x7fd7c40382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7fd7e7c42640 1 --2- 172.21.15.81:0/1390248529 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7c4035e00 0x7fd7c40382c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00ae000 tx=0x7fd7d00a6070 comp rx=0 tx=0).stop 2024-09-18T02:03:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7fd7e7c42640 1 -- 172.21.15.81:0/1390248529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7e006f860 msgr2=0x7fd7e01c2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7fd7e7c42640 1 --2- 172.21.15.81:0/1390248529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7e006f860 0x7fd7e01c2080 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00c450 tx=0x7fd7dc00c910 comp rx=0 tx=0).stop 2024-09-18T02:03:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7fd7e7c42640 1 -- 172.21.15.81:0/1390248529 shutdown_connections 2024-09-18T02:03:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7fd7e7c42640 1 --2- 172.21.15.81:0/1390248529 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd7c4035e00 0x7fd7c40382c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7fd7e7c42640 1 --2- 172.21.15.81:0/1390248529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7e006f860 0x7fd7e01c2080 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7fd7e7c42640 1 -- 172.21.15.81:0/1390248529 >> 172.21.15.81:0/1390248529 conn(0x7fd7e009ac70 msgr2=0x7fd7e008d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:54.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7fd7e7c42640 1 -- 172.21.15.81:0/1390248529 shutdown_connections 2024-09-18T02:03:54.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7fd7e7c42640 1 -- 172.21.15.81:0/1390248529 wait complete. 2024-09-18T02:03:54.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7f43091ab640 1 -- 172.21.15.81:0/1716981966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f42e4005650 con 0x7f430412e760 2024-09-18T02:03:54.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.547+0000 7f42eb7fe640 1 -- 172.21.15.81:0/1716981966 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42f40c5020 con 0x7f430412e760 2024-09-18T02:03:54.555 INFO:teuthology.orchestra.run.smithi081.stdout:38654705669 2024-09-18T02:03:54.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.551+0000 7f43091ab640 1 -- 172.21.15.81:0/1716981966 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f42f0035f40 msgr2=0x7f42f0038400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.551+0000 7f43091ab640 1 --2- 172.21.15.81:0/1716981966 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f42f0035f40 0x7f42f0038400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f42f8005890 tx=0x7f42f8007a90 comp rx=0 tx=0).stop 2024-09-18T02:03:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.551+0000 7f43091ab640 1 -- 172.21.15.81:0/1716981966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f430412e760 msgr2=0x7f430409c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.551+0000 7f43091ab640 1 --2- 172.21.15.81:0/1716981966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f430412e760 0x7f430409c920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f42f401a030 tx=0x7f42f401ac40 comp rx=0 tx=0).stop 2024-09-18T02:03:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.551+0000 7f43091ab640 1 -- 172.21.15.81:0/1716981966 shutdown_connections 2024-09-18T02:03:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.551+0000 7f43091ab640 1 --2- 172.21.15.81:0/1716981966 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f42f0035f40 0x7f42f0038400 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.551+0000 7f43091ab640 1 --2- 172.21.15.81:0/1716981966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f430412e760 0x7f430409c920 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.551+0000 7f43091ab640 1 -- 172.21.15.81:0/1716981966 >> 172.21.15.81:0/1716981966 conn(0x7f43040a10a0 msgr2=0x7f4304095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.551+0000 7f43091ab640 1 -- 172.21.15.81:0/1716981966 shutdown_connections 2024-09-18T02:03:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.551+0000 7f43091ab640 1 -- 172.21.15.81:0/1716981966 wait complete. 2024-09-18T02:03:54.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2024-09-18T02:03:54.569 DEBUG:teuthology.parallel:result is None 2024-09-18T02:03:54.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-09-18T02:03:54.571 DEBUG:teuthology.parallel:result is None 2024-09-18T02:03:54.571 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T02:03:54.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T02:03:54.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bdd260640 1 Processor -- start 2024-09-18T02:03:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bdd260640 1 -- start start 2024-09-18T02:03:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bdd260640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9bd812cd50 0x7f9bd812d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bdd260640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd809e860 con 0x7f9bd8071c60 2024-09-18T02:03:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bdd260640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd812d670 con 0x7f9bd812cd50 2024-09-18T02:03:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bd6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9bd812cd50 0x7f9bd812d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bd659c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9bd8071c60 0x7f9bd806f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36566/0 (socket says 172.21.15.81:36566) 2024-09-18T02:03:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bd6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9bd812cd50 0x7f9bd812d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39482/0 (socket says 172.21.15.81:39482) 2024-09-18T02:03:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bd659c640 1 -- 172.21.15.81:0/1368000890 learned_addr learned my addr 172.21.15.81:0/1368000890 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bd6d9d640 1 -- 172.21.15.81:0/1368000890 >> v1:172.21.15.81:6789/0 conn(0x7f9bd8071c60 legacy=0x7f9bd806f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bd6d9d640 1 -- 172.21.15.81:0/1368000890 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd812d820 con 0x7f9bd812cd50 2024-09-18T02:03:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.711+0000 7f9bd5d9b640 1 -- 172.21.15.81:0/1368000890 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949978150 0 0) 0x7f9bd809e860 con 0x7f9bd8071c60 2024-09-18T02:03:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bd6d9d640 1 --2- 172.21.15.81:0/1368000890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd812cd50 0x7f9bd812d130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009740 tx=0x7f9bc801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf4566bbcddc1bd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bd5d9b640 1 -- 172.21.15.81:0/1368000890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc80ab550 con 0x7f9bd812cd50 2024-09-18T02:03:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bd5d9b640 1 -- 172.21.15.81:0/1368000890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc80b0070 con 0x7f9bd812cd50 2024-09-18T02:03:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bd5d9b640 1 -- 172.21.15.81:0/1368000890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc80ab840 con 0x7f9bd812cd50 2024-09-18T02:03:54.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 -- 172.21.15.81:0/1368000890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd812cd50 msgr2=0x7f9bd812d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 --2- 172.21.15.81:0/1368000890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd812cd50 0x7f9bd812d130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009740 tx=0x7f9bc801c400 comp rx=0 tx=0).stop 2024-09-18T02:03:54.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 -- 172.21.15.81:0/1368000890 shutdown_connections 2024-09-18T02:03:54.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 --2- 172.21.15.81:0/1368000890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd812cd50 0x7f9bd812d130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 -- 172.21.15.81:0/1368000890 >> 172.21.15.81:0/1368000890 conn(0x7f9bd809cd30 msgr2=0x7f9bd809d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:54.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 -- 172.21.15.81:0/1368000890 shutdown_connections 2024-09-18T02:03:54.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 -- 172.21.15.81:0/1368000890 wait complete. 2024-09-18T02:03:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 Processor -- start 2024-09-18T02:03:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 -- start start 2024-09-18T02:03:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd8071c60 0x7f9bd80986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd8070b10 con 0x7f9bd8071c60 2024-09-18T02:03:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bd6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd8071c60 0x7f9bd80986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bd6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd8071c60 0x7f9bd80986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39490/0 (socket says 172.21.15.81:39490) 2024-09-18T02:03:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bd6d9d640 1 -- 172.21.15.81:0/1589849941 learned_addr learned my addr 172.21.15.81:0/1589849941 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bd6d9d640 1 -- 172.21.15.81:0/1589849941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd806f010 con 0x7f9bd8071c60 2024-09-18T02:03:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bd6d9d640 1 --2- 172.21.15.81:0/1589849941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd8071c60 0x7f9bd80986d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8019010 tx=0x7f9bc801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bbf7fe640 1 -- 172.21.15.81:0/1589849941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc80bf410 con 0x7f9bd8071c60 2024-09-18T02:03:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bbf7fe640 1 -- 172.21.15.81:0/1589849941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc80bf5d0 con 0x7f9bd8071c60 2024-09-18T02:03:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 -- 172.21.15.81:0/1589849941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd8072cd0 con 0x7f9bd8071c60 2024-09-18T02:03:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bbf7fe640 1 -- 172.21.15.81:0/1589849941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc80bf8f0 con 0x7f9bd8071c60 2024-09-18T02:03:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.715+0000 7f9bdd260640 1 -- 172.21.15.81:0/1589849941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd812a2d0 con 0x7f9bd8071c60 2024-09-18T02:03:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.719+0000 7f9bbf7fe640 1 -- 172.21.15.81:0/1589849941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9bc80bd020 con 0x7f9bd8071c60 2024-09-18T02:03:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.719+0000 7f9bdd260640 1 -- 172.21.15.81:0/1589849941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd8129c40 con 0x7f9bd8071c60 2024-09-18T02:03:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.719+0000 7f9bbf7fe640 1 --2- 172.21.15.81:0/1589849941 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9bc4035db0 0x7f9bc4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.719+0000 7f9bbf7fe640 1 -- 172.21.15.81:0/1589849941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f9bc80e2e80 con 0x7f9bd8071c60 2024-09-18T02:03:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.719+0000 7f9bd659c640 1 --2- 172.21.15.81:0/1589849941 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9bc4035db0 0x7f9bc4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.719+0000 7f9bd659c640 1 --2- 172.21.15.81:0/1589849941 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9bc4035db0 0x7f9bc4038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc007fd0 tx=0x7f9bcc007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:54.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.723+0000 7f9bbf7fe640 1 -- 172.21.15.81:0/1589849941 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9bc8015ff0 con 0x7f9bd8071c60 2024-09-18T02:03:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.867+0000 7f9bdd260640 1 -- 172.21.15.81:0/1589849941 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9bd812abb0 con 0x7f9bc4035db0 2024-09-18T02:03:54.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.871+0000 7f9bbf7fe640 1 -- 172.21.15.81:0/1589849941 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32187 (secure 0 0 0) 0x7f9bd812abb0 con 0x7f9bc4035db0 2024-09-18T02:03:54.876 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:54.876 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T02:03:54.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.871+0000 7f9bdd260640 1 -- 172.21.15.81:0/1589849941 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9bc4035db0 msgr2=0x7f9bc4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.871+0000 7f9bdd260640 1 --2- 172.21.15.81:0/1589849941 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9bc4035db0 0x7f9bc4038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc007fd0 tx=0x7f9bcc007940 comp rx=0 tx=0).stop 2024-09-18T02:03:54.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.871+0000 7f9bdd260640 1 -- 172.21.15.81:0/1589849941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd8071c60 msgr2=0x7f9bd80986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:54.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.871+0000 7f9bdd260640 1 --2- 172.21.15.81:0/1589849941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd8071c60 0x7f9bd80986d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8019010 tx=0x7f9bc801ac40 comp rx=0 tx=0).stop 2024-09-18T02:03:54.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.871+0000 7f9bdd260640 1 -- 172.21.15.81:0/1589849941 shutdown_connections 2024-09-18T02:03:54.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.871+0000 7f9bdd260640 1 --2- 172.21.15.81:0/1589849941 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9bc4035db0 0x7f9bc4038270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.871+0000 7f9bdd260640 1 --2- 172.21.15.81:0/1589849941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd8071c60 0x7f9bd80986d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:54.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.871+0000 7f9bdd260640 1 -- 172.21.15.81:0/1589849941 >> 172.21.15.81:0/1589849941 conn(0x7f9bd809cd30 msgr2=0x7f9bd8099600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:54.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.875+0000 7f9bdd260640 1 -- 172.21.15.81:0/1589849941 shutdown_connections 2024-09-18T02:03:54.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:54.875+0000 7f9bdd260640 1 -- 172.21.15.81:0/1589849941 wait complete. 2024-09-18T02:03:54.892 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-18T02:03:53.241695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109840,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377520,"statfs":{"total":386547056640,"available":386434580480,"internally_reserved":0,"allocated":1753088,"data_stored":1361342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.978004"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.288611+0000","last_change":"2024-09-18T02:03:50.288611+0000","last_active":"2024-09-18T02:03:50.288611+0000","last_peered":"2024-09-18T02:03:50.288611+0000","last_clean":"2024-09-18T02:03:50.288611+0000","last_became_active":"2024-09-18T02:03:48.396609+0000","last_became_peered":"2024-09-18T02:03:48.396609+0000","last_unstale":"2024-09-18T02:03:50.288611+0000","last_undegraded":"2024-09-18T02:03:50.288611+0000","last_fullsized":"2024-09-18T02:03:50.288611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:40:52.248589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025902970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.282549+0000","last_change":"2024-09-18T02:03:50.282549+0000","last_active":"2024-09-18T02:03:50.282549+0000","last_peered":"2024-09-18T02:03:50.282549+0000","last_clean":"2024-09-18T02:03:50.282549+0000","last_became_active":"2024-09-18T02:03:48.274030+0000","last_became_peered":"2024-09-18T02:03:48.274030+0000","last_unstale":"2024-09-18T02:03:50.282549+0000","last_undegraded":"2024-09-18T02:03:50.282549+0000","last_fullsized":"2024-09-18T02:03:50.282549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:21:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011092910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.288345+0000","last_change":"2024-09-18T02:03:50.288345+0000","last_active":"2024-09-18T02:03:50.288345+0000","last_peered":"2024-09-18T02:03:50.288345+0000","last_clean":"2024-09-18T02:03:50.288345+0000","last_became_active":"2024-09-18T02:03:48.276300+0000","last_became_peered":"2024-09-18T02:03:48.276300+0000","last_unstale":"2024-09-18T02:03:50.288345+0000","last_undegraded":"2024-09-18T02:03:50.288345+0000","last_fullsized":"2024-09-18T02:03:50.288345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:57.432759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002788245,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.282381+0000","last_change":"2024-09-18T02:03:50.282381+0000","last_active":"2024-09-18T02:03:50.282381+0000","last_peered":"2024-09-18T02:03:50.282381+0000","last_clean":"2024-09-18T02:03:50.282381+0000","last_became_active":"2024-09-18T02:03:48.274657+0000","last_became_peered":"2024-09-18T02:03:48.274657+0000","last_unstale":"2024-09-18T02:03:50.282381+0000","last_undegraded":"2024-09-18T02:03:50.282381+0000","last_fullsized":"2024-09-18T02:03:50.282381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000970169,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.288728+0000","last_change":"2024-09-18T02:03:50.287790+0000","last_active":"2024-09-18T02:03:50.288728+0000","last_peered":"2024-09-18T02:03:50.288728+0000","last_clean":"2024-09-18T02:03:50.288728+0000","last_became_active":"2024-09-18T02:03:48.276543+0000","last_became_peered":"2024-09-18T02:03:48.276543+0000","last_unstale":"2024-09-18T02:03:50.288728+0000","last_undegraded":"2024-09-18T02:03:50.288728+0000","last_fullsized":"2024-09-18T02:03:50.288728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:17.356845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023330579999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.338272+0000","last_change":"2024-09-18T02:03:50.338272+0000","last_active":"2024-09-18T02:03:50.338272+0000","last_peered":"2024-09-18T02:03:50.338272+0000","last_clean":"2024-09-18T02:03:50.338272+0000","last_became_active":"2024-09-18T02:03:48.275609+0000","last_became_peered":"2024-09-18T02:03:48.275609+0000","last_unstale":"2024-09-18T02:03:50.338272+0000","last_undegraded":"2024-09-18T02:03:50.338272+0000","last_fullsized":"2024-09-18T02:03:50.338272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067244799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.285797+0000","last_change":"2024-09-18T02:03:50.285797+0000","last_active":"2024-09-18T02:03:50.285797+0000","last_peered":"2024-09-18T02:03:50.285797+0000","last_clean":"2024-09-18T02:03:50.285797+0000","last_became_active":"2024-09-18T02:03:48.275709+0000","last_became_peered":"2024-09-18T02:03:48.275709+0000","last_unstale":"2024-09-18T02:03:50.285797+0000","last_undegraded":"2024-09-18T02:03:50.285797+0000","last_fullsized":"2024-09-18T02:03:50.285797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:53.873897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047579399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.287984+0000","last_change":"2024-09-18T02:03:50.287984+0000","last_active":"2024-09-18T02:03:50.287984+0000","last_peered":"2024-09-18T02:03:50.287984+0000","last_clean":"2024-09-18T02:03:50.287984+0000","last_became_active":"2024-09-18T02:03:48.273444+0000","last_became_peered":"2024-09-18T02:03:48.273444+0000","last_unstale":"2024-09-18T02:03:50.287984+0000","last_undegraded":"2024-09-18T02:03:50.287984+0000","last_fullsized":"2024-09-18T02:03:50.287984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:18.121435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024299339999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'117","reported_seq":170,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.377972+0000","last_change":"2024-09-18T02:03:43.338768+0000","last_active":"2024-09-18T02:03:50.377972+0000","last_peered":"2024-09-18T02:03:50.377972+0000","last_clean":"2024-09-18T02:03:50.377972+0000","last_became_active":"2024-09-18T02:03:43.336731+0000","last_became_peered":"2024-09-18T02:03:43.336731+0000","last_unstale":"2024-09-18T02:03:50.377972+0000","last_undegraded":"2024-09-18T02:03:50.377972+0000","last_fullsized":"2024-09-18T02:03:50.377972+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_clean_scrub_stamp":"2024-09-18T02:03:42.235832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:47:03.749921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T02:03:54.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T02:03:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.003+0000 7f0a858fc640 1 Processor -- start 2024-09-18T02:03:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.003+0000 7f0a858fc640 1 -- start start 2024-09-18T02:03:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.003+0000 7f0a858fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a8006d0e0 0x7f0a8006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.003+0000 7f0a858fc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a80071c10 con 0x7f0a8006da00 2024-09-18T02:03:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.003+0000 7f0a858fc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0a80072230 con 0x7f0a8006d0e0 2024-09-18T02:03:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.003+0000 7f0a7e7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0a8006da00 0x7f0a8012ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36582/0 (socket says 172.21.15.81:36582) 2024-09-18T02:03:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.003+0000 7f0a7e7fc640 1 -- 172.21.15.81:0/2967804962 learned_addr learned my addr 172.21.15.81:0/2967804962 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:03:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.003+0000 7f0a7effd640 1 --2- 172.21.15.81:0/2967804962 >> v2:172.21.15.81:3300/0 conn(0x7f0a8006d0e0 0x7f0a8006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a7dffb640 1 -- 172.21.15.81:0/2967804962 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195828108 0 0) 0x7f0a80071c10 con 0x7f0a8006da00 2024-09-18T02:03:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a7dffb640 1 -- 172.21.15.81:0/2967804962 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a68003530 con 0x7f0a8006da00 2024-09-18T02:03:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a7effd640 1 -- 172.21.15.81:0/2967804962 >> v1:172.21.15.81:6789/0 conn(0x7f0a8006da00 legacy=0x7f0a8012ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a7dffb640 1 -- 172.21.15.81:0/2967804962 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1650099199 0 0) 0x7f0a68003530 con 0x7f0a8006da00 2024-09-18T02:03:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a7effd640 1 -- 172.21.15.81:0/2967804962 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a800709e0 con 0x7f0a8006d0e0 2024-09-18T02:03:55.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a7effd640 1 --2- 172.21.15.81:0/2967804962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8006d0e0 0x7f0a8006d4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009740 tx=0x7f0a7401c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf6c1fc6e9bbca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:55.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a7dffb640 1 -- 172.21.15.81:0/2967804962 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a740b1070 con 0x7f0a8006d0e0 2024-09-18T02:03:55.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a7dffb640 1 -- 172.21.15.81:0/2967804962 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a740a4ce0 con 0x7f0a8006d0e0 2024-09-18T02:03:55.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a7dffb640 1 -- 172.21.15.81:0/2967804962 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a700015b0 con 0x7f0a8006d0e0 2024-09-18T02:03:55.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a858fc640 1 -- 172.21.15.81:0/2967804962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8006d0e0 msgr2=0x7f0a8006d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:55.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a858fc640 1 --2- 172.21.15.81:0/2967804962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8006d0e0 0x7f0a8006d4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009740 tx=0x7f0a7401c290 comp rx=0 tx=0).stop 2024-09-18T02:03:55.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a858fc640 1 -- 172.21.15.81:0/2967804962 shutdown_connections 2024-09-18T02:03:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a858fc640 1 --2- 172.21.15.81:0/2967804962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8006d0e0 0x7f0a8006d4c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a858fc640 1 -- 172.21.15.81:0/2967804962 >> 172.21.15.81:0/2967804962 conn(0x7f0a80099a50 msgr2=0x7f0a800972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a858fc640 1 -- 172.21.15.81:0/2967804962 shutdown_connections 2024-09-18T02:03:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a858fc640 1 -- 172.21.15.81:0/2967804962 wait complete. 2024-09-18T02:03:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a858fc640 1 Processor -- start 2024-09-18T02:03:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.007+0000 7f0a858fc640 1 -- start start 2024-09-18T02:03:55.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a858fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8006d0e0 0x7f0a801279c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:55.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a858fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a80134e80 con 0x7f0a8006d0e0 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a7effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8006d0e0 0x7f0a801279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a7effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8006d0e0 0x7f0a801279c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39502/0 (socket says 172.21.15.81:39502) 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a7effd640 1 -- 172.21.15.81:0/1077192960 learned_addr learned my addr 172.21.15.81:0/1077192960 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a7effd640 1 -- 172.21.15.81:0/1077192960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8012ab00 con 0x7f0a8006d0e0 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a7effd640 1 --2- 172.21.15.81:0/1077192960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8006d0e0 0x7f0a801279c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a74018ea0 tx=0x7f0a74019030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a67fff640 1 -- 172.21.15.81:0/1077192960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a740b9020 con 0x7f0a8006d0e0 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a67fff640 1 -- 172.21.15.81:0/1077192960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a74003750 con 0x7f0a8006d0e0 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a67fff640 1 -- 172.21.15.81:0/1077192960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a740b1040 con 0x7f0a8006d0e0 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a858fc640 1 -- 172.21.15.81:0/1077192960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a80072710 con 0x7f0a8006d0e0 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a858fc640 1 -- 172.21.15.81:0/1077192960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a80127f00 con 0x7f0a8006d0e0 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a67fff640 1 -- 172.21.15.81:0/1077192960 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a740bc020 con 0x7f0a8006d0e0 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a858fc640 1 -- 172.21.15.81:0/1077192960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a8006d4c0 con 0x7f0a8006d0e0 2024-09-18T02:03:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a67fff640 1 --2- 172.21.15.81:0/1077192960 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a6c035db0 0x7f0a6c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a67fff640 1 -- 172.21.15.81:0/1077192960 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f0a740e1e40 con 0x7f0a8006d0e0 2024-09-18T02:03:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a7e7fc640 1 --2- 172.21.15.81:0/1077192960 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a6c035db0 0x7f0a6c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.011+0000 7f0a7e7fc640 1 --2- 172.21.15.81:0/1077192960 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a6c035db0 0x7f0a6c038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a70005890 tx=0x7f0a70001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:55.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.015+0000 7f0a67fff640 1 -- 172.21.15.81:0/1077192960 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a740c3030 con 0x7f0a8006d0e0 2024-09-18T02:03:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.163+0000 7f0a858fc640 1 -- 172.21.15.81:0/1077192960 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a80073790 con 0x7f0a6c035db0 2024-09-18T02:03:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.163+0000 7f0a67fff640 1 -- 172.21.15.81:0/1077192960 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32187 (secure 0 0 0) 0x7f0a80073790 con 0x7f0a6c035db0 2024-09-18T02:03:55.169 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T02:03:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.167+0000 7f0a858fc640 1 -- 172.21.15.81:0/1077192960 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a6c035db0 msgr2=0x7f0a6c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.167+0000 7f0a858fc640 1 --2- 172.21.15.81:0/1077192960 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a6c035db0 0x7f0a6c038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a70005890 tx=0x7f0a70001240 comp rx=0 tx=0).stop 2024-09-18T02:03:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.167+0000 7f0a858fc640 1 -- 172.21.15.81:0/1077192960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8006d0e0 msgr2=0x7f0a801279c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.167+0000 7f0a858fc640 1 --2- 172.21.15.81:0/1077192960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8006d0e0 0x7f0a801279c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a74018ea0 tx=0x7f0a74019030 comp rx=0 tx=0).stop 2024-09-18T02:03:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.167+0000 7f0a858fc640 1 -- 172.21.15.81:0/1077192960 shutdown_connections 2024-09-18T02:03:55.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.167+0000 7f0a858fc640 1 --2- 172.21.15.81:0/1077192960 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a6c035db0 0x7f0a6c038270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:55.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.167+0000 7f0a858fc640 1 --2- 172.21.15.81:0/1077192960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a8006d0e0 0x7f0a801279c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:55.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.167+0000 7f0a858fc640 1 -- 172.21.15.81:0/1077192960 >> 172.21.15.81:0/1077192960 conn(0x7f0a80099a50 msgr2=0x7f0a80131c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:55.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.167+0000 7f0a858fc640 1 -- 172.21.15.81:0/1077192960 shutdown_connections 2024-09-18T02:03:55.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.167+0000 7f0a858fc640 1 -- 172.21.15.81:0/1077192960 wait complete. 2024-09-18T02:03:55.186 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-18T02:03:53.241695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109840,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377520,"statfs":{"total":386547056640,"available":386434580480,"internally_reserved":0,"allocated":1753088,"data_stored":1361342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.978004"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.288611+0000","last_change":"2024-09-18T02:03:50.288611+0000","last_active":"2024-09-18T02:03:50.288611+0000","last_peered":"2024-09-18T02:03:50.288611+0000","last_clean":"2024-09-18T02:03:50.288611+0000","last_became_active":"2024-09-18T02:03:48.396609+0000","last_became_peered":"2024-09-18T02:03:48.396609+0000","last_unstale":"2024-09-18T02:03:50.288611+0000","last_undegraded":"2024-09-18T02:03:50.288611+0000","last_fullsized":"2024-09-18T02:03:50.288611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:40:52.248589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025902970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.282549+0000","last_change":"2024-09-18T02:03:50.282549+0000","last_active":"2024-09-18T02:03:50.282549+0000","last_peered":"2024-09-18T02:03:50.282549+0000","last_clean":"2024-09-18T02:03:50.282549+0000","last_became_active":"2024-09-18T02:03:48.274030+0000","last_became_peered":"2024-09-18T02:03:48.274030+0000","last_unstale":"2024-09-18T02:03:50.282549+0000","last_undegraded":"2024-09-18T02:03:50.282549+0000","last_fullsized":"2024-09-18T02:03:50.282549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:21:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011092910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.288345+0000","last_change":"2024-09-18T02:03:50.288345+0000","last_active":"2024-09-18T02:03:50.288345+0000","last_peered":"2024-09-18T02:03:50.288345+0000","last_clean":"2024-09-18T02:03:50.288345+0000","last_became_active":"2024-09-18T02:03:48.276300+0000","last_became_peered":"2024-09-18T02:03:48.276300+0000","last_unstale":"2024-09-18T02:03:50.288345+0000","last_undegraded":"2024-09-18T02:03:50.288345+0000","last_fullsized":"2024-09-18T02:03:50.288345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:57.432759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002788245,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.282381+0000","last_change":"2024-09-18T02:03:50.282381+0000","last_active":"2024-09-18T02:03:50.282381+0000","last_peered":"2024-09-18T02:03:50.282381+0000","last_clean":"2024-09-18T02:03:50.282381+0000","last_became_active":"2024-09-18T02:03:48.274657+0000","last_became_peered":"2024-09-18T02:03:48.274657+0000","last_unstale":"2024-09-18T02:03:50.282381+0000","last_undegraded":"2024-09-18T02:03:50.282381+0000","last_fullsized":"2024-09-18T02:03:50.282381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000970169,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.288728+0000","last_change":"2024-09-18T02:03:50.287790+0000","last_active":"2024-09-18T02:03:50.288728+0000","last_peered":"2024-09-18T02:03:50.288728+0000","last_clean":"2024-09-18T02:03:50.288728+0000","last_became_active":"2024-09-18T02:03:48.276543+0000","last_became_peered":"2024-09-18T02:03:48.276543+0000","last_unstale":"2024-09-18T02:03:50.288728+0000","last_undegraded":"2024-09-18T02:03:50.288728+0000","last_fullsized":"2024-09-18T02:03:50.288728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:17.356845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023330579999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.338272+0000","last_change":"2024-09-18T02:03:50.338272+0000","last_active":"2024-09-18T02:03:50.338272+0000","last_peered":"2024-09-18T02:03:50.338272+0000","last_clean":"2024-09-18T02:03:50.338272+0000","last_became_active":"2024-09-18T02:03:48.275609+0000","last_became_peered":"2024-09-18T02:03:48.275609+0000","last_unstale":"2024-09-18T02:03:50.338272+0000","last_undegraded":"2024-09-18T02:03:50.338272+0000","last_fullsized":"2024-09-18T02:03:50.338272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067244799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.285797+0000","last_change":"2024-09-18T02:03:50.285797+0000","last_active":"2024-09-18T02:03:50.285797+0000","last_peered":"2024-09-18T02:03:50.285797+0000","last_clean":"2024-09-18T02:03:50.285797+0000","last_became_active":"2024-09-18T02:03:48.275709+0000","last_became_peered":"2024-09-18T02:03:48.275709+0000","last_unstale":"2024-09-18T02:03:50.285797+0000","last_undegraded":"2024-09-18T02:03:50.285797+0000","last_fullsized":"2024-09-18T02:03:50.285797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:53.873897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047579399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.287984+0000","last_change":"2024-09-18T02:03:50.287984+0000","last_active":"2024-09-18T02:03:50.287984+0000","last_peered":"2024-09-18T02:03:50.287984+0000","last_clean":"2024-09-18T02:03:50.287984+0000","last_became_active":"2024-09-18T02:03:48.273444+0000","last_became_peered":"2024-09-18T02:03:48.273444+0000","last_unstale":"2024-09-18T02:03:50.287984+0000","last_undegraded":"2024-09-18T02:03:50.287984+0000","last_fullsized":"2024-09-18T02:03:50.287984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:18.121435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024299339999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'117","reported_seq":170,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T02:03:50.377972+0000","last_change":"2024-09-18T02:03:43.338768+0000","last_active":"2024-09-18T02:03:50.377972+0000","last_peered":"2024-09-18T02:03:50.377972+0000","last_clean":"2024-09-18T02:03:50.377972+0000","last_became_active":"2024-09-18T02:03:43.336731+0000","last_became_peered":"2024-09-18T02:03:43.336731+0000","last_unstale":"2024-09-18T02:03:50.377972+0000","last_undegraded":"2024-09-18T02:03:50.377972+0000","last_fullsized":"2024-09-18T02:03:50.377972+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_clean_scrub_stamp":"2024-09-18T02:03:42.235832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:47:03.749921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T02:03:55.187 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T02:03:55.187 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T02:03:55.187 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-18T02:03:55.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-18T02:03:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb24249a640 1 Processor -- start 2024-09-18T02:03:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb24249a640 1 -- start start 2024-09-18T02:03:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb24249a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb23c06e170 0x7fb23c133880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb24249a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23c0985e0 con 0x7fb23c06d680 2024-09-18T02:03:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb24249a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb23c06e590 con 0x7fb23c06e170 2024-09-18T02:03:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb23b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb23c06e170 0x7fb23c133880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb23b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb23c06e170 0x7fb23c133880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39510/0 (socket says 172.21.15.81:39510) 2024-09-18T02:03:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb23b7fe640 1 -- 172.21.15.81:0/2568988185 learned_addr learned my addr 172.21.15.81:0/2568988185 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb23bfff640 1 --1- 172.21.15.81:0/2568988185 >> v1:172.21.15.81:6789/0 conn(0x7fb23c06d680 0x7fb23c06da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36588/0 (socket says 172.21.15.81:36588) 2024-09-18T02:03:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb23b7fe640 1 -- 172.21.15.81:0/2568988185 >> v1:172.21.15.81:6789/0 conn(0x7fb23c06d680 legacy=0x7fb23c06da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb23affd640 1 -- 172.21.15.81:0/2568988185 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542120779 0 0) 0x7fb23c0985e0 con 0x7fb23c06d680 2024-09-18T02:03:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb23b7fe640 1 -- 172.21.15.81:0/2568988185 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c098a20 con 0x7fb23c06e170 2024-09-18T02:03:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.295+0000 7fb23b7fe640 1 --2- 172.21.15.81:0/2568988185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c06e170 0x7fb23c133880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb2300097f0 tx=0x7fb23001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81c2cb8c30ab495 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:55.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb23affd640 1 -- 172.21.15.81:0/2568988185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2300b0070 con 0x7fb23c06e170 2024-09-18T02:03:55.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb23affd640 1 -- 172.21.15.81:0/2568988185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2300ab530 con 0x7fb23c06e170 2024-09-18T02:03:55.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb23affd640 1 -- 172.21.15.81:0/2568988185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2300ab830 con 0x7fb23c06e170 2024-09-18T02:03:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 -- 172.21.15.81:0/2568988185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c06e170 msgr2=0x7fb23c133880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 --2- 172.21.15.81:0/2568988185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c06e170 0x7fb23c133880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb2300097f0 tx=0x7fb23001c430 comp rx=0 tx=0).stop 2024-09-18T02:03:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 -- 172.21.15.81:0/2568988185 shutdown_connections 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 --2- 172.21.15.81:0/2568988185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c06e170 0x7fb23c133880 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 -- 172.21.15.81:0/2568988185 >> 172.21.15.81:0/2568988185 conn(0x7fb23c09f0b0 msgr2=0x7fb23c09f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 -- 172.21.15.81:0/2568988185 shutdown_connections 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 -- 172.21.15.81:0/2568988185 wait complete. 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 Processor -- start 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 -- start start 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c06d680 0x7fb23c12f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c136970 con 0x7fb23c06d680 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb23bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c06d680 0x7fb23c12f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb23bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c06d680 0x7fb23c12f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39512/0 (socket says 172.21.15.81:39512) 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb23bfff640 1 -- 172.21.15.81:0/4242016062 learned_addr learned my addr 172.21.15.81:0/4242016062 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb23bfff640 1 -- 172.21.15.81:0/4242016062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c131040 con 0x7fb23c06d680 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb23bfff640 1 --2- 172.21.15.81:0/4242016062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c06d680 0x7fb23c12f600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c390 tx=0x7fb22c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb238ff9640 1 -- 172.21.15.81:0/4242016062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb22c007410 con 0x7fb23c06d680 2024-09-18T02:03:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb238ff9640 1 -- 172.21.15.81:0/4242016062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c0075d0 con 0x7fb23c06d680 2024-09-18T02:03:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb238ff9640 1 -- 172.21.15.81:0/4242016062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb22c004960 con 0x7fb23c06d680 2024-09-18T02:03:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 -- 172.21.15.81:0/4242016062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23c128ea0 con 0x7fb23c06d680 2024-09-18T02:03:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 -- 172.21.15.81:0/4242016062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23c132150 con 0x7fb23c06d680 2024-09-18T02:03:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb238ff9640 1 -- 172.21.15.81:0/4242016062 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb22c011070 con 0x7fb23c06d680 2024-09-18T02:03:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb24249a640 1 -- 172.21.15.81:0/4242016062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23c06da60 con 0x7fb23c06d680 2024-09-18T02:03:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb238ff9640 1 --2- 172.21.15.81:0/4242016062 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb228035db0 0x7fb228038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.299+0000 7fb238ff9640 1 -- 172.21.15.81:0/4242016062 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fb22c048250 con 0x7fb23c06d680 2024-09-18T02:03:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.303+0000 7fb23b7fe640 1 --2- 172.21.15.81:0/4242016062 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb228035db0 0x7fb228038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.303+0000 7fb23b7fe640 1 --2- 172.21.15.81:0/4242016062 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb228035db0 0x7fb228038270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb23c073950 tx=0x7fb2300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.307+0000 7fb238ff9640 1 -- 172.21.15.81:0/4242016062 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb22c004d90 con 0x7fb23c06d680 2024-09-18T02:03:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.487+0000 7fb24249a640 1 -- 172.21.15.81:0/4242016062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb23c075bf0 con 0x7fb23c06d680 2024-09-18T02:03:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.487+0000 7fb238ff9640 1 -- 172.21.15.81:0/4242016062 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb22c0138e0 con 0x7fb23c06d680 2024-09-18T02:03:55.492 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:03:55.492 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T02:03:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.487+0000 7fb24249a640 1 -- 172.21.15.81:0/4242016062 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb228035db0 msgr2=0x7fb228038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.487+0000 7fb24249a640 1 --2- 172.21.15.81:0/4242016062 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb228035db0 0x7fb228038270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb23c073950 tx=0x7fb2300a6000 comp rx=0 tx=0).stop 2024-09-18T02:03:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.487+0000 7fb24249a640 1 -- 172.21.15.81:0/4242016062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c06d680 msgr2=0x7fb23c12f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.487+0000 7fb24249a640 1 --2- 172.21.15.81:0/4242016062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c06d680 0x7fb23c12f600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c390 tx=0x7fb22c00c850 comp rx=0 tx=0).stop 2024-09-18T02:03:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.487+0000 7fb24249a640 1 -- 172.21.15.81:0/4242016062 shutdown_connections 2024-09-18T02:03:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.487+0000 7fb24249a640 1 --2- 172.21.15.81:0/4242016062 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb228035db0 0x7fb228038270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.487+0000 7fb24249a640 1 --2- 172.21.15.81:0/4242016062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c06d680 0x7fb23c12f600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.491+0000 7fb24249a640 1 -- 172.21.15.81:0/4242016062 >> 172.21.15.81:0/4242016062 conn(0x7fb23c09f0b0 msgr2=0x7fb23c127e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.491+0000 7fb24249a640 1 -- 172.21.15.81:0/4242016062 shutdown_connections 2024-09-18T02:03:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:03:55.491+0000 7fb24249a640 1 -- 172.21.15.81:0/4242016062 wait complete. 2024-09-18T02:03:55.509 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-18T02:03:55.509 INFO:teuthology.run_tasks:Running task rgw... 2024-09-18T02:03:55.524 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-18T02:03:55.525 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-18T02:03:55.525 INFO:tasks.rgw:Creating data pools 2024-09-18T02:03:55.525 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-18T02:03:55.525 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-18T02:03:55.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.652+0000 7f3815ebc640 1 Processor -- start 2024-09-18T02:03:55.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.652+0000 7f3815ebc640 1 -- start start 2024-09-18T02:03:55.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.652+0000 7f3815ebc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38101171c0 0x7f38101195b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:55.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.652+0000 7f3815ebc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3810119af0 con 0x7f3810114450 2024-09-18T02:03:55.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.652+0000 7f3815ebc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f381011acd0 con 0x7f38101171c0 2024-09-18T02:03:55.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.656+0000 7f380effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38101171c0 0x7f38101195b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:55.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.656+0000 7f380effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38101171c0 0x7f38101195b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60232/0 (socket says 172.21.15.167:60232) 2024-09-18T02:03:55.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.656+0000 7f380effd640 1 -- 172.21.15.167:0/3021175057 learned_addr learned my addr 172.21.15.167:0/3021175057 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:55.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.656+0000 7f380effd640 1 -- 172.21.15.167:0/3021175057 >> v1:172.21.15.81:6789/0 conn(0x7f3810114450 legacy=0x7f3810114830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:55.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.656+0000 7f380effd640 1 -- 172.21.15.167:0/3021175057 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381011ae80 con 0x7f38101171c0 2024-09-18T02:03:55.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.656+0000 7f380effd640 1 --2- 172.21.15.167:0/3021175057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38101171c0 0x7f38101195b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f380400a990 tx=0x7f380401d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f327c01fa0d924a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:55.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f380e7fc640 1 -- 172.21.15.167:0/3021175057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38040b3070 con 0x7f38101171c0 2024-09-18T02:03:55.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f380e7fc640 1 -- 172.21.15.167:0/3021175057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38040a67a0 con 0x7f38101171c0 2024-09-18T02:03:55.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f380e7fc640 1 -- 172.21.15.167:0/3021175057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f380400b040 con 0x7f38101171c0 2024-09-18T02:03:55.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 -- 172.21.15.167:0/3021175057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38101171c0 msgr2=0x7f38101195b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:55.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 --2- 172.21.15.167:0/3021175057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38101171c0 0x7f38101195b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f380400a990 tx=0x7f380401d800 comp rx=0 tx=0).stop 2024-09-18T02:03:55.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 -- 172.21.15.167:0/3021175057 shutdown_connections 2024-09-18T02:03:55.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 --2- 172.21.15.167:0/3021175057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38101171c0 0x7f38101195b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:55.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 -- 172.21.15.167:0/3021175057 >> 172.21.15.167:0/3021175057 conn(0x7f381006f390 msgr2=0x7f38100717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:55.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 -- 172.21.15.167:0/3021175057 shutdown_connections 2024-09-18T02:03:55.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 -- 172.21.15.167:0/3021175057 wait complete. 2024-09-18T02:03:55.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 Processor -- start 2024-09-18T02:03:55.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 -- start start 2024-09-18T02:03:55.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3810114450 0x7f38101a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:55.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f381011a9f0 con 0x7f3810114450 2024-09-18T02:03:55.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f380f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3810114450 0x7f38101a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:55.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f380f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3810114450 0x7f38101a9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60246/0 (socket says 172.21.15.167:60246) 2024-09-18T02:03:55.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f380f7fe640 1 -- 172.21.15.167:0/3705212306 learned_addr learned my addr 172.21.15.167:0/3705212306 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:55.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f380f7fe640 1 -- 172.21.15.167:0/3705212306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38101aa2d0 con 0x7f3810114450 2024-09-18T02:03:55.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f380f7fe640 1 --2- 172.21.15.167:0/3705212306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3810114450 0x7f38101a9d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f380000c480 tx=0x7f380000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:55.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f37f7fff640 1 -- 172.21.15.167:0/3705212306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3800005150 con 0x7f3810114450 2024-09-18T02:03:55.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f37f7fff640 1 -- 172.21.15.167:0/3705212306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38000052f0 con 0x7f3810114450 2024-09-18T02:03:55.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 -- 172.21.15.167:0/3705212306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38101aa5c0 con 0x7f3810114450 2024-09-18T02:03:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f37f7fff640 1 -- 172.21.15.167:0/3705212306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3800007030 con 0x7f3810114450 2024-09-18T02:03:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.660+0000 7f3815ebc640 1 -- 172.21.15.167:0/3705212306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38101ae5b0 con 0x7f3810114450 2024-09-18T02:03:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.664+0000 7f3815ebc640 1 -- 172.21.15.167:0/3705212306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38101aa7f0 con 0x7f3810114450 2024-09-18T02:03:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.664+0000 7f37f7fff640 1 -- 172.21.15.167:0/3705212306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3800019020 con 0x7f3810114450 2024-09-18T02:03:55.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.664+0000 7f37f7fff640 1 --2- 172.21.15.167:0/3705212306 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f37fc035db0 0x7f37fc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:55.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.664+0000 7f37f7fff640 1 -- 172.21.15.167:0/3705212306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3510+0+0 (secure 0 0 0) 0x7f3800047c30 con 0x7f3810114450 2024-09-18T02:03:55.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.664+0000 7f380effd640 1 --2- 172.21.15.167:0/3705212306 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f37fc035db0 0x7f37fc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:55.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.664+0000 7f380effd640 1 --2- 172.21.15.167:0/3705212306 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f37fc035db0 0x7f37fc038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f38040b0000 tx=0x7f380400c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:55.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.676+0000 7f37f7fff640 1 -- 172.21.15.167:0/3705212306 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f38101aa7f0 con 0x7f3810114450 2024-09-18T02:03:55.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:55.840+0000 7f3815ebc640 1 -- 172.21.15.167:0/3705212306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f3810114830 con 0x7f3810114450 2024-09-18T02:03:56.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.492+0000 7f37f7fff640 1 -- 172.21.15.167:0/3705212306 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v18) ==== 167+0+0 (secure 0 0 0) 0x7f38000182c0 con 0x7f3810114450 2024-09-18T02:03:56.496 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'default.rgw.buckets.data' created 2024-09-18T02:03:56.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.496+0000 7f3815ebc640 1 -- 172.21.15.167:0/3705212306 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f37fc035db0 msgr2=0x7f37fc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:56.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.496+0000 7f3815ebc640 1 --2- 172.21.15.167:0/3705212306 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f37fc035db0 0x7f37fc038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f38040b0000 tx=0x7f380400c040 comp rx=0 tx=0).stop 2024-09-18T02:03:56.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.496+0000 7f3815ebc640 1 -- 172.21.15.167:0/3705212306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3810114450 msgr2=0x7f38101a9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:56.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.496+0000 7f3815ebc640 1 --2- 172.21.15.167:0/3705212306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3810114450 0x7f38101a9d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f380000c480 tx=0x7f380000c940 comp rx=0 tx=0).stop 2024-09-18T02:03:56.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.496+0000 7f3815ebc640 1 -- 172.21.15.167:0/3705212306 shutdown_connections 2024-09-18T02:03:56.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.496+0000 7f3815ebc640 1 --2- 172.21.15.167:0/3705212306 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f37fc035db0 0x7f37fc038270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:56.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.496+0000 7f3815ebc640 1 --2- 172.21.15.167:0/3705212306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3810114450 0x7f38101a9d90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:56.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.496+0000 7f3815ebc640 1 -- 172.21.15.167:0/3705212306 >> 172.21.15.167:0/3705212306 conn(0x7f381006f390 msgr2=0x7f3810117b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:56.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.496+0000 7f3815ebc640 1 -- 172.21.15.167:0/3705212306 shutdown_connections 2024-09-18T02:03:56.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.496+0000 7f3815ebc640 1 -- 172.21.15.167:0/3705212306 wait complete. 2024-09-18T02:03:56.527 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-18T02:03:56.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.644+0000 7f6b34e3e640 1 Processor -- start 2024-09-18T02:03:56.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.644+0000 7f6b34e3e640 1 -- start start 2024-09-18T02:03:56.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.644+0000 7f6b34e3e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b30111bc0 0x7f6b300733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:56.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.644+0000 7f6b34e3e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b30073e60 con 0x7f6b30073920 2024-09-18T02:03:56.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.644+0000 7f6b34e3e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6b30074030 con 0x7f6b30111bc0 2024-09-18T02:03:56.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.644+0000 7f6b2e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b30111bc0 0x7f6b300733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:56.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.644+0000 7f6b2e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b30111bc0 0x7f6b300733e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:36194/0 (socket says 172.21.15.167:36194) 2024-09-18T02:03:56.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.644+0000 7f6b2e59c640 1 -- 172.21.15.167:0/108137047 learned_addr learned my addr 172.21.15.167:0/108137047 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:56.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.644+0000 7f6b2e59c640 1 -- 172.21.15.167:0/108137047 >> v1:172.21.15.81:6789/0 conn(0x7f6b30073920 legacy=0x7f6b3011c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:56.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.644+0000 7f6b2e59c640 1 -- 172.21.15.167:0/108137047 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b300741e0 con 0x7f6b30111bc0 2024-09-18T02:03:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b2e59c640 1 --2- 172.21.15.167:0/108137047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b30111bc0 0x7f6b300733e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6b280097f0 tx=0x7f6b2801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475631983a4c6db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b2d59a640 1 -- 172.21.15.167:0/108137047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b280ab580 con 0x7f6b30111bc0 2024-09-18T02:03:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b2d59a640 1 -- 172.21.15.167:0/108137047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b280b0070 con 0x7f6b30111bc0 2024-09-18T02:03:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b2d59a640 1 -- 172.21.15.167:0/108137047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b280ab870 con 0x7f6b30111bc0 2024-09-18T02:03:56.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b34e3e640 1 -- 172.21.15.167:0/108137047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b30111bc0 msgr2=0x7f6b300733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:56.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b34e3e640 1 --2- 172.21.15.167:0/108137047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b30111bc0 0x7f6b300733e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6b280097f0 tx=0x7f6b2801c430 comp rx=0 tx=0).stop 2024-09-18T02:03:56.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b34e3e640 1 -- 172.21.15.167:0/108137047 shutdown_connections 2024-09-18T02:03:56.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b34e3e640 1 --2- 172.21.15.167:0/108137047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b30111bc0 0x7f6b300733e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:56.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b34e3e640 1 -- 172.21.15.167:0/108137047 >> 172.21.15.167:0/108137047 conn(0x7f6b3006f3a0 msgr2=0x7f6b300717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:56.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b34e3e640 1 -- 172.21.15.167:0/108137047 shutdown_connections 2024-09-18T02:03:56.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b34e3e640 1 -- 172.21.15.167:0/108137047 wait complete. 2024-09-18T02:03:56.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b34e3e640 1 Processor -- start 2024-09-18T02:03:56.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b34e3e640 1 -- start start 2024-09-18T02:03:56.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b34e3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b30073920 0x7f6b301aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:56.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b34e3e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3011e8b0 con 0x7f6b30073920 2024-09-18T02:03:56.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b2e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b30073920 0x7f6b301aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:56.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b2e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b30073920 0x7f6b301aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:36198/0 (socket says 172.21.15.167:36198) 2024-09-18T02:03:56.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.648+0000 7f6b2e59c640 1 -- 172.21.15.167:0/895039545 learned_addr learned my addr 172.21.15.167:0/895039545 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:56.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b2e59c640 1 -- 172.21.15.167:0/895039545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b301af410 con 0x7f6b30073920 2024-09-18T02:03:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b2e59c640 1 --2- 172.21.15.167:0/895039545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b30073920 0x7f6b301aee40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6b28019040 tx=0x7f6b2801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b26ffd640 1 -- 172.21.15.167:0/895039545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b280abe50 con 0x7f6b30073920 2024-09-18T02:03:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b26ffd640 1 -- 172.21.15.167:0/895039545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b280aa8f0 con 0x7f6b30073920 2024-09-18T02:03:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b26ffd640 1 -- 172.21.15.167:0/895039545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b280aabf0 con 0x7f6b30073920 2024-09-18T02:03:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b34e3e640 1 -- 172.21.15.167:0/895039545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b301af640 con 0x7f6b30073920 2024-09-18T02:03:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b34e3e640 1 -- 172.21.15.167:0/895039545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b301a8f60 con 0x7f6b30073920 2024-09-18T02:03:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b34e3e640 1 -- 172.21.15.167:0/895039545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b300733e0 con 0x7f6b30073920 2024-09-18T02:03:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b26ffd640 1 -- 172.21.15.167:0/895039545 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6b280c7440 con 0x7f6b30073920 2024-09-18T02:03:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b26ffd640 1 --2- 172.21.15.167:0/895039545 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b10035fa0 0x7f6b10038460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:56.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b26ffd640 1 -- 172.21.15.167:0/895039545 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3845+0+0 (secure 0 0 0) 0x7f6b280e3920 con 0x7f6b30073920 2024-09-18T02:03:56.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b2dd9b640 1 --2- 172.21.15.167:0/895039545 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b10035fa0 0x7f6b10038460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:56.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.652+0000 7f6b2dd9b640 1 --2- 172.21.15.167:0/895039545 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b10035fa0 0x7f6b10038460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6b18007fd0 tx=0x7f6b18007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.668+0000 7f6b26ffd640 1 -- 172.21.15.167:0/895039545 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6b280160b0 con 0x7f6b30073920 2024-09-18T02:03:56.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:56.828+0000 7f6b34e3e640 1 -- 172.21.15.167:0/895039545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f6b30111bc0 con 0x7f6b30073920 2024-09-18T02:03:57.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.496+0000 7f6b26ffd640 1 -- 172.21.15.167:0/895039545 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) ==== 185+0+0 (secure 0 0 0) 0x7f6b280cc0c0 con 0x7f6b30073920 2024-09-18T02:03:57.501 INFO:teuthology.orchestra.run.smithi167.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-18T02:03:57.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.500+0000 7f6b34e3e640 1 -- 172.21.15.167:0/895039545 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b10035fa0 msgr2=0x7f6b10038460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:57.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.500+0000 7f6b34e3e640 1 --2- 172.21.15.167:0/895039545 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b10035fa0 0x7f6b10038460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6b18007fd0 tx=0x7f6b18007dc0 comp rx=0 tx=0).stop 2024-09-18T02:03:57.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.500+0000 7f6b34e3e640 1 -- 172.21.15.167:0/895039545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b30073920 msgr2=0x7f6b301aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:57.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.500+0000 7f6b34e3e640 1 --2- 172.21.15.167:0/895039545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b30073920 0x7f6b301aee40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6b28019040 tx=0x7f6b2801ac70 comp rx=0 tx=0).stop 2024-09-18T02:03:57.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.500+0000 7f6b34e3e640 1 -- 172.21.15.167:0/895039545 shutdown_connections 2024-09-18T02:03:57.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.500+0000 7f6b34e3e640 1 --2- 172.21.15.167:0/895039545 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b10035fa0 0x7f6b10038460 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:57.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.500+0000 7f6b34e3e640 1 --2- 172.21.15.167:0/895039545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b30073920 0x7f6b301aee40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:57.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.500+0000 7f6b34e3e640 1 -- 172.21.15.167:0/895039545 >> 172.21.15.167:0/895039545 conn(0x7f6b3006f3a0 msgr2=0x7f6b30070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:57.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.504+0000 7f6b34e3e640 1 -- 172.21.15.167:0/895039545 shutdown_connections 2024-09-18T02:03:57.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.504+0000 7f6b34e3e640 1 -- 172.21.15.167:0/895039545 wait complete. 2024-09-18T02:03:57.550 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-18T02:03:57.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabef7b3640 1 Processor -- start 2024-09-18T02:03:57.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabef7b3640 1 -- start start 2024-09-18T02:03:57.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabef7b3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabe810f880 0x7fabe811b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:57.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabef7b3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabe811b660 con 0x7fabe810ed90 2024-09-18T02:03:57.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabef7b3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fabe811c840 con 0x7fabe810f880 2024-09-18T02:03:57.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabecd4e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabe810f880 0x7fabe811b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:57.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabed54f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fabe810ed90 0x7fabe810f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:35464/0 (socket says 172.21.15.167:35464) 2024-09-18T02:03:57.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabed54f640 1 -- 172.21.15.167:0/917146371 learned_addr learned my addr 172.21.15.167:0/917146371 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:03:57.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabe7fff640 1 -- 172.21.15.167:0/917146371 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215487033 0 0) 0x7fabe811b660 con 0x7fabe810ed90 2024-09-18T02:03:57.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabe7fff640 1 -- 172.21.15.167:0/917146371 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabd0003530 con 0x7fabe810ed90 2024-09-18T02:03:57.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabecd4e640 1 -- 172.21.15.167:0/917146371 >> v1:172.21.15.81:6789/0 conn(0x7fabe810ed90 legacy=0x7fabe810f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:57.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.668+0000 7fabecd4e640 1 -- 172.21.15.167:0/917146371 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe811c9c0 con 0x7fabe810f880 2024-09-18T02:03:57.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabecd4e640 1 --2- 172.21.15.167:0/917146371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe810f880 0x7fabe811b120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009740 tx=0x7fabdc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b12709422f2a0fa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:57.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabe7fff640 1 -- 172.21.15.167:0/917146371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabdc0b1070 con 0x7fabe810f880 2024-09-18T02:03:57.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabe7fff640 1 -- 172.21.15.167:0/917146371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabdc0ac520 con 0x7fabe810f880 2024-09-18T02:03:57.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabe7fff640 1 -- 172.21.15.167:0/917146371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabdc0ac800 con 0x7fabe810f880 2024-09-18T02:03:57.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabef7b3640 1 -- 172.21.15.167:0/917146371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe810f880 msgr2=0x7fabe811b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabef7b3640 1 --2- 172.21.15.167:0/917146371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe810f880 0x7fabe811b120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009740 tx=0x7fabdc01c370 comp rx=0 tx=0).stop 2024-09-18T02:03:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabef7b3640 1 -- 172.21.15.167:0/917146371 shutdown_connections 2024-09-18T02:03:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabef7b3640 1 --2- 172.21.15.167:0/917146371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe810f880 0x7fabe811b120 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabef7b3640 1 -- 172.21.15.167:0/917146371 >> 172.21.15.167:0/917146371 conn(0x7fabe806f390 msgr2=0x7fabe80717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabef7b3640 1 -- 172.21.15.167:0/917146371 shutdown_connections 2024-09-18T02:03:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabef7b3640 1 -- 172.21.15.167:0/917146371 wait complete. 2024-09-18T02:03:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabef7b3640 1 Processor -- start 2024-09-18T02:03:57.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabef7b3640 1 -- start start 2024-09-18T02:03:57.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabef7b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe810ed90 0x7fabe81aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:57.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabef7b3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fabe811c490 con 0x7fabe810ed90 2024-09-18T02:03:57.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabed54f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe810ed90 0x7fabe81aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:57.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabed54f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe810ed90 0x7fabe81aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:36226/0 (socket says 172.21.15.167:36226) 2024-09-18T02:03:57.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.672+0000 7fabed54f640 1 -- 172.21.15.167:0/1392105924 learned_addr learned my addr 172.21.15.167:0/1392105924 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:57.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabed54f640 1 -- 172.21.15.167:0/1392105924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe81af320 con 0x7fabe810ed90 2024-09-18T02:03:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabed54f640 1 --2- 172.21.15.167:0/1392105924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe810ed90 0x7fabe81aed50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fabd800cb40 tx=0x7fabd80021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabe5ffb640 1 -- 172.21.15.167:0/1392105924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd8017070 con 0x7fabe810ed90 2024-09-18T02:03:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabef7b3640 1 -- 172.21.15.167:0/1392105924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe81af5b0 con 0x7fabe810ed90 2024-09-18T02:03:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabe5ffb640 1 -- 172.21.15.167:0/1392105924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd800ab80 con 0x7fabe810ed90 2024-09-18T02:03:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabe5ffb640 1 -- 172.21.15.167:0/1392105924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd8012400 con 0x7fabe810ed90 2024-09-18T02:03:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabef7b3640 1 -- 172.21.15.167:0/1392105924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe81a8fc0 con 0x7fabe810ed90 2024-09-18T02:03:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabef7b3640 1 -- 172.21.15.167:0/1392105924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe810f170 con 0x7fabe810ed90 2024-09-18T02:03:57.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabe5ffb640 1 -- 172.21.15.167:0/1392105924 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fabd801a070 con 0x7fabe810ed90 2024-09-18T02:03:57.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabe5ffb640 1 --2- 172.21.15.167:0/1392105924 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabd4035d60 0x7fabd4038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:57.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabe5ffb640 1 -- 172.21.15.167:0/1392105924 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3856+0+0 (secure 0 0 0) 0x7fabd8048a00 con 0x7fabe810ed90 2024-09-18T02:03:57.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabecd4e640 1 --2- 172.21.15.167:0/1392105924 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabd4035d60 0x7fabd4038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:57.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.676+0000 7fabecd4e640 1 --2- 172.21.15.167:0/1392105924 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabd4035d60 0x7fabd4038220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0ae000 tx=0x7fabdc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:57.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.688+0000 7fabe5ffb640 1 -- 172.21.15.167:0/1392105924 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fabd8021020 con 0x7fabe810ed90 2024-09-18T02:03:57.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:57.852+0000 7fabef7b3640 1 -- 172.21.15.167:0/1392105924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fabe81af7e0 con 0x7fabe810ed90 2024-09-18T02:03:58.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.504+0000 7fabe5ffb640 1 -- 172.21.15.167:0/1392105924 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) ==== 169+0+0 (secure 0 0 0) 0x7fabd8046890 con 0x7fabe810ed90 2024-09-18T02:03:58.509 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'default.rgw.buckets.index' created 2024-09-18T02:03:58.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.508+0000 7fabef7b3640 1 -- 172.21.15.167:0/1392105924 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabd4035d60 msgr2=0x7fabd4038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:58.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.508+0000 7fabef7b3640 1 --2- 172.21.15.167:0/1392105924 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabd4035d60 0x7fabd4038220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0ae000 tx=0x7fabdc0a7000 comp rx=0 tx=0).stop 2024-09-18T02:03:58.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.508+0000 7fabef7b3640 1 -- 172.21.15.167:0/1392105924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe810ed90 msgr2=0x7fabe81aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:58.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.508+0000 7fabef7b3640 1 --2- 172.21.15.167:0/1392105924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe810ed90 0x7fabe81aed50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fabd800cb40 tx=0x7fabd80021f0 comp rx=0 tx=0).stop 2024-09-18T02:03:58.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.508+0000 7fabef7b3640 1 -- 172.21.15.167:0/1392105924 shutdown_connections 2024-09-18T02:03:58.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.508+0000 7fabef7b3640 1 --2- 172.21.15.167:0/1392105924 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabd4035d60 0x7fabd4038220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:58.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.508+0000 7fabef7b3640 1 --2- 172.21.15.167:0/1392105924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe810ed90 0x7fabe81aed50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:58.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.508+0000 7fabef7b3640 1 -- 172.21.15.167:0/1392105924 >> 172.21.15.167:0/1392105924 conn(0x7fabe806f390 msgr2=0x7fabe810ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:58.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.508+0000 7fabef7b3640 1 -- 172.21.15.167:0/1392105924 shutdown_connections 2024-09-18T02:03:58.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.508+0000 7fabef7b3640 1 -- 172.21.15.167:0/1392105924 wait complete. 2024-09-18T02:03:58.541 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-18T02:03:58.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.656+0000 7fe7b548c640 1 Processor -- start 2024-09-18T02:03:58.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.656+0000 7fe7b548c640 1 -- start start 2024-09-18T02:03:58.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7b548c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7b011ad80 0x7fe7b011d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:58.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7b548c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b011d6b0 con 0x7fe7b0112010 2024-09-18T02:03:58.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7b548c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe7b011e890 con 0x7fe7b011ad80 2024-09-18T02:03:58.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7ae7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7b011ad80 0x7fe7b011d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:58.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7ae7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7b011ad80 0x7fe7b011d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:36230/0 (socket says 172.21.15.167:36230) 2024-09-18T02:03:58.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7ae7fc640 1 -- 172.21.15.167:0/3364988487 learned_addr learned my addr 172.21.15.167:0/3364988487 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:58.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7ae7fc640 1 -- 172.21.15.167:0/3364988487 >> v1:172.21.15.81:6789/0 conn(0x7fe7b0112010 legacy=0x7fe7b01123f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:58.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7ae7fc640 1 -- 172.21.15.167:0/3364988487 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b011ea10 con 0x7fe7b011ad80 2024-09-18T02:03:58.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7ae7fc640 1 --2- 172.21.15.167:0/3364988487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b011ad80 0x7fe7b011d170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40097f0 tx=0x7fe7a401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7b730a4790c120 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:58.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7adffb640 1 -- 172.21.15.167:0/3364988487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40ab580 con 0x7fe7b011ad80 2024-09-18T02:03:58.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7adffb640 1 -- 172.21.15.167:0/3364988487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40b0070 con 0x7fe7b011ad80 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.660+0000 7fe7adffb640 1 -- 172.21.15.167:0/3364988487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40ab870 con 0x7fe7b011ad80 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 -- 172.21.15.167:0/3364988487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b011ad80 msgr2=0x7fe7b011d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 --2- 172.21.15.167:0/3364988487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b011ad80 0x7fe7b011d170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40097f0 tx=0x7fe7a401c430 comp rx=0 tx=0).stop 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 -- 172.21.15.167:0/3364988487 shutdown_connections 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 --2- 172.21.15.167:0/3364988487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b011ad80 0x7fe7b011d170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 -- 172.21.15.167:0/3364988487 >> 172.21.15.167:0/3364988487 conn(0x7fe7b006e5a0 msgr2=0x7fe7b006e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 -- 172.21.15.167:0/3364988487 shutdown_connections 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 -- 172.21.15.167:0/3364988487 wait complete. 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 Processor -- start 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 -- start start 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b0112010 0x7fe7b01aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b011e580 con 0x7fe7b0112010 2024-09-18T02:03:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b0112010 0x7fe7b01aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b0112010 0x7fe7b01aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:36246/0 (socket says 172.21.15.167:36246) 2024-09-18T02:03:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7aeffd640 1 -- 172.21.15.167:0/3463837711 learned_addr learned my addr 172.21.15.167:0/3463837711 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:03:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7aeffd640 1 -- 172.21.15.167:0/3463837711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b01af4f0 con 0x7fe7b0112010 2024-09-18T02:03:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7aeffd640 1 --2- 172.21.15.167:0/3463837711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b0112010 0x7fe7b01aef20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800c6f0 tx=0x7fe7a800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7977fe640 1 -- 172.21.15.167:0/3463837711 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a8016020 con 0x7fe7b0112010 2024-09-18T02:03:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 -- 172.21.15.167:0/3463837711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b01af780 con 0x7fe7b0112010 2024-09-18T02:03:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7977fe640 1 -- 172.21.15.167:0/3463837711 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a8006b60 con 0x7fe7b0112010 2024-09-18T02:03:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 -- 172.21.15.167:0/3463837711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b01a9190 con 0x7fe7b0112010 2024-09-18T02:03:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7977fe640 1 -- 172.21.15.167:0/3463837711 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a8006e40 con 0x7fe7b0112010 2024-09-18T02:03:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.664+0000 7fe7b548c640 1 -- 172.21.15.167:0/3463837711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe790005090 con 0x7fe7b0112010 2024-09-18T02:03:58.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.668+0000 7fe7977fe640 1 -- 172.21.15.167:0/3463837711 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe7a800a870 con 0x7fe7b0112010 2024-09-18T02:03:58.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.668+0000 7fe7977fe640 1 --2- 172.21.15.167:0/3463837711 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe79c035d60 0x7fe79c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:03:58.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.668+0000 7fe7977fe640 1 -- 172.21.15.167:0/3463837711 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4220+0+0 (secure 0 0 0) 0x7fe7a8049390 con 0x7fe7b0112010 2024-09-18T02:03:58.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.668+0000 7fe7ae7fc640 1 --2- 172.21.15.167:0/3463837711 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe79c035d60 0x7fe79c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:03:58.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.668+0000 7fe7ae7fc640 1 --2- 172.21.15.167:0/3463837711 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe79c035d60 0x7fe79c038220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40af000 tx=0x7fe7a40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:03:58.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.680+0000 7fe7977fe640 1 -- 172.21.15.167:0/3463837711 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe7a8020020 con 0x7fe7b0112010 2024-09-18T02:03:58.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:58.844+0000 7fe7b548c640 1 -- 172.21.15.167:0/3463837711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fe790005380 con 0x7fe7b0112010 2024-09-18T02:03:59.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:59.512+0000 7fe7977fe640 1 -- 172.21.15.167:0/3463837711 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) ==== 187+0+0 (secure 0 0 0) 0x7fe7a8023e20 con 0x7fe7b0112010 2024-09-18T02:03:59.516 INFO:teuthology.orchestra.run.smithi167.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-18T02:03:59.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:59.516+0000 7fe7b548c640 1 -- 172.21.15.167:0/3463837711 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe79c035d60 msgr2=0x7fe79c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:59.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:59.516+0000 7fe7b548c640 1 --2- 172.21.15.167:0/3463837711 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe79c035d60 0x7fe79c038220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40af000 tx=0x7fe7a40a7000 comp rx=0 tx=0).stop 2024-09-18T02:03:59.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:59.516+0000 7fe7b548c640 1 -- 172.21.15.167:0/3463837711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b0112010 msgr2=0x7fe7b01aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:03:59.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:59.516+0000 7fe7b548c640 1 --2- 172.21.15.167:0/3463837711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b0112010 0x7fe7b01aef20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800c6f0 tx=0x7fe7a800cbb0 comp rx=0 tx=0).stop 2024-09-18T02:03:59.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:59.516+0000 7fe7b548c640 1 -- 172.21.15.167:0/3463837711 shutdown_connections 2024-09-18T02:03:59.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:59.516+0000 7fe7b548c640 1 --2- 172.21.15.167:0/3463837711 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe79c035d60 0x7fe79c038220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:03:59.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:59.516+0000 7fe7b548c640 1 --2- 172.21.15.167:0/3463837711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b0112010 0x7fe7b01aef20 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800c6f0 tx=0x7fe7a800cbb0 comp rx=0 tx=0).stop 2024-09-18T02:03:59.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:59.516+0000 7fe7b548c640 1 -- 172.21.15.167:0/3463837711 >> 172.21.15.167:0/3463837711 conn(0x7fe7b006e5a0 msgr2=0x7fe7b010f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:03:59.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:59.516+0000 7fe7b548c640 1 -- 172.21.15.167:0/3463837711 shutdown_connections 2024-09-18T02:03:59.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:03:59.516+0000 7fe7b548c640 1 -- 172.21.15.167:0/3463837711 wait complete. 2024-09-18T02:03:59.556 DEBUG:tasks.rgw:Pools created 2024-09-18T02:03:59.556 INFO:tasks.rgw:Starting rgw... 2024-09-18T02:03:59.556 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-18T02:03:59.557 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-18T02:03:59.557 DEBUG:teuthology.orchestra.run.smithi167:> sudo echo -n http://smithi167.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-18T02:03:59.571 INFO:teuthology.orchestra.run.smithi167.stdout:http://smithi167.front.sepia.ceph.com:80 2024-09-18T02:03:59.571 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-18T02:03:59.624 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-18T02:03:59.624 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-18T02:03:59.667 INFO:tasks.rgw.client.0:Started 2024-09-18T02:03:59.667 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi167.front.sepia.ceph.com:80/ 2024-09-18T02:03:59.667 DEBUG:teuthology.orchestra.run.smithi167:> curl http://smithi167.front.sepia.ceph.com:80/ 2024-09-18T02:03:59.693 INFO:teuthology.orchestra.run.smithi167.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T02:03:59.693 INFO:teuthology.orchestra.run.smithi167.stderr: Dload Upload Total Spent Left Speed 2024-09-18T02:03:59.693 INFO:teuthology.orchestra.run.smithi167.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T02:03:59.694 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T02:03:59.694 INFO:teuthology.orchestra.run.smithi167.stderr:curl: (7) Failed to connect to smithi167.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-18T02:04:00.695 DEBUG:teuthology.orchestra.run.smithi167:> curl http://smithi167.front.sepia.ceph.com:80/ 2024-09-18T02:04:00.707 INFO:teuthology.orchestra.run.smithi167.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T02:04:00.707 INFO:teuthology.orchestra.run.smithi167.stderr: Dload Upload Total Spent Left Speed 2024-09-18T02:04:00.707 INFO:teuthology.orchestra.run.smithi167.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T02:04:00.707 INFO:teuthology.orchestra.run.smithi167.stderr:curl: (7) Failed to connect to smithi167.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-18T02:04:00.707 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T02:04:02.709 DEBUG:teuthology.orchestra.run.smithi167:> curl http://smithi167.front.sepia.ceph.com:80/ 2024-09-18T02:04:02.721 INFO:teuthology.orchestra.run.smithi167.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T02:04:02.721 INFO:teuthology.orchestra.run.smithi167.stderr: Dload Upload Total Spent Left Speed 2024-09-18T02:04:02.721 INFO:teuthology.orchestra.run.smithi167.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T02:04:02.722 INFO:teuthology.orchestra.run.smithi167.stderr:curl: (7) Failed to connect to smithi167.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-18T02:04:02.722 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T02:04:06.724 DEBUG:teuthology.orchestra.run.smithi167:> curl http://smithi167.front.sepia.ceph.com:80/ 2024-09-18T02:04:06.736 INFO:teuthology.orchestra.run.smithi167.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T02:04:06.736 INFO:teuthology.orchestra.run.smithi167.stderr: Dload Upload Total Spent Left Speed 2024-09-18T02:04:06.736 INFO:teuthology.orchestra.run.smithi167.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T02:04:06.736 INFO:teuthology.orchestra.run.smithi167.stderr:curl: (7) Failed to connect to smithi167.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-18T02:04:06.736 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T02:04:08.739 INFO:tasks.rgw.client.0.smithi167.stdout:2024-09-18T02:04:08.736+0000 7f60e8e78a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-18T02:04:14.738 DEBUG:teuthology.orchestra.run.smithi167:> curl http://smithi167.front.sepia.ceph.com:80/ 2024-09-18T02:04:14.749 INFO:teuthology.orchestra.run.smithi167.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T02:04:14.750 INFO:teuthology.orchestra.run.smithi167.stderr: Dload Upload Total Spent Left Speed 2024-09-18T02:04:14.753 INFO:teuthology.orchestra.run.smithi167.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 46750 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-18T02:04:14.754 INFO:teuthology.orchestra.run.smithi167.stdout:anonymous 2024-09-18T02:04:14.754 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-18T02:04:14.834 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-18T02:04:14.834 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-18T02:04:14.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-18T02:04:14.834 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-18T02:04:14.871 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:14.872 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:14.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.868+0000 7f17921f1980 1 Processor -- start 2024-09-18T02:04:14.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.868+0000 7f17921f1980 1 -- start start 2024-09-18T02:04:14.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.868+0000 7f17921f1980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558e0fcd82c0 0x558e0fd68750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.868+0000 7f17921f1980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558e0fbebae0 con 0x558e0fd68c90 2024-09-18T02:04:14.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.868+0000 7f17921f1980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x558e0fc0fe30 con 0x558e0fcd82c0 2024-09-18T02:04:14.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.868+0000 7f178fd01640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558e0fcd82c0 0x558e0fd68750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.868+0000 7f178fd01640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558e0fcd82c0 0x558e0fd68750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60416/0 (socket says 172.21.15.167:60416) 2024-09-18T02:04:14.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.868+0000 7f178fd01640 1 -- 172.21.15.167:0/2108420609 learned_addr learned my addr 172.21.15.167:0/2108420609 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:14.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.868+0000 7f178f500640 1 --1- 172.21.15.167:0/2108420609 >> v1:172.21.15.81:6789/0 conn(0x558e0fd68c90 0x558e0fd6b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:34518/0 (socket says 172.21.15.167:34518) 2024-09-18T02:04:14.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.872+0000 7f178fd01640 1 -- 172.21.15.167:0/2108420609 >> v1:172.21.15.81:6789/0 conn(0x558e0fd68c90 legacy=0x558e0fd6b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:14.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.872+0000 7f178fd01640 1 -- 172.21.15.167:0/2108420609 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0fcd86a0 con 0x558e0fcd82c0 2024-09-18T02:04:14.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.872+0000 7f178fd01640 1 --2- 172.21.15.167:0/2108420609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fd68750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f178000a4e0 tx=0x7f178001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb1e668e854b67d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.872+0000 7f178ecff640 1 -- 172.21.15.167:0/2108420609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800aa540 con 0x558e0fcd82c0 2024-09-18T02:04:14.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.872+0000 7f178ecff640 1 -- 172.21.15.167:0/2108420609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800aa6e0 con 0x558e0fcd82c0 2024-09-18T02:04:14.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.872+0000 7f178ecff640 1 -- 172.21.15.167:0/2108420609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800aaa40 con 0x558e0fcd82c0 2024-09-18T02:04:14.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.872+0000 7f17921f1980 1 -- 172.21.15.167:0/2108420609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 msgr2=0x558e0fd68750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:14.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.872+0000 7f17921f1980 1 --2- 172.21.15.167:0/2108420609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fd68750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f178000a4e0 tx=0x7f178001b090 comp rx=0 tx=0).stop 2024-09-18T02:04:14.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.872+0000 7f17921f1980 1 -- 172.21.15.167:0/2108420609 shutdown_connections 2024-09-18T02:04:14.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.872+0000 7f17921f1980 1 --2- 172.21.15.167:0/2108420609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fd68750 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:14.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.872+0000 7f17921f1980 1 -- 172.21.15.167:0/2108420609 >> 172.21.15.167:0/2108420609 conn(0x558e0fd5e080 msgr2=0x558e0fd604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:14.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.876+0000 7f17921f1980 1 -- 172.21.15.167:0/2108420609 shutdown_connections 2024-09-18T02:04:14.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.876+0000 7f17921f1980 1 -- 172.21.15.167:0/2108420609 wait complete. 2024-09-18T02:04:14.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 Processor -- start 2024-09-18T02:04:14.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 -- start start 2024-09-18T02:04:14.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fe50bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e0fc11200 con 0x558e0fcd82c0 2024-09-18T02:04:14.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f178fd01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fe50bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f178fd01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fe50bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60424/0 (socket says 172.21.15.167:60424) 2024-09-18T02:04:14.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f178fd01640 1 -- 172.21.15.167:0/64510319 learned_addr learned my addr 172.21.15.167:0/64510319 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:14.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f178fd01640 1 -- 172.21.15.167:0/64510319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0fe511c0 con 0x558e0fcd82c0 2024-09-18T02:04:14.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f178fd01640 1 --2- 172.21.15.167:0/64510319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fe50bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1780018cc0 tx=0x7f17800033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06368995b469196 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f167de0b640 1 -- 172.21.15.167:0/64510319 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800b9030 con 0x558e0fcd82c0 2024-09-18T02:04:14.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f167de0b640 1 -- 172.21.15.167:0/64510319 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800aaa80 con 0x558e0fcd82c0 2024-09-18T02:04:14.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f167de0b640 1 -- 172.21.15.167:0/64510319 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800aada0 con 0x558e0fcd82c0 2024-09-18T02:04:14.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 -- 172.21.15.167:0/64510319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 msgr2=0x558e0fe50bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:14.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 --2- 172.21.15.167:0/64510319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fe50bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1780018cc0 tx=0x7f17800033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:14.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 -- 172.21.15.167:0/64510319 shutdown_connections 2024-09-18T02:04:14.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 --2- 172.21.15.167:0/64510319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fe50bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:14.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 -- 172.21.15.167:0/64510319 >> 172.21.15.167:0/64510319 conn(0x558e0fd5e080 msgr2=0x558e0fe4c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:14.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 -- 172.21.15.167:0/64510319 shutdown_connections 2024-09-18T02:04:14.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 -- 172.21.15.167:0/64510319 wait complete. 2024-09-18T02:04:14.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 Processor -- start 2024-09-18T02:04:14.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 -- start start 2024-09-18T02:04:14.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fe57ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.892+0000 7f17921f1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e0fd6f200 con 0x558e0fcd82c0 2024-09-18T02:04:14.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f178fd01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fe57ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f178fd01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fe57ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60426/0 (socket says 172.21.15.167:60426) 2024-09-18T02:04:14.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f178fd01640 1 -- 172.21.15.167:0/3853498061 learned_addr learned my addr 172.21.15.167:0/3853498061 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:14.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f178fd01640 1 -- 172.21.15.167:0/3853498061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0fe58400 con 0x558e0fcd82c0 2024-09-18T02:04:14.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f178fd01640 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fe57ec0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1780018cc0 tx=0x7f1780017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f1677fff640 1 -- 172.21.15.167:0/3853498061 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800b9070 con 0x558e0fcd82c0 2024-09-18T02:04:14.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f1677fff640 1 -- 172.21.15.167:0/3853498061 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800c3030 con 0x558e0fcd82c0 2024-09-18T02:04:14.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e0fe58690 con 0x558e0fcd82c0 2024-09-18T02:04:14.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f1677fff640 1 -- 172.21.15.167:0/3853498061 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800bf770 con 0x558e0fcd82c0 2024-09-18T02:04:14.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e0fe5b370 con 0x558e0fcd82c0 2024-09-18T02:04:14.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f1677fff640 1 -- 172.21.15.167:0/3853498061 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f17800b3040 con 0x558e0fcd82c0 2024-09-18T02:04:14.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f1677fff640 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1678034650 0x7f1678036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f1677fff640 1 -- 172.21.15.167:0/3853498061 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f17800ba070 con 0x558e0fcd82c0 2024-09-18T02:04:14.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f178f500640 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1678034650 0x7f1678036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f17921f1980 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558e0fd68c90 0x558e0fe5ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe5f420 con 0x558e0fd68c90 2024-09-18T02:04:14.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f1790502640 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558e0fd68c90 0x558e0fe5ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f178f500640 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1678034650 0x7f1678036b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1784001e50 tx=0x7f17840013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.896+0000 7f1790502640 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558e0fd68c90 0x558e0fe5ee50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f1790502640 1 -- 172.21.15.167:0/3853498061 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17880083f0 con 0x558e0fd68c90 2024-09-18T02:04:14.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe5c570 con 0x558e0fd68c90 2024-09-18T02:04:14.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f1790502640 1 -- 172.21.15.167:0/3853498061 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17880083f0 con 0x558e0fd68c90 2024-09-18T02:04:14.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f17921f1980 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558e0fe617a0 0x558e0fe63b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe64260 con 0x558e0fe617a0 2024-09-18T02:04:14.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f178fd01640 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558e0fe617a0 0x558e0fe63b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f178fd01640 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558e0fe617a0 0x558e0fe63b90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f178fd01640 1 -- 172.21.15.167:0/3853498061 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe617a0 2024-09-18T02:04:14.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe60640 con 0x558e0fd68c90 2024-09-18T02:04:14.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f1790502640 1 -- 172.21.15.167:0/3853498061 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17880083f0 con 0x558e0fd68c90 2024-09-18T02:04:14.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f17921f1980 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558e0fe656c0 0x558e0fe67ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe681b0 con 0x558e0fe656c0 2024-09-18T02:04:14.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f178f500640 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558e0fe656c0 0x558e0fe67ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.900+0000 7f178f500640 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558e0fe656c0 0x558e0fe67ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f178f500640 1 -- 172.21.15.167:0/3853498061 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f178400f700 con 0x558e0fe656c0 2024-09-18T02:04:14.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f17921f1980 1 Processor -- start 2024-09-18T02:04:14.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f17921f1980 1 -- start start 2024-09-18T02:04:14.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f17921f1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe75c80 0x558e0fe760a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f17921f1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e0fc6a800 con 0x558e0fe75c80 2024-09-18T02:04:14.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f178fd01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe75c80 0x558e0fe760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f178fd01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe75c80 0x558e0fe760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60442/0 (socket says 172.21.15.167:60442) 2024-09-18T02:04:14.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f178fd01640 1 -- 172.21.15.167:0/1916794386 learned_addr learned my addr 172.21.15.167:0/1916794386 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:14.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f178fd01640 1 -- 172.21.15.167:0/1916794386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0fe765e0 con 0x558e0fe75c80 2024-09-18T02:04:14.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f178fd01640 1 --2- 172.21.15.167:0/1916794386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe75c80 0x558e0fe760a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f17800e3930 tx=0x7f17800bca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f16757fa640 1 -- 172.21.15.167:0/1916794386 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800e22f0 con 0x558e0fe75c80 2024-09-18T02:04:14.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f16757fa640 1 -- 172.21.15.167:0/1916794386 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800e2490 con 0x558e0fe75c80 2024-09-18T02:04:14.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f17921f1980 1 -- 172.21.15.167:0/1916794386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e0fe76870 con 0x558e0fe75c80 2024-09-18T02:04:14.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f16757fa640 1 -- 172.21.15.167:0/1916794386 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800bfb50 con 0x558e0fe75c80 2024-09-18T02:04:14.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f17921f1980 1 -- 172.21.15.167:0/1916794386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e0fe794f0 con 0x558e0fe75c80 2024-09-18T02:04:14.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f16757fa640 1 -- 172.21.15.167:0/1916794386 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f17800bfcf0 con 0x558e0fe75c80 2024-09-18T02:04:14.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f16757fa640 1 --2- 172.21.15.167:0/1916794386 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1668034650 0x7f1668036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f16757fa640 1 -- 172.21.15.167:0/1916794386 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f17800090d0 con 0x558e0fe75c80 2024-09-18T02:04:14.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.904+0000 7f178f500640 1 --2- 172.21.15.167:0/1916794386 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1668034650 0x7f1668036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 Processor -- start 2024-09-18T02:04:14.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 -- start start 2024-09-18T02:04:14.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f178f500640 1 --2- 172.21.15.167:0/1916794386 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1668034650 0x7f1668036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x558e0fe5fd50 tx=0x7f178400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 0x558e0fe82a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e0fe51480 con 0x558e0fe82620 2024-09-18T02:04:14.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f178fd01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 0x558e0fe82a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f178fd01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 0x558e0fe82a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60450/0 (socket says 172.21.15.167:60450) 2024-09-18T02:04:14.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f178fd01640 1 -- 172.21.15.167:0/699915675 learned_addr learned my addr 172.21.15.167:0/699915675 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:14.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f178fd01640 1 -- 172.21.15.167:0/699915675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0fe82fd0 con 0x558e0fe82620 2024-09-18T02:04:14.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f178fd01640 1 --2- 172.21.15.167:0/699915675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 0x558e0fe82a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f17800d3e40 tx=0x7f17800d3f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567945910dab3ec server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f166effd640 1 -- 172.21.15.167:0/699915675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800c6a30 con 0x558e0fe82620 2024-09-18T02:04:14.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f166effd640 1 -- 172.21.15.167:0/699915675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800f3070 con 0x558e0fe82620 2024-09-18T02:04:14.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f166effd640 1 -- 172.21.15.167:0/699915675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800e01f0 con 0x558e0fe82620 2024-09-18T02:04:14.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 -- 172.21.15.167:0/699915675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 msgr2=0x558e0fe82a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:14.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 --2- 172.21.15.167:0/699915675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 0x558e0fe82a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f17800d3e40 tx=0x7f17800d3f30 comp rx=0 tx=0).stop 2024-09-18T02:04:14.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 -- 172.21.15.167:0/699915675 shutdown_connections 2024-09-18T02:04:14.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 --2- 172.21.15.167:0/699915675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 0x558e0fe82a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:14.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 -- 172.21.15.167:0/699915675 >> 172.21.15.167:0/699915675 conn(0x558e0fe7ea00 msgr2=0x558e0fe7cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:14.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 -- 172.21.15.167:0/699915675 shutdown_connections 2024-09-18T02:04:14.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 -- 172.21.15.167:0/699915675 wait complete. 2024-09-18T02:04:14.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 Processor -- start 2024-09-18T02:04:14.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 -- start start 2024-09-18T02:04:14.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 0x558e0fe89760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f17921f1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e0fe83470 con 0x558e0fe82620 2024-09-18T02:04:14.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f178fd01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 0x558e0fe89760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f178fd01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 0x558e0fe89760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60464/0 (socket says 172.21.15.167:60464) 2024-09-18T02:04:14.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.908+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 learned_addr learned my addr 172.21.15.167:0/3401822908 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:14.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0fe89ca0 con 0x558e0fe82620 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f178fd01640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 0x558e0fe89760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f17800bf9b0 tx=0x7f17800dbf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f166d7fa640 1 -- 172.21.15.167:0/3401822908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780109070 con 0x558e0fe82620 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f166d7fa640 1 -- 172.21.15.167:0/3401822908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800d39d0 con 0x558e0fe82620 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e0fe89ca0 con 0x558e0fe82620 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f166d7fa640 1 -- 172.21.15.167:0/3401822908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800de7b0 con 0x558e0fe82620 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e0fe89ca0 con 0x558e0fe82620 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f166d7fa640 1 -- 172.21.15.167:0/3401822908 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1780102040 con 0x558e0fe82620 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f166d7fa640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1658034650 0x7f1658036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f166d7fa640 1 -- 172.21.15.167:0/3401822908 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f17800fe650 con 0x558e0fe82620 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f178f500640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1658034650 0x7f1658036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558e0fe94890 0x558e0fe96d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe974a0 con 0x558e0fe94890 2024-09-18T02:04:14.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f1790502640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558e0fe94890 0x558e0fe96d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f178f500640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1658034650 0x7f1658036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x558e0fe685b0 tx=0x7f1784010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f1790502640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558e0fe94890 0x558e0fe96d50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17880083f0 con 0x558e0fe94890 2024-09-18T02:04:14.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:14.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 20 realm 2024-09-18T02:04:14.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:14.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe978b0 con 0x558e0fe94890 2024-09-18T02:04:14.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17880083f0 con 0x558e0fe94890 2024-09-18T02:04:14.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:14.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:14.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:14.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe98150 con 0x558e0fe94890 2024-09-18T02:04:14.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17880083f0 con 0x558e0fe94890 2024-09-18T02:04:14.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:14.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:14.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.912+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17880083f0 con 0x558e0fe94890 2024-09-18T02:04:14.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f17921f1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:14.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f17921f1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:14.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f17921f1980 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558e0fe99250 0x558e0fe9b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe9bb80 con 0x558e0fe99250 2024-09-18T02:04:14.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f178fd01640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558e0fe99250 0x558e0fe9b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f178fd01640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558e0fe99250 0x558e0fe9b640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f17921f1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f17921f1980 20 searching for the correct realm 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f17921f1980 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558e0fe9daf0 0x558e0fe9ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea0680 con 0x558e0fe9daf0 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f178f500640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558e0fe9daf0 0x558e0fe9ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f178f500640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558e0fe9daf0 0x558e0fe9ffb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f178f500640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f178401fbe0 0x7f178403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea0680 con 0x7f178401fbe0 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f1790502640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f178401fbe0 0x7f178403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f1790502640 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f178401fbe0 0x7f178403a3c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:14.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17880083f0 con 0x7f178401fbe0 2024-09-18T02:04:14.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.916+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe99250 2024-09-18T02:04:14.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17880083f0 con 0x558e0fe94890 2024-09-18T02:04:14.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe99250 2024-09-18T02:04:14.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe99250 2024-09-18T02:04:14.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x7f178401fbe0 2024-09-18T02:04:14.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe99250 2024-09-18T02:04:14.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.920+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x7f178401fbe0 2024-09-18T02:04:14.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe99250 2024-09-18T02:04:14.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe99250 2024-09-18T02:04:14.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.924+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x7f178401fbe0 2024-09-18T02:04:14.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe99250 2024-09-18T02:04:14.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe99250 2024-09-18T02:04:14.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x7f178401fbe0 2024-09-18T02:04:14.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe99250 2024-09-18T02:04:14.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.928+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x7f178401fbe0 2024-09-18T02:04:14.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe9c3d0 con 0x558e0fe94890 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe9c3d0 con 0x558e0fe94890 2024-09-18T02:04:14.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe9c3d0 con 0x558e0fe9daf0 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 zone default found 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 4 Realm: () 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 zonegroup default 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:14.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe9cc70 con 0x558e0fe99250 2024-09-18T02:04:14.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea24e0 con 0x558e0fe9daf0 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea2880 con 0x558e0fe9daf0 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 started sync module instance, tier type = 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.932+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea1980 con 0x7f178401fbe0 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.936+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.936+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94068640718512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea1980 con 0x7f178401fbe0 2024-09-18T02:04:14.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.936+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea32d0 con 0x558e0fe94890 2024-09-18T02:04:14.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.936+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94068640718512] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.936+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.936+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94068640722400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea1980 con 0x558e0fe94890 2024-09-18T02:04:14.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.936+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea3ce0 con 0x558e0fe9daf0 2024-09-18T02:04:14.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.940+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.940+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94068640725040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea4580 con 0x558e0fe9daf0 2024-09-18T02:04:14.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.940+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea4fa0 con 0x7f178401fbe0 2024-09-18T02:04:14.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.940+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94068640722400] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.940+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94068640725040] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.940+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.940+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94068640727248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea14d0 con 0x7f178401fbe0 2024-09-18T02:04:14.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.940+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea5840 con 0x558e0fe94890 2024-09-18T02:04:14.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.944+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94068640727248] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.944+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.944+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94068640729744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea5760 con 0x558e0fe94890 2024-09-18T02:04:14.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.944+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea6030 con 0x558e0fe99250 2024-09-18T02:04:14.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.944+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.944+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94068640733328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe99250 2024-09-18T02:04:14.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.944+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea7290 con 0x558e0fe99250 2024-09-18T02:04:14.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.944+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94068640729744] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.948+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94068640733328] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.948+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.948+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94068640731824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea7290 con 0x558e0fe99250 2024-09-18T02:04:14.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.948+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea7ae0 con 0x558e0fe99250 2024-09-18T02:04:14.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.956+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.956+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94068640740464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea7f00 con 0x558e0fe99250 2024-09-18T02:04:14.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.956+0000 7f17921f1980 20 add_watcher() i=0 2024-09-18T02:04:14.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.956+0000 7f17921f1980 20 add_watcher() i=1 2024-09-18T02:04:14.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.956+0000 7f17921f1980 20 add_watcher() i=2 2024-09-18T02:04:14.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.956+0000 7f17921f1980 20 add_watcher() i=3 2024-09-18T02:04:14.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.956+0000 7f17921f1980 20 add_watcher() i=4 2024-09-18T02:04:14.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.956+0000 7f17921f1980 20 add_watcher() i=5 2024-09-18T02:04:14.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.956+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94068640731824] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.956+0000 7f17921f1980 20 add_watcher() i=6 2024-09-18T02:04:14.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94068640740464] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f17921f1980 20 add_watcher() i=7 2024-09-18T02:04:14.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f17921f1980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:14.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea6de0 con 0x558e0fe94890 2024-09-18T02:04:14.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94068640738784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea84b0 con 0x558e0fe94890 2024-09-18T02:04:14.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94068640738784] v30'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f1645fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:14.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f17921f1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:14.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f17921f1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:14.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f17921f1980 5 note: GC not initialized 2024-09-18T02:04:14.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f1644fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:14.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f17921f1980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:14.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f17921f1980 20 Filter name: none 2024-09-18T02:04:14.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f15be7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:14.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fecdc70 con 0x558e0fe9daf0 2024-09-18T02:04:14.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.960+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fecdc70 con 0x558e0fe9daf0 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fecdc70 con 0x558e0fe94890 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x7f178401fbe0 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x7f178401fbe0 2024-09-18T02:04:14.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe99250 2024-09-18T02:04:14.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.964+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe99250 2024-09-18T02:04:14.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe9daf0 2024-09-18T02:04:14.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe99250 2024-09-18T02:04:14.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe99250 2024-09-18T02:04:14.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe99250 2024-09-18T02:04:14.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe9daf0 2024-09-18T02:04:14.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x7f178401fbe0 2024-09-18T02:04:14.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.968+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe94890 2024-09-18T02:04:14.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe94890 2024-09-18T02:04:14.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe9daf0 2024-09-18T02:04:14.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x7f178401fbe0 2024-09-18T02:04:14.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe99250 2024-09-18T02:04:14.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe94890 2024-09-18T02:04:14.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe99250 2024-09-18T02:04:14.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe9daf0 2024-09-18T02:04:14.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x7f178401fbe0 2024-09-18T02:04:14.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.972+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe99250 2024-09-18T02:04:14.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.976+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.976+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe94890 2024-09-18T02:04:14.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.976+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.976+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x558e0fe9daf0 2024-09-18T02:04:14.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.976+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.976+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea68d0 con 0x7f178401fbe0 2024-09-18T02:04:14.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.976+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.976+0000 7f1645fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:14.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.976+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94068640738784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.976+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94068640738784] v30'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.976+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94068640718512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x7f178401fbe0 2024-09-18T02:04:14.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.980+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94068640718512] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.980+0000 7f17921f1980 20 remove_watcher() i=0 2024-09-18T02:04:14.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.980+0000 7f17921f1980 2 removed watcher, disabling cache 2024-09-18T02:04:14.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.980+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94068640722400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe94890 2024-09-18T02:04:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.984+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94068640722400] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.984+0000 7f17921f1980 20 remove_watcher() i=1 2024-09-18T02:04:14.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.984+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94068640725040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fe984f0 con 0x558e0fe9daf0 2024-09-18T02:04:14.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.984+0000 7f178f500640 1 -- 172.21.15.167:0/3401822908 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94068640725040] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784037040 con 0x558e0fe9daf0 2024-09-18T02:04:14.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.984+0000 7f17921f1980 20 remove_watcher() i=2 2024-09-18T02:04:14.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.984+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94068640727248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea3830 con 0x7f178401fbe0 2024-09-18T02:04:14.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.988+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94068640727248] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x7f178401fbe0 2024-09-18T02:04:14.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.988+0000 7f17921f1980 20 remove_watcher() i=3 2024-09-18T02:04:14.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.988+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94068640729744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea40d0 con 0x558e0fe94890 2024-09-18T02:04:14.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.988+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94068640729744] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1788026040 con 0x558e0fe94890 2024-09-18T02:04:14.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.988+0000 7f17921f1980 20 remove_watcher() i=4 2024-09-18T02:04:14.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.988+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94068640733328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea3830 con 0x558e0fe99250 2024-09-18T02:04:14.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.992+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94068640733328] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.992+0000 7f17921f1980 20 remove_watcher() i=5 2024-09-18T02:04:14.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.992+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94068640731824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea40d0 con 0x558e0fe99250 2024-09-18T02:04:14.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.992+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94068640731824] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:14.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.992+0000 7f17921f1980 20 remove_watcher() i=6 2024-09-18T02:04:14.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.992+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94068640740464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558e0fea5890 con 0x558e0fe99250 2024-09-18T02:04:15.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f178fd01640 1 -- 172.21.15.167:0/3401822908 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94068640740464] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800cf070 con 0x558e0fe99250 2024-09-18T02:04:15.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 20 remove_watcher() i=7 2024-09-18T02:04:15.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558e0fe99250 msgr2=0x558e0fe9b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558e0fe99250 0x558e0fe9b640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558e0fe94890 msgr2=0x558e0fe96d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558e0fe94890 0x558e0fe96d50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f178401fbe0 msgr2=0x7f178403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f178401fbe0 0x7f178403a3c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558e0fe9daf0 msgr2=0x558e0fe9ffb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558e0fe9daf0 0x558e0fe9ffb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1658034650 msgr2=0x7f1658036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1658034650 0x7f1658036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x558e0fe685b0 tx=0x7f1784010000 comp rx=0 tx=0).stop 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 msgr2=0x558e0fe89760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/3401822908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe82620 0x558e0fe89760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f17800bf9b0 tx=0x7f17800dbf60 comp rx=0 tx=0).stop 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f1790502640 1 -- 172.21.15.167:0/3401822908 reap_dead start 2024-09-18T02:04:15.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 shutdown_connections 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 >> 172.21.15.167:0/3401822908 conn(0x558e0fe7ea00 msgr2=0x558e0fe7cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 shutdown_connections 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3401822908 wait complete. 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/1916794386 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1668034650 msgr2=0x7f1668036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/1916794386 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1668034650 0x7f1668036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x558e0fe5fd50 tx=0x7f178400f000 comp rx=0 tx=0).stop 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/1916794386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe75c80 msgr2=0x558e0fe760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/1916794386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe75c80 0x558e0fe760a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f17800e3930 tx=0x7f17800bca20 comp rx=0 tx=0).stop 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/1916794386 shutdown_connections 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/1916794386 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1668034650 0x7f1668036b10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/1916794386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fe75c80 0x558e0fe760a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/1916794386 >> 172.21.15.167:0/1916794386 conn(0x558e0fe6add0 msgr2=0x558e0fe6d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/1916794386 shutdown_connections 2024-09-18T02:04:15.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/1916794386 wait complete. 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558e0fe617a0 msgr2=0x558e0fe63b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558e0fe617a0 0x558e0fe63b90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558e0fd68c90 msgr2=0x558e0fe5ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558e0fd68c90 0x558e0fe5ee50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558e0fe656c0 msgr2=0x558e0fe67ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558e0fe656c0 0x558e0fe67ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1678034650 msgr2=0x7f1678036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1678034650 0x7f1678036b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1784001e50 tx=0x7f17840013b0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 msgr2=0x558e0fe57ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 --2- 172.21.15.167:0/3853498061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e0fcd82c0 0x558e0fe57ec0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1780018cc0 tx=0x7f1780017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f1790502640 1 -- 172.21.15.167:0/3853498061 reap_dead start 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 shutdown_connections 2024-09-18T02:04:15.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 >> 172.21.15.167:0/3853498061 conn(0x558e0fd5e080 msgr2=0x558e0fe4b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 shutdown_connections 2024-09-18T02:04:15.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:14.996+0000 7f17921f1980 1 -- 172.21.15.167:0/3853498061 wait complete. 2024-09-18T02:04:15.011 INFO:teuthology.orchestra.run.smithi167.stdout:[] 2024-09-18T02:04:15.011 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T02:04:15.011 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-18T02:04:15.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-18T02:04:15.011 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-18T02:04:15.086 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:15.087 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:15.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f398b1980 1 Processor -- start 2024-09-18T02:04:15.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f398b1980 1 -- start start 2024-09-18T02:04:15.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f398b1980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55b50578fa10 0x55b505791e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f398b1980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b505613ae0 con 0x55b50578b690 2024-09-18T02:04:15.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f398b1980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55b505637e30 con 0x55b50578fa10 2024-09-18T02:04:15.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f36bc0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55b50578fa10 0x55b505791e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f373c1640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55b50578b690 0x55b50578ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:34522/0 (socket says 172.21.15.167:34522) 2024-09-18T02:04:15.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f373c1640 1 -- 172.21.15.167:0/3538067137 learned_addr learned my addr 172.21.15.167:0/3538067137 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:15.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f363bf640 1 -- 172.21.15.167:0/3538067137 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196546918 0 0) 0x55b505613ae0 con 0x55b50578b690 2024-09-18T02:04:15.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f363bf640 1 -- 172.21.15.167:0/3538067137 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f20001e20 con 0x55b50578b690 2024-09-18T02:04:15.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3538067137 >> v1:172.21.15.81:6789/0 conn(0x55b50578b690 legacy=0x55b50578ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.084+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3538067137 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b505793350 con 0x55b50578fa10 2024-09-18T02:04:15.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.088+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/3538067137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578fa10 0x55b505791e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00a480 tx=0x7f3f2c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389a561556aaa013 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.088+0000 7f3f363bf640 1 -- 172.21.15.167:0/3538067137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c0b0070 con 0x55b50578fa10 2024-09-18T02:04:15.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.088+0000 7f3f363bf640 1 -- 172.21.15.167:0/3538067137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c0ab540 con 0x55b50578fa10 2024-09-18T02:04:15.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.088+0000 7f3f363bf640 1 -- 172.21.15.167:0/3538067137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c0ab840 con 0x55b50578fa10 2024-09-18T02:04:15.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.088+0000 7f3f398b1980 1 -- 172.21.15.167:0/3538067137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578fa10 msgr2=0x55b505791e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.088+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3538067137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578fa10 0x55b505791e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00a480 tx=0x7f3f2c01b280 comp rx=0 tx=0).stop 2024-09-18T02:04:15.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.088+0000 7f3f398b1980 1 -- 172.21.15.167:0/3538067137 shutdown_connections 2024-09-18T02:04:15.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.088+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3538067137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578fa10 0x55b505791e00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.088+0000 7f3f398b1980 1 -- 172.21.15.167:0/3538067137 >> 172.21.15.167:0/3538067137 conn(0x55b5057871b0 msgr2=0x55b5057895d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.088+0000 7f3f398b1980 1 -- 172.21.15.167:0/3538067137 shutdown_connections 2024-09-18T02:04:15.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.088+0000 7f3f398b1980 1 -- 172.21.15.167:0/3538067137 wait complete. 2024-09-18T02:04:15.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.104+0000 7f3f398b1980 1 Processor -- start 2024-09-18T02:04:15.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.104+0000 7f3f398b1980 1 -- start start 2024-09-18T02:04:15.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.104+0000 7f3f398b1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 0x55b505876880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.104+0000 7f3f398b1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b505639200 con 0x55b50578b690 2024-09-18T02:04:15.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.104+0000 7f3f373c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 0x55b505876880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.104+0000 7f3f373c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 0x55b505876880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60476/0 (socket says 172.21.15.167:60476) 2024-09-18T02:04:15.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.104+0000 7f3f373c1640 1 -- 172.21.15.167:0/3675002760 learned_addr learned my addr 172.21.15.167:0/3675002760 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f373c1640 1 -- 172.21.15.167:0/3675002760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b505876e50 con 0x55b50578b690 2024-09-18T02:04:15.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f373c1640 1 --2- 172.21.15.167:0/3675002760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 0x55b505876880 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3f30001740 tx=0x7f3f30001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78b0ccbf5c1848d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3e2560a640 1 -- 172.21.15.167:0/3675002760 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30016070 con 0x55b50578b690 2024-09-18T02:04:15.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3e2560a640 1 -- 172.21.15.167:0/3675002760 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f30004530 con 0x55b50578b690 2024-09-18T02:04:15.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3e2560a640 1 -- 172.21.15.167:0/3675002760 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30004850 con 0x55b50578b690 2024-09-18T02:04:15.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f398b1980 1 -- 172.21.15.167:0/3675002760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 msgr2=0x55b505876880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3675002760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 0x55b505876880 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3f30001740 tx=0x7f3f30001c00 comp rx=0 tx=0).stop 2024-09-18T02:04:15.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f398b1980 1 -- 172.21.15.167:0/3675002760 shutdown_connections 2024-09-18T02:04:15.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3675002760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 0x55b505876880 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f398b1980 1 -- 172.21.15.167:0/3675002760 >> 172.21.15.167:0/3675002760 conn(0x55b5057871b0 msgr2=0x55b5058724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f398b1980 1 -- 172.21.15.167:0/3675002760 shutdown_connections 2024-09-18T02:04:15.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f398b1980 1 -- 172.21.15.167:0/3675002760 wait complete. 2024-09-18T02:04:15.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f398b1980 1 Processor -- start 2024-09-18T02:04:15.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f398b1980 1 -- start start 2024-09-18T02:04:15.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f398b1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 0x55b505702510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f398b1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b505792e50 con 0x55b50578b690 2024-09-18T02:04:15.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f373c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 0x55b505702510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f373c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 0x55b505702510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60486/0 (socket says 172.21.15.167:60486) 2024-09-18T02:04:15.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f373c1640 1 -- 172.21.15.167:0/2059354918 learned_addr learned my addr 172.21.15.167:0/2059354918 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f373c1640 1 -- 172.21.15.167:0/2059354918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b505700c30 con 0x55b50578b690 2024-09-18T02:04:15.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.108+0000 7f3f373c1640 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 0x55b505702510 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3f30014040 tx=0x7f3f30001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3e23e07640 1 -- 172.21.15.167:0/2059354918 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30016040 con 0x55b50578b690 2024-09-18T02:04:15.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3e23e07640 1 -- 172.21.15.167:0/2059354918 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f30011400 con 0x55b50578b690 2024-09-18T02:04:15.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b505700ec0 con 0x55b50578b690 2024-09-18T02:04:15.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3e23e07640 1 -- 172.21.15.167:0/2059354918 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30011720 con 0x55b50578b690 2024-09-18T02:04:15.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b505701410 con 0x55b50578b690 2024-09-18T02:04:15.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3e23e07640 1 -- 172.21.15.167:0/2059354918 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f300118c0 con 0x55b50578b690 2024-09-18T02:04:15.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3e23e07640 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e1c0346a0 0x7f3e1c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3e23e07640 1 -- 172.21.15.167:0/2059354918 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3f30049360 con 0x55b50578b690 2024-09-18T02:04:15.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e1c0346a0 0x7f3e1c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b50578fa10 0x55b505887010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b505887550 con 0x55b50578fa10 2024-09-18T02:04:15.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f37bc2640 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b50578fa10 0x55b505887010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e1c0346a0 0x7f3e1c036b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0ad000 tx=0x7f3f2c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f37bc2640 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b50578fa10 0x55b505887010 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f37bc2640 1 -- 172.21.15.167:0/2059354918 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f280083f0 con 0x55b50578fa10 2024-09-18T02:04:15.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b505887950 con 0x55b50578fa10 2024-09-18T02:04:15.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f37bc2640 1 -- 172.21.15.167:0/2059354918 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f280083f0 con 0x55b50578fa10 2024-09-18T02:04:15.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b505889760 0x55b50588bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50588c220 con 0x55b505889760 2024-09-18T02:04:15.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.112+0000 7f3f373c1640 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b505889760 0x55b50588bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f373c1640 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b505889760 0x55b50588bb50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f373c1640 1 -- 172.21.15.167:0/2059354918 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f3002c070 con 0x55b505889760 2024-09-18T02:04:15.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b505888600 con 0x55b50578fa10 2024-09-18T02:04:15.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f37bc2640 1 -- 172.21.15.167:0/2059354918 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f280083f0 con 0x55b50578fa10 2024-09-18T02:04:15.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b50588d680 0x55b50588fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b505890170 con 0x55b50588d680 2024-09-18T02:04:15.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b50588d680 0x55b50588fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b50588d680 0x55b50588fa70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f36bc0640 1 -- 172.21.15.167:0/2059354918 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3f2c0b3040 con 0x55b50588d680 2024-09-18T02:04:15.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f398b1980 1 Processor -- start 2024-09-18T02:04:15.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f398b1980 1 -- start start 2024-09-18T02:04:15.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f398b1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50589dc00 0x55b50589e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f398b1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b505692800 con 0x55b50589dc00 2024-09-18T02:04:15.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f373c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50589dc00 0x55b50589e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f373c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50589dc00 0x55b50589e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60496/0 (socket says 172.21.15.167:60496) 2024-09-18T02:04:15.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f373c1640 1 -- 172.21.15.167:0/2185403253 learned_addr learned my addr 172.21.15.167:0/2185403253 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.116+0000 7f3f373c1640 1 -- 172.21.15.167:0/2185403253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50589e560 con 0x55b50589dc00 2024-09-18T02:04:15.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f373c1640 1 --2- 172.21.15.167:0/2185403253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50589dc00 0x55b50589e020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f30047960 tx=0x7f3f30011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3e21602640 1 -- 172.21.15.167:0/2185403253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30046130 con 0x55b50589dc00 2024-09-18T02:04:15.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3e21602640 1 -- 172.21.15.167:0/2185403253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f300462d0 con 0x55b50589dc00 2024-09-18T02:04:15.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f398b1980 1 -- 172.21.15.167:0/2185403253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b50589e7f0 con 0x55b50589dc00 2024-09-18T02:04:15.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3e21602640 1 -- 172.21.15.167:0/2185403253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3002d350 con 0x55b50589dc00 2024-09-18T02:04:15.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f398b1980 1 -- 172.21.15.167:0/2185403253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5058a1470 con 0x55b50589dc00 2024-09-18T02:04:15.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3e21602640 1 -- 172.21.15.167:0/2185403253 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f3002d4f0 con 0x55b50589dc00 2024-09-18T02:04:15.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3e21602640 1 --2- 172.21.15.167:0/2185403253 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e10034650 0x7f3e10036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3e21602640 1 -- 172.21.15.167:0/2185403253 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3f30039b40 con 0x55b50589dc00 2024-09-18T02:04:15.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/2185403253 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e10034650 0x7f3e10036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f398b1980 1 Processor -- start 2024-09-18T02:04:15.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f398b1980 1 -- start start 2024-09-18T02:04:15.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f398b1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/2185403253 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e10034650 0x7f3e10036b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55b505887d10 tx=0x7f3f2c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f398b1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b5058771d0 con 0x55b5058aa500 2024-09-18T02:04:15.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f373c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f373c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058aa8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60510/0 (socket says 172.21.15.167:60510) 2024-09-18T02:04:15.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f373c1640 1 -- 172.21.15.167:0/3860059280 learned_addr learned my addr 172.21.15.167:0/3860059280 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f373c1640 1 -- 172.21.15.167:0/3860059280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5058aaeb0 con 0x55b5058aa500 2024-09-18T02:04:15.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3f373c1640 1 --2- 172.21.15.167:0/3860059280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058aa8e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3f3002ffb0 tx=0x7f3f30049a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3057c37e6268f2f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3e1affd640 1 -- 172.21.15.167:0/3860059280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3003d040 con 0x55b5058aa500 2024-09-18T02:04:15.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3e1affd640 1 -- 172.21.15.167:0/3860059280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f30039e60 con 0x55b5058aa500 2024-09-18T02:04:15.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.120+0000 7f3e1affd640 1 -- 172.21.15.167:0/3860059280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3002f440 con 0x55b5058aa500 2024-09-18T02:04:15.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 -- 172.21.15.167:0/3860059280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 msgr2=0x55b5058aa8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3860059280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058aa8e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3f3002ffb0 tx=0x7f3f30049a90 comp rx=0 tx=0).stop 2024-09-18T02:04:15.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 -- 172.21.15.167:0/3860059280 shutdown_connections 2024-09-18T02:04:15.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3860059280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058aa8e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 -- 172.21.15.167:0/3860059280 >> 172.21.15.167:0/3860059280 conn(0x55b5058a68e0 msgr2=0x55b5058a49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 -- 172.21.15.167:0/3860059280 shutdown_connections 2024-09-18T02:04:15.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 -- 172.21.15.167:0/3860059280 wait complete. 2024-09-18T02:04:15.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 Processor -- start 2024-09-18T02:04:15.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 -- start start 2024-09-18T02:04:15.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b5058ab350 con 0x55b5058aa500 2024-09-18T02:04:15.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f373c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f373c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60516/0 (socket says 172.21.15.167:60516) 2024-09-18T02:04:15.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 learned_addr learned my addr 172.21.15.167:0/3580050078 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5058b1c00 con 0x55b5058aa500 2024-09-18T02:04:15.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f373c1640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058b16c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3f3002ffb0 tx=0x7f3f3000a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3e197fa640 1 -- 172.21.15.167:0/3580050078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30063070 con 0x55b5058aa500 2024-09-18T02:04:15.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3e197fa640 1 -- 172.21.15.167:0/3580050078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f3002f440 con 0x55b5058aa500 2024-09-18T02:04:15.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5058b1c00 con 0x55b5058aa500 2024-09-18T02:04:15.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5058b1c00 con 0x55b5058aa500 2024-09-18T02:04:15.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.124+0000 7f3e197fa640 1 -- 172.21.15.167:0/3580050078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3003d040 con 0x55b5058aa500 2024-09-18T02:04:15.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3e197fa640 1 -- 172.21.15.167:0/3580050078 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f3005b070 con 0x55b5058aa500 2024-09-18T02:04:15.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3e197fa640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e00034650 0x7f3e00036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3e197fa640 1 -- 172.21.15.167:0/3580050078 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3f30059020 con 0x55b5058aa500 2024-09-18T02:04:15.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e00034650 0x7f3e00036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b5058bc580 0x55b5058bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058bf190 con 0x55b5058bc580 2024-09-18T02:04:15.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f37bc2640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b5058bc580 0x55b5058bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e00034650 0x7f3e00036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000c10 tx=0x7f3f2c0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f37bc2640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b5058bc580 0x55b5058bea40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f280083f0 con 0x55b5058bc580 2024-09-18T02:04:15.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 20 realm 2024-09-18T02:04:15.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058bf5a0 con 0x55b5058bc580 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f280083f0 con 0x55b5058bc580 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058bfe70 con 0x55b5058bc580 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f280083f0 con 0x55b5058bc580 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058bc580 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f280083f0 con 0x55b5058bc580 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b5058c0f70 0x55b5058c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c3970 con 0x55b5058c0f70 2024-09-18T02:04:15.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f373c1640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b5058c0f70 0x55b5058c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.128+0000 7f3f373c1640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b5058c0f70 0x55b5058c3360 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f398b1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:15.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f398b1980 20 searching for the correct realm 2024-09-18T02:04:15.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b5058c58c0 0x55b5058c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c83a0 con 0x55b5058c58c0 2024-09-18T02:04:15.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b5058c58c0 0x55b5058c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b5058c58c0 0x55b5058c7cd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f36bc0640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3f2c0cd040 0x7f3f2c0b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c83a0 con 0x7f3f2c0cd040 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f37bc2640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3f2c0cd040 0x7f3f2c0b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f37bc2640 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3f2c0cd040 0x7f3f2c0b7420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f280083f0 con 0x7f3f2c0cd040 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c0f70 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058bc580 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f280083f0 con 0x55b5058bc580 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058bc580 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.132+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c0f70 2024-09-18T02:04:15.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c0f70 2024-09-18T02:04:15.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x7f3f2c0cd040 2024-09-18T02:04:15.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c58c0 2024-09-18T02:04:15.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058bc580 2024-09-18T02:04:15.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c0f70 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058bc580 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x7f3f2c0cd040 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c58c0 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c58c0 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.136+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c0f70 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c58c0 2024-09-18T02:04:15.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c58c0 2024-09-18T02:04:15.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058bc580 2024-09-18T02:04:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058bc580 2024-09-18T02:04:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c0f70 2024-09-18T02:04:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c58c0 2024-09-18T02:04:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x7f3f2c0cd040 2024-09-18T02:04:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058bc580 2024-09-18T02:04:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.140+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c0f70 2024-09-18T02:04:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c58c0 2024-09-18T02:04:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c0f70 2024-09-18T02:04:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x7f3f2c0cd040 2024-09-18T02:04:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c58c0 2024-09-18T02:04:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058c0f70 2024-09-18T02:04:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x55b5058bc580 2024-09-18T02:04:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c0210 con 0x7f3f2c0cd040 2024-09-18T02:04:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c4230 con 0x55b5058bc580 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c4230 con 0x55b5058bc580 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.144+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c4230 con 0x55b5058c58c0 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 20 zone default found 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 4 Realm: () 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 20 zonegroup default 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c4bf0 con 0x55b5058c0f70 2024-09-18T02:04:15.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c4790 con 0x55b5058c58c0 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ca750 con 0x55b5058c58c0 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 20 started sync module instance, tier type = 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c9b40 con 0x7f3f2c0cd040 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94235970543712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c9b40 con 0x7f3f2c0cd040 2024-09-18T02:04:15.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.148+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cb1d0 con 0x55b5058bc580 2024-09-18T02:04:15.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.152+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94235970543712] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.152+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.152+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94235970547248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c9b40 con 0x55b5058bc580 2024-09-18T02:04:15.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.152+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cbbe0 con 0x55b5058c58c0 2024-09-18T02:04:15.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.152+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.152+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94235970549552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cc480 con 0x55b5058c58c0 2024-09-18T02:04:15.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.152+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ccec0 con 0x7f3f2c0cd040 2024-09-18T02:04:15.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.152+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94235970547248] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.156+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.156+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94235970554256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cd2b0 con 0x7f3f2c0cd040 2024-09-18T02:04:15.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.156+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94235970549552] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.156+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cdc70 con 0x55b5058bc580 2024-09-18T02:04:15.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.156+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.156+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94235970551760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cdc70 con 0x55b5058bc580 2024-09-18T02:04:15.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.156+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ce4c0 con 0x55b5058c0f70 2024-09-18T02:04:15.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.160+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.160+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94235970559392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ced60 con 0x55b5058c0f70 2024-09-18T02:04:15.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.160+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cf720 con 0x55b5058c0f70 2024-09-18T02:04:15.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.160+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94235970554256] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.160+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94235970551760] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94235970564720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cfac0 con 0x55b5058c0f70 2024-09-18T02:04:15.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058d0350 con 0x55b5058c0f70 2024-09-18T02:04:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94235970559392] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94235970562144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058d0530 con 0x55b5058c0f70 2024-09-18T02:04:15.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 20 add_watcher() i=0 2024-09-18T02:04:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 20 add_watcher() i=1 2024-09-18T02:04:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 20 add_watcher() i=2 2024-09-18T02:04:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 20 add_watcher() i=3 2024-09-18T02:04:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 20 add_watcher() i=4 2024-09-18T02:04:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 20 add_watcher() i=5 2024-09-18T02:04:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94235970564720] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 20 add_watcher() i=6 2024-09-18T02:04:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94235970562144] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 20 add_watcher() i=7 2024-09-18T02:04:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.164+0000 7f3f398b1980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.168+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058d3450 con 0x55b5058bc580 2024-09-18T02:04:15.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.168+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.168+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94235970541200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058d08d0 con 0x55b5058bc580 2024-09-18T02:04:15.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.168+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94235970541200] v30'32 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.168+0000 7f3dedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:15.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.168+0000 7f3f398b1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:15.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.168+0000 7f3f398b1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:15.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.168+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dbb90 con 0x55b5058bc580 2024-09-18T02:04:15.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.172+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'40 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.172+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dc260 con 0x55b5058c0f70 2024-09-18T02:04:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.172+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.172+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dc260 con 0x55b5058c58c0 2024-09-18T02:04:15.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.176+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.176+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dc850 con 0x55b5058bc580 2024-09-18T02:04:15.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.176+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.176+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dcd00 con 0x7f3f2c0cd040 2024-09-18T02:04:15.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.176+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.176+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058d9b00 con 0x55b5058c58c0 2024-09-18T02:04:15.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.180+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.180+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058d9b00 con 0x55b5058bc580 2024-09-18T02:04:15.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.180+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.180+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dd860 con 0x55b5058c0f70 2024-09-18T02:04:15.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.184+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.184+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dd860 con 0x7f3f2c0cd040 2024-09-18T02:04:15.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.184+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.184+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dd860 con 0x55b5058c58c0 2024-09-18T02:04:15.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.188+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.188+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ddd10 con 0x7f3f2c0cd040 2024-09-18T02:04:15.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.188+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.188+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ddd10 con 0x55b5058c0f70 2024-09-18T02:04:15.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.192+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.192+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ddd10 con 0x7f3f2c0cd040 2024-09-18T02:04:15.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.192+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.192+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ddd10 con 0x55b5058c0f70 2024-09-18T02:04:15.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.196+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.196+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ddd10 con 0x55b5058bc580 2024-09-18T02:04:15.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.196+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'34 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.196+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ddd10 con 0x55b5058c58c0 2024-09-18T02:04:15.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.200+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.200+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ddda0 con 0x7f3f2c0cd040 2024-09-18T02:04:15.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.200+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.200+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058ddda0 con 0x55b5058c58c0 2024-09-18T02:04:15.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.200+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.200+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde90 con 0x55b5058bc580 2024-09-18T02:04:15.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.204+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.204+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde90 con 0x55b5058bc580 2024-09-18T02:04:15.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.204+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'35 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.204+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde30 con 0x55b5058c58c0 2024-09-18T02:04:15.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.208+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.208+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde30 con 0x7f3f2c0cd040 2024-09-18T02:04:15.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.208+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.208+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde60 con 0x55b5058c58c0 2024-09-18T02:04:15.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.212+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.212+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde60 con 0x55b5058c58c0 2024-09-18T02:04:15.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.212+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.212+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde30 con 0x55b5058c58c0 2024-09-18T02:04:15.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.212+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.212+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde60 con 0x55b5058c58c0 2024-09-18T02:04:15.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.216+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'26 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.216+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde60 con 0x55b5058c0f70 2024-09-18T02:04:15.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.216+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.216+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde30 con 0x55b5058c58c0 2024-09-18T02:04:15.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.216+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.220+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde60 con 0x55b5058c0f70 2024-09-18T02:04:15.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.220+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.220+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde60 con 0x55b5058c58c0 2024-09-18T02:04:15.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.224+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.224+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde30 con 0x55b5058c0f70 2024-09-18T02:04:15.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.224+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.224+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058dde30 con 0x7f3f2c0cd040 2024-09-18T02:04:15.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3decfe1640 20 reqs_thread_entry: start 2024-09-18T02:04:15.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3f398b1980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:15.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3f398b1980 20 Filter name: none 2024-09-18T02:04:15.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3d667fc640 20 reqs_thread_entry: start 2024-09-18T02:04:15.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3f398b1980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-18T02:04:15.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3f398b1980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5058d8cf0 con 0x7f3f2c0cd040 2024-09-18T02:04:15.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3f398b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3f398b1980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-18T02:04:15.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3f398b1980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T02:04:15.233 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T02:04:15.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3dedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:15.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.228+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94235970541200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058d6be0 con 0x55b5058bc580 2024-09-18T02:04:15.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.232+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94235970541200] v30'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.232+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94235970543712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c9690 con 0x7f3f2c0cd040 2024-09-18T02:04:15.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.232+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94235970543712] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.232+0000 7f3f398b1980 20 remove_watcher() i=0 2024-09-18T02:04:15.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.232+0000 7f3f398b1980 2 removed watcher, disabling cache 2024-09-18T02:04:15.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.232+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94235970547248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c9690 con 0x55b5058bc580 2024-09-18T02:04:15.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.236+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94235970547248] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.236+0000 7f3f398b1980 20 remove_watcher() i=1 2024-09-18T02:04:15.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.236+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94235970549552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cae30 con 0x55b5058c58c0 2024-09-18T02:04:15.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.236+0000 7f3f36bc0640 1 -- 172.21.15.167:0/3580050078 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94235970549552] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2c0d8070 con 0x55b5058c58c0 2024-09-18T02:04:15.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.236+0000 7f3f398b1980 20 remove_watcher() i=2 2024-09-18T02:04:15.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.236+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94235970554256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c9690 con 0x7f3f2c0cd040 2024-09-18T02:04:15.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.240+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94235970554256] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x7f3f2c0cd040 2024-09-18T02:04:15.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.240+0000 7f3f398b1980 20 remove_watcher() i=3 2024-09-18T02:04:15.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.240+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94235970551760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cae30 con 0x55b5058bc580 2024-09-18T02:04:15.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.240+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94235970551760] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f28026040 con 0x55b5058bc580 2024-09-18T02:04:15.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.240+0000 7f3f398b1980 20 remove_watcher() i=4 2024-09-18T02:04:15.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.240+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94235970559392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058c9690 con 0x55b5058c0f70 2024-09-18T02:04:15.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.244+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94235970559392] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.244+0000 7f3f398b1980 20 remove_watcher() i=5 2024-09-18T02:04:15.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.244+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94235970564720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cbfd0 con 0x55b5058c0f70 2024-09-18T02:04:15.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.244+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94235970564720] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.244+0000 7f3f398b1980 20 remove_watcher() i=6 2024-09-18T02:04:15.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.244+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94235970562144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5058cae30 con 0x55b5058c0f70 2024-09-18T02:04:15.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f373c1640 1 -- 172.21.15.167:0/3580050078 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94235970562144] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3002c070 con 0x55b5058c0f70 2024-09-18T02:04:15.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 20 remove_watcher() i=7 2024-09-18T02:04:15.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b5058c0f70 msgr2=0x55b5058c3360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b5058c0f70 0x55b5058c3360 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b5058bc580 msgr2=0x55b5058bea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b5058bc580 0x55b5058bea40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3f2c0cd040 msgr2=0x7f3f2c0b7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3f2c0cd040 0x7f3f2c0b7420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b5058c58c0 msgr2=0x55b5058c7cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b5058c58c0 0x55b5058c7cd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e00034650 msgr2=0x7f3e00036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e00034650 0x7f3e00036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000c10 tx=0x7f3f2c0b9040 comp rx=0 tx=0).stop 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 msgr2=0x55b5058b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f37bc2640 1 -- 172.21.15.167:0/3580050078 reap_dead start 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058b16c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3f3002ffb0 tx=0x7f3f3000a360 comp rx=0 tx=0).stop 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 shutdown_connections 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/3580050078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5058aa500 0x55b5058b16c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 >> 172.21.15.167:0/3580050078 conn(0x55b5058a68e0 msgr2=0x55b5058a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 shutdown_connections 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/3580050078 wait complete. 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2185403253 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e10034650 msgr2=0x7f3e10036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2185403253 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e10034650 0x7f3e10036b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55b505887d10 tx=0x7f3f2c005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2185403253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50589dc00 msgr2=0x55b50589e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2185403253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50589dc00 0x55b50589e020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f30047960 tx=0x7f3f30011f80 comp rx=0 tx=0).stop 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2185403253 shutdown_connections 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2185403253 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e10034650 0x7f3e10036b10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2185403253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50589dc00 0x55b50589e020 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2185403253 >> 172.21.15.167:0/2185403253 conn(0x55b505892d50 msgr2=0x55b5058957d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2185403253 shutdown_connections 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2185403253 wait complete. 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b505889760 msgr2=0x55b50588bb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b505889760 0x55b50588bb50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b50578fa10 msgr2=0x55b505887010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b50578fa10 0x55b505887010 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b50588d680 msgr2=0x55b50588fa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b50588d680 0x55b50588fa70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e1c0346a0 msgr2=0x7f3e1c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e1c0346a0 0x7f3e1c036b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0ad000 tx=0x7f3f2c0a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 msgr2=0x55b505702510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 --2- 172.21.15.167:0/2059354918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50578b690 0x55b505702510 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3f30014040 tx=0x7f3f30001260 comp rx=0 tx=0).stop 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f37bc2640 1 -- 172.21.15.167:0/2059354918 reap_dead start 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 shutdown_connections 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 >> 172.21.15.167:0/2059354918 conn(0x55b5057871b0 msgr2=0x55b505871030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 shutdown_connections 2024-09-18T02:04:15.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.248+0000 7f3f398b1980 1 -- 172.21.15.167:0/2059354918 wait complete. 2024-09-18T02:04:15.263 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T02:04:15.264 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-18T02:04:15.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-18T02:04:15.264 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-18T02:04:15.341 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:15.341 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:15.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00c1ebd980 1 Processor -- start 2024-09-18T02:04:15.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00c1ebd980 1 -- start start 2024-09-18T02:04:15.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00c1ebd980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55910c011290 0x55910c09f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00c1ebd980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55910bf24ae0 con 0x55910c09f8e0 2024-09-18T02:04:15.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00c1ebd980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55910bf48e30 con 0x55910c011290 2024-09-18T02:04:15.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00bf9cd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55910c011290 0x55910c09f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00bf9cd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55910c011290 0x55910c09f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60528/0 (socket says 172.21.15.167:60528) 2024-09-18T02:04:15.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00bf1cc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55910c09f8e0 0x55910c0a1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:34528/0 (socket says 172.21.15.167:34528) 2024-09-18T02:04:15.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00bf9cd640 1 -- 172.21.15.167:0/1145179076 learned_addr learned my addr 172.21.15.167:0/1145179076 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00bf9cd640 1 -- 172.21.15.167:0/1145179076 >> v1:172.21.15.81:6789/0 conn(0x55910c09f8e0 legacy=0x55910c0a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00be9cb640 1 -- 172.21.15.167:0/1145179076 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1770612216 0 0) 0x55910bf24ae0 con 0x55910c09f8e0 2024-09-18T02:04:15.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.340+0000 7f00bf9cd640 1 -- 172.21.15.167:0/1145179076 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910c011820 con 0x55910c011290 2024-09-18T02:04:15.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.344+0000 7f00bf9cd640 1 --2- 172.21.15.167:0/1145179076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c09f3a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f00b000a4e0 tx=0x7f00b001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3772715597143f63 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.344+0000 7f00be9cb640 1 -- 172.21.15.167:0/1145179076 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00aa540 con 0x55910c011290 2024-09-18T02:04:15.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.344+0000 7f00be9cb640 1 -- 172.21.15.167:0/1145179076 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b00aa6e0 con 0x55910c011290 2024-09-18T02:04:15.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.344+0000 7f00be9cb640 1 -- 172.21.15.167:0/1145179076 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00aaa00 con 0x55910c011290 2024-09-18T02:04:15.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.344+0000 7f00c1ebd980 1 -- 172.21.15.167:0/1145179076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 msgr2=0x55910c09f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.344+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/1145179076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c09f3a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f00b000a4e0 tx=0x7f00b001b090 comp rx=0 tx=0).stop 2024-09-18T02:04:15.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.344+0000 7f00c1ebd980 1 -- 172.21.15.167:0/1145179076 shutdown_connections 2024-09-18T02:04:15.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.344+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/1145179076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c09f3a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.344+0000 7f00c1ebd980 1 -- 172.21.15.167:0/1145179076 >> 172.21.15.167:0/1145179076 conn(0x55910c097090 msgr2=0x55910c0994b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.344+0000 7f00c1ebd980 1 -- 172.21.15.167:0/1145179076 shutdown_connections 2024-09-18T02:04:15.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.344+0000 7f00c1ebd980 1 -- 172.21.15.167:0/1145179076 wait complete. 2024-09-18T02:04:15.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.360+0000 7f00c1ebd980 1 Processor -- start 2024-09-18T02:04:15.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.360+0000 7f00c1ebd980 1 -- start start 2024-09-18T02:04:15.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.360+0000 7f00c1ebd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c187760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.360+0000 7f00c1ebd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55910bf4a200 con 0x55910c011290 2024-09-18T02:04:15.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.360+0000 7f00bf9cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c187760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.360+0000 7f00bf9cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c187760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60530/0 (socket says 172.21.15.167:60530) 2024-09-18T02:04:15.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.360+0000 7f00bf9cd640 1 -- 172.21.15.167:0/388221670 learned_addr learned my addr 172.21.15.167:0/388221670 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.360+0000 7f00bf9cd640 1 -- 172.21.15.167:0/388221670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910c187d30 con 0x55910c011290 2024-09-18T02:04:15.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00bf9cd640 1 --2- 172.21.15.167:0/388221670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c187760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f00b0017ca0 tx=0x7f00b00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301735804716ed46 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7effade0b640 1 -- 172.21.15.167:0/388221670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00b9030 con 0x55910c011290 2024-09-18T02:04:15.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7effade0b640 1 -- 172.21.15.167:0/388221670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b00aaac0 con 0x55910c011290 2024-09-18T02:04:15.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7effade0b640 1 -- 172.21.15.167:0/388221670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00aada0 con 0x55910c011290 2024-09-18T02:04:15.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 -- 172.21.15.167:0/388221670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 msgr2=0x55910c187760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/388221670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c187760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f00b0017ca0 tx=0x7f00b00033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 -- 172.21.15.167:0/388221670 shutdown_connections 2024-09-18T02:04:15.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/388221670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c187760 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 -- 172.21.15.167:0/388221670 >> 172.21.15.167:0/388221670 conn(0x55910c097090 msgr2=0x55910c183390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 -- 172.21.15.167:0/388221670 shutdown_connections 2024-09-18T02:04:15.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 -- 172.21.15.167:0/388221670 wait complete. 2024-09-18T02:04:15.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 Processor -- start 2024-09-18T02:04:15.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 -- start start 2024-09-18T02:04:15.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c18e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55910c0a3f00 con 0x55910c011290 2024-09-18T02:04:15.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00bf9cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c18e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00bf9cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c18e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60544/0 (socket says 172.21.15.167:60544) 2024-09-18T02:04:15.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2669313515 learned_addr learned my addr 172.21.15.167:0/2669313515 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2669313515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910c18eef0 con 0x55910c011290 2024-09-18T02:04:15.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00bf9cd640 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c18e9b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00b0005cc0 tx=0x7f00b0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7effa7fff640 1 -- 172.21.15.167:0/2669313515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00b9030 con 0x55910c011290 2024-09-18T02:04:15.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7effa7fff640 1 -- 172.21.15.167:0/2669313515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b00c3070 con 0x55910c011290 2024-09-18T02:04:15.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7effa7fff640 1 -- 172.21.15.167:0/2669313515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00bf750 con 0x55910c011290 2024-09-18T02:04:15.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55910c18f180 con 0x55910c011290 2024-09-18T02:04:15.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.364+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55910c191e60 con 0x55910c011290 2024-09-18T02:04:15.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7effa7fff640 1 -- 172.21.15.167:0/2669313515 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00b00c5030 con 0x55910c011290 2024-09-18T02:04:15.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7effa7fff640 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effa80346a0 0x7effa8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7effa7fff640 1 -- 172.21.15.167:0/2669313515 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f00b00ba070 con 0x55910c011290 2024-09-18T02:04:15.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00bf1cc640 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effa80346a0 0x7effa8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55910c09f8e0 0x55910c195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c195f60 con 0x55910c09f8e0 2024-09-18T02:04:15.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00c01ce640 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55910c09f8e0 0x55910c195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00bf1cc640 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effa80346a0 0x7effa8036b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f00b4000c10 tx=0x7f00b40013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00c01ce640 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55910c09f8e0 0x55910c195940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00c01ce640 1 -- 172.21.15.167:0/2669313515 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b80083f0 con 0x55910c09f8e0 2024-09-18T02:04:15.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c193060 con 0x55910c09f8e0 2024-09-18T02:04:15.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00c01ce640 1 -- 172.21.15.167:0/2669313515 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00b80083f0 con 0x55910c09f8e0 2024-09-18T02:04:15.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55910c1982c0 0x55910c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c19ad80 con 0x55910c1982c0 2024-09-18T02:04:15.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00bf9cd640 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55910c1982c0 0x55910c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.368+0000 7f00bf9cd640 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55910c1982c0 0x55910c19a6b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2669313515 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f00b00ce070 con 0x55910c1982c0 2024-09-18T02:04:15.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c197160 con 0x55910c09f8e0 2024-09-18T02:04:15.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00c01ce640 1 -- 172.21.15.167:0/2669313515 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00b80083f0 con 0x55910c09f8e0 2024-09-18T02:04:15.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55910c19c1c0 0x55910c19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c19ed40 con 0x55910c19c1c0 2024-09-18T02:04:15.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00bf1cc640 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55910c19c1c0 0x55910c19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00bf1cc640 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55910c19c1c0 0x55910c19e5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2669313515 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f00b400f680 con 0x55910c19c1c0 2024-09-18T02:04:15.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00c1ebd980 1 Processor -- start 2024-09-18T02:04:15.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00c1ebd980 1 -- start start 2024-09-18T02:04:15.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00c1ebd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1ac7d0 0x55910c1acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00c1ebd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55910bfa3800 con 0x55910c1ac7d0 2024-09-18T02:04:15.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00bf9cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1ac7d0 0x55910c1acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00bf9cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1ac7d0 0x55910c1acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60554/0 (socket says 172.21.15.167:60554) 2024-09-18T02:04:15.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00bf9cd640 1 -- 172.21.15.167:0/4245389419 learned_addr learned my addr 172.21.15.167:0/4245389419 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00bf9cd640 1 -- 172.21.15.167:0/4245389419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910c1ad130 con 0x55910c1ac7d0 2024-09-18T02:04:15.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.372+0000 7f00bf9cd640 1 --2- 172.21.15.167:0/4245389419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1ac7d0 0x55910c1acbf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f00b0008030 tx=0x7f00b00a9720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7effa57fa640 1 -- 172.21.15.167:0/4245389419 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00c65d0 con 0x55910c1ac7d0 2024-09-18T02:04:15.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00c1ebd980 1 -- 172.21.15.167:0/4245389419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55910c1ad3c0 con 0x55910c1ac7d0 2024-09-18T02:04:15.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7effa57fa640 1 -- 172.21.15.167:0/4245389419 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b00c6770 con 0x55910c1ac7d0 2024-09-18T02:04:15.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7effa57fa640 1 -- 172.21.15.167:0/4245389419 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00b4b50 con 0x55910c1ac7d0 2024-09-18T02:04:15.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00c1ebd980 1 -- 172.21.15.167:0/4245389419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55910c1b0040 con 0x55910c1ac7d0 2024-09-18T02:04:15.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7effa57fa640 1 -- 172.21.15.167:0/4245389419 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00b00ea060 con 0x55910c1ac7d0 2024-09-18T02:04:15.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7effa57fa640 1 --2- 172.21.15.167:0/4245389419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 0x7eff98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7effa57fa640 1 -- 172.21.15.167:0/4245389419 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f00b00e8070 con 0x55910c1ac7d0 2024-09-18T02:04:15.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00bf1cc640 1 --2- 172.21.15.167:0/4245389419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 0x7eff98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00c1ebd980 1 Processor -- start 2024-09-18T02:04:15.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00c1ebd980 1 -- start start 2024-09-18T02:04:15.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00c1ebd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 0x55910c1b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00c1ebd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55910c187ff0 con 0x55910c1b90c0 2024-09-18T02:04:15.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00bf1cc640 1 --2- 172.21.15.167:0/4245389419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 0x7eff98036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55910c19f140 tx=0x7f00b4006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00bf9cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 0x55910c1b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00bf9cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 0x55910c1b94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60570/0 (socket says 172.21.15.167:60570) 2024-09-18T02:04:15.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00bf9cd640 1 -- 172.21.15.167:0/1116828832 learned_addr learned my addr 172.21.15.167:0/1116828832 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00bf9cd640 1 -- 172.21.15.167:0/1116828832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910c1b9a70 con 0x55910c1b90c0 2024-09-18T02:04:15.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7f00bf9cd640 1 --2- 172.21.15.167:0/1116828832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 0x55910c1b94a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f00b00c9000 tx=0x7f00b00d0af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3c2bc8f1d10fa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7eff9effd640 1 -- 172.21.15.167:0/1116828832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00c7830 con 0x55910c1b90c0 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7eff9effd640 1 -- 172.21.15.167:0/1116828832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b00f1070 con 0x55910c1b90c0 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.376+0000 7eff9effd640 1 -- 172.21.15.167:0/1116828832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00b4e20 con 0x55910c1b90c0 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 -- 172.21.15.167:0/1116828832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 msgr2=0x55910c1b94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/1116828832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 0x55910c1b94a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f00b00c9000 tx=0x7f00b00d0af0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 -- 172.21.15.167:0/1116828832 shutdown_connections 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/1116828832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 0x55910c1b94a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 -- 172.21.15.167:0/1116828832 >> 172.21.15.167:0/1116828832 conn(0x55910c1b54a0 msgr2=0x55910c1b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 -- 172.21.15.167:0/1116828832 shutdown_connections 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 -- 172.21.15.167:0/1116828832 wait complete. 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 Processor -- start 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 -- start start 2024-09-18T02:04:15.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 0x55910c1c0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55910c1b9f10 con 0x55910c1b90c0 2024-09-18T02:04:15.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00bf9cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 0x55910c1c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00bf9cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 0x55910c1c0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60580/0 (socket says 172.21.15.167:60580) 2024-09-18T02:04:15.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 learned_addr learned my addr 172.21.15.167:0/2519528042 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910c1c07c0 con 0x55910c1b90c0 2024-09-18T02:04:15.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00bf9cd640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 0x55910c1c0280 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f00b00c8d40 tx=0x7f00b00b1e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7eff9d7fa640 1 -- 172.21.15.167:0/2519528042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0106070 con 0x55910c1b90c0 2024-09-18T02:04:15.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55910c1c07c0 con 0x55910c1b90c0 2024-09-18T02:04:15.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55910c1c07c0 con 0x55910c1b90c0 2024-09-18T02:04:15.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7eff9d7fa640 1 -- 172.21.15.167:0/2519528042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b00e04d0 con 0x55910c1b90c0 2024-09-18T02:04:15.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7eff9d7fa640 1 -- 172.21.15.167:0/2519528042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0110060 con 0x55910c1b90c0 2024-09-18T02:04:15.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7eff9d7fa640 1 -- 172.21.15.167:0/2519528042 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00b0109070 con 0x55910c1b90c0 2024-09-18T02:04:15.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.380+0000 7eff9d7fa640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff880346a0 0x7eff88036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7eff9d7fa640 1 -- 172.21.15.167:0/2519528042 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f00b00fd030 con 0x55910c1b90c0 2024-09-18T02:04:15.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00bf1cc640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff880346a0 0x7eff88036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55910c1cb300 0x55910c1cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cdf10 con 0x55910c1cb300 2024-09-18T02:04:15.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c01ce640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55910c1cb300 0x55910c1cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00bf1cc640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff880346a0 0x7eff88036b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00b400ffd0 tx=0x7f00b4023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c01ce640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55910c1cb300 0x55910c1cd7c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b80083f0 con 0x55910c1cb300 2024-09-18T02:04:15.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 20 realm 2024-09-18T02:04:15.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ce320 con 0x55910c1cb300 2024-09-18T02:04:15.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b80083f0 con 0x55910c1cb300 2024-09-18T02:04:15.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:15.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cebc0 con 0x55910c1cb300 2024-09-18T02:04:15.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b80083f0 con 0x55910c1cb300 2024-09-18T02:04:15.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cb300 2024-09-18T02:04:15.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00b80083f0 con 0x55910c1cb300 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55910c1cfcc0 0x55910c1d20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d2750 con 0x55910c1cfcc0 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00bf9cd640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55910c1cfcc0 0x55910c1d20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00bf9cd640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55910c1cfcc0 0x55910c1d20b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 20 searching for the correct realm 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55910c1d4630 0x55910c1d6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d7120 con 0x55910c1d4630 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.384+0000 7f00bf1cc640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55910c1d4630 0x55910c1d6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00bf1cc640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55910c1d4630 0x55910c1d6aa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00bf1cc640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00b401f940 0x7f00b403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d7120 con 0x7f00b401f940 2024-09-18T02:04:15.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00c01ce640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00b401f940 0x7f00b403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00c01ce640 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00b401f940 0x7f00b403a3c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b80083f0 con 0x7f00b401f940 2024-09-18T02:04:15.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cfcc0 2024-09-18T02:04:15.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cb300 2024-09-18T02:04:15.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b80083f0 con 0x55910c1cb300 2024-09-18T02:04:15.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cb300 2024-09-18T02:04:15.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cfcc0 2024-09-18T02:04:15.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.388+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cfcc0 2024-09-18T02:04:15.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x7f00b401f940 2024-09-18T02:04:15.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1d4630 2024-09-18T02:04:15.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cb300 2024-09-18T02:04:15.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cfcc0 2024-09-18T02:04:15.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cb300 2024-09-18T02:04:15.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x7f00b401f940 2024-09-18T02:04:15.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1d4630 2024-09-18T02:04:15.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1d4630 2024-09-18T02:04:15.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cfcc0 2024-09-18T02:04:15.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.392+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1d4630 2024-09-18T02:04:15.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1d4630 2024-09-18T02:04:15.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cb300 2024-09-18T02:04:15.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cb300 2024-09-18T02:04:15.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cfcc0 2024-09-18T02:04:15.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1d4630 2024-09-18T02:04:15.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x7f00b401f940 2024-09-18T02:04:15.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cb300 2024-09-18T02:04:15.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cfcc0 2024-09-18T02:04:15.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1d4630 2024-09-18T02:04:15.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.396+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cfcc0 2024-09-18T02:04:15.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x7f00b401f940 2024-09-18T02:04:15.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1d4630 2024-09-18T02:04:15.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cfcc0 2024-09-18T02:04:15.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x55910c1cb300 2024-09-18T02:04:15.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55910c1cef60 con 0x7f00b401f940 2024-09-18T02:04:15.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:15.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d2fa0 con 0x55910c1cb300 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d2fa0 con 0x55910c1cb300 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:15.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d2fa0 con 0x55910c1d4630 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 zone default found 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 4 Realm: () 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 zonegroup default 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.400+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d3910 con 0x55910c1cfcc0 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d8fe0 con 0x55910c1d4630 2024-09-18T02:04:15.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d9490 con 0x55910c1d4630 2024-09-18T02:04:15.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 20 started sync module instance, tier type = 2024-09-18T02:04:15.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:15.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d8420 con 0x7f00b401f940 2024-09-18T02:04:15.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94081461881152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d8420 con 0x7f00b401f940 2024-09-18T02:04:15.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.404+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d9f50 con 0x55910c1cb300 2024-09-18T02:04:15.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.408+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94081461881152] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.408+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.408+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94081461885536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d8420 con 0x55910c1cb300 2024-09-18T02:04:15.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.408+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1da990 con 0x55910c1d4630 2024-09-18T02:04:15.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.408+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.408+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94081461888224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1db1e0 con 0x55910c1d4630 2024-09-18T02:04:15.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.408+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1dbbe0 con 0x7f00b401f940 2024-09-18T02:04:15.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.408+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94081461885536] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.412+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.412+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94081461878640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1dc000 con 0x7f00b401f940 2024-09-18T02:04:15.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.412+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1dc9c0 con 0x55910c1cb300 2024-09-18T02:04:15.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.412+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94081461888224] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.412+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.412+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94081461890352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1dc9c0 con 0x55910c1cb300 2024-09-18T02:04:15.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.412+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1dd270 con 0x55910c1cfcc0 2024-09-18T02:04:15.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.416+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94081461878640] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.416+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.416+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94081461897664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1dcde0 con 0x55910c1cfcc0 2024-09-18T02:04:15.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.416+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ddfc0 con 0x55910c1cfcc0 2024-09-18T02:04:15.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.416+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94081461890352] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.416+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94081461897664] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.416+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.416+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94081461900816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ddee0 con 0x55910c1cfcc0 2024-09-18T02:04:15.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.416+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1de7b0 con 0x55910c1cfcc0 2024-09-18T02:04:15.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94081461900816] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94081461901872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1de300 con 0x55910c1cfcc0 2024-09-18T02:04:15.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 20 add_watcher() i=0 2024-09-18T02:04:15.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 20 add_watcher() i=1 2024-09-18T02:04:15.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 20 add_watcher() i=2 2024-09-18T02:04:15.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 20 add_watcher() i=3 2024-09-18T02:04:15.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 20 add_watcher() i=4 2024-09-18T02:04:15.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 20 add_watcher() i=5 2024-09-18T02:04:15.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 20 add_watcher() i=6 2024-09-18T02:04:15.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94081461901872] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 20 add_watcher() i=7 2024-09-18T02:04:15.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:15.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1e1c60 con 0x55910c1cb300 2024-09-18T02:04:15.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.420+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94081461903392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1df150 con 0x55910c1cb300 2024-09-18T02:04:15.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.424+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94081461903392] v30'37 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.424+0000 7eff75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:15.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.424+0000 7f00c1ebd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:15.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.424+0000 7f00c1ebd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:15.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.424+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1e1950 con 0x55910c1cb300 2024-09-18T02:04:15.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.424+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'41 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.424+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1eacb0 con 0x55910c1cfcc0 2024-09-18T02:04:15.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.428+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.428+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1eacb0 con 0x55910c1d4630 2024-09-18T02:04:15.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.428+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.428+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1eb750 con 0x55910c1cb300 2024-09-18T02:04:15.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.432+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.432+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ea320 con 0x7f00b401f940 2024-09-18T02:04:15.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.432+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.432+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ea320 con 0x55910c1d4630 2024-09-18T02:04:15.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.436+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.436+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ec480 con 0x55910c1cb300 2024-09-18T02:04:15.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.436+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.436+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ec480 con 0x55910c1cfcc0 2024-09-18T02:04:15.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.440+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.440+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ec480 con 0x7f00b401f940 2024-09-18T02:04:15.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.440+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.440+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ec480 con 0x55910c1d4630 2024-09-18T02:04:15.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.444+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.444+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1eca10 con 0x7f00b401f940 2024-09-18T02:04:15.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.444+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.444+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ec9c0 con 0x55910c1cfcc0 2024-09-18T02:04:15.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.448+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.448+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ec9c0 con 0x7f00b401f940 2024-09-18T02:04:15.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.448+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.448+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ec9c0 con 0x55910c1cfcc0 2024-09-18T02:04:15.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.452+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'35 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.452+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ec9c0 con 0x55910c1cb300 2024-09-18T02:04:15.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.452+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'39 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.452+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ec9c0 con 0x55910c1d4630 2024-09-18T02:04:15.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.456+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.456+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ec9c0 con 0x7f00b401f940 2024-09-18T02:04:15.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.460+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.460+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ec9c0 con 0x55910c1d4630 2024-09-18T02:04:15.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.460+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.460+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1eca50 con 0x55910c1cb300 2024-09-18T02:04:15.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.464+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.464+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1eca50 con 0x55910c1cb300 2024-09-18T02:04:15.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.464+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'40 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.464+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1eca50 con 0x55910c1d4630 2024-09-18T02:04:15.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.468+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.468+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ecb00 con 0x7f00b401f940 2024-09-18T02:04:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.468+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.468+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ecb00 con 0x55910c1d4630 2024-09-18T02:04:15.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.472+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.472+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ecb00 con 0x55910c1d4630 2024-09-18T02:04:15.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.472+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.472+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ecb00 con 0x55910c1d4630 2024-09-18T02:04:15.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.476+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.476+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ecb00 con 0x55910c1d4630 2024-09-18T02:04:15.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.476+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.476+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ecb00 con 0x55910c1cfcc0 2024-09-18T02:04:15.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.480+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.480+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ecb00 con 0x55910c1d4630 2024-09-18T02:04:15.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.480+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.484+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ecb00 con 0x55910c1cfcc0 2024-09-18T02:04:15.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.484+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.484+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ecb00 con 0x55910c1d4630 2024-09-18T02:04:15.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.488+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.488+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ecb00 con 0x55910c1cfcc0 2024-09-18T02:04:15.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.492+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.492+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ecb00 con 0x7f00b401f940 2024-09-18T02:04:15.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.492+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.492+0000 7eff74fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:15.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.492+0000 7f00c1ebd980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:15.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.492+0000 7f00c1ebd980 20 Filter name: none 2024-09-18T02:04:15.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.496+0000 7efeee7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:15.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.496+0000 7f00c1ebd980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-18T02:04:15.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.496+0000 7f00c1ebd980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.496+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55910c1e9820 con 0x55910c1cfcc0 2024-09-18T02:04:15.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.496+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.496+0000 7f00c1ebd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.496+0000 7f00c1ebd980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-18T02:04:15.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.496+0000 7f00c1ebd980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T02:04:15.499 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T02:04:15.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.496+0000 7eff75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:15.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.496+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94081461903392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1e8320 con 0x55910c1cb300 2024-09-18T02:04:15.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.500+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94081461903392] v30'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.500+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94081461881152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1ddff0 con 0x7f00b401f940 2024-09-18T02:04:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.500+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94081461881152] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.500+0000 7f00c1ebd980 20 remove_watcher() i=0 2024-09-18T02:04:15.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.500+0000 7f00c1ebd980 2 removed watcher, disabling cache 2024-09-18T02:04:15.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.500+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94081461885536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d8920 con 0x55910c1cb300 2024-09-18T02:04:15.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.504+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94081461885536] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.504+0000 7f00c1ebd980 20 remove_watcher() i=1 2024-09-18T02:04:15.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.504+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94081461888224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d9a60 con 0x55910c1d4630 2024-09-18T02:04:15.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.504+0000 7f00bf1cc640 1 -- 172.21.15.167:0/2519528042 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94081461888224] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4037040 con 0x55910c1d4630 2024-09-18T02:04:15.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.504+0000 7f00c1ebd980 20 remove_watcher() i=2 2024-09-18T02:04:15.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.504+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94081461878640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d9a60 con 0x7f00b401f940 2024-09-18T02:04:15.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.508+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94081461878640] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x7f00b401f940 2024-09-18T02:04:15.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.508+0000 7f00c1ebd980 20 remove_watcher() i=3 2024-09-18T02:04:15.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.508+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94081461890352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d9a60 con 0x55910c1cb300 2024-09-18T02:04:15.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.508+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94081461890352] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b8026040 con 0x55910c1cb300 2024-09-18T02:04:15.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.508+0000 7f00c1ebd980 20 remove_watcher() i=4 2024-09-18T02:04:15.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.508+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94081461897664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1dad30 con 0x55910c1cfcc0 2024-09-18T02:04:15.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.512+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94081461897664] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.512+0000 7f00c1ebd980 20 remove_watcher() i=5 2024-09-18T02:04:15.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.512+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94081461900816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1d9a60 con 0x55910c1cfcc0 2024-09-18T02:04:15.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.512+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94081461900816] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.512+0000 7f00c1ebd980 20 remove_watcher() i=6 2024-09-18T02:04:15.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.512+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94081461901872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55910c1dc9c0 con 0x55910c1cfcc0 2024-09-18T02:04:15.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00bf9cd640 1 -- 172.21.15.167:0/2519528042 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94081461901872] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0108030 con 0x55910c1cfcc0 2024-09-18T02:04:15.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 20 remove_watcher() i=7 2024-09-18T02:04:15.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55910c1cfcc0 msgr2=0x55910c1d20b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55910c1cfcc0 0x55910c1d20b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55910c1cb300 msgr2=0x55910c1cd7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55910c1cb300 0x55910c1cd7c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00b401f940 msgr2=0x7f00b403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00b401f940 0x7f00b403a3c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55910c1d4630 msgr2=0x55910c1d6aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55910c1d4630 0x55910c1d6aa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff880346a0 msgr2=0x7eff88036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff880346a0 0x7eff88036b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00b400ffd0 tx=0x7f00b4023040 comp rx=0 tx=0).stop 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 msgr2=0x55910c1c0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2519528042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1b90c0 0x55910c1c0280 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f00b00c8d40 tx=0x7f00b00b1e70 comp rx=0 tx=0).stop 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 reap_dead start 2024-09-18T02:04:15.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c01ce640 1 -- 172.21.15.167:0/2519528042 reap_dead start 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 shutdown_connections 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 >> 172.21.15.167:0/2519528042 conn(0x55910c1b54a0 msgr2=0x55910c1b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 shutdown_connections 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2519528042 wait complete. 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/4245389419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 msgr2=0x7eff98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/4245389419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 0x7eff98036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55910c19f140 tx=0x7f00b4006000 comp rx=0 tx=0).stop 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/4245389419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1ac7d0 msgr2=0x55910c1acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/4245389419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1ac7d0 0x55910c1acbf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f00b0008030 tx=0x7f00b00a9720 comp rx=0 tx=0).stop 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/4245389419 shutdown_connections 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/4245389419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 0x7eff98036b10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/4245389419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c1ac7d0 0x55910c1acbf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/4245389419 >> 172.21.15.167:0/4245389419 conn(0x55910c1a1920 msgr2=0x55910c1a43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/4245389419 shutdown_connections 2024-09-18T02:04:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/4245389419 wait complete. 2024-09-18T02:04:15.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55910c1982c0 msgr2=0x55910c19a6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55910c1982c0 0x55910c19a6b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55910c09f8e0 msgr2=0x55910c195940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55910c09f8e0 0x55910c195940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55910c19c1c0 msgr2=0x55910c19e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55910c19c1c0 0x55910c19e5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effa80346a0 msgr2=0x7effa8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effa80346a0 0x7effa8036b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f00b4000c10 tx=0x7f00b40013c0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 msgr2=0x55910c18e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 --2- 172.21.15.167:0/2669313515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55910c011290 0x55910c18e9b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00b0005cc0 tx=0x7f00b0017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c01ce640 1 -- 172.21.15.167:0/2669313515 reap_dead start 2024-09-18T02:04:15.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 shutdown_connections 2024-09-18T02:04:15.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 >> 172.21.15.167:0/2669313515 conn(0x55910c097090 msgr2=0x55910c181f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 shutdown_connections 2024-09-18T02:04:15.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.516+0000 7f00c1ebd980 1 -- 172.21.15.167:0/2669313515 wait complete. 2024-09-18T02:04:15.533 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T02:04:15.533 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-18T02:04:15.533 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-18T02:04:15.533 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-18T02:04:15.613 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:15.614 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:15.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.612+0000 7ff2e0592980 1 Processor -- start 2024-09-18T02:04:15.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.612+0000 7ff2e0592980 1 -- start start 2024-09-18T02:04:15.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.612+0000 7ff2e0592980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x560507b4d3b0 0x560507b4bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.612+0000 7ff2e0592980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560507a5eae0 con 0x560507b4d7c0 2024-09-18T02:04:15.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.612+0000 7ff2e0592980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x560507a82e30 con 0x560507b4d3b0 2024-09-18T02:04:15.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.612+0000 7ff2de0a2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x560507b4d3b0 0x560507b4bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.612+0000 7ff2dd8a1640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x560507b4d7c0 0x560507b4c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:34532/0 (socket says 172.21.15.167:34532) 2024-09-18T02:04:15.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.612+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/4142859425 learned_addr learned my addr 172.21.15.167:0/4142859425 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:15.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.612+0000 7ff2de0a2640 1 -- 172.21.15.167:0/4142859425 >> v1:172.21.15.81:6789/0 conn(0x560507b4d7c0 legacy=0x560507b4c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.612+0000 7ff2de0a2640 1 -- 172.21.15.167:0/4142859425 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560507b4c8e0 con 0x560507b4d3b0 2024-09-18T02:04:15.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.616+0000 7ff2de0a2640 1 --2- 172.21.15.167:0/4142859425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507b4bb70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000a480 tx=0x7ff2d001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb495beb2d57f64 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.616+0000 7ff2dd0a0640 1 -- 172.21.15.167:0/4142859425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00b0070 con 0x560507b4d3b0 2024-09-18T02:04:15.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.616+0000 7ff2dd0a0640 1 -- 172.21.15.167:0/4142859425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d00ab540 con 0x560507b4d3b0 2024-09-18T02:04:15.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.616+0000 7ff2dd0a0640 1 -- 172.21.15.167:0/4142859425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00ab840 con 0x560507b4d3b0 2024-09-18T02:04:15.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.616+0000 7ff2e0592980 1 -- 172.21.15.167:0/4142859425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 msgr2=0x560507b4bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.616+0000 7ff2e0592980 1 --2- 172.21.15.167:0/4142859425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507b4bb70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000a480 tx=0x7ff2d001b280 comp rx=0 tx=0).stop 2024-09-18T02:04:15.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.616+0000 7ff2e0592980 1 -- 172.21.15.167:0/4142859425 shutdown_connections 2024-09-18T02:04:15.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.616+0000 7ff2e0592980 1 --2- 172.21.15.167:0/4142859425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507b4bb70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.616+0000 7ff2e0592980 1 -- 172.21.15.167:0/4142859425 >> 172.21.15.167:0/4142859425 conn(0x560507bd2180 msgr2=0x560507bd45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.616+0000 7ff2e0592980 1 -- 172.21.15.167:0/4142859425 shutdown_connections 2024-09-18T02:04:15.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.616+0000 7ff2e0592980 1 -- 172.21.15.167:0/4142859425 wait complete. 2024-09-18T02:04:15.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.632+0000 7ff2e0592980 1 Processor -- start 2024-09-18T02:04:15.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.632+0000 7ff2e0592980 1 -- start start 2024-09-18T02:04:15.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.632+0000 7ff2e0592980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507cc3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.632+0000 7ff2e0592980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560507a84200 con 0x560507b4d3b0 2024-09-18T02:04:15.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.632+0000 7ff2de0a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507cc3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.632+0000 7ff2de0a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507cc3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60606/0 (socket says 172.21.15.167:60606) 2024-09-18T02:04:15.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.632+0000 7ff2de0a2640 1 -- 172.21.15.167:0/348323761 learned_addr learned my addr 172.21.15.167:0/348323761 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2de0a2640 1 -- 172.21.15.167:0/348323761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560507cc4240 con 0x560507b4d3b0 2024-09-18T02:04:15.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2de0a2640 1 --2- 172.21.15.167:0/348323761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507cc3c70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0017e90 tx=0x7ff2d0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ea94e440020ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff1cc608640 1 -- 172.21.15.167:0/348323761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00b0040 con 0x560507b4d3b0 2024-09-18T02:04:15.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff1cc608640 1 -- 172.21.15.167:0/348323761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d00ab9d0 con 0x560507b4d3b0 2024-09-18T02:04:15.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff1cc608640 1 -- 172.21.15.167:0/348323761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00abcf0 con 0x560507b4d3b0 2024-09-18T02:04:15.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2e0592980 1 -- 172.21.15.167:0/348323761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 msgr2=0x560507cc3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2e0592980 1 --2- 172.21.15.167:0/348323761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507cc3c70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0017e90 tx=0x7ff2d0003030 comp rx=0 tx=0).stop 2024-09-18T02:04:15.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2e0592980 1 -- 172.21.15.167:0/348323761 shutdown_connections 2024-09-18T02:04:15.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2e0592980 1 --2- 172.21.15.167:0/348323761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507cc3c70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2e0592980 1 -- 172.21.15.167:0/348323761 >> 172.21.15.167:0/348323761 conn(0x560507bd2180 msgr2=0x560507cbf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2e0592980 1 -- 172.21.15.167:0/348323761 shutdown_connections 2024-09-18T02:04:15.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2e0592980 1 -- 172.21.15.167:0/348323761 wait complete. 2024-09-18T02:04:15.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2e0592980 1 Processor -- start 2024-09-18T02:04:15.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2e0592980 1 -- start start 2024-09-18T02:04:15.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2e0592980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507ccaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2e0592980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560507be21d0 con 0x560507b4d3b0 2024-09-18T02:04:15.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2de0a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507ccaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2de0a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507ccaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60612/0 (socket says 172.21.15.167:60612) 2024-09-18T02:04:15.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2de0a2640 1 -- 172.21.15.167:0/316496371 learned_addr learned my addr 172.21.15.167:0/316496371 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2de0a2640 1 -- 172.21.15.167:0/316496371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560507ccb400 con 0x560507b4d3b0 2024-09-18T02:04:15.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff2de0a2640 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507ccaec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0019930 tx=0x7ff2d0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.636+0000 7ff1cae05640 1 -- 172.21.15.167:0/316496371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00b0070 con 0x560507b4d3b0 2024-09-18T02:04:15.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff1cae05640 1 -- 172.21.15.167:0/316496371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d00b6d80 con 0x560507b4d3b0 2024-09-18T02:04:15.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff1cae05640 1 -- 172.21.15.167:0/316496371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00c8590 con 0x560507b4d3b0 2024-09-18T02:04:15.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560507ccb690 con 0x560507b4d3b0 2024-09-18T02:04:15.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560507cce370 con 0x560507b4d3b0 2024-09-18T02:04:15.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff1cae05640 1 -- 172.21.15.167:0/316496371 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff2d00bf410 con 0x560507b4d3b0 2024-09-18T02:04:15.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff1cae05640 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1c4034650 0x7ff1c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff1cae05640 1 -- 172.21.15.167:0/316496371 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff2d00a8070 con 0x560507b4d3b0 2024-09-18T02:04:15.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2dd8a1640 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1c4034650 0x7ff1c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2e0592980 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560507b4d7c0 0x560507cd1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507cd2500 con 0x560507b4d7c0 2024-09-18T02:04:15.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2de8a3640 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560507b4d7c0 0x560507cd1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2dd8a1640 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1c4034650 0x7ff1c4036b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4000f70 tx=0x7ff2d40012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2de8a3640 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560507b4d7c0 0x560507cd1fc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2de8a3640 1 -- 172.21.15.167:0/316496371 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507b4d7c0 2024-09-18T02:04:15.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507ccf570 con 0x560507b4d7c0 2024-09-18T02:04:15.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2de8a3640 1 -- 172.21.15.167:0/316496371 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507b4d7c0 2024-09-18T02:04:15.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2e0592980 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560507cd4820 0x560507cd6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507cd7300 con 0x560507cd4820 2024-09-18T02:04:15.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.640+0000 7ff2de0a2640 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560507cd4820 0x560507cd6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2de0a2640 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560507cd4820 0x560507cd6c10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2de0a2640 1 -- 172.21.15.167:0/316496371 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507cd4820 2024-09-18T02:04:15.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507cd36c0 con 0x560507b4d7c0 2024-09-18T02:04:15.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2de8a3640 1 -- 172.21.15.167:0/316496371 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507b4d7c0 2024-09-18T02:04:15.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2e0592980 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560507cd8760 0x560507cdab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507cdb290 con 0x560507cd8760 2024-09-18T02:04:15.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2dd8a1640 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560507cd8760 0x560507cdab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2dd8a1640 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560507cd8760 0x560507cdab50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/316496371 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff2d400e620 con 0x560507cd8760 2024-09-18T02:04:15.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2e0592980 1 Processor -- start 2024-09-18T02:04:15.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2e0592980 1 -- start start 2024-09-18T02:04:15.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2e0592980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507ce8d60 0x560507ce9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2e0592980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560507add800 con 0x560507ce8d60 2024-09-18T02:04:15.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2de0a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507ce8d60 0x560507ce9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2de0a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507ce8d60 0x560507ce9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60616/0 (socket says 172.21.15.167:60616) 2024-09-18T02:04:15.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2de0a2640 1 -- 172.21.15.167:0/1824033613 learned_addr learned my addr 172.21.15.167:0/1824033613 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2de0a2640 1 -- 172.21.15.167:0/1824033613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560507ce96c0 con 0x560507ce8d60 2024-09-18T02:04:15.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.644+0000 7ff2de0a2640 1 --2- 172.21.15.167:0/1824033613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507ce8d60 0x560507ce9180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00b6850 tx=0x7ff2d00d8390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff1c3fff640 1 -- 172.21.15.167:0/1824033613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00d0b70 con 0x560507ce8d60 2024-09-18T02:04:15.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff1c3fff640 1 -- 172.21.15.167:0/1824033613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d00d0d10 con 0x560507ce8d60 2024-09-18T02:04:15.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2e0592980 1 -- 172.21.15.167:0/1824033613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560507ce9950 con 0x560507ce8d60 2024-09-18T02:04:15.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff1c3fff640 1 -- 172.21.15.167:0/1824033613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00d03a0 con 0x560507ce8d60 2024-09-18T02:04:15.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2e0592980 1 -- 172.21.15.167:0/1824033613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560507cec5d0 con 0x560507ce8d60 2024-09-18T02:04:15.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff1c3fff640 1 -- 172.21.15.167:0/1824033613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff2d00eb060 con 0x560507ce8d60 2024-09-18T02:04:15.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff1c3fff640 1 --2- 172.21.15.167:0/1824033613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1b80346a0 0x7ff1b8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff1c3fff640 1 -- 172.21.15.167:0/1824033613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff2d00e0070 con 0x560507ce8d60 2024-09-18T02:04:15.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2dd8a1640 1 --2- 172.21.15.167:0/1824033613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1b80346a0 0x7ff1b8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2e0592980 1 Processor -- start 2024-09-18T02:04:15.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2e0592980 1 -- start start 2024-09-18T02:04:15.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2dd8a1640 1 --2- 172.21.15.167:0/1824033613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1b80346a0 0x7ff1b8036b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400bf60 tx=0x7ff2d400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2e0592980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cf5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2e0592980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560507cc45c0 con 0x560507cf5610 2024-09-18T02:04:15.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2de0a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cf5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2de0a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cf5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60630/0 (socket says 172.21.15.167:60630) 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2de0a2640 1 -- 172.21.15.167:0/3341910400 learned_addr learned my addr 172.21.15.167:0/3341910400 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2de0a2640 1 -- 172.21.15.167:0/3341910400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560507cf5fe0 con 0x560507cf5610 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff2de0a2640 1 --2- 172.21.15.167:0/3341910400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cf5a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00defd0 tx=0x7ff2d00d9170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4de0626c5573786 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff1c1ffb640 1 -- 172.21.15.167:0/3341910400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00e4530 con 0x560507cf5610 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff1c1ffb640 1 -- 172.21.15.167:0/3341910400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d00fd070 con 0x560507cf5610 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.648+0000 7ff1c1ffb640 1 -- 172.21.15.167:0/3341910400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00e4a50 con 0x560507cf5610 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 -- 172.21.15.167:0/3341910400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 msgr2=0x560507cf5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 --2- 172.21.15.167:0/3341910400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cf5a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00defd0 tx=0x7ff2d00d9170 comp rx=0 tx=0).stop 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 -- 172.21.15.167:0/3341910400 shutdown_connections 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 --2- 172.21.15.167:0/3341910400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cf5a10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 -- 172.21.15.167:0/3341910400 >> 172.21.15.167:0/3341910400 conn(0x560507cf1a80 msgr2=0x560507cefb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 -- 172.21.15.167:0/3341910400 shutdown_connections 2024-09-18T02:04:15.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 -- 172.21.15.167:0/3341910400 wait complete. 2024-09-18T02:04:15.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 Processor -- start 2024-09-18T02:04:15.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 -- start start 2024-09-18T02:04:15.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cfc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560507cf5fe0 con 0x560507cf5610 2024-09-18T02:04:15.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2de0a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cfc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2de0a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cfc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60638/0 (socket says 172.21.15.167:60638) 2024-09-18T02:04:15.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 learned_addr learned my addr 172.21.15.167:0/439917475 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560507cfcc00 con 0x560507cf5610 2024-09-18T02:04:15.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2de0a2640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cfc6c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00fa040 tx=0x7ff2d00dee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff1affff640 1 -- 172.21.15.167:0/439917475 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00b5e10 con 0x560507cf5610 2024-09-18T02:04:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560507cfcc00 con 0x560507cf5610 2024-09-18T02:04:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff1affff640 1 -- 172.21.15.167:0/439917475 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d00eeb60 con 0x560507cf5610 2024-09-18T02:04:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560507cfcc00 con 0x560507cf5610 2024-09-18T02:04:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff1affff640 1 -- 172.21.15.167:0/439917475 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d00eee40 con 0x560507cf5610 2024-09-18T02:04:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff1affff640 1 -- 172.21.15.167:0/439917475 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff2d0113060 con 0x560507cf5610 2024-09-18T02:04:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff1affff640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1a8034650 0x7ff1a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.652+0000 7ff1affff640 1 -- 172.21.15.167:0/439917475 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff2d00f3070 con 0x560507cf5610 2024-09-18T02:04:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2dd8a1640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1a8034650 0x7ff1a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560507d07660 0x560507d09b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d0a270 con 0x560507d07660 2024-09-18T02:04:15.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2de8a3640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560507d07660 0x560507d09b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2dd8a1640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1a8034650 0x7ff1a8036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x560507cd29c0 tx=0x7ff2d4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2de8a3640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560507d07660 0x560507d09b20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 realm 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d0a680 con 0x560507d07660 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d0af50 con 0x560507d07660 2024-09-18T02:04:15.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d07660 2024-09-18T02:04:15.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:15.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560507d0c050 0x560507d0e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d0ea50 con 0x560507d0c050 2024-09-18T02:04:15.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2de0a2640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560507d0c050 0x560507d0e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2de0a2640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560507d0c050 0x560507d0e440 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:15.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 20 searching for the correct realm 2024-09-18T02:04:15.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560507d109a0 0x560507d12db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.656+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d13480 con 0x560507d109a0 2024-09-18T02:04:15.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2dd8a1640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560507d109a0 0x560507d12db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2dd8a1640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560507d109a0 0x560507d12db0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2dd8a1640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff2d4037040 0x7ff2d4036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d13480 con 0x7ff2d4037040 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de8a3640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff2d4037040 0x7ff2d4036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de8a3640 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff2d4037040 0x7ff2d4036410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d0c050 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d07660 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d07660 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d0c050 2024-09-18T02:04:15.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d0c050 2024-09-18T02:04:15.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.660+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x7ff2d4037040 2024-09-18T02:04:15.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d109a0 2024-09-18T02:04:15.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d07660 2024-09-18T02:04:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d0c050 2024-09-18T02:04:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d07660 2024-09-18T02:04:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x7ff2d4037040 2024-09-18T02:04:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d109a0 2024-09-18T02:04:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d109a0 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d0c050 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d109a0 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.664+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d109a0 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d07660 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d07660 2024-09-18T02:04:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d0c050 2024-09-18T02:04:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d109a0 2024-09-18T02:04:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x7ff2d4037040 2024-09-18T02:04:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d07660 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d0c050 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d109a0 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d0c050 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x7ff2d4037040 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.668+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d109a0 2024-09-18T02:04:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d0c050 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x560507d07660 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560507d0b2f0 con 0x7ff2d4037040 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d0f310 con 0x560507d07660 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d0f310 con 0x560507d07660 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d0f310 con 0x560507d109a0 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 zone default found 2024-09-18T02:04:15.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 4 Realm: () 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 zonegroup default 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d0fc40 con 0x560507d0c050 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d15310 con 0x560507d109a0 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d15820 con 0x560507d109a0 2024-09-18T02:04:15.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 started sync module instance, tier type = 2024-09-18T02:04:15.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:15.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.672+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d14780 con 0x7ff2d4037040 2024-09-18T02:04:15.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.676+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.676+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94579605982368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d14780 con 0x7ff2d4037040 2024-09-18T02:04:15.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.676+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d16310 con 0x560507d07660 2024-09-18T02:04:15.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.676+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94579605982368] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.676+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.676+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94579605986848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d14780 con 0x560507d07660 2024-09-18T02:04:15.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.676+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d16d50 con 0x560507d109a0 2024-09-18T02:04:15.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.680+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94579605986848] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.680+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.680+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94579605979856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d146f0 con 0x560507d109a0 2024-09-18T02:04:15.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.680+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d17aa0 con 0x7ff2d4037040 2024-09-18T02:04:15.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.680+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.680+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94579605993216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d18190 con 0x7ff2d4037040 2024-09-18T02:04:15.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.680+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d18cb0 con 0x560507d07660 2024-09-18T02:04:15.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.684+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94579605979856] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.684+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94579605993216] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.684+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.684+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94579605997440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d18c70 con 0x560507d07660 2024-09-18T02:04:15.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.684+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d190a0 con 0x560507d0c050 2024-09-18T02:04:15.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.684+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94579605997440] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.688+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.688+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94579605991744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d19490 con 0x560507d0c050 2024-09-18T02:04:15.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.688+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d19e50 con 0x560507d0c050 2024-09-18T02:04:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.688+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.688+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94579606004208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d1aac0 con 0x560507d0c050 2024-09-18T02:04:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.688+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d1b480 con 0x560507d0c050 2024-09-18T02:04:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.688+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94579605991744] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94579606004208] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94579605994464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d1b480 con 0x560507d0c050 2024-09-18T02:04:15.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 20 add_watcher() i=0 2024-09-18T02:04:15.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 20 add_watcher() i=1 2024-09-18T02:04:15.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 20 add_watcher() i=2 2024-09-18T02:04:15.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 20 add_watcher() i=3 2024-09-18T02:04:15.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 20 add_watcher() i=4 2024-09-18T02:04:15.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 20 add_watcher() i=5 2024-09-18T02:04:15.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 20 add_watcher() i=6 2024-09-18T02:04:15.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94579605994464] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 20 add_watcher() i=7 2024-09-18T02:04:15.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:15.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d1e8a0 con 0x560507d07660 2024-09-18T02:04:15.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.692+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94579606007760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d1bd20 con 0x560507d07660 2024-09-18T02:04:15.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.696+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94579606007760] v30'42 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.696+0000 7ff194fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.696+0000 7ff2e0592980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.696+0000 7ff2e0592980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.696+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d27070 con 0x560507d07660 2024-09-18T02:04:15.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.696+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'42 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.696+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d27740 con 0x560507d0c050 2024-09-18T02:04:15.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.700+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'18 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.700+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d27740 con 0x560507d109a0 2024-09-18T02:04:15.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.700+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.700+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d27d30 con 0x560507d07660 2024-09-18T02:04:15.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.700+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.700+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d281e0 con 0x7ff2d4037040 2024-09-18T02:04:15.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.704+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.704+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d24eb0 con 0x560507d109a0 2024-09-18T02:04:15.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.704+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.704+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d24eb0 con 0x560507d07660 2024-09-18T02:04:15.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.704+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.704+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d28d40 con 0x560507d0c050 2024-09-18T02:04:15.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.708+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.708+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d28d40 con 0x7ff2d4037040 2024-09-18T02:04:15.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.708+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.708+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d28d40 con 0x560507d109a0 2024-09-18T02:04:15.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.712+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.712+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29140 con 0x7ff2d4037040 2024-09-18T02:04:15.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.712+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.712+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29140 con 0x560507d0c050 2024-09-18T02:04:15.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.716+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.716+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d291d0 con 0x7ff2d4037040 2024-09-18T02:04:15.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.716+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.716+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d291d0 con 0x560507d0c050 2024-09-18T02:04:15.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.716+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'37 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.716+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29260 con 0x560507d07660 2024-09-18T02:04:15.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.720+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'44 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.720+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29260 con 0x560507d109a0 2024-09-18T02:04:15.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.720+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.720+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d292f0 con 0x7ff2d4037040 2024-09-18T02:04:15.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.724+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.724+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d292f0 con 0x560507d109a0 2024-09-18T02:04:15.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.724+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.724+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d294c0 con 0x560507d07660 2024-09-18T02:04:15.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.724+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.728+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d294c0 con 0x560507d07660 2024-09-18T02:04:15.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.728+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'45 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.728+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x560507d109a0 2024-09-18T02:04:15.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.728+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.728+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x7ff2d4037040 2024-09-18T02:04:15.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.732+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.732+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x560507d109a0 2024-09-18T02:04:15.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.732+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.732+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x560507d109a0 2024-09-18T02:04:15.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.732+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.732+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x560507d109a0 2024-09-18T02:04:15.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.736+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.736+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x560507d109a0 2024-09-18T02:04:15.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.736+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'30 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.736+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x560507d0c050 2024-09-18T02:04:15.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.740+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.740+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x560507d109a0 2024-09-18T02:04:15.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.740+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.740+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x560507d0c050 2024-09-18T02:04:15.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.744+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.744+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x560507d109a0 2024-09-18T02:04:15.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.744+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.744+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x560507d0c050 2024-09-18T02:04:15.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.748+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'38 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.748+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d29940 con 0x7ff2d4037040 2024-09-18T02:04:15.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.748+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.748+0000 7ff10f7fe640 20 reqs_thread_entry: start 2024-09-18T02:04:15.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.748+0000 7ff2e0592980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:15.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.748+0000 7ff2e0592980 20 Filter name: none 2024-09-18T02:04:15.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.748+0000 7ff10d7fa640 20 reqs_thread_entry: start 2024-09-18T02:04:15.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.748+0000 7ff2e0592980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T02:04:15.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.748+0000 7ff2e0592980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.748+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560507d44970 con 0x560507d0c050 2024-09-18T02:04:15.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.752+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.752+0000 7ff2e0592980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.752+0000 7ff2e0592980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T02:04:15.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.752+0000 7ff2e0592980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:04:15.754 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T02:04:15.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.752+0000 7ff194fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:15.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.752+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94579606007760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d22d60 con 0x560507d07660 2024-09-18T02:04:15.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.752+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94579606007760] v30'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.752+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94579605982368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d1afd0 con 0x7ff2d4037040 2024-09-18T02:04:15.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.756+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94579605982368] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.756+0000 7ff2e0592980 20 remove_watcher() i=0 2024-09-18T02:04:15.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.756+0000 7ff2e0592980 2 removed watcher, disabling cache 2024-09-18T02:04:15.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.756+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94579605986848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d1afd0 con 0x560507d07660 2024-09-18T02:04:15.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.756+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94579605986848] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.756+0000 7ff2e0592980 20 remove_watcher() i=1 2024-09-18T02:04:15.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.756+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94579605979856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d1afd0 con 0x560507d109a0 2024-09-18T02:04:15.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.760+0000 7ff2dd8a1640 1 -- 172.21.15.167:0/439917475 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94579605979856] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d400e620 con 0x560507d109a0 2024-09-18T02:04:15.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.760+0000 7ff2e0592980 20 remove_watcher() i=2 2024-09-18T02:04:15.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.760+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94579605993216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d142d0 con 0x7ff2d4037040 2024-09-18T02:04:15.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.760+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94579605993216] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x7ff2d4037040 2024-09-18T02:04:15.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.760+0000 7ff2e0592980 20 remove_watcher() i=3 2024-09-18T02:04:15.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.760+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94579605997440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d1afd0 con 0x560507d07660 2024-09-18T02:04:15.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.764+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94579605997440] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d800a4d0 con 0x560507d07660 2024-09-18T02:04:15.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.764+0000 7ff2e0592980 20 remove_watcher() i=4 2024-09-18T02:04:15.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.764+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94579605991744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d17700 con 0x560507d0c050 2024-09-18T02:04:15.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.764+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94579605991744] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.764+0000 7ff2e0592980 20 remove_watcher() i=5 2024-09-18T02:04:15.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.764+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94579606004208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d142d0 con 0x560507d0c050 2024-09-18T02:04:15.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94579606004208] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 20 remove_watcher() i=6 2024-09-18T02:04:15.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94579605994464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560507d1afd0 con 0x560507d0c050 2024-09-18T02:04:15.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2de0a2640 1 -- 172.21.15.167:0/439917475 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94579605994464] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d00b3040 con 0x560507d0c050 2024-09-18T02:04:15.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 20 remove_watcher() i=7 2024-09-18T02:04:15.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560507d0c050 msgr2=0x560507d0e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560507d0c050 0x560507d0e440 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560507d07660 msgr2=0x560507d09b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560507d07660 0x560507d09b20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff2d4037040 msgr2=0x7ff2d4036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff2d4037040 0x7ff2d4036410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560507d109a0 msgr2=0x560507d12db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560507d109a0 0x560507d12db0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1a8034650 msgr2=0x7ff1a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1a8034650 0x7ff1a8036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x560507cd29c0 tx=0x7ff2d4010000 comp rx=0 tx=0).stop 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 msgr2=0x560507cfc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2de8a3640 1 -- 172.21.15.167:0/439917475 reap_dead start 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cfc6c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00fa040 tx=0x7ff2d00dee70 comp rx=0 tx=0).stop 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 shutdown_connections 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 --2- 172.21.15.167:0/439917475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507cf5610 0x560507cfc6c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 >> 172.21.15.167:0/439917475 conn(0x560507cf1a80 msgr2=0x560507cefb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 shutdown_connections 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.768+0000 7ff2e0592980 1 -- 172.21.15.167:0/439917475 wait complete. 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/1824033613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1b80346a0 msgr2=0x7ff1b8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 --2- 172.21.15.167:0/1824033613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1b80346a0 0x7ff1b8036b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400bf60 tx=0x7ff2d400f000 comp rx=0 tx=0).stop 2024-09-18T02:04:15.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/1824033613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507ce8d60 msgr2=0x560507ce9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 --2- 172.21.15.167:0/1824033613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507ce8d60 0x560507ce9180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00b6850 tx=0x7ff2d00d8390 comp rx=0 tx=0).stop 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/1824033613 shutdown_connections 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 --2- 172.21.15.167:0/1824033613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1b80346a0 0x7ff1b8036b60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 --2- 172.21.15.167:0/1824033613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507ce8d60 0x560507ce9180 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/1824033613 >> 172.21.15.167:0/1824033613 conn(0x560507cddeb0 msgr2=0x560507ce0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/1824033613 shutdown_connections 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/1824033613 wait complete. 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560507cd4820 msgr2=0x560507cd6c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560507cd4820 0x560507cd6c10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560507b4d7c0 msgr2=0x560507cd1fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560507b4d7c0 0x560507cd1fc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560507cd8760 msgr2=0x560507cdab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560507cd8760 0x560507cdab50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1c4034650 msgr2=0x7ff1c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff1c4034650 0x7ff1c4036b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4000f70 tx=0x7ff2d40012c0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 msgr2=0x560507ccaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 --2- 172.21.15.167:0/316496371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560507b4d3b0 0x560507ccaec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0019930 tx=0x7ff2d0018020 comp rx=0 tx=0).stop 2024-09-18T02:04:15.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2de8a3640 1 -- 172.21.15.167:0/316496371 reap_dead start 2024-09-18T02:04:15.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 shutdown_connections 2024-09-18T02:04:15.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 >> 172.21.15.167:0/316496371 conn(0x560507bd2180 msgr2=0x560507cbe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 shutdown_connections 2024-09-18T02:04:15.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.772+0000 7ff2e0592980 1 -- 172.21.15.167:0/316496371 wait complete. 2024-09-18T02:04:15.788 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T02:04:15.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-18T02:04:15.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-18T02:04:15.789 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-18T02:04:15.866 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:15.866 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:15.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.864+0000 7fb7c8924980 1 Processor -- start 2024-09-18T02:04:15.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.864+0000 7fb7c8924980 1 -- start start 2024-09-18T02:04:15.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.864+0000 7fb7c8924980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5578c5cf87c0 0x5578c5cf7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.864+0000 7fb7c8924980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578c5c09ae0 con 0x5578c5cf83b0 2024-09-18T02:04:15.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.864+0000 7fb7c8924980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x5578c5c2de30 con 0x5578c5cf87c0 2024-09-18T02:04:15.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.864+0000 7fb7c5c33640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5578c5cf87c0 0x5578c5cf7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.864+0000 7fb7c6434640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5578c5cf83b0 0x5578c5cf6b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:34536/0 (socket says 172.21.15.167:34536) 2024-09-18T02:04:15.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.864+0000 7fb7c5c33640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5578c5cf87c0 0x5578c5cf7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60654/0 (socket says 172.21.15.167:60654) 2024-09-18T02:04:15.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.864+0000 7fb7c6434640 1 -- 172.21.15.167:0/3846489629 learned_addr learned my addr 172.21.15.167:0/3846489629 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.864+0000 7fb7c5c33640 1 -- 172.21.15.167:0/3846489629 >> v1:172.21.15.81:6789/0 conn(0x5578c5cf83b0 legacy=0x5578c5cf6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.864+0000 7fb7c5c33640 1 -- 172.21.15.167:0/3846489629 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c5cf78e0 con 0x5578c5cf87c0 2024-09-18T02:04:15.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.868+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/3846489629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf87c0 0x5578c5cf7280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00a480 tx=0x7fb7bc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1ac6f0318bfb2c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.868+0000 7fb7c5432640 1 -- 172.21.15.167:0/3846489629 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc0b0070 con 0x5578c5cf87c0 2024-09-18T02:04:15.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.868+0000 7fb7c5432640 1 -- 172.21.15.167:0/3846489629 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7bc0ab540 con 0x5578c5cf87c0 2024-09-18T02:04:15.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.868+0000 7fb7c5432640 1 -- 172.21.15.167:0/3846489629 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc0ab840 con 0x5578c5cf87c0 2024-09-18T02:04:15.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.868+0000 7fb7c8924980 1 -- 172.21.15.167:0/3846489629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf87c0 msgr2=0x5578c5cf7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.868+0000 7fb7c8924980 1 --2- 172.21.15.167:0/3846489629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf87c0 0x5578c5cf7280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00a480 tx=0x7fb7bc01b280 comp rx=0 tx=0).stop 2024-09-18T02:04:15.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.868+0000 7fb7c8924980 1 -- 172.21.15.167:0/3846489629 shutdown_connections 2024-09-18T02:04:15.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.868+0000 7fb7c8924980 1 --2- 172.21.15.167:0/3846489629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf87c0 0x5578c5cf7280 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.868+0000 7fb7c8924980 1 -- 172.21.15.167:0/3846489629 >> 172.21.15.167:0/3846489629 conn(0x5578c5d7d1b0 msgr2=0x5578c5d7f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.868+0000 7fb7c8924980 1 -- 172.21.15.167:0/3846489629 shutdown_connections 2024-09-18T02:04:15.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.868+0000 7fb7c8924980 1 -- 172.21.15.167:0/3846489629 wait complete. 2024-09-18T02:04:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.884+0000 7fb7c8924980 1 Processor -- start 2024-09-18T02:04:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.884+0000 7fb7c8924980 1 -- start start 2024-09-18T02:04:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.884+0000 7fb7c8924980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 0x5578c5e6ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.884+0000 7fb7c8924980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5578c5c2f200 con 0x5578c5cf83b0 2024-09-18T02:04:15.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c6434640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 0x5578c5e6ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c6434640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 0x5578c5e6ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60668/0 (socket says 172.21.15.167:60668) 2024-09-18T02:04:15.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c6434640 1 -- 172.21.15.167:0/2900635522 learned_addr learned my addr 172.21.15.167:0/2900635522 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c6434640 1 -- 172.21.15.167:0/2900635522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c5e6f1e0 con 0x5578c5cf83b0 2024-09-18T02:04:15.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c6434640 1 --2- 172.21.15.167:0/2900635522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 0x5578c5e6ec10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80015f0 tx=0x7fb7b8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4334184a157e2eec server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb6b4608640 1 -- 172.21.15.167:0/2900635522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b8004530 con 0x5578c5cf83b0 2024-09-18T02:04:15.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb6b4608640 1 -- 172.21.15.167:0/2900635522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b80046f0 con 0x5578c5cf83b0 2024-09-18T02:04:15.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb6b4608640 1 -- 172.21.15.167:0/2900635522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b8004a90 con 0x5578c5cf83b0 2024-09-18T02:04:15.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c8924980 1 -- 172.21.15.167:0/2900635522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 msgr2=0x5578c5e6ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c8924980 1 --2- 172.21.15.167:0/2900635522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 0x5578c5e6ec10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80015f0 tx=0x7fb7b8001ab0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c8924980 1 -- 172.21.15.167:0/2900635522 shutdown_connections 2024-09-18T02:04:15.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c8924980 1 --2- 172.21.15.167:0/2900635522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 0x5578c5e6ec10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c8924980 1 -- 172.21.15.167:0/2900635522 >> 172.21.15.167:0/2900635522 conn(0x5578c5d7d1b0 msgr2=0x5578c5e6a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c8924980 1 -- 172.21.15.167:0/2900635522 shutdown_connections 2024-09-18T02:04:15.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c8924980 1 -- 172.21.15.167:0/2900635522 wait complete. 2024-09-18T02:04:15.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c8924980 1 Processor -- start 2024-09-18T02:04:15.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c8924980 1 -- start start 2024-09-18T02:04:15.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c8924980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 0x5578c5e75f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c8924980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5578c5d8d200 con 0x5578c5cf83b0 2024-09-18T02:04:15.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c6434640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 0x5578c5e75f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c6434640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 0x5578c5e75f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60678/0 (socket says 172.21.15.167:60678) 2024-09-18T02:04:15.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c6434640 1 -- 172.21.15.167:0/1893932702 learned_addr learned my addr 172.21.15.167:0/1893932702 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.888+0000 7fb7c6434640 1 -- 172.21.15.167:0/1893932702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c5e764a0 con 0x5578c5cf83b0 2024-09-18T02:04:15.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c6434640 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 0x5578c5e75f60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5578c5e6fdf0 tx=0x7fb7b8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb6b2e05640 1 -- 172.21.15.167:0/1893932702 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b8013760 con 0x5578c5cf83b0 2024-09-18T02:04:15.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb6b2e05640 1 -- 172.21.15.167:0/1893932702 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b8013900 con 0x5578c5cf83b0 2024-09-18T02:04:15.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb6b2e05640 1 -- 172.21.15.167:0/1893932702 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b8013be0 con 0x5578c5cf83b0 2024-09-18T02:04:15.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578c5e76730 con 0x5578c5cf83b0 2024-09-18T02:04:15.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c5e79410 con 0x5578c5cf83b0 2024-09-18T02:04:15.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb6b2e05640 1 -- 172.21.15.167:0/1893932702 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb7b8010070 con 0x5578c5cf83b0 2024-09-18T02:04:15.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb6b2e05640 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6ac034650 0x7fb6ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb6b2e05640 1 -- 172.21.15.167:0/1893932702 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb7b8018070 con 0x5578c5cf83b0 2024-09-18T02:04:15.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6ac034650 0x7fb6ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c8924980 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5578c5cf87c0 0x5578c5e7cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5e7d5c0 con 0x5578c5cf87c0 2024-09-18T02:04:15.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c6c35640 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5578c5cf87c0 0x5578c5e7cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6ac034650 0x7fb6ac036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0ad000 tx=0x7fb7bc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c6c35640 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5578c5cf87c0 0x5578c5e7cf50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c6c35640 1 -- 172.21.15.167:0/1893932702 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7c00083f0 con 0x5578c5cf87c0 2024-09-18T02:04:15.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5e7a610 con 0x5578c5cf87c0 2024-09-18T02:04:15.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c6c35640 1 -- 172.21.15.167:0/1893932702 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7c00083f0 con 0x5578c5cf87c0 2024-09-18T02:04:15.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c8924980 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5578c5e7f8f0 0x5578c5e81ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.892+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5e823d0 con 0x5578c5e7f8f0 2024-09-18T02:04:15.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c6434640 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5578c5e7f8f0 0x5578c5e81ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c6434640 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5578c5e7f8f0 0x5578c5e81ce0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c6434640 1 -- 172.21.15.167:0/1893932702 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5e7f8f0 2024-09-18T02:04:15.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5e7e790 con 0x5578c5cf87c0 2024-09-18T02:04:15.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c6c35640 1 -- 172.21.15.167:0/1893932702 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7c00083f0 con 0x5578c5cf87c0 2024-09-18T02:04:15.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c8924980 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5578c5e83830 0x5578c5e85c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5e86360 con 0x5578c5e83830 2024-09-18T02:04:15.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5578c5e83830 0x5578c5e85c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5578c5e83830 0x5578c5e85c20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c5c33640 1 -- 172.21.15.167:0/1893932702 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb7bc0abcf0 con 0x5578c5e83830 2024-09-18T02:04:15.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c8924980 1 Processor -- start 2024-09-18T02:04:15.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c8924980 1 -- start start 2024-09-18T02:04:15.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c8924980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5e93e30 0x5578c5e94250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c8924980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5578c5c88800 con 0x5578c5e93e30 2024-09-18T02:04:15.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.896+0000 7fb7c6434640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5e93e30 0x5578c5e94250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c6434640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5e93e30 0x5578c5e94250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60692/0 (socket says 172.21.15.167:60692) 2024-09-18T02:04:15.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c6434640 1 -- 172.21.15.167:0/426836669 learned_addr learned my addr 172.21.15.167:0/426836669 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c6434640 1 -- 172.21.15.167:0/426836669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c5e94790 con 0x5578c5e93e30 2024-09-18T02:04:15.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c6434640 1 --2- 172.21.15.167:0/426836669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5e93e30 0x5578c5e94250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80483b0 tx=0x7fb7b8012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb6abfff640 1 -- 172.21.15.167:0/426836669 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b8039030 con 0x5578c5e93e30 2024-09-18T02:04:15.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb6abfff640 1 -- 172.21.15.167:0/426836669 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b80413d0 con 0x5578c5e93e30 2024-09-18T02:04:15.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c8924980 1 -- 172.21.15.167:0/426836669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578c5e94a20 con 0x5578c5e93e30 2024-09-18T02:04:15.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb6abfff640 1 -- 172.21.15.167:0/426836669 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b8043040 con 0x5578c5e93e30 2024-09-18T02:04:15.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c8924980 1 -- 172.21.15.167:0/426836669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c5e976a0 con 0x5578c5e93e30 2024-09-18T02:04:15.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb6abfff640 1 -- 172.21.15.167:0/426836669 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb7b80416b0 con 0x5578c5e93e30 2024-09-18T02:04:15.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb6abfff640 1 --2- 172.21.15.167:0/426836669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6a0034650 0x7fb6a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb6abfff640 1 -- 172.21.15.167:0/426836669 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb7b803d070 con 0x5578c5e93e30 2024-09-18T02:04:15.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/426836669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6a0034650 0x7fb6a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c8924980 1 Processor -- start 2024-09-18T02:04:15.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c8924980 1 -- start start 2024-09-18T02:04:15.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/426836669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6a0034650 0x7fb6a0036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5578c5e7da90 tx=0x7fb7bc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c8924980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c8924980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5578c5e6f560 con 0x5578c5ea0770 2024-09-18T02:04:15.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c6434640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c6434640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60708/0 (socket says 172.21.15.167:60708) 2024-09-18T02:04:15.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.900+0000 7fb7c6434640 1 -- 172.21.15.167:0/4255304491 learned_addr learned my addr 172.21.15.167:0/4255304491 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c6434640 1 -- 172.21.15.167:0/4255304491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c5ea1140 con 0x5578c5ea0770 2024-09-18T02:04:15.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c6434640 1 --2- 172.21.15.167:0/4255304491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea0b70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80106a0 tx=0x7fb7b8052ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7293f39cd4a61f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb6a9ffb640 1 -- 172.21.15.167:0/4255304491 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b8035d70 con 0x5578c5ea0770 2024-09-18T02:04:15.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb6a9ffb640 1 -- 172.21.15.167:0/4255304491 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b8063070 con 0x5578c5ea0770 2024-09-18T02:04:15.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb6a9ffb640 1 -- 172.21.15.167:0/4255304491 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b80355a0 con 0x5578c5ea0770 2024-09-18T02:04:15.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 -- 172.21.15.167:0/4255304491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 msgr2=0x5578c5ea0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:15.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4255304491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea0b70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80106a0 tx=0x7fb7b8052ac0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 -- 172.21.15.167:0/4255304491 shutdown_connections 2024-09-18T02:04:15.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4255304491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea0b70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:15.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 -- 172.21.15.167:0/4255304491 >> 172.21.15.167:0/4255304491 conn(0x5578c5e9cb50 msgr2=0x5578c5e9ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:15.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 -- 172.21.15.167:0/4255304491 shutdown_connections 2024-09-18T02:04:15.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 -- 172.21.15.167:0/4255304491 wait complete. 2024-09-18T02:04:15.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 Processor -- start 2024-09-18T02:04:15.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 -- start start 2024-09-18T02:04:15.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5578c5ea15c0 con 0x5578c5ea0770 2024-09-18T02:04:15.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c6434640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c6434640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60724/0 (socket says 172.21.15.167:60724) 2024-09-18T02:04:15.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 learned_addr learned my addr 172.21.15.167:0/4064677605 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:15.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c5ea7f50 con 0x5578c5ea0770 2024-09-18T02:04:15.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c6434640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea7a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80419a0 tx=0x7fb7b8042f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb697fff640 1 -- 172.21.15.167:0/4064677605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b8034b30 con 0x5578c5ea0770 2024-09-18T02:04:15.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578c5ea7f50 con 0x5578c5ea0770 2024-09-18T02:04:15.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb697fff640 1 -- 172.21.15.167:0/4064677605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b806e070 con 0x5578c5ea0770 2024-09-18T02:04:15.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb697fff640 1 -- 172.21.15.167:0/4064677605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b8034e00 con 0x5578c5ea0770 2024-09-18T02:04:15.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.904+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c5ea7f50 con 0x5578c5ea0770 2024-09-18T02:04:15.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb697fff640 1 -- 172.21.15.167:0/4064677605 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb7b8041bf0 con 0x5578c5ea0770 2024-09-18T02:04:15.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb697fff640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6900345b0 0x7fb690036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb697fff640 1 -- 172.21.15.167:0/4064677605 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb7b8074b20 con 0x5578c5ea0770 2024-09-18T02:04:15.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6900345b0 0x7fb690036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5578c5eb29d0 0x5578c5eb4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb55e0 con 0x5578c5eb29d0 2024-09-18T02:04:15.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c6c35640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5578c5eb29d0 0x5578c5eb4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6900345b0 0x7fb690036a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5578c5e86760 tx=0x7fb7bc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c6c35640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5578c5eb29d0 0x5578c5eb4e90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7c00083f0 con 0x5578c5eb29d0 2024-09-18T02:04:15.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 20 realm 2024-09-18T02:04:15.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb59f0 con 0x5578c5eb29d0 2024-09-18T02:04:15.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7c00083f0 con 0x5578c5eb29d0 2024-09-18T02:04:15.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb62c0 con 0x5578c5eb29d0 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7c00083f0 con 0x5578c5eb29d0 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x5578c5eb29d0 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7c00083f0 con 0x5578c5eb29d0 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5578c5eb73c0 0x5578c5eb97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb9d80 con 0x5578c5eb73c0 2024-09-18T02:04:15.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.908+0000 7fb7c6434640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5578c5eb73c0 0x5578c5eb97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c6434640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5578c5eb73c0 0x5578c5eb97b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c8924980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:15.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c8924980 20 searching for the correct realm 2024-09-18T02:04:15.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5578c5ebbcd0 0x5578c5ebe100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ebe7d0 con 0x5578c5ebbcd0 2024-09-18T02:04:15.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5578c5ebbcd0 0x5578c5ebe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5578c5ebbcd0 0x5578c5ebe100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c5c33640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb7bc0ce040 0x7fb7bc0c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ebe7d0 con 0x7fb7bc0ce040 2024-09-18T02:04:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c6c35640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb7bc0ce040 0x7fb7bc0c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c6c35640 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb7bc0ce040 0x7fb7bc0c03c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7c00083f0 con 0x7fb7bc0ce040 2024-09-18T02:04:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x5578c5eb73c0 2024-09-18T02:04:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.912+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x5578c5eb29d0 2024-09-18T02:04:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7c00083f0 con 0x5578c5eb29d0 2024-09-18T02:04:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x5578c5eb29d0 2024-09-18T02:04:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x5578c5eb73c0 2024-09-18T02:04:15.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x5578c5eb73c0 2024-09-18T02:04:15.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x7fb7bc0ce040 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x5578c5ebbcd0 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x5578c5eb29d0 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x5578c5eb73c0 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x5578c5eb29d0 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.916+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x7fb7bc0ce040 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eb6660 con 0x5578c5ebbcd0 2024-09-18T02:04:15.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5ebbcd0 2024-09-18T02:04:15.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5eb73c0 2024-09-18T02:04:15.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5ebbcd0 2024-09-18T02:04:15.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5ebbcd0 2024-09-18T02:04:15.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5eb29d0 2024-09-18T02:04:15.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5eb29d0 2024-09-18T02:04:15.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5eb73c0 2024-09-18T02:04:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5ebbcd0 2024-09-18T02:04:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.920+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x7fb7bc0ce040 2024-09-18T02:04:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5eb29d0 2024-09-18T02:04:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5eb73c0 2024-09-18T02:04:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5ebbcd0 2024-09-18T02:04:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5eb73c0 2024-09-18T02:04:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x7fb7bc0ce040 2024-09-18T02:04:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5ebbcd0 2024-09-18T02:04:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5eb73c0 2024-09-18T02:04:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x5578c5eb29d0 2024-09-18T02:04:15.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.924+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb7bc0e8080 con 0x7fb7bc0ce040 2024-09-18T02:04:15.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eba640 con 0x5578c5eb29d0 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eba640 con 0x5578c5eb29d0 2024-09-18T02:04:15.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5eba640 con 0x5578c5ebbcd0 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 zone default found 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 4 Realm: () 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 zonegroup default 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ebb020 con 0x5578c5eb73c0 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ebabf0 con 0x5578c5ebbcd0 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec0b90 con 0x5578c5ebbcd0 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 started sync module instance, tier type = 2024-09-18T02:04:15.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:15.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.928+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ebff70 con 0x7fb7bc0ce040 2024-09-18T02:04:15.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.932+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.932+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93977205015696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ebff70 con 0x7fb7bc0ce040 2024-09-18T02:04:15.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.932+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec1630 con 0x5578c5eb29d0 2024-09-18T02:04:15.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.932+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93977205015696] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.932+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.932+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93977205018944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ebff70 con 0x5578c5eb29d0 2024-09-18T02:04:15.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.932+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec2040 con 0x5578c5ebbcd0 2024-09-18T02:04:15.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.936+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93977205018944] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.936+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.936+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93977205013184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ebfee0 con 0x5578c5ebbcd0 2024-09-18T02:04:15.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.936+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec2dd0 con 0x7fb7bc0ce040 2024-09-18T02:04:15.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.936+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.936+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93977205024992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec3670 con 0x7fb7bc0ce040 2024-09-18T02:04:15.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.936+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec4070 con 0x5578c5eb29d0 2024-09-18T02:04:15.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.936+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93977205013184] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.940+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93977205024992] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.940+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.940+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93977205023792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec3140 con 0x5578c5eb29d0 2024-09-18T02:04:15.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.940+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec4910 con 0x5578c5eb73c0 2024-09-18T02:04:15.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.940+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93977205023792] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.940+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.940+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93977205029760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec3140 con 0x5578c5eb73c0 2024-09-18T02:04:15.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.940+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec4dc0 con 0x5578c5eb73c0 2024-09-18T02:04:15.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93977205029760] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93977205032032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec4d30 con 0x5578c5eb73c0 2024-09-18T02:04:15.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec5770 con 0x5578c5eb73c0 2024-09-18T02:04:15.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93977205032032] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93977205035584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec5950 con 0x5578c5eb73c0 2024-09-18T02:04:15.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c8924980 20 add_watcher() i=0 2024-09-18T02:04:15.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c8924980 20 add_watcher() i=1 2024-09-18T02:04:15.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c8924980 20 add_watcher() i=2 2024-09-18T02:04:15.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c8924980 20 add_watcher() i=3 2024-09-18T02:04:15.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c8924980 20 add_watcher() i=4 2024-09-18T02:04:15.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c8924980 20 add_watcher() i=5 2024-09-18T02:04:15.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.944+0000 7fb7c8924980 20 add_watcher() i=6 2024-09-18T02:04:15.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.948+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93977205035584] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.948+0000 7fb7c8924980 20 add_watcher() i=7 2024-09-18T02:04:15.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.948+0000 7fb7c8924980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:15.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.948+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec8d20 con 0x5578c5eb29d0 2024-09-18T02:04:15.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.948+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.948+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93977205037120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec6110 con 0x5578c5eb29d0 2024-09-18T02:04:15.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.948+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93977205037120] v30'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.948+0000 7fb67cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:15.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.948+0000 7fb7c8924980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:15.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.948+0000 7fb7c8924980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:15.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.948+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed15b0 con 0x5578c5eb29d0 2024-09-18T02:04:15.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.952+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'43 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.952+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed1c00 con 0x5578c5eb73c0 2024-09-18T02:04:15.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.952+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'19 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.956+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed1c00 con 0x5578c5ebbcd0 2024-09-18T02:04:15.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.956+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.956+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed2230 con 0x5578c5eb29d0 2024-09-18T02:04:15.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.956+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.956+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed26e0 con 0x7fb7bc0ce040 2024-09-18T02:04:15.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.956+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.956+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed2c50 con 0x5578c5ebbcd0 2024-09-18T02:04:15.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.960+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.960+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3100 con 0x5578c5eb29d0 2024-09-18T02:04:15.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.960+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.960+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed2f30 con 0x5578c5eb73c0 2024-09-18T02:04:15.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.964+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.964+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed2fc0 con 0x7fb7bc0ce040 2024-09-18T02:04:15.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.964+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.964+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed2fc0 con 0x5578c5ebbcd0 2024-09-18T02:04:15.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.968+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.968+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed35d0 con 0x7fb7bc0ce040 2024-09-18T02:04:15.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.968+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.968+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3590 con 0x5578c5eb73c0 2024-09-18T02:04:15.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.968+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.972+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3590 con 0x7fb7bc0ce040 2024-09-18T02:04:15.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.972+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.972+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3590 con 0x5578c5eb73c0 2024-09-18T02:04:15.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.976+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'39 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.976+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3590 con 0x5578c5eb29d0 2024-09-18T02:04:15.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.976+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'49 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.976+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3590 con 0x5578c5ebbcd0 2024-09-18T02:04:15.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.976+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.976+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3590 con 0x7fb7bc0ce040 2024-09-18T02:04:15.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.980+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.980+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3590 con 0x5578c5ebbcd0 2024-09-18T02:04:15.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.980+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.980+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5eb29d0 2024-09-18T02:04:15.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.984+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.984+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5eb29d0 2024-09-18T02:04:15.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.984+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'50 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:15.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.984+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5ebbcd0 2024-09-18T02:04:15.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.984+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.984+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x7fb7bc0ce040 2024-09-18T02:04:15.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.988+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:15.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.988+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5ebbcd0 2024-09-18T02:04:15.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.988+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.988+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5ebbcd0 2024-09-18T02:04:15.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.988+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.988+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5ebbcd0 2024-09-18T02:04:15.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.992+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.992+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5ebbcd0 2024-09-18T02:04:15.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.992+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'32 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.992+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5eb73c0 2024-09-18T02:04:15.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.996+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:15.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.996+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5ebbcd0 2024-09-18T02:04:15.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.996+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:15.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.996+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5eb73c0 2024-09-18T02:04:16.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.996+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:16.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:15.996+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5ebbcd0 2024-09-18T02:04:16.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.000+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:16.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.000+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x5578c5eb73c0 2024-09-18T02:04:16.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.004+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'40 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:16.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.004+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ed3620 con 0x7fb7bc0ce040 2024-09-18T02:04:16.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.004+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.004+0000 7fb5f77fe640 20 reqs_thread_entry: start 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.004+0000 7fb7c8924980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.004+0000 7fb7c8924980 20 Filter name: none 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.004+0000 7fb5f57fa640 20 reqs_thread_entry: start 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.004+0000 7fb7c8924980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.004+0000 7fb7c8924980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.008+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ecf8c0 con 0x5578c5eb29d0 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.008+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.008+0000 7fb7c8924980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.008+0000 7fb7c8924980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.008+0000 7fb7c8924980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:16.010 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T02:04:16.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.008+0000 7fb67cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:16.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.008+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93977205037120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ecd6a0 con 0x5578c5eb29d0 2024-09-18T02:04:16.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.008+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93977205037120] v30'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:16.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.008+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93977205015696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec5840 con 0x7fb7bc0ce040 2024-09-18T02:04:16.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.012+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93977205015696] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:16.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.012+0000 7fb7c8924980 20 remove_watcher() i=0 2024-09-18T02:04:16.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.012+0000 7fb7c8924980 2 removed watcher, disabling cache 2024-09-18T02:04:16.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.012+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93977205018944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec5840 con 0x5578c5eb29d0 2024-09-18T02:04:16.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.012+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93977205018944] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:16.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.012+0000 7fb7c8924980 20 remove_watcher() i=1 2024-09-18T02:04:16.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.012+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93977205013184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec1140 con 0x5578c5ebbcd0 2024-09-18T02:04:16.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.016+0000 7fb7c5c33640 1 -- 172.21.15.167:0/4064677605 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93977205013184] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0d9070 con 0x5578c5ebbcd0 2024-09-18T02:04:16.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.016+0000 7fb7c8924980 20 remove_watcher() i=2 2024-09-18T02:04:16.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.016+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93977205024992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec5840 con 0x7fb7bc0ce040 2024-09-18T02:04:16.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.016+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93977205024992] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x7fb7bc0ce040 2024-09-18T02:04:16.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.016+0000 7fb7c8924980 20 remove_watcher() i=3 2024-09-18T02:04:16.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.016+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93977205023792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ebfac0 con 0x5578c5eb29d0 2024-09-18T02:04:16.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.016+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93977205023792] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7c0026040 con 0x5578c5eb29d0 2024-09-18T02:04:16.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.016+0000 7fb7c8924980 20 remove_watcher() i=4 2024-09-18T02:04:16.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.016+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93977205029760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec1140 con 0x5578c5eb73c0 2024-09-18T02:04:16.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.020+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93977205029760] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:16.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.020+0000 7fb7c8924980 20 remove_watcher() i=5 2024-09-18T02:04:16.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.020+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93977205032032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ec5840 con 0x5578c5eb73c0 2024-09-18T02:04:16.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.020+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93977205032032] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:16.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.020+0000 7fb7c8924980 20 remove_watcher() i=6 2024-09-18T02:04:16.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.020+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93977205035584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578c5ebfac0 con 0x5578c5eb73c0 2024-09-18T02:04:16.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c6434640 1 -- 172.21.15.167:0/4064677605 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93977205035584] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7b801b030 con 0x5578c5eb73c0 2024-09-18T02:04:16.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 20 remove_watcher() i=7 2024-09-18T02:04:16.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5578c5eb73c0 msgr2=0x5578c5eb97b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5578c5eb73c0 0x5578c5eb97b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5578c5eb29d0 msgr2=0x5578c5eb4e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5578c5eb29d0 0x5578c5eb4e90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb7bc0ce040 msgr2=0x7fb7bc0c03c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb7bc0ce040 0x7fb7bc0c03c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5578c5ebbcd0 msgr2=0x5578c5ebe100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5578c5ebbcd0 0x5578c5ebe100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6900345b0 msgr2=0x7fb690036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6900345b0 0x7fb690036a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5578c5e86760 tx=0x7fb7bc0a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 msgr2=0x5578c5ea7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c6c35640 1 -- 172.21.15.167:0/4064677605 reap_dead start 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea7a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80419a0 tx=0x7fb7b8042f70 comp rx=0 tx=0).stop 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 shutdown_connections 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/4064677605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5ea0770 0x5578c5ea7a10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 >> 172.21.15.167:0/4064677605 conn(0x5578c5e9cb50 msgr2=0x5578c5e9ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 shutdown_connections 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/4064677605 wait complete. 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/426836669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6a0034650 msgr2=0x7fb6a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/426836669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6a0034650 0x7fb6a0036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5578c5e7da90 tx=0x7fb7bc005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/426836669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5e93e30 msgr2=0x5578c5e94250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/426836669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5e93e30 0x5578c5e94250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80483b0 tx=0x7fb7b8012ef0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/426836669 shutdown_connections 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/426836669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6a0034650 0x7fb6a0036b10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/426836669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5e93e30 0x5578c5e94250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/426836669 >> 172.21.15.167:0/426836669 conn(0x5578c5e88f80 msgr2=0x5578c5e8ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/426836669 shutdown_connections 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/426836669 wait complete. 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5578c5e7f8f0 msgr2=0x5578c5e81ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5578c5e7f8f0 0x5578c5e81ce0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5578c5cf87c0 msgr2=0x5578c5e7cf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5578c5cf87c0 0x5578c5e7cf50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5578c5e83830 msgr2=0x5578c5e85c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5578c5e83830 0x5578c5e85c20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6ac034650 msgr2=0x7fb6ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb6ac034650 0x7fb6ac036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0ad000 tx=0x7fb7bc0a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:16.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 msgr2=0x5578c5e75f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 --2- 172.21.15.167:0/1893932702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578c5cf83b0 0x5578c5e75f60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5578c5e6fdf0 tx=0x7fb7b8000f50 comp rx=0 tx=0).stop 2024-09-18T02:04:16.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c6c35640 1 -- 172.21.15.167:0/1893932702 reap_dead start 2024-09-18T02:04:16.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 shutdown_connections 2024-09-18T02:04:16.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 >> 172.21.15.167:0/1893932702 conn(0x5578c5d7d1b0 msgr2=0x5578c5e693c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 shutdown_connections 2024-09-18T02:04:16.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.024+0000 7fb7c8924980 1 -- 172.21.15.167:0/1893932702 wait complete. 2024-09-18T02:04:16.040 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T02:04:16.040 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T02:04:16.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T02:04:16.040 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-18T02:04:16.115 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:16.115 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.112+0000 7f45428d6980 1 Processor -- start 2024-09-18T02:04:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.112+0000 7f45428d6980 1 -- start start 2024-09-18T02:04:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.112+0000 7f45428d6980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ec6ed88520 0x55ec6ed88900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.112+0000 7f45428d6980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ec6ec11ae0 con 0x55ec6ed88e70 2024-09-18T02:04:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.112+0000 7f45428d6980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55ec6ec35e30 con 0x55ec6ed88520 2024-09-18T02:04:16.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.112+0000 7f45403e6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ec6ed88520 0x55ec6ed88900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.112+0000 7f45403e6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ec6ed88520 0x55ec6ed88900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60734/0 (socket says 172.21.15.167:60734) 2024-09-18T02:04:16.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.112+0000 7f45403e6640 1 -- 172.21.15.167:0/2663920224 learned_addr learned my addr 172.21.15.167:0/2663920224 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.112+0000 7f453fbe5640 1 --1- 172.21.15.167:0/2663920224 >> v1:172.21.15.81:6789/0 conn(0x55ec6ed88e70 0x55ec6ed8d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:34544/0 (socket says 172.21.15.167:34544) 2024-09-18T02:04:16.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.112+0000 7f45403e6640 1 -- 172.21.15.167:0/2663920224 >> v1:172.21.15.81:6789/0 conn(0x55ec6ed88e70 legacy=0x55ec6ed8d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.112+0000 7f45403e6640 1 -- 172.21.15.167:0/2663920224 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6ed90140 con 0x55ec6ed88520 2024-09-18T02:04:16.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.116+0000 7f45403e6640 1 --2- 172.21.15.167:0/2663920224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ed88900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f453000a5c0 tx=0x7f453001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfba4daa61d2b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.116+0000 7f453f3e4640 1 -- 172.21.15.167:0/2663920224 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45300a6070 con 0x55ec6ed88520 2024-09-18T02:04:16.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.116+0000 7f453f3e4640 1 -- 172.21.15.167:0/2663920224 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45300af070 con 0x55ec6ed88520 2024-09-18T02:04:16.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.116+0000 7f453f3e4640 1 -- 172.21.15.167:0/2663920224 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45300aa5c0 con 0x55ec6ed88520 2024-09-18T02:04:16.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.116+0000 7f45428d6980 1 -- 172.21.15.167:0/2663920224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 msgr2=0x55ec6ed88900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.116+0000 7f45428d6980 1 --2- 172.21.15.167:0/2663920224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ed88900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f453000a5c0 tx=0x7f453001b340 comp rx=0 tx=0).stop 2024-09-18T02:04:16.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.116+0000 7f45428d6980 1 -- 172.21.15.167:0/2663920224 shutdown_connections 2024-09-18T02:04:16.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.116+0000 7f45428d6980 1 --2- 172.21.15.167:0/2663920224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ed88900 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.116+0000 7f45428d6980 1 -- 172.21.15.167:0/2663920224 >> 172.21.15.167:0/2663920224 conn(0x55ec6ed84040 msgr2=0x55ec6ed86460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.116+0000 7f45428d6980 1 -- 172.21.15.167:0/2663920224 shutdown_connections 2024-09-18T02:04:16.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.116+0000 7f45428d6980 1 -- 172.21.15.167:0/2663920224 wait complete. 2024-09-18T02:04:16.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.132+0000 7f45428d6980 1 Processor -- start 2024-09-18T02:04:16.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.132+0000 7f45428d6980 1 -- start start 2024-09-18T02:04:16.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.132+0000 7f45428d6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ee73990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.132+0000 7f45428d6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ec6ec37200 con 0x55ec6ed88520 2024-09-18T02:04:16.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.132+0000 7f45403e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ee73990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.132+0000 7f45403e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ee73990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60744/0 (socket says 172.21.15.167:60744) 2024-09-18T02:04:16.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.132+0000 7f45403e6640 1 -- 172.21.15.167:0/4059966272 learned_addr learned my addr 172.21.15.167:0/4059966272 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.132+0000 7f45403e6640 1 -- 172.21.15.167:0/4059966272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6ee73f60 con 0x55ec6ed88520 2024-09-18T02:04:16.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.132+0000 7f45403e6640 1 --2- 172.21.15.167:0/4059966272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ee73990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f45300199f0 tx=0x7f4530003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cddf47b8c448f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f442e60c640 1 -- 172.21.15.167:0/4059966272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45300aaa00 con 0x55ec6ed88520 2024-09-18T02:04:16.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f442e60c640 1 -- 172.21.15.167:0/4059966272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45300aaba0 con 0x55ec6ed88520 2024-09-18T02:04:16.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f442e60c640 1 -- 172.21.15.167:0/4059966272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45300bd3f0 con 0x55ec6ed88520 2024-09-18T02:04:16.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 -- 172.21.15.167:0/4059966272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 msgr2=0x55ec6ee73990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 --2- 172.21.15.167:0/4059966272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ee73990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f45300199f0 tx=0x7f4530003030 comp rx=0 tx=0).stop 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 -- 172.21.15.167:0/4059966272 shutdown_connections 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 --2- 172.21.15.167:0/4059966272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ee73990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 -- 172.21.15.167:0/4059966272 >> 172.21.15.167:0/4059966272 conn(0x55ec6ed84040 msgr2=0x55ec6ee6f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 -- 172.21.15.167:0/4059966272 shutdown_connections 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 -- 172.21.15.167:0/4059966272 wait complete. 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 Processor -- start 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 -- start start 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ecfdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ec6ed8fb80 con 0x55ec6ed88520 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45403e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ecfdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45403e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ecfdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60756/0 (socket says 172.21.15.167:60756) 2024-09-18T02:04:16.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45403e6640 1 -- 172.21.15.167:0/2218579582 learned_addr learned my addr 172.21.15.167:0/2218579582 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45403e6640 1 -- 172.21.15.167:0/2218579582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6ee7ea10 con 0x55ec6ed88520 2024-09-18T02:04:16.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45403e6640 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ecfdd00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f45300199f0 tx=0x7f45300180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f442ce09640 1 -- 172.21.15.167:0/2218579582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45300bd7c0 con 0x55ec6ed88520 2024-09-18T02:04:16.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec6ee7ebe0 con 0x55ec6ed88520 2024-09-18T02:04:16.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f442ce09640 1 -- 172.21.15.167:0/2218579582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45300bd960 con 0x55ec6ed88520 2024-09-18T02:04:16.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f442ce09640 1 -- 172.21.15.167:0/2218579582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45300bdc40 con 0x55ec6ed88520 2024-09-18T02:04:16.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec6ee7f070 con 0x55ec6ed88520 2024-09-18T02:04:16.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.136+0000 7f45428d6980 1 Processor -- start 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 -- start start 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee88f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ec6ec90800 con 0x55ec6ee88b40 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f442ce09640 1 -- 172.21.15.167:0/2218579582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f45300ce020 con 0x55ec6ed88520 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f4540be7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee88f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f4540be7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee88f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60768/0 (socket says 172.21.15.167:60768) 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f4540be7640 1 -- 172.21.15.167:0/3351735787 learned_addr learned my addr 172.21.15.167:0/3351735787 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f442ce09640 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4428034650 0x7f4428036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f442ce09640 1 -- 172.21.15.167:0/2218579582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f45300cc020 con 0x55ec6ed88520 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45403e6640 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4428034650 0x7f4428036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f4540be7640 1 -- 172.21.15.167:0/3351735787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6ee89480 con 0x55ec6ee88b40 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f4540be7640 1 --2- 172.21.15.167:0/3351735787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee88f40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f453800a430 tx=0x7f453800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953110aebbbac42a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45403e6640 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4428034650 0x7f4428036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f45300cf8b0 tx=0x7f45300cf740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f44267fc640 1 -- 172.21.15.167:0/3351735787 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f453800f6e0 con 0x55ec6ee88b40 2024-09-18T02:04:16.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f44267fc640 1 -- 172.21.15.167:0/3351735787 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4538015070 con 0x55ec6ee88b40 2024-09-18T02:04:16.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f44267fc640 1 -- 172.21.15.167:0/3351735787 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f453800fa10 con 0x55ec6ee88b40 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 -- 172.21.15.167:0/3351735787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 msgr2=0x55ec6ee88f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 --2- 172.21.15.167:0/3351735787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee88f40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f453800a430 tx=0x7f453800a8f0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 -- 172.21.15.167:0/3351735787 shutdown_connections 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 --2- 172.21.15.167:0/3351735787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee88f40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 -- 172.21.15.167:0/3351735787 >> 172.21.15.167:0/3351735787 conn(0x55ec6ed88e70 msgr2=0x55ec6ee84450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 -- 172.21.15.167:0/3351735787 shutdown_connections 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 -- 172.21.15.167:0/3351735787 wait complete. 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 Processor -- start 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 -- start start 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee8ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f45428d6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ec6ee89e60 con 0x55ec6ee88b40 2024-09-18T02:04:16.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f4540be7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee8ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f4540be7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee8ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60782/0 (socket says 172.21.15.167:60782) 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f4540be7640 1 -- 172.21.15.167:0/1439423407 learned_addr learned my addr 172.21.15.167:0/1439423407 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f4540be7640 1 -- 172.21.15.167:0/1439423407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6ee904a0 con 0x55ec6ee88b40 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.140+0000 7f4540be7640 1 --2- 172.21.15.167:0/1439423407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee8ff60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55ec6ee898f0 tx=0x7f4538003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f4424ff9640 1 -- 172.21.15.167:0/1439423407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f453800fe00 con 0x55ec6ee88b40 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f4424ff9640 1 -- 172.21.15.167:0/1439423407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4538010a20 con 0x55ec6ee88b40 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45428d6980 1 -- 172.21.15.167:0/1439423407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec6ee90730 con 0x55ec6ee88b40 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f4424ff9640 1 -- 172.21.15.167:0/1439423407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4538010dc0 con 0x55ec6ee88b40 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45428d6980 1 -- 172.21.15.167:0/1439423407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec6ee93410 con 0x55ec6ee88b40 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45428d6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45428d6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:16.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f4424ff9640 1 -- 172.21.15.167:0/1439423407 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f453801a480 con 0x55ec6ee88b40 2024-09-18T02:04:16.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f4424ff9640 1 --2- 172.21.15.167:0/1439423407 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4418034650 0x7f4418036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45428d6980 1 Processor -- start 2024-09-18T02:04:16.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f4424ff9640 1 -- 172.21.15.167:0/1439423407 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f453804a290 con 0x55ec6ee88b40 2024-09-18T02:04:16.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f4540be7640 1 --2- 172.21.15.167:0/1439423407 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4418034650 0x7f4418036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45428d6980 1 -- start start 2024-09-18T02:04:16.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45428d6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6eea97e0 0x55ec6eea9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45428d6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ec6ee74220 con 0x55ec6eea97e0 2024-09-18T02:04:16.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f4540be7640 1 --2- 172.21.15.167:0/1439423407 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4418034650 0x7f4418036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f453802dce0 tx=0x7f4538024f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45403e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6eea97e0 0x55ec6eea9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45403e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6eea97e0 0x55ec6eea9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60794/0 (socket says 172.21.15.167:60794) 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45403e6640 1 -- 172.21.15.167:0/1191984776 learned_addr learned my addr 172.21.15.167:0/1191984776 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45403e6640 1 -- 172.21.15.167:0/1191984776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6eeaa1d0 con 0x55ec6eea97e0 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f45403e6640 1 --2- 172.21.15.167:0/1191984776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6eea97e0 0x55ec6eea9c00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f45300c9460 tx=0x7f45300bcea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.144+0000 7f4404fe1640 1 -- 172.21.15.167:0/1191984776 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45300df070 con 0x55ec6eea97e0 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f45428d6980 1 -- 172.21.15.167:0/1191984776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec6eeacd30 con 0x55ec6eea97e0 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f4404fe1640 1 -- 172.21.15.167:0/1191984776 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45300cf4f0 con 0x55ec6eea97e0 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f4404fe1640 1 -- 172.21.15.167:0/1191984776 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45300e3650 con 0x55ec6eea97e0 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f45428d6980 1 -- 172.21.15.167:0/1191984776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec6eead130 con 0x55ec6eea97e0 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f4404fe1640 1 -- 172.21.15.167:0/1191984776 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f45300cf970 con 0x55ec6eea97e0 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f4404fe1640 1 --2- 172.21.15.167:0/1191984776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4380034650 0x7f4380036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f4404fe1640 1 -- 172.21.15.167:0/1191984776 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f45300f0af0 con 0x55ec6eea97e0 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f453fbe5640 1 --2- 172.21.15.167:0/1191984776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4380034650 0x7f4380036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f43967fc640 20 reqs_thread_entry: start 2024-09-18T02:04:16.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f45428d6980 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ec6eeaf2f0 0x55ec6eeb1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ec6eeb1df0 con 0x55ec6eeaf2f0 2024-09-18T02:04:16.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f453fbe5640 1 --2- 172.21.15.167:0/1191984776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4380034650 0x7f4380036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4534000f70 tx=0x7f4534001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f4540be7640 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ec6eeaf2f0 0x55ec6eeb1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f4540be7640 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ec6eeaf2f0 0x55ec6eeb1720 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f4540be7640 1 -- 172.21.15.167:0/2218579582 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f453800e070 con 0x55ec6eeaf2f0 2024-09-18T02:04:16.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f45428d6980 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ec6eeb3c10 0x55ec6eeb6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:2 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ec6eeb6650 con 0x55ec6eeb3c10 2024-09-18T02:04:16.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f45403e6640 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ec6eeb3c10 0x55ec6eeb6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.148+0000 7f45403e6640 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ec6eeb3c10 0x55ec6eeb6000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.152+0000 7f45403e6640 1 -- 172.21.15.167:0/2218579582 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(2 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f45300f5020 con 0x55ec6eeb3c10 2024-09-18T02:04:16.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.152+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ec6eebb3b0 con 0x55ec6eeb3c10 2024-09-18T02:04:16.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.152+0000 7f45403e6640 1 -- 172.21.15.167:0/2218579582 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [stat,call,call,writefull 0~993] v30'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f45300f5020 con 0x55ec6eeb3c10 2024-09-18T02:04:16.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.152+0000 7f45428d6980 1 -- 172.21.15.167:0/1439423407 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4418034650 msgr2=0x7f4418036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.152+0000 7f45428d6980 1 --2- 172.21.15.167:0/1439423407 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4418034650 0x7f4418036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f453802dce0 tx=0x7f4538024f20 comp rx=0 tx=0).stop 2024-09-18T02:04:16.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.152+0000 7f45428d6980 1 -- 172.21.15.167:0/1439423407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 msgr2=0x55ec6ee8ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.152+0000 7f45428d6980 1 --2- 172.21.15.167:0/1439423407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee8ff60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55ec6ee898f0 tx=0x7f4538003380 comp rx=0 tx=0).stop 2024-09-18T02:04:16.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/1439423407 shutdown_connections 2024-09-18T02:04:16.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/1439423407 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4418034650 0x7f4418036b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/1439423407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ee88b40 0x55ec6ee8ff60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/1439423407 >> 172.21.15.167:0/1439423407 conn(0x55ec6ed88e70 msgr2=0x55ec6ee84020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/1439423407 shutdown_connections 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/1439423407 wait complete. 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/1191984776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4380034650 msgr2=0x7f4380036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/1191984776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4380034650 0x7f4380036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4534000f70 tx=0x7f4534001300 comp rx=0 tx=0).stop 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/1191984776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6eea97e0 msgr2=0x55ec6eea9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/1191984776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6eea97e0 0x55ec6eea9c00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f45300c9460 tx=0x7f45300bcea0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/1191984776 shutdown_connections 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/1191984776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4380034650 0x7f4380036b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/1191984776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6eea97e0 0x55ec6eea9c00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/1191984776 >> 172.21.15.167:0/1191984776 conn(0x55ec6ee9e7b0 msgr2=0x55ec6eea10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/1191984776 shutdown_connections 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/1191984776 wait complete. 2024-09-18T02:04:16.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ec6eeb3c10 msgr2=0x55ec6eeb6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ec6eeb3c10 0x55ec6eeb6000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ec6eeaf2f0 msgr2=0x55ec6eeb1720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ec6eeaf2f0 0x55ec6eeb1720 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4428034650 msgr2=0x7f4428036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4428034650 0x7f4428036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f45300cf8b0 tx=0x7f45300cf740 comp rx=0 tx=0).stop 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 msgr2=0x55ec6ecfdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ecfdd00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f45300199f0 tx=0x7f45300180e0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 shutdown_connections 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ec6eeb3c10 0x55ec6eeb6000 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ec6eeaf2f0 0x55ec6eeb1720 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4428034650 0x7f4428036b10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 --2- 172.21.15.167:0/2218579582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec6ed88520 0x55ec6ecfdd00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 >> 172.21.15.167:0/2218579582 conn(0x55ec6ed84040 msgr2=0x55ec6ee6e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 shutdown_connections 2024-09-18T02:04:16.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.156+0000 7f45428d6980 1 -- 172.21.15.167:0/2218579582 wait complete. 2024-09-18T02:04:16.169 INFO:teuthology.orchestra.run.smithi167.stdout:{"id":"c5231f36-c36e-44d5-8268-aaf52617db58","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-18T02:04:16.169 DEBUG:tasks.util.rgw: json result: {'id': 'c5231f36-c36e-44d5-8268-aaf52617db58', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-18T02:04:16.171 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-18T02:04:16.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-18T02:04:16.171 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-18T02:04:16.243 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:16.243 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:16.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.240+0000 7f2157f22980 1 Processor -- start 2024-09-18T02:04:16.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.240+0000 7f2157f22980 1 -- start start 2024-09-18T02:04:16.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.240+0000 7f2157f22980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ddd861caf0 0x55ddd86ab320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.240+0000 7f2157f22980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ddd8530ae0 con 0x55ddd86ab860 2024-09-18T02:04:16.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.240+0000 7f2157f22980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55ddd8554e30 con 0x55ddd861caf0 2024-09-18T02:04:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.240+0000 7f2155a32640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ddd861caf0 0x55ddd86ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.240+0000 7f2155231640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55ddd86ab860 0x55ddd86adc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:34560/0 (socket says 172.21.15.167:34560) 2024-09-18T02:04:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.240+0000 7f2155a32640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ddd861caf0 0x55ddd86ab320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60808/0 (socket says 172.21.15.167:60808) 2024-09-18T02:04:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.240+0000 7f2155231640 1 -- 172.21.15.167:0/1706211860 learned_addr learned my addr 172.21.15.167:0/1706211860 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.240+0000 7f2155a32640 1 -- 172.21.15.167:0/1706211860 >> v1:172.21.15.81:6789/0 conn(0x55ddd86ab860 legacy=0x55ddd86adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.240+0000 7f2155a32640 1 -- 172.21.15.167:0/1706211860 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd86b0380 con 0x55ddd861caf0 2024-09-18T02:04:16.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.244+0000 7f2155a32640 1 --2- 172.21.15.167:0/1706211860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd86ab320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f214800a480 tx=0x7f214801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7ac7a5a5a8ba5c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.244+0000 7f2154a30640 1 -- 172.21.15.167:0/1706211860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21480b0070 con 0x55ddd861caf0 2024-09-18T02:04:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.244+0000 7f2154a30640 1 -- 172.21.15.167:0/1706211860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21480ab540 con 0x55ddd861caf0 2024-09-18T02:04:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.244+0000 7f2154a30640 1 -- 172.21.15.167:0/1706211860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21480ab840 con 0x55ddd861caf0 2024-09-18T02:04:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.244+0000 7f2157f22980 1 -- 172.21.15.167:0/1706211860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 msgr2=0x55ddd86ab320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.244+0000 7f2157f22980 1 --2- 172.21.15.167:0/1706211860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd86ab320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f214800a480 tx=0x7f214801b280 comp rx=0 tx=0).stop 2024-09-18T02:04:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.244+0000 7f2157f22980 1 -- 172.21.15.167:0/1706211860 shutdown_connections 2024-09-18T02:04:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.244+0000 7f2157f22980 1 --2- 172.21.15.167:0/1706211860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd86ab320 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.244+0000 7f2157f22980 1 -- 172.21.15.167:0/1706211860 >> 172.21.15.167:0/1706211860 conn(0x55ddd86a3050 msgr2=0x55ddd86a5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.244+0000 7f2157f22980 1 -- 172.21.15.167:0/1706211860 shutdown_connections 2024-09-18T02:04:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.248+0000 7f2157f22980 1 -- 172.21.15.167:0/1706211860 wait complete. 2024-09-18T02:04:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.260+0000 7f2157f22980 1 Processor -- start 2024-09-18T02:04:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.260+0000 7f2157f22980 1 -- start start 2024-09-18T02:04:16.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.260+0000 7f2157f22980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd86a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.260+0000 7f2157f22980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ddd8556200 con 0x55ddd861caf0 2024-09-18T02:04:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.260+0000 7f2155a32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd86a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.260+0000 7f2155a32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd86a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60818/0 (socket says 172.21.15.167:60818) 2024-09-18T02:04:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.260+0000 7f2155a32640 1 -- 172.21.15.167:0/4072978445 learned_addr learned my addr 172.21.15.167:0/4072978445 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2155a32640 1 -- 172.21.15.167:0/4072978445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd86a9050 con 0x55ddd861caf0 2024-09-18T02:04:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2155a32640 1 --2- 172.21.15.167:0/4072978445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd86a8a80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f21480ae040 tx=0x7f2148003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ea095ef874a75e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2043e07640 1 -- 172.21.15.167:0/4072978445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21480b0040 con 0x55ddd861caf0 2024-09-18T02:04:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2043e07640 1 -- 172.21.15.167:0/4072978445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21480ab9d0 con 0x55ddd861caf0 2024-09-18T02:04:16.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2043e07640 1 -- 172.21.15.167:0/4072978445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21480abcf0 con 0x55ddd861caf0 2024-09-18T02:04:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 -- 172.21.15.167:0/4072978445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 msgr2=0x55ddd86a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 --2- 172.21.15.167:0/4072978445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd86a8a80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f21480ae040 tx=0x7f2148003030 comp rx=0 tx=0).stop 2024-09-18T02:04:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 -- 172.21.15.167:0/4072978445 shutdown_connections 2024-09-18T02:04:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 --2- 172.21.15.167:0/4072978445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd86a8a80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 -- 172.21.15.167:0/4072978445 >> 172.21.15.167:0/4072978445 conn(0x55ddd86a3050 msgr2=0x55ddd878f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 -- 172.21.15.167:0/4072978445 shutdown_connections 2024-09-18T02:04:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 -- 172.21.15.167:0/4072978445 wait complete. 2024-09-18T02:04:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 Processor -- start 2024-09-18T02:04:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 -- start start 2024-09-18T02:04:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd879cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ddd86afe20 con 0x55ddd861caf0 2024-09-18T02:04:16.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2155a32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd879cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2155a32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd879cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60834/0 (socket says 172.21.15.167:60834) 2024-09-18T02:04:16.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2155a32640 1 -- 172.21.15.167:0/344427516 learned_addr learned my addr 172.21.15.167:0/344427516 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2155a32640 1 -- 172.21.15.167:0/344427516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd879d4b0 con 0x55ddd861caf0 2024-09-18T02:04:16.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2155a32640 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd879cf70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f214801b2c0 tx=0x7f2148018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2042604640 1 -- 172.21.15.167:0/344427516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21480c5070 con 0x55ddd861caf0 2024-09-18T02:04:16.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddd879d740 con 0x55ddd861caf0 2024-09-18T02:04:16.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2042604640 1 -- 172.21.15.167:0/344427516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21480b6830 con 0x55ddd861caf0 2024-09-18T02:04:16.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2042604640 1 -- 172.21.15.167:0/344427516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21480b0050 con 0x55ddd861caf0 2024-09-18T02:04:16.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.264+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddd87a0420 con 0x55ddd861caf0 2024-09-18T02:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2042604640 1 -- 172.21.15.167:0/344427516 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f21480b6b30 con 0x55ddd861caf0 2024-09-18T02:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2042604640 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f203c034650 0x7f203c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2042604640 1 -- 172.21.15.167:0/344427516 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f21480bc070 con 0x55ddd861caf0 2024-09-18T02:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2155231640 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f203c034650 0x7f203c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2157f22980 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ddd86ab860 0x55ddd87a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87a4570 con 0x55ddd86ab860 2024-09-18T02:04:16.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2156233640 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ddd86ab860 0x55ddd87a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2155231640 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f203c034650 0x7f203c036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f214c001da0 tx=0x7f214c001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2156233640 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ddd86ab860 0x55ddd87a3f00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2156233640 1 -- 172.21.15.167:0/344427516 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd86ab860 2024-09-18T02:04:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87a4e60 con 0x55ddd86ab860 2024-09-18T02:04:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2156233640 1 -- 172.21.15.167:0/344427516 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd86ab860 2024-09-18T02:04:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2157f22980 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ddd87a6770 0x55ddd87a8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87a93c0 con 0x55ddd87a6770 2024-09-18T02:04:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2155a32640 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ddd87a6770 0x55ddd87a8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.268+0000 7f2155a32640 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ddd87a6770 0x55ddd87a8c30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2155a32640 1 -- 172.21.15.167:0/344427516 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87a6770 2024-09-18T02:04:16.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87a56b0 con 0x55ddd86ab860 2024-09-18T02:04:16.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2156233640 1 -- 172.21.15.167:0/344427516 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd86ab860 2024-09-18T02:04:16.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2157f22980 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ddd87aa820 0x55ddd87acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87ad310 con 0x55ddd87aa820 2024-09-18T02:04:16.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2155231640 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ddd87aa820 0x55ddd87acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2155231640 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ddd87aa820 0x55ddd87acc10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2155231640 1 -- 172.21.15.167:0/344427516 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87aa820 2024-09-18T02:04:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2157f22980 1 Processor -- start 2024-09-18T02:04:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2157f22980 1 -- start start 2024-09-18T02:04:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2157f22980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87bade0 0x55ddd87bb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2157f22980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ddd85af800 con 0x55ddd87bade0 2024-09-18T02:04:16.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2155a32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87bade0 0x55ddd87bb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2155a32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87bade0 0x55ddd87bb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60848/0 (socket says 172.21.15.167:60848) 2024-09-18T02:04:16.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2155a32640 1 -- 172.21.15.167:0/1334747961 learned_addr learned my addr 172.21.15.167:0/1334747961 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2155a32640 1 -- 172.21.15.167:0/1334747961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd87bb740 con 0x55ddd87bade0 2024-09-18T02:04:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.272+0000 7f2155a32640 1 --2- 172.21.15.167:0/1334747961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87bade0 0x55ddd87bb200 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f21480ab4f0 tx=0x7f21480b77f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f203b7fe640 1 -- 172.21.15.167:0/1334747961 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21480e1120 con 0x55ddd87bade0 2024-09-18T02:04:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f203b7fe640 1 -- 172.21.15.167:0/1334747961 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21480b5a30 con 0x55ddd87bade0 2024-09-18T02:04:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2157f22980 1 -- 172.21.15.167:0/1334747961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddd87bb9d0 con 0x55ddd87bade0 2024-09-18T02:04:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f203b7fe640 1 -- 172.21.15.167:0/1334747961 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21480b8030 con 0x55ddd87bade0 2024-09-18T02:04:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2157f22980 1 -- 172.21.15.167:0/1334747961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddd87be650 con 0x55ddd87bade0 2024-09-18T02:04:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f203b7fe640 1 -- 172.21.15.167:0/1334747961 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f21480b81d0 con 0x55ddd87bade0 2024-09-18T02:04:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f203b7fe640 1 --2- 172.21.15.167:0/1334747961 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2030034650 0x7f2030036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f203b7fe640 1 -- 172.21.15.167:0/1334747961 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f21480a8070 con 0x55ddd87bade0 2024-09-18T02:04:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2155231640 1 --2- 172.21.15.167:0/1334747961 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2030034650 0x7f2030036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2157f22980 1 Processor -- start 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2157f22980 1 -- start start 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2155231640 1 --2- 172.21.15.167:0/1334747961 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2030034650 0x7f2030036b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55ddd87a1680 tx=0x7f214c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2157f22980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2157f22980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ddd86a71b0 con 0x55ddd87c7700 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2155a32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2155a32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60850/0 (socket says 172.21.15.167:60850) 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2155a32640 1 -- 172.21.15.167:0/3407920647 learned_addr learned my addr 172.21.15.167:0/3407920647 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2155a32640 1 -- 172.21.15.167:0/3407920647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd87c80d0 con 0x55ddd87c7700 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f2155a32640 1 --2- 172.21.15.167:0/3407920647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87c7b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f21480b5d90 tx=0x7f21480de5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472cda6106b812a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f20397fa640 1 -- 172.21.15.167:0/3407920647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21480e2660 con 0x55ddd87c7700 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f20397fa640 1 -- 172.21.15.167:0/3407920647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21480ecc90 con 0x55ddd87c7700 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.276+0000 7f20397fa640 1 -- 172.21.15.167:0/3407920647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21480e2800 con 0x55ddd87c7700 2024-09-18T02:04:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 -- 172.21.15.167:0/3407920647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 msgr2=0x55ddd87c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 --2- 172.21.15.167:0/3407920647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87c7b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f21480b5d90 tx=0x7f21480de5d0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 -- 172.21.15.167:0/3407920647 shutdown_connections 2024-09-18T02:04:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 --2- 172.21.15.167:0/3407920647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87c7b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 -- 172.21.15.167:0/3407920647 >> 172.21.15.167:0/3407920647 conn(0x55ddd87c3b30 msgr2=0x55ddd87c1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 -- 172.21.15.167:0/3407920647 shutdown_connections 2024-09-18T02:04:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 -- 172.21.15.167:0/3407920647 wait complete. 2024-09-18T02:04:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 Processor -- start 2024-09-18T02:04:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 -- start start 2024-09-18T02:04:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ddd87c85a0 con 0x55ddd87c7700 2024-09-18T02:04:16.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2155a32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2155a32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:60856/0 (socket says 172.21.15.167:60856) 2024-09-18T02:04:16.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 learned_addr learned my addr 172.21.15.167:0/386294843 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd87cee70 con 0x55ddd87c7700 2024-09-18T02:04:16.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2155a32640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87ce930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f21480ecc10 tx=0x7f21480e7f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f20277fe640 1 -- 172.21.15.167:0/386294843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f214810c020 con 0x55ddd87c7700 2024-09-18T02:04:16.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddd87cee70 con 0x55ddd87c7700 2024-09-18T02:04:16.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f20277fe640 1 -- 172.21.15.167:0/386294843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21480e2b80 con 0x55ddd87c7700 2024-09-18T02:04:16.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f20277fe640 1 -- 172.21.15.167:0/386294843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21480eab40 con 0x55ddd87c7700 2024-09-18T02:04:16.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddd87cee70 con 0x55ddd87c7700 2024-09-18T02:04:16.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f20277fe640 1 -- 172.21.15.167:0/386294843 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f214810f020 con 0x55ddd87c7700 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f2157f22980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.280+0000 7f20277fe640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2020034650 0x7f2020036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f20277fe640 1 -- 172.21.15.167:0/386294843 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2148102040 con 0x55ddd87c7700 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2155231640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2020034650 0x7f2020036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ddd87d9a80 0x55ddd87dbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dc690 con 0x55ddd87d9a80 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2156233640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ddd87d9a80 0x55ddd87dbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2155231640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2020034650 0x7f2020036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55ddd87ad710 tx=0x7f214c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2156233640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ddd87d9a80 0x55ddd87dbf40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 20 realm 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dcaa0 con 0x55ddd87d9a80 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd340 con 0x55ddd87d9a80 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87d9a80 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:16.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ddd87de210 0x55ddd87e0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e0d40 con 0x55ddd87de210 2024-09-18T02:04:16.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2155a32640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ddd87de210 0x55ddd87e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.284+0000 7f2155a32640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ddd87de210 0x55ddd87e0600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2157f22980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:16.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2157f22980 20 searching for the correct realm 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2157f22980 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ddd87e2ce0 0x55ddd87e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e5850 con 0x55ddd87e2ce0 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2155231640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ddd87e2ce0 0x55ddd87e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2155231640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ddd87e2ce0 0x55ddd87e5180 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2155231640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f214c037040 0x7f214c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e5850 con 0x7f214c037040 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2156233640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f214c037040 0x7f214c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2156233640 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f214c037040 0x7f214c036410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87de210 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87d9a80 2024-09-18T02:04:16.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87d9a80 2024-09-18T02:04:16.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87de210 2024-09-18T02:04:16.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.288+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87de210 2024-09-18T02:04:16.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x7f214c037040 2024-09-18T02:04:16.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87d9a80 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87de210 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87d9a80 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x7f214c037040 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87de210 2024-09-18T02:04:16.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.292+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87d9a80 2024-09-18T02:04:16.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87d9a80 2024-09-18T02:04:16.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87de210 2024-09-18T02:04:16.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x7f214c037040 2024-09-18T02:04:16.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87d9a80 2024-09-18T02:04:16.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87de210 2024-09-18T02:04:16.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.296+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87de210 2024-09-18T02:04:16.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x7f214c037040 2024-09-18T02:04:16.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87de210 2024-09-18T02:04:16.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x55ddd87d9a80 2024-09-18T02:04:16.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87dd6e0 con 0x7f214c037040 2024-09-18T02:04:16.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e1600 con 0x55ddd87d9a80 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e1600 con 0x55ddd87d9a80 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:16.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e1600 con 0x55ddd87e2ce0 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 zone default found 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 4 Realm: () 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 zonegroup default 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e1ea0 con 0x55ddd87de210 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.300+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e76b0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2157f22980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2157f22980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e7a50 con 0x55ddd87e2ce0 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2157f22980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2157f22980 20 started sync module instance, tier type = 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2157f22980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e6b50 con 0x7f214c037040 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94411308298320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e6b50 con 0x7f214c037040 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e8490 con 0x55ddd87d9a80 2024-09-18T02:04:16.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94411308298320] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.304+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94411308302176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e6b50 con 0x55ddd87d9a80 2024-09-18T02:04:16.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.308+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e8ea0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.308+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.308+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94411308304880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87e96f0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.308+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87ea110 con 0x7f214c037040 2024-09-18T02:04:16.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.308+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94411308302176] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.308+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.308+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94411308309504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87ea500 con 0x7f214c037040 2024-09-18T02:04:16.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.308+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87eaec0 con 0x55ddd87d9a80 2024-09-18T02:04:16.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.308+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94411308304880] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.312+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94411308309504] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.312+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.312+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94411308295840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87eaa10 con 0x55ddd87d9a80 2024-09-18T02:04:16.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.312+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87eb260 con 0x55ddd87de210 2024-09-18T02:04:16.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.312+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94411308295840] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.312+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.312+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94411308313104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87eae30 con 0x55ddd87de210 2024-09-18T02:04:16.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.312+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87ebf60 con 0x55ddd87de210 2024-09-18T02:04:16.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.316+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.316+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94411308317872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87ec780 con 0x55ddd87de210 2024-09-18T02:04:16.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.316+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87ed2a0 con 0x55ddd87de210 2024-09-18T02:04:16.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.316+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94411308313104] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.316+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94411308317872] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94411308322160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87ec1d0 con 0x55ddd87de210 2024-09-18T02:04:16.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 20 add_watcher() i=0 2024-09-18T02:04:16.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 20 add_watcher() i=1 2024-09-18T02:04:16.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 20 add_watcher() i=2 2024-09-18T02:04:16.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 20 add_watcher() i=3 2024-09-18T02:04:16.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 20 add_watcher() i=4 2024-09-18T02:04:16.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 20 add_watcher() i=5 2024-09-18T02:04:16.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 20 add_watcher() i=6 2024-09-18T02:04:16.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94411308322160] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 20 add_watcher() i=7 2024-09-18T02:04:16.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:16.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87f0290 con 0x55ddd87d9a80 2024-09-18T02:04:16.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94411308316160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd87ed780 con 0x55ddd87d9a80 2024-09-18T02:04:16.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.320+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94411308316160] v30'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f20077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:16.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:16.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:16.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 5 note: GC not initialized 2024-09-18T02:04:16.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f20067fc640 20 reqs_thread_entry: start 2024-09-18T02:04:16.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:16.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 20 Filter name: none 2024-09-18T02:04:16.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f1f77fff640 20 reqs_thread_entry: start 2024-09-18T02:04:16.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813dd0 con 0x55ddd87d9a80 2024-09-18T02:04:16.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813dd0 con 0x7f214c037040 2024-09-18T02:04:16.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.324+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87de210 2024-09-18T02:04:16.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x7f214c037040 2024-09-18T02:04:16.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87de210 2024-09-18T02:04:16.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87de210 2024-09-18T02:04:16.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87de210 2024-09-18T02:04:16.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.328+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87de210 2024-09-18T02:04:16.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x7f214c037040 2024-09-18T02:04:16.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87de210 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.332+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87de210 2024-09-18T02:04:16.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.336+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.336+0000 7f20077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:16.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.336+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94411308316160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.336+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94411308316160] v30'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.336+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94411308298320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x7f214c037040 2024-09-18T02:04:16.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.336+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94411308298320] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.336+0000 7f2157f22980 20 remove_watcher() i=0 2024-09-18T02:04:16.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.336+0000 7f2157f22980 2 removed watcher, disabling cache 2024-09-18T02:04:16.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.336+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94411308302176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.340+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94411308302176] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.340+0000 7f2157f22980 20 remove_watcher() i=1 2024-09-18T02:04:16.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.340+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94411308304880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87e2ce0 2024-09-18T02:04:16.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.340+0000 7f2155231640 1 -- 172.21.15.167:0/386294843 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94411308304880] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f214c00e6c0 con 0x55ddd87e2ce0 2024-09-18T02:04:16.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.340+0000 7f2157f22980 20 remove_watcher() i=2 2024-09-18T02:04:16.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.340+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94411308309504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x7f214c037040 2024-09-18T02:04:16.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.344+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94411308309504] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x7f214c037040 2024-09-18T02:04:16.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.344+0000 7f2157f22980 20 remove_watcher() i=3 2024-09-18T02:04:16.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.344+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94411308295840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87d9a80 2024-09-18T02:04:16.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.344+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94411308295840] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215000a4d0 con 0x55ddd87d9a80 2024-09-18T02:04:16.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.344+0000 7f2157f22980 20 remove_watcher() i=4 2024-09-18T02:04:16.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.344+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94411308313104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87de210 2024-09-18T02:04:16.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.348+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94411308313104] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.348+0000 7f2157f22980 20 remove_watcher() i=5 2024-09-18T02:04:16.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.348+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94411308317872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87de210 2024-09-18T02:04:16.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.348+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94411308317872] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.348+0000 7f2157f22980 20 remove_watcher() i=6 2024-09-18T02:04:16.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.348+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94411308322160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddd8813d90 con 0x55ddd87de210 2024-09-18T02:04:16.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2155a32640 1 -- 172.21.15.167:0/386294843 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94411308322160] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21480b3040 con 0x55ddd87de210 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 20 remove_watcher() i=7 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ddd87de210 msgr2=0x55ddd87e0600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ddd87de210 0x55ddd87e0600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ddd87d9a80 msgr2=0x55ddd87dbf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ddd87d9a80 0x55ddd87dbf40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f214c037040 msgr2=0x7f214c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f214c037040 0x7f214c036410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ddd87e2ce0 msgr2=0x55ddd87e5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ddd87e2ce0 0x55ddd87e5180 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2020034650 msgr2=0x7f2020036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2020034650 0x7f2020036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55ddd87ad710 tx=0x7f214c010000 comp rx=0 tx=0).stop 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 msgr2=0x55ddd87ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87ce930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f21480ecc10 tx=0x7f21480e7f30 comp rx=0 tx=0).stop 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2156233640 1 -- 172.21.15.167:0/386294843 reap_dead start 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 shutdown_connections 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/386294843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87c7700 0x55ddd87ce930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 >> 172.21.15.167:0/386294843 conn(0x55ddd87c3b30 msgr2=0x55ddd87c1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 shutdown_connections 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/386294843 wait complete. 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/1334747961 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2030034650 msgr2=0x7f2030036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/1334747961 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2030034650 0x7f2030036b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55ddd87a1680 tx=0x7f214c00f000 comp rx=0 tx=0).stop 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/1334747961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87bade0 msgr2=0x55ddd87bb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/1334747961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87bade0 0x55ddd87bb200 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f21480ab4f0 tx=0x7f21480b77f0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/1334747961 shutdown_connections 2024-09-18T02:04:16.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/1334747961 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2030034650 0x7f2030036b10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/1334747961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd87bade0 0x55ddd87bb200 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/1334747961 >> 172.21.15.167:0/1334747961 conn(0x55ddd87aff30 msgr2=0x55ddd87b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/1334747961 shutdown_connections 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/1334747961 wait complete. 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ddd87a6770 msgr2=0x55ddd87a8c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ddd87a6770 0x55ddd87a8c30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ddd86ab860 msgr2=0x55ddd87a3f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ddd86ab860 0x55ddd87a3f00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ddd87aa820 msgr2=0x55ddd87acc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ddd87aa820 0x55ddd87acc10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f203c034650 msgr2=0x7f203c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f203c034650 0x7f203c036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f214c001da0 tx=0x7f214c001300 comp rx=0 tx=0).stop 2024-09-18T02:04:16.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 msgr2=0x55ddd879cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 --2- 172.21.15.167:0/344427516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddd861caf0 0x55ddd879cf70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f214801b2c0 tx=0x7f2148018020 comp rx=0 tx=0).stop 2024-09-18T02:04:16.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2156233640 1 -- 172.21.15.167:0/344427516 reap_dead start 2024-09-18T02:04:16.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 shutdown_connections 2024-09-18T02:04:16.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 >> 172.21.15.167:0/344427516 conn(0x55ddd86a3050 msgr2=0x55ddd86a76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 shutdown_connections 2024-09-18T02:04:16.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.352+0000 7f2157f22980 1 -- 172.21.15.167:0/344427516 wait complete. 2024-09-18T02:04:16.366 INFO:teuthology.orchestra.run.smithi167.stdout:{"entries":[],"summary":[]} 2024-09-18T02:04:16.366 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-18T02:04:16.367 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T02:04:16.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T02:04:16.367 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T02:04:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:16.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.440+0000 7f98be366980 1 Processor -- start 2024-09-18T02:04:16.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.440+0000 7f98be366980 1 -- start start 2024-09-18T02:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98be366980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562c6bb6fc60 0x562c6bb72050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98be366980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c6b9f1ae0 con 0x562c6bb6b8e0 2024-09-18T02:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98be366980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x562c6ba15e30 con 0x562c6bb6fc60 2024-09-18T02:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98bb675640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562c6bb6fc60 0x562c6bb72050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98bbe76640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x562c6bb6b8e0 0x562c6bb6bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55366/0 (socket says 172.21.15.167:55366) 2024-09-18T02:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98bbe76640 1 -- 172.21.15.167:0/3781079381 learned_addr learned my addr 172.21.15.167:0/3781079381 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98bb675640 1 -- 172.21.15.167:0/3781079381 >> v1:172.21.15.81:6789/0 conn(0x562c6bb6b8e0 legacy=0x562c6bb6bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98bb675640 1 -- 172.21.15.167:0/3781079381 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6bb735a0 con 0x562c6bb6fc60 2024-09-18T02:04:16.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98bb675640 1 --2- 172.21.15.167:0/3781079381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6fc60 0x562c6bb72050 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f98b000a480 tx=0x7f98b001b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c071af6acda38a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98bae74640 1 -- 172.21.15.167:0/3781079381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b00af070 con 0x562c6bb6fc60 2024-09-18T02:04:16.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98bae74640 1 -- 172.21.15.167:0/3781079381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b00a3e50 con 0x562c6bb6fc60 2024-09-18T02:04:16.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.444+0000 7f98bae74640 1 -- 172.21.15.167:0/3781079381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b00aa680 con 0x562c6bb6fc60 2024-09-18T02:04:16.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.448+0000 7f98be366980 1 -- 172.21.15.167:0/3781079381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6fc60 msgr2=0x562c6bb72050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.448+0000 7f98be366980 1 --2- 172.21.15.167:0/3781079381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6fc60 0x562c6bb72050 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f98b000a480 tx=0x7f98b001b110 comp rx=0 tx=0).stop 2024-09-18T02:04:16.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.448+0000 7f98be366980 1 -- 172.21.15.167:0/3781079381 shutdown_connections 2024-09-18T02:04:16.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.448+0000 7f98be366980 1 --2- 172.21.15.167:0/3781079381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6fc60 0x562c6bb72050 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.448+0000 7f98be366980 1 -- 172.21.15.167:0/3781079381 >> 172.21.15.167:0/3781079381 conn(0x562c6badf230 msgr2=0x562c6badf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.448+0000 7f98be366980 1 -- 172.21.15.167:0/3781079381 shutdown_connections 2024-09-18T02:04:16.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.448+0000 7f98be366980 1 -- 172.21.15.167:0/3781079381 wait complete. 2024-09-18T02:04:16.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 Processor -- start 2024-09-18T02:04:16.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 -- start start 2024-09-18T02:04:16.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 0x562c6bc56c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562c6ba17200 con 0x562c6bb6b8e0 2024-09-18T02:04:16.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98bbe76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 0x562c6bc56c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98bbe76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 0x562c6bc56c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55744/0 (socket says 172.21.15.167:55744) 2024-09-18T02:04:16.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98bbe76640 1 -- 172.21.15.167:0/4038684925 learned_addr learned my addr 172.21.15.167:0/4038684925 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98bbe76640 1 -- 172.21.15.167:0/4038684925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6bc57200 con 0x562c6bb6b8e0 2024-09-18T02:04:16.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98bbe76640 1 --2- 172.21.15.167:0/4038684925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 0x562c6bc56c30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00b3e0 tx=0x7f98ac00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97d972dc2adbd4a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f97a9e0b640 1 -- 172.21.15.167:0/4038684925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac00d700 con 0x562c6bb6b8e0 2024-09-18T02:04:16.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f97a9e0b640 1 -- 172.21.15.167:0/4038684925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ac008070 con 0x562c6bb6b8e0 2024-09-18T02:04:16.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f97a9e0b640 1 -- 172.21.15.167:0/4038684925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac00da10 con 0x562c6bb6b8e0 2024-09-18T02:04:16.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 -- 172.21.15.167:0/4038684925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 msgr2=0x562c6bc56c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 --2- 172.21.15.167:0/4038684925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 0x562c6bc56c30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00b3e0 tx=0x7f98ac00b8a0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 -- 172.21.15.167:0/4038684925 shutdown_connections 2024-09-18T02:04:16.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 --2- 172.21.15.167:0/4038684925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 0x562c6bc56c30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 -- 172.21.15.167:0/4038684925 >> 172.21.15.167:0/4038684925 conn(0x562c6badf230 msgr2=0x562c6bc52860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 -- 172.21.15.167:0/4038684925 shutdown_connections 2024-09-18T02:04:16.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 -- 172.21.15.167:0/4038684925 wait complete. 2024-09-18T02:04:16.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 Processor -- start 2024-09-18T02:04:16.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 -- start start 2024-09-18T02:04:16.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 0x562c6bc5e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98be366980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562c6bb730a0 con 0x562c6bb6b8e0 2024-09-18T02:04:16.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.464+0000 7f98bbe76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 0x562c6bc5e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98bbe76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 0x562c6bc5e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55754/0 (socket says 172.21.15.167:55754) 2024-09-18T02:04:16.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98bbe76640 1 -- 172.21.15.167:0/17793937 learned_addr learned my addr 172.21.15.167:0/17793937 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98bbe76640 1 -- 172.21.15.167:0/17793937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6bc5e570 con 0x562c6bb6b8e0 2024-09-18T02:04:16.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98bbe76640 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 0x562c6bc5e030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x562c6bc57e10 tx=0x7f98ac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f97a3fff640 1 -- 172.21.15.167:0/17793937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac01a7c0 con 0x562c6bb6b8e0 2024-09-18T02:04:16.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f97a3fff640 1 -- 172.21.15.167:0/17793937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ac01a960 con 0x562c6bb6b8e0 2024-09-18T02:04:16.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c6bc5e800 con 0x562c6bb6b8e0 2024-09-18T02:04:16.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f97a3fff640 1 -- 172.21.15.167:0/17793937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac01aca0 con 0x562c6bb6b8e0 2024-09-18T02:04:16.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c6bc614e0 con 0x562c6bb6b8e0 2024-09-18T02:04:16.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f97a3fff640 1 -- 172.21.15.167:0/17793937 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f98ac017070 con 0x562c6bb6b8e0 2024-09-18T02:04:16.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f97a3fff640 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f97a40346a0 0x7f97a4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f97a3fff640 1 -- 172.21.15.167:0/17793937 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f98ac015020 con 0x562c6bb6b8e0 2024-09-18T02:04:16.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98bb675640 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f97a40346a0 0x7f97a4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98be366980 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562c6bb6fc60 0x562c6bc65130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc656b0 con 0x562c6bb6fc60 2024-09-18T02:04:16.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98bc677640 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562c6bb6fc60 0x562c6bc65130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98bb675640 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f97a40346a0 0x7f97a4036b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f98b00ac000 tx=0x7f98b00a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.468+0000 7f98bc677640 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562c6bb6fc60 0x562c6bc65130 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98bc677640 1 -- 172.21.15.167:0/17793937 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bb6fc60 2024-09-18T02:04:16.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc62700 con 0x562c6bb6fc60 2024-09-18T02:04:16.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98bc677640 1 -- 172.21.15.167:0/17793937 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bb6fc60 2024-09-18T02:04:16.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98be366980 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562c6bc679e0 0x562c6bc69dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc6a4c0 con 0x562c6bc679e0 2024-09-18T02:04:16.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98bbe76640 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562c6bc679e0 0x562c6bc69dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98bbe76640 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562c6bc679e0 0x562c6bc69dd0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98bbe76640 1 -- 172.21.15.167:0/17793937 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc679e0 2024-09-18T02:04:16.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc66880 con 0x562c6bb6fc60 2024-09-18T02:04:16.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98bc677640 1 -- 172.21.15.167:0/17793937 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bb6fc60 2024-09-18T02:04:16.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98be366980 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562c6bc6b920 0x562c6bc6dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc6e480 con 0x562c6bc6b920 2024-09-18T02:04:16.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98bb675640 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562c6bc6b920 0x562c6bc6dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98bb675640 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562c6bc6b920 0x562c6bc6dd10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98bb675640 1 -- 172.21.15.167:0/17793937 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98b00b2040 con 0x562c6bc6b920 2024-09-18T02:04:16.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.472+0000 7f98be366980 1 Processor -- start 2024-09-18T02:04:16.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98be366980 1 -- start start 2024-09-18T02:04:16.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98be366980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc7bef0 0x562c6bc7c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98be366980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562c6ba70800 con 0x562c6bc7bef0 2024-09-18T02:04:16.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98bbe76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc7bef0 0x562c6bc7c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98bbe76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc7bef0 0x562c6bc7c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55756/0 (socket says 172.21.15.167:55756) 2024-09-18T02:04:16.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98bbe76640 1 -- 172.21.15.167:0/1502283408 learned_addr learned my addr 172.21.15.167:0/1502283408 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98bbe76640 1 -- 172.21.15.167:0/1502283408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6bc7c850 con 0x562c6bc7bef0 2024-09-18T02:04:16.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98bbe76640 1 --2- 172.21.15.167:0/1502283408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc7bef0 0x562c6bc7c310 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98ac01afb0 tx=0x7f98ac04a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f97a17fa640 1 -- 172.21.15.167:0/1502283408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac041070 con 0x562c6bc7bef0 2024-09-18T02:04:16.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f97a17fa640 1 -- 172.21.15.167:0/1502283408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ac0425f0 con 0x562c6bc7bef0 2024-09-18T02:04:16.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98be366980 1 -- 172.21.15.167:0/1502283408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c6bc7cae0 con 0x562c6bc7bef0 2024-09-18T02:04:16.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f97a17fa640 1 -- 172.21.15.167:0/1502283408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac0428d0 con 0x562c6bc7bef0 2024-09-18T02:04:16.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98be366980 1 -- 172.21.15.167:0/1502283408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c6bc7f760 con 0x562c6bc7bef0 2024-09-18T02:04:16.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f97a17fa640 1 -- 172.21.15.167:0/1502283408 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f98ac01b3d0 con 0x562c6bc7bef0 2024-09-18T02:04:16.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f97a17fa640 1 --2- 172.21.15.167:0/1502283408 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9794034650 0x7f9794036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f97a17fa640 1 -- 172.21.15.167:0/1502283408 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f98ac045050 con 0x562c6bc7bef0 2024-09-18T02:04:16.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98bb675640 1 --2- 172.21.15.167:0/1502283408 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9794034650 0x7f9794036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98be366980 1 Processor -- start 2024-09-18T02:04:16.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.476+0000 7f98be366980 1 -- start start 2024-09-18T02:04:16.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98bb675640 1 --2- 172.21.15.167:0/1502283408 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9794034650 0x7f9794036b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98b0018d40 tx=0x7f98b0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc88bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562c6bc57580 con 0x562c6bc887e0 2024-09-18T02:04:16.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98bbe76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc88bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98bbe76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc88bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55766/0 (socket says 172.21.15.167:55766) 2024-09-18T02:04:16.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98bbe76640 1 -- 172.21.15.167:0/1919195952 learned_addr learned my addr 172.21.15.167:0/1919195952 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98bbe76640 1 -- 172.21.15.167:0/1919195952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6bc89190 con 0x562c6bc887e0 2024-09-18T02:04:16.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98bbe76640 1 --2- 172.21.15.167:0/1919195952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc88bc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f98ac02ff10 tx=0x7f98ac03c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ece9bcd4174aa29 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f979affd640 1 -- 172.21.15.167:0/1919195952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac0474a0 con 0x562c6bc887e0 2024-09-18T02:04:16.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f979affd640 1 -- 172.21.15.167:0/1919195952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ac027d50 con 0x562c6bc887e0 2024-09-18T02:04:16.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f979affd640 1 -- 172.21.15.167:0/1919195952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac00f860 con 0x562c6bc887e0 2024-09-18T02:04:16.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 -- 172.21.15.167:0/1919195952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 msgr2=0x562c6bc88bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 --2- 172.21.15.167:0/1919195952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc88bc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f98ac02ff10 tx=0x7f98ac03c6b0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 -- 172.21.15.167:0/1919195952 shutdown_connections 2024-09-18T02:04:16.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 --2- 172.21.15.167:0/1919195952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc88bc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 -- 172.21.15.167:0/1919195952 >> 172.21.15.167:0/1919195952 conn(0x562c6bc84bc0 msgr2=0x562c6bc82cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 -- 172.21.15.167:0/1919195952 shutdown_connections 2024-09-18T02:04:16.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 -- 172.21.15.167:0/1919195952 wait complete. 2024-09-18T02:04:16.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 Processor -- start 2024-09-18T02:04:16.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 -- start start 2024-09-18T02:04:16.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc8f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98be366980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562c6bc89630 con 0x562c6bc887e0 2024-09-18T02:04:16.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98bbe76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc8f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98bbe76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc8f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55780/0 (socket says 172.21.15.167:55780) 2024-09-18T02:04:16.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 learned_addr learned my addr 172.21.15.167:0/2909206799 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.480+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6bc8fec0 con 0x562c6bc887e0 2024-09-18T02:04:16.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98bbe76640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc8f980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f98ac03c6f0 tx=0x7f98ac02fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f97997fa640 1 -- 172.21.15.167:0/2909206799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac034e30 con 0x562c6bc887e0 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c6bc8fec0 con 0x562c6bc887e0 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f97997fa640 1 -- 172.21.15.167:0/2909206799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ac01b8d0 con 0x562c6bc887e0 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f97997fa640 1 -- 172.21.15.167:0/2909206799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac027930 con 0x562c6bc887e0 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c6bc8fec0 con 0x562c6bc887e0 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f97997fa640 1 -- 172.21.15.167:0/2909206799 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f98ac070030 con 0x562c6bc887e0 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f97997fa640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9784034650 0x7f9784036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f97997fa640 1 -- 172.21.15.167:0/2909206799 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f98ac06e070 con 0x562c6bc887e0 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98bb675640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9784034650 0x7f9784036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562c6bc9aaa0 0x562c6bc9cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9d6b0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98bc677640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562c6bc9aaa0 0x562c6bc9cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98bb675640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9784034650 0x7f9784036b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98b001b150 tx=0x7f98b00b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98bc677640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562c6bc9aaa0 0x562c6bc9cf60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 20 realm 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9dac0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e360 con 0x562c6bc9aaa0 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.484+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x562c6bc9aaa0 2024-09-18T02:04:16.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98be366980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:16.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98be366980 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562c6bc9f460 0x562c6bca1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca1dd0 con 0x562c6bc9f460 2024-09-18T02:04:16.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bbe76640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562c6bc9f460 0x562c6bca1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bbe76640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562c6bc9f460 0x562c6bca1850 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98be366980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:16.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98be366980 20 searching for the correct realm 2024-09-18T02:04:16.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98be366980 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562c6bca3d00 0x562c6bca6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca6860 con 0x562c6bca3d00 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bb675640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562c6bca3d00 0x562c6bca6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bb675640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562c6bca3d00 0x562c6bca6190 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bb675640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f98b00cc040 0x7f98b00d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca6860 con 0x7f98b00cc040 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bc677640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f98b00cc040 0x7f98b00d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bc677640 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f98b00cc040 0x7f98b00d9410 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.488+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x562c6bc9f460 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x562c6bc9aaa0 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x562c6bc9aaa0 2024-09-18T02:04:16.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x562c6bc9f460 2024-09-18T02:04:16.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x562c6bc9f460 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x7f98b00cc040 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x562c6bca3d00 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x562c6bc9aaa0 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x562c6bc9f460 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.492+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x562c6bc9aaa0 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x7f98b00cc040 2024-09-18T02:04:16.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c6bc9e700 con 0x562c6bca3d00 2024-09-18T02:04:16.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bca3d00 2024-09-18T02:04:16.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bc9f460 2024-09-18T02:04:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bca3d00 2024-09-18T02:04:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bca3d00 2024-09-18T02:04:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bc9aaa0 2024-09-18T02:04:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bc9aaa0 2024-09-18T02:04:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bc9f460 2024-09-18T02:04:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bca3d00 2024-09-18T02:04:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.496+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x7f98b00cc040 2024-09-18T02:04:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bc9aaa0 2024-09-18T02:04:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bc9f460 2024-09-18T02:04:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bca3d00 2024-09-18T02:04:16.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bc9f460 2024-09-18T02:04:16.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x7f98b00cc040 2024-09-18T02:04:16.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bca3d00 2024-09-18T02:04:16.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bc9f460 2024-09-18T02:04:16.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x562c6bc9aaa0 2024-09-18T02:04:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.500+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f98b00e6080 con 0x7f98b00cc040 2024-09-18T02:04:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:16.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca2620 con 0x562c6bc9aaa0 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca2620 con 0x562c6bc9aaa0 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca2620 con 0x562c6bca3d00 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 zone default found 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 4 Realm: () 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 zonegroup default 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca2ec0 con 0x562c6bc9f460 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca86c0 con 0x562c6bca3d00 2024-09-18T02:04:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca8a60 con 0x562c6bca3d00 2024-09-18T02:04:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 started sync module instance, tier type = 2024-09-18T02:04:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:16.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca7b60 con 0x7f98b00cc040 2024-09-18T02:04:16.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94748786983040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca7b60 con 0x7f98b00cc040 2024-09-18T02:04:16.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.504+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca9460 con 0x562c6bc9aaa0 2024-09-18T02:04:16.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.508+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94748786983040] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.508+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.508+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94748786986864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca7b60 con 0x562c6bc9aaa0 2024-09-18T02:04:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.508+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bca9e70 con 0x562c6bca3d00 2024-09-18T02:04:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94748786989504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcaa6c0 con 0x562c6bca3d00 2024-09-18T02:04:16.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcab0c0 con 0x7f98b00cc040 2024-09-18T02:04:16.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94748786986864] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94748786980528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcab080 con 0x7f98b00cc040 2024-09-18T02:04:16.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcabad0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94748786989504] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94748786980528] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94748786994128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcab620 con 0x562c6bc9aaa0 2024-09-18T02:04:16.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.512+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcabe70 con 0x562c6bc9f460 2024-09-18T02:04:16.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.516+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94748786994128] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.516+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.516+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94748786996768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcaba40 con 0x562c6bc9f460 2024-09-18T02:04:16.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.516+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcacb70 con 0x562c6bc9f460 2024-09-18T02:04:16.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.516+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.516+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94748786996768] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.516+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94748787003152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcad330 con 0x562c6bc9f460 2024-09-18T02:04:16.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.516+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcadcf0 con 0x562c6bc9f460 2024-09-18T02:04:16.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.520+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.520+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94748787005504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcae110 con 0x562c6bc9f460 2024-09-18T02:04:16.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.520+0000 7f98be366980 20 add_watcher() i=0 2024-09-18T02:04:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.520+0000 7f98be366980 20 add_watcher() i=1 2024-09-18T02:04:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.520+0000 7f98be366980 20 add_watcher() i=2 2024-09-18T02:04:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.520+0000 7f98be366980 20 add_watcher() i=3 2024-09-18T02:04:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.520+0000 7f98be366980 20 add_watcher() i=4 2024-09-18T02:04:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.520+0000 7f98be366980 20 add_watcher() i=5 2024-09-18T02:04:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.520+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94748787003152] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.520+0000 7f98be366980 20 add_watcher() i=6 2024-09-18T02:04:16.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94748787005504] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 20 add_watcher() i=7 2024-09-18T02:04:16.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:16.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcae110 con 0x562c6bc9aaa0 2024-09-18T02:04:16.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94748787006560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcae080 con 0x562c6bc9aaa0 2024-09-18T02:04:16.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94748787006560] v30'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f97727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:16.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:16.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:16.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 5 note: GC not initialized 2024-09-18T02:04:16.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f97717e2640 20 reqs_thread_entry: start 2024-09-18T02:04:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 20 Filter name: none 2024-09-18T02:04:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f976a7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcd4370 con 0x562c6bc9aaa0 2024-09-18T02:04:16.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.524+0000 7f98be366980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.530 INFO:teuthology.orchestra.run.smithi167.stderr:could not fetch user info: no user info saved 2024-09-18T02:04:16.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.528+0000 7f97727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:16.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.528+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94748787006560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcd4330 con 0x562c6bc9aaa0 2024-09-18T02:04:16.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.528+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94748787006560] v30'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.528+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94748786983040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcd4330 con 0x7f98b00cc040 2024-09-18T02:04:16.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.528+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94748786983040] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.528+0000 7f98be366980 20 remove_watcher() i=0 2024-09-18T02:04:16.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.528+0000 7f98be366980 2 removed watcher, disabling cache 2024-09-18T02:04:16.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.528+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94748786986864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcd4330 con 0x562c6bc9aaa0 2024-09-18T02:04:16.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.532+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94748786986864] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.532+0000 7f98be366980 20 remove_watcher() i=1 2024-09-18T02:04:16.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.532+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94748786989504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcd4330 con 0x562c6bca3d00 2024-09-18T02:04:16.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.532+0000 7f98bb675640 1 -- 172.21.15.167:0/2909206799 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94748786989504] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b00d7070 con 0x562c6bca3d00 2024-09-18T02:04:16.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.532+0000 7f98be366980 20 remove_watcher() i=2 2024-09-18T02:04:16.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.532+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94748786980528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcd4330 con 0x7f98b00cc040 2024-09-18T02:04:16.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.536+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94748786980528] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x7f98b00cc040 2024-09-18T02:04:16.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.536+0000 7f98be366980 20 remove_watcher() i=3 2024-09-18T02:04:16.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.536+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94748786994128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcd4330 con 0x562c6bc9aaa0 2024-09-18T02:04:16.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.536+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94748786994128] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b400a4d0 con 0x562c6bc9aaa0 2024-09-18T02:04:16.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.536+0000 7f98be366980 20 remove_watcher() i=4 2024-09-18T02:04:16.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.536+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94748786996768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcd4330 con 0x562c6bc9f460 2024-09-18T02:04:16.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.540+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94748786996768] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.540+0000 7f98be366980 20 remove_watcher() i=5 2024-09-18T02:04:16.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.540+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94748787003152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcd4330 con 0x562c6bc9f460 2024-09-18T02:04:16.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.540+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94748787003152] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.540+0000 7f98be366980 20 remove_watcher() i=6 2024-09-18T02:04:16.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.540+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94748787005504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c6bcd4330 con 0x562c6bc9f460 2024-09-18T02:04:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98bbe76640 1 -- 172.21.15.167:0/2909206799 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94748787005504] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac02e070 con 0x562c6bc9f460 2024-09-18T02:04:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 20 remove_watcher() i=7 2024-09-18T02:04:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562c6bc9f460 msgr2=0x562c6bca1850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562c6bc9f460 0x562c6bca1850 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562c6bc9aaa0 msgr2=0x562c6bc9cf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562c6bc9aaa0 0x562c6bc9cf60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f98b00cc040 msgr2=0x7f98b00d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f98b00cc040 0x7f98b00d9410 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562c6bca3d00 msgr2=0x562c6bca6190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562c6bca3d00 0x562c6bca6190 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9784034650 msgr2=0x7f9784036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9784034650 0x7f9784036b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98b001b150 tx=0x7f98b00b8040 comp rx=0 tx=0).stop 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 msgr2=0x562c6bc8f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc8f980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f98ac03c6f0 tx=0x7f98ac02fea0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98bc677640 1 -- 172.21.15.167:0/2909206799 reap_dead start 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 shutdown_connections 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/2909206799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc887e0 0x562c6bc8f980 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 >> 172.21.15.167:0/2909206799 conn(0x562c6bc84bc0 msgr2=0x562c6bc82c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 shutdown_connections 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/2909206799 wait complete. 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/1502283408 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9794034650 msgr2=0x7f9794036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/1502283408 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9794034650 0x7f9794036b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98b0018d40 tx=0x7f98b0005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/1502283408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc7bef0 msgr2=0x562c6bc7c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/1502283408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc7bef0 0x562c6bc7c310 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98ac01afb0 tx=0x7f98ac04a2b0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/1502283408 shutdown_connections 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/1502283408 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9794034650 0x7f9794036b10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/1502283408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bc7bef0 0x562c6bc7c310 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/1502283408 >> 172.21.15.167:0/1502283408 conn(0x562c6bc71040 msgr2=0x562c6bc73ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/1502283408 shutdown_connections 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/1502283408 wait complete. 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562c6bc679e0 msgr2=0x562c6bc69dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562c6bc679e0 0x562c6bc69dd0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562c6bb6fc60 msgr2=0x562c6bc65130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562c6bb6fc60 0x562c6bc65130 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562c6bc6b920 msgr2=0x562c6bc6dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562c6bc6b920 0x562c6bc6dd10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f97a40346a0 msgr2=0x7f97a4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f97a40346a0 0x7f97a4036b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f98b00ac000 tx=0x7f98b00a5000 comp rx=0 tx=0).stop 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 msgr2=0x562c6bc5e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 --2- 172.21.15.167:0/17793937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c6bb6b8e0 0x562c6bc5e030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x562c6bc57e10 tx=0x7f98ac000bd0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98bc677640 1 -- 172.21.15.167:0/17793937 reap_dead start 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 shutdown_connections 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 >> 172.21.15.167:0/17793937 conn(0x562c6badf230 msgr2=0x562c6bc513e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 shutdown_connections 2024-09-18T02:04:16.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.544+0000 7f98be366980 1 -- 172.21.15.167:0/17793937 wait complete. 2024-09-18T02:04:16.558 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T02:04:16.559 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-18T02:04:16.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-18T02:04:16.559 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-18T02:04:16.645 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:16.646 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:16.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.644+0000 7f8991c76980 1 Processor -- start 2024-09-18T02:04:16.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.644+0000 7f8991c76980 1 -- start start 2024-09-18T02:04:16.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.644+0000 7f8991c76980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564eb00b54e0 0x564eb00b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.644+0000 7f8991c76980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564eaff3eae0 con 0x564eb00b5e30 2024-09-18T02:04:16.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.644+0000 7f8991c76980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x564eaff62e30 con 0x564eb00b54e0 2024-09-18T02:04:16.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.644+0000 7f898f786640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564eb00b54e0 0x564eb00b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.644+0000 7f898f786640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564eb00b54e0 0x564eb00b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55796/0 (socket says 172.21.15.167:55796) 2024-09-18T02:04:16.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.644+0000 7f898ef85640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x564eb00b5e30 0x564eb00ba8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55370/0 (socket says 172.21.15.167:55370) 2024-09-18T02:04:16.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.644+0000 7f898f786640 1 -- 172.21.15.167:0/3928318074 learned_addr learned my addr 172.21.15.167:0/3928318074 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.644+0000 7f898f786640 1 -- 172.21.15.167:0/3928318074 >> v1:172.21.15.81:6789/0 conn(0x564eb00b5e30 legacy=0x564eb00ba8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.644+0000 7f898f786640 1 -- 172.21.15.167:0/3928318074 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb00bd100 con 0x564eb00b54e0 2024-09-18T02:04:16.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.648+0000 7f898f786640 1 --2- 172.21.15.167:0/3928318074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b54e0 0x564eb00b58c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f898000a5c0 tx=0x7f898001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adcdf682a2c1f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.648+0000 7f898e784640 1 -- 172.21.15.167:0/3928318074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800a6070 con 0x564eb00b54e0 2024-09-18T02:04:16.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.648+0000 7f898e784640 1 -- 172.21.15.167:0/3928318074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89800af070 con 0x564eb00b54e0 2024-09-18T02:04:16.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.648+0000 7f898e784640 1 -- 172.21.15.167:0/3928318074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800aa5c0 con 0x564eb00b54e0 2024-09-18T02:04:16.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.648+0000 7f8991c76980 1 -- 172.21.15.167:0/3928318074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b54e0 msgr2=0x564eb00b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.648+0000 7f8991c76980 1 --2- 172.21.15.167:0/3928318074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b54e0 0x564eb00b58c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f898000a5c0 tx=0x7f898001b340 comp rx=0 tx=0).stop 2024-09-18T02:04:16.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.648+0000 7f8991c76980 1 -- 172.21.15.167:0/3928318074 shutdown_connections 2024-09-18T02:04:16.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.648+0000 7f8991c76980 1 --2- 172.21.15.167:0/3928318074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b54e0 0x564eb00b58c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.648+0000 7f8991c76980 1 -- 172.21.15.167:0/3928318074 >> 172.21.15.167:0/3928318074 conn(0x564eb00b1000 msgr2=0x564eb00b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.648+0000 7f8991c76980 1 -- 172.21.15.167:0/3928318074 shutdown_connections 2024-09-18T02:04:16.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.648+0000 7f8991c76980 1 -- 172.21.15.167:0/3928318074 wait complete. 2024-09-18T02:04:16.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f8991c76980 1 Processor -- start 2024-09-18T02:04:16.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f8991c76980 1 -- start start 2024-09-18T02:04:16.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f8991c76980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 0x564eb00c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f8991c76980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564eaff64200 con 0x564eb00b5e30 2024-09-18T02:04:16.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f898f786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 0x564eb00c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f898f786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 0x564eb00c0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55806/0 (socket says 172.21.15.167:55806) 2024-09-18T02:04:16.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f898f786640 1 -- 172.21.15.167:0/1783371346 learned_addr learned my addr 172.21.15.167:0/1783371346 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f898f786640 1 -- 172.21.15.167:0/1783371346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb00c12f0 con 0x564eb00b5e30 2024-09-18T02:04:16.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f898f786640 1 --2- 172.21.15.167:0/1783371346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 0x564eb00c0d20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8980018f70 tx=0x7f8980003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a4c045bc041e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f887d60a640 1 -- 172.21.15.167:0/1783371346 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800aa990 con 0x564eb00b5e30 2024-09-18T02:04:16.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f887d60a640 1 -- 172.21.15.167:0/1783371346 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89800aab30 con 0x564eb00b5e30 2024-09-18T02:04:16.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f887d60a640 1 -- 172.21.15.167:0/1783371346 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800aae10 con 0x564eb00b5e30 2024-09-18T02:04:16.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f8991c76980 1 -- 172.21.15.167:0/1783371346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 msgr2=0x564eb00c0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f8991c76980 1 --2- 172.21.15.167:0/1783371346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 0x564eb00c0d20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8980018f70 tx=0x7f8980003030 comp rx=0 tx=0).stop 2024-09-18T02:04:16.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f8991c76980 1 -- 172.21.15.167:0/1783371346 shutdown_connections 2024-09-18T02:04:16.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f8991c76980 1 --2- 172.21.15.167:0/1783371346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 0x564eb00c0d20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f8991c76980 1 -- 172.21.15.167:0/1783371346 >> 172.21.15.167:0/1783371346 conn(0x564eb00b1000 msgr2=0x564eb019d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f8991c76980 1 -- 172.21.15.167:0/1783371346 shutdown_connections 2024-09-18T02:04:16.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.664+0000 7f8991c76980 1 -- 172.21.15.167:0/1783371346 wait complete. 2024-09-18T02:04:16.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f8991c76980 1 Processor -- start 2024-09-18T02:04:16.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f8991c76980 1 -- start start 2024-09-18T02:04:16.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f8991c76980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 0x564eb01ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f8991c76980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564eb00bcb40 con 0x564eb00b5e30 2024-09-18T02:04:16.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f898f786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 0x564eb01ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f898f786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 0x564eb01ab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55808/0 (socket says 172.21.15.167:55808) 2024-09-18T02:04:16.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f898f786640 1 -- 172.21.15.167:0/2621871634 learned_addr learned my addr 172.21.15.167:0/2621871634 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f898f786640 1 -- 172.21.15.167:0/2621871634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb01ab610 con 0x564eb00b5e30 2024-09-18T02:04:16.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f898f786640 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 0x564eb01ab0d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8980005aa0 tx=0x7f89800180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f887be07640 1 -- 172.21.15.167:0/2621871634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800cb030 con 0x564eb00b5e30 2024-09-18T02:04:16.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564eb01ab8a0 con 0x564eb00b5e30 2024-09-18T02:04:16.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f887be07640 1 -- 172.21.15.167:0/2621871634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8980000e50 con 0x564eb00b5e30 2024-09-18T02:04:16.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f887be07640 1 -- 172.21.15.167:0/2621871634 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800bd930 con 0x564eb00b5e30 2024-09-18T02:04:16.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eb01ae580 con 0x564eb00b5e30 2024-09-18T02:04:16.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f887be07640 1 -- 172.21.15.167:0/2621871634 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89800ce070 con 0x564eb00b5e30 2024-09-18T02:04:16.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.668+0000 7f887be07640 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8874034650 0x7f8874036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f887be07640 1 -- 172.21.15.167:0/2621871634 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f89800cc070 con 0x564eb00b5e30 2024-09-18T02:04:16.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f898ef85640 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8874034650 0x7f8874036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f8991c76980 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564eb01b0050 0x564eb01b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01b2a80 con 0x564eb01b0050 2024-09-18T02:04:16.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f898ff87640 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564eb01b0050 0x564eb01b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f898ef85640 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8874034650 0x7f8874036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8984000f70 tx=0x7f8984001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f898ff87640 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564eb01b0050 0x564eb01b2440 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f898ff87640 1 -- 172.21.15.167:0/2621871634 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01b0050 2024-09-18T02:04:16.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01af780 con 0x564eb01b0050 2024-09-18T02:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f898ff87640 1 -- 172.21.15.167:0/2621871634 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01b0050 2024-09-18T02:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f8991c76980 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564eb01b4db0 0x564eb01b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01b7870 con 0x564eb01b4db0 2024-09-18T02:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f898f786640 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564eb01b4db0 0x564eb01b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f898f786640 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564eb01b4db0 0x564eb01b71a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f898f786640 1 -- 172.21.15.167:0/2621871634 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89800c69b0 con 0x564eb01b4db0 2024-09-18T02:04:16.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01b3c50 con 0x564eb01b0050 2024-09-18T02:04:16.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f898ff87640 1 -- 172.21.15.167:0/2621871634 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01b0050 2024-09-18T02:04:16.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f8991c76980 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564eb01b8cb0 0x564eb01bb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01bb830 con 0x564eb01b8cb0 2024-09-18T02:04:16.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.672+0000 7f898ef85640 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564eb01b8cb0 0x564eb01bb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f898ef85640 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564eb01b8cb0 0x564eb01bb0a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f898ef85640 1 -- 172.21.15.167:0/2621871634 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f898400f6a0 con 0x564eb01b8cb0 2024-09-18T02:04:16.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8991c76980 1 Processor -- start 2024-09-18T02:04:16.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8991c76980 1 -- start start 2024-09-18T02:04:16.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8991c76980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01c92c0 0x564eb01c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8991c76980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564eaffbd800 con 0x564eb01c92c0 2024-09-18T02:04:16.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f898f786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01c92c0 0x564eb01c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f898f786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01c92c0 0x564eb01c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55822/0 (socket says 172.21.15.167:55822) 2024-09-18T02:04:16.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f898f786640 1 -- 172.21.15.167:0/395381220 learned_addr learned my addr 172.21.15.167:0/395381220 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f898f786640 1 -- 172.21.15.167:0/395381220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb01c9c20 con 0x564eb01c92c0 2024-09-18T02:04:16.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f898f786640 1 --2- 172.21.15.167:0/395381220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01c92c0 0x564eb01c96e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f89800cf460 tx=0x7f89800c6710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8879602640 1 -- 172.21.15.167:0/395381220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800bddb0 con 0x564eb01c92c0 2024-09-18T02:04:16.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8991c76980 1 -- 172.21.15.167:0/395381220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564eb01c9e50 con 0x564eb01c92c0 2024-09-18T02:04:16.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8879602640 1 -- 172.21.15.167:0/395381220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89800e50b0 con 0x564eb01c92c0 2024-09-18T02:04:16.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8879602640 1 -- 172.21.15.167:0/395381220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800e53b0 con 0x564eb01c92c0 2024-09-18T02:04:16.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8991c76980 1 -- 172.21.15.167:0/395381220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eb01cca70 con 0x564eb01c92c0 2024-09-18T02:04:16.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8879602640 1 -- 172.21.15.167:0/395381220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89800c5720 con 0x564eb01c92c0 2024-09-18T02:04:16.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8879602640 1 --2- 172.21.15.167:0/395381220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8868034650 0x7f8868036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.676+0000 7f8879602640 1 -- 172.21.15.167:0/395381220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f89800f0b00 con 0x564eb01c92c0 2024-09-18T02:04:16.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f898ef85640 1 --2- 172.21.15.167:0/395381220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8868034650 0x7f8868036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 Processor -- start 2024-09-18T02:04:16.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 -- start start 2024-09-18T02:04:16.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f898ef85640 1 --2- 172.21.15.167:0/395381220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8868034650 0x7f8868036b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x564eb01bbc30 tx=0x7f898400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01d5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564eb00bf450 con 0x564eb01d5870 2024-09-18T02:04:16.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f898f786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f898f786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01d5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55836/0 (socket says 172.21.15.167:55836) 2024-09-18T02:04:16.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f898f786640 1 -- 172.21.15.167:0/1228171874 learned_addr learned my addr 172.21.15.167:0/1228171874 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f898f786640 1 -- 172.21.15.167:0/1228171874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb01d6220 con 0x564eb01d5870 2024-09-18T02:04:16.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f898f786640 1 --2- 172.21.15.167:0/1228171874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01d5c50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f89800da010 tx=0x7f89800b5ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfb8ea344b807e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8872ffd640 1 -- 172.21.15.167:0/1228171874 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800f0e20 con 0x564eb01d5870 2024-09-18T02:04:16.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8872ffd640 1 -- 172.21.15.167:0/1228171874 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89800c5a10 con 0x564eb01d5870 2024-09-18T02:04:16.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8872ffd640 1 -- 172.21.15.167:0/1228171874 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800cf6f0 con 0x564eb01d5870 2024-09-18T02:04:16.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 -- 172.21.15.167:0/1228171874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 msgr2=0x564eb01d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 --2- 172.21.15.167:0/1228171874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01d5c50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f89800da010 tx=0x7f89800b5ba0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 -- 172.21.15.167:0/1228171874 shutdown_connections 2024-09-18T02:04:16.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 --2- 172.21.15.167:0/1228171874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01d5c50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 -- 172.21.15.167:0/1228171874 >> 172.21.15.167:0/1228171874 conn(0x564eb01d1c50 msgr2=0x564eb01cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 -- 172.21.15.167:0/1228171874 shutdown_connections 2024-09-18T02:04:16.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 -- 172.21.15.167:0/1228171874 wait complete. 2024-09-18T02:04:16.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 Processor -- start 2024-09-18T02:04:16.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 -- start start 2024-09-18T02:04:16.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01dc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f8991c76980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564eb01d6220 con 0x564eb01d5870 2024-09-18T02:04:16.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f898f786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01dc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f898f786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01dc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55838/0 (socket says 172.21.15.167:55838) 2024-09-18T02:04:16.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.680+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 learned_addr learned my addr 172.21.15.167:0/2214089622 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb01dce90 con 0x564eb01d5870 2024-09-18T02:04:16.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f898f786640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01dc950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f89800e5ab0 tx=0x7f89800b0f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f88717fa640 1 -- 172.21.15.167:0/2214089622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f898010e070 con 0x564eb01d5870 2024-09-18T02:04:16.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564eb01dce90 con 0x564eb01d5870 2024-09-18T02:04:16.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f88717fa640 1 -- 172.21.15.167:0/2214089622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89800cf6f0 con 0x564eb01d5870 2024-09-18T02:04:16.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f88717fa640 1 -- 172.21.15.167:0/2214089622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800cbbc0 con 0x564eb01d5870 2024-09-18T02:04:16.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eb01dce90 con 0x564eb01d5870 2024-09-18T02:04:16.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f88717fa640 1 -- 172.21.15.167:0/2214089622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8980111070 con 0x564eb01d5870 2024-09-18T02:04:16.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f88717fa640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8858034650 0x7f8858036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f88717fa640 1 -- 172.21.15.167:0/2214089622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8980104030 con 0x564eb01d5870 2024-09-18T02:04:16.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f898ef85640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8858034650 0x7f8858036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f8991c76980 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564eb01e7850 0x564eb01e9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01ea440 con 0x564eb01e7850 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f898ff87640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564eb01e7850 0x564eb01e9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f898ef85640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8858034650 0x7f8858036b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f898400c010 tx=0x7f8984010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f898ff87640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564eb01e7850 0x564eb01e9cf0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f8991c76980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f8991c76980 20 realm 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.684+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01ea850 con 0x564eb01e7850 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb0f0 con 0x564eb01e7850 2024-09-18T02:04:16.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01e7850 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564eb01ec1f0 0x564eb01ee5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eec30 con 0x564eb01ec1f0 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898f786640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564eb01ec1f0 0x564eb01ee5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898f786640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564eb01ec1f0 0x564eb01ee5e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:16.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 20 searching for the correct realm 2024-09-18T02:04:16.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564eb01f0b10 0x564eb01f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f3600 con 0x564eb01f0b10 2024-09-18T02:04:16.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898ef85640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564eb01f0b10 0x564eb01f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898ef85640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564eb01f0b10 0x564eb01f2f80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898ef85640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f898401fbe0 0x7f898403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f3600 con 0x7f898401fbe0 2024-09-18T02:04:16.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898ff87640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f898401fbe0 0x7f898403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.688+0000 7f898ff87640 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f898401fbe0 0x7f898403a3c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01ec1f0 2024-09-18T02:04:16.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01e7850 2024-09-18T02:04:16.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01e7850 2024-09-18T02:04:16.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01ec1f0 2024-09-18T02:04:16.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01ec1f0 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x7f898401fbe0 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01f0b10 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01e7850 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.692+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01ec1f0 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01e7850 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x7f898401fbe0 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01f0b10 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01f0b10 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01ec1f0 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01f0b10 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01f0b10 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01e7850 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01e7850 2024-09-18T02:04:16.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.696+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01ec1f0 2024-09-18T02:04:16.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01f0b10 2024-09-18T02:04:16.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x7f898401fbe0 2024-09-18T02:04:16.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01e7850 2024-09-18T02:04:16.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01ec1f0 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01f0b10 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01ec1f0 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x7f898401fbe0 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01f0b10 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.700+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01ec1f0 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x564eb01e7850 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564eb01eb490 con 0x7f898401fbe0 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01ef480 con 0x564eb01e7850 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01ef480 con 0x564eb01e7850 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01ef480 con 0x564eb01f0b10 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 zone default found 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 4 Realm: () 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:16.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 zonegroup default 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01efe50 con 0x564eb01ec1f0 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01ef9b0 con 0x564eb01f0b10 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f59d0 con 0x564eb01f0b10 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 started sync module instance, tier type = 2024-09-18T02:04:16.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:16.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.704+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f4da0 con 0x7f898401fbe0 2024-09-18T02:04:16.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.708+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.708+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94895962280640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f4da0 con 0x7f898401fbe0 2024-09-18T02:04:16.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.708+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f64e0 con 0x564eb01e7850 2024-09-18T02:04:16.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.708+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94895962280640] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.708+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.708+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94895962283984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f4da0 con 0x564eb01e7850 2024-09-18T02:04:16.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.708+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f6ef0 con 0x564eb01f0b10 2024-09-18T02:04:16.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.712+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94895962283984] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.712+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.712+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94895962278128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f4d10 con 0x564eb01f0b10 2024-09-18T02:04:16.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.712+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f7c80 con 0x7f898401fbe0 2024-09-18T02:04:16.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.712+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.712+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94895962290064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f8520 con 0x7f898401fbe0 2024-09-18T02:04:16.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.712+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f8f20 con 0x564eb01e7850 2024-09-18T02:04:16.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.712+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94895962278128] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.712+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94895962290064] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.716+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.716+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94895962288864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f7ff0 con 0x564eb01e7850 2024-09-18T02:04:16.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.716+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f97c0 con 0x564eb01ec1f0 2024-09-18T02:04:16.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.716+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94895962288864] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.720+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.720+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94895962297104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f7ff0 con 0x564eb01ec1f0 2024-09-18T02:04:16.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.720+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01fa010 con 0x564eb01ec1f0 2024-09-18T02:04:16.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94895962297104] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94895962294832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01fa860 con 0x564eb01ec1f0 2024-09-18T02:04:16.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01fb110 con 0x564eb01ec1f0 2024-09-18T02:04:16.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94895962294832] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94895962301360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01fb2f0 con 0x564eb01ec1f0 2024-09-18T02:04:16.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f8991c76980 20 add_watcher() i=0 2024-09-18T02:04:16.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f8991c76980 20 add_watcher() i=1 2024-09-18T02:04:16.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f8991c76980 20 add_watcher() i=2 2024-09-18T02:04:16.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f8991c76980 20 add_watcher() i=3 2024-09-18T02:04:16.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f8991c76980 20 add_watcher() i=4 2024-09-18T02:04:16.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f8991c76980 20 add_watcher() i=5 2024-09-18T02:04:16.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.724+0000 7f8991c76980 20 add_watcher() i=6 2024-09-18T02:04:16.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94895962301360] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 20 add_watcher() i=7 2024-09-18T02:04:16.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:16.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb01fe6c0 con 0x564eb01e7850 2024-09-18T02:04:16.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94895962304992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01fbab0 con 0x564eb01e7850 2024-09-18T02:04:16.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94895962304992] v30'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8845fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:16.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:16.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:16.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 5 note: GC not initialized 2024-09-18T02:04:16.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8844fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:16.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:16.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 20 Filter name: none 2024-09-18T02:04:16.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f87be7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:16.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:16.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.728+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb0221c90 con 0x564eb01e7850 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb0220430 con 0x564eb01e7850 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T02:04:16.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-18T02:04:16.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb0220430 con 0x564eb01ec1f0 2024-09-18T02:04:16.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-18T02:04:16.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-18T02:04:16.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb0220dc0 con 0x564eb01e7850 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94895962458224 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb02257b0 con 0x564eb01e7850 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== watch-notify(notify (1) cookie 94895962288864 notify 128849018880 ret 0) ==== 609+0+0 (crc 0 0 0) 0x564eb0221160 con 0x564eb01e7850 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8872ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94895962288864 notifier 4298 bl.length()=567 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(66 notify.4 [notify cookie 94895962458224 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8872ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8872ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:16.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8872ffd640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8854003eb0 con 0x564eb01e7850 2024-09-18T02:04:16.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== watch-notify(notify_complete (2) cookie 94895962458224 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564eb02218b0 con 0x564eb01e7850 2024-09-18T02:04:16.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.732+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb0220870 con 0x564eb01e7850 2024-09-18T02:04:16.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f8991c76980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-18T02:04:16.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f8991c76980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T02:04:16.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f8991c76980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-18T02:04:16.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94895962458224 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb0225be0 con 0x7f898401fbe0 2024-09-18T02:04:16.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== watch-notify(notify (1) cookie 94895962290064 notify 128849018880 ret 0) ==== 211+0+0 (crc 0 0 0) 0x564eb02218b0 con 0x7f898401fbe0 2024-09-18T02:04:16.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f8872ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94895962290064 notifier 4298 bl.length()=169 2024-09-18T02:04:16.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f8872ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-18T02:04:16.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f8872ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T02:04:16.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(69 notify.3 [notify cookie 94895962458224 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f8872ffd640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8854003eb0 con 0x7f898401fbe0 2024-09-18T02:04:16.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== watch-notify(notify_complete (2) cookie 94895962458224 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f89880266f0 con 0x7f898401fbe0 2024-09-18T02:04:16.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.736+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb0223870 con 0x564eb01ec1f0 2024-09-18T02:04:16.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f8991c76980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-18T02:04:16.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f8991c76980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-18T02:04:16.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f8991c76980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-18T02:04:16.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94895962468960 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564eb0223870 con 0x7f898401fbe0 2024-09-18T02:04:16.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== watch-notify(notify (1) cookie 94895962290064 notify 128849018881 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f89880266f0 con 0x7f898401fbe0 2024-09-18T02:04:16.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f88727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94895962290064 notifier 4298 bl.length()=177 2024-09-18T02:04:16.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f88727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-18T02:04:16.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f88727fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-18T02:04:16.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(72 notify.3 [notify cookie 94895962468960 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f88727fc640 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f87c4003410 con 0x7f898401fbe0 2024-09-18T02:04:16.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== watch-notify(notify_complete (2) cookie 94895962468960 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8988026ba0 con 0x7f898401fbe0 2024-09-18T02:04:16.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.745 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:16.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f8845fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:16.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.740+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94895962304992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb021fa30 con 0x564eb01e7850 2024-09-18T02:04:16.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.744+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94895962304992] v30'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.744+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94895962280640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb021fa30 con 0x7f898401fbe0 2024-09-18T02:04:16.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.744+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94895962280640] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.744+0000 7f8991c76980 20 remove_watcher() i=0 2024-09-18T02:04:16.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.744+0000 7f8991c76980 2 removed watcher, disabling cache 2024-09-18T02:04:16.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.744+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94895962283984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f52c0 con 0x564eb01e7850 2024-09-18T02:04:16.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.744+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94895962283984] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.744+0000 7f8991c76980 20 remove_watcher() i=1 2024-09-18T02:04:16.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.744+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94895962278128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb021fa30 con 0x564eb01f0b10 2024-09-18T02:04:16.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.748+0000 7f898ef85640 1 -- 172.21.15.167:0/2214089622 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94895962278128] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984037040 con 0x564eb01f0b10 2024-09-18T02:04:16.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.748+0000 7f8991c76980 20 remove_watcher() i=2 2024-09-18T02:04:16.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.748+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94895962290064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f5fd0 con 0x7f898401fbe0 2024-09-18T02:04:16.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.748+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94895962290064] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x7f898401fbe0 2024-09-18T02:04:16.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.748+0000 7f8991c76980 20 remove_watcher() i=3 2024-09-18T02:04:16.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.748+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94895962288864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f52c0 con 0x564eb01e7850 2024-09-18T02:04:16.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.752+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94895962288864] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898800a4d0 con 0x564eb01e7850 2024-09-18T02:04:16.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.752+0000 7f8991c76980 20 remove_watcher() i=4 2024-09-18T02:04:16.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.752+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94895962297104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f48f0 con 0x564eb01ec1f0 2024-09-18T02:04:16.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.752+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94895962297104] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.752+0000 7f8991c76980 20 remove_watcher() i=5 2024-09-18T02:04:16.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.752+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94895962294832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f5fd0 con 0x564eb01ec1f0 2024-09-18T02:04:16.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.756+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94895962294832] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.756+0000 7f8991c76980 20 remove_watcher() i=6 2024-09-18T02:04:16.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.756+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94895962301360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564eb01f72e0 con 0x564eb01ec1f0 2024-09-18T02:04:16.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f898f786640 1 -- 172.21.15.167:0/2214089622 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94895962301360] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8980110030 con 0x564eb01ec1f0 2024-09-18T02:04:16.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 20 remove_watcher() i=7 2024-09-18T02:04:16.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564eb01ec1f0 msgr2=0x564eb01ee5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564eb01ec1f0 0x564eb01ee5e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564eb01e7850 msgr2=0x564eb01e9cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564eb01e7850 0x564eb01e9cf0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f898401fbe0 msgr2=0x7f898403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f898401fbe0 0x7f898403a3c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564eb01f0b10 msgr2=0x564eb01f2f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564eb01f0b10 0x564eb01f2f80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8858034650 msgr2=0x7f8858036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8858034650 0x7f8858036b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f898400c010 tx=0x7f8984010000 comp rx=0 tx=0).stop 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f898ff87640 1 -- 172.21.15.167:0/2214089622 reap_dead start 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 msgr2=0x564eb01dc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01dc950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f89800e5ab0 tx=0x7f89800b0f40 comp rx=0 tx=0).stop 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 shutdown_connections 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2214089622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01d5870 0x564eb01dc950 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 >> 172.21.15.167:0/2214089622 conn(0x564eb01d1c50 msgr2=0x564eb01cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 shutdown_connections 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2214089622 wait complete. 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/395381220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8868034650 msgr2=0x7f8868036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/395381220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8868034650 0x7f8868036b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x564eb01bbc30 tx=0x7f898400f000 comp rx=0 tx=0).stop 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/395381220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01c92c0 msgr2=0x564eb01c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/395381220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01c92c0 0x564eb01c96e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f89800cf460 tx=0x7f89800c6710 comp rx=0 tx=0).stop 2024-09-18T02:04:16.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/395381220 shutdown_connections 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/395381220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8868034650 0x7f8868036b10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/395381220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb01c92c0 0x564eb01c96e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/395381220 >> 172.21.15.167:0/395381220 conn(0x564eb01be410 msgr2=0x564eb01c0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/395381220 shutdown_connections 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/395381220 wait complete. 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564eb01b4db0 msgr2=0x564eb01b71a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564eb01b4db0 0x564eb01b71a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564eb01b0050 msgr2=0x564eb01b2440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564eb01b0050 0x564eb01b2440 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564eb01b8cb0 msgr2=0x564eb01bb0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564eb01b8cb0 0x564eb01bb0a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8874034650 msgr2=0x7f8874036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8874034650 0x7f8874036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8984000f70 tx=0x7f8984001380 comp rx=0 tx=0).stop 2024-09-18T02:04:16.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 msgr2=0x564eb01ab0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 --2- 172.21.15.167:0/2621871634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564eb00b5e30 0x564eb01ab0d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8980005aa0 tx=0x7f89800180e0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f898ff87640 1 -- 172.21.15.167:0/2621871634 reap_dead start 2024-09-18T02:04:16.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 shutdown_connections 2024-09-18T02:04:16.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 >> 172.21.15.167:0/2621871634 conn(0x564eb00b1000 msgr2=0x564eb00bf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 shutdown_connections 2024-09-18T02:04:16.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.760+0000 7f8991c76980 1 -- 172.21.15.167:0/2621871634 wait complete. 2024-09-18T02:04:16.774 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:16.774 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-18T02:04:16.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-18T02:04:16.775 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-18T02:04:16.808 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:16.808 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:16.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.804+0000 7f5d95e94980 1 Processor -- start 2024-09-18T02:04:16.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.804+0000 7f5d95e94980 1 -- start start 2024-09-18T02:04:16.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.804+0000 7f5d95e94980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55abfc4d7890 0x55abfc4d9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.804+0000 7f5d95e94980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55abfc35cae0 con 0x55abfc4d3510 2024-09-18T02:04:16.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.804+0000 7f5d95e94980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55abfc380e30 con 0x55abfc4d7890 2024-09-18T02:04:16.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.808+0000 7f5d8b1a3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55abfc4d7890 0x55abfc4d9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.808+0000 7f5d939a4640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55abfc4d3510 0x55abfc4d38f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55386/0 (socket says 172.21.15.167:55386) 2024-09-18T02:04:16.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.808+0000 7f5d939a4640 1 -- 172.21.15.167:0/3328964970 learned_addr learned my addr 172.21.15.167:0/3328964970 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:16.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.808+0000 7f5d931a3640 1 -- 172.21.15.167:0/3328964970 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 572988141 0 0) 0x55abfc35cae0 con 0x55abfc4d3510 2024-09-18T02:04:16.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.808+0000 7f5d931a3640 1 -- 172.21.15.167:0/3328964970 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d80001e20 con 0x55abfc4d3510 2024-09-18T02:04:16.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.808+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3328964970 >> v1:172.21.15.81:6789/0 conn(0x55abfc4d3510 legacy=0x55abfc4d38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.808+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3328964970 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abfc4db1d0 con 0x55abfc4d7890 2024-09-18T02:04:16.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.808+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/3328964970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d7890 0x55abfc4d9c80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00a480 tx=0x7f5d7c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f2b4b33ea28e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.808+0000 7f5d931a3640 1 -- 172.21.15.167:0/3328964970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d7c0b0070 con 0x55abfc4d7890 2024-09-18T02:04:16.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.808+0000 7f5d931a3640 1 -- 172.21.15.167:0/3328964970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7c0ab540 con 0x55abfc4d7890 2024-09-18T02:04:16.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.808+0000 7f5d931a3640 1 -- 172.21.15.167:0/3328964970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d7c0ab820 con 0x55abfc4d7890 2024-09-18T02:04:16.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.812+0000 7f5d95e94980 1 -- 172.21.15.167:0/3328964970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d7890 msgr2=0x55abfc4d9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.812+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3328964970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d7890 0x55abfc4d9c80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00a480 tx=0x7f5d7c01b280 comp rx=0 tx=0).stop 2024-09-18T02:04:16.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.812+0000 7f5d95e94980 1 -- 172.21.15.167:0/3328964970 shutdown_connections 2024-09-18T02:04:16.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.812+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3328964970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d7890 0x55abfc4d9c80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.812+0000 7f5d95e94980 1 -- 172.21.15.167:0/3328964970 >> 172.21.15.167:0/3328964970 conn(0x55abfc4cf030 msgr2=0x55abfc4d1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.812+0000 7f5d95e94980 1 -- 172.21.15.167:0/3328964970 shutdown_connections 2024-09-18T02:04:16.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.812+0000 7f5d95e94980 1 -- 172.21.15.167:0/3328964970 wait complete. 2024-09-18T02:04:16.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.824+0000 7f5d95e94980 1 Processor -- start 2024-09-18T02:04:16.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.824+0000 7f5d95e94980 1 -- start start 2024-09-18T02:04:16.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.824+0000 7f5d95e94980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 0x55abfc448ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.824+0000 7f5d95e94980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55abfc382200 con 0x55abfc4d3510 2024-09-18T02:04:16.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.824+0000 7f5d939a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 0x55abfc448ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.824+0000 7f5d939a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 0x55abfc448ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55868/0 (socket says 172.21.15.167:55868) 2024-09-18T02:04:16.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.824+0000 7f5d939a4640 1 -- 172.21.15.167:0/3576774164 learned_addr learned my addr 172.21.15.167:0/3576774164 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.824+0000 7f5d939a4640 1 -- 172.21.15.167:0/3576774164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abfc449170 con 0x55abfc4d3510 2024-09-18T02:04:16.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.824+0000 7f5d939a4640 1 --2- 172.21.15.167:0/3576774164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 0x55abfc448ba0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5d84001dc0 tx=0x7f5d8400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da92bdd245b73cb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5c81e0b640 1 -- 172.21.15.167:0/3576774164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d84012020 con 0x55abfc4d3510 2024-09-18T02:04:16.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5c81e0b640 1 -- 172.21.15.167:0/3576774164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8400e7c0 con 0x55abfc4d3510 2024-09-18T02:04:16.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5c81e0b640 1 -- 172.21.15.167:0/3576774164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8400eb40 con 0x55abfc4d3510 2024-09-18T02:04:16.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 -- 172.21.15.167:0/3576774164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 msgr2=0x55abfc448ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3576774164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 0x55abfc448ba0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5d84001dc0 tx=0x7f5d8400b6d0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 -- 172.21.15.167:0/3576774164 shutdown_connections 2024-09-18T02:04:16.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3576774164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 0x55abfc448ba0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 -- 172.21.15.167:0/3576774164 >> 172.21.15.167:0/3576774164 conn(0x55abfc4cf030 msgr2=0x55abfc5ba2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 -- 172.21.15.167:0/3576774164 shutdown_connections 2024-09-18T02:04:16.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 -- 172.21.15.167:0/3576774164 wait complete. 2024-09-18T02:04:16.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 Processor -- start 2024-09-18T02:04:16.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 -- start start 2024-09-18T02:04:16.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 0x55abfc5c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55abfc4dacd0 con 0x55abfc4d3510 2024-09-18T02:04:16.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d939a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 0x55abfc5c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d939a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 0x55abfc5c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55876/0 (socket says 172.21.15.167:55876) 2024-09-18T02:04:16.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d939a4640 1 -- 172.21.15.167:0/1113267252 learned_addr learned my addr 172.21.15.167:0/1113267252 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d939a4640 1 -- 172.21.15.167:0/1113267252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abfc5c70b0 con 0x55abfc4d3510 2024-09-18T02:04:16.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d939a4640 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 0x55abfc5c6b70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5d84004180 tx=0x7f5d84000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5c7bfff640 1 -- 172.21.15.167:0/1113267252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d84012030 con 0x55abfc4d3510 2024-09-18T02:04:16.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5c7bfff640 1 -- 172.21.15.167:0/1113267252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d84001440 con 0x55abfc4d3510 2024-09-18T02:04:16.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abfc5c7340 con 0x55abfc4d3510 2024-09-18T02:04:16.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5c7bfff640 1 -- 172.21.15.167:0/1113267252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8401aaa0 con 0x55abfc4d3510 2024-09-18T02:04:16.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.828+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abfc5ca020 con 0x55abfc4d3510 2024-09-18T02:04:16.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5c7bfff640 1 -- 172.21.15.167:0/1113267252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d84015020 con 0x55abfc4d3510 2024-09-18T02:04:16.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5c7bfff640 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c7c0346a0 0x7f5c7c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5c7bfff640 1 -- 172.21.15.167:0/1113267252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5d84020030 con 0x55abfc4d3510 2024-09-18T02:04:16.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c7c0346a0 0x7f5c7c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d95e94980 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55abfc4d7890 0x55abfc5cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc5ce160 con 0x55abfc4d7890 2024-09-18T02:04:16.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d941a5640 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55abfc4d7890 0x55abfc5cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c7c0346a0 0x7f5c7c036b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0ad000 tx=0x7f5d7c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d941a5640 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55abfc4d7890 0x55abfc5cdb20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d941a5640 1 -- 172.21.15.167:0/1113267252 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc4d7890 2024-09-18T02:04:16.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc5cb240 con 0x55abfc4d7890 2024-09-18T02:04:16.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d941a5640 1 -- 172.21.15.167:0/1113267252 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc4d7890 2024-09-18T02:04:16.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d95e94980 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55abfc5d0490 0x55abfc5d2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc5d2f50 con 0x55abfc5d0490 2024-09-18T02:04:16.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d939a4640 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55abfc5d0490 0x55abfc5d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.832+0000 7f5d939a4640 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55abfc5d0490 0x55abfc5d2880 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d939a4640 1 -- 172.21.15.167:0/1113267252 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d84008030 con 0x55abfc5d0490 2024-09-18T02:04:16.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc5cf300 con 0x55abfc4d7890 2024-09-18T02:04:16.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d941a5640 1 -- 172.21.15.167:0/1113267252 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc4d7890 2024-09-18T02:04:16.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d95e94980 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55abfc5d4390 0x55abfc5d6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc5d6ef0 con 0x55abfc5d4390 2024-09-18T02:04:16.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55abfc5d4390 0x55abfc5d6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55abfc5d4390 0x55abfc5d6780 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/1113267252 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d7c0b3040 con 0x55abfc5d4390 2024-09-18T02:04:16.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d95e94980 1 Processor -- start 2024-09-18T02:04:16.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d95e94980 1 -- start start 2024-09-18T02:04:16.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d95e94980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5e4960 0x55abfc5e4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d95e94980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55abfc3db800 con 0x55abfc5e4960 2024-09-18T02:04:16.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d939a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5e4960 0x55abfc5e4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d939a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5e4960 0x55abfc5e4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55890/0 (socket says 172.21.15.167:55890) 2024-09-18T02:04:16.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d939a4640 1 -- 172.21.15.167:0/2416839527 learned_addr learned my addr 172.21.15.167:0/2416839527 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d939a4640 1 -- 172.21.15.167:0/2416839527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abfc5e52c0 con 0x55abfc5e4960 2024-09-18T02:04:16.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d939a4640 1 --2- 172.21.15.167:0/2416839527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5e4960 0x55abfc5e4d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d8401a9f0 tx=0x7f5d8400db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5c797fa640 1 -- 172.21.15.167:0/2416839527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d84024550 con 0x55abfc5e4960 2024-09-18T02:04:16.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d95e94980 1 -- 172.21.15.167:0/2416839527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abfc5e5550 con 0x55abfc5e4960 2024-09-18T02:04:16.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5c797fa640 1 -- 172.21.15.167:0/2416839527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d840246f0 con 0x55abfc5e4960 2024-09-18T02:04:16.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5c797fa640 1 -- 172.21.15.167:0/2416839527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d84041b30 con 0x55abfc5e4960 2024-09-18T02:04:16.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.836+0000 7f5d95e94980 1 -- 172.21.15.167:0/2416839527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abfc5e5550 con 0x55abfc5e4960 2024-09-18T02:04:16.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5c797fa640 1 -- 172.21.15.167:0/2416839527 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d84039040 con 0x55abfc5e4960 2024-09-18T02:04:16.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5c797fa640 1 --2- 172.21.15.167:0/2416839527 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c6c034650 0x7f5c6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5c797fa640 1 -- 172.21.15.167:0/2416839527 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5d84005050 con 0x55abfc5e4960 2024-09-18T02:04:16.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/2416839527 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c6c034650 0x7f5c6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d95e94980 1 Processor -- start 2024-09-18T02:04:16.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d95e94980 1 -- start start 2024-09-18T02:04:16.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/2416839527 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c6c034650 0x7f5c6c036b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0ae040 tx=0x7f5d7c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d95e94980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5bfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d95e94980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55abfc4494f0 con 0x55abfc5bf810 2024-09-18T02:04:16.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d939a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5bfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d939a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5bfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55906/0 (socket says 172.21.15.167:55906) 2024-09-18T02:04:16.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d939a4640 1 -- 172.21.15.167:0/484710137 learned_addr learned my addr 172.21.15.167:0/484710137 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d939a4640 1 -- 172.21.15.167:0/484710137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abfc5c01c0 con 0x55abfc5bf810 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d939a4640 1 --2- 172.21.15.167:0/484710137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5bfbf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5d84014040 tx=0x7f5d8400ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225d638fb8f1dc87 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5c72ffd640 1 -- 172.21.15.167:0/484710137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d84059040 con 0x55abfc5bf810 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5c72ffd640 1 -- 172.21.15.167:0/484710137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d84063070 con 0x55abfc5bf810 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5c72ffd640 1 -- 172.21.15.167:0/484710137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8402fe30 con 0x55abfc5bf810 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d95e94980 1 -- 172.21.15.167:0/484710137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 msgr2=0x55abfc5bfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d95e94980 1 --2- 172.21.15.167:0/484710137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5bfbf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5d84014040 tx=0x7f5d8400ab80 comp rx=0 tx=0).stop 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d95e94980 1 -- 172.21.15.167:0/484710137 shutdown_connections 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d95e94980 1 --2- 172.21.15.167:0/484710137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5bfbf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d95e94980 1 -- 172.21.15.167:0/484710137 >> 172.21.15.167:0/484710137 conn(0x55abfc5ed500 msgr2=0x55abfc5eb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d95e94980 1 -- 172.21.15.167:0/484710137 shutdown_connections 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.840+0000 7f5d95e94980 1 -- 172.21.15.167:0/484710137 wait complete. 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d95e94980 1 Processor -- start 2024-09-18T02:04:16.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d95e94980 1 -- start start 2024-09-18T02:04:16.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d95e94980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d95e94980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55abfc5be3a0 con 0x55abfc5bf810 2024-09-18T02:04:16.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d939a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d939a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5fa4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55912/0 (socket says 172.21.15.167:55912) 2024-09-18T02:04:16.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 learned_addr learned my addr 172.21.15.167:0/3566131081 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abfc5faa20 con 0x55abfc5bf810 2024-09-18T02:04:16.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d939a4640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5fa4e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5d84027f70 tx=0x7f5d84027f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5c717fa640 1 -- 172.21.15.167:0/3566131081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d84052c80 con 0x55abfc5bf810 2024-09-18T02:04:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5c717fa640 1 -- 172.21.15.167:0/3566131081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8406d070 con 0x55abfc5bf810 2024-09-18T02:04:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5c717fa640 1 -- 172.21.15.167:0/3566131081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8403b440 con 0x55abfc5bf810 2024-09-18T02:04:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abfc5faa20 con 0x55abfc5bf810 2024-09-18T02:04:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abfc5faa20 con 0x55abfc5bf810 2024-09-18T02:04:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5c717fa640 1 -- 172.21.15.167:0/3566131081 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d84009070 con 0x55abfc5bf810 2024-09-18T02:04:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5c717fa640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c5c034650 0x7f5c5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5c717fa640 1 -- 172.21.15.167:0/3566131081 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5d84073b20 con 0x55abfc5bf810 2024-09-18T02:04:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.844+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c5c034650 0x7f5c5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55abfc605620 0x55abfc607ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc608210 con 0x55abfc605620 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d941a5640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55abfc605620 0x55abfc607ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c5c034650 0x7f5c5c036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c017e90 tx=0x7f5d7c0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d941a5640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55abfc605620 0x55abfc607ac0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 20 realm 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc608670 con 0x55abfc605620 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc608f10 con 0x55abfc605620 2024-09-18T02:04:16.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc605620 2024-09-18T02:04:16.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:16.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55abfc60a010 0x55abfc60c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc60caa0 con 0x55abfc60a010 2024-09-18T02:04:16.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d939a4640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55abfc60a010 0x55abfc60c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d939a4640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55abfc60a010 0x55abfc60c400 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 20 searching for the correct realm 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55abfc60e980 0x55abfc610d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6113f0 con 0x55abfc60e980 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55abfc60e980 0x55abfc610d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.848+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55abfc60e980 0x55abfc610d70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d8b1a3640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5d7c0dc040 0x7f5d7c0dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6113f0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d941a5640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5d7c0dc040 0x7f5d7c0dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d941a5640 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5d7c0dc040 0x7f5d7c0dd430 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60a010 2024-09-18T02:04:16.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc605620 2024-09-18T02:04:16.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc605620 2024-09-18T02:04:16.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60a010 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60a010 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.852+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60e980 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc605620 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60a010 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc605620 2024-09-18T02:04:16.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60e980 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60e980 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60a010 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60e980 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60e980 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc605620 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.856+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc605620 2024-09-18T02:04:16.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60a010 2024-09-18T02:04:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60e980 2024-09-18T02:04:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc605620 2024-09-18T02:04:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60a010 2024-09-18T02:04:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60e980 2024-09-18T02:04:16.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60a010 2024-09-18T02:04:16.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60e980 2024-09-18T02:04:16.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.860+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc60a010 2024-09-18T02:04:16.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x55abfc605620 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6092b0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc60d2f0 con 0x55abfc605620 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc60d2f0 con 0x55abfc605620 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc60d2f0 con 0x55abfc60e980 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 zone default found 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 4 Realm: () 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:16.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 zonegroup default 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc60dd10 con 0x55abfc60a010 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc613700 con 0x55abfc60e980 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc613aa0 con 0x55abfc60e980 2024-09-18T02:04:16.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 started sync module instance, tier type = 2024-09-18T02:04:16.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:16.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.864+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc612b40 con 0x7f5d7c0dc040 2024-09-18T02:04:16.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.868+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.868+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94197161996128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc612b40 con 0x7f5d7c0dc040 2024-09-18T02:04:16.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.868+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6142f0 con 0x55abfc605620 2024-09-18T02:04:16.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.868+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94197161996128] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.868+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.868+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94197162000208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc612b40 con 0x55abfc605620 2024-09-18T02:04:16.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.868+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc614d00 con 0x55abfc60e980 2024-09-18T02:04:16.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94197162000208] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94197161993872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc612ab0 con 0x55abfc60e980 2024-09-18T02:04:16.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc615a00 con 0x7f5d7c0dc040 2024-09-18T02:04:16.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94197162006112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc616110 con 0x7f5d7c0dc040 2024-09-18T02:04:16.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc616c30 con 0x55abfc605620 2024-09-18T02:04:16.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94197161993872] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94197162006112] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94197162010368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc616bf0 con 0x55abfc605620 2024-09-18T02:04:16.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.872+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc617020 con 0x55abfc60a010 2024-09-18T02:04:16.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.876+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.876+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94197162007392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6178c0 con 0x55abfc60a010 2024-09-18T02:04:16.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.876+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94197162010368] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.876+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc618280 con 0x55abfc60a010 2024-09-18T02:04:16.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.876+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.876+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94197162007392] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.876+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94197162004640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc618280 con 0x55abfc60a010 2024-09-18T02:04:16.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.876+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc617410 con 0x55abfc60a010 2024-09-18T02:04:16.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94197162004640] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94197162016208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6181f0 con 0x55abfc60a010 2024-09-18T02:04:16.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 20 add_watcher() i=0 2024-09-18T02:04:16.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 20 add_watcher() i=1 2024-09-18T02:04:16.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 20 add_watcher() i=2 2024-09-18T02:04:16.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 20 add_watcher() i=3 2024-09-18T02:04:16.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 20 add_watcher() i=4 2024-09-18T02:04:16.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 20 add_watcher() i=5 2024-09-18T02:04:16.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 20 add_watcher() i=6 2024-09-18T02:04:16.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94197162016208] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 20 add_watcher() i=7 2024-09-18T02:04:16.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:16.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc61bcc0 con 0x55abfc605620 2024-09-18T02:04:16.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.880+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94197162018784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc619120 con 0x55abfc605620 2024-09-18T02:04:16.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94197162018784] v30'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:16.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:16.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:16.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 5 note: GC not initialized 2024-09-18T02:04:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5c48fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 20 Filter name: none 2024-09-18T02:04:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5bc27fc640 20 reqs_thread_entry: start 2024-09-18T02:04:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T02:04:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc63f1e0 con 0x55abfc60a010 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc63d980 con 0x55abfc605620 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 20 rados_obj.operate() r=0 bl.length=7 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T02:04:16.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 20 rados->read ofs=0 len=0 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55abfc63dd70 con 0x55abfc605620 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.884+0000 7f5d95e94980 20 get_user_info_from_index found 0 xattrs 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.888+0000 7f5c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:16.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.888+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94197162018784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc61e530 con 0x55abfc605620 2024-09-18T02:04:16.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.888+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94197162018784] v30'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.888+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94197161996128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc6187e0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.888+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94197161996128] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.888+0000 7f5d95e94980 20 remove_watcher() i=0 2024-09-18T02:04:16.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.888+0000 7f5d95e94980 2 removed watcher, disabling cache 2024-09-18T02:04:16.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.888+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94197162000208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc612f60 con 0x55abfc605620 2024-09-18T02:04:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.892+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94197162000208] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.892+0000 7f5d95e94980 20 remove_watcher() i=1 2024-09-18T02:04:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.892+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94197161993872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc612f60 con 0x55abfc60e980 2024-09-18T02:04:16.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.892+0000 7f5d8b1a3640 1 -- 172.21.15.167:0/3566131081 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94197161993872] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7c0c9030 con 0x55abfc60e980 2024-09-18T02:04:16.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.892+0000 7f5d95e94980 20 remove_watcher() i=2 2024-09-18T02:04:16.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.892+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94197162006112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc612f60 con 0x7f5d7c0dc040 2024-09-18T02:04:16.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.892+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94197162006112] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x7f5d7c0dc040 2024-09-18T02:04:16.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.892+0000 7f5d95e94980 20 remove_watcher() i=3 2024-09-18T02:04:16.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.892+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94197162010368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc612f60 con 0x55abfc605620 2024-09-18T02:04:16.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.896+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94197162010368] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c00a4d0 con 0x55abfc605620 2024-09-18T02:04:16.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.896+0000 7f5d95e94980 20 remove_watcher() i=4 2024-09-18T02:04:16.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.896+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94197162007392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc616700 con 0x55abfc60a010 2024-09-18T02:04:16.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.896+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94197162007392] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.896+0000 7f5d95e94980 20 remove_watcher() i=5 2024-09-18T02:04:16.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.896+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94197162004640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc612f60 con 0x55abfc60a010 2024-09-18T02:04:16.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94197162004640] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 20 remove_watcher() i=6 2024-09-18T02:04:16.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94197162016208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55abfc616700 con 0x55abfc60a010 2024-09-18T02:04:16.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d939a4640 1 -- 172.21.15.167:0/3566131081 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94197162016208] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8405c040 con 0x55abfc60a010 2024-09-18T02:04:16.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 20 remove_watcher() i=7 2024-09-18T02:04:16.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55abfc60a010 msgr2=0x55abfc60c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55abfc60a010 0x55abfc60c400 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55abfc605620 msgr2=0x55abfc607ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55abfc605620 0x55abfc607ac0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5d7c0dc040 msgr2=0x7f5d7c0dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5d7c0dc040 0x7f5d7c0dd430 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55abfc60e980 msgr2=0x55abfc610d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55abfc60e980 0x55abfc610d70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c5c034650 msgr2=0x7f5c5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c5c034650 0x7f5c5c036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c017e90 tx=0x7f5d7c0b9040 comp rx=0 tx=0).stop 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 msgr2=0x55abfc5fa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5fa4e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5d84027f70 tx=0x7f5d84027f00 comp rx=0 tx=0).stop 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d941a5640 1 -- 172.21.15.167:0/3566131081 reap_dead start 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 shutdown_connections 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 --2- 172.21.15.167:0/3566131081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5bf810 0x55abfc5fa4e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 >> 172.21.15.167:0/3566131081 conn(0x55abfc5ed500 msgr2=0x55abfc5eb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 shutdown_connections 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.900+0000 7f5d95e94980 1 -- 172.21.15.167:0/3566131081 wait complete. 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/2416839527 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c6c034650 msgr2=0x7f5c6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 --2- 172.21.15.167:0/2416839527 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c6c034650 0x7f5c6c036b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0ae040 tx=0x7f5d7c005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/2416839527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5e4960 msgr2=0x55abfc5e4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 --2- 172.21.15.167:0/2416839527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5e4960 0x55abfc5e4d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d8401a9f0 tx=0x7f5d8400db30 comp rx=0 tx=0).stop 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/2416839527 shutdown_connections 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 --2- 172.21.15.167:0/2416839527 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c6c034650 0x7f5c6c036b10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 --2- 172.21.15.167:0/2416839527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc5e4960 0x55abfc5e4d80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/2416839527 >> 172.21.15.167:0/2416839527 conn(0x55abfc5d9ab0 msgr2=0x55abfc5dc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/2416839527 shutdown_connections 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/2416839527 wait complete. 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55abfc5d0490 msgr2=0x55abfc5d2880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55abfc5d0490 0x55abfc5d2880 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55abfc4d7890 msgr2=0x55abfc5cdb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55abfc4d7890 0x55abfc5cdb20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55abfc5d4390 msgr2=0x55abfc5d6780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55abfc5d4390 0x55abfc5d6780 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c7c0346a0 msgr2=0x7f5c7c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c7c0346a0 0x7f5c7c036b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0ad000 tx=0x7f5d7c0a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:16.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 msgr2=0x55abfc5c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 --2- 172.21.15.167:0/1113267252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abfc4d3510 0x55abfc5c6b70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5d84004180 tx=0x7f5d84000bd0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d941a5640 1 -- 172.21.15.167:0/1113267252 reap_dead start 2024-09-18T02:04:16.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 shutdown_connections 2024-09-18T02:04:16.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 >> 172.21.15.167:0/1113267252 conn(0x55abfc4cf030 msgr2=0x55abfc5b8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 shutdown_connections 2024-09-18T02:04:16.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.904+0000 7f5d95e94980 1 -- 172.21.15.167:0/1113267252 wait complete. 2024-09-18T02:04:16.915 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-18T02:04:16.915 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T02:04:16.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T02:04:16.916 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T02:04:16.991 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:16.991 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:16.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.988+0000 7fc0a1d02980 1 Processor -- start 2024-09-18T02:04:16.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.988+0000 7fc0a1d02980 1 -- start start 2024-09-18T02:04:16.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.988+0000 7fc0a1d02980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c26790a680 0x55c26790aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:16.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.988+0000 7fc0a1d02980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c26781bae0 con 0x55c26790afd0 2024-09-18T02:04:16.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.988+0000 7fc0a1d02980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55c26783fe30 con 0x55c26790a680 2024-09-18T02:04:16.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.988+0000 7fc09f812640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c26790a680 0x55c26790aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:16.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.988+0000 7fc09f812640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c26790a680 0x55c26790aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55926/0 (socket says 172.21.15.167:55926) 2024-09-18T02:04:16.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.988+0000 7fc09f011640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55c26790afd0 0x55c26790d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55390/0 (socket says 172.21.15.167:55390) 2024-09-18T02:04:16.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.988+0000 7fc09f812640 1 -- 172.21.15.167:0/3580528960 learned_addr learned my addr 172.21.15.167:0/3580528960 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:16.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc09f812640 1 -- 172.21.15.167:0/3580528960 >> v1:172.21.15.81:6789/0 conn(0x55c26790afd0 legacy=0x55c26790d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc09f812640 1 -- 172.21.15.167:0/3580528960 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26790e220 con 0x55c26790a680 2024-09-18T02:04:16.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc09f812640 1 --2- 172.21.15.167:0/3580528960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c26790aa60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc09000a4e0 tx=0x7fc09001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638dabcf45e04532 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:16.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc09e810640 1 -- 172.21.15.167:0/3580528960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900aa410 con 0x55c26790a680 2024-09-18T02:04:16.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc09e810640 1 -- 172.21.15.167:0/3580528960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0900aa5b0 con 0x55c26790a680 2024-09-18T02:04:16.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc09e810640 1 -- 172.21.15.167:0/3580528960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900aa910 con 0x55c26790a680 2024-09-18T02:04:16.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3580528960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 msgr2=0x55c26790aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:16.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/3580528960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c26790aa60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc09000a4e0 tx=0x7fc09001b090 comp rx=0 tx=0).stop 2024-09-18T02:04:16.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3580528960 shutdown_connections 2024-09-18T02:04:16.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/3580528960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c26790aa60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:16.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3580528960 >> 172.21.15.167:0/3580528960 conn(0x55c267909230 msgr2=0x55c267909640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:16.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3580528960 shutdown_connections 2024-09-18T02:04:16.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:16.992+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3580528960 wait complete. 2024-09-18T02:04:17.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.004+0000 7fc0a1d02980 1 Processor -- start 2024-09-18T02:04:17.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.004+0000 7fc0a1d02980 1 -- start start 2024-09-18T02:04:17.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c267a85260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c267841200 con 0x55c26790a680 2024-09-18T02:04:17.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc09f812640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c267a85260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc09f812640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c267a85260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55942/0 (socket says 172.21.15.167:55942) 2024-09-18T02:04:17.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc09f812640 1 -- 172.21.15.167:0/392197671 learned_addr learned my addr 172.21.15.167:0/392197671 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc09f812640 1 -- 172.21.15.167:0/392197671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c267a85830 con 0x55c26790a680 2024-09-18T02:04:17.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc09f812640 1 --2- 172.21.15.167:0/392197671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c267a85260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc090017ca0 tx=0x7fc0900033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b3f50b746b74b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fbf8de0b640 1 -- 172.21.15.167:0/392197671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900b9070 con 0x55c26790a680 2024-09-18T02:04:17.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fbf8de0b640 1 -- 172.21.15.167:0/392197671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0900aaa50 con 0x55c26790a680 2024-09-18T02:04:17.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fbf8de0b640 1 -- 172.21.15.167:0/392197671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900aad50 con 0x55c26790a680 2024-09-18T02:04:17.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 -- 172.21.15.167:0/392197671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 msgr2=0x55c267a85260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/392197671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c267a85260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc090017ca0 tx=0x7fc0900033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 -- 172.21.15.167:0/392197671 shutdown_connections 2024-09-18T02:04:17.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/392197671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c267a85260 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 -- 172.21.15.167:0/392197671 >> 172.21.15.167:0/392197671 conn(0x55c267909230 msgr2=0x55c267a80e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 -- 172.21.15.167:0/392197671 shutdown_connections 2024-09-18T02:04:17.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 -- 172.21.15.167:0/392197671 wait complete. 2024-09-18T02:04:17.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 Processor -- start 2024-09-18T02:04:17.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 -- start start 2024-09-18T02:04:17.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c267a8c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc0a1d02980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c2679a3920 con 0x55c26790a680 2024-09-18T02:04:17.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc09f812640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c267a8c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc09f812640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c267a8c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55950/0 (socket says 172.21.15.167:55950) 2024-09-18T02:04:17.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc09f812640 1 -- 172.21.15.167:0/2252465536 learned_addr learned my addr 172.21.15.167:0/2252465536 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc09f812640 1 -- 172.21.15.167:0/2252465536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c267a8c9b0 con 0x55c26790a680 2024-09-18T02:04:17.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.008+0000 7fc09f812640 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c267a8c470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc09001aec0 tx=0x7fc090017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fbf87fff640 1 -- 172.21.15.167:0/2252465536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900b9070 con 0x55c26790a680 2024-09-18T02:04:17.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fbf87fff640 1 -- 172.21.15.167:0/2252465536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0900b5d20 con 0x55c26790a680 2024-09-18T02:04:17.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c267a8cc40 con 0x55c26790a680 2024-09-18T02:04:17.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fbf87fff640 1 -- 172.21.15.167:0/2252465536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900c85c0 con 0x55c26790a680 2024-09-18T02:04:17.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c267a8f920 con 0x55c26790a680 2024-09-18T02:04:17.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fbf87fff640 1 -- 172.21.15.167:0/2252465536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc0900b3040 con 0x55c26790a680 2024-09-18T02:04:17.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fbf87fff640 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf88034650 0x7fbf88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fbf87fff640 1 -- 172.21.15.167:0/2252465536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc0900c4070 con 0x55c26790a680 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc09f011640 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf88034650 0x7fbf88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c26790afd0 0x55c267a93440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267a93a80 con 0x55c26790afd0 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc0a0013640 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c26790afd0 0x55c267a93440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc09f011640 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf88034650 0x7fbf88036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc088000f70 tx=0x7fc088001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc0a0013640 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c26790afd0 0x55c267a93440 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc0a0013640 1 -- 172.21.15.167:0/2252465536 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0980083f0 con 0x55c26790afd0 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267a90b40 con 0x55c26790afd0 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc0a0013640 1 -- 172.21.15.167:0/2252465536 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc0980083f0 con 0x55c26790afd0 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c267a95dd0 0x55c267a981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267a98890 con 0x55c267a95dd0 2024-09-18T02:04:17.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc09f812640 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c267a95dd0 0x55c267a981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.012+0000 7fc09f812640 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c267a95dd0 0x55c267a981c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc09f812640 1 -- 172.21.15.167:0/2252465536 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc0900c0050 con 0x55c267a95dd0 2024-09-18T02:04:17.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267a94c70 con 0x55c26790afd0 2024-09-18T02:04:17.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc0a0013640 1 -- 172.21.15.167:0/2252465536 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc0980083f0 con 0x55c26790afd0 2024-09-18T02:04:17.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c267a99cd0 0x55c267a9c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267a9c850 con 0x55c267a99cd0 2024-09-18T02:04:17.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc09f011640 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c267a99cd0 0x55c267a9c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc09f011640 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c267a99cd0 0x55c267a9c0c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc09f011640 1 -- 172.21.15.167:0/2252465536 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc08800f6a0 con 0x55c267a99cd0 2024-09-18T02:04:17.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc0a1d02980 1 Processor -- start 2024-09-18T02:04:17.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc0a1d02980 1 -- start start 2024-09-18T02:04:17.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc0a1d02980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267aaa2e0 0x55c267aaa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc0a1d02980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c26789a800 con 0x55c267aaa2e0 2024-09-18T02:04:17.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc09f812640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267aaa2e0 0x55c267aaa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc09f812640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267aaa2e0 0x55c267aaa700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55952/0 (socket says 172.21.15.167:55952) 2024-09-18T02:04:17.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc09f812640 1 -- 172.21.15.167:0/3186895168 learned_addr learned my addr 172.21.15.167:0/3186895168 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc09f812640 1 -- 172.21.15.167:0/3186895168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c267aaac40 con 0x55c267aaa2e0 2024-09-18T02:04:17.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc09f812640 1 --2- 172.21.15.167:0/3186895168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267aaa2e0 0x55c267aaa700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc0900e3280 tx=0x7fc0900c7c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fbf857fa640 1 -- 172.21.15.167:0/3186895168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900a98f0 con 0x55c267aaa2e0 2024-09-18T02:04:17.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3186895168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c267aaae70 con 0x55c267aaa2e0 2024-09-18T02:04:17.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fbf857fa640 1 -- 172.21.15.167:0/3186895168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0900c10c0 con 0x55c267aaa2e0 2024-09-18T02:04:17.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fbf857fa640 1 -- 172.21.15.167:0/3186895168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900c13a0 con 0x55c267aaa2e0 2024-09-18T02:04:17.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.016+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3186895168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c267aadaf0 con 0x55c267aaa2e0 2024-09-18T02:04:17.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fbf857fa640 1 -- 172.21.15.167:0/3186895168 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc0900c1830 con 0x55c267aaa2e0 2024-09-18T02:04:17.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fbf857fa640 1 --2- 172.21.15.167:0/3186895168 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf78034650 0x7fbf78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fbf857fa640 1 -- 172.21.15.167:0/3186895168 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc0900de070 con 0x55c267aaa2e0 2024-09-18T02:04:17.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc09f011640 1 --2- 172.21.15.167:0/3186895168 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf78034650 0x7fbf78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc0a1d02980 1 Processor -- start 2024-09-18T02:04:17.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc0a1d02980 1 -- start start 2024-09-18T02:04:17.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc09f011640 1 --2- 172.21.15.167:0/3186895168 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf78034650 0x7fbf78036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55c267a9cc50 tx=0x7fc08800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc0a1d02980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267ab7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc0a1d02980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c267a85af0 con 0x55c267ab6c50 2024-09-18T02:04:17.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc09f812640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267ab7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc09f812640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267ab7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55966/0 (socket says 172.21.15.167:55966) 2024-09-18T02:04:17.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc09f812640 1 -- 172.21.15.167:0/3790411674 learned_addr learned my addr 172.21.15.167:0/3790411674 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc09f812640 1 -- 172.21.15.167:0/3790411674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c267ab7620 con 0x55c267ab6c50 2024-09-18T02:04:17.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc09f812640 1 --2- 172.21.15.167:0/3790411674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267ab7050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc090007810 tx=0x7fc0900d77e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3157a32c9bd5a646 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fbf7effd640 1 -- 172.21.15.167:0/3790411674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900d0800 con 0x55c267ab6c50 2024-09-18T02:04:17.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fbf7effd640 1 -- 172.21.15.167:0/3790411674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0900ac0d0 con 0x55c267ab6c50 2024-09-18T02:04:17.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fbf7effd640 1 -- 172.21.15.167:0/3790411674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900d09a0 con 0x55c267ab6c50 2024-09-18T02:04:17.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3790411674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 msgr2=0x55c267ab7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/3790411674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267ab7050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc090007810 tx=0x7fc0900d77e0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3790411674 shutdown_connections 2024-09-18T02:04:17.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/3790411674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267ab7050 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3790411674 >> 172.21.15.167:0/3790411674 conn(0x55c267ab2fd0 msgr2=0x55c267ab10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3790411674 shutdown_connections 2024-09-18T02:04:17.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.020+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3790411674 wait complete. 2024-09-18T02:04:17.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc0a1d02980 1 Processor -- start 2024-09-18T02:04:17.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc0a1d02980 1 -- start start 2024-09-18T02:04:17.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc0a1d02980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267abddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc0a1d02980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c267ab79e0 con 0x55c267ab6c50 2024-09-18T02:04:17.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc09f812640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267abddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc09f812640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267abddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55976/0 (socket says 172.21.15.167:55976) 2024-09-18T02:04:17.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 learned_addr learned my addr 172.21.15.167:0/1476480832 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c267abe330 con 0x55c267ab6c50 2024-09-18T02:04:17.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc09f812640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267abddf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc090007c50 tx=0x7fc0900077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fbf7d7fa640 1 -- 172.21.15.167:0/1476480832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900bd400 con 0x55c267ab6c50 2024-09-18T02:04:17.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c267abe330 con 0x55c267ab6c50 2024-09-18T02:04:17.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fbf7d7fa640 1 -- 172.21.15.167:0/1476480832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0900b4c70 con 0x55c267ab6c50 2024-09-18T02:04:17.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fbf7d7fa640 1 -- 172.21.15.167:0/1476480832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900b4570 con 0x55c267ab6c50 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c267abe800 con 0x55c267ab6c50 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fbf7d7fa640 1 -- 172.21.15.167:0/1476480832 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc0900b4710 con 0x55c267ab6c50 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fbf7d7fa640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf68034650 0x7fbf68036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fbf7d7fa640 1 -- 172.21.15.167:0/1476480832 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc090118aa0 con 0x55c267ab6c50 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc09f011640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf68034650 0x7fbf68036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c267ac8e80 0x55c267acb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267acba70 con 0x55c267ac8e80 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc0a0013640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c267ac8e80 0x55c267acb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc09f011640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf68034650 0x7fbf68036b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc08800c010 tx=0x7fc088010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.024+0000 7fc0a0013640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c267ac8e80 0x55c267acb320 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0980083f0 con 0x55c267ac8e80 2024-09-18T02:04:17.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 20 realm 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267acbed0 con 0x55c267ac8e80 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0980083f0 con 0x55c267ac8e80 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267acc770 con 0x55c267ac8e80 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0980083f0 con 0x55c267ac8e80 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ac8e80 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc0980083f0 con 0x55c267ac8e80 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c267acd870 0x55c267acfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad01e0 con 0x55c267acd870 2024-09-18T02:04:17.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc09f812640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c267acd870 0x55c267acfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc09f812640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c267acd870 0x55c267acfc60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:17.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 20 searching for the correct realm 2024-09-18T02:04:17.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c267ad2130 0x55c267ad45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad4cc0 con 0x55c267ad2130 2024-09-18T02:04:17.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc09f011640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c267ad2130 0x55c267ad45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc09f011640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c267ad2130 0x55c267ad45f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc09f011640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc08801fbe0 0x7fc08803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad4cc0 con 0x7fc08801fbe0 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a0013640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc08801fbe0 0x7fc08803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a0013640 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc08801fbe0 0x7fc08803a3c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0980083f0 con 0x7fc08801fbe0 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.028+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267acd870 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ac8e80 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0980083f0 con 0x55c267ac8e80 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ac8e80 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267acd870 2024-09-18T02:04:17.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267acd870 2024-09-18T02:04:17.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x7fc08801fbe0 2024-09-18T02:04:17.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc098026040 con 0x7fc08801fbe0 2024-09-18T02:04:17.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ad2130 2024-09-18T02:04:17.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ac8e80 2024-09-18T02:04:17.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267acd870 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.032+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ac8e80 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x7fc08801fbe0 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc098026040 con 0x7fc08801fbe0 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ad2130 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ad2130 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267acd870 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ad2130 2024-09-18T02:04:17.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ad2130 2024-09-18T02:04:17.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ac8e80 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ac8e80 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267acd870 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ad2130 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x7fc08801fbe0 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc098026040 con 0x7fc08801fbe0 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.036+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ac8e80 2024-09-18T02:04:17.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267acd870 2024-09-18T02:04:17.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ad2130 2024-09-18T02:04:17.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267acd870 2024-09-18T02:04:17.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x7fc08801fbe0 2024-09-18T02:04:17.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc098026040 con 0x7fc08801fbe0 2024-09-18T02:04:17.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ad2130 2024-09-18T02:04:17.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267acd870 2024-09-18T02:04:17.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x55c267ac8e80 2024-09-18T02:04:17.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c267accb10 con 0x7fc08801fbe0 2024-09-18T02:04:17.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc098026040 con 0x7fc08801fbe0 2024-09-18T02:04:17.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:17.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad0a30 con 0x55c267ac8e80 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad0a30 con 0x55c267ac8e80 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.040+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad0a30 con 0x55c267ad2130 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 20 zone default found 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 4 Realm: () 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 20 zonegroup default 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad12d0 con 0x55c267acd870 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad6b20 con 0x55c267ad2130 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad6ec0 con 0x55c267ad2130 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 20 started sync module instance, tier type = 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad5fc0 con 0x7fc08801fbe0 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x7fc08801fbe0 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293451433152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad5fc0 con 0x7fc08801fbe0 2024-09-18T02:04:17.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad7900 con 0x55c267ac8e80 2024-09-18T02:04:17.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.044+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94293451433152] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x7fc08801fbe0 2024-09-18T02:04:17.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.048+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.048+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94293451437008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad5fc0 con 0x55c267ac8e80 2024-09-18T02:04:17.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.048+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad8310 con 0x55c267ad2130 2024-09-18T02:04:17.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.048+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.048+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94293451439712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad8bb0 con 0x55c267ad2130 2024-09-18T02:04:17.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.048+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad95b0 con 0x7fc08801fbe0 2024-09-18T02:04:17.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.048+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94293451437008] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.048+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x7fc08801fbe0 2024-09-18T02:04:17.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.048+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94293451430672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad99d0 con 0x7fc08801fbe0 2024-09-18T02:04:17.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.048+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ada390 con 0x55c267ac8e80 2024-09-18T02:04:17.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.052+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94293451439712] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.052+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94293451430672] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x7fc08801fbe0 2024-09-18T02:04:17.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.052+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.052+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94293451444416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad9ee0 con 0x55c267ac8e80 2024-09-18T02:04:17.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.052+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ada730 con 0x55c267acd870 2024-09-18T02:04:17.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.052+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94293451444416] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.052+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.052+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94293451448032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad8810 con 0x55c267acd870 2024-09-18T02:04:17.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.052+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267adb430 con 0x55c267acd870 2024-09-18T02:04:17.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94293451454416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267adc0a0 con 0x55c267acd870 2024-09-18T02:04:17.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267adca60 con 0x55c267acd870 2024-09-18T02:04:17.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94293451448032] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94293451454416] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94293451455472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267adc010 con 0x55c267acd870 2024-09-18T02:04:17.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc0a1d02980 20 add_watcher() i=0 2024-09-18T02:04:17.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc0a1d02980 20 add_watcher() i=1 2024-09-18T02:04:17.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc0a1d02980 20 add_watcher() i=2 2024-09-18T02:04:17.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc0a1d02980 20 add_watcher() i=3 2024-09-18T02:04:17.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc0a1d02980 20 add_watcher() i=4 2024-09-18T02:04:17.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc0a1d02980 20 add_watcher() i=5 2024-09-18T02:04:17.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.056+0000 7fc0a1d02980 20 add_watcher() i=6 2024-09-18T02:04:17.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94293451455472] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a1d02980 20 add_watcher() i=7 2024-09-18T02:04:17.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a1d02980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:17.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267adfa90 con 0x55c267ac8e80 2024-09-18T02:04:17.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94293451457968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267adce80 con 0x55c267ac8e80 2024-09-18T02:04:17.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94293451457968] v30'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fbf55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a1d02980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:17.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a1d02980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:17.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a1d02980 5 note: GC not initialized 2024-09-18T02:04:17.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fbf54fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:17.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a1d02980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:17.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a1d02980 20 Filter name: none 2024-09-18T02:04:17.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fbece7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:17.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a1d02980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.060+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c267b02a90 con 0x55c267ac8e80 2024-09-18T02:04:17.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.064+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.064+0000 7fc0a1d02980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:17.066 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:17.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.064+0000 7fbf55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.064+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94293451457968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267b019e0 con 0x55c267ac8e80 2024-09-18T02:04:17.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.064+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94293451457968] v30'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.064+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94293451433152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267adc5b0 con 0x7fc08801fbe0 2024-09-18T02:04:17.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.064+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94293451433152] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x7fc08801fbe0 2024-09-18T02:04:17.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.064+0000 7fc0a1d02980 20 remove_watcher() i=0 2024-09-18T02:04:17.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.064+0000 7fc0a1d02980 2 removed watcher, disabling cache 2024-09-18T02:04:17.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.064+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94293451437008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267adc5b0 con 0x55c267ac8e80 2024-09-18T02:04:17.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.068+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94293451437008] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.068+0000 7fc0a1d02980 20 remove_watcher() i=1 2024-09-18T02:04:17.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.068+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94293451439712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad73d0 con 0x55c267ad2130 2024-09-18T02:04:17.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.068+0000 7fc09f011640 1 -- 172.21.15.167:0/1476480832 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94293451439712] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc088037040 con 0x55c267ad2130 2024-09-18T02:04:17.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.068+0000 7fc0a1d02980 20 remove_watcher() i=2 2024-09-18T02:04:17.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.068+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94293451430672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267adc5b0 con 0x7fc08801fbe0 2024-09-18T02:04:17.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.068+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94293451430672] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x7fc08801fbe0 2024-09-18T02:04:17.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.068+0000 7fc0a1d02980 20 remove_watcher() i=3 2024-09-18T02:04:17.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.068+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94293451444416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267adc5b0 con 0x55c267ac8e80 2024-09-18T02:04:17.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.072+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94293451444416] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc098026040 con 0x55c267ac8e80 2024-09-18T02:04:17.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.072+0000 7fc0a1d02980 20 remove_watcher() i=4 2024-09-18T02:04:17.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.072+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94293451448032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad90c0 con 0x55c267acd870 2024-09-18T02:04:17.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.072+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94293451448032] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.072+0000 7fc0a1d02980 20 remove_watcher() i=5 2024-09-18T02:04:17.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.072+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94293451454416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267adc5b0 con 0x55c267acd870 2024-09-18T02:04:17.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94293451454416] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 20 remove_watcher() i=6 2024-09-18T02:04:17.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94293451455472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c267ad9ee0 con 0x55c267acd870 2024-09-18T02:04:17.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc09f812640 1 -- 172.21.15.167:0/1476480832 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94293451455472] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090114020 con 0x55c267acd870 2024-09-18T02:04:17.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 20 remove_watcher() i=7 2024-09-18T02:04:17.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c267acd870 msgr2=0x55c267acfc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c267acd870 0x55c267acfc60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c267ac8e80 msgr2=0x55c267acb320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c267ac8e80 0x55c267acb320 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc08801fbe0 msgr2=0x7fc08803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc08801fbe0 0x7fc08803a3c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c267ad2130 msgr2=0x55c267ad45f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c267ad2130 0x55c267ad45f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf68034650 msgr2=0x7fbf68036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf68034650 0x7fbf68036b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc08800c010 tx=0x7fc088010000 comp rx=0 tx=0).stop 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a0013640 1 -- 172.21.15.167:0/1476480832 reap_dead start 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 msgr2=0x55c267abddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267abddf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc090007c50 tx=0x7fc0900077a0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 shutdown_connections 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/1476480832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267ab6c50 0x55c267abddf0 secure :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc090007c50 tx=0x7fc0900077a0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 >> 172.21.15.167:0/1476480832 conn(0x55c267ab2fd0 msgr2=0x55c267ab10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 shutdown_connections 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.076+0000 7fc0a1d02980 1 -- 172.21.15.167:0/1476480832 wait complete. 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3186895168 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf78034650 msgr2=0x7fbf78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/3186895168 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf78034650 0x7fbf78036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55c267a9cc50 tx=0x7fc08800f000 comp rx=0 tx=0).stop 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3186895168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267aaa2e0 msgr2=0x55c267aaa700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/3186895168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267aaa2e0 0x55c267aaa700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc0900e3280 tx=0x7fc0900c7c40 comp rx=0 tx=0).stop 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3186895168 shutdown_connections 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/3186895168 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf78034650 0x7fbf78036b10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/3186895168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c267aaa2e0 0x55c267aaa700 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3186895168 >> 172.21.15.167:0/3186895168 conn(0x55c267a9f430 msgr2=0x55c267aa1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3186895168 shutdown_connections 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/3186895168 wait complete. 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c267a95dd0 msgr2=0x55c267a981c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c267a95dd0 0x55c267a981c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c26790afd0 msgr2=0x55c267a93440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c26790afd0 0x55c267a93440 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c267a99cd0 msgr2=0x55c267a9c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c267a99cd0 0x55c267a9c0c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf88034650 msgr2=0x7fbf88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbf88034650 0x7fbf88036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc088000f70 tx=0x7fc088001380 comp rx=0 tx=0).stop 2024-09-18T02:04:17.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 msgr2=0x55c267a8c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 --2- 172.21.15.167:0/2252465536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c26790a680 0x55c267a8c470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc09001aec0 tx=0x7fc090017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:17.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a0013640 1 -- 172.21.15.167:0/2252465536 reap_dead start 2024-09-18T02:04:17.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 shutdown_connections 2024-09-18T02:04:17.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 >> 172.21.15.167:0/2252465536 conn(0x55c267909230 msgr2=0x55c267a7fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 shutdown_connections 2024-09-18T02:04:17.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.080+0000 7fc0a1d02980 1 -- 172.21.15.167:0/2252465536 wait complete. 2024-09-18T02:04:17.091 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:17.091 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-18T02:04:17.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-18T02:04:17.091 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-18T02:04:17.159 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:17.159 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:17.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.156+0000 7f2f35954980 1 Processor -- start 2024-09-18T02:04:17.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.156+0000 7f2f35954980 1 -- start start 2024-09-18T02:04:17.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.156+0000 7f2f35954980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562aee7962d0 0x562aee824360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.156+0000 7f2f35954980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562aee6a9ae0 con 0x562aee8248a0 2024-09-18T02:04:17.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.156+0000 7f2f35954980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x562aee6cde30 con 0x562aee7962d0 2024-09-18T02:04:17.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.156+0000 7f2f33464640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562aee7962d0 0x562aee824360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.156+0000 7f2f33464640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562aee7962d0 0x562aee824360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:55992/0 (socket says 172.21.15.167:55992) 2024-09-18T02:04:17.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.156+0000 7f2f33464640 1 -- 172.21.15.167:0/311980751 learned_addr learned my addr 172.21.15.167:0/311980751 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f33464640 1 -- 172.21.15.167:0/311980751 >> v1:172.21.15.81:6789/0 conn(0x562aee8248a0 legacy=0x562aee826c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f33464640 1 -- 172.21.15.167:0/311980751 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aee8293c0 con 0x562aee7962d0 2024-09-18T02:04:17.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f33464640 1 --2- 172.21.15.167:0/311980751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee824360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00a4e0 tx=0x7f2f2c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff737801edcd8ebe server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f32462640 1 -- 172.21.15.167:0/311980751 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0aa540 con 0x562aee7962d0 2024-09-18T02:04:17.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f32462640 1 -- 172.21.15.167:0/311980751 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0aa6e0 con 0x562aee7962d0 2024-09-18T02:04:17.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f32462640 1 -- 172.21.15.167:0/311980751 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0aaa40 con 0x562aee7962d0 2024-09-18T02:04:17.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f35954980 1 -- 172.21.15.167:0/311980751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 msgr2=0x562aee824360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f35954980 1 --2- 172.21.15.167:0/311980751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee824360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00a4e0 tx=0x7f2f2c01b090 comp rx=0 tx=0).stop 2024-09-18T02:04:17.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f35954980 1 -- 172.21.15.167:0/311980751 shutdown_connections 2024-09-18T02:04:17.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f35954980 1 --2- 172.21.15.167:0/311980751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee824360 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f35954980 1 -- 172.21.15.167:0/311980751 >> 172.21.15.167:0/311980751 conn(0x562aee81c090 msgr2=0x562aee81e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f35954980 1 -- 172.21.15.167:0/311980751 shutdown_connections 2024-09-18T02:04:17.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.160+0000 7f2f35954980 1 -- 172.21.15.167:0/311980751 wait complete. 2024-09-18T02:04:17.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.172+0000 7f2f35954980 1 Processor -- start 2024-09-18T02:04:17.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.172+0000 7f2f35954980 1 -- start start 2024-09-18T02:04:17.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee90c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562aee6cf200 con 0x562aee7962d0 2024-09-18T02:04:17.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f33464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee90c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f33464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee90c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56008/0 (socket says 172.21.15.167:56008) 2024-09-18T02:04:17.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f33464640 1 -- 172.21.15.167:0/787681521 learned_addr learned my addr 172.21.15.167:0/787681521 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f33464640 1 -- 172.21.15.167:0/787681521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aee90cf70 con 0x562aee7962d0 2024-09-18T02:04:17.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f33464640 1 --2- 172.21.15.167:0/787681521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee90c9a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c017ca0 tx=0x7f2f2c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8819274c367c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2e2160a640 1 -- 172.21.15.167:0/787681521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0b9030 con 0x562aee7962d0 2024-09-18T02:04:17.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2e2160a640 1 -- 172.21.15.167:0/787681521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0aaac0 con 0x562aee7962d0 2024-09-18T02:04:17.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2e2160a640 1 -- 172.21.15.167:0/787681521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0aada0 con 0x562aee7962d0 2024-09-18T02:04:17.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 -- 172.21.15.167:0/787681521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 msgr2=0x562aee90c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 --2- 172.21.15.167:0/787681521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee90c9a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c017ca0 tx=0x7f2f2c0033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 -- 172.21.15.167:0/787681521 shutdown_connections 2024-09-18T02:04:17.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 --2- 172.21.15.167:0/787681521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee90c9a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 -- 172.21.15.167:0/787681521 >> 172.21.15.167:0/787681521 conn(0x562aee81c090 msgr2=0x562aee9085d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 -- 172.21.15.167:0/787681521 shutdown_connections 2024-09-18T02:04:17.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 -- 172.21.15.167:0/787681521 wait complete. 2024-09-18T02:04:17.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 Processor -- start 2024-09-18T02:04:17.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 -- start start 2024-09-18T02:04:17.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee913bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f35954980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562aee828e30 con 0x562aee7962d0 2024-09-18T02:04:17.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f33464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee913bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f33464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee913bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56024/0 (socket says 172.21.15.167:56024) 2024-09-18T02:04:17.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f33464640 1 -- 172.21.15.167:0/2042403380 learned_addr learned my addr 172.21.15.167:0/2042403380 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.176+0000 7f2f33464640 1 -- 172.21.15.167:0/2042403380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aee9140f0 con 0x562aee7962d0 2024-09-18T02:04:17.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f33464640 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee913bb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c005cc0 tx=0x7f2f2c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2e1fe07640 1 -- 172.21.15.167:0/2042403380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0b9030 con 0x562aee7962d0 2024-09-18T02:04:17.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562aee914380 con 0x562aee7962d0 2024-09-18T02:04:17.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2e1fe07640 1 -- 172.21.15.167:0/2042403380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0c3070 con 0x562aee7962d0 2024-09-18T02:04:17.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2e1fe07640 1 -- 172.21.15.167:0/2042403380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0bf750 con 0x562aee7962d0 2024-09-18T02:04:17.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aee917060 con 0x562aee7962d0 2024-09-18T02:04:17.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2e1fe07640 1 -- 172.21.15.167:0/2042403380 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2f2c0c5030 con 0x562aee7962d0 2024-09-18T02:04:17.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2e1fe07640 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2e18034650 0x7f2e18036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2e1fe07640 1 -- 172.21.15.167:0/2042403380 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2f2c0ba070 con 0x562aee7962d0 2024-09-18T02:04:17.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f32c63640 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2e18034650 0x7f2e18036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f35954980 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562aee8248a0 0x562aee91ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee91b180 con 0x562aee8248a0 2024-09-18T02:04:17.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f33c65640 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562aee8248a0 0x562aee91ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f32c63640 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2e18034650 0x7f2e18036b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f28000f70 tx=0x7f2f28001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f33c65640 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562aee8248a0 0x562aee91ab40 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f33c65640 1 -- 172.21.15.167:0/2042403380 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee8248a0 2024-09-18T02:04:17.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee91ba40 con 0x562aee8248a0 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f33c65640 1 -- 172.21.15.167:0/2042403380 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee8248a0 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f35954980 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562aee91d350 0x562aee91f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee91ff80 con 0x562aee91d350 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f33464640 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562aee91d350 0x562aee91f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.180+0000 7f2f33464640 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562aee91d350 0x562aee91f7f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f33464640 1 -- 172.21.15.167:0/2042403380 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f2c0ce070 con 0x562aee91d350 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee91c290 con 0x562aee8248a0 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f33c65640 1 -- 172.21.15.167:0/2042403380 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee8248a0 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f35954980 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562aee9213e0 0x562aee9237d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee923f40 con 0x562aee9213e0 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f32c63640 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562aee9213e0 0x562aee9237d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f32c63640 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562aee9213e0 0x562aee9237d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f32c63640 1 -- 172.21.15.167:0/2042403380 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f2800d040 con 0x562aee9213e0 2024-09-18T02:04:17.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f35954980 1 Processor -- start 2024-09-18T02:04:17.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f35954980 1 -- start start 2024-09-18T02:04:17.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f35954980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee9319f0 0x562aee931e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f35954980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562aee728800 con 0x562aee9319f0 2024-09-18T02:04:17.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f33464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee9319f0 0x562aee931e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f33464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee9319f0 0x562aee931e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56032/0 (socket says 172.21.15.167:56032) 2024-09-18T02:04:17.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f33464640 1 -- 172.21.15.167:0/157152937 learned_addr learned my addr 172.21.15.167:0/157152937 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f33464640 1 -- 172.21.15.167:0/157152937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aee932350 con 0x562aee9319f0 2024-09-18T02:04:17.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.184+0000 7f2f33464640 1 --2- 172.21.15.167:0/157152937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee9319f0 0x562aee931e10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0b7010 tx=0x7f2f2c0b4c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2e1d602640 1 -- 172.21.15.167:0/157152937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0c64f0 con 0x562aee9319f0 2024-09-18T02:04:17.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2e1d602640 1 -- 172.21.15.167:0/157152937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0c6690 con 0x562aee9319f0 2024-09-18T02:04:17.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f35954980 1 -- 172.21.15.167:0/157152937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562aee9325e0 con 0x562aee9319f0 2024-09-18T02:04:17.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2e1d602640 1 -- 172.21.15.167:0/157152937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0bf9c0 con 0x562aee9319f0 2024-09-18T02:04:17.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f35954980 1 -- 172.21.15.167:0/157152937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aee935260 con 0x562aee9319f0 2024-09-18T02:04:17.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2e1d602640 1 -- 172.21.15.167:0/157152937 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2f2c0b3040 con 0x562aee9319f0 2024-09-18T02:04:17.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2e1d602640 1 --2- 172.21.15.167:0/157152937 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2e0c0346a0 0x7f2e0c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2e1d602640 1 -- 172.21.15.167:0/157152937 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2f2c0d7070 con 0x562aee9319f0 2024-09-18T02:04:17.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f32c63640 1 --2- 172.21.15.167:0/157152937 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2e0c0346a0 0x7f2e0c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f35954980 1 Processor -- start 2024-09-18T02:04:17.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f35954980 1 -- start start 2024-09-18T02:04:17.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f32c63640 1 --2- 172.21.15.167:0/157152937 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2e0c0346a0 0x7f2e0c036b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x562aee920320 tx=0x7f2f28006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f35954980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee820700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f35954980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562aee90d230 con 0x562aee820320 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f33464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee820700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f33464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee820700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56038/0 (socket says 172.21.15.167:56038) 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f33464640 1 -- 172.21.15.167:0/133463596 learned_addr learned my addr 172.21.15.167:0/133463596 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f33464640 1 -- 172.21.15.167:0/133463596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aee820cd0 con 0x562aee820320 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2f33464640 1 --2- 172.21.15.167:0/133463596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee820700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0c6990 tx=0x7f2f2c0c7b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717e4d2af0010c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2e16ffd640 1 -- 172.21.15.167:0/133463596 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0fa020 con 0x562aee820320 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2e16ffd640 1 -- 172.21.15.167:0/133463596 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0c7410 con 0x562aee820320 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.188+0000 7f2e16ffd640 1 -- 172.21.15.167:0/133463596 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0af230 con 0x562aee820320 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 -- 172.21.15.167:0/133463596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 msgr2=0x562aee820700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 --2- 172.21.15.167:0/133463596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee820700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0c6990 tx=0x7f2f2c0c7b60 comp rx=0 tx=0).stop 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 -- 172.21.15.167:0/133463596 shutdown_connections 2024-09-18T02:04:17.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 --2- 172.21.15.167:0/133463596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee820700 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 -- 172.21.15.167:0/133463596 >> 172.21.15.167:0/133463596 conn(0x562aee93a6c0 msgr2=0x562aee9387c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 -- 172.21.15.167:0/133463596 shutdown_connections 2024-09-18T02:04:17.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 -- 172.21.15.167:0/133463596 wait complete. 2024-09-18T02:04:17.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 Processor -- start 2024-09-18T02:04:17.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 -- start start 2024-09-18T02:04:17.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee947750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562aee821320 con 0x562aee820320 2024-09-18T02:04:17.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f33464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee947750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f33464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee947750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56048/0 (socket says 172.21.15.167:56048) 2024-09-18T02:04:17.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 learned_addr learned my addr 172.21.15.167:0/4082011067 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aee947c90 con 0x562aee820320 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f33464640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee947750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0c6990 tx=0x7f2f2c0c3fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2e157fa640 1 -- 172.21.15.167:0/4082011067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c10e070 con 0x562aee820320 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2e157fa640 1 -- 172.21.15.167:0/4082011067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2c005230 con 0x562aee820320 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562aee947c90 con 0x562aee820320 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2e157fa640 1 -- 172.21.15.167:0/4082011067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0d0800 con 0x562aee820320 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aee947c90 con 0x562aee820320 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2e157fa640 1 -- 172.21.15.167:0/4082011067 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2f2c111070 con 0x562aee820320 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.192+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2e157fa640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2dfc0346a0 0x7f2dfc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2e157fa640 1 -- 172.21.15.167:0/4082011067 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2f2c0f2040 con 0x562aee820320 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f32c63640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2dfc0346a0 0x7f2dfc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562aee952680 0x562aee954b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee955290 con 0x562aee952680 2024-09-18T02:04:17.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f33c65640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562aee952680 0x562aee954b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f32c63640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2dfc0346a0 0x7f2dfc036b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f28010fd0 tx=0x7f2f28011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f33c65640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562aee952680 0x562aee954b40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 20 realm 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee9556a0 con 0x562aee952680 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee955f40 con 0x562aee952680 2024-09-18T02:04:17.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee952680 2024-09-18T02:04:17.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562aee957040 0x562aee959430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee959a80 con 0x562aee957040 2024-09-18T02:04:17.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f33464640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562aee957040 0x562aee959430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f33464640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562aee957040 0x562aee959430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:17.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 20 searching for the correct realm 2024-09-18T02:04:17.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562aee95b960 0x562aee95dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee95e410 con 0x562aee95b960 2024-09-18T02:04:17.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f32c63640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562aee95b960 0x562aee95dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.196+0000 7f2f32c63640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562aee95b960 0x562aee95dd90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f32c63640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2f2800f3d0 0x7f2f2800f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee95e410 con 0x7f2f2800f3d0 2024-09-18T02:04:17.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33c65640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2f2800f3d0 0x7f2f2800f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33c65640 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2f2800f3d0 0x7f2f2800f7f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee957040 2024-09-18T02:04:17.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee952680 2024-09-18T02:04:17.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee952680 2024-09-18T02:04:17.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee957040 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee957040 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee95b960 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.200+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee952680 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee957040 2024-09-18T02:04:17.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee952680 2024-09-18T02:04:17.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee95b960 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee95b960 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee957040 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee95b960 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee95b960 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee952680 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee952680 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.204+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee957040 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee95b960 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee952680 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee957040 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee95b960 2024-09-18T02:04:17.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee957040 2024-09-18T02:04:17.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee95b960 2024-09-18T02:04:17.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee957040 2024-09-18T02:04:17.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x562aee952680 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.208+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562aee9562e0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee95a2d0 con 0x562aee952680 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee95a2d0 con 0x562aee952680 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee95a2d0 con 0x562aee95b960 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 zone default found 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 4 Realm: () 2024-09-18T02:04:17.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 zonegroup default 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee95ac50 con 0x562aee957040 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee9602d0 con 0x562aee95b960 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee960780 con 0x562aee95b960 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 started sync module instance, tier type = 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee95f710 con 0x7f2f2800f3d0 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94742391422000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee95f710 con 0x7f2f2800f3d0 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.212+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee961290 con 0x562aee952680 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.216+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94742391422000] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.216+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.216+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94742391426432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee95f710 con 0x562aee952680 2024-09-18T02:04:17.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.216+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee961ca0 con 0x562aee95b960 2024-09-18T02:04:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.216+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.216+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94742391429104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee962540 con 0x562aee95b960 2024-09-18T02:04:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.216+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee962f40 con 0x7f2f2800f3d0 2024-09-18T02:04:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.216+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94742391426432] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.220+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.220+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94742391419488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee962f00 con 0x7f2f2800f3d0 2024-09-18T02:04:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.220+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee963950 con 0x562aee952680 2024-09-18T02:04:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.220+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94742391429104] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.220+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94742391419488] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.220+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.220+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94742391433808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee9621a0 con 0x562aee952680 2024-09-18T02:04:17.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.220+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee963e00 con 0x562aee957040 2024-09-18T02:04:17.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.220+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94742391433808] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.224+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.224+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94742391436448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee9621a0 con 0x562aee957040 2024-09-18T02:04:17.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.224+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee9648c0 con 0x562aee957040 2024-09-18T02:04:17.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.224+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94742391436448] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.224+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.224+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94742391437504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee965110 con 0x562aee957040 2024-09-18T02:04:17.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.224+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee965ad0 con 0x562aee957040 2024-09-18T02:04:17.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94742391445504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee966250 con 0x562aee957040 2024-09-18T02:04:17.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 20 add_watcher() i=0 2024-09-18T02:04:17.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 20 add_watcher() i=1 2024-09-18T02:04:17.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 20 add_watcher() i=2 2024-09-18T02:04:17.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 20 add_watcher() i=3 2024-09-18T02:04:17.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 20 add_watcher() i=4 2024-09-18T02:04:17.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 20 add_watcher() i=5 2024-09-18T02:04:17.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94742391437504] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 20 add_watcher() i=6 2024-09-18T02:04:17.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94742391445504] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 20 add_watcher() i=7 2024-09-18T02:04:17.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:17.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee964c60 con 0x562aee952680 2024-09-18T02:04:17.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94742391446752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee964c60 con 0x562aee952680 2024-09-18T02:04:17.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94742391446752] v30'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2de9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:17.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:17.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.228+0000 7f2f35954980 5 note: GC not initialized 2024-09-18T02:04:17.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2de8fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:17.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:17.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 20 Filter name: none 2024-09-18T02:04:17.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2d627fc640 20 reqs_thread_entry: start 2024-09-18T02:04:17.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:17.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee98c910 con 0x562aee952680 2024-09-18T02:04:17.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:17.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:17.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:17.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:17.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee98c450 con 0x7f2f2800f3d0 2024-09-18T02:04:17.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee992bf0 con 0x562aee952680 2024-09-18T02:04:17.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:17.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:17.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:17.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94742391629952 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562aee98f910 con 0x562aee952680 2024-09-18T02:04:17.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94742391433808 notify 128849018881 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f2f24010040 con 0x562aee952680 2024-09-18T02:04:17.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2e16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94742391433808 notifier 4319 bl.length()=567 2024-09-18T02:04:17.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2e16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:17.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2e16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:17.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify cookie 94742391629952 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2e16ffd640 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2df8003eb0 con 0x562aee952680 2024-09-18T02:04:17.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94742391629952 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2f2400a810 con 0x562aee952680 2024-09-18T02:04:17.238 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:17.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2de9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.232+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94742391446752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee98a740 con 0x562aee952680 2024-09-18T02:04:17.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.236+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94742391446752] v30'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.236+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94742391422000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee98a740 con 0x7f2f2800f3d0 2024-09-18T02:04:17.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.236+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94742391422000] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.236+0000 7f2f35954980 20 remove_watcher() i=0 2024-09-18T02:04:17.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.236+0000 7f2f35954980 2 removed watcher, disabling cache 2024-09-18T02:04:17.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.236+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94742391426432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee98a740 con 0x562aee952680 2024-09-18T02:04:17.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.236+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94742391426432] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.236+0000 7f2f35954980 20 remove_watcher() i=1 2024-09-18T02:04:17.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.236+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94742391429104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee98a740 con 0x562aee95b960 2024-09-18T02:04:17.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.240+0000 7f2f32c63640 1 -- 172.21.15.167:0/4082011067 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94742391429104] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28036040 con 0x562aee95b960 2024-09-18T02:04:17.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.240+0000 7f2f35954980 20 remove_watcher() i=2 2024-09-18T02:04:17.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.240+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94742391419488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee98a740 con 0x7f2f2800f3d0 2024-09-18T02:04:17.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.240+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94742391419488] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x7f2f2800f3d0 2024-09-18T02:04:17.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.240+0000 7f2f35954980 20 remove_watcher() i=3 2024-09-18T02:04:17.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.240+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94742391433808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee95f260 con 0x562aee952680 2024-09-18T02:04:17.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.244+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94742391433808] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f240083f0 con 0x562aee952680 2024-09-18T02:04:17.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.244+0000 7f2f35954980 20 remove_watcher() i=4 2024-09-18T02:04:17.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.244+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94742391436448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee98a740 con 0x562aee957040 2024-09-18T02:04:17.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.244+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94742391436448] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.244+0000 7f2f35954980 20 remove_watcher() i=5 2024-09-18T02:04:17.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.244+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94742391437504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee962a50 con 0x562aee957040 2024-09-18T02:04:17.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94742391437504] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 20 remove_watcher() i=6 2024-09-18T02:04:17.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94742391445504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562aee95f260 con 0x562aee957040 2024-09-18T02:04:17.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f33464640 1 -- 172.21.15.167:0/4082011067 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94742391445504] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c110030 con 0x562aee957040 2024-09-18T02:04:17.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 20 remove_watcher() i=7 2024-09-18T02:04:17.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562aee957040 msgr2=0x562aee959430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562aee957040 0x562aee959430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562aee952680 msgr2=0x562aee954b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562aee952680 0x562aee954b40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2f2800f3d0 msgr2=0x7f2f2800f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2f2800f3d0 0x7f2f2800f7f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562aee95b960 msgr2=0x562aee95dd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562aee95b960 0x562aee95dd90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2dfc0346a0 msgr2=0x7f2dfc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2dfc0346a0 0x7f2dfc036b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f28010fd0 tx=0x7f2f28011000 comp rx=0 tx=0).stop 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 msgr2=0x562aee947750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f33c65640 1 -- 172.21.15.167:0/4082011067 reap_dead start 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.248+0000 7f2f35954980 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee947750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0c6990 tx=0x7f2f2c0c3fb0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 shutdown_connections 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 --2- 172.21.15.167:0/4082011067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee820320 0x562aee947750 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 >> 172.21.15.167:0/4082011067 conn(0x562aee93a6c0 msgr2=0x562aee938790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 shutdown_connections 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/4082011067 wait complete. 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/157152937 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2e0c0346a0 msgr2=0x7f2e0c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 --2- 172.21.15.167:0/157152937 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2e0c0346a0 0x7f2e0c036b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x562aee920320 tx=0x7f2f28006000 comp rx=0 tx=0).stop 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/157152937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee9319f0 msgr2=0x562aee931e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 --2- 172.21.15.167:0/157152937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee9319f0 0x562aee931e10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0b7010 tx=0x7f2f2c0b4c50 comp rx=0 tx=0).stop 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/157152937 shutdown_connections 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 --2- 172.21.15.167:0/157152937 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2e0c0346a0 0x7f2e0c036b60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 --2- 172.21.15.167:0/157152937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee9319f0 0x562aee931e10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/157152937 >> 172.21.15.167:0/157152937 conn(0x562aee926b40 msgr2=0x562aee9295c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/157152937 shutdown_connections 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/157152937 wait complete. 2024-09-18T02:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562aee91d350 msgr2=0x562aee91f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562aee91d350 0x562aee91f7f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562aee8248a0 msgr2=0x562aee91ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562aee8248a0 0x562aee91ab40 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562aee9213e0 msgr2=0x562aee9237d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562aee9213e0 0x562aee9237d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2e18034650 msgr2=0x7f2e18036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2e18034650 0x7f2e18036b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f28000f70 tx=0x7f2f28001420 comp rx=0 tx=0).stop 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 msgr2=0x562aee913bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 --2- 172.21.15.167:0/2042403380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aee7962d0 0x562aee913bb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c005cc0 tx=0x7f2f2c017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f33c65640 1 -- 172.21.15.167:0/2042403380 reap_dead start 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 shutdown_connections 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 >> 172.21.15.167:0/2042403380 conn(0x562aee81c090 msgr2=0x562aee907150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 shutdown_connections 2024-09-18T02:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.252+0000 7f2f35954980 1 -- 172.21.15.167:0/2042403380 wait complete. 2024-09-18T02:04:17.263 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:17.264 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T02:04:17.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T02:04:17.264 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T02:04:17.333 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:17.333 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:17.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.332+0000 7f3b713f0980 1 Processor -- start 2024-09-18T02:04:17.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.332+0000 7f3b713f0980 1 -- start start 2024-09-18T02:04:17.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.332+0000 7f3b713f0980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a44e1cf8e0 0x55a44e1cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.332+0000 7f3b713f0980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a44e055ae0 con 0x55a44e1d0230 2024-09-18T02:04:17.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.332+0000 7f3b713f0980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55a44e079e30 con 0x55a44e1cf8e0 2024-09-18T02:04:17.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.332+0000 7f3b6ef00640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a44e1cf8e0 0x55a44e1cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.332+0000 7f3b6ef00640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a44e1cf8e0 0x55a44e1cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56054/0 (socket says 172.21.15.167:56054) 2024-09-18T02:04:17.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.332+0000 7f3b6ef00640 1 -- 172.21.15.167:0/460351742 learned_addr learned my addr 172.21.15.167:0/460351742 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.332+0000 7f3b6ef00640 1 -- 172.21.15.167:0/460351742 >> v1:172.21.15.81:6789/0 conn(0x55a44e1d0230 legacy=0x55a44e1d4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.332+0000 7f3b6ef00640 1 -- 172.21.15.167:0/460351742 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a44e1d74b0 con 0x55a44e1cf8e0 2024-09-18T02:04:17.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.332+0000 7f3b6ef00640 1 --2- 172.21.15.167:0/460351742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e1cfcc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400a5c0 tx=0x7f3b6401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33faf2c4f0c5b490 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.336+0000 7f3b6defe640 1 -- 172.21.15.167:0/460351742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640a6070 con 0x55a44e1cf8e0 2024-09-18T02:04:17.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.336+0000 7f3b6defe640 1 -- 172.21.15.167:0/460351742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b640af070 con 0x55a44e1cf8e0 2024-09-18T02:04:17.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.336+0000 7f3b6defe640 1 -- 172.21.15.167:0/460351742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640aa5c0 con 0x55a44e1cf8e0 2024-09-18T02:04:17.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.336+0000 7f3b713f0980 1 -- 172.21.15.167:0/460351742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 msgr2=0x55a44e1cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.336+0000 7f3b713f0980 1 --2- 172.21.15.167:0/460351742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e1cfcc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400a5c0 tx=0x7f3b6401b340 comp rx=0 tx=0).stop 2024-09-18T02:04:17.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.336+0000 7f3b713f0980 1 -- 172.21.15.167:0/460351742 shutdown_connections 2024-09-18T02:04:17.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.336+0000 7f3b713f0980 1 --2- 172.21.15.167:0/460351742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e1cfcc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.336+0000 7f3b713f0980 1 -- 172.21.15.167:0/460351742 >> 172.21.15.167:0/460351742 conn(0x55a44e143230 msgr2=0x55a44e143640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.336+0000 7f3b713f0980 1 -- 172.21.15.167:0/460351742 shutdown_connections 2024-09-18T02:04:17.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.336+0000 7f3b713f0980 1 -- 172.21.15.167:0/460351742 wait complete. 2024-09-18T02:04:17.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b713f0980 1 Processor -- start 2024-09-18T02:04:17.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b713f0980 1 -- start start 2024-09-18T02:04:17.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b713f0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e2babd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b713f0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a44e07b200 con 0x55a44e1cf8e0 2024-09-18T02:04:17.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b6ef00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e2babd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b6ef00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e2babd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56068/0 (socket says 172.21.15.167:56068) 2024-09-18T02:04:17.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3347772822 learned_addr learned my addr 172.21.15.167:0/3347772822 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3347772822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a44e2bb1a0 con 0x55a44e1cf8e0 2024-09-18T02:04:17.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b6ef00640 1 --2- 172.21.15.167:0/3347772822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e2babd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3b640199f0 tx=0x7f3b64003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ed748ead4caec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3a5ce09640 1 -- 172.21.15.167:0/3347772822 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640aaa00 con 0x55a44e1cf8e0 2024-09-18T02:04:17.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3a5ce09640 1 -- 172.21.15.167:0/3347772822 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b640aaba0 con 0x55a44e1cf8e0 2024-09-18T02:04:17.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3a5ce09640 1 -- 172.21.15.167:0/3347772822 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640bd3f0 con 0x55a44e1cf8e0 2024-09-18T02:04:17.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b713f0980 1 -- 172.21.15.167:0/3347772822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 msgr2=0x55a44e2babd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3347772822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e2babd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3b640199f0 tx=0x7f3b64003030 comp rx=0 tx=0).stop 2024-09-18T02:04:17.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b713f0980 1 -- 172.21.15.167:0/3347772822 shutdown_connections 2024-09-18T02:04:17.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3347772822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e2babd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b713f0980 1 -- 172.21.15.167:0/3347772822 >> 172.21.15.167:0/3347772822 conn(0x55a44e143230 msgr2=0x55a44e2b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b713f0980 1 -- 172.21.15.167:0/3347772822 shutdown_connections 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.348+0000 7f3b713f0980 1 -- 172.21.15.167:0/3347772822 wait complete. 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b713f0980 1 Processor -- start 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b713f0980 1 -- start start 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b713f0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e2c1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b713f0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a44e1d6ef0 con 0x55a44e1cf8e0 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b6ef00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e2c1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b6ef00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e2c1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56076/0 (socket says 172.21.15.167:56076) 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b6ef00640 1 -- 172.21.15.167:0/1628314548 learned_addr learned my addr 172.21.15.167:0/1628314548 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b6ef00640 1 -- 172.21.15.167:0/1628314548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a44e2c2380 con 0x55a44e1cf8e0 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b6ef00640 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e2c1e40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3b640199f0 tx=0x7f3b640180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3a5b606640 1 -- 172.21.15.167:0/1628314548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640bd7c0 con 0x55a44e1cf8e0 2024-09-18T02:04:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a44e2c2610 con 0x55a44e1cf8e0 2024-09-18T02:04:17.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3a5b606640 1 -- 172.21.15.167:0/1628314548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b640bd960 con 0x55a44e1cf8e0 2024-09-18T02:04:17.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a44e2c52f0 con 0x55a44e1cf8e0 2024-09-18T02:04:17.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3a5b606640 1 -- 172.21.15.167:0/1628314548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640bdb10 con 0x55a44e1cf8e0 2024-09-18T02:04:17.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3a5b606640 1 -- 172.21.15.167:0/1628314548 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3b640ce020 con 0x55a44e1cf8e0 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3a5b606640 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a54034650 0x7f3a54036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3a5b606640 1 -- 172.21.15.167:0/1628314548 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3b640cc020 con 0x55a44e1cf8e0 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b6e6ff640 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a54034650 0x7f3a54036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b713f0980 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a44e1d0230 0x55a44e2c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e2c9480 con 0x55a44e1d0230 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b6f701640 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a44e1d0230 0x55a44e2c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b6e6ff640 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a54034650 0x7f3a54036b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b60001e20 tx=0x7f3b600013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b6f701640 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a44e1d0230 0x55a44e2c8f40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b6f701640 1 -- 172.21.15.167:0/1628314548 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e1d0230 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.352+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e2c9d50 con 0x55a44e1d0230 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b6f701640 1 -- 172.21.15.167:0/1628314548 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e1d0230 2024-09-18T02:04:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b713f0980 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a44e2cb660 0x55a44e2cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e2ce2b0 con 0x55a44e2cb660 2024-09-18T02:04:17.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b6ef00640 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a44e2cb660 0x55a44e2cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b6ef00640 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a44e2cb660 0x55a44e2cdb20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b6ef00640 1 -- 172.21.15.167:0/1628314548 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3b640c6a40 con 0x55a44e2cb660 2024-09-18T02:04:17.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e2ca5a0 con 0x55a44e1d0230 2024-09-18T02:04:17.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b6f701640 1 -- 172.21.15.167:0/1628314548 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e1d0230 2024-09-18T02:04:17.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b713f0980 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a44e2cf710 0x55a44e2d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e2d21f0 con 0x55a44e2cf710 2024-09-18T02:04:17.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b6e6ff640 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a44e2cf710 0x55a44e2d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b6e6ff640 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a44e2cf710 0x55a44e2d1b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/1628314548 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3b6000d040 con 0x55a44e2cf710 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b713f0980 1 Processor -- start 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b713f0980 1 -- start start 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b713f0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2dfcc0 0x55a44e2e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b713f0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a44e0d4800 con 0x55a44e2dfcc0 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b6ef00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2dfcc0 0x55a44e2e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b6ef00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2dfcc0 0x55a44e2e00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56088/0 (socket says 172.21.15.167:56088) 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.356+0000 7f3b6ef00640 1 -- 172.21.15.167:0/2930759744 learned_addr learned my addr 172.21.15.167:0/2930759744 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b6ef00640 1 -- 172.21.15.167:0/2930759744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a44e2e0620 con 0x55a44e2dfcc0 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b6ef00640 1 --2- 172.21.15.167:0/2930759744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2dfcc0 0x55a44e2e00e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b64003050 tx=0x7f3b640c67f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3a58e01640 1 -- 172.21.15.167:0/2930759744 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640c5500 con 0x55a44e2dfcc0 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b713f0980 1 -- 172.21.15.167:0/2930759744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a44e2e08b0 con 0x55a44e2dfcc0 2024-09-18T02:04:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3a58e01640 1 -- 172.21.15.167:0/2930759744 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b640c56a0 con 0x55a44e2dfcc0 2024-09-18T02:04:17.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3a58e01640 1 -- 172.21.15.167:0/2930759744 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640c5980 con 0x55a44e2dfcc0 2024-09-18T02:04:17.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b713f0980 1 -- 172.21.15.167:0/2930759744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a44e2e3530 con 0x55a44e2dfcc0 2024-09-18T02:04:17.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3a58e01640 1 -- 172.21.15.167:0/2930759744 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3b640ef060 con 0x55a44e2dfcc0 2024-09-18T02:04:17.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3a58e01640 1 --2- 172.21.15.167:0/2930759744 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a48034650 0x7f3a48036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3a58e01640 1 -- 172.21.15.167:0/2930759744 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3b640e9ac0 con 0x55a44e2dfcc0 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b6e6ff640 1 --2- 172.21.15.167:0/2930759744 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a48034650 0x7f3a48036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b713f0980 1 Processor -- start 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b713f0980 1 -- start start 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b6e6ff640 1 --2- 172.21.15.167:0/2930759744 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a48034650 0x7f3a48036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55a44e2c6550 tx=0x7f3b60006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b713f0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2ec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b713f0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a44e2bb460 con 0x55a44e2ec5f0 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b6ef00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2ec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b6ef00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2ec9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56092/0 (socket says 172.21.15.167:56092) 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b6ef00640 1 -- 172.21.15.167:0/231329456 learned_addr learned my addr 172.21.15.167:0/231329456 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.360+0000 7f3b6ef00640 1 -- 172.21.15.167:0/231329456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a44e2ecfc0 con 0x55a44e2ec5f0 2024-09-18T02:04:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b6ef00640 1 --2- 172.21.15.167:0/231329456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2ec9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b640b3fb0 tx=0x7f3b640a7b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adf964f6e8ce12b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3a527fc640 1 -- 172.21.15.167:0/231329456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640e9e20 con 0x55a44e2ec5f0 2024-09-18T02:04:17.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3a527fc640 1 -- 172.21.15.167:0/231329456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b640f1ab0 con 0x55a44e2ec5f0 2024-09-18T02:04:17.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3a527fc640 1 -- 172.21.15.167:0/231329456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640b3b00 con 0x55a44e2ec5f0 2024-09-18T02:04:17.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 -- 172.21.15.167:0/231329456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 msgr2=0x55a44e2ec9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 --2- 172.21.15.167:0/231329456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2ec9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b640b3fb0 tx=0x7f3b640a7b60 comp rx=0 tx=0).stop 2024-09-18T02:04:17.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 -- 172.21.15.167:0/231329456 shutdown_connections 2024-09-18T02:04:17.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 --2- 172.21.15.167:0/231329456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2ec9f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 -- 172.21.15.167:0/231329456 >> 172.21.15.167:0/231329456 conn(0x55a44e2e8a10 msgr2=0x55a44e2e6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 -- 172.21.15.167:0/231329456 shutdown_connections 2024-09-18T02:04:17.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 -- 172.21.15.167:0/231329456 wait complete. 2024-09-18T02:04:17.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 Processor -- start 2024-09-18T02:04:17.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 -- start start 2024-09-18T02:04:17.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a44e2ed420 con 0x55a44e2ec5f0 2024-09-18T02:04:17.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b6ef00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b6ef00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2f37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56104/0 (socket says 172.21.15.167:56104) 2024-09-18T02:04:17.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 learned_addr learned my addr 172.21.15.167:0/3750448414 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a44e2f3d10 con 0x55a44e2ec5f0 2024-09-18T02:04:17.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b6ef00640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2f37d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b640a7ba0 tx=0x7f3b640daf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3a50ff9640 1 -- 172.21.15.167:0/3750448414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640c75d0 con 0x55a44e2ec5f0 2024-09-18T02:04:17.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a44e2f3d10 con 0x55a44e2ec5f0 2024-09-18T02:04:17.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3a50ff9640 1 -- 172.21.15.167:0/3750448414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b640c7770 con 0x55a44e2ec5f0 2024-09-18T02:04:17.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3a50ff9640 1 -- 172.21.15.167:0/3750448414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b640c7a50 con 0x55a44e2ec5f0 2024-09-18T02:04:17.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a44e2f3d10 con 0x55a44e2ec5f0 2024-09-18T02:04:17.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.364+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3a50ff9640 1 -- 172.21.15.167:0/3750448414 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3b640fa070 con 0x55a44e2ec5f0 2024-09-18T02:04:17.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3a50ff9640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a380346a0 0x7f3a38036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3a50ff9640 1 -- 172.21.15.167:0/3750448414 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3b64110ae0 con 0x55a44e2ec5f0 2024-09-18T02:04:17.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6e6ff640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a380346a0 0x7f3a38036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a44e2fe910 0x55a44e300db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e301500 con 0x55a44e2fe910 2024-09-18T02:04:17.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6f701640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a44e2fe910 0x55a44e300db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6e6ff640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a380346a0 0x7f3a38036b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55a44e2d25f0 tx=0x7f3b60011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6f701640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a44e2fe910 0x55a44e300db0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 20 realm 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e301910 con 0x55a44e2fe910 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e3021b0 con 0x55a44e2fe910 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e2fe910 2024-09-18T02:04:17.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a44e3032b0 0x55a44e3056a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e305c20 con 0x55a44e3032b0 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6ef00640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a44e3032b0 0x55a44e3056a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6ef00640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a44e3032b0 0x55a44e3056a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 20 searching for the correct realm 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a44e307b50 0x55a44e309fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30a6b0 con 0x55a44e307b50 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6e6ff640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a44e307b50 0x55a44e309fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.368+0000 7f3b6e6ff640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a44e307b50 0x55a44e309fe0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6e6ff640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3b6000f3d0 0x7f3b6000f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30a6b0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6f701640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3b6000f3d0 0x7f3b6000f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6f701640 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3b6000f3d0 0x7f3b6000f7f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e3032b0 2024-09-18T02:04:17.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e2fe910 2024-09-18T02:04:17.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e2fe910 2024-09-18T02:04:17.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e3032b0 2024-09-18T02:04:17.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e3032b0 2024-09-18T02:04:17.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x7f3b6000f3d0 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.372+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e307b50 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e2fe910 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e3032b0 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e2fe910 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x7f3b6000f3d0 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e307b50 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e307b50 2024-09-18T02:04:17.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e3032b0 2024-09-18T02:04:17.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e307b50 2024-09-18T02:04:17.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e307b50 2024-09-18T02:04:17.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e2fe910 2024-09-18T02:04:17.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e2fe910 2024-09-18T02:04:17.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.376+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e3032b0 2024-09-18T02:04:17.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e307b50 2024-09-18T02:04:17.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x7f3b6000f3d0 2024-09-18T02:04:17.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e2fe910 2024-09-18T02:04:17.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e3032b0 2024-09-18T02:04:17.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e307b50 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e3032b0 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x7f3b6000f3d0 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e307b50 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.380+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e3032b0 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x55a44e2fe910 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a44e302550 con 0x7f3b6000f3d0 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e306470 con 0x55a44e2fe910 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e306470 con 0x55a44e2fe910 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e306470 con 0x55a44e307b50 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 zone default found 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 4 Realm: () 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 zonegroup default 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e306d10 con 0x55a44e3032b0 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30c510 con 0x55a44e307b50 2024-09-18T02:04:17.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30c8b0 con 0x55a44e307b50 2024-09-18T02:04:17.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 started sync module instance, tier type = 2024-09-18T02:04:17.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:17.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30b9b0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94164174814896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30b9b0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.384+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30d300 con 0x55a44e2fe910 2024-09-18T02:04:17.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.388+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94164174814896] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.388+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.388+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94164174818832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30b9b0 con 0x55a44e2fe910 2024-09-18T02:04:17.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.388+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30dd10 con 0x55a44e307b50 2024-09-18T02:04:17.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.388+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.388+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94164174821472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30e5b0 con 0x55a44e307b50 2024-09-18T02:04:17.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.388+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30efb0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.392+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94164174818832] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.392+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.392+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94164174812416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30ef70 con 0x7f3b6000f3d0 2024-09-18T02:04:17.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.392+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30f9f0 con 0x55a44e2fe910 2024-09-18T02:04:17.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.392+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94164174821472] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.392+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94164174812416] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.392+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.392+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94164174826176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30e210 con 0x55a44e2fe910 2024-09-18T02:04:17.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.392+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30fea0 con 0x55a44e3032b0 2024-09-18T02:04:17.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.396+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.396+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94164174830064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e3106f0 con 0x55a44e3032b0 2024-09-18T02:04:17.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.396+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e310f40 con 0x55a44e3032b0 2024-09-18T02:04:17.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.396+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94164174826176] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.396+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.396+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94164174828864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e311790 con 0x55a44e3032b0 2024-09-18T02:04:17.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.396+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e312150 con 0x55a44e3032b0 2024-09-18T02:04:17.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.396+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94164174830064] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94164174828864] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94164174836448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e311700 con 0x55a44e3032b0 2024-09-18T02:04:17.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 20 add_watcher() i=0 2024-09-18T02:04:17.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 20 add_watcher() i=1 2024-09-18T02:04:17.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 20 add_watcher() i=2 2024-09-18T02:04:17.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 20 add_watcher() i=3 2024-09-18T02:04:17.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 20 add_watcher() i=4 2024-09-18T02:04:17.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 20 add_watcher() i=5 2024-09-18T02:04:17.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 20 add_watcher() i=6 2024-09-18T02:04:17.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94164174836448] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 20 add_watcher() i=7 2024-09-18T02:04:17.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:17.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e315180 con 0x55a44e2fe910 2024-09-18T02:04:17.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.400+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94164174838944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e312570 con 0x55a44e2fe910 2024-09-18T02:04:17.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94164174838944] v30'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3a257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b713f0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:17.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b713f0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:17.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b713f0980 5 note: GC not initialized 2024-09-18T02:04:17.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f399ffff640 20 reqs_thread_entry: start 2024-09-18T02:04:17.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b713f0980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:17.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b713f0980 20 Filter name: none 2024-09-18T02:04:17.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f399dffb640 20 reqs_thread_entry: start 2024-09-18T02:04:17.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b713f0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a44e3381e0 con 0x55a44e2fe910 2024-09-18T02:04:17.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b713f0980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:17.408 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:17.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3a257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94164174838944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e337130 con 0x55a44e2fe910 2024-09-18T02:04:17.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94164174838944] v30'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.404+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94164174814896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e311ca0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.408+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94164174814896] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.408+0000 7f3b713f0980 20 remove_watcher() i=0 2024-09-18T02:04:17.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.408+0000 7f3b713f0980 2 removed watcher, disabling cache 2024-09-18T02:04:17.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.408+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94164174818832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e311ca0 con 0x55a44e2fe910 2024-09-18T02:04:17.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.408+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94164174818832] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.408+0000 7f3b713f0980 20 remove_watcher() i=1 2024-09-18T02:04:17.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.408+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94164174821472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30ce10 con 0x55a44e307b50 2024-09-18T02:04:17.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.412+0000 7f3b6e6ff640 1 -- 172.21.15.167:0/3750448414 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94164174821472] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b60036040 con 0x55a44e307b50 2024-09-18T02:04:17.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.412+0000 7f3b713f0980 20 remove_watcher() i=2 2024-09-18T02:04:17.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.412+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94164174812416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e311ca0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.412+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94164174812416] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x7f3b6000f3d0 2024-09-18T02:04:17.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.412+0000 7f3b713f0980 20 remove_watcher() i=3 2024-09-18T02:04:17.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.412+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94164174826176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30ce10 con 0x55a44e2fe910 2024-09-18T02:04:17.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.412+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94164174826176] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b6800a4d0 con 0x55a44e2fe910 2024-09-18T02:04:17.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.412+0000 7f3b713f0980 20 remove_watcher() i=4 2024-09-18T02:04:17.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.412+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94164174830064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e311ca0 con 0x55a44e3032b0 2024-09-18T02:04:17.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.416+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94164174830064] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.416+0000 7f3b713f0980 20 remove_watcher() i=5 2024-09-18T02:04:17.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.416+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94164174828864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30ce10 con 0x55a44e3032b0 2024-09-18T02:04:17.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.416+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94164174828864] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.416+0000 7f3b713f0980 20 remove_watcher() i=6 2024-09-18T02:04:17.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.416+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94164174836448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a44e30f9f0 con 0x55a44e3032b0 2024-09-18T02:04:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b6ef00640 1 -- 172.21.15.167:0/3750448414 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94164174836448] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b64115020 con 0x55a44e3032b0 2024-09-18T02:04:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 20 remove_watcher() i=7 2024-09-18T02:04:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a44e3032b0 msgr2=0x55a44e3056a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a44e3032b0 0x55a44e3056a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a44e2fe910 msgr2=0x55a44e300db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a44e2fe910 0x55a44e300db0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3b6000f3d0 msgr2=0x7f3b6000f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3b6000f3d0 0x7f3b6000f7f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a44e307b50 msgr2=0x55a44e309fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a44e307b50 0x55a44e309fe0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a380346a0 msgr2=0x7f3a38036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a380346a0 0x7f3a38036b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55a44e2d25f0 tx=0x7f3b60011000 comp rx=0 tx=0).stop 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b6f701640 1 -- 172.21.15.167:0/3750448414 reap_dead start 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 msgr2=0x55a44e2f37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2f37d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b640a7ba0 tx=0x7f3b640daf10 comp rx=0 tx=0).stop 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 shutdown_connections 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/3750448414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2ec5f0 0x55a44e2f37d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 >> 172.21.15.167:0/3750448414 conn(0x55a44e2e8a10 msgr2=0x55a44e2e6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 shutdown_connections 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/3750448414 wait complete. 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/2930759744 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a48034650 msgr2=0x7f3a48036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/2930759744 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a48034650 0x7f3a48036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55a44e2c6550 tx=0x7f3b60006000 comp rx=0 tx=0).stop 2024-09-18T02:04:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/2930759744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2dfcc0 msgr2=0x55a44e2e00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/2930759744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2dfcc0 0x55a44e2e00e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b64003050 tx=0x7f3b640c67f0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/2930759744 shutdown_connections 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/2930759744 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a48034650 0x7f3a48036b10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/2930759744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e2dfcc0 0x55a44e2e00e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/2930759744 >> 172.21.15.167:0/2930759744 conn(0x55a44e2d4e10 msgr2=0x55a44e2d7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/2930759744 shutdown_connections 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/2930759744 wait complete. 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a44e2cb660 msgr2=0x55a44e2cdb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a44e2cb660 0x55a44e2cdb20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a44e1d0230 msgr2=0x55a44e2c8f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a44e1d0230 0x55a44e2c8f40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a44e2cf710 msgr2=0x55a44e2d1b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a44e2cf710 0x55a44e2d1b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a54034650 msgr2=0x7f3a54036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3a54034650 0x7f3a54036b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b60001e20 tx=0x7f3b600013a0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 msgr2=0x55a44e2c1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 --2- 172.21.15.167:0/1628314548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44e1cf8e0 0x55a44e2c1e40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3b640199f0 tx=0x7f3b640180e0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b6f701640 1 -- 172.21.15.167:0/1628314548 reap_dead start 2024-09-18T02:04:17.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 shutdown_connections 2024-09-18T02:04:17.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 >> 172.21.15.167:0/1628314548 conn(0x55a44e143230 msgr2=0x55a44e2b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 shutdown_connections 2024-09-18T02:04:17.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.420+0000 7f3b713f0980 1 -- 172.21.15.167:0/1628314548 wait complete. 2024-09-18T02:04:17.433 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:17.433 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-18T02:04:17.434 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-18T02:04:17.434 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-18T02:04:17.506 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:17.506 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:17.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.504+0000 7f69dd745980 1 Processor -- start 2024-09-18T02:04:17.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.504+0000 7f69dd745980 1 -- start start 2024-09-18T02:04:17.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.504+0000 7f69dd745980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558405b138e0 0x558405b13cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.504+0000 7f69dd745980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558405999ae0 con 0x558405b14230 2024-09-18T02:04:17.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.504+0000 7f69dd745980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x5584059bde30 con 0x558405b138e0 2024-09-18T02:04:17.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.504+0000 7f69db255640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558405b138e0 0x558405b13cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.504+0000 7f69db255640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558405b138e0 0x558405b13cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56118/0 (socket says 172.21.15.167:56118) 2024-09-18T02:04:17.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.504+0000 7f69db255640 1 -- 172.21.15.167:0/821196994 learned_addr learned my addr 172.21.15.167:0/821196994 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.504+0000 7f69db255640 1 -- 172.21.15.167:0/821196994 >> v1:172.21.15.81:6789/0 conn(0x558405b14230 legacy=0x558405b18c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.504+0000 7f69db255640 1 -- 172.21.15.167:0/821196994 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558405b1b4b0 con 0x558405b138e0 2024-09-18T02:04:17.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.508+0000 7f69db255640 1 --2- 172.21.15.167:0/821196994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405b13cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f69d400a4e0 tx=0x7f69d401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2b2f3d9babd754 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.508+0000 7f69da253640 1 -- 172.21.15.167:0/821196994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40aa540 con 0x558405b138e0 2024-09-18T02:04:17.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.508+0000 7f69da253640 1 -- 172.21.15.167:0/821196994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40aa6e0 con 0x558405b138e0 2024-09-18T02:04:17.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.508+0000 7f69da253640 1 -- 172.21.15.167:0/821196994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40aaa40 con 0x558405b138e0 2024-09-18T02:04:17.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.508+0000 7f69dd745980 1 -- 172.21.15.167:0/821196994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 msgr2=0x558405b13cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.508+0000 7f69dd745980 1 --2- 172.21.15.167:0/821196994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405b13cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f69d400a4e0 tx=0x7f69d401b090 comp rx=0 tx=0).stop 2024-09-18T02:04:17.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.508+0000 7f69dd745980 1 -- 172.21.15.167:0/821196994 shutdown_connections 2024-09-18T02:04:17.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.508+0000 7f69dd745980 1 --2- 172.21.15.167:0/821196994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405b13cc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.508+0000 7f69dd745980 1 -- 172.21.15.167:0/821196994 >> 172.21.15.167:0/821196994 conn(0x558405a87230 msgr2=0x558405a87640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.508+0000 7f69dd745980 1 -- 172.21.15.167:0/821196994 shutdown_connections 2024-09-18T02:04:17.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.508+0000 7f69dd745980 1 -- 172.21.15.167:0/821196994 wait complete. 2024-09-18T02:04:17.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.520+0000 7f69dd745980 1 Processor -- start 2024-09-18T02:04:17.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.520+0000 7f69dd745980 1 -- start start 2024-09-18T02:04:17.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.520+0000 7f69dd745980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405bfebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.520+0000 7f69dd745980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5584059bf200 con 0x558405b138e0 2024-09-18T02:04:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.520+0000 7f69db255640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405bfebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.520+0000 7f69db255640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405bfebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56130/0 (socket says 172.21.15.167:56130) 2024-09-18T02:04:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.520+0000 7f69db255640 1 -- 172.21.15.167:0/4230858045 learned_addr learned my addr 172.21.15.167:0/4230858045 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.520+0000 7f69db255640 1 -- 172.21.15.167:0/4230858045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558405bff1a0 con 0x558405b138e0 2024-09-18T02:04:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.520+0000 7f69db255640 1 --2- 172.21.15.167:0/4230858045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405bfebd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f69d4017ca0 tx=0x7f69d40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6027113e025b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f68c960a640 1 -- 172.21.15.167:0/4230858045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40b9070 con 0x558405b138e0 2024-09-18T02:04:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f68c960a640 1 -- 172.21.15.167:0/4230858045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40aaa80 con 0x558405b138e0 2024-09-18T02:04:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f68c960a640 1 -- 172.21.15.167:0/4230858045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40aad60 con 0x558405b138e0 2024-09-18T02:04:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 -- 172.21.15.167:0/4230858045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 msgr2=0x558405bfebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 --2- 172.21.15.167:0/4230858045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405bfebd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f69d4017ca0 tx=0x7f69d40033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 -- 172.21.15.167:0/4230858045 shutdown_connections 2024-09-18T02:04:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 --2- 172.21.15.167:0/4230858045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405bfebd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 -- 172.21.15.167:0/4230858045 >> 172.21.15.167:0/4230858045 conn(0x558405a87230 msgr2=0x558405bfa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 -- 172.21.15.167:0/4230858045 shutdown_connections 2024-09-18T02:04:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 -- 172.21.15.167:0/4230858045 wait complete. 2024-09-18T02:04:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 Processor -- start 2024-09-18T02:04:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 -- start start 2024-09-18T02:04:17.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405c05e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558405b1aef0 con 0x558405b138e0 2024-09-18T02:04:17.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69db255640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405c05e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69db255640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405c05e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56142/0 (socket says 172.21.15.167:56142) 2024-09-18T02:04:17.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69db255640 1 -- 172.21.15.167:0/2071110839 learned_addr learned my addr 172.21.15.167:0/2071110839 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69db255640 1 -- 172.21.15.167:0/2071110839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558405c063c0 con 0x558405b138e0 2024-09-18T02:04:17.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69db255640 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405c05e80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f69d4018cc0 tx=0x7f69d4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f68c7e07640 1 -- 172.21.15.167:0/2071110839 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40cc070 con 0x558405b138e0 2024-09-18T02:04:17.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558405c06650 con 0x558405b138e0 2024-09-18T02:04:17.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f68c7e07640 1 -- 172.21.15.167:0/2071110839 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40c7410 con 0x558405b138e0 2024-09-18T02:04:17.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f68c7e07640 1 -- 172.21.15.167:0/2071110839 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40b9070 con 0x558405b138e0 2024-09-18T02:04:17.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.524+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558405c09330 con 0x558405b138e0 2024-09-18T02:04:17.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f68c7e07640 1 -- 172.21.15.167:0/2071110839 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f69d40b3040 con 0x558405b138e0 2024-09-18T02:04:17.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f68c7e07640 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68c00346a0 0x7f68c0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f68c7e07640 1 -- 172.21.15.167:0/2071110839 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f69d40c4070 con 0x558405b138e0 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69daa54640 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68c00346a0 0x7f68c0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dd745980 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558405b14230 0x558405c0cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c0d4c0 con 0x558405b14230 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dba56640 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558405b14230 0x558405c0cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69daa54640 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68c00346a0 0x7f68c0036b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f69d0000f70 tx=0x7f69d0001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dba56640 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558405b14230 0x558405c0cf80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dba56640 1 -- 172.21.15.167:0/2071110839 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405b14230 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c0dd80 con 0x558405b14230 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dba56640 1 -- 172.21.15.167:0/2071110839 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405b14230 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dd745980 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558405c0f690 0x558405c11b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c122c0 con 0x558405c0f690 2024-09-18T02:04:17.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69db255640 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558405c0f690 0x558405c11b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69db255640 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558405c0f690 0x558405c11b30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69db255640 1 -- 172.21.15.167:0/2071110839 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f69d40ce310 con 0x558405c0f690 2024-09-18T02:04:17.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c0e5d0 con 0x558405b14230 2024-09-18T02:04:17.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dba56640 1 -- 172.21.15.167:0/2071110839 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405b14230 2024-09-18T02:04:17.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dd745980 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558405c13720 0x558405c15b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c16280 con 0x558405c13720 2024-09-18T02:04:17.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.528+0000 7f69daa54640 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558405c13720 0x558405c15b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69daa54640 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558405c13720 0x558405c15b10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69daa54640 1 -- 172.21.15.167:0/2071110839 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f69d000d040 con 0x558405c13720 2024-09-18T02:04:17.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69dd745980 1 Processor -- start 2024-09-18T02:04:17.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69dd745980 1 -- start start 2024-09-18T02:04:17.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69dd745980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c23d30 0x558405c24150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69dd745980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558405a18800 con 0x558405c23d30 2024-09-18T02:04:17.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69db255640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c23d30 0x558405c24150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69db255640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c23d30 0x558405c24150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56144/0 (socket says 172.21.15.167:56144) 2024-09-18T02:04:17.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69db255640 1 -- 172.21.15.167:0/3157103243 learned_addr learned my addr 172.21.15.167:0/3157103243 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69db255640 1 -- 172.21.15.167:0/3157103243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558405c24690 con 0x558405c23d30 2024-09-18T02:04:17.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69db255640 1 --2- 172.21.15.167:0/3157103243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c23d30 0x558405c24150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f69d40c6940 tx=0x7f69d40c67e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f68c5602640 1 -- 172.21.15.167:0/3157103243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40e4260 con 0x558405c23d30 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69dd745980 1 -- 172.21.15.167:0/3157103243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558405c24920 con 0x558405c23d30 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f68c5602640 1 -- 172.21.15.167:0/3157103243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40e4400 con 0x558405c23d30 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f68c5602640 1 -- 172.21.15.167:0/3157103243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40e4950 con 0x558405c23d30 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f69dd745980 1 -- 172.21.15.167:0/3157103243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558405c275a0 con 0x558405c23d30 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f68c5602640 1 -- 172.21.15.167:0/3157103243 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f69d40eb060 con 0x558405c23d30 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f68c5602640 1 --2- 172.21.15.167:0/3157103243 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68b4034650 0x7f68b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.532+0000 7f68c5602640 1 -- 172.21.15.167:0/3157103243 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f69d40d6040 con 0x558405c23d30 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69daa54640 1 --2- 172.21.15.167:0/3157103243 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68b4034650 0x7f68b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 Processor -- start 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 -- start start 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69daa54640 1 --2- 172.21.15.167:0/3157103243 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68b4034650 0x7f68b4036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x558405c12660 tx=0x7f69d0006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c30ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558405bff460 con 0x558405c306c0 2024-09-18T02:04:17.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69db255640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c30ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69db255640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c30ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56148/0 (socket says 172.21.15.167:56148) 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69db255640 1 -- 172.21.15.167:0/3904857003 learned_addr learned my addr 172.21.15.167:0/3904857003 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69db255640 1 -- 172.21.15.167:0/3904857003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558405c31090 con 0x558405c306c0 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69db255640 1 --2- 172.21.15.167:0/3904857003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c30ac0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f69d40ddbb0 tx=0x7f69d40c7e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ba63aea6e4cf9c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f68beffd640 1 -- 172.21.15.167:0/3904857003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40fb020 con 0x558405c306c0 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f68beffd640 1 -- 172.21.15.167:0/3904857003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40ce770 con 0x558405c306c0 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f68beffd640 1 -- 172.21.15.167:0/3904857003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40bd920 con 0x558405c306c0 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 -- 172.21.15.167:0/3904857003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 msgr2=0x558405c30ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 --2- 172.21.15.167:0/3904857003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c30ac0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f69d40ddbb0 tx=0x7f69d40c7e70 comp rx=0 tx=0).stop 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 -- 172.21.15.167:0/3904857003 shutdown_connections 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 --2- 172.21.15.167:0/3904857003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c30ac0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 -- 172.21.15.167:0/3904857003 >> 172.21.15.167:0/3904857003 conn(0x558405c2ca40 msgr2=0x558405c2ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 -- 172.21.15.167:0/3904857003 shutdown_connections 2024-09-18T02:04:17.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 -- 172.21.15.167:0/3904857003 wait complete. 2024-09-18T02:04:17.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 Processor -- start 2024-09-18T02:04:17.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 -- start start 2024-09-18T02:04:17.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c37820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69dd745980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558405c31450 con 0x558405c306c0 2024-09-18T02:04:17.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69db255640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c37820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69db255640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c37820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56150/0 (socket says 172.21.15.167:56150) 2024-09-18T02:04:17.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 learned_addr learned my addr 172.21.15.167:0/1787789273 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.536+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558405c37d60 con 0x558405c306c0 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69db255640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c37820 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f69d40e1c50 tx=0x7f69d40d9ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f68bd7fa640 1 -- 172.21.15.167:0/1787789273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40bc490 con 0x558405c306c0 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558405c37d60 con 0x558405c306c0 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558405c37d60 con 0x558405c306c0 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f68bd7fa640 1 -- 172.21.15.167:0/1787789273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40bd400 con 0x558405c306c0 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f68bd7fa640 1 -- 172.21.15.167:0/1787789273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40bd6e0 con 0x558405c306c0 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f68bd7fa640 1 -- 172.21.15.167:0/1787789273 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f69d40fe020 con 0x558405c306c0 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f68bd7fa640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68a40346a0 0x7f68a4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f68bd7fa640 1 -- 172.21.15.167:0/1787789273 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f69d40f3070 con 0x558405c306c0 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69daa54640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68a40346a0 0x7f68a4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558405c42760 0x558405c44c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c45370 con 0x558405c42760 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dba56640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558405c42760 0x558405c44c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69daa54640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68a40346a0 0x7f68a4036b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f69d0010fd0 tx=0x7f69d0011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dba56640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558405c42760 0x558405c44c20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 20 realm 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c45780 con 0x558405c42760 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c46050 con 0x558405c42760 2024-09-18T02:04:17.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c42760 2024-09-18T02:04:17.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558405c47150 0x558405c49540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.540+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c49b00 con 0x558405c47150 2024-09-18T02:04:17.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69db255640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558405c47150 0x558405c49540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69db255640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558405c47150 0x558405c49540 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69dd745980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:17.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69dd745980 20 searching for the correct realm 2024-09-18T02:04:17.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69dd745980 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558405c4ba50 0x558405c4de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c4e530 con 0x558405c4ba50 2024-09-18T02:04:17.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69daa54640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558405c4ba50 0x558405c4de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69daa54640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558405c4ba50 0x558405c4de60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69daa54640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f69d000f3d0 0x7f69d000f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c4e530 con 0x7f69d000f3d0 2024-09-18T02:04:17.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69dba56640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f69d000f3d0 0x7f69d000f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69dba56640 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f69d000f3d0 0x7f69d000f7f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c47150 2024-09-18T02:04:17.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c42760 2024-09-18T02:04:17.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.544+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c42760 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c47150 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c47150 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c4ba50 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c42760 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c47150 2024-09-18T02:04:17.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c42760 2024-09-18T02:04:17.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c4ba50 2024-09-18T02:04:17.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c4ba50 2024-09-18T02:04:17.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c47150 2024-09-18T02:04:17.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.548+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c4ba50 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c4ba50 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c42760 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c42760 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c47150 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c4ba50 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c42760 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c47150 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c4ba50 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.552+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c47150 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c4ba50 2024-09-18T02:04:17.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c47150 2024-09-18T02:04:17.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x558405c42760 2024-09-18T02:04:17.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558405c463f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:17.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:17.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:17.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:17.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c4a3c0 con 0x558405c42760 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c4a3c0 con 0x558405c42760 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c4a3c0 con 0x558405c4ba50 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 zone default found 2024-09-18T02:04:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 4 Realm: () 2024-09-18T02:04:17.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:17.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:17.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:17.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 zonegroup default 2024-09-18T02:04:17.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c4ade0 con 0x558405c47150 2024-09-18T02:04:17.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c50840 con 0x558405c4ba50 2024-09-18T02:04:17.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c50be0 con 0x558405c4ba50 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 started sync module instance, tier type = 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.556+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c4fc80 con 0x7f69d000f3d0 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.560+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.560+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94025520840864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c4fc80 con 0x7f69d000f3d0 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.560+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c51430 con 0x558405c42760 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.560+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94025520840864] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.560+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.560+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94025520838880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c51430 con 0x558405c42760 2024-09-18T02:04:17.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.560+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c51df0 con 0x558405c4ba50 2024-09-18T02:04:17.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.564+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94025520838880] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.564+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.564+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94025520844672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c513a0 con 0x558405c4ba50 2024-09-18T02:04:17.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.564+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c52af0 con 0x7f69d000f3d0 2024-09-18T02:04:17.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.564+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.564+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94025520850496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c52a60 con 0x7f69d000f3d0 2024-09-18T02:04:17.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.564+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c53a30 con 0x558405c42760 2024-09-18T02:04:17.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.564+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94025520844672] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.564+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94025520850496] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.568+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.568+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94025520854272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c539f0 con 0x558405c42760 2024-09-18T02:04:17.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.568+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c53e20 con 0x558405c47150 2024-09-18T02:04:17.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.568+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94025520854272] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.568+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.568+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94025520852624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c541c0 con 0x558405c47150 2024-09-18T02:04:17.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.568+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c54a50 con 0x558405c47150 2024-09-18T02:04:17.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94025520860784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c55740 con 0x558405c47150 2024-09-18T02:04:17.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c56160 con 0x558405c47150 2024-09-18T02:04:17.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94025520852624] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94025520860784] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94025520849296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c55740 con 0x558405c47150 2024-09-18T02:04:17.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 20 add_watcher() i=0 2024-09-18T02:04:17.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 20 add_watcher() i=1 2024-09-18T02:04:17.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 20 add_watcher() i=2 2024-09-18T02:04:17.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 20 add_watcher() i=3 2024-09-18T02:04:17.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 20 add_watcher() i=4 2024-09-18T02:04:17.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 20 add_watcher() i=5 2024-09-18T02:04:17.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 20 add_watcher() i=6 2024-09-18T02:04:17.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94025520849296] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 20 add_watcher() i=7 2024-09-18T02:04:17.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:17.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.572+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c59150 con 0x558405c42760 2024-09-18T02:04:17.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94025520862304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c565d0 con 0x558405c42760 2024-09-18T02:04:17.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94025520862304] v30'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f6891fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:17.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:17.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 5 note: GC not initialized 2024-09-18T02:04:17.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f6890fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:17.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:17.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 20 Filter name: none 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f680a7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c7c6d0 con 0x558405c42760 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c7f160 con 0x7f69d000f3d0 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.576+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c828a0 con 0x558405c42760 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dd745980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dd745980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dd745980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94025521046320 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558405c7e150 con 0x558405c42760 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94025520854272 notify 128849018882 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f69cc010040 con 0x558405c42760 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f68beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94025520854272 notifier 4333 bl.length()=567 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f68beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f68beffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify cookie 94025521046320 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f68beffd640 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f68a0003eb0 con 0x558405c42760 2024-09-18T02:04:17.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94025521046320 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f69cc00ab50 con 0x558405c42760 2024-09-18T02:04:17.584 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:17.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f6891fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94025520862304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c7a500 con 0x558405c42760 2024-09-18T02:04:17.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94025520862304] v30'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94025520840864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c7a500 con 0x7f69d000f3d0 2024-09-18T02:04:17.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94025520840864] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dd745980 20 remove_watcher() i=0 2024-09-18T02:04:17.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dd745980 2 removed watcher, disabling cache 2024-09-18T02:04:17.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.580+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94025520838880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c7a500 con 0x558405c42760 2024-09-18T02:04:17.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.584+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94025520838880] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.584+0000 7f69dd745980 20 remove_watcher() i=1 2024-09-18T02:04:17.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.584+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94025520844672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c7a500 con 0x558405c4ba50 2024-09-18T02:04:17.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.584+0000 7f69daa54640 1 -- 172.21.15.167:0/1787789273 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94025520844672] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d0036040 con 0x558405c4ba50 2024-09-18T02:04:17.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.584+0000 7f69dd745980 20 remove_watcher() i=2 2024-09-18T02:04:17.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.584+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94025520850496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c7a500 con 0x7f69d000f3d0 2024-09-18T02:04:17.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.588+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94025520850496] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x7f69d000f3d0 2024-09-18T02:04:17.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.588+0000 7f69dd745980 20 remove_watcher() i=3 2024-09-18T02:04:17.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.588+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94025520854272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c7a500 con 0x558405c42760 2024-09-18T02:04:17.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.588+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94025520854272] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc0083f0 con 0x558405c42760 2024-09-18T02:04:17.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.588+0000 7f69dd745980 20 remove_watcher() i=4 2024-09-18T02:04:17.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.588+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94025520852624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c7a500 con 0x558405c47150 2024-09-18T02:04:17.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.592+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94025520852624] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.592+0000 7f69dd745980 20 remove_watcher() i=5 2024-09-18T02:04:17.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.592+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94025520860784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c7a500 con 0x558405c47150 2024-09-18T02:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.592+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94025520860784] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.592+0000 7f69dd745980 20 remove_watcher() i=6 2024-09-18T02:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.592+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94025520849296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558405c54e70 con 0x558405c47150 2024-09-18T02:04:17.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69db255640 1 -- 172.21.15.167:0/1787789273 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94025520849296] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d40d9040 con 0x558405c47150 2024-09-18T02:04:17.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 20 remove_watcher() i=7 2024-09-18T02:04:17.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558405c47150 msgr2=0x558405c49540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558405c47150 0x558405c49540 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558405c42760 msgr2=0x558405c44c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558405c42760 0x558405c44c20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f69d000f3d0 msgr2=0x7f69d000f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f69d000f3d0 0x7f69d000f7f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558405c4ba50 msgr2=0x558405c4de60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558405c4ba50 0x558405c4de60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68a40346a0 msgr2=0x7f68a4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68a40346a0 0x7f68a4036b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f69d0010fd0 tx=0x7f69d0011000 comp rx=0 tx=0).stop 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dba56640 1 -- 172.21.15.167:0/1787789273 reap_dead start 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 msgr2=0x558405c37820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c37820 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f69d40e1c50 tx=0x7f69d40d9ee0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 shutdown_connections 2024-09-18T02:04:17.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/1787789273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c306c0 0x558405c37820 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 >> 172.21.15.167:0/1787789273 conn(0x558405c2ca40 msgr2=0x558405c2ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 shutdown_connections 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/1787789273 wait complete. 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/3157103243 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68b4034650 msgr2=0x7f68b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/3157103243 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68b4034650 0x7f68b4036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x558405c12660 tx=0x7f69d0006000 comp rx=0 tx=0).stop 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/3157103243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c23d30 msgr2=0x558405c24150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/3157103243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c23d30 0x558405c24150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f69d40c6940 tx=0x7f69d40c67e0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/3157103243 shutdown_connections 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/3157103243 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68b4034650 0x7f68b4036b10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/3157103243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405c23d30 0x558405c24150 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/3157103243 >> 172.21.15.167:0/3157103243 conn(0x558405c18e80 msgr2=0x558405c1b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/3157103243 shutdown_connections 2024-09-18T02:04:17.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/3157103243 wait complete. 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558405c0f690 msgr2=0x558405c11b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558405c0f690 0x558405c11b30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558405b14230 msgr2=0x558405c0cf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558405b14230 0x558405c0cf80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558405c13720 msgr2=0x558405c15b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558405c13720 0x558405c15b10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68c00346a0 msgr2=0x7f68c0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f68c00346a0 0x7f68c0036b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f69d0000f70 tx=0x7f69d0001420 comp rx=0 tx=0).stop 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 msgr2=0x558405c05e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 --2- 172.21.15.167:0/2071110839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558405b138e0 0x558405c05e80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f69d4018cc0 tx=0x7f69d4017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dba56640 1 -- 172.21.15.167:0/2071110839 reap_dead start 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 shutdown_connections 2024-09-18T02:04:17.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 >> 172.21.15.167:0/2071110839 conn(0x558405a87230 msgr2=0x558405bf9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 shutdown_connections 2024-09-18T02:04:17.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.596+0000 7f69dd745980 1 -- 172.21.15.167:0/2071110839 wait complete. 2024-09-18T02:04:17.609 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:17.610 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T02:04:17.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T02:04:17.610 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T02:04:17.687 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:17.687 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:17.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.684+0000 7f4ffea9a980 1 Processor -- start 2024-09-18T02:04:17.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.684+0000 7f4ffea9a980 1 -- start start 2024-09-18T02:04:17.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.684+0000 7f4ffea9a980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56059f0daac0 0x56059f0dceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.684+0000 7f4ffea9a980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56059ef5eae0 con 0x56059f04b290 2024-09-18T02:04:17.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.684+0000 7f4ffea9a980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x56059ef82e30 con 0x56059f0daac0 2024-09-18T02:04:17.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.684+0000 7f4ff3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56059f0daac0 0x56059f0dceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.684+0000 7f4ff3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56059f0daac0 0x56059f0dceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56166/0 (socket says 172.21.15.167:56166) 2024-09-18T02:04:17.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.684+0000 7f4ff3fff640 1 -- 172.21.15.167:0/1364271165 learned_addr learned my addr 172.21.15.167:0/1364271165 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.684+0000 7f4ff3fff640 1 -- 172.21.15.167:0/1364271165 >> v1:172.21.15.81:6789/0 conn(0x56059f04b290 legacy=0x56059f0d93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ff3fff640 1 -- 172.21.15.167:0/1364271165 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059f04b820 con 0x56059f0daac0 2024-09-18T02:04:17.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/1364271165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f0daac0 0x56059f0dceb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400a5c0 tx=0x7f4fe401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2733ea56e62451c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ffbda9640 1 -- 172.21.15.167:0/1364271165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe40a6070 con 0x56059f0daac0 2024-09-18T02:04:17.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ffbda9640 1 -- 172.21.15.167:0/1364271165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe40af070 con 0x56059f0daac0 2024-09-18T02:04:17.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ffbda9640 1 -- 172.21.15.167:0/1364271165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe40aa5c0 con 0x56059f0daac0 2024-09-18T02:04:17.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ffea9a980 1 -- 172.21.15.167:0/1364271165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f0daac0 msgr2=0x56059f0dceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/1364271165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f0daac0 0x56059f0dceb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400a5c0 tx=0x7f4fe401b340 comp rx=0 tx=0).stop 2024-09-18T02:04:17.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ffea9a980 1 -- 172.21.15.167:0/1364271165 shutdown_connections 2024-09-18T02:04:17.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/1364271165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f0daac0 0x56059f0dceb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ffea9a980 1 -- 172.21.15.167:0/1364271165 >> 172.21.15.167:0/1364271165 conn(0x56059f0d1090 msgr2=0x56059f0d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ffea9a980 1 -- 172.21.15.167:0/1364271165 shutdown_connections 2024-09-18T02:04:17.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.688+0000 7f4ffea9a980 1 -- 172.21.15.167:0/1364271165 wait complete. 2024-09-18T02:04:17.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.700+0000 7f4ffea9a980 1 Processor -- start 2024-09-18T02:04:17.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.700+0000 7f4ffea9a980 1 -- start start 2024-09-18T02:04:17.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.700+0000 7f4ffea9a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 0x56059f0d6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.700+0000 7f4ffea9a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56059ef84200 con 0x56059f04b290 2024-09-18T02:04:17.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffc5aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 0x56059f0d6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffc5aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 0x56059f0d6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56168/0 (socket says 172.21.15.167:56168) 2024-09-18T02:04:17.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/2857139626 learned_addr learned my addr 172.21.15.167:0/2857139626 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/2857139626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059f0d70d0 con 0x56059f04b290 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffc5aa640 1 --2- 172.21.15.167:0/2857139626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 0x56059f0d6b00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4fec001ea0 tx=0x7f4fec00b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5412efbbfe54ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4eea60c640 1 -- 172.21.15.167:0/2857139626 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec00a040 con 0x56059f04b290 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4eea60c640 1 -- 172.21.15.167:0/2857139626 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec00f620 con 0x56059f04b290 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4eea60c640 1 -- 172.21.15.167:0/2857139626 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec00f890 con 0x56059f04b290 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2857139626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 msgr2=0x56059f0d6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2857139626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 0x56059f0d6b00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4fec001ea0 tx=0x7f4fec00b680 comp rx=0 tx=0).stop 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2857139626 shutdown_connections 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2857139626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 0x56059f0d6b00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2857139626 >> 172.21.15.167:0/2857139626 conn(0x56059f0d1090 msgr2=0x56059f1bd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2857139626 shutdown_connections 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2857139626 wait complete. 2024-09-18T02:04:17.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 Processor -- start 2024-09-18T02:04:17.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 -- start start 2024-09-18T02:04:17.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 0x56059f1caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56059f0ddf00 con 0x56059f04b290 2024-09-18T02:04:17.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffc5aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 0x56059f1caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffc5aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 0x56059f1caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56182/0 (socket says 172.21.15.167:56182) 2024-09-18T02:04:17.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/2943533244 learned_addr learned my addr 172.21.15.167:0/2943533244 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/2943533244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059f1cb4d0 con 0x56059f04b290 2024-09-18T02:04:17.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffc5aa640 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 0x56059f1caf90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4fec001fd0 tx=0x7f4fec000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ee8e09640 1 -- 172.21.15.167:0/2943533244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec001520 con 0x56059f04b290 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56059f1cb760 con 0x56059f04b290 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ee8e09640 1 -- 172.21.15.167:0/2943533244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec01ca10 con 0x56059f04b290 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059f1ce440 con 0x56059f04b290 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.704+0000 7f4ee8e09640 1 -- 172.21.15.167:0/2943533244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec02c060 con 0x56059f04b290 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ee8e09640 1 -- 172.21.15.167:0/2943533244 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4fec017050 con 0x56059f04b290 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ee8e09640 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ee40346a0 0x7f4ee4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ee8e09640 1 -- 172.21.15.167:0/2943533244 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4fec015020 con 0x56059f04b290 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ee40346a0 0x7f4ee4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56059f0daac0 0x56059f1d2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f1d25d0 con 0x56059f0daac0 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ffcdab640 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56059f0daac0 0x56059f1d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ee40346a0 0x7f4ee4036b60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40ae000 tx=0x7f4fe40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ffcdab640 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56059f0daac0 0x56059f1d2090 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ffcdab640 1 -- 172.21.15.167:0/2943533244 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f0daac0 2024-09-18T02:04:17.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f1cf660 con 0x56059f0daac0 2024-09-18T02:04:17.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ffcdab640 1 -- 172.21.15.167:0/2943533244 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f0daac0 2024-09-18T02:04:17.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56059f1d4900 0x56059f1d6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f1d73e0 con 0x56059f1d4900 2024-09-18T02:04:17.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ffc5aa640 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56059f1d4900 0x56059f1d6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.708+0000 7f4ffc5aa640 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56059f1d4900 0x56059f1d6cf0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/2943533244 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4fec02e070 con 0x56059f1d4900 2024-09-18T02:04:17.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f1d37a0 con 0x56059f0daac0 2024-09-18T02:04:17.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffcdab640 1 -- 172.21.15.167:0/2943533244 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f0daac0 2024-09-18T02:04:17.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56059f1d8840 0x56059f1dac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f1db370 con 0x56059f1d8840 2024-09-18T02:04:17.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56059f1d8840 0x56059f1dac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56059f1d8840 0x56059f1dac30 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ff3fff640 1 -- 172.21.15.167:0/2943533244 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f1d8840 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffea9a980 1 Processor -- start 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffea9a980 1 -- start start 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffea9a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1e8e40 0x56059f1e9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffea9a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56059efdd800 con 0x56059f1e8e40 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffc5aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1e8e40 0x56059f1e9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffc5aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1e8e40 0x56059f1e9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56194/0 (socket says 172.21.15.167:56194) 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/433770379 learned_addr learned my addr 172.21.15.167:0/433770379 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/433770379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059f1e97a0 con 0x56059f1e8e40 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffc5aa640 1 --2- 172.21.15.167:0/433770379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1e8e40 0x56059f1e9260 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0485a0 tx=0x7f4fec00eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ee1ffb640 1 -- 172.21.15.167:0/433770379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec019600 con 0x56059f1e8e40 2024-09-18T02:04:17.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffea9a980 1 -- 172.21.15.167:0/433770379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56059f1e9a30 con 0x56059f1e8e40 2024-09-18T02:04:17.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ee1ffb640 1 -- 172.21.15.167:0/433770379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec0197a0 con 0x56059f1e8e40 2024-09-18T02:04:17.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ee1ffb640 1 -- 172.21.15.167:0/433770379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec019a80 con 0x56059f1e8e40 2024-09-18T02:04:17.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.712+0000 7f4ffea9a980 1 -- 172.21.15.167:0/433770379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059f1e9a30 con 0x56059f1e8e40 2024-09-18T02:04:17.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ee1ffb640 1 -- 172.21.15.167:0/433770379 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4fec03b070 con 0x56059f1e8e40 2024-09-18T02:04:17.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ee1ffb640 1 --2- 172.21.15.167:0/433770379 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ed40346a0 0x7f4ed4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ee1ffb640 1 -- 172.21.15.167:0/433770379 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4fec03eac0 con 0x56059f1e8e40 2024-09-18T02:04:17.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/433770379 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ed40346a0 0x7f4ed4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffea9a980 1 Processor -- start 2024-09-18T02:04:17.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffea9a980 1 -- start start 2024-09-18T02:04:17.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/433770379 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ed40346a0 0x7f4ed4036b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56059f1d2a80 tx=0x7f4fe4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffea9a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 0x56059f1f5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffea9a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56059f0d52f0 con 0x56059f1f5580 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffc5aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 0x56059f1f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffc5aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 0x56059f1f5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56198/0 (socket says 172.21.15.167:56198) 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/2491268917 learned_addr learned my addr 172.21.15.167:0/2491268917 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/2491268917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059f1f5f50 con 0x56059f1f5580 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffc5aa640 1 --2- 172.21.15.167:0/2491268917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 0x56059f1f5980 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4fec019eb0 tx=0x7f4fec03c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ce23cc5dea65df server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4edb7fe640 1 -- 172.21.15.167:0/2491268917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec045a30 con 0x56059f1f5580 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4edb7fe640 1 -- 172.21.15.167:0/2491268917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec019c20 con 0x56059f1f5580 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4edb7fe640 1 -- 172.21.15.167:0/2491268917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec045e40 con 0x56059f1f5580 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2491268917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 msgr2=0x56059f1f5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2491268917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 0x56059f1f5980 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4fec019eb0 tx=0x7f4fec03c960 comp rx=0 tx=0).stop 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2491268917 shutdown_connections 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2491268917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 0x56059f1f5980 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2491268917 >> 172.21.15.167:0/2491268917 conn(0x56059f1f19b0 msgr2=0x56059f1efab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2491268917 shutdown_connections 2024-09-18T02:04:17.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.716+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2491268917 wait complete. 2024-09-18T02:04:17.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 1 Processor -- start 2024-09-18T02:04:17.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 1 -- start start 2024-09-18T02:04:17.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 0x56059f1fc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56059f1f6420 con 0x56059f1f5580 2024-09-18T02:04:17.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffc5aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 0x56059f1fc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffc5aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 0x56059f1fc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56204/0 (socket says 172.21.15.167:56204) 2024-09-18T02:04:17.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 learned_addr learned my addr 172.21.15.167:0/843097676 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059f1fccc0 con 0x56059f1f5580 2024-09-18T02:04:17.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffc5aa640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 0x56059f1fc780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4fec03ce40 tx=0x7f4fec020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ed9ffb640 1 -- 172.21.15.167:0/843097676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec06c020 con 0x56059f1f5580 2024-09-18T02:04:17.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56059f1fccc0 con 0x56059f1f5580 2024-09-18T02:04:17.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ed9ffb640 1 -- 172.21.15.167:0/843097676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec02f510 con 0x56059f1f5580 2024-09-18T02:04:17.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059f1fd130 con 0x56059f1f5580 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ed9ffb640 1 -- 172.21.15.167:0/843097676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec061040 con 0x56059f1f5580 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ed9ffb640 1 -- 172.21.15.167:0/843097676 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4fec06f020 con 0x56059f1f5580 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ed9ffb640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ecc034650 0x7f4ecc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ed9ffb640 1 -- 172.21.15.167:0/843097676 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4fec072ab0 con 0x56059f1f5580 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ecc034650 0x7f4ecc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56059f207890 0x56059f209d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f20a480 con 0x56059f207890 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffcdab640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56059f207890 0x56059f209d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ecc034650 0x7f4ecc036b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4000c10 tx=0x7f4fe40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffcdab640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56059f207890 0x56059f209d30 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 20 realm 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.720+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f20a890 con 0x56059f207890 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b130 con 0x56059f207890 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f207890 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56059f20c230 0x56059f20e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f20eba0 con 0x56059f20c230 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffc5aa640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56059f20c230 0x56059f20e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffc5aa640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56059f20c230 0x56059f20e620 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 20 searching for the correct realm 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56059f210b10 0x56059f212fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f2136a0 con 0x56059f210b10 2024-09-18T02:04:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56059f210b10 0x56059f212fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56059f210b10 0x56059f212fd0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ff3fff640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4fe40e0040 0x7f4fe40e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f2136a0 con 0x7f4fe40e0040 2024-09-18T02:04:17.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffcdab640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4fe40e0040 0x7f4fe40e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffcdab640 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4fe40e0040 0x7f4fe40e0420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.724+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f20c230 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f207890 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f207890 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f20c230 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f20c230 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f210b10 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f207890 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f20c230 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f207890 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.728+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f210b10 2024-09-18T02:04:17.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f210b10 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f20c230 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f210b10 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f210b10 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f207890 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f207890 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f20c230 2024-09-18T02:04:17.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f210b10 2024-09-18T02:04:17.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f207890 2024-09-18T02:04:17.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.732+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f20c230 2024-09-18T02:04:17.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f210b10 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f20c230 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f210b10 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f20c230 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x56059f207890 2024-09-18T02:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56059f20b4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f20f3f0 con 0x56059f207890 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f20f3f0 con 0x56059f207890 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.736+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f20f3f0 con 0x56059f210b10 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 20 zone default found 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 4 Realm: () 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 20 zonegroup default 2024-09-18T02:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f20fc90 con 0x56059f20c230 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f215500 con 0x56059f210b10 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f2158a0 con 0x56059f210b10 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 20 started sync module instance, tier type = 2024-09-18T02:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:17.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f2149a0 con 0x7f4fe40e0040 2024-09-18T02:04:17.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94582144585376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f2149a0 con 0x7f4fe40e0040 2024-09-18T02:04:17.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f2162a0 con 0x56059f207890 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.740+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94582144585376] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.744+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.744+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94582144589232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f2149a0 con 0x56059f207890 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.744+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f216ce0 con 0x56059f210b10 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.744+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.744+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94582144591920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f217530 con 0x56059f210b10 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.744+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f217f30 con 0x7f4fe40e0040 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.744+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94582144589232] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.744+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.744+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94582144582896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f218320 con 0x7f4fe40e0040 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.744+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f218ce0 con 0x56059f207890 2024-09-18T02:04:17.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.748+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94582144591920] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.748+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94582144582896] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.748+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.748+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94582144596544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f218830 con 0x56059f207890 2024-09-18T02:04:17.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.748+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f219080 con 0x56059f20c230 2024-09-18T02:04:17.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.748+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94582144596544] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.748+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.748+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94582144600112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f218c50 con 0x56059f20c230 2024-09-18T02:04:17.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.748+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f219d80 con 0x56059f20c230 2024-09-18T02:04:17.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94582144600112] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94582144603440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f219f20 con 0x56059f20c230 2024-09-18T02:04:17.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f21aa40 con 0x56059f20c230 2024-09-18T02:04:17.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94582144607504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f21aeb0 con 0x56059f20c230 2024-09-18T02:04:17.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffea9a980 20 add_watcher() i=0 2024-09-18T02:04:17.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffea9a980 20 add_watcher() i=1 2024-09-18T02:04:17.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffea9a980 20 add_watcher() i=2 2024-09-18T02:04:17.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffea9a980 20 add_watcher() i=3 2024-09-18T02:04:17.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffea9a980 20 add_watcher() i=4 2024-09-18T02:04:17.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffea9a980 20 add_watcher() i=5 2024-09-18T02:04:17.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94582144603440] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.752+0000 7f4ffea9a980 20 add_watcher() i=6 2024-09-18T02:04:17.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94582144607504] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 20 add_watcher() i=7 2024-09-18T02:04:17.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:17.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f2199d0 con 0x56059f207890 2024-09-18T02:04:17.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94582144608768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f219990 con 0x56059f207890 2024-09-18T02:04:17.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94582144608768] v30'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4eb27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:17.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:17.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 5 note: GC not initialized 2024-09-18T02:04:17.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4eb17e2640 20 reqs_thread_entry: start 2024-09-18T02:04:17.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:17.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 20 Filter name: none 2024-09-18T02:04:17.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4e22ffd640 20 reqs_thread_entry: start 2024-09-18T02:04:17.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56059f241070 con 0x56059f207890 2024-09-18T02:04:17.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.756+0000 7f4ffea9a980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:17.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.760+0000 7f4eb27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.760+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94582144608768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f23ffc0 con 0x56059f207890 2024-09-18T02:04:17.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.760+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94582144608768] v30'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.760+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94582144585376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f21aa00 con 0x7f4fe40e0040 2024-09-18T02:04:17.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.760+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94582144585376] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.760+0000 7f4ffea9a980 20 remove_watcher() i=0 2024-09-18T02:04:17.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.760+0000 7f4ffea9a980 2 removed watcher, disabling cache 2024-09-18T02:04:17.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.760+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94582144589232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f21aa00 con 0x56059f207890 2024-09-18T02:04:17.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.764+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94582144589232] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.764+0000 7f4ffea9a980 20 remove_watcher() i=1 2024-09-18T02:04:17.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.764+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94582144591920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f215db0 con 0x56059f210b10 2024-09-18T02:04:17.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.764+0000 7f4ff3fff640 1 -- 172.21.15.167:0/843097676 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94582144591920] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fe40aaae0 con 0x56059f210b10 2024-09-18T02:04:17.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.764+0000 7f4ffea9a980 20 remove_watcher() i=2 2024-09-18T02:04:17.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.764+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94582144582896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f21aa00 con 0x7f4fe40e0040 2024-09-18T02:04:17.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.764+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94582144582896] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x7f4fe40e0040 2024-09-18T02:04:17.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.764+0000 7f4ffea9a980 20 remove_watcher() i=3 2024-09-18T02:04:17.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.764+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94582144596544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f216830 con 0x56059f207890 2024-09-18T02:04:17.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.768+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94582144596544] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff400a4d0 con 0x56059f207890 2024-09-18T02:04:17.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.768+0000 7f4ffea9a980 20 remove_watcher() i=4 2024-09-18T02:04:17.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.768+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94582144600112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f215db0 con 0x56059f20c230 2024-09-18T02:04:17.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.768+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94582144600112] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.768+0000 7f4ffea9a980 20 remove_watcher() i=5 2024-09-18T02:04:17.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.768+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94582144603440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f21aa00 con 0x56059f20c230 2024-09-18T02:04:17.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94582144603440] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 20 remove_watcher() i=6 2024-09-18T02:04:17.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94582144607504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56059f216830 con 0x56059f20c230 2024-09-18T02:04:17.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffc5aa640 1 -- 172.21.15.167:0/843097676 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94582144607504] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec059030 con 0x56059f20c230 2024-09-18T02:04:17.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 20 remove_watcher() i=7 2024-09-18T02:04:17.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56059f20c230 msgr2=0x56059f20e620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56059f20c230 0x56059f20e620 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56059f207890 msgr2=0x56059f209d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56059f207890 0x56059f209d30 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4fe40e0040 msgr2=0x7f4fe40e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4fe40e0040 0x7f4fe40e0420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56059f210b10 msgr2=0x56059f212fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56059f210b10 0x56059f212fd0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ecc034650 msgr2=0x7f4ecc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ecc034650 0x7f4ecc036b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4000c10 tx=0x7f4fe40c1040 comp rx=0 tx=0).stop 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 msgr2=0x56059f1fc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/843097676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1f5580 0x56059f1fc780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4fec03ce40 tx=0x7f4fec020f60 comp rx=0 tx=0).stop 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 reap_dead start 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.772+0000 7f4ffcdab640 1 -- 172.21.15.167:0/843097676 reap_dead start 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 shutdown_connections 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 >> 172.21.15.167:0/843097676 conn(0x56059f1f19b0 msgr2=0x56059f1efa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 shutdown_connections 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/843097676 wait complete. 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/433770379 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ed40346a0 msgr2=0x7f4ed4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/433770379 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ed40346a0 0x7f4ed4036b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56059f1d2a80 tx=0x7f4fe4005ad0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/433770379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1e8e40 msgr2=0x56059f1e9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/433770379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1e8e40 0x56059f1e9260 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0485a0 tx=0x7f4fec00eac0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/433770379 shutdown_connections 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/433770379 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ed40346a0 0x7f4ed4036b60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/433770379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f1e8e40 0x56059f1e9260 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/433770379 >> 172.21.15.167:0/433770379 conn(0x56059f1ddf90 msgr2=0x56059f1e0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/433770379 shutdown_connections 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/433770379 wait complete. 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56059f1d4900 msgr2=0x56059f1d6cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56059f1d4900 0x56059f1d6cf0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56059f0daac0 msgr2=0x56059f1d2090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56059f0daac0 0x56059f1d2090 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56059f1d8840 msgr2=0x56059f1dac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56059f1d8840 0x56059f1dac30 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ee40346a0 msgr2=0x7f4ee4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ee40346a0 0x7f4ee4036b60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40ae000 tx=0x7f4fe40a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:17.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 msgr2=0x56059f1caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 --2- 172.21.15.167:0/2943533244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56059f04b290 0x56059f1caf90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4fec001fd0 tx=0x7f4fec000bd0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffcdab640 1 -- 172.21.15.167:0/2943533244 reap_dead start 2024-09-18T02:04:17.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 shutdown_connections 2024-09-18T02:04:17.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 >> 172.21.15.167:0/2943533244 conn(0x56059f0d1090 msgr2=0x56059f1bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 shutdown_connections 2024-09-18T02:04:17.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.776+0000 7f4ffea9a980 1 -- 172.21.15.167:0/2943533244 wait complete. 2024-09-18T02:04:17.787 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:17.787 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-18T02:04:17.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-18T02:04:17.788 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-18T02:04:17.866 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:17.866 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:17.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.864+0000 7fc7a229a980 1 Processor -- start 2024-09-18T02:04:17.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.864+0000 7fc7a229a980 1 -- start start 2024-09-18T02:04:17.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.864+0000 7fc7a229a980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5625814cf9b0 0x5625814d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.864+0000 7fc7a229a980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562581353ae0 con 0x5625814cb630 2024-09-18T02:04:17.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.864+0000 7fc7a229a980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x562581377e30 con 0x5625814cf9b0 2024-09-18T02:04:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.864+0000 7fc79f5a9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5625814cf9b0 0x5625814d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.864+0000 7fc79f5a9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5625814cf9b0 0x5625814d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56218/0 (socket says 172.21.15.167:56218) 2024-09-18T02:04:17.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.864+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2608642104 learned_addr learned my addr 172.21.15.167:0/2608642104 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.864+0000 7fc79fdaa640 1 --1- 172.21.15.167:0/2608642104 >> v1:172.21.15.81:6789/0 conn(0x5625814cb630 0x5625814cba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55450/0 (socket says 172.21.15.167:55450) 2024-09-18T02:04:17.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.864+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2608642104 >> v1:172.21.15.81:6789/0 conn(0x5625814cb630 legacy=0x5625814cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.864+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2608642104 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625814d32f0 con 0x5625814cf9b0 2024-09-18T02:04:17.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.868+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/2608642104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cf9b0 0x5625814d1da0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc79400a5c0 tx=0x7fc79401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4220706ab6e848b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.868+0000 7fc79eda8640 1 -- 172.21.15.167:0/2608642104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7940a6070 con 0x5625814cf9b0 2024-09-18T02:04:17.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.868+0000 7fc79eda8640 1 -- 172.21.15.167:0/2608642104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7940af070 con 0x5625814cf9b0 2024-09-18T02:04:17.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.868+0000 7fc79eda8640 1 -- 172.21.15.167:0/2608642104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7940aa5c0 con 0x5625814cf9b0 2024-09-18T02:04:17.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.868+0000 7fc7a229a980 1 -- 172.21.15.167:0/2608642104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cf9b0 msgr2=0x5625814d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.868+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2608642104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cf9b0 0x5625814d1da0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc79400a5c0 tx=0x7fc79401b340 comp rx=0 tx=0).stop 2024-09-18T02:04:17.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.868+0000 7fc7a229a980 1 -- 172.21.15.167:0/2608642104 shutdown_connections 2024-09-18T02:04:17.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.868+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2608642104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cf9b0 0x5625814d1da0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.868+0000 7fc7a229a980 1 -- 172.21.15.167:0/2608642104 >> 172.21.15.167:0/2608642104 conn(0x5625814c7150 msgr2=0x5625814c9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.868+0000 7fc7a229a980 1 -- 172.21.15.167:0/2608642104 shutdown_connections 2024-09-18T02:04:17.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.868+0000 7fc7a229a980 1 -- 172.21.15.167:0/2608642104 wait complete. 2024-09-18T02:04:17.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.880+0000 7fc7a229a980 1 Processor -- start 2024-09-18T02:04:17.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.880+0000 7fc7a229a980 1 -- start start 2024-09-18T02:04:17.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.880+0000 7fc7a229a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 0x5625815b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.880+0000 7fc7a229a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562581379200 con 0x5625814cb630 2024-09-18T02:04:17.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.880+0000 7fc79fdaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 0x5625815b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.880+0000 7fc79fdaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 0x5625815b6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56234/0 (socket says 172.21.15.167:56234) 2024-09-18T02:04:17.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.880+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2470399792 learned_addr learned my addr 172.21.15.167:0/2470399792 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.880+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2470399792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625815b7050 con 0x5625814cb630 2024-09-18T02:04:17.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc79fdaa640 1 --2- 172.21.15.167:0/2470399792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 0x5625815b6a80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc790001e50 tx=0x7fc790001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262981b4455f4479 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc68de0b640 1 -- 172.21.15.167:0/2470399792 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc79000e5d0 con 0x5625814cb630 2024-09-18T02:04:17.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc68de0b640 1 -- 172.21.15.167:0/2470399792 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79000e770 con 0x5625814cb630 2024-09-18T02:04:17.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc68de0b640 1 -- 172.21.15.167:0/2470399792 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc79000eab0 con 0x5625814cb630 2024-09-18T02:04:17.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 -- 172.21.15.167:0/2470399792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 msgr2=0x5625815b6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2470399792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 0x5625815b6a80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc790001e50 tx=0x7fc790001e80 comp rx=0 tx=0).stop 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 -- 172.21.15.167:0/2470399792 shutdown_connections 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2470399792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 0x5625815b6a80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 -- 172.21.15.167:0/2470399792 >> 172.21.15.167:0/2470399792 conn(0x5625814c7150 msgr2=0x5625815b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 -- 172.21.15.167:0/2470399792 shutdown_connections 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 -- 172.21.15.167:0/2470399792 wait complete. 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 Processor -- start 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 -- start start 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 0x5625815bde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5625814d2df0 con 0x5625814cb630 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc79fdaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 0x5625815bde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc79fdaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 0x5625815bde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56238/0 (socket says 172.21.15.167:56238) 2024-09-18T02:04:17.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc79fdaa640 1 -- 172.21.15.167:0/491021806 learned_addr learned my addr 172.21.15.167:0/491021806 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc79fdaa640 1 -- 172.21.15.167:0/491021806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625815be390 con 0x5625814cb630 2024-09-18T02:04:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc79fdaa640 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 0x5625815bde50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5625815b7c60 tx=0x7fc790000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc687fff640 1 -- 172.21.15.167:0/491021806 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc790001260 con 0x5625814cb630 2024-09-18T02:04:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc687fff640 1 -- 172.21.15.167:0/491021806 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79000fa40 con 0x5625814cb630 2024-09-18T02:04:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625815be620 con 0x5625814cb630 2024-09-18T02:04:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc687fff640 1 -- 172.21.15.167:0/491021806 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc79000fd80 con 0x5625814cb630 2024-09-18T02:04:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.884+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625815c1300 con 0x5625814cb630 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc687fff640 1 -- 172.21.15.167:0/491021806 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc790017070 con 0x5625814cb630 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc687fff640 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc6880346a0 0x7fc688036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc687fff640 1 -- 172.21.15.167:0/491021806 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc790015020 con 0x5625814cb630 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc6880346a0 0x7fc688036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc7a229a980 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5625814cf9b0 0x5625815c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625815c5490 con 0x5625814cf9b0 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc7a05ab640 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5625814cf9b0 0x5625815c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc6880346a0 0x7fc688036b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7940ae000 tx=0x7fc7940a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc7a05ab640 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5625814cf9b0 0x5625815c4e20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc7a05ab640 1 -- 172.21.15.167:0/491021806 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625814cf9b0 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625815c2520 con 0x5625814cf9b0 2024-09-18T02:04:17.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc7a05ab640 1 -- 172.21.15.167:0/491021806 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625814cf9b0 2024-09-18T02:04:17.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc7a229a980 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5625815c77e0 0x5625815c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625815ca2c0 con 0x5625815c77e0 2024-09-18T02:04:17.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc79fdaa640 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5625815c77e0 0x5625815c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc79fdaa640 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5625815c77e0 0x5625815c9bd0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc79fdaa640 1 -- 172.21.15.167:0/491021806 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc79002e070 con 0x5625815c77e0 2024-09-18T02:04:17.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.888+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625815c6680 con 0x5625814cf9b0 2024-09-18T02:04:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc7a05ab640 1 -- 172.21.15.167:0/491021806 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625814cf9b0 2024-09-18T02:04:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc7a229a980 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5625815cb720 0x5625815cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625815ce250 con 0x5625815cb720 2024-09-18T02:04:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5625815cb720 0x5625815cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5625815cb720 0x5625815cdb10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc79f5a9640 1 -- 172.21.15.167:0/491021806 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7940aaae0 con 0x5625815cb720 2024-09-18T02:04:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc7a229a980 1 Processor -- start 2024-09-18T02:04:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc7a229a980 1 -- start start 2024-09-18T02:04:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc7a229a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562581442530 0x562581440bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc7a229a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5625813d2800 con 0x562581442530 2024-09-18T02:04:17.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc79fdaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562581442530 0x562581440bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc79fdaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562581442530 0x562581440bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56246/0 (socket says 172.21.15.167:56246) 2024-09-18T02:04:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2516446636 learned_addr learned my addr 172.21.15.167:0/2516446636 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2516446636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562581442950 con 0x562581442530 2024-09-18T02:04:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc79fdaa640 1 --2- 172.21.15.167:0/2516446636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562581442530 0x562581440bb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc790048ec0 tx=0x7fc790017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc6857fa640 1 -- 172.21.15.167:0/2516446636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7900426a0 con 0x562581442530 2024-09-18T02:04:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc7a229a980 1 -- 172.21.15.167:0/2516446636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562581441150 con 0x562581442530 2024-09-18T02:04:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc6857fa640 1 -- 172.21.15.167:0/2516446636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc790042840 con 0x562581442530 2024-09-18T02:04:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc7a229a980 1 -- 172.21.15.167:0/2516446636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562581441150 con 0x562581442530 2024-09-18T02:04:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc6857fa640 1 -- 172.21.15.167:0/2516446636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7900421c0 con 0x562581442530 2024-09-18T02:04:17.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc6857fa640 1 -- 172.21.15.167:0/2516446636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc79003b020 con 0x562581442530 2024-09-18T02:04:17.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.892+0000 7fc6857fa640 1 --2- 172.21.15.167:0/2516446636 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc678034650 0x7fc678036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc6857fa640 1 -- 172.21.15.167:0/2516446636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc790043040 con 0x562581442530 2024-09-18T02:04:17.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/2516446636 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc678034650 0x7fc678036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 Processor -- start 2024-09-18T02:04:17.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 -- start start 2024-09-18T02:04:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815eaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5625815b73d0 con 0x5625815ea670 2024-09-18T02:04:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/2516446636 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc678034650 0x7fc678036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5625815c5960 tx=0x7fc794005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc79fdaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815eaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc79fdaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815eaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56260/0 (socket says 172.21.15.167:56260) 2024-09-18T02:04:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc79fdaa640 1 -- 172.21.15.167:0/4063361713 learned_addr learned my addr 172.21.15.167:0/4063361713 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc79fdaa640 1 -- 172.21.15.167:0/4063361713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625815eb020 con 0x5625815ea670 2024-09-18T02:04:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc79fdaa640 1 --2- 172.21.15.167:0/4063361713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815eaa50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc79002ffa0 tx=0x7fc790047780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7acee2595ddd787 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc67effd640 1 -- 172.21.15.167:0/4063361713 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7900478c0 con 0x5625815ea670 2024-09-18T02:04:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc67effd640 1 -- 172.21.15.167:0/4063361713 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79000c2b0 con 0x5625815ea670 2024-09-18T02:04:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc67effd640 1 -- 172.21.15.167:0/4063361713 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc790012e10 con 0x5625815ea670 2024-09-18T02:04:17.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 -- 172.21.15.167:0/4063361713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 msgr2=0x5625815eaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 --2- 172.21.15.167:0/4063361713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815eaa50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc79002ffa0 tx=0x7fc790047780 comp rx=0 tx=0).stop 2024-09-18T02:04:17.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 -- 172.21.15.167:0/4063361713 shutdown_connections 2024-09-18T02:04:17.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 --2- 172.21.15.167:0/4063361713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815eaa50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 -- 172.21.15.167:0/4063361713 >> 172.21.15.167:0/4063361713 conn(0x5625815e6a50 msgr2=0x5625815e4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 -- 172.21.15.167:0/4063361713 shutdown_connections 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 -- 172.21.15.167:0/4063361713 wait complete. 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 Processor -- start 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 -- start start 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc7a229a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5625815eb4c0 con 0x5625815ea670 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc79fdaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc79fdaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815f17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56270/0 (socket says 172.21.15.167:56270) 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 learned_addr learned my addr 172.21.15.167:0/2843066167 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.896+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625815f1d20 con 0x5625815ea670 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc79fdaa640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815f17e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc79004cfd0 tx=0x7fc790016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc67d7fa640 1 -- 172.21.15.167:0/2843066167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7900478c0 con 0x5625815ea670 2024-09-18T02:04:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625815f1d20 con 0x5625815ea670 2024-09-18T02:04:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc67d7fa640 1 -- 172.21.15.167:0/2843066167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79001dc70 con 0x5625815ea670 2024-09-18T02:04:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625815f1d20 con 0x5625815ea670 2024-09-18T02:04:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc67d7fa640 1 -- 172.21.15.167:0/2843066167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc79004ad00 con 0x5625815ea670 2024-09-18T02:04:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc67d7fa640 1 -- 172.21.15.167:0/2843066167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc79003e880 con 0x5625815ea670 2024-09-18T02:04:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc67d7fa640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc668034650 0x7fc668036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc67d7fa640 1 -- 172.21.15.167:0/2843066167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc790067070 con 0x5625815ea670 2024-09-18T02:04:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc668034650 0x7fc668036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5625815fc9b0 0x5625815fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625815ff5a0 con 0x5625815fc9b0 2024-09-18T02:04:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a05ab640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5625815fc9b0 0x5625815fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc668034650 0x7fc668036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc794000c10 tx=0x7fc7940c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a05ab640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5625815fc9b0 0x5625815fee50 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 20 realm 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625815ff9b0 con 0x5625815fc9b0 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562581600250 con 0x5625815fc9b0 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x5625815fc9b0 2024-09-18T02:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562581601350 0x562581603740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562581603de0 con 0x562581601350 2024-09-18T02:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.900+0000 7fc79fdaa640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562581601350 0x562581603740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc79fdaa640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562581601350 0x562581603740 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a229a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a229a980 20 searching for the correct realm 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562581605cc0 0x562581608130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816087b0 con 0x562581605cc0 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562581605cc0 0x562581608130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562581605cc0 0x562581608130 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc79f5a9640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc7940e0040 0x7fc7940e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816087b0 con 0x7fc7940e0040 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a05ab640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc7940e0040 0x7fc7940e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a05ab640 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc7940e0040 0x7fc7940e0420 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:17.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581601350 2024-09-18T02:04:17.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x5625815fc9b0 2024-09-18T02:04:17.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x5625815fc9b0 2024-09-18T02:04:17.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.904+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581601350 2024-09-18T02:04:17.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581601350 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x7fc7940e0040 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581605cc0 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x5625815fc9b0 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581601350 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x5625815fc9b0 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x7fc7940e0040 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581605cc0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581605cc0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581601350 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.908+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581605cc0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581605cc0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x5625815fc9b0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x5625815fc9b0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581601350 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581605cc0 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x7fc7940e0040 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x5625815fc9b0 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581601350 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581605cc0 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581601350 2024-09-18T02:04:17.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.912+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x7fc7940e0040 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581605cc0 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x562581601350 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x5625815fc9b0 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625816005f0 con 0x7fc7940e0040 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:17.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562581604630 con 0x5625815fc9b0 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562581604630 con 0x5625815fc9b0 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562581604630 con 0x562581605cc0 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 zone default found 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 4 Realm: () 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 zonegroup default 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562581604ff0 con 0x562581601350 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562581604b80 con 0x562581605cc0 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56258160abc0 con 0x562581605cc0 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 started sync module instance, tier type = 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.916+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562581609f50 con 0x7fc7940e0040 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.920+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.920+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94719084373072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562581609f50 con 0x7fc7940e0040 2024-09-18T02:04:17.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.920+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160b640 con 0x5625815fc9b0 2024-09-18T02:04:17.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.920+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94719084373072] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.920+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.920+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94719084370864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160b640 con 0x5625815fc9b0 2024-09-18T02:04:17.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.920+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160c000 con 0x562581605cc0 2024-09-18T02:04:17.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94719084370864] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94719084376464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160b5b0 con 0x562581605cc0 2024-09-18T02:04:17.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160cd40 con 0x7fc7940e0040 2024-09-18T02:04:17.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94719084382288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160d5e0 con 0x7fc7940e0040 2024-09-18T02:04:17.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160dfa0 con 0x5625815fc9b0 2024-09-18T02:04:17.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94719084376464] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94719084382288] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94719084387056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160df10 con 0x5625815fc9b0 2024-09-18T02:04:17.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.924+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160d530 con 0x562581601350 2024-09-18T02:04:17.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.928+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94719084387056] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.928+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.928+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94719084384384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160e840 con 0x562581601350 2024-09-18T02:04:17.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.928+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160f090 con 0x562581601350 2024-09-18T02:04:17.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.928+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94719084384384] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94719084389264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160f8e0 con 0x562581601350 2024-09-18T02:04:17.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562581610170 con 0x562581601350 2024-09-18T02:04:17.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94719084389264] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94719084393520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562581610350 con 0x562581601350 2024-09-18T02:04:17.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 20 add_watcher() i=0 2024-09-18T02:04:17.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 20 add_watcher() i=1 2024-09-18T02:04:17.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 20 add_watcher() i=2 2024-09-18T02:04:17.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 20 add_watcher() i=3 2024-09-18T02:04:17.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 20 add_watcher() i=4 2024-09-18T02:04:17.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 20 add_watcher() i=5 2024-09-18T02:04:17.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 20 add_watcher() i=6 2024-09-18T02:04:17.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94719084393520] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 20 add_watcher() i=7 2024-09-18T02:04:17.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:17.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562581613720 con 0x5625815fc9b0 2024-09-18T02:04:17.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.932+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94719084397120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562581610b10 con 0x5625815fc9b0 2024-09-18T02:04:17.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94719084397120] v30'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc655fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 5 note: GC not initialized 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc654fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 20 Filter name: none 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc5ce7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562581636d40 con 0x5625815fc9b0 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:17.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:17.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:17.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:17.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T02:04:17.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:17.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625816377b0 con 0x562581601350 2024-09-18T02:04:17.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258163d0a0 con 0x5625815fc9b0 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v30'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.936+0000 7fc7a229a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94719084579600 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625816387c0 con 0x5625815fc9b0 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94719084387056 notify 128849018883 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7fc798018ba0 con 0x5625815fc9b0 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc67effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94719084387056 notifier 4347 bl.length()=678 2024-09-18T02:04:17.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc67effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:17.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc67effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:17.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify cookie 94719084579600 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc67effd640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc664003eb0 con 0x5625815fc9b0 2024-09-18T02:04:17.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94719084579600 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc798018d70 con 0x5625815fc9b0 2024-09-18T02:04:17.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258163cb10 con 0x562581601350 2024-09-18T02:04:17.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc7a229a980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T02:04:17.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc7a229a980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:04:17.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc7a229a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T02:04:17.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94719084579600 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625816382c0 con 0x562581605cc0 2024-09-18T02:04:17.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== watch-notify(notify (1) cookie 94719084376464 notify 128849018880 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5625814d32f0 con 0x562581605cc0 2024-09-18T02:04:17.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc67effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94719084376464 notifier 4347 bl.length()=177 2024-09-18T02:04:17.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc67effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T02:04:17.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc67effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:04:17.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(68 notify.2 [notify cookie 94719084579600 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc67effd640 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc664003eb0 con 0x562581605cc0 2024-09-18T02:04:17.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.940+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== watch-notify(notify_complete (2) cookie 94719084579600 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc7940e0960 con 0x562581605cc0 2024-09-18T02:04:17.946 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T02:04:17.939780Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:17.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.944+0000 7fc655fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:17.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.944+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94719084397120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562581638bf0 con 0x5625815fc9b0 2024-09-18T02:04:17.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.944+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94719084397120] v30'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.944+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94719084373072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562581610240 con 0x7fc7940e0040 2024-09-18T02:04:17.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.944+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94719084373072] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.944+0000 7fc7a229a980 20 remove_watcher() i=0 2024-09-18T02:04:17.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.944+0000 7fc7a229a980 2 removed watcher, disabling cache 2024-09-18T02:04:17.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.944+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94719084370864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160a450 con 0x5625815fc9b0 2024-09-18T02:04:17.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.948+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94719084370864] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.948+0000 7fc7a229a980 20 remove_watcher() i=1 2024-09-18T02:04:17.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.948+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94719084376464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562581610240 con 0x562581605cc0 2024-09-18T02:04:17.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.948+0000 7fc79f5a9640 1 -- 172.21.15.167:0/2843066167 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94719084376464] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7940aaae0 con 0x562581605cc0 2024-09-18T02:04:17.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.948+0000 7fc7a229a980 20 remove_watcher() i=2 2024-09-18T02:04:17.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.948+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94719084382288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160a450 con 0x7fc7940e0040 2024-09-18T02:04:17.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.948+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94719084382288] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x7fc7940e0040 2024-09-18T02:04:17.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.948+0000 7fc7a229a980 20 remove_watcher() i=3 2024-09-18T02:04:17.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.948+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94719084387056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160b190 con 0x5625815fc9b0 2024-09-18T02:04:17.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.952+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94719084387056] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79800a4d0 con 0x5625815fc9b0 2024-09-18T02:04:17.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.952+0000 7fc7a229a980 20 remove_watcher() i=4 2024-09-18T02:04:17.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.952+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94719084384384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562581610240 con 0x562581601350 2024-09-18T02:04:17.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.952+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94719084384384] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.952+0000 7fc7a229a980 20 remove_watcher() i=5 2024-09-18T02:04:17.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.952+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94719084389264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160daf0 con 0x562581601350 2024-09-18T02:04:17.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94719084389264] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 20 remove_watcher() i=6 2024-09-18T02:04:17.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94719084393520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56258160b190 con 0x562581601350 2024-09-18T02:04:17.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc79fdaa640 1 -- 172.21.15.167:0/2843066167 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94719084393520] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79007d040 con 0x562581601350 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 20 remove_watcher() i=7 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562581601350 msgr2=0x562581603740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562581601350 0x562581603740 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5625815fc9b0 msgr2=0x5625815fee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5625815fc9b0 0x5625815fee50 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc7940e0040 msgr2=0x7fc7940e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc7940e0040 0x7fc7940e0420 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562581605cc0 msgr2=0x562581608130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562581605cc0 0x562581608130 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc668034650 msgr2=0x7fc668036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc668034650 0x7fc668036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc794000c10 tx=0x7fc7940c1040 comp rx=0 tx=0).stop 2024-09-18T02:04:17.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 msgr2=0x5625815f17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a05ab640 1 -- 172.21.15.167:0/2843066167 reap_dead start 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815f17e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc79004cfd0 tx=0x7fc790016000 comp rx=0 tx=0).stop 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 shutdown_connections 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2843066167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625815ea670 0x5625815f17e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 >> 172.21.15.167:0/2843066167 conn(0x5625815e6a50 msgr2=0x5625815e4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 shutdown_connections 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2843066167 wait complete. 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2516446636 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc678034650 msgr2=0x7fc678036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2516446636 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc678034650 0x7fc678036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5625815c5960 tx=0x7fc794005ad0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2516446636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562581442530 msgr2=0x562581440bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2516446636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562581442530 0x562581440bb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc790048ec0 tx=0x7fc790017d50 comp rx=0 tx=0).stop 2024-09-18T02:04:17.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2516446636 shutdown_connections 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2516446636 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc678034650 0x7fc678036b10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 --2- 172.21.15.167:0/2516446636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562581442530 0x562581440bb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2516446636 >> 172.21.15.167:0/2516446636 conn(0x5625815d0e70 msgr2=0x5625815d38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2516446636 shutdown_connections 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.956+0000 7fc7a229a980 1 -- 172.21.15.167:0/2516446636 wait complete. 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5625815c77e0 msgr2=0x5625815c9bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5625815c77e0 0x5625815c9bd0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5625814cf9b0 msgr2=0x5625815c4e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5625814cf9b0 0x5625815c4e20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5625815cb720 msgr2=0x5625815cdb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5625815cb720 0x5625815cdb10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc6880346a0 msgr2=0x7fc688036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc6880346a0 0x7fc688036b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7940ae000 tx=0x7fc7940a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:17.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 msgr2=0x5625815bde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:17.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 --2- 172.21.15.167:0/491021806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625814cb630 0x5625815bde50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5625815b7c60 tx=0x7fc790000bd0 comp rx=0 tx=0).stop 2024-09-18T02:04:17.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a05ab640 1 -- 172.21.15.167:0/491021806 reap_dead start 2024-09-18T02:04:17.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 shutdown_connections 2024-09-18T02:04:17.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 >> 172.21.15.167:0/491021806 conn(0x5625814c7150 msgr2=0x5625815b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:17.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 shutdown_connections 2024-09-18T02:04:17.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:17.960+0000 7fc7a229a980 1 -- 172.21.15.167:0/491021806 wait complete. 2024-09-18T02:04:17.971 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T02:04:17.939780Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:17.971 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T02:04:17.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T02:04:17.971 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T02:04:18.040 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:18.040 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:18.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.036+0000 7f41b7580980 1 Processor -- start 2024-09-18T02:04:18.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.036+0000 7f41b7580980 1 -- start start 2024-09-18T02:04:18.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.036+0000 7f41b7580980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56020b5fd8e0 0x56020b5fdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.036+0000 7f41b7580980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56020b483ae0 con 0x56020b5fe230 2024-09-18T02:04:18.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.036+0000 7f41b7580980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x56020b4a7e30 con 0x56020b5fd8e0 2024-09-18T02:04:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.040+0000 7f41b488f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x56020b5fe230 0x56020b602c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55458/0 (socket says 172.21.15.167:55458) 2024-09-18T02:04:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.040+0000 7f41b488f640 1 -- 172.21.15.167:0/989092558 learned_addr learned my addr 172.21.15.167:0/989092558 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.040+0000 7f41b5090640 1 --2- 172.21.15.167:0/989092558 >> v2:172.21.15.81:3300/0 conn(0x56020b5fd8e0 0x56020b5fdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.040+0000 7f41a7fff640 1 -- 172.21.15.167:0/989092558 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 442880685 0 0) 0x56020b483ae0 con 0x56020b5fe230 2024-09-18T02:04:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.040+0000 7f41a7fff640 1 -- 172.21.15.167:0/989092558 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41a0001e20 con 0x56020b5fe230 2024-09-18T02:04:18.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.040+0000 7f41b5090640 1 -- 172.21.15.167:0/989092558 >> v1:172.21.15.81:6789/0 conn(0x56020b5fe230 legacy=0x56020b602c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.040+0000 7f41b5090640 1 -- 172.21.15.167:0/989092558 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020b6054b0 con 0x56020b5fd8e0 2024-09-18T02:04:18.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.044+0000 7f41b5090640 1 --2- 172.21.15.167:0/989092558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b5fdcc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f41a800a480 tx=0x7f41a801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b1cfe8f0cab78a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.044+0000 7f41a7fff640 1 -- 172.21.15.167:0/989092558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a80b0070 con 0x56020b5fd8e0 2024-09-18T02:04:18.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.044+0000 7f41a7fff640 1 -- 172.21.15.167:0/989092558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a80ab540 con 0x56020b5fd8e0 2024-09-18T02:04:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.044+0000 7f41a7fff640 1 -- 172.21.15.167:0/989092558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a80ab840 con 0x56020b5fd8e0 2024-09-18T02:04:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.044+0000 7f41b7580980 1 -- 172.21.15.167:0/989092558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 msgr2=0x56020b5fdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.044+0000 7f41b7580980 1 --2- 172.21.15.167:0/989092558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b5fdcc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f41a800a480 tx=0x7f41a801b280 comp rx=0 tx=0).stop 2024-09-18T02:04:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.044+0000 7f41b7580980 1 -- 172.21.15.167:0/989092558 shutdown_connections 2024-09-18T02:04:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.044+0000 7f41b7580980 1 --2- 172.21.15.167:0/989092558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b5fdcc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.044+0000 7f41b7580980 1 -- 172.21.15.167:0/989092558 >> 172.21.15.167:0/989092558 conn(0x56020b571230 msgr2=0x56020b571640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.044+0000 7f41b7580980 1 -- 172.21.15.167:0/989092558 shutdown_connections 2024-09-18T02:04:18.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.044+0000 7f41b7580980 1 -- 172.21.15.167:0/989092558 wait complete. 2024-09-18T02:04:18.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f41b7580980 1 Processor -- start 2024-09-18T02:04:18.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f41b7580980 1 -- start start 2024-09-18T02:04:18.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f41b7580980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b6e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f41b7580980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56020b4a9200 con 0x56020b5fd8e0 2024-09-18T02:04:18.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f41b5090640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b6e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f41b5090640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b6e8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56280/0 (socket says 172.21.15.167:56280) 2024-09-18T02:04:18.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f41b5090640 1 -- 172.21.15.167:0/1843158570 learned_addr learned my addr 172.21.15.167:0/1843158570 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f41b5090640 1 -- 172.21.15.167:0/1843158570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020b6e9020 con 0x56020b5fd8e0 2024-09-18T02:04:18.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f41b5090640 1 --2- 172.21.15.167:0/1843158570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b6e8a50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f41a80ae040 tx=0x7f41a8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ccf787dbeaddbf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f40a3606640 1 -- 172.21.15.167:0/1843158570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a80b0040 con 0x56020b5fd8e0 2024-09-18T02:04:18.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f40a3606640 1 -- 172.21.15.167:0/1843158570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a80ab9d0 con 0x56020b5fd8e0 2024-09-18T02:04:18.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.056+0000 7f40a3606640 1 -- 172.21.15.167:0/1843158570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a80abcd0 con 0x56020b5fd8e0 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 -- 172.21.15.167:0/1843158570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 msgr2=0x56020b6e8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 --2- 172.21.15.167:0/1843158570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b6e8a50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f41a80ae040 tx=0x7f41a8003030 comp rx=0 tx=0).stop 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 -- 172.21.15.167:0/1843158570 shutdown_connections 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 --2- 172.21.15.167:0/1843158570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b6e8a50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 -- 172.21.15.167:0/1843158570 >> 172.21.15.167:0/1843158570 conn(0x56020b571230 msgr2=0x56020b6e4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 -- 172.21.15.167:0/1843158570 shutdown_connections 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 -- 172.21.15.167:0/1843158570 wait complete. 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 Processor -- start 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 -- start start 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b6efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56020b604ef0 con 0x56020b5fd8e0 2024-09-18T02:04:18.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b5090640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b6efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b5090640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b6efcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56288/0 (socket says 172.21.15.167:56288) 2024-09-18T02:04:18.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b5090640 1 -- 172.21.15.167:0/2927793511 learned_addr learned my addr 172.21.15.167:0/2927793511 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b5090640 1 -- 172.21.15.167:0/2927793511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020b6f0200 con 0x56020b5fd8e0 2024-09-18T02:04:18.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b5090640 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b6efcc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f41a8018eb0 tx=0x7f41a8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f40a1e03640 1 -- 172.21.15.167:0/2927793511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a80b0070 con 0x56020b5fd8e0 2024-09-18T02:04:18.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56020b6f0490 con 0x56020b5fd8e0 2024-09-18T02:04:18.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f40a1e03640 1 -- 172.21.15.167:0/2927793511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a80b6870 con 0x56020b5fd8e0 2024-09-18T02:04:18.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f40a1e03640 1 -- 172.21.15.167:0/2927793511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a80b6b90 con 0x56020b5fd8e0 2024-09-18T02:04:18.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020b6f3170 con 0x56020b5fd8e0 2024-09-18T02:04:18.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.060+0000 7f40a1e03640 1 -- 172.21.15.167:0/2927793511 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f41a80bf3f0 con 0x56020b5fd8e0 2024-09-18T02:04:18.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f40a1e03640 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f409c034650 0x7f409c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f40a1e03640 1 -- 172.21.15.167:0/2927793511 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f41a80bc070 con 0x56020b5fd8e0 2024-09-18T02:04:18.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b488f640 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f409c034650 0x7f409c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b7580980 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56020b5fe230 0x56020b6f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b6f7290 con 0x56020b5fe230 2024-09-18T02:04:18.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b5891640 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56020b5fe230 0x56020b6f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b488f640 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f409c034650 0x7f409c036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f41ac000f70 tx=0x7f41ac0010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b5891640 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56020b5fe230 0x56020b6f6c50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b5891640 1 -- 172.21.15.167:0/2927793511 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b5fe230 2024-09-18T02:04:18.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b6f4370 con 0x56020b5fe230 2024-09-18T02:04:18.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b5891640 1 -- 172.21.15.167:0/2927793511 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b5fe230 2024-09-18T02:04:18.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b7580980 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56020b6f95c0 0x56020b6fb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b6fc080 con 0x56020b6f95c0 2024-09-18T02:04:18.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b5090640 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56020b6f95c0 0x56020b6fb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b5090640 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56020b6f95c0 0x56020b6fb9b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b5090640 1 -- 172.21.15.167:0/2927793511 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f41a80b3040 con 0x56020b6f95c0 2024-09-18T02:04:18.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b6f8460 con 0x56020b5fe230 2024-09-18T02:04:18.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b5891640 1 -- 172.21.15.167:0/2927793511 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b5fe230 2024-09-18T02:04:18.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b7580980 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56020b6fd4c0 0x56020b6ff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b700040 con 0x56020b6fd4c0 2024-09-18T02:04:18.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b488f640 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56020b6fd4c0 0x56020b6ff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.064+0000 7f41b488f640 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56020b6fd4c0 0x56020b6ff8b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b488f640 1 -- 172.21.15.167:0/2927793511 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b6fd4c0 2024-09-18T02:04:18.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b7580980 1 Processor -- start 2024-09-18T02:04:18.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b7580980 1 -- start start 2024-09-18T02:04:18.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b7580980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b70dad0 0x56020b70def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b7580980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56020b502800 con 0x56020b70dad0 2024-09-18T02:04:18.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b5090640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b70dad0 0x56020b70def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b5090640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b70dad0 0x56020b70def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56290/0 (socket says 172.21.15.167:56290) 2024-09-18T02:04:18.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b5090640 1 -- 172.21.15.167:0/1430332841 learned_addr learned my addr 172.21.15.167:0/1430332841 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b5090640 1 -- 172.21.15.167:0/1430332841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020b70e430 con 0x56020b70dad0 2024-09-18T02:04:18.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b5090640 1 --2- 172.21.15.167:0/1430332841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b70dad0 0x56020b70def0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f41a8006910 tx=0x7f41a80b56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f409affd640 1 -- 172.21.15.167:0/1430332841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a80b4a50 con 0x56020b70dad0 2024-09-18T02:04:18.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b7580980 1 -- 172.21.15.167:0/1430332841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56020b70e6c0 con 0x56020b70dad0 2024-09-18T02:04:18.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f409affd640 1 -- 172.21.15.167:0/1430332841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a80d7070 con 0x56020b70dad0 2024-09-18T02:04:18.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f409affd640 1 -- 172.21.15.167:0/1430332841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a80b4d20 con 0x56020b70dad0 2024-09-18T02:04:18.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b7580980 1 -- 172.21.15.167:0/1430332841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020b711340 con 0x56020b70dad0 2024-09-18T02:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f409affd640 1 -- 172.21.15.167:0/1430332841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f41a80e29b0 con 0x56020b70dad0 2024-09-18T02:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f409affd640 1 --2- 172.21.15.167:0/1430332841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f408c034650 0x7f408c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f409affd640 1 -- 172.21.15.167:0/1430332841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f41a80a8070 con 0x56020b70dad0 2024-09-18T02:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b488f640 1 --2- 172.21.15.167:0/1430332841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f408c034650 0x7f408c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b7580980 1 Processor -- start 2024-09-18T02:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b7580980 1 -- start start 2024-09-18T02:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.068+0000 7f41b488f640 1 --2- 172.21.15.167:0/1430332841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f408c034650 0x7f408c036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x56020b700440 tx=0x7f41ac00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 0x56020b71a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56020b6e92e0 con 0x56020b71a420 2024-09-18T02:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b5090640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 0x56020b71a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b5090640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 0x56020b71a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56298/0 (socket says 172.21.15.167:56298) 2024-09-18T02:04:18.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b5090640 1 -- 172.21.15.167:0/3417650922 learned_addr learned my addr 172.21.15.167:0/3417650922 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b5090640 1 -- 172.21.15.167:0/3417650922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020b71adf0 con 0x56020b71a420 2024-09-18T02:04:18.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b5090640 1 --2- 172.21.15.167:0/3417650922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 0x56020b71a820 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f41a80dafd0 tx=0x7f41a80bfd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562c6c31a435f9cc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f4098ff9640 1 -- 172.21.15.167:0/3417650922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a80e9030 con 0x56020b71a420 2024-09-18T02:04:18.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f4098ff9640 1 -- 172.21.15.167:0/3417650922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a80e5e80 con 0x56020b71a420 2024-09-18T02:04:18.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f4098ff9640 1 -- 172.21.15.167:0/3417650922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a80dc7d0 con 0x56020b71a420 2024-09-18T02:04:18.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 -- 172.21.15.167:0/3417650922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 msgr2=0x56020b71a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 --2- 172.21.15.167:0/3417650922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 0x56020b71a820 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f41a80dafd0 tx=0x7f41a80bfd80 comp rx=0 tx=0).stop 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 -- 172.21.15.167:0/3417650922 shutdown_connections 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 --2- 172.21.15.167:0/3417650922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 0x56020b71a820 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 -- 172.21.15.167:0/3417650922 >> 172.21.15.167:0/3417650922 conn(0x56020b7167b0 msgr2=0x56020b7148b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 -- 172.21.15.167:0/3417650922 shutdown_connections 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 -- 172.21.15.167:0/3417650922 wait complete. 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 Processor -- start 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 -- start start 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 0x56020b7215e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56020b71b340 con 0x56020b71a420 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b5090640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 0x56020b7215e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b5090640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 0x56020b7215e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56312/0 (socket says 172.21.15.167:56312) 2024-09-18T02:04:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 learned_addr learned my addr 172.21.15.167:0/4248317978 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020b721b20 con 0x56020b71a420 2024-09-18T02:04:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b5090640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 0x56020b7215e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f41a8007000 tx=0x7f41a80c8140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f408affd640 1 -- 172.21.15.167:0/4248317978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a8107020 con 0x56020b71a420 2024-09-18T02:04:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56020b721b20 con 0x56020b71a420 2024-09-18T02:04:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f408affd640 1 -- 172.21.15.167:0/4248317978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a80dca00 con 0x56020b71a420 2024-09-18T02:04:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020b721f90 con 0x56020b71a420 2024-09-18T02:04:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.072+0000 7f408affd640 1 -- 172.21.15.167:0/4248317978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a80dcbb0 con 0x56020b71a420 2024-09-18T02:04:18.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f408affd640 1 -- 172.21.15.167:0/4248317978 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f41a810a070 con 0x56020b71a420 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f408affd640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4080034650 0x7f4080036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f408affd640 1 -- 172.21.15.167:0/4248317978 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f41a80f4030 con 0x56020b71a420 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b488f640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4080034650 0x7f4080036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56020b72c540 0x56020b72ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b72f150 con 0x56020b72c540 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b5891640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56020b72c540 0x56020b72ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b488f640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4080034650 0x7f4080036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f41ac020010 tx=0x7f41ac010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b5891640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56020b72c540 0x56020b72ea00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 20 realm 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b72f560 con 0x56020b72c540 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b72fe00 con 0x56020b72c540 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b72c540 2024-09-18T02:04:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56020b730f00 0x56020b7332f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b733870 con 0x56020b730f00 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b5090640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56020b730f00 0x56020b7332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.076+0000 7f41b5090640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56020b730f00 0x56020b7332f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b7580980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b7580980 20 searching for the correct realm 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b7580980 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56020b7357a0 0x56020b737c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b738330 con 0x56020b7357a0 2024-09-18T02:04:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b488f640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56020b7357a0 0x56020b737c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b488f640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56020b7357a0 0x56020b737c60 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b488f640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f41ac037040 0x7f41ac036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b738330 con 0x7f41ac037040 2024-09-18T02:04:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5891640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f41ac037040 0x7f41ac036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5891640 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f41ac037040 0x7f41ac036410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b730f00 2024-09-18T02:04:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b72c540 2024-09-18T02:04:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b72c540 2024-09-18T02:04:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b730f00 2024-09-18T02:04:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.080+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b730f00 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x7f41ac037040 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b7357a0 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b72c540 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b730f00 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b72c540 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x7f41ac037040 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b7357a0 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b7357a0 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b730f00 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b7357a0 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b7357a0 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.084+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b72c540 2024-09-18T02:04:18.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b72c540 2024-09-18T02:04:18.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b730f00 2024-09-18T02:04:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b7357a0 2024-09-18T02:04:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x7f41ac037040 2024-09-18T02:04:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b72c540 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b730f00 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b7357a0 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b730f00 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x7f41ac037040 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b7357a0 2024-09-18T02:04:18.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.088+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b730f00 2024-09-18T02:04:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x56020b72c540 2024-09-18T02:04:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56020b7301a0 con 0x7f41ac037040 2024-09-18T02:04:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:18.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b7340c0 con 0x56020b72c540 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b7340c0 con 0x56020b72c540 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b7340c0 con 0x56020b7357a0 2024-09-18T02:04:18.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 zone default found 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 4 Realm: () 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 zonegroup default 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b734960 con 0x56020b730f00 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b73a190 con 0x56020b7357a0 2024-09-18T02:04:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b73a530 con 0x56020b7357a0 2024-09-18T02:04:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 started sync module instance, tier type = 2024-09-18T02:04:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:18.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.092+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b739630 con 0x7f41ac037040 2024-09-18T02:04:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.096+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.096+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94566782049120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b739630 con 0x7f41ac037040 2024-09-18T02:04:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.096+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73afe0 con 0x56020b72c540 2024-09-18T02:04:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.096+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94566782049120] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.096+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.096+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94566782053040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b739630 con 0x56020b72c540 2024-09-18T02:04:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.096+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73b9f0 con 0x56020b7357a0 2024-09-18T02:04:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94566782053040] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94566782055744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73c290 con 0x56020b7357a0 2024-09-18T02:04:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b739180 con 0x7f41ac037040 2024-09-18T02:04:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94566782060448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73d070 con 0x7f41ac037040 2024-09-18T02:04:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73da30 con 0x56020b72c540 2024-09-18T02:04:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94566782055744] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94566782060448] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94566782061504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73bef0 con 0x56020b72c540 2024-09-18T02:04:18.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.100+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73dee0 con 0x56020b730f00 2024-09-18T02:04:18.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.104+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94566782061504] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.104+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.104+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94566782064000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73bef0 con 0x56020b730f00 2024-09-18T02:04:18.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.104+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73e9b0 con 0x56020b730f00 2024-09-18T02:04:18.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.104+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94566782064000] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94566782067872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73db00 con 0x56020b730f00 2024-09-18T02:04:18.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73f7a0 con 0x56020b730f00 2024-09-18T02:04:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94566782071440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b73fc10 con 0x56020b730f00 2024-09-18T02:04:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b7580980 20 add_watcher() i=0 2024-09-18T02:04:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b7580980 20 add_watcher() i=1 2024-09-18T02:04:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b7580980 20 add_watcher() i=2 2024-09-18T02:04:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b7580980 20 add_watcher() i=3 2024-09-18T02:04:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b7580980 20 add_watcher() i=4 2024-09-18T02:04:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b7580980 20 add_watcher() i=5 2024-09-18T02:04:18.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94566782067872] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.108+0000 7f41b7580980 20 add_watcher() i=6 2024-09-18T02:04:18.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94566782071440] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 20 add_watcher() i=7 2024-09-18T02:04:18.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:18.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b73eb90 con 0x56020b72c540 2024-09-18T02:04:18.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94566782069648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b740190 con 0x56020b72c540 2024-09-18T02:04:18.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94566782069648] v30'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f406b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 5 note: GC not initialized 2024-09-18T02:04:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f406a7e4640 20 reqs_thread_entry: start 2024-09-18T02:04:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:18.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 20 Filter name: none 2024-09-18T02:04:18.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f3fdbfff640 20 reqs_thread_entry: start 2024-09-18T02:04:18.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56020b765de0 con 0x56020b72c540 2024-09-18T02:04:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.112+0000 7f41b7580980 20 rados_obj.operate() r=0 bl.length=502 2024-09-18T02:04:18.120 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T02:04:17.939780Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:18.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.116+0000 7f406b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:18.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.116+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94566782069648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b764990 con 0x56020b72c540 2024-09-18T02:04:18.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.116+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94566782069648] v30'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.116+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94566782049120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b763ce0 con 0x7f41ac037040 2024-09-18T02:04:18.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.116+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94566782049120] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.116+0000 7f41b7580980 20 remove_watcher() i=0 2024-09-18T02:04:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.116+0000 7f41b7580980 2 removed watcher, disabling cache 2024-09-18T02:04:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.116+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94566782053040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b763ce0 con 0x56020b72c540 2024-09-18T02:04:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.120+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94566782053040] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.120+0000 7f41b7580980 20 remove_watcher() i=1 2024-09-18T02:04:18.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.120+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94566782055744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b763ce0 con 0x56020b7357a0 2024-09-18T02:04:18.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.120+0000 7f41b488f640 1 -- 172.21.15.167:0/4248317978 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94566782055744] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41ac00e6c0 con 0x56020b7357a0 2024-09-18T02:04:18.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.120+0000 7f41b7580980 20 remove_watcher() i=2 2024-09-18T02:04:18.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.120+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94566782060448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b763ce0 con 0x7f41ac037040 2024-09-18T02:04:18.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.120+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94566782060448] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x7f41ac037040 2024-09-18T02:04:18.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.120+0000 7f41b7580980 20 remove_watcher() i=3 2024-09-18T02:04:18.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.120+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94566782061504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b763ce0 con 0x56020b72c540 2024-09-18T02:04:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.124+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94566782061504] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41b000a4d0 con 0x56020b72c540 2024-09-18T02:04:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.124+0000 7f41b7580980 20 remove_watcher() i=4 2024-09-18T02:04:18.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.124+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94566782064000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b763ce0 con 0x56020b730f00 2024-09-18T02:04:18.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.124+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94566782064000] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.124+0000 7f41b7580980 20 remove_watcher() i=5 2024-09-18T02:04:18.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.124+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94566782067872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b763ce0 con 0x56020b730f00 2024-09-18T02:04:18.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94566782067872] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 20 remove_watcher() i=6 2024-09-18T02:04:18.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94566782071440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56020b763ce0 con 0x56020b730f00 2024-09-18T02:04:18.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b5090640 1 -- 172.21.15.167:0/4248317978 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94566782071440] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8109030 con 0x56020b730f00 2024-09-18T02:04:18.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 20 remove_watcher() i=7 2024-09-18T02:04:18.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56020b730f00 msgr2=0x56020b7332f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56020b730f00 0x56020b7332f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56020b72c540 msgr2=0x56020b72ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56020b72c540 0x56020b72ea00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f41ac037040 msgr2=0x7f41ac036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f41ac037040 0x7f41ac036410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56020b7357a0 msgr2=0x56020b737c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56020b7357a0 0x56020b737c60 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4080034650 msgr2=0x7f4080036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4080034650 0x7f4080036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f41ac020010 tx=0x7f41ac010000 comp rx=0 tx=0).stop 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 msgr2=0x56020b7215e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 --2- 172.21.15.167:0/4248317978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b71a420 0x56020b7215e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f41a8007000 tx=0x7f41a80c8140 comp rx=0 tx=0).stop 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b5891640 1 -- 172.21.15.167:0/4248317978 reap_dead start 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 shutdown_connections 2024-09-18T02:04:18.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 >> 172.21.15.167:0/4248317978 conn(0x56020b7167b0 msgr2=0x56020b714880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 shutdown_connections 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/4248317978 wait complete. 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/1430332841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f408c034650 msgr2=0x7f408c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 --2- 172.21.15.167:0/1430332841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f408c034650 0x7f408c036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x56020b700440 tx=0x7f41ac00f000 comp rx=0 tx=0).stop 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/1430332841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b70dad0 msgr2=0x56020b70def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 --2- 172.21.15.167:0/1430332841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b70dad0 0x56020b70def0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f41a8006910 tx=0x7f41a80b56c0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/1430332841 shutdown_connections 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 --2- 172.21.15.167:0/1430332841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f408c034650 0x7f408c036b10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 --2- 172.21.15.167:0/1430332841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b70dad0 0x56020b70def0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/1430332841 >> 172.21.15.167:0/1430332841 conn(0x56020b702c20 msgr2=0x56020b7056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/1430332841 shutdown_connections 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.128+0000 7f41b7580980 1 -- 172.21.15.167:0/1430332841 wait complete. 2024-09-18T02:04:18.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56020b6f95c0 msgr2=0x56020b6fb9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56020b6f95c0 0x56020b6fb9b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56020b5fe230 msgr2=0x56020b6f6c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56020b5fe230 0x56020b6f6c50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56020b6fd4c0 msgr2=0x56020b6ff8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56020b6fd4c0 0x56020b6ff8b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f409c034650 msgr2=0x7f409c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f409c034650 0x7f409c036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f41ac000f70 tx=0x7f41ac0010b0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 msgr2=0x56020b6efcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 --2- 172.21.15.167:0/2927793511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56020b5fd8e0 0x56020b6efcc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f41a8018eb0 tx=0x7f41a8018020 comp rx=0 tx=0).stop 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b5891640 1 -- 172.21.15.167:0/2927793511 reap_dead start 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 shutdown_connections 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 >> 172.21.15.167:0/2927793511 conn(0x56020b571230 msgr2=0x56020b6e3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 shutdown_connections 2024-09-18T02:04:18.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.132+0000 7f41b7580980 1 -- 172.21.15.167:0/2927793511 wait complete. 2024-09-18T02:04:18.143 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T02:04:17.939780Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:18.143 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-18T02:04:18.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-18T02:04:18.143 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-18T02:04:18.214 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:18.214 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:18.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.212+0000 7f40ec397980 1 Processor -- start 2024-09-18T02:04:18.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.212+0000 7f40ec397980 1 -- start start 2024-09-18T02:04:18.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.212+0000 7f40ec397980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5628986a0c70 0x5628986a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.212+0000 7f40ec397980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562898522ae0 con 0x56289869c8f0 2024-09-18T02:04:18.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.212+0000 7f40ec397980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x562898546e30 con 0x5628986a0c70 2024-09-18T02:04:18.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.212+0000 7f40e96a6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5628986a0c70 0x5628986a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.212+0000 7f40e96a6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5628986a0c70 0x5628986a3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56318/0 (socket says 172.21.15.167:56318) 2024-09-18T02:04:18.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.212+0000 7f40e96a6640 1 -- 172.21.15.167:0/643412528 learned_addr learned my addr 172.21.15.167:0/643412528 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.212+0000 7f40e9ea7640 1 --1- 172.21.15.167:0/643412528 >> v1:172.21.15.81:6789/0 conn(0x56289869c8f0 0x56289869ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55462/0 (socket says 172.21.15.167:55462) 2024-09-18T02:04:18.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.212+0000 7f40e96a6640 1 -- 172.21.15.167:0/643412528 >> v1:172.21.15.81:6789/0 conn(0x56289869c8f0 legacy=0x56289869ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.212+0000 7f40e96a6640 1 -- 172.21.15.167:0/643412528 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628986a45b0 con 0x5628986a0c70 2024-09-18T02:04:18.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.216+0000 7f40e96a6640 1 --2- 172.21.15.167:0/643412528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628986a0c70 0x5628986a3060 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f40d400a5c0 tx=0x7f40d401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff134ca79bd1f858 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.216+0000 7f40e8ea5640 1 -- 172.21.15.167:0/643412528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d40a6070 con 0x5628986a0c70 2024-09-18T02:04:18.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.216+0000 7f40e8ea5640 1 -- 172.21.15.167:0/643412528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d40af070 con 0x5628986a0c70 2024-09-18T02:04:18.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.216+0000 7f40e8ea5640 1 -- 172.21.15.167:0/643412528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d40aa5c0 con 0x5628986a0c70 2024-09-18T02:04:18.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.216+0000 7f40ec397980 1 -- 172.21.15.167:0/643412528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628986a0c70 msgr2=0x5628986a3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.216+0000 7f40ec397980 1 --2- 172.21.15.167:0/643412528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628986a0c70 0x5628986a3060 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f40d400a5c0 tx=0x7f40d401b340 comp rx=0 tx=0).stop 2024-09-18T02:04:18.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.216+0000 7f40ec397980 1 -- 172.21.15.167:0/643412528 shutdown_connections 2024-09-18T02:04:18.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.216+0000 7f40ec397980 1 --2- 172.21.15.167:0/643412528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628986a0c70 0x5628986a3060 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.216+0000 7f40ec397980 1 -- 172.21.15.167:0/643412528 >> 172.21.15.167:0/643412528 conn(0x562898610240 msgr2=0x562898610650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.216+0000 7f40ec397980 1 -- 172.21.15.167:0/643412528 shutdown_connections 2024-09-18T02:04:18.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.216+0000 7f40ec397980 1 -- 172.21.15.167:0/643412528 wait complete. 2024-09-18T02:04:18.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f40ec397980 1 Processor -- start 2024-09-18T02:04:18.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f40ec397980 1 -- start start 2024-09-18T02:04:18.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f40ec397980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 0x562898787ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f40ec397980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562898548200 con 0x56289869c8f0 2024-09-18T02:04:18.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f40e9ea7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 0x562898787ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f40e9ea7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 0x562898787ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56320/0 (socket says 172.21.15.167:56320) 2024-09-18T02:04:18.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f40e9ea7640 1 -- 172.21.15.167:0/3652637010 learned_addr learned my addr 172.21.15.167:0/3652637010 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f40e9ea7640 1 -- 172.21.15.167:0/3652637010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562898788270 con 0x56289869c8f0 2024-09-18T02:04:18.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f40e9ea7640 1 --2- 172.21.15.167:0/3652637010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 0x562898787ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f40e40015f0 tx=0x7f40e4001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60eec10a31cd9690 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f3fd7e07640 1 -- 172.21.15.167:0/3652637010 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4013420 con 0x56289869c8f0 2024-09-18T02:04:18.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f3fd7e07640 1 -- 172.21.15.167:0/3652637010 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e40135e0 con 0x56289869c8f0 2024-09-18T02:04:18.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.228+0000 7f3fd7e07640 1 -- 172.21.15.167:0/3652637010 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4013940 con 0x56289869c8f0 2024-09-18T02:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 -- 172.21.15.167:0/3652637010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 msgr2=0x562898787ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 --2- 172.21.15.167:0/3652637010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 0x562898787ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f40e40015f0 tx=0x7f40e4001ab0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 -- 172.21.15.167:0/3652637010 shutdown_connections 2024-09-18T02:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 --2- 172.21.15.167:0/3652637010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 0x562898787ca0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 -- 172.21.15.167:0/3652637010 >> 172.21.15.167:0/3652637010 conn(0x562898610240 msgr2=0x5628987838d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 -- 172.21.15.167:0/3652637010 shutdown_connections 2024-09-18T02:04:18.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 -- 172.21.15.167:0/3652637010 wait complete. 2024-09-18T02:04:18.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 Processor -- start 2024-09-18T02:04:18.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 -- start start 2024-09-18T02:04:18.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 0x56289878f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5628986a40b0 con 0x56289869c8f0 2024-09-18T02:04:18.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40e9ea7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 0x56289878f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40e9ea7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 0x56289878f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56332/0 (socket says 172.21.15.167:56332) 2024-09-18T02:04:18.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40e9ea7640 1 -- 172.21.15.167:0/3774653982 learned_addr learned my addr 172.21.15.167:0/3774653982 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40e9ea7640 1 -- 172.21.15.167:0/3774653982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56289878f550 con 0x56289869c8f0 2024-09-18T02:04:18.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40e9ea7640 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 0x56289878f010 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f40e4006640 tx=0x7f40e4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f3fd6604640 1 -- 172.21.15.167:0/3774653982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4022020 con 0x56289869c8f0 2024-09-18T02:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56289878f7e0 con 0x56289869c8f0 2024-09-18T02:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f3fd6604640 1 -- 172.21.15.167:0/3774653982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e4006320 con 0x56289869c8f0 2024-09-18T02:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f3fd6604640 1 -- 172.21.15.167:0/3774653982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4004ab0 con 0x56289869c8f0 2024-09-18T02:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628987924c0 con 0x56289869c8f0 2024-09-18T02:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f3fd6604640 1 -- 172.21.15.167:0/3774653982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40e4025020 con 0x56289869c8f0 2024-09-18T02:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f3fd6604640 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fd0034650 0x7f3fd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f3fd6604640 1 -- 172.21.15.167:0/3774653982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f40e4018030 con 0x56289869c8f0 2024-09-18T02:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40e96a6640 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fd0034650 0x7f3fd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5628986a0c70 0x562898796020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.232+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562898796660 con 0x5628986a0c70 2024-09-18T02:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40ea6a8640 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5628986a0c70 0x562898796020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40e96a6640 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fd0034650 0x7f3fd0036b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40d40ae000 tx=0x7f40d40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40ea6a8640 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5628986a0c70 0x562898796020 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40ea6a8640 1 -- 172.21.15.167:0/3774653982 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x5628986a0c70 2024-09-18T02:04:18.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987936e0 con 0x5628986a0c70 2024-09-18T02:04:18.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40ea6a8640 1 -- 172.21.15.167:0/3774653982 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40dc0083f0 con 0x5628986a0c70 2024-09-18T02:04:18.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40ec397980 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5628987989b0 0x56289879ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56289879b470 con 0x5628987989b0 2024-09-18T02:04:18.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40e9ea7640 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5628987989b0 0x56289879ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40e9ea7640 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5628987989b0 0x56289879ada0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40e9ea7640 1 -- 172.21.15.167:0/3774653982 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40e401b070 con 0x5628987989b0 2024-09-18T02:04:18.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562898797850 con 0x5628986a0c70 2024-09-18T02:04:18.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40ea6a8640 1 -- 172.21.15.167:0/3774653982 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40dc0083f0 con 0x5628986a0c70 2024-09-18T02:04:18.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40ec397980 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56289879c8b0 0x56289879eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56289879f430 con 0x56289879c8b0 2024-09-18T02:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40e96a6640 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56289879c8b0 0x56289879eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40e96a6640 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56289879c8b0 0x56289879eca0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.236+0000 7f40e96a6640 1 -- 172.21.15.167:0/3774653982 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40d40aaae0 con 0x56289879c8b0 2024-09-18T02:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40ec397980 1 Processor -- start 2024-09-18T02:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40ec397980 1 -- start start 2024-09-18T02:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40ec397980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987acec0 0x5628987ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40ec397980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5628985a1800 con 0x5628987acec0 2024-09-18T02:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40e9ea7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987acec0 0x5628987ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40e9ea7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987acec0 0x5628987ad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56334/0 (socket says 172.21.15.167:56334) 2024-09-18T02:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40e9ea7640 1 -- 172.21.15.167:0/4101254219 learned_addr learned my addr 172.21.15.167:0/4101254219 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40e9ea7640 1 -- 172.21.15.167:0/4101254219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628987ad820 con 0x5628987acec0 2024-09-18T02:04:18.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40e9ea7640 1 --2- 172.21.15.167:0/4101254219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987acec0 0x5628987ad2e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f40e40069a0 tx=0x7f40e4010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f3fcf7fe640 1 -- 172.21.15.167:0/4101254219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4041f80 con 0x5628987acec0 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40ec397980 1 -- 172.21.15.167:0/4101254219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628987adab0 con 0x5628987acec0 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f3fcf7fe640 1 -- 172.21.15.167:0/4101254219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e401d580 con 0x5628987acec0 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f3fcf7fe640 1 -- 172.21.15.167:0/4101254219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e401d860 con 0x5628987acec0 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40ec397980 1 -- 172.21.15.167:0/4101254219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628987b0730 con 0x5628987acec0 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f3fcf7fe640 1 -- 172.21.15.167:0/4101254219 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40e4010070 con 0x5628987acec0 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f3fcf7fe640 1 --2- 172.21.15.167:0/4101254219 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fc4034650 0x7f3fc4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f3fcf7fe640 1 -- 172.21.15.167:0/4101254219 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f40e401fcd0 con 0x5628987acec0 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40e96a6640 1 --2- 172.21.15.167:0/4101254219 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fc4034650 0x7f3fc4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40ec397980 1 Processor -- start 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40ec397980 1 -- start start 2024-09-18T02:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40e96a6640 1 --2- 172.21.15.167:0/4101254219 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fc4034650 0x7f3fc4036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f40d4000c10 tx=0x7f40d4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40ec397980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.240+0000 7f40ec397980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5628987885f0 con 0x5628987b97b0 2024-09-18T02:04:18.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40e9ea7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40e9ea7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987b9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56344/0 (socket says 172.21.15.167:56344) 2024-09-18T02:04:18.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40e9ea7640 1 -- 172.21.15.167:0/610783863 learned_addr learned my addr 172.21.15.167:0/610783863 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40e9ea7640 1 -- 172.21.15.167:0/610783863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628987ba180 con 0x5628987b97b0 2024-09-18T02:04:18.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40e9ea7640 1 --2- 172.21.15.167:0/610783863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987b9bb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f40e4010b80 tx=0x7f40e40305e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8c1b3a7c72a49f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f3fcd7fa640 1 -- 172.21.15.167:0/610783863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40307c0 con 0x5628987b97b0 2024-09-18T02:04:18.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f3fcd7fa640 1 -- 172.21.15.167:0/610783863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e4059070 con 0x5628987b97b0 2024-09-18T02:04:18.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f3fcd7fa640 1 -- 172.21.15.167:0/610783863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4012580 con 0x5628987b97b0 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 -- 172.21.15.167:0/610783863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 msgr2=0x5628987b9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 --2- 172.21.15.167:0/610783863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987b9bb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f40e4010b80 tx=0x7f40e40305e0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 -- 172.21.15.167:0/610783863 shutdown_connections 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 --2- 172.21.15.167:0/610783863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987b9bb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 -- 172.21.15.167:0/610783863 >> 172.21.15.167:0/610783863 conn(0x5628987b5be0 msgr2=0x5628987b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 -- 172.21.15.167:0/610783863 shutdown_connections 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 -- 172.21.15.167:0/610783863 wait complete. 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 Processor -- start 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 -- start start 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5628987ba650 con 0x5628987b97b0 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40e9ea7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40e9ea7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987c09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56356/0 (socket says 172.21.15.167:56356) 2024-09-18T02:04:18.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 learned_addr learned my addr 172.21.15.167:0/128870712 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628987c0ef0 con 0x5628987b97b0 2024-09-18T02:04:18.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40e9ea7640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987c09b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f40e404d040 tx=0x7f40e401f910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f3fbb7fe640 1 -- 172.21.15.167:0/128870712 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e403b440 con 0x5628987b97b0 2024-09-18T02:04:18.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628987c0ef0 con 0x5628987b97b0 2024-09-18T02:04:18.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f3fbb7fe640 1 -- 172.21.15.167:0/128870712 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e403b5e0 con 0x5628987b97b0 2024-09-18T02:04:18.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f3fbb7fe640 1 -- 172.21.15.167:0/128870712 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e401da00 con 0x5628987b97b0 2024-09-18T02:04:18.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.244+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628987c0ef0 con 0x5628987b97b0 2024-09-18T02:04:18.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f3fbb7fe640 1 -- 172.21.15.167:0/128870712 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40e4070060 con 0x5628987b97b0 2024-09-18T02:04:18.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f3fbb7fe640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fb4034650 0x7f3fb4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f3fbb7fe640 1 -- 172.21.15.167:0/128870712 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f40e403f1c0 con 0x5628987b97b0 2024-09-18T02:04:18.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40e96a6640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fb4034650 0x7f3fb4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5628987cb9c0 0x5628987cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987ce5d0 con 0x5628987cb9c0 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ea6a8640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5628987cb9c0 0x5628987cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40e96a6640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fb4034650 0x7f3fb4036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f40d40aa910 tx=0x7f40d40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ea6a8640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5628987cb9c0 0x5628987cde80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x5628987cb9c0 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 20 realm 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987ce9e0 con 0x5628987cb9c0 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x5628987cb9c0 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf280 con 0x5628987cb9c0 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40dc0083f0 con 0x5628987cb9c0 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987cb9c0 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40dc0083f0 con 0x5628987cb9c0 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5628987d0380 0x5628987d2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987d2e10 con 0x5628987d0380 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40e9ea7640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5628987d0380 0x5628987d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.248+0000 7f40e9ea7640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5628987d0380 0x5628987d2770 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ec397980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ec397980 20 searching for the correct realm 2024-09-18T02:04:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ec397980 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5628987d4cf0 0x5628987d7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987d77e0 con 0x5628987d4cf0 2024-09-18T02:04:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e96a6640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5628987d4cf0 0x5628987d7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e96a6640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5628987d4cf0 0x5628987d7160 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e96a6640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f40d40e0040 0x7f40d40e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987d77e0 con 0x7f40d40e0040 2024-09-18T02:04:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ea6a8640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f40d40e0040 0x7f40d40e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ea6a8640 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f40d40e0040 0x7f40d40e0420 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x7f40d40e0040 2024-09-18T02:04:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d0380 2024-09-18T02:04:18.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987cb9c0 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc0083f0 con 0x5628987cb9c0 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987cb9c0 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d0380 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d0380 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.252+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x7f40d40e0040 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc026040 con 0x7f40d40e0040 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d4cf0 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987cb9c0 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d0380 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987cb9c0 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x7f40d40e0040 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40dc026040 con 0x7f40d40e0040 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d4cf0 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d4cf0 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d0380 2024-09-18T02:04:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d4cf0 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d4cf0 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987cb9c0 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.256+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987cb9c0 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d0380 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d4cf0 2024-09-18T02:04:18.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x7f40d40e0040 2024-09-18T02:04:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc026040 con 0x7f40d40e0040 2024-09-18T02:04:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987cb9c0 2024-09-18T02:04:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d0380 2024-09-18T02:04:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d4cf0 2024-09-18T02:04:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d0380 2024-09-18T02:04:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x7f40d40e0040 2024-09-18T02:04:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc026040 con 0x7f40d40e0040 2024-09-18T02:04:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d4cf0 2024-09-18T02:04:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987d0380 2024-09-18T02:04:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.260+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x5628987cb9c0 2024-09-18T02:04:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5628987cf620 con 0x7f40d40e0040 2024-09-18T02:04:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40dc026040 con 0x7f40d40e0040 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987d3660 con 0x5628987cb9c0 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987d3660 con 0x5628987cb9c0 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987d3660 con 0x5628987d4cf0 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 zone default found 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 4 Realm: () 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 zonegroup default 2024-09-18T02:04:18.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987d3f90 con 0x5628987d0380 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987d9640 con 0x5628987d4cf0 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987d9b00 con 0x5628987d4cf0 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 started sync module instance, tier type = 2024-09-18T02:04:18.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:18.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987d8ae0 con 0x7f40d40e0040 2024-09-18T02:04:18.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x7f40d40e0040 2024-09-18T02:04:18.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94732357046272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987d8ae0 con 0x7f40d40e0040 2024-09-18T02:04:18.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.264+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987da580 con 0x5628987cb9c0 2024-09-18T02:04:18.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.268+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94732357046272] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x7f40d40e0040 2024-09-18T02:04:18.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.268+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.268+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94732357050848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987d8ae0 con 0x5628987cb9c0 2024-09-18T02:04:18.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.268+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987daf90 con 0x5628987d4cf0 2024-09-18T02:04:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.268+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94732357050848] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.268+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.272+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94732357043760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987d8a50 con 0x5628987d4cf0 2024-09-18T02:04:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.272+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987dbcd0 con 0x7f40d40e0040 2024-09-18T02:04:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.272+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x7f40d40e0040 2024-09-18T02:04:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.272+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94732357056480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987dc570 con 0x7f40d40e0040 2024-09-18T02:04:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.272+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987dcf70 con 0x5628987cb9c0 2024-09-18T02:04:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.272+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94732357056480] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x7f40d40e0040 2024-09-18T02:04:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.272+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94732357043760] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.272+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.272+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94732357055280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987dc040 con 0x5628987cb9c0 2024-09-18T02:04:18.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.272+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987dd810 con 0x5628987d0380 2024-09-18T02:04:18.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.276+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94732357055280] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.276+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.276+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94732357063520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987dc040 con 0x5628987d0380 2024-09-18T02:04:18.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.276+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987de060 con 0x5628987d0380 2024-09-18T02:04:18.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.276+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94732357063520] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.276+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.276+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94732357065648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987de480 con 0x5628987d0380 2024-09-18T02:04:18.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.276+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987dee40 con 0x5628987d0380 2024-09-18T02:04:18.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94732357065648] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94732357067008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987dee40 con 0x5628987d0380 2024-09-18T02:04:18.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40ec397980 20 add_watcher() i=0 2024-09-18T02:04:18.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40ec397980 20 add_watcher() i=1 2024-09-18T02:04:18.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40ec397980 20 add_watcher() i=2 2024-09-18T02:04:18.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40ec397980 20 add_watcher() i=3 2024-09-18T02:04:18.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40ec397980 20 add_watcher() i=4 2024-09-18T02:04:18.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40ec397980 20 add_watcher() i=5 2024-09-18T02:04:18.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40ec397980 20 add_watcher() i=6 2024-09-18T02:04:18.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94732357067008] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40ec397980 20 add_watcher() i=7 2024-09-18T02:04:18.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40ec397980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:18.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.280+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628987e21c0 con 0x5628987cb9c0 2024-09-18T02:04:18.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94732357082016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987defb0 con 0x5628987cb9c0 2024-09-18T02:04:18.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94732357082016] v30'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f3f9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 5 note: GC not initialized 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f3f9a7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 20 Filter name: none 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f3f0bfff640 20 reqs_thread_entry: start 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562898805950 con 0x5628987cb9c0 2024-09-18T02:04:18.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 20 rados_obj.operate() r=0 bl.length=502 2024-09-18T02:04:18.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:18.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:18.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:18.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56289880bfa0 con 0x5628987cb9c0 2024-09-18T02:04:18.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:18.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:18.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:18.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94732357253648 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562898807690 con 0x5628987cb9c0 2024-09-18T02:04:18.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94732357055280 notify 128849018884 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f40dc010040 con 0x5628987cb9c0 2024-09-18T02:04:18.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f3fcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94732357055280 notifier 4361 bl.length()=567 2024-09-18T02:04:18.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f3fcd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:18.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f3fcd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:18.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(64 notify.4 [notify cookie 94732357253648 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.284+0000 7f3fcd7fa640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3fac003eb0 con 0x5628987cb9c0 2024-09-18T02:04:18.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== watch-notify(notify_complete (2) cookie 94732357253648 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f40dc02a450 con 0x5628987cb9c0 2024-09-18T02:04:18.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56289880ba10 con 0x5628987d0380 2024-09-18T02:04:18.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f40ec397980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T02:04:18.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94732357253648 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5628988071e0 con 0x5628987d4cf0 2024-09-18T02:04:18.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== watch-notify(notify (1) cookie 94732357043760 notify 128849018881 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5628986a45b0 con 0x5628987d4cf0 2024-09-18T02:04:18.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f3fcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94732357043760 notifier 4361 bl.length()=170 2024-09-18T02:04:18.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 notify.2 [notify cookie 94732357253648 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f3fcd7fa640 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3fac003eb0 con 0x5628987d4cf0 2024-09-18T02:04:18.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== watch-notify(notify_complete (2) cookie 94732357253648 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f40d40e0960 con 0x5628987d4cf0 2024-09-18T02:04:18.293 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:18.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f3f9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:18.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.288+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94732357082016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562898803730 con 0x5628987cb9c0 2024-09-18T02:04:18.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.292+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94732357082016] v30'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.292+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94732357046272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562898803730 con 0x7f40d40e0040 2024-09-18T02:04:18.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.292+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94732357046272] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x7f40d40e0040 2024-09-18T02:04:18.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.292+0000 7f40ec397980 20 remove_watcher() i=0 2024-09-18T02:04:18.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.292+0000 7f40ec397980 2 removed watcher, disabling cache 2024-09-18T02:04:18.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.292+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94732357050848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562898803730 con 0x5628987cb9c0 2024-09-18T02:04:18.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.292+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94732357050848] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.292+0000 7f40ec397980 20 remove_watcher() i=1 2024-09-18T02:04:18.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.292+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94732357043760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987da1e0 con 0x5628987d4cf0 2024-09-18T02:04:18.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.296+0000 7f40e96a6640 1 -- 172.21.15.167:0/128870712 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94732357043760] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d40aaae0 con 0x5628987d4cf0 2024-09-18T02:04:18.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.296+0000 7f40ec397980 20 remove_watcher() i=2 2024-09-18T02:04:18.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.296+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94732357056480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562898803730 con 0x7f40d40e0040 2024-09-18T02:04:18.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.296+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94732357056480] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x7f40d40e0040 2024-09-18T02:04:18.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.296+0000 7f40ec397980 20 remove_watcher() i=3 2024-09-18T02:04:18.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.296+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94732357055280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987d8630 con 0x5628987cb9c0 2024-09-18T02:04:18.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.300+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94732357055280] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40dc026040 con 0x5628987cb9c0 2024-09-18T02:04:18.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.300+0000 7f40ec397980 20 remove_watcher() i=4 2024-09-18T02:04:18.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.300+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94732357063520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987da1e0 con 0x5628987d0380 2024-09-18T02:04:18.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.300+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94732357063520] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.300+0000 7f40ec397980 20 remove_watcher() i=5 2024-09-18T02:04:18.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.300+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94732357065648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562898803730 con 0x5628987d0380 2024-09-18T02:04:18.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94732357065648] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 20 remove_watcher() i=6 2024-09-18T02:04:18.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94732357067008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5628987d8630 con 0x5628987d0380 2024-09-18T02:04:18.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40e9ea7640 1 -- 172.21.15.167:0/128870712 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94732357067008] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e4039070 con 0x5628987d0380 2024-09-18T02:04:18.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 20 remove_watcher() i=7 2024-09-18T02:04:18.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5628987d0380 msgr2=0x5628987d2770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5628987d0380 0x5628987d2770 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5628987cb9c0 msgr2=0x5628987cde80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5628987cb9c0 0x5628987cde80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f40d40e0040 msgr2=0x7f40d40e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f40d40e0040 0x7f40d40e0420 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5628987d4cf0 msgr2=0x5628987d7160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5628987d4cf0 0x5628987d7160 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fb4034650 msgr2=0x7f3fb4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fb4034650 0x7f3fb4036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f40d40aa910 tx=0x7f40d40c1040 comp rx=0 tx=0).stop 2024-09-18T02:04:18.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ea6a8640 1 -- 172.21.15.167:0/128870712 reap_dead start 2024-09-18T02:04:18.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 msgr2=0x5628987c09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987c09b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f40e404d040 tx=0x7f40e401f910 comp rx=0 tx=0).stop 2024-09-18T02:04:18.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 shutdown_connections 2024-09-18T02:04:18.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 --2- 172.21.15.167:0/128870712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987b97b0 0x5628987c09b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 >> 172.21.15.167:0/128870712 conn(0x5628987b5be0 msgr2=0x5628987b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 shutdown_connections 2024-09-18T02:04:18.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/128870712 wait complete. 2024-09-18T02:04:18.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/4101254219 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fc4034650 msgr2=0x7f3fc4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 --2- 172.21.15.167:0/4101254219 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fc4034650 0x7f3fc4036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f40d4000c10 tx=0x7f40d4005ad0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/4101254219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987acec0 msgr2=0x5628987ad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 --2- 172.21.15.167:0/4101254219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987acec0 0x5628987ad2e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f40e40069a0 tx=0x7f40e4010ab0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/4101254219 shutdown_connections 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 --2- 172.21.15.167:0/4101254219 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fc4034650 0x7f3fc4036b10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 --2- 172.21.15.167:0/4101254219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628987acec0 0x5628987ad2e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/4101254219 >> 172.21.15.167:0/4101254219 conn(0x5628987a2010 msgr2=0x5628987a4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/4101254219 shutdown_connections 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.304+0000 7f40ec397980 1 -- 172.21.15.167:0/4101254219 wait complete. 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5628987989b0 msgr2=0x56289879ada0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5628987989b0 0x56289879ada0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5628986a0c70 msgr2=0x562898796020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5628986a0c70 0x562898796020 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56289879c8b0 msgr2=0x56289879eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56289879c8b0 0x56289879eca0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fd0034650 msgr2=0x7f3fd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3fd0034650 0x7f3fd0036b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40d40ae000 tx=0x7f40d40a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:18.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 msgr2=0x56289878f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 --2- 172.21.15.167:0/3774653982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289869c8f0 0x56289878f010 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f40e4006640 tx=0x7f40e4000f50 comp rx=0 tx=0).stop 2024-09-18T02:04:18.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ea6a8640 1 -- 172.21.15.167:0/3774653982 reap_dead start 2024-09-18T02:04:18.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 shutdown_connections 2024-09-18T02:04:18.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 >> 172.21.15.167:0/3774653982 conn(0x562898610240 msgr2=0x562898782450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 shutdown_connections 2024-09-18T02:04:18.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.308+0000 7f40ec397980 1 -- 172.21.15.167:0/3774653982 wait complete. 2024-09-18T02:04:18.318 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:18.319 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-18T02:04:18.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-18T02:04:18.319 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-18T02:04:18.397 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:18.397 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:18.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.396+0000 7f8668a6d980 1 Processor -- start 2024-09-18T02:04:18.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.396+0000 7f8668a6d980 1 -- start start 2024-09-18T02:04:18.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.396+0000 7f8668a6d980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5655177ea2a0 0x56551787a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.396+0000 7f8668a6d980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5655176fdae0 con 0x56551787acf0 2024-09-18T02:04:18.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.396+0000 7f8668a6d980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x565517721e30 con 0x5655177ea2a0 2024-09-18T02:04:18.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.396+0000 7f866657d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5655177ea2a0 0x56551787a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.396+0000 7f866657d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5655177ea2a0 0x56551787a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56362/0 (socket says 172.21.15.167:56362) 2024-09-18T02:04:18.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.396+0000 7f866657d640 1 -- 172.21.15.167:0/3745833911 learned_addr learned my addr 172.21.15.167:0/3745833911 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.396+0000 7f8665d7c640 1 --1- 172.21.15.167:0/3745833911 >> v1:172.21.15.81:6789/0 conn(0x56551787acf0 0x56551787d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55478/0 (socket says 172.21.15.167:55478) 2024-09-18T02:04:18.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.396+0000 7f866657d640 1 -- 172.21.15.167:0/3745833911 >> v1:172.21.15.81:6789/0 conn(0x56551787acf0 legacy=0x56551787d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.396+0000 7f866657d640 1 -- 172.21.15.167:0/3745833911 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655177ea680 con 0x5655177ea2a0 2024-09-18T02:04:18.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.400+0000 7f866657d640 1 --2- 172.21.15.167:0/3745833911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x56551787a7b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f865800a5c0 tx=0x7f865801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8d774b22f29e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.400+0000 7f866557b640 1 -- 172.21.15.167:0/3745833911 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580a6070 con 0x5655177ea2a0 2024-09-18T02:04:18.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.400+0000 7f866557b640 1 -- 172.21.15.167:0/3745833911 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86580af070 con 0x5655177ea2a0 2024-09-18T02:04:18.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.400+0000 7f866557b640 1 -- 172.21.15.167:0/3745833911 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580aa5c0 con 0x5655177ea2a0 2024-09-18T02:04:18.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.400+0000 7f8668a6d980 1 -- 172.21.15.167:0/3745833911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 msgr2=0x56551787a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.400+0000 7f8668a6d980 1 --2- 172.21.15.167:0/3745833911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x56551787a7b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f865800a5c0 tx=0x7f865801b340 comp rx=0 tx=0).stop 2024-09-18T02:04:18.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.400+0000 7f8668a6d980 1 -- 172.21.15.167:0/3745833911 shutdown_connections 2024-09-18T02:04:18.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.400+0000 7f8668a6d980 1 --2- 172.21.15.167:0/3745833911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x56551787a7b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.400+0000 7f8668a6d980 1 -- 172.21.15.167:0/3745833911 >> 172.21.15.167:0/3745833911 conn(0x5655178700a0 msgr2=0x5655178724c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.400+0000 7f8668a6d980 1 -- 172.21.15.167:0/3745833911 shutdown_connections 2024-09-18T02:04:18.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.400+0000 7f8668a6d980 1 -- 172.21.15.167:0/3745833911 wait complete. 2024-09-18T02:04:18.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.412+0000 7f8668a6d980 1 Processor -- start 2024-09-18T02:04:18.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.412+0000 7f8668a6d980 1 -- start start 2024-09-18T02:04:18.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.412+0000 7f8668a6d980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x565517962c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.412+0000 7f8668a6d980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x565517723200 con 0x5655177ea2a0 2024-09-18T02:04:18.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.412+0000 7f866657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x565517962c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.412+0000 7f866657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x565517962c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56376/0 (socket says 172.21.15.167:56376) 2024-09-18T02:04:18.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.412+0000 7f866657d640 1 -- 172.21.15.167:0/4077164949 learned_addr learned my addr 172.21.15.167:0/4077164949 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f866657d640 1 -- 172.21.15.167:0/4077164949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565517963250 con 0x5655177ea2a0 2024-09-18T02:04:18.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f866657d640 1 --2- 172.21.15.167:0/4077164949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x565517962c80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f865801b380 tx=0x7f8658003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f1c96c07f736d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8554608640 1 -- 172.21.15.167:0/4077164949 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580aa970 con 0x5655177ea2a0 2024-09-18T02:04:18.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8554608640 1 -- 172.21.15.167:0/4077164949 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86580aab30 con 0x5655177ea2a0 2024-09-18T02:04:18.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8554608640 1 -- 172.21.15.167:0/4077164949 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580aae50 con 0x5655177ea2a0 2024-09-18T02:04:18.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 -- 172.21.15.167:0/4077164949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 msgr2=0x565517962c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4077164949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x565517962c80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f865801b380 tx=0x7f8658003030 comp rx=0 tx=0).stop 2024-09-18T02:04:18.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 -- 172.21.15.167:0/4077164949 shutdown_connections 2024-09-18T02:04:18.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4077164949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x565517962c80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 -- 172.21.15.167:0/4077164949 >> 172.21.15.167:0/4077164949 conn(0x5655178700a0 msgr2=0x56551795e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 -- 172.21.15.167:0/4077164949 shutdown_connections 2024-09-18T02:04:18.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 -- 172.21.15.167:0/4077164949 wait complete. 2024-09-18T02:04:18.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 Processor -- start 2024-09-18T02:04:18.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 -- start start 2024-09-18T02:04:18.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x565517969e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x565517881230 con 0x5655177ea2a0 2024-09-18T02:04:18.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f866657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x565517969e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f866657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x565517969e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56388/0 (socket says 172.21.15.167:56388) 2024-09-18T02:04:18.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f866657d640 1 -- 172.21.15.167:0/4003290387 learned_addr learned my addr 172.21.15.167:0/4003290387 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f866657d640 1 -- 172.21.15.167:0/4003290387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56551796a390 con 0x5655177ea2a0 2024-09-18T02:04:18.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f866657d640 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x565517969e50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f865801b380 tx=0x7f86580180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8552e05640 1 -- 172.21.15.167:0/4003290387 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580bd6a0 con 0x5655177ea2a0 2024-09-18T02:04:18.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8552e05640 1 -- 172.21.15.167:0/4003290387 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86580cc070 con 0x5655177ea2a0 2024-09-18T02:04:18.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56551796a620 con 0x5655177ea2a0 2024-09-18T02:04:18.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.416+0000 7f8552e05640 1 -- 172.21.15.167:0/4003290387 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580bd970 con 0x5655177ea2a0 2024-09-18T02:04:18.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56551796d300 con 0x5655177ea2a0 2024-09-18T02:04:18.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8552e05640 1 -- 172.21.15.167:0/4003290387 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86580bdb10 con 0x5655177ea2a0 2024-09-18T02:04:18.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8552e05640 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f854c0346f0 0x7f854c036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8552e05640 1 -- 172.21.15.167:0/4003290387 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f86580e5470 con 0x5655177ea2a0 2024-09-18T02:04:18.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8665d7c640 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f854c0346f0 0x7f854c036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56551787acf0 0x565517970e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565517971490 con 0x56551787acf0 2024-09-18T02:04:18.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8666d7e640 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56551787acf0 0x565517970e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8665d7c640 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f854c0346f0 0x7f854c036bb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f865c000f70 tx=0x7f865c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8666d7e640 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56551787acf0 0x565517970e20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8666d7e640 1 -- 172.21.15.167:0/4003290387 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x56551787acf0 2024-09-18T02:04:18.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56551796e500 con 0x56551787acf0 2024-09-18T02:04:18.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8666d7e640 1 -- 172.21.15.167:0/4003290387 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f866000a4d0 con 0x56551787acf0 2024-09-18T02:04:18.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5655179737c0 0x565517975bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565517976280 con 0x5655179737c0 2024-09-18T02:04:18.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f866657d640 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5655179737c0 0x565517975bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.420+0000 7f866657d640 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5655179737c0 0x565517975bb0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f866657d640 1 -- 172.21.15.167:0/4003290387 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f86580c6d20 con 0x5655179737c0 2024-09-18T02:04:18.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565517972630 con 0x56551787acf0 2024-09-18T02:04:18.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f8666d7e640 1 -- 172.21.15.167:0/4003290387 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f866000a4d0 con 0x56551787acf0 2024-09-18T02:04:18.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5655179776e0 0x565517979ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56551797a1c0 con 0x5655179776e0 2024-09-18T02:04:18.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f8665d7c640 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5655179776e0 0x565517979ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f8665d7c640 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5655179776e0 0x565517979ad0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f8665d7c640 1 -- 172.21.15.167:0/4003290387 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f865c00f6a0 con 0x5655179776e0 2024-09-18T02:04:18.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f8668a6d980 1 Processor -- start 2024-09-18T02:04:18.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f8668a6d980 1 -- start start 2024-09-18T02:04:18.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f8668a6d980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517987c70 0x565517988090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f8668a6d980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56551777c800 con 0x565517987c70 2024-09-18T02:04:18.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f866657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517987c70 0x565517988090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f866657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517987c70 0x565517988090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56390/0 (socket says 172.21.15.167:56390) 2024-09-18T02:04:18.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f866657d640 1 -- 172.21.15.167:0/2428674614 learned_addr learned my addr 172.21.15.167:0/2428674614 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f866657d640 1 -- 172.21.15.167:0/2428674614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655179885d0 con 0x565517987c70 2024-09-18T02:04:18.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.424+0000 7f866657d640 1 --2- 172.21.15.167:0/2428674614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517987c70 0x565517988090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f86580e3a40 tx=0x7f86580b3620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f854bfff640 1 -- 172.21.15.167:0/2428674614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580e3d00 con 0x565517987c70 2024-09-18T02:04:18.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f854bfff640 1 -- 172.21.15.167:0/2428674614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86580e9070 con 0x565517987c70 2024-09-18T02:04:18.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f8668a6d980 1 -- 172.21.15.167:0/2428674614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565517988860 con 0x565517987c70 2024-09-18T02:04:18.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f854bfff640 1 -- 172.21.15.167:0/2428674614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580bc9c0 con 0x565517987c70 2024-09-18T02:04:18.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f8668a6d980 1 -- 172.21.15.167:0/2428674614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56551798b4e0 con 0x565517987c70 2024-09-18T02:04:18.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f854bfff640 1 -- 172.21.15.167:0/2428674614 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86580bcb60 con 0x565517987c70 2024-09-18T02:04:18.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f854bfff640 1 --2- 172.21.15.167:0/2428674614 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8540034650 0x7f8540036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f854bfff640 1 -- 172.21.15.167:0/2428674614 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f86580efb10 con 0x565517987c70 2024-09-18T02:04:18.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f8665d7c640 1 --2- 172.21.15.167:0/2428674614 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8540034650 0x7f8540036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f8668a6d980 1 Processor -- start 2024-09-18T02:04:18.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f8668a6d980 1 -- start start 2024-09-18T02:04:18.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f8665d7c640 1 --2- 172.21.15.167:0/2428674614 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8540034650 0x7f8540036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x565517971d70 tx=0x7f865c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f8668a6d980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x565517994a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f8668a6d980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x565517963510 con 0x565517994600 2024-09-18T02:04:18.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f866657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x565517994a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f866657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x565517994a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56404/0 (socket says 172.21.15.167:56404) 2024-09-18T02:04:18.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f866657d640 1 -- 172.21.15.167:0/1518608773 learned_addr learned my addr 172.21.15.167:0/1518608773 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f866657d640 1 -- 172.21.15.167:0/1518608773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565517994fd0 con 0x565517994600 2024-09-18T02:04:18.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f866657d640 1 --2- 172.21.15.167:0/1518608773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x565517994a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f86580eafd0 tx=0x7f86580eff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c494a6746428d3a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f8549ffb640 1 -- 172.21.15.167:0/1518608773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580f3030 con 0x565517994600 2024-09-18T02:04:18.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f8549ffb640 1 -- 172.21.15.167:0/1518608773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8658002d90 con 0x565517994600 2024-09-18T02:04:18.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.428+0000 7f8549ffb640 1 -- 172.21.15.167:0/1518608773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580bf740 con 0x565517994600 2024-09-18T02:04:18.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 -- 172.21.15.167:0/1518608773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 msgr2=0x565517994a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 --2- 172.21.15.167:0/1518608773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x565517994a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f86580eafd0 tx=0x7f86580eff30 comp rx=0 tx=0).stop 2024-09-18T02:04:18.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 -- 172.21.15.167:0/1518608773 shutdown_connections 2024-09-18T02:04:18.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 --2- 172.21.15.167:0/1518608773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x565517994a00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 -- 172.21.15.167:0/1518608773 >> 172.21.15.167:0/1518608773 conn(0x5655179909e0 msgr2=0x56551798eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 -- 172.21.15.167:0/1518608773 shutdown_connections 2024-09-18T02:04:18.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 -- 172.21.15.167:0/1518608773 wait complete. 2024-09-18T02:04:18.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 Processor -- start 2024-09-18T02:04:18.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 -- start start 2024-09-18T02:04:18.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x56551799b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5655179953f0 con 0x565517994600 2024-09-18T02:04:18.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f866657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x56551799b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f866657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x56551799b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56406/0 (socket says 172.21.15.167:56406) 2024-09-18T02:04:18.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 learned_addr learned my addr 172.21.15.167:0/4078523575 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56551799bd20 con 0x565517994600 2024-09-18T02:04:18.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f866657d640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x56551799b7e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86580e3ff0 tx=0x7f86580adf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8537fff640 1 -- 172.21.15.167:0/4078523575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580cfe50 con 0x565517994600 2024-09-18T02:04:18.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56551799bd20 con 0x565517994600 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56551799bd20 con 0x565517994600 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8537fff640 1 -- 172.21.15.167:0/4078523575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8658112070 con 0x565517994600 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8537fff640 1 -- 172.21.15.167:0/4078523575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86580c76f0 con 0x565517994600 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8537fff640 1 -- 172.21.15.167:0/4078523575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86580c7890 con 0x565517994600 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8537fff640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f85300347f0 0x7f8530036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8537fff640 1 -- 172.21.15.167:0/4078523575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f86580fe030 con 0x565517994600 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8665d7c640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f85300347f0 0x7f8530036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5655179a66c0 0x5655179a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179a92d0 con 0x5655179a66c0 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.432+0000 7f8666d7e640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5655179a66c0 0x5655179a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8665d7c640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f85300347f0 0x7f8530036cb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c010 tx=0x7f865c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8666d7e640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5655179a66c0 0x5655179a8b80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 20 realm 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179a96e0 con 0x5655179a66c0 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179a9fb0 con 0x5655179a66c0 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179a66c0 2024-09-18T02:04:18.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5655179ab0b0 0x5655179ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179adab0 con 0x5655179ab0b0 2024-09-18T02:04:18.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f866657d640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5655179ab0b0 0x5655179ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f866657d640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5655179ab0b0 0x5655179ad4a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:18.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 20 searching for the correct realm 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5655179afa00 0x5655179b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179b24c0 con 0x5655179afa00 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8665d7c640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5655179afa00 0x5655179b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8665d7c640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5655179afa00 0x5655179b1df0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8665d7c640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f865c01fbe0 0x7f865c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179b24c0 con 0x7f865c01fbe0 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.436+0000 7f8666d7e640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f865c01fbe0 0x7f865c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8666d7e640 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f865c01fbe0 0x7f865c03a3c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179ab0b0 2024-09-18T02:04:18.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179a66c0 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179a66c0 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179ab0b0 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179ab0b0 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x7f865c01fbe0 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179afa00 2024-09-18T02:04:18.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179a66c0 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179ab0b0 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.440+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179a66c0 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x7f865c01fbe0 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179afa00 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179afa00 2024-09-18T02:04:18.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179ab0b0 2024-09-18T02:04:18.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179afa00 2024-09-18T02:04:18.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179afa00 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179a66c0 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179a66c0 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179ab0b0 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179afa00 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x7f865c01fbe0 2024-09-18T02:04:18.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.444+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179a66c0 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179ab0b0 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179afa00 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179ab0b0 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x7f865c01fbe0 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179afa00 2024-09-18T02:04:18.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179ab0b0 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x5655179a66c0 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5655179aa350 con 0x7f865c01fbe0 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8668a6d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8668a6d980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8668a6d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8668a6d980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8668a6d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8668a6d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:18.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.448+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179ae370 con 0x5655179a66c0 2024-09-18T02:04:18.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179ae370 con 0x5655179a66c0 2024-09-18T02:04:18.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179ae370 con 0x5655179afa00 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 zone default found 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 4 Realm: () 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 zonegroup default 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179aede0 con 0x5655179ab0b0 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179b47d0 con 0x5655179afa00 2024-09-18T02:04:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179b4b70 con 0x5655179afa00 2024-09-18T02:04:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 started sync module instance, tier type = 2024-09-18T02:04:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:18.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b3c10 con 0x7f865c01fbe0 2024-09-18T02:04:18.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94923468259376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b3c10 con 0x7f865c01fbe0 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.452+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b53c0 con 0x5655179a66c0 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.456+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94923468259376] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.456+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.456+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94923468263456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b3c10 con 0x5655179a66c0 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.456+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b5dd0 con 0x5655179afa00 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.456+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94923468263456] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.456+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.456+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94923468257120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b3b80 con 0x5655179afa00 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.456+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b6ad0 con 0x7f865c01fbe0 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.460+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.460+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94923468269392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b7370 con 0x7f865c01fbe0 2024-09-18T02:04:18.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.460+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b7d30 con 0x5655179a66c0 2024-09-18T02:04:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.460+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94923468257120] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.460+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94923468269392] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.460+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.460+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94923468273792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b7320 con 0x5655179a66c0 2024-09-18T02:04:18.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.460+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b7ca0 con 0x5655179ab0b0 2024-09-18T02:04:18.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.464+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.464+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94923468276000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b89f0 con 0x5655179ab0b0 2024-09-18T02:04:18.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.464+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b93b0 con 0x5655179ab0b0 2024-09-18T02:04:18.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.464+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94923468273792] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.464+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.464+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94923468276000] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.464+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94923468271216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b8f00 con 0x5655179ab0b0 2024-09-18T02:04:18.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.464+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b98c0 con 0x5655179ab0b0 2024-09-18T02:04:18.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94923468271216] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94923468277056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b98c0 con 0x5655179ab0b0 2024-09-18T02:04:18.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 20 add_watcher() i=0 2024-09-18T02:04:18.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 20 add_watcher() i=1 2024-09-18T02:04:18.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 20 add_watcher() i=2 2024-09-18T02:04:18.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 20 add_watcher() i=3 2024-09-18T02:04:18.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 20 add_watcher() i=4 2024-09-18T02:04:18.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 20 add_watcher() i=5 2024-09-18T02:04:18.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 20 add_watcher() i=6 2024-09-18T02:04:18.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94923468277056] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 20 add_watcher() i=7 2024-09-18T02:04:18.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:18.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179bcbe0 con 0x5655179a66c0 2024-09-18T02:04:18.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.468+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94923468281216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b9e50 con 0x5655179a66c0 2024-09-18T02:04:18.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94923468281216] v30'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f851cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:18.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:18.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:18.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 5 note: GC not initialized 2024-09-18T02:04:18.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f84977fe640 20 reqs_thread_entry: start 2024-09-18T02:04:18.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:18.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 20 Filter name: none 2024-09-18T02:04:18.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f84957fa640 20 reqs_thread_entry: start 2024-09-18T02:04:18.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:18.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179e02d0 con 0x5655179a66c0 2024-09-18T02:04:18.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:18.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:18.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:18.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:18.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179e0d40 con 0x5655179a66c0 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179e6710 con 0x5655179a66c0 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v30'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:18.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:18.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94923468464512 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179e1d50 con 0x5655179a66c0 2024-09-18T02:04:18.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== watch-notify(notify (1) cookie 94923468273792 notify 128849018885 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f8660026780 con 0x5655179a66c0 2024-09-18T02:04:18.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8549ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94923468273792 notifier 4368 bl.length()=732 2024-09-18T02:04:18.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8549ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:18.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8549ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:18.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(65 notify.4 [notify cookie 94923468464512 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8549ffb640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f852c003eb0 con 0x5655179a66c0 2024-09-18T02:04:18.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== watch-notify(notify_complete (2) cookie 94923468464512 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8660018d50 con 0x5655179a66c0 2024-09-18T02:04:18.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.472+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179e6180 con 0x5655179a66c0 2024-09-18T02:04:18.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8668a6d980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-18T02:04:18.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8668a6d980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-18T02:04:18.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8668a6d980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-18T02:04:18.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94923468464512 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5655179e18a0 con 0x7f865c01fbe0 2024-09-18T02:04:18.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== watch-notify(notify (1) cookie 94923468259376 notify 128849018882 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f8660018d50 con 0x7f865c01fbe0 2024-09-18T02:04:18.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8549ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94923468259376 notifier 4368 bl.length()=166 2024-09-18T02:04:18.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8549ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-18T02:04:18.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8549ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-18T02:04:18.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(68 notify.0 [notify cookie 94923468464512 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8549ffb640 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f852c003eb0 con 0x7f865c01fbe0 2024-09-18T02:04:18.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== watch-notify(notify_complete (2) cookie 94923468464512 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8660026a20 con 0x7f865c01fbe0 2024-09-18T02:04:18.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.482 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"aWwAhZdZtzviMIqHe9Cu2psairOMRw3B2ReCPTvR","active":true,"create_date":"2024-09-18T02:04:18.474649Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:18.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f851cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:18.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94923468281216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179de100 con 0x5655179a66c0 2024-09-18T02:04:18.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94923468281216] v30'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.476+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94923468259376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179de100 con 0x7f865c01fbe0 2024-09-18T02:04:18.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.480+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94923468259376] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.480+0000 7f8668a6d980 20 remove_watcher() i=0 2024-09-18T02:04:18.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.480+0000 7f8668a6d980 2 removed watcher, disabling cache 2024-09-18T02:04:18.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.480+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94923468263456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179de100 con 0x5655179a66c0 2024-09-18T02:04:18.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.480+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94923468263456] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.480+0000 7f8668a6d980 20 remove_watcher() i=1 2024-09-18T02:04:18.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.480+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94923468257120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179de100 con 0x5655179afa00 2024-09-18T02:04:18.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.484+0000 7f8665d7c640 1 -- 172.21.15.167:0/4078523575 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94923468257120] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f865c037040 con 0x5655179afa00 2024-09-18T02:04:18.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.484+0000 7f8668a6d980 20 remove_watcher() i=2 2024-09-18T02:04:18.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.484+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94923468269392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b3760 con 0x7f865c01fbe0 2024-09-18T02:04:18.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.484+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94923468269392] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x7f865c01fbe0 2024-09-18T02:04:18.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.484+0000 7f8668a6d980 20 remove_watcher() i=3 2024-09-18T02:04:18.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.484+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94923468273792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b3760 con 0x5655179a66c0 2024-09-18T02:04:18.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.484+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94923468273792] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866000a4d0 con 0x5655179a66c0 2024-09-18T02:04:18.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.484+0000 7f8668a6d980 20 remove_watcher() i=4 2024-09-18T02:04:18.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.484+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94923468276000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b7880 con 0x5655179ab0b0 2024-09-18T02:04:18.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.488+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94923468276000] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.488+0000 7f8668a6d980 20 remove_watcher() i=5 2024-09-18T02:04:18.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.488+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94923468271216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b3760 con 0x5655179ab0b0 2024-09-18T02:04:18.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.488+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94923468271216] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.488+0000 7f8668a6d980 20 remove_watcher() i=6 2024-09-18T02:04:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.488+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94923468277056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5655179b8120 con 0x5655179ab0b0 2024-09-18T02:04:18.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f866657d640 1 -- 172.21.15.167:0/4078523575 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94923468277056] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86580f5070 con 0x5655179ab0b0 2024-09-18T02:04:18.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 20 remove_watcher() i=7 2024-09-18T02:04:18.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5655179ab0b0 msgr2=0x5655179ad4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5655179ab0b0 0x5655179ad4a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5655179a66c0 msgr2=0x5655179a8b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5655179a66c0 0x5655179a8b80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f865c01fbe0 msgr2=0x7f865c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f865c01fbe0 0x7f865c03a3c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5655179afa00 msgr2=0x5655179b1df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5655179afa00 0x5655179b1df0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f85300347f0 msgr2=0x7f8530036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f85300347f0 0x7f8530036cb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c010 tx=0x7f865c010000 comp rx=0 tx=0).stop 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8666d7e640 1 -- 172.21.15.167:0/4078523575 reap_dead start 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 msgr2=0x56551799b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x56551799b7e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86580e3ff0 tx=0x7f86580adf00 comp rx=0 tx=0).stop 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 shutdown_connections 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4078523575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517994600 0x56551799b7e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 >> 172.21.15.167:0/4078523575 conn(0x5655179909e0 msgr2=0x56551798eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 shutdown_connections 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4078523575 wait complete. 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/2428674614 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8540034650 msgr2=0x7f8540036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/2428674614 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8540034650 0x7f8540036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x565517971d70 tx=0x7f865c00f000 comp rx=0 tx=0).stop 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/2428674614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517987c70 msgr2=0x565517988090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/2428674614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517987c70 0x565517988090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f86580e3a40 tx=0x7f86580b3620 comp rx=0 tx=0).stop 2024-09-18T02:04:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/2428674614 shutdown_connections 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/2428674614 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8540034650 0x7f8540036b10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/2428674614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565517987c70 0x565517988090 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/2428674614 >> 172.21.15.167:0/2428674614 conn(0x56551797cdc0 msgr2=0x56551797f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/2428674614 shutdown_connections 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/2428674614 wait complete. 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5655179737c0 msgr2=0x565517975bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5655179737c0 0x565517975bb0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56551787acf0 msgr2=0x565517970e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56551787acf0 0x565517970e20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5655179776e0 msgr2=0x565517979ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5655179776e0 0x565517979ad0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f854c0346f0 msgr2=0x7f854c036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f854c0346f0 0x7f854c036bb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f865c000f70 tx=0x7f865c001380 comp rx=0 tx=0).stop 2024-09-18T02:04:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 msgr2=0x565517969e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 --2- 172.21.15.167:0/4003290387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5655177ea2a0 0x565517969e50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f865801b380 tx=0x7f86580180e0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8666d7e640 1 -- 172.21.15.167:0/4003290387 reap_dead start 2024-09-18T02:04:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 shutdown_connections 2024-09-18T02:04:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 >> 172.21.15.167:0/4003290387 conn(0x5655178700a0 msgr2=0x56551795d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 shutdown_connections 2024-09-18T02:04:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.492+0000 7f8668a6d980 1 -- 172.21.15.167:0/4003290387 wait complete. 2024-09-18T02:04:18.505 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'aWwAhZdZtzviMIqHe9Cu2psairOMRw3B2ReCPTvR', 'active': True, 'create_date': '2024-09-18T02:04:18.474649Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:18.505 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-18T02:04:18.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-18T02:04:18.505 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-18T02:04:18.576 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:18.576 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:18.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.572+0000 7f2040ccb980 1 Processor -- start 2024-09-18T02:04:18.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.572+0000 7f2040ccb980 1 -- start start 2024-09-18T02:04:18.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.572+0000 7f2040ccb980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5608a011e9b0 0x5608a0120da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.572+0000 7f2040ccb980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56089ffa2ae0 con 0x5608a011a630 2024-09-18T02:04:18.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.572+0000 7f2040ccb980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x56089ffc6e30 con 0x5608a011e9b0 2024-09-18T02:04:18.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f203dfda640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5608a011e9b0 0x5608a0120da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f203e7db640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5608a011a630 0x5608a011aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55484/0 (socket says 172.21.15.167:55484) 2024-09-18T02:04:18.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f203dfda640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5608a011e9b0 0x5608a0120da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56422/0 (socket says 172.21.15.167:56422) 2024-09-18T02:04:18.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f203e7db640 1 -- 172.21.15.167:0/3595184499 learned_addr learned my addr 172.21.15.167:0/3595184499 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:18.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f203dfda640 1 -- 172.21.15.167:0/3595184499 >> v1:172.21.15.81:6789/0 conn(0x5608a011a630 legacy=0x5608a011aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f203dfda640 1 -- 172.21.15.167:0/3595184499 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608a01222f0 con 0x5608a011e9b0 2024-09-18T02:04:18.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f203dfda640 1 --2- 172.21.15.167:0/3595184499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011e9b0 0x5608a0120da0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f203400a480 tx=0x7f203401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd97e96c2a752e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f203d7d9640 1 -- 172.21.15.167:0/3595184499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20340b0070 con 0x5608a011e9b0 2024-09-18T02:04:18.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f203d7d9640 1 -- 172.21.15.167:0/3595184499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20340ab540 con 0x5608a011e9b0 2024-09-18T02:04:18.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f203d7d9640 1 -- 172.21.15.167:0/3595184499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20340ab840 con 0x5608a011e9b0 2024-09-18T02:04:18.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f2040ccb980 1 -- 172.21.15.167:0/3595184499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011e9b0 msgr2=0x5608a0120da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f2040ccb980 1 --2- 172.21.15.167:0/3595184499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011e9b0 0x5608a0120da0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f203400a480 tx=0x7f203401b280 comp rx=0 tx=0).stop 2024-09-18T02:04:18.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f2040ccb980 1 -- 172.21.15.167:0/3595184499 shutdown_connections 2024-09-18T02:04:18.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f2040ccb980 1 --2- 172.21.15.167:0/3595184499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011e9b0 0x5608a0120da0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f2040ccb980 1 -- 172.21.15.167:0/3595184499 >> 172.21.15.167:0/3595184499 conn(0x5608a0116150 msgr2=0x5608a0118570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f2040ccb980 1 -- 172.21.15.167:0/3595184499 shutdown_connections 2024-09-18T02:04:18.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.576+0000 7f2040ccb980 1 -- 172.21.15.167:0/3595184499 wait complete. 2024-09-18T02:04:18.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 Processor -- start 2024-09-18T02:04:18.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 -- start start 2024-09-18T02:04:18.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 0x5608a0205a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56089ffc8200 con 0x5608a011a630 2024-09-18T02:04:18.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f203e7db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 0x5608a0205a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f203e7db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 0x5608a0205a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56430/0 (socket says 172.21.15.167:56430) 2024-09-18T02:04:18.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f203e7db640 1 -- 172.21.15.167:0/3640119712 learned_addr learned my addr 172.21.15.167:0/3640119712 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f203e7db640 1 -- 172.21.15.167:0/3640119712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608a0206020 con 0x5608a011a630 2024-09-18T02:04:18.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f203e7db640 1 --2- 172.21.15.167:0/3640119712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 0x5608a0205a50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f20380015f0 tx=0x7f2038001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0090cfae476a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f1f2c608640 1 -- 172.21.15.167:0/3640119712 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2038004530 con 0x5608a011a630 2024-09-18T02:04:18.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f1f2c608640 1 -- 172.21.15.167:0/3640119712 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20380046f0 con 0x5608a011a630 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f1f2c608640 1 -- 172.21.15.167:0/3640119712 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2038004a90 con 0x5608a011a630 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 -- 172.21.15.167:0/3640119712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 msgr2=0x5608a0205a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 --2- 172.21.15.167:0/3640119712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 0x5608a0205a50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f20380015f0 tx=0x7f2038001ab0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 -- 172.21.15.167:0/3640119712 shutdown_connections 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 --2- 172.21.15.167:0/3640119712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 0x5608a0205a50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 -- 172.21.15.167:0/3640119712 >> 172.21.15.167:0/3640119712 conn(0x5608a0116150 msgr2=0x5608a0201680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 -- 172.21.15.167:0/3640119712 shutdown_connections 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 -- 172.21.15.167:0/3640119712 wait complete. 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 Processor -- start 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 -- start start 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 0x5608a020ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.592+0000 7f2040ccb980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5608a0121df0 con 0x5608a011a630 2024-09-18T02:04:18.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f203e7db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 0x5608a020ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f203e7db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 0x5608a020ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56436/0 (socket says 172.21.15.167:56436) 2024-09-18T02:04:18.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f203e7db640 1 -- 172.21.15.167:0/1555994513 learned_addr learned my addr 172.21.15.167:0/1555994513 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f203e7db640 1 -- 172.21.15.167:0/1555994513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608a020d360 con 0x5608a011a630 2024-09-18T02:04:18.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f203e7db640 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 0x5608a020ce20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5608a0206c30 tx=0x7f2038000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f1f2ae05640 1 -- 172.21.15.167:0/1555994513 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2038013760 con 0x5608a011a630 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f1f2ae05640 1 -- 172.21.15.167:0/1555994513 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2038013900 con 0x5608a011a630 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608a020d5f0 con 0x5608a011a630 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f1f2ae05640 1 -- 172.21.15.167:0/1555994513 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2038013be0 con 0x5608a011a630 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608a02102d0 con 0x5608a011a630 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f1f2ae05640 1 -- 172.21.15.167:0/1555994513 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2038010070 con 0x5608a011a630 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f1f2ae05640 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f240346a0 0x7f1f24036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f1f2ae05640 1 -- 172.21.15.167:0/1555994513 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2038018070 con 0x5608a011a630 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f203dfda640 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f240346a0 0x7f1f24036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f2040ccb980 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5608a011e9b0 0x5608a0213db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a0214400 con 0x5608a011e9b0 2024-09-18T02:04:18.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f203efdc640 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5608a011e9b0 0x5608a0213db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f203dfda640 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f240346a0 0x7f1f24036b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20340ad000 tx=0x7f20340a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f203efdc640 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5608a011e9b0 0x5608a0213db0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f203efdc640 1 -- 172.21.15.167:0/1555994513 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20300083f0 con 0x5608a011e9b0 2024-09-18T02:04:18.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a02114f0 con 0x5608a011e9b0 2024-09-18T02:04:18.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f203efdc640 1 -- 172.21.15.167:0/1555994513 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20300083f0 con 0x5608a011e9b0 2024-09-18T02:04:18.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.596+0000 7f2040ccb980 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5608a02167a0 0x5608a0218b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a0219260 con 0x5608a02167a0 2024-09-18T02:04:18.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f203e7db640 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5608a02167a0 0x5608a0218b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f203e7db640 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5608a02167a0 0x5608a0218b90 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f203e7db640 1 -- 172.21.15.167:0/1555994513 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f203801b030 con 0x5608a02167a0 2024-09-18T02:04:18.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a0215610 con 0x5608a011e9b0 2024-09-18T02:04:18.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f203efdc640 1 -- 172.21.15.167:0/1555994513 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20300083f0 con 0x5608a011e9b0 2024-09-18T02:04:18.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f2040ccb980 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5608a021a6a0 0x5608a021ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a021d200 con 0x5608a021a6a0 2024-09-18T02:04:18.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f203dfda640 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5608a021a6a0 0x5608a021ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f203dfda640 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5608a021a6a0 0x5608a021ca90 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f203dfda640 1 -- 172.21.15.167:0/1555994513 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20340b3040 con 0x5608a021a6a0 2024-09-18T02:04:18.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f2040ccb980 1 Processor -- start 2024-09-18T02:04:18.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f2040ccb980 1 -- start start 2024-09-18T02:04:18.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f2040ccb980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a0091530 0x5608a008fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f2040ccb980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5608a0021800 con 0x5608a0091530 2024-09-18T02:04:18.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f203e7db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a0091530 0x5608a008fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f203e7db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a0091530 0x5608a008fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56452/0 (socket says 172.21.15.167:56452) 2024-09-18T02:04:18.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.600+0000 7f203e7db640 1 -- 172.21.15.167:0/3807522005 learned_addr learned my addr 172.21.15.167:0/3807522005 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f203e7db640 1 -- 172.21.15.167:0/3807522005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608a0091950 con 0x5608a0091530 2024-09-18T02:04:18.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f203e7db640 1 --2- 172.21.15.167:0/3807522005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a0091530 0x5608a008fbb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f20380333f0 tx=0x7f2038029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f1f23fff640 1 -- 172.21.15.167:0/3807522005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2038029970 con 0x5608a0091530 2024-09-18T02:04:18.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f1f23fff640 1 -- 172.21.15.167:0/3807522005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20380128f0 con 0x5608a0091530 2024-09-18T02:04:18.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f2040ccb980 1 -- 172.21.15.167:0/3807522005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608a0090150 con 0x5608a0091530 2024-09-18T02:04:18.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f1f23fff640 1 -- 172.21.15.167:0/3807522005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2038010dc0 con 0x5608a0091530 2024-09-18T02:04:18.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f2040ccb980 1 -- 172.21.15.167:0/3807522005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608a0090620 con 0x5608a0091530 2024-09-18T02:04:18.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f1f23fff640 1 -- 172.21.15.167:0/3807522005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2038033810 con 0x5608a0091530 2024-09-18T02:04:18.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f1f23fff640 1 --2- 172.21.15.167:0/3807522005 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f18034740 0x7f1f18036c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f1f23fff640 1 -- 172.21.15.167:0/3807522005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f203803fb10 con 0x5608a0091530 2024-09-18T02:04:18.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f203dfda640 1 --2- 172.21.15.167:0/3807522005 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f18034740 0x7f1f18036c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f2040ccb980 1 Processor -- start 2024-09-18T02:04:18.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f2040ccb980 1 -- start start 2024-09-18T02:04:18.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f203dfda640 1 --2- 172.21.15.167:0/3807522005 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f18034740 0x7f1f18036c00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5608a0214970 tx=0x7f2034005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f2040ccb980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 0x5608a0239af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f2040ccb980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5608a02063a0 con 0x5608a02396f0 2024-09-18T02:04:18.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f203e7db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 0x5608a0239af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f203e7db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 0x5608a0239af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56468/0 (socket says 172.21.15.167:56468) 2024-09-18T02:04:18.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f203e7db640 1 -- 172.21.15.167:0/661127197 learned_addr learned my addr 172.21.15.167:0/661127197 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.604+0000 7f203e7db640 1 -- 172.21.15.167:0/661127197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608a023a0c0 con 0x5608a02396f0 2024-09-18T02:04:18.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f203e7db640 1 --2- 172.21.15.167:0/661127197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 0x5608a0239af0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f20380046c0 tx=0x7f2038051e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307751b3114ef90 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f1f21ffb640 1 -- 172.21.15.167:0/661127197 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20380523f0 con 0x5608a02396f0 2024-09-18T02:04:18.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f1f21ffb640 1 -- 172.21.15.167:0/661127197 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2038028d10 con 0x5608a02396f0 2024-09-18T02:04:18.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f1f21ffb640 1 -- 172.21.15.167:0/661127197 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20380287f0 con 0x5608a02396f0 2024-09-18T02:04:18.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 -- 172.21.15.167:0/661127197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 msgr2=0x5608a0239af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 --2- 172.21.15.167:0/661127197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 0x5608a0239af0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f20380046c0 tx=0x7f2038051e80 comp rx=0 tx=0).stop 2024-09-18T02:04:18.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 -- 172.21.15.167:0/661127197 shutdown_connections 2024-09-18T02:04:18.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 --2- 172.21.15.167:0/661127197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 0x5608a0239af0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 -- 172.21.15.167:0/661127197 >> 172.21.15.167:0/661127197 conn(0x5608a0235b20 msgr2=0x5608a0233c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 -- 172.21.15.167:0/661127197 shutdown_connections 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 -- 172.21.15.167:0/661127197 wait complete. 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 Processor -- start 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 -- start start 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 0x5608a02408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5608a023a590 con 0x5608a02396f0 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f203e7db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 0x5608a02408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f203e7db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 0x5608a02408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56484/0 (socket says 172.21.15.167:56484) 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 learned_addr learned my addr 172.21.15.167:0/836285251 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608a0240e30 con 0x5608a02396f0 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f203e7db640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 0x5608a02408f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2038001340 tx=0x7f20380340a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f1f0ffff640 1 -- 172.21.15.167:0/836285251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f203806b070 con 0x5608a02396f0 2024-09-18T02:04:18.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608a0240e30 con 0x5608a02396f0 2024-09-18T02:04:18.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f1f0ffff640 1 -- 172.21.15.167:0/836285251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2038011e30 con 0x5608a02396f0 2024-09-18T02:04:18.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608a0240e30 con 0x5608a02396f0 2024-09-18T02:04:18.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.608+0000 7f1f0ffff640 1 -- 172.21.15.167:0/836285251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2038033d10 con 0x5608a02396f0 2024-09-18T02:04:18.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f1f0ffff640 1 -- 172.21.15.167:0/836285251 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2038064040 con 0x5608a02396f0 2024-09-18T02:04:18.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f1f0ffff640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f08034650 0x7f1f08036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f1f0ffff640 1 -- 172.21.15.167:0/836285251 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2038059070 con 0x5608a02396f0 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f203dfda640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f08034650 0x7f1f08036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5608a024b9d0 0x5608a024de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a024e5e0 con 0x5608a024b9d0 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f203efdc640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5608a024b9d0 0x5608a024de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f203dfda640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f08034650 0x7f1f08036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2034018eb0 tx=0x7f20340b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f203efdc640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5608a024b9d0 0x5608a024de90 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20300083f0 con 0x5608a024b9d0 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 20 realm 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a024ea40 con 0x5608a024b9d0 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20300083f0 con 0x5608a024b9d0 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f2e0 con 0x5608a024b9d0 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20300083f0 con 0x5608a024b9d0 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a024b9d0 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20300083f0 con 0x5608a024b9d0 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5608a02503e0 0x5608a02527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a0252e70 con 0x5608a02503e0 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f203e7db640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5608a02503e0 0x5608a02527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.612+0000 7f203e7db640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5608a02503e0 0x5608a02527d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f2040ccb980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f2040ccb980 20 searching for the correct realm 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f2040ccb980 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5608a0254d50 0x5608a0257140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a02577a0 con 0x5608a0254d50 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203dfda640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5608a0254d50 0x5608a0257140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203dfda640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5608a0254d50 0x5608a0257140 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203dfda640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f20340dc040 0x7f20340dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a02577a0 con 0x7f20340dc040 2024-09-18T02:04:18.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203efdc640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f20340dc040 0x7f20340dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203efdc640 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f20340dc040 0x7f20340dd430 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20300083f0 con 0x7f20340dc040 2024-09-18T02:04:18.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a02503e0 2024-09-18T02:04:18.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a024b9d0 2024-09-18T02:04:18.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20300083f0 con 0x5608a024b9d0 2024-09-18T02:04:18.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a024b9d0 2024-09-18T02:04:18.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a02503e0 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.616+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a02503e0 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x7f20340dc040 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2030026040 con 0x7f20340dc040 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a0254d50 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a024b9d0 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a02503e0 2024-09-18T02:04:18.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a024b9d0 2024-09-18T02:04:18.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x7f20340dc040 2024-09-18T02:04:18.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2030026040 con 0x7f20340dc040 2024-09-18T02:04:18.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a0254d50 2024-09-18T02:04:18.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a0254d50 2024-09-18T02:04:18.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a02503e0 2024-09-18T02:04:18.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a0254d50 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.620+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a0254d50 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a024b9d0 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a024b9d0 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a02503e0 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a0254d50 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x7f20340dc040 2024-09-18T02:04:18.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2030026040 con 0x7f20340dc040 2024-09-18T02:04:18.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a024b9d0 2024-09-18T02:04:18.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a02503e0 2024-09-18T02:04:18.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a0254d50 2024-09-18T02:04:18.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a02503e0 2024-09-18T02:04:18.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x7f20340dc040 2024-09-18T02:04:18.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2030026040 con 0x7f20340dc040 2024-09-18T02:04:18.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a0254d50 2024-09-18T02:04:18.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.624+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a02503e0 2024-09-18T02:04:18.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x5608a024b9d0 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608a024f680 con 0x7f20340dc040 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2030026040 con 0x7f20340dc040 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a02536c0 con 0x5608a024b9d0 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a02536c0 con 0x5608a024b9d0 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a02536c0 con 0x5608a0254d50 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 zone default found 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 4 Realm: () 2024-09-18T02:04:18.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 zonegroup default 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a0254090 con 0x5608a02503e0 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a0253bf0 con 0x5608a0254d50 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a0259b50 con 0x5608a0254d50 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 started sync module instance, tier type = 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.628+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a0258f40 con 0x7f20340dc040 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.632+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x7f20340dc040 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.632+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94595046544480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a0258f40 con 0x7f20340dc040 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.632+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025a610 con 0x5608a024b9d0 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.632+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94595046544480] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x7f20340dc040 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.632+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.632+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94595046547712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a0258f40 con 0x5608a024b9d0 2024-09-18T02:04:18.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.632+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025b050 con 0x5608a0254d50 2024-09-18T02:04:18.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.632+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94595046547712] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.636+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.636+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94595046541968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a0258eb0 con 0x5608a0254d50 2024-09-18T02:04:18.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.636+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025bde0 con 0x7f20340dc040 2024-09-18T02:04:18.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.636+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x7f20340dc040 2024-09-18T02:04:18.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.636+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94595046553840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025c680 con 0x7f20340dc040 2024-09-18T02:04:18.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.636+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025d080 con 0x5608a024b9d0 2024-09-18T02:04:18.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.636+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94595046553840] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x7f20340dc040 2024-09-18T02:04:18.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.636+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94595046541968] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.636+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.636+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94595046552640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025c150 con 0x5608a024b9d0 2024-09-18T02:04:18.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.636+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025d920 con 0x5608a02503e0 2024-09-18T02:04:18.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.640+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94595046552640] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.640+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.640+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94595046560880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025c150 con 0x5608a02503e0 2024-09-18T02:04:18.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.640+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025e170 con 0x5608a02503e0 2024-09-18T02:04:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.640+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.640+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94595046560880] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.640+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94595046563280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025e6a0 con 0x5608a02503e0 2024-09-18T02:04:18.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.640+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025eef0 con 0x5608a02503e0 2024-09-18T02:04:18.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.644+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.644+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94595046563280] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.644+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94595046566016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025e2f0 con 0x5608a02503e0 2024-09-18T02:04:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.644+0000 7f2040ccb980 20 add_watcher() i=0 2024-09-18T02:04:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.644+0000 7f2040ccb980 20 add_watcher() i=1 2024-09-18T02:04:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.644+0000 7f2040ccb980 20 add_watcher() i=2 2024-09-18T02:04:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.644+0000 7f2040ccb980 20 add_watcher() i=3 2024-09-18T02:04:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.644+0000 7f2040ccb980 20 add_watcher() i=4 2024-09-18T02:04:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.644+0000 7f2040ccb980 20 add_watcher() i=5 2024-09-18T02:04:18.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.644+0000 7f2040ccb980 20 add_watcher() i=6 2024-09-18T02:04:18.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94595046566016] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 20 add_watcher() i=7 2024-09-18T02:04:18.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:18.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a02627a0 con 0x5608a024b9d0 2024-09-18T02:04:18.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94595046568640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025fc00 con 0x5608a024b9d0 2024-09-18T02:04:18.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94595046568640] v30'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f1ef4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:18.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:18.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:18.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 5 note: GC not initialized 2024-09-18T02:04:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f1e6f7fe640 20 reqs_thread_entry: start 2024-09-18T02:04:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 20 Filter name: none 2024-09-18T02:04:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f1e6d7fa640 20 reqs_thread_entry: start 2024-09-18T02:04:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a0285d50 con 0x5608a024b9d0 2024-09-18T02:04:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T02:04:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.648+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a028c4c0 con 0x5608a024b9d0 2024-09-18T02:04:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f2040ccb980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f2040ccb980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f2040ccb980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:18.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94595046752048 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608a0287bf0 con 0x5608a024b9d0 2024-09-18T02:04:18.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94595046552640 notify 128849018886 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f2030010040 con 0x5608a024b9d0 2024-09-18T02:04:18.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f1f21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94595046552640 notifier 4375 bl.length()=732 2024-09-18T02:04:18.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f1f21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:18.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(64 notify.4 [notify cookie 94595046752048 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f1f21ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:18.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f1f21ffb640 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1f04003eb0 con 0x5608a024b9d0 2024-09-18T02:04:18.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94595046752048 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f203002a450 con 0x5608a024b9d0 2024-09-18T02:04:18.656 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:18.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f1ef4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:18.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94595046568640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a0287740 con 0x5608a024b9d0 2024-09-18T02:04:18.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94595046568640] v30'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.652+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94595046544480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a0287bf0 con 0x7f20340dc040 2024-09-18T02:04:18.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.656+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94595046544480] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x7f20340dc040 2024-09-18T02:04:18.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.656+0000 7f2040ccb980 20 remove_watcher() i=0 2024-09-18T02:04:18.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.656+0000 7f2040ccb980 2 removed watcher, disabling cache 2024-09-18T02:04:18.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.656+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94595046547712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a0287bf0 con 0x5608a024b9d0 2024-09-18T02:04:18.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.656+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94595046547712] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.656+0000 7f2040ccb980 20 remove_watcher() i=1 2024-09-18T02:04:18.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.656+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94595046541968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025f2c0 con 0x5608a0254d50 2024-09-18T02:04:18.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.660+0000 7f203dfda640 1 -- 172.21.15.167:0/836285251 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94595046541968] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20340c9030 con 0x5608a0254d50 2024-09-18T02:04:18.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.660+0000 7f2040ccb980 20 remove_watcher() i=2 2024-09-18T02:04:18.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.660+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94595046553840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a0258a90 con 0x7f20340dc040 2024-09-18T02:04:18.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.660+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94595046553840] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x7f20340dc040 2024-09-18T02:04:18.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.660+0000 7f2040ccb980 20 remove_watcher() i=3 2024-09-18T02:04:18.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.660+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94595046552640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025f2c0 con 0x5608a024b9d0 2024-09-18T02:04:18.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.660+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94595046552640] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2030026040 con 0x5608a024b9d0 2024-09-18T02:04:18.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.660+0000 7f2040ccb980 20 remove_watcher() i=4 2024-09-18T02:04:18.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.660+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94595046560880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a0258a90 con 0x5608a02503e0 2024-09-18T02:04:18.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.664+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94595046560880] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.664+0000 7f2040ccb980 20 remove_watcher() i=5 2024-09-18T02:04:18.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.664+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94595046563280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a025b440 con 0x5608a02503e0 2024-09-18T02:04:18.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.664+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94595046563280] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.664+0000 7f2040ccb980 20 remove_watcher() i=6 2024-09-18T02:04:18.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.664+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94595046566016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608a0258a90 con 0x5608a02503e0 2024-09-18T02:04:18.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f203e7db640 1 -- 172.21.15.167:0/836285251 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94595046566016] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203803c070 con 0x5608a02503e0 2024-09-18T02:04:18.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 20 remove_watcher() i=7 2024-09-18T02:04:18.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5608a02503e0 msgr2=0x5608a02527d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5608a02503e0 0x5608a02527d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5608a024b9d0 msgr2=0x5608a024de90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5608a024b9d0 0x5608a024de90 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f20340dc040 msgr2=0x7f20340dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f20340dc040 0x7f20340dd430 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5608a0254d50 msgr2=0x5608a0257140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5608a0254d50 0x5608a0257140 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f08034650 msgr2=0x7f1f08036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f08034650 0x7f1f08036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2034018eb0 tx=0x7f20340b9040 comp rx=0 tx=0).stop 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 msgr2=0x5608a02408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/836285251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a02396f0 0x5608a02408f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2038001340 tx=0x7f20380340a0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 reap_dead start 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f203efdc640 1 -- 172.21.15.167:0/836285251 reap_dead start 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 shutdown_connections 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 >> 172.21.15.167:0/836285251 conn(0x5608a0235b20 msgr2=0x5608a0233bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 shutdown_connections 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/836285251 wait complete. 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/3807522005 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f18034740 msgr2=0x7f1f18036c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/3807522005 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f18034740 0x7f1f18036c00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5608a0214970 tx=0x7f2034005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/3807522005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a0091530 msgr2=0x5608a008fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/3807522005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a0091530 0x5608a008fbb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f20380333f0 tx=0x7f2038029840 comp rx=0 tx=0).stop 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/3807522005 shutdown_connections 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/3807522005 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f18034740 0x7f1f18036c00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/3807522005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a0091530 0x5608a008fbb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/3807522005 >> 172.21.15.167:0/3807522005 conn(0x5608a021fde0 msgr2=0x5608a0222860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/3807522005 shutdown_connections 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/3807522005 wait complete. 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5608a02167a0 msgr2=0x5608a0218b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5608a02167a0 0x5608a0218b90 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5608a011e9b0 msgr2=0x5608a0213db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5608a011e9b0 0x5608a0213db0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5608a021a6a0 msgr2=0x5608a021ca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5608a021a6a0 0x5608a021ca90 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f240346a0 msgr2=0x7f1f24036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1f240346a0 0x7f1f24036b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20340ad000 tx=0x7f20340a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:18.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 msgr2=0x5608a020ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 --2- 172.21.15.167:0/1555994513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608a011a630 0x5608a020ce20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5608a0206c30 tx=0x7f2038000f50 comp rx=0 tx=0).stop 2024-09-18T02:04:18.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f203efdc640 1 -- 172.21.15.167:0/1555994513 reap_dead start 2024-09-18T02:04:18.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 shutdown_connections 2024-09-18T02:04:18.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 >> 172.21.15.167:0/1555994513 conn(0x5608a0116150 msgr2=0x5608a0200200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 shutdown_connections 2024-09-18T02:04:18.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.668+0000 7f2040ccb980 1 -- 172.21.15.167:0/1555994513 wait complete. 2024-09-18T02:04:18.680 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:18.680 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T02:04:18.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T02:04:18.681 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T02:04:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:18.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.752+0000 7ff1c4f0f980 1 Processor -- start 2024-09-18T02:04:18.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.752+0000 7ff1c4f0f980 1 -- start start 2024-09-18T02:04:18.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.752+0000 7ff1c4f0f980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x559aa9952b00 0x559aa99e3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.752+0000 7ff1c4f0f980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559aa9866ae0 con 0x559aa99e3c70 2024-09-18T02:04:18.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.752+0000 7ff1c4f0f980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x559aa988ae30 con 0x559aa9952b00 2024-09-18T02:04:18.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.752+0000 7ff1c2a1f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x559aa9952b00 0x559aa99e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.752+0000 7ff1c221e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x559aa99e3c70 0x559aa99e6060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55492/0 (socket says 172.21.15.167:55492) 2024-09-18T02:04:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.752+0000 7ff1c2a1f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x559aa9952b00 0x559aa99e3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56492/0 (socket says 172.21.15.167:56492) 2024-09-18T02:04:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.752+0000 7ff1c221e640 1 -- 172.21.15.167:0/3971040285 learned_addr learned my addr 172.21.15.167:0/3971040285 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.752+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3971040285 >> v1:172.21.15.81:6789/0 conn(0x559aa99e3c70 legacy=0x559aa99e6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.752+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3971040285 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa9952ee0 con 0x559aa9952b00 2024-09-18T02:04:18.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.756+0000 7ff1c2a1f640 1 --2- 172.21.15.167:0/3971040285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa99e3730 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00a480 tx=0x7ff1bc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe71e57dd561f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.756+0000 7ff1c1a1d640 1 -- 172.21.15.167:0/3971040285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc0b0070 con 0x559aa9952b00 2024-09-18T02:04:18.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.756+0000 7ff1c1a1d640 1 -- 172.21.15.167:0/3971040285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc0ab540 con 0x559aa9952b00 2024-09-18T02:04:18.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.756+0000 7ff1c1a1d640 1 -- 172.21.15.167:0/3971040285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc0ab840 con 0x559aa9952b00 2024-09-18T02:04:18.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.756+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3971040285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 msgr2=0x559aa99e3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.756+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3971040285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa99e3730 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00a480 tx=0x7ff1bc01b280 comp rx=0 tx=0).stop 2024-09-18T02:04:18.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.756+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3971040285 shutdown_connections 2024-09-18T02:04:18.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.756+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3971040285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa99e3730 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.756+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3971040285 >> 172.21.15.167:0/3971040285 conn(0x559aa99d9060 msgr2=0x559aa99db480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.756+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3971040285 shutdown_connections 2024-09-18T02:04:18.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.756+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3971040285 wait complete. 2024-09-18T02:04:18.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.768+0000 7ff1c4f0f980 1 Processor -- start 2024-09-18T02:04:18.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.768+0000 7ff1c4f0f980 1 -- start start 2024-09-18T02:04:18.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.768+0000 7ff1c4f0f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa9acbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.768+0000 7ff1c4f0f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559aa988c200 con 0x559aa9952b00 2024-09-18T02:04:18.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c2a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa9acbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c2a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa9acbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56494/0 (socket says 172.21.15.167:56494) 2024-09-18T02:04:18.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/4143822478 learned_addr learned my addr 172.21.15.167:0/4143822478 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/4143822478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa9acc1f0 con 0x559aa9952b00 2024-09-18T02:04:18.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c2a1f640 1 --2- 172.21.15.167:0/4143822478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa9acbc20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc018eb0 tx=0x7ff1bc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80cc1765ab2abcc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff0b0e09640 1 -- 172.21.15.167:0/4143822478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc0b0040 con 0x559aa9952b00 2024-09-18T02:04:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff0b0e09640 1 -- 172.21.15.167:0/4143822478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc0aba30 con 0x559aa9952b00 2024-09-18T02:04:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff0b0e09640 1 -- 172.21.15.167:0/4143822478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc0abd30 con 0x559aa9952b00 2024-09-18T02:04:18.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/4143822478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 msgr2=0x559aa9acbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/4143822478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa9acbc20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc018eb0 tx=0x7ff1bc003030 comp rx=0 tx=0).stop 2024-09-18T02:04:18.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/4143822478 shutdown_connections 2024-09-18T02:04:18.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/4143822478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa9acbc20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/4143822478 >> 172.21.15.167:0/4143822478 conn(0x559aa99d9060 msgr2=0x559aa9ac7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/4143822478 shutdown_connections 2024-09-18T02:04:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/4143822478 wait complete. 2024-09-18T02:04:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 Processor -- start 2024-09-18T02:04:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 -- start start 2024-09-18T02:04:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa9ad2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559aa99ea210 con 0x559aa9952b00 2024-09-18T02:04:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c2a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa9ad2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c2a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa9ad2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56510/0 (socket says 172.21.15.167:56510) 2024-09-18T02:04:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/1294582597 learned_addr learned my addr 172.21.15.167:0/1294582597 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/1294582597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa9ad33c0 con 0x559aa9952b00 2024-09-18T02:04:18.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c2a1f640 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa9ad2e80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc01bb20 tx=0x7ff1bc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff0af606640 1 -- 172.21.15.167:0/1294582597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc0b0070 con 0x559aa9952b00 2024-09-18T02:04:18.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aa9ad3650 con 0x559aa9952b00 2024-09-18T02:04:18.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff0af606640 1 -- 172.21.15.167:0/1294582597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc0b6d10 con 0x559aa9952b00 2024-09-18T02:04:18.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff0af606640 1 -- 172.21.15.167:0/1294582597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc0c8440 con 0x559aa9952b00 2024-09-18T02:04:18.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.772+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa9ad6330 con 0x559aa9952b00 2024-09-18T02:04:18.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff0af606640 1 -- 172.21.15.167:0/1294582597 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1bc0bf410 con 0x559aa9952b00 2024-09-18T02:04:18.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff0af606640 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff0a80346a0 0x7ff0a8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff0af606640 1 -- 172.21.15.167:0/1294582597 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff1bc0a8070 con 0x559aa9952b00 2024-09-18T02:04:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c221e640 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff0a80346a0 0x7ff0a8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559aa99e3c70 0x559aa9ad9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9ada4c0 con 0x559aa99e3c70 2024-09-18T02:04:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c3220640 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559aa99e3c70 0x559aa9ad9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c221e640 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff0a80346a0 0x7ff0a8036b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000f70 tx=0x7ff1ac0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c3220640 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559aa99e3c70 0x559aa9ad9f80 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c3220640 1 -- 172.21.15.167:0/1294582597 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa99e3c70 2024-09-18T02:04:18.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9ad7550 con 0x559aa99e3c70 2024-09-18T02:04:18.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c3220640 1 -- 172.21.15.167:0/1294582597 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa99e3c70 2024-09-18T02:04:18.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559aa9adc800 0x559aa9adebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9adf2e0 con 0x559aa9adc800 2024-09-18T02:04:18.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c2a1f640 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559aa9adc800 0x559aa9adebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.776+0000 7ff1c2a1f640 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559aa9adc800 0x559aa9adebf0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.780+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/1294582597 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9adc800 2024-09-18T02:04:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.780+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9adb6a0 con 0x559aa99e3c70 2024-09-18T02:04:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.780+0000 7ff1c3220640 1 -- 172.21.15.167:0/1294582597 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa99e3c70 2024-09-18T02:04:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.780+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559aa9ae0740 0x559aa9ae2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.780+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9ae3270 con 0x559aa9ae0740 2024-09-18T02:04:18.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.780+0000 7ff1c221e640 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559aa9ae0740 0x559aa9ae2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c221e640 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559aa9ae0740 0x559aa9ae2b30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c221e640 1 -- 172.21.15.167:0/1294582597 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9ae0740 2024-09-18T02:04:18.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c4f0f980 1 Processor -- start 2024-09-18T02:04:18.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c4f0f980 1 -- start start 2024-09-18T02:04:18.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c4f0f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9af0d40 0x559aa9af1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c4f0f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559aa98e5800 con 0x559aa9af0d40 2024-09-18T02:04:18.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c2a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9af0d40 0x559aa9af1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c2a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9af0d40 0x559aa9af1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56520/0 (socket says 172.21.15.167:56520) 2024-09-18T02:04:18.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/1055270612 learned_addr learned my addr 172.21.15.167:0/1055270612 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/1055270612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa9af16a0 con 0x559aa9af0d40 2024-09-18T02:04:18.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c2a1f640 1 --2- 172.21.15.167:0/1055270612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9af0d40 0x559aa9af1160 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0e3430 tx=0x7ff1bc0aa910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff0ace01640 1 -- 172.21.15.167:0/1055270612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc0b7160 con 0x559aa9af0d40 2024-09-18T02:04:18.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff0ace01640 1 -- 172.21.15.167:0/1055270612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc006bb0 con 0x559aa9af0d40 2024-09-18T02:04:18.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1055270612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aa9af1930 con 0x559aa9af0d40 2024-09-18T02:04:18.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff0ace01640 1 -- 172.21.15.167:0/1055270612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc006da0 con 0x559aa9af0d40 2024-09-18T02:04:18.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1055270612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa9af45b0 con 0x559aa9af0d40 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff0ace01640 1 -- 172.21.15.167:0/1055270612 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1bc0dd070 con 0x559aa9af0d40 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff0ace01640 1 --2- 172.21.15.167:0/1055270612 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff09c034650 0x7ff09c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff0ace01640 1 -- 172.21.15.167:0/1055270612 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff1bc0ee0b0 con 0x559aa9af0d40 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.784+0000 7ff1c221e640 1 --2- 172.21.15.167:0/1055270612 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff09c034650 0x7ff09c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 Processor -- start 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 -- start start 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c221e640 1 --2- 172.21.15.167:0/1055270612 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff09c034650 0x7ff09c036b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00bf60 tx=0x7ff1ac00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9afda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559aa9acc4b0 con 0x559aa9afd680 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c2a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9afda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c2a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9afda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56526/0 (socket says 172.21.15.167:56526) 2024-09-18T02:04:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/2898709373 learned_addr learned my addr 172.21.15.167:0/2898709373 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/2898709373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa9afe030 con 0x559aa9afd680 2024-09-18T02:04:18.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c2a1f640 1 --2- 172.21.15.167:0/2898709373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9afda60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0a6f90 tx=0x7ff1bc0ecaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9752f77333637e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff0a67fc640 1 -- 172.21.15.167:0/2898709373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc0ff020 con 0x559aa9afd680 2024-09-18T02:04:18.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff0a67fc640 1 -- 172.21.15.167:0/2898709373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc0e3e30 con 0x559aa9afd680 2024-09-18T02:04:18.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff0a67fc640 1 -- 172.21.15.167:0/2898709373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc0af170 con 0x559aa9afd680 2024-09-18T02:04:18.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/2898709373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 msgr2=0x559aa9afda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/2898709373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9afda60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0a6f90 tx=0x7ff1bc0ecaf0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/2898709373 shutdown_connections 2024-09-18T02:04:18.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/2898709373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9afda60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/2898709373 >> 172.21.15.167:0/2898709373 conn(0x559aa9af9a60 msgr2=0x559aa9af7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/2898709373 shutdown_connections 2024-09-18T02:04:18.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/2898709373 wait complete. 2024-09-18T02:04:18.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 Processor -- start 2024-09-18T02:04:18.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 -- start start 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9b04640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559aa9afe030 con 0x559aa9afd680 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c2a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9b04640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c2a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9b04640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56542/0 (socket says 172.21.15.167:56542) 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 learned_addr learned my addr 172.21.15.167:0/3105670448 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa9b04b80 con 0x559aa9afd680 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c2a1f640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9b04640 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0b7960 tx=0x7ff1bc0f1f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff0a4ff9640 1 -- 172.21.15.167:0/3105670448 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc10c030 con 0x559aa9afd680 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff0a4ff9640 1 -- 172.21.15.167:0/3105670448 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc0c8df0 con 0x559aa9afd680 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.788+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aa9b04b80 con 0x559aa9afd680 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff0a4ff9640 1 -- 172.21.15.167:0/3105670448 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc0d40c0 con 0x559aa9afd680 2024-09-18T02:04:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa9b04b80 con 0x559aa9afd680 2024-09-18T02:04:18.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff0a4ff9640 1 -- 172.21.15.167:0/3105670448 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1bc10f030 con 0x559aa9afd680 2024-09-18T02:04:18.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff0a4ff9640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff08c034620 0x7ff08c036ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff0a4ff9640 1 -- 172.21.15.167:0/3105670448 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff1bc10d070 con 0x559aa9afd680 2024-09-18T02:04:18.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c221e640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff08c034620 0x7ff08c036ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559aa9b0f500 0x559aa9b119a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b120f0 con 0x559aa9b0f500 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c3220640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559aa9b0f500 0x559aa9b119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c221e640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff08c034620 0x7ff08c036ae0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x559aa9ada980 tx=0x7ff1ac010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c3220640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559aa9b0f500 0x559aa9b119a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 20 realm 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b12500 con 0x559aa9b0f500 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:18.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b12da0 con 0x559aa9b0f500 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b0f500 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559aa9b13ea0 0x559aa9b16290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b16810 con 0x559aa9b13ea0 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.792+0000 7ff1c2a1f640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559aa9b13ea0 0x559aa9b16290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c2a1f640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559aa9b13ea0 0x559aa9b16290 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c4f0f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c4f0f980 20 searching for the correct realm 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559aa9b18760 0x559aa9b1ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1b2f0 con 0x559aa9b18760 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c221e640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559aa9b18760 0x559aa9b1ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c221e640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559aa9b18760 0x559aa9b1ac20 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c221e640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff1ac037040 0x7ff1ac036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1b2f0 con 0x7ff1ac037040 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c3220640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff1ac037040 0x7ff1ac036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c3220640 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff1ac037040 0x7ff1ac036410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b13ea0 2024-09-18T02:04:18.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b0f500 2024-09-18T02:04:18.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b0f500 2024-09-18T02:04:18.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b13ea0 2024-09-18T02:04:18.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.796+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b13ea0 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x7ff1ac037040 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b18760 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b0f500 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b13ea0 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b0f500 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x7ff1ac037040 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b18760 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b18760 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b13ea0 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b18760 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b18760 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.800+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b0f500 2024-09-18T02:04:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b0f500 2024-09-18T02:04:18.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b13ea0 2024-09-18T02:04:18.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b18760 2024-09-18T02:04:18.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x7ff1ac037040 2024-09-18T02:04:18.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b0f500 2024-09-18T02:04:18.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b13ea0 2024-09-18T02:04:18.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b18760 2024-09-18T02:04:18.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b13ea0 2024-09-18T02:04:18.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x7ff1ac037040 2024-09-18T02:04:18.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b18760 2024-09-18T02:04:18.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.804+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b13ea0 2024-09-18T02:04:18.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x559aa9b0f500 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b13140 con 0x7ff1ac037040 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b17060 con 0x559aa9b0f500 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b17060 con 0x559aa9b0f500 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b17060 con 0x559aa9b18760 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 zone default found 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 4 Realm: () 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:18.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 zonegroup default 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b17900 con 0x559aa9b13ea0 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1d150 con 0x559aa9b18760 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1d4f0 con 0x559aa9b18760 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 started sync module instance, tier type = 2024-09-18T02:04:18.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:18.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.808+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1c5f0 con 0x7ff1ac037040 2024-09-18T02:04:18.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.812+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.812+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94122760325920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1c5f0 con 0x7ff1ac037040 2024-09-18T02:04:18.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.812+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1df10 con 0x559aa9b0f500 2024-09-18T02:04:18.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.812+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94122760325920] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.812+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.812+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94122760329728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1c5f0 con 0x559aa9b0f500 2024-09-18T02:04:18.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.812+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1e950 con 0x559aa9b18760 2024-09-18T02:04:18.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94122760332448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1f1f0 con 0x559aa9b18760 2024-09-18T02:04:18.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1fbf0 con 0x7ff1ac037040 2024-09-18T02:04:18.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94122760329728] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94122760323392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b20010 con 0x7ff1ac037040 2024-09-18T02:04:18.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b208e0 con 0x559aa9b0f500 2024-09-18T02:04:18.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94122760332448] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94122760323392] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94122760337152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1ffc0 con 0x559aa9b0f500 2024-09-18T02:04:18.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.816+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b21180 con 0x559aa9b13ea0 2024-09-18T02:04:18.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.820+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.820+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94122760342736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1ffc0 con 0x559aa9b13ea0 2024-09-18T02:04:18.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.820+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b21ff0 con 0x559aa9b13ea0 2024-09-18T02:04:18.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.820+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94122760337152] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.820+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94122760342736] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.820+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.820+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94122760346432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b22390 con 0x559aa9b13ea0 2024-09-18T02:04:18.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.820+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b22be0 con 0x559aa9b13ea0 2024-09-18T02:04:18.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94122760346432] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94122760348560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b22c60 con 0x559aa9b13ea0 2024-09-18T02:04:18.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 20 add_watcher() i=0 2024-09-18T02:04:18.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 20 add_watcher() i=1 2024-09-18T02:04:18.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 20 add_watcher() i=2 2024-09-18T02:04:18.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 20 add_watcher() i=3 2024-09-18T02:04:18.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 20 add_watcher() i=4 2024-09-18T02:04:18.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 20 add_watcher() i=5 2024-09-18T02:04:18.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 20 add_watcher() i=6 2024-09-18T02:04:18.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94122760348560] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 20 add_watcher() i=7 2024-09-18T02:04:18.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:18.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b25f50 con 0x559aa9b0f500 2024-09-18T02:04:18.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.824+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94122760349984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b231f0 con 0x559aa9b0f500 2024-09-18T02:04:18.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94122760349984] v30'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff0797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:18.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c4f0f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:18.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c4f0f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:18.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c4f0f980 5 note: GC not initialized 2024-09-18T02:04:18.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7feff3fff640 20 reqs_thread_entry: start 2024-09-18T02:04:18.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c4f0f980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:18.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c4f0f980 20 Filter name: none 2024-09-18T02:04:18.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7feff1ffb640 20 reqs_thread_entry: start 2024-09-18T02:04:18.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c4f0f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b491c0 con 0x559aa9b0f500 2024-09-18T02:04:18.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c4f0f980 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T02:04:18.832 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:18.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff0797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:18.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94122760349984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b47d70 con 0x559aa9b0f500 2024-09-18T02:04:18.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94122760349984] v30'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.828+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94122760325920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b22920 con 0x7ff1ac037040 2024-09-18T02:04:18.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.832+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94122760325920] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.832+0000 7ff1c4f0f980 20 remove_watcher() i=0 2024-09-18T02:04:18.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.832+0000 7ff1c4f0f980 2 removed watcher, disabling cache 2024-09-18T02:04:18.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.832+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94122760329728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b22920 con 0x559aa9b0f500 2024-09-18T02:04:18.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.832+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94122760329728] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.832+0000 7ff1c4f0f980 20 remove_watcher() i=1 2024-09-18T02:04:18.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.832+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94122760332448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1da00 con 0x559aa9b18760 2024-09-18T02:04:18.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.836+0000 7ff1c221e640 1 -- 172.21.15.167:0/3105670448 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94122760332448] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00e620 con 0x559aa9b18760 2024-09-18T02:04:18.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.836+0000 7ff1c4f0f980 20 remove_watcher() i=2 2024-09-18T02:04:18.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.836+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94122760323392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b22920 con 0x7ff1ac037040 2024-09-18T02:04:18.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.836+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94122760323392] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x7ff1ac037040 2024-09-18T02:04:18.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.836+0000 7ff1c4f0f980 20 remove_watcher() i=3 2024-09-18T02:04:18.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.836+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94122760337152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1da00 con 0x559aa9b0f500 2024-09-18T02:04:18.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.836+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94122760337152] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1b400a4d0 con 0x559aa9b0f500 2024-09-18T02:04:18.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.836+0000 7ff1c4f0f980 20 remove_watcher() i=4 2024-09-18T02:04:18.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.836+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94122760342736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b22920 con 0x559aa9b13ea0 2024-09-18T02:04:18.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.840+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94122760342736] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.840+0000 7ff1c4f0f980 20 remove_watcher() i=5 2024-09-18T02:04:18.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.840+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94122760346432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1f700 con 0x559aa9b13ea0 2024-09-18T02:04:18.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.840+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94122760346432] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.840+0000 7ff1c4f0f980 20 remove_watcher() i=6 2024-09-18T02:04:18.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.840+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94122760348560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa9b1da00 con 0x559aa9b13ea0 2024-09-18T02:04:18.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c2a1f640 1 -- 172.21.15.167:0/3105670448 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94122760348560] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1bc0b3040 con 0x559aa9b13ea0 2024-09-18T02:04:18.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 20 remove_watcher() i=7 2024-09-18T02:04:18.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559aa9b13ea0 msgr2=0x559aa9b16290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559aa9b13ea0 0x559aa9b16290 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559aa9b0f500 msgr2=0x559aa9b119a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559aa9b0f500 0x559aa9b119a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff1ac037040 msgr2=0x7ff1ac036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff1ac037040 0x7ff1ac036410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559aa9b18760 msgr2=0x559aa9b1ac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559aa9b18760 0x559aa9b1ac20 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff08c034620 msgr2=0x7ff08c036ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff08c034620 0x7ff08c036ae0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x559aa9ada980 tx=0x7ff1ac010000 comp rx=0 tx=0).stop 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c3220640 1 -- 172.21.15.167:0/3105670448 reap_dead start 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 msgr2=0x559aa9b04640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9b04640 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0b7960 tx=0x7ff1bc0f1f30 comp rx=0 tx=0).stop 2024-09-18T02:04:18.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 shutdown_connections 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/3105670448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9afd680 0x559aa9b04640 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 >> 172.21.15.167:0/3105670448 conn(0x559aa9af9a60 msgr2=0x559aa9af7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 shutdown_connections 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/3105670448 wait complete. 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1055270612 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff09c034650 msgr2=0x7ff09c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1055270612 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff09c034650 0x7ff09c036b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00bf60 tx=0x7ff1ac00f000 comp rx=0 tx=0).stop 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1055270612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9af0d40 msgr2=0x559aa9af1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1055270612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9af0d40 0x559aa9af1160 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0e3430 tx=0x7ff1bc0aa910 comp rx=0 tx=0).stop 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1055270612 shutdown_connections 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1055270612 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff09c034650 0x7ff09c036b10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1055270612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9af0d40 0x559aa9af1160 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1055270612 >> 172.21.15.167:0/1055270612 conn(0x559aa9ae5e90 msgr2=0x559aa9ae8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1055270612 shutdown_connections 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1055270612 wait complete. 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559aa9adc800 msgr2=0x559aa9adebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559aa9adc800 0x559aa9adebf0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559aa99e3c70 msgr2=0x559aa9ad9f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559aa99e3c70 0x559aa9ad9f80 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559aa9ae0740 msgr2=0x559aa9ae2b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559aa9ae0740 0x559aa9ae2b30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff0a80346a0 msgr2=0x7ff0a8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff0a80346a0 0x7ff0a8036b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000f70 tx=0x7ff1ac0012c0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 msgr2=0x559aa9ad2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 --2- 172.21.15.167:0/1294582597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559aa9952b00 0x559aa9ad2e80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc01bb20 tx=0x7ff1bc018020 comp rx=0 tx=0).stop 2024-09-18T02:04:18.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c3220640 1 -- 172.21.15.167:0/1294582597 reap_dead start 2024-09-18T02:04:18.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 shutdown_connections 2024-09-18T02:04:18.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 >> 172.21.15.167:0/1294582597 conn(0x559aa99d9060 msgr2=0x559aa9ac63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 shutdown_connections 2024-09-18T02:04:18.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.844+0000 7ff1c4f0f980 1 -- 172.21.15.167:0/1294582597 wait complete. 2024-09-18T02:04:18.857 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:18.857 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T02:04:18.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T02:04:18.858 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T02:04:18.930 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:18.930 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:18.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.928+0000 7f06ef9a6980 1 Processor -- start 2024-09-18T02:04:18.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.928+0000 7f06ef9a6980 1 -- start start 2024-09-18T02:04:18.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.928+0000 7f06ef9a6980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5581998c7a90 0x5581998c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.928+0000 7f06ef9a6980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55819974bae0 con 0x558199837ac0 2024-09-18T02:04:18.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.928+0000 7f06ef9a6980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55819976fe30 con 0x5581998c7a90 2024-09-18T02:04:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.928+0000 7f06eccb5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5581998c7a90 0x5581998c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.928+0000 7f06ed4b6640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x558199837ac0 0x5581998c6370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55494/0 (socket says 172.21.15.167:55494) 2024-09-18T02:04:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.928+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1111378693 learned_addr learned my addr 172.21.15.167:0/1111378693 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.928+0000 7f06eccb5640 1 -- 172.21.15.167:0/1111378693 >> v1:172.21.15.81:6789/0 conn(0x558199837ac0 legacy=0x5581998c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.928+0000 7f06eccb5640 1 -- 172.21.15.167:0/1111378693 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581998cb3d0 con 0x5581998c7a90 2024-09-18T02:04:18.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.932+0000 7f06eccb5640 1 --2- 172.21.15.167:0/1111378693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c7a90 0x5581998c9e80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f06e400a480 tx=0x7f06e401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9d474e00f75bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.932+0000 7f06dffff640 1 -- 172.21.15.167:0/1111378693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e40b0070 con 0x5581998c7a90 2024-09-18T02:04:18.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.932+0000 7f06dffff640 1 -- 172.21.15.167:0/1111378693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e40ab540 con 0x5581998c7a90 2024-09-18T02:04:18.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.932+0000 7f06dffff640 1 -- 172.21.15.167:0/1111378693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e40ab840 con 0x5581998c7a90 2024-09-18T02:04:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.932+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1111378693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c7a90 msgr2=0x5581998c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.932+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1111378693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c7a90 0x5581998c9e80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f06e400a480 tx=0x7f06e401b280 comp rx=0 tx=0).stop 2024-09-18T02:04:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.932+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1111378693 shutdown_connections 2024-09-18T02:04:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.932+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1111378693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c7a90 0x5581998c9e80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.932+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1111378693 >> 172.21.15.167:0/1111378693 conn(0x5581998be060 msgr2=0x5581998c0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.932+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1111378693 shutdown_connections 2024-09-18T02:04:18.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.932+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1111378693 wait complete. 2024-09-18T02:04:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.944+0000 7f06ef9a6980 1 Processor -- start 2024-09-18T02:04:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.944+0000 7f06ef9a6980 1 -- start start 2024-09-18T02:04:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.944+0000 7f06ef9a6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 0x5581999aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.944+0000 7f06ef9a6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558199771200 con 0x558199837ac0 2024-09-18T02:04:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.944+0000 7f06ed4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 0x5581999aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.944+0000 7f06ed4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 0x5581999aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56558/0 (socket says 172.21.15.167:56558) 2024-09-18T02:04:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.944+0000 7f06ed4b6640 1 -- 172.21.15.167:0/3493812678 learned_addr learned my addr 172.21.15.167:0/3493812678 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.944+0000 7f06ed4b6640 1 -- 172.21.15.167:0/3493812678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581999af0b0 con 0x558199837ac0 2024-09-18T02:04:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ed4b6640 1 --2- 172.21.15.167:0/3493812678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 0x5581999aeae0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f06e8001e20 tx=0x7f06e800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f42e5b064e06a4c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f05db606640 1 -- 172.21.15.167:0/3493812678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e8012020 con 0x558199837ac0 2024-09-18T02:04:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f05db606640 1 -- 172.21.15.167:0/3493812678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e800e7c0 con 0x558199837ac0 2024-09-18T02:04:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f05db606640 1 -- 172.21.15.167:0/3493812678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e800eb00 con 0x558199837ac0 2024-09-18T02:04:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3493812678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 msgr2=0x5581999aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/3493812678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 0x5581999aeae0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f06e8001e20 tx=0x7f06e800b790 comp rx=0 tx=0).stop 2024-09-18T02:04:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3493812678 shutdown_connections 2024-09-18T02:04:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/3493812678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 0x5581999aeae0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3493812678 >> 172.21.15.167:0/3493812678 conn(0x5581998be060 msgr2=0x5581999aa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3493812678 shutdown_connections 2024-09-18T02:04:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3493812678 wait complete. 2024-09-18T02:04:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 Processor -- start 2024-09-18T02:04:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 -- start start 2024-09-18T02:04:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 0x5581999b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5581998cae10 con 0x558199837ac0 2024-09-18T02:04:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ed4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 0x5581999b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ed4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 0x5581999b5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56572/0 (socket says 172.21.15.167:56572) 2024-09-18T02:04:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ed4b6640 1 -- 172.21.15.167:0/2926169357 learned_addr learned my addr 172.21.15.167:0/2926169357 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ed4b6640 1 -- 172.21.15.167:0/2926169357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581999b6390 con 0x558199837ac0 2024-09-18T02:04:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ed4b6640 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 0x5581999b5e50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f06e8001e20 tx=0x7f06e8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f05d9e03640 1 -- 172.21.15.167:0/2926169357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e8012030 con 0x558199837ac0 2024-09-18T02:04:18.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581999b6620 con 0x558199837ac0 2024-09-18T02:04:18.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f05d9e03640 1 -- 172.21.15.167:0/2926169357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e8001480 con 0x558199837ac0 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f05d9e03640 1 -- 172.21.15.167:0/2926169357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e801a920 con 0x558199837ac0 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.948+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581999b9300 con 0x558199837ac0 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f05d9e03640 1 -- 172.21.15.167:0/2926169357 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f06e8015020 con 0x558199837ac0 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f05d9e03640 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05d4034650 0x7f05d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f05d9e03640 1 -- 172.21.15.167:0/2926169357 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06e8020030 con 0x558199837ac0 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06eccb5640 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05d4034650 0x7f05d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5581998c7a90 0x5581999bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999bd430 con 0x5581998c7a90 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06edcb7640 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5581998c7a90 0x5581999bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06eccb5640 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05d4034650 0x7f05d4036b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06e40ad000 tx=0x7f06e40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06edcb7640 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5581998c7a90 0x5581999bcde0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06edcb7640 1 -- 172.21.15.167:0/2926169357 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581998c7a90 2024-09-18T02:04:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999ba520 con 0x5581998c7a90 2024-09-18T02:04:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06edcb7640 1 -- 172.21.15.167:0/2926169357 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581998c7a90 2024-09-18T02:04:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5581999bf740 0x5581999c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999c2200 con 0x5581999bf740 2024-09-18T02:04:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06ed4b6640 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5581999bf740 0x5581999c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06ed4b6640 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5581999bf740 0x5581999c1b30 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.952+0000 7f06ed4b6640 1 -- 172.21.15.167:0/2926169357 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06e8008030 con 0x5581999bf740 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999be5e0 con 0x5581998c7a90 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06edcb7640 1 -- 172.21.15.167:0/2926169357 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581998c7a90 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5581999c3660 0x5581999c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999c6150 con 0x5581999c3660 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06eccb5640 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5581999c3660 0x5581999c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06eccb5640 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5581999c3660 0x5581999c5a50 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06eccb5640 1 -- 172.21.15.167:0/2926169357 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f06e40b3040 con 0x5581999c3660 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ef9a6980 1 Processor -- start 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ef9a6980 1 -- start start 2024-09-18T02:04:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ef9a6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581999d3c20 0x5581999d4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ef9a6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5581997ca800 con 0x5581999d3c20 2024-09-18T02:04:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ed4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581999d3c20 0x5581999d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ed4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581999d3c20 0x5581999d4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56578/0 (socket says 172.21.15.167:56578) 2024-09-18T02:04:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ed4b6640 1 -- 172.21.15.167:0/3895791423 learned_addr learned my addr 172.21.15.167:0/3895791423 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ed4b6640 1 -- 172.21.15.167:0/3895791423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581999d4580 con 0x5581999d3c20 2024-09-18T02:04:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ed4b6640 1 --2- 172.21.15.167:0/3895791423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581999d3c20 0x5581999d4040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f06e800e790 tx=0x7f06e8017f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f05d2ffd640 1 -- 172.21.15.167:0/3895791423 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e804b070 con 0x5581999d3c20 2024-09-18T02:04:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f05d2ffd640 1 -- 172.21.15.167:0/3895791423 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e8003a20 con 0x5581999d3c20 2024-09-18T02:04:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3895791423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581999d4810 con 0x5581999d3c20 2024-09-18T02:04:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f05d2ffd640 1 -- 172.21.15.167:0/3895791423 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e8003d40 con 0x5581999d3c20 2024-09-18T02:04:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.956+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3895791423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581999d4810 con 0x5581999d3c20 2024-09-18T02:04:18.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f05d2ffd640 1 -- 172.21.15.167:0/3895791423 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f06e804e070 con 0x5581999d3c20 2024-09-18T02:04:18.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f05d2ffd640 1 --2- 172.21.15.167:0/3895791423 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05c4034600 0x7f05c4036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f05d2ffd640 1 -- 172.21.15.167:0/3895791423 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06e8005050 con 0x5581999d3c20 2024-09-18T02:04:18.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06eccb5640 1 --2- 172.21.15.167:0/3895791423 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05c4034600 0x7f05c4036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 Processor -- start 2024-09-18T02:04:18.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 -- start start 2024-09-18T02:04:18.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06eccb5640 1 --2- 172.21.15.167:0/3895791423 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05c4034600 0x7f05c4036ac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5581999bdcf0 tx=0x7f06e4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581998c2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5581999af430 con 0x5581998c2330 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ed4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581998c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ed4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581998c2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56584/0 (socket says 172.21.15.167:56584) 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ed4b6640 1 -- 172.21.15.167:0/2343602011 learned_addr learned my addr 172.21.15.167:0/2343602011 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ed4b6640 1 -- 172.21.15.167:0/2343602011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581998c2d00 con 0x5581998c2330 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ed4b6640 1 --2- 172.21.15.167:0/2343602011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581998c2730 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f06e8048840 tx=0x7f06e8046ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a211e7fd02e63991 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f05d0ff9640 1 -- 172.21.15.167:0/2343602011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e8064070 con 0x5581998c2330 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f05d0ff9640 1 -- 172.21.15.167:0/2343602011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e8048930 con 0x5581998c2330 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f05d0ff9640 1 -- 172.21.15.167:0/2343602011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e805b040 con 0x5581998c2330 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2343602011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 msgr2=0x5581998c2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/2343602011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581998c2730 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f06e8048840 tx=0x7f06e8046ee0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2343602011 shutdown_connections 2024-09-18T02:04:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/2343602011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581998c2730 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2343602011 >> 172.21.15.167:0/2343602011 conn(0x5581999dc760 msgr2=0x5581999da860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2343602011 shutdown_connections 2024-09-18T02:04:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2343602011 wait complete. 2024-09-18T02:04:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 Processor -- start 2024-09-18T02:04:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 -- start start 2024-09-18T02:04:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581999e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ef9a6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5581998c3330 con 0x5581998c2330 2024-09-18T02:04:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ed4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581999e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ed4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581999e9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56586/0 (socket says 172.21.15.167:56586) 2024-09-18T02:04:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 learned_addr learned my addr 172.21.15.167:0/1293767635 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.960+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581999e9d80 con 0x5581998c2330 2024-09-18T02:04:18.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ed4b6640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581999e9840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f06e8017fd0 tx=0x7f06e801fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f05c2ffd640 1 -- 172.21.15.167:0/1293767635 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e806d020 con 0x5581998c2330 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f05c2ffd640 1 -- 172.21.15.167:0/1293767635 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e80166f0 con 0x5581998c2330 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581999e9d80 con 0x5581998c2330 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f05c2ffd640 1 -- 172.21.15.167:0/1293767635 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e8064040 con 0x5581998c2330 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581999e9d80 con 0x5581998c2330 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f05c2ffd640 1 -- 172.21.15.167:0/1293767635 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f06e8070020 con 0x5581998c2330 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f05c2ffd640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05b8034650 0x7f05b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f05c2ffd640 1 -- 172.21.15.167:0/1293767635 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06e8073ab0 con 0x5581998c2330 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06eccb5640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05b8034650 0x7f05b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5581999f4870 0x5581999f6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999f7480 con 0x5581999f4870 2024-09-18T02:04:18.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06edcb7640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5581999f4870 0x5581999f6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06eccb5640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05b8034650 0x7f05b8036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f06e4000c10 tx=0x7f06e40b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06edcb7640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5581999f4870 0x5581999f6d30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 20 realm 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999f7890 con 0x5581999f4870 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999f8130 con 0x5581999f4870 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f4870 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5581999f9230 0x5581999fb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999fbba0 con 0x5581999f9230 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.964+0000 7f06ed4b6640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5581999f9230 0x5581999fb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06ed4b6640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5581999f9230 0x5581999fb620 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06ef9a6980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:18.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06ef9a6980 20 searching for the correct realm 2024-09-18T02:04:18.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5581999fdad0 0x5581999fff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558199a00630 con 0x5581999fdad0 2024-09-18T02:04:18.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06eccb5640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5581999fdad0 0x5581999fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06eccb5640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5581999fdad0 0x5581999fff60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06eccb5640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f06e40dc040 0x7f06e40dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558199a00630 con 0x7f06e40dc040 2024-09-18T02:04:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06edcb7640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f06e40dc040 0x7f06e40dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06edcb7640 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f06e40dc040 0x7f06e40dd430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f9230 2024-09-18T02:04:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f4870 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f4870 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.968+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f9230 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f9230 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x7f06e40dc040 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999fdad0 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f4870 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f9230 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f4870 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x7f06e40dc040 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999fdad0 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999fdad0 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f9230 2024-09-18T02:04:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999fdad0 2024-09-18T02:04:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.972+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999fdad0 2024-09-18T02:04:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f4870 2024-09-18T02:04:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f4870 2024-09-18T02:04:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f9230 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999fdad0 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x7f06e40dc040 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f4870 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f9230 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999fdad0 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f9230 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x7f06e40dc040 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.976+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999fdad0 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f9230 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x5581999f4870 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581999f84d0 con 0x7f06e40dc040 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999fc3f0 con 0x5581999f4870 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999fc3f0 con 0x5581999f4870 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999fc3f0 con 0x5581999fdad0 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 zone default found 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 4 Realm: () 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 zonegroup default 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581999fcc90 con 0x5581999f9230 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558199a02490 con 0x5581999fdad0 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558199a02830 con 0x5581999fdad0 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 started sync module instance, tier type = 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.980+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a01930 con 0x7f06e40dc040 2024-09-18T02:04:18.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.984+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:18.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.984+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94015116549760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a01930 con 0x7f06e40dc040 2024-09-18T02:04:18.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.984+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a031f0 con 0x5581999f4870 2024-09-18T02:04:18.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.984+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94015116549760] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:18.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.984+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.984+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94015116553808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a01930 con 0x5581999f4870 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.984+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a03c00 con 0x5581999fdad0 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94015116553808] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94015116547200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a018a0 con 0x5581999fdad0 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a04900 con 0x7f06e40dc040 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94015116559744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a051a0 con 0x7f06e40dc040 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a05ba0 con 0x5581999f4870 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94015116559744] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94015116547200] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94015116558240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a04c80 con 0x5581999f4870 2024-09-18T02:04:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.988+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a06440 con 0x5581999f9230 2024-09-18T02:04:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.992+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94015116558240] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.992+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.992+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94015116566416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a04c80 con 0x5581999f9230 2024-09-18T02:04:18.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.992+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a06c90 con 0x5581999f9230 2024-09-18T02:04:18.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.992+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.992+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94015116569056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a07470 con 0x5581999f9230 2024-09-18T02:04:18.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.992+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a07f90 con 0x5581999f9230 2024-09-18T02:04:18.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.992+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94015116566416] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:18.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94015116573280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a07f50 con 0x5581999f9230 2024-09-18T02:04:18.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 20 add_watcher() i=0 2024-09-18T02:04:18.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 20 add_watcher() i=1 2024-09-18T02:04:18.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 20 add_watcher() i=2 2024-09-18T02:04:18.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 20 add_watcher() i=3 2024-09-18T02:04:18.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 20 add_watcher() i=4 2024-09-18T02:04:18.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 20 add_watcher() i=5 2024-09-18T02:04:19.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94015116569056] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:19.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 20 add_watcher() i=6 2024-09-18T02:04:19.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94015116573280] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:19.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 20 add_watcher() i=7 2024-09-18T02:04:19.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:19.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558199a06f00 con 0x5581999f4870 2024-09-18T02:04:19.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:19.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:18.996+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94015116564144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a06ec0 con 0x5581999f4870 2024-09-18T02:04:19.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94015116564144] v30'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:19.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f05a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06ef9a6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:19.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06ef9a6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:19.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06ef9a6980 5 note: GC not initialized 2024-09-18T02:04:19.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f05a27e4640 20 reqs_thread_entry: start 2024-09-18T02:04:19.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06ef9a6980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:19.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06ef9a6980 20 Filter name: none 2024-09-18T02:04:19.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f0513fff640 20 reqs_thread_entry: start 2024-09-18T02:04:19.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06ef9a6980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558199a2e000 con 0x5581999f4870 2024-09-18T02:04:19.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:19.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06ef9a6980 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T02:04:19.004 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:19.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f05a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94015116564144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a2cbb0 con 0x5581999f4870 2024-09-18T02:04:19.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94015116564144] v30'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:19.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.000+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94015116549760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a056b0 con 0x7f06e40dc040 2024-09-18T02:04:19.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.004+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94015116549760] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:19.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.004+0000 7f06ef9a6980 20 remove_watcher() i=0 2024-09-18T02:04:19.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.004+0000 7f06ef9a6980 2 removed watcher, disabling cache 2024-09-18T02:04:19.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.004+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94015116553808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a056b0 con 0x5581999f4870 2024-09-18T02:04:19.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.004+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94015116553808] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:19.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.004+0000 7f06ef9a6980 20 remove_watcher() i=1 2024-09-18T02:04:19.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.004+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94015116547200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a056b0 con 0x5581999fdad0 2024-09-18T02:04:19.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.008+0000 7f06eccb5640 1 -- 172.21.15.167:0/1293767635 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94015116547200] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e40c9030 con 0x5581999fdad0 2024-09-18T02:04:19.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.008+0000 7f06ef9a6980 20 remove_watcher() i=2 2024-09-18T02:04:19.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.008+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94015116559744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a056b0 con 0x7f06e40dc040 2024-09-18T02:04:19.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.008+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94015116559744] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x7f06e40dc040 2024-09-18T02:04:19.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.008+0000 7f06ef9a6980 20 remove_watcher() i=3 2024-09-18T02:04:19.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.008+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94015116558240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a056b0 con 0x5581999f4870 2024-09-18T02:04:19.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.008+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94015116558240] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e000a4d0 con 0x5581999f4870 2024-09-18T02:04:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.008+0000 7f06ef9a6980 20 remove_watcher() i=4 2024-09-18T02:04:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.008+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94015116566416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a03fa0 con 0x5581999f9230 2024-09-18T02:04:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.012+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94015116566416] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.012+0000 7f06ef9a6980 20 remove_watcher() i=5 2024-09-18T02:04:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.012+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94015116569056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a056b0 con 0x5581999f9230 2024-09-18T02:04:19.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.012+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94015116569056] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:19.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.012+0000 7f06ef9a6980 20 remove_watcher() i=6 2024-09-18T02:04:19.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.012+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94015116573280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558199a05f90 con 0x5581999f9230 2024-09-18T02:04:19.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ed4b6640 1 -- 172.21.15.167:0/1293767635 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94015116573280] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e8067040 con 0x5581999f9230 2024-09-18T02:04:19.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 20 remove_watcher() i=7 2024-09-18T02:04:19.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5581999f9230 msgr2=0x5581999fb620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5581999f9230 0x5581999fb620 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5581999f4870 msgr2=0x5581999f6d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5581999f4870 0x5581999f6d30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f06e40dc040 msgr2=0x7f06e40dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f06e40dc040 0x7f06e40dd430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5581999fdad0 msgr2=0x5581999fff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5581999fdad0 0x5581999fff60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05b8034650 msgr2=0x7f05b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05b8034650 0x7f05b8036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f06e4000c10 tx=0x7f06e40b9040 comp rx=0 tx=0).stop 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06edcb7640 1 -- 172.21.15.167:0/1293767635 reap_dead start 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 msgr2=0x5581999e9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581999e9840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f06e8017fd0 tx=0x7f06e801fee0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 shutdown_connections 2024-09-18T02:04:19.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/1293767635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581998c2330 0x5581999e9840 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 >> 172.21.15.167:0/1293767635 conn(0x5581999dc760 msgr2=0x5581999da830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 shutdown_connections 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/1293767635 wait complete. 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3895791423 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05c4034600 msgr2=0x7f05c4036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/3895791423 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05c4034600 0x7f05c4036ac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5581999bdcf0 tx=0x7f06e4005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3895791423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581999d3c20 msgr2=0x5581999d4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/3895791423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581999d3c20 0x5581999d4040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f06e800e790 tx=0x7f06e8017f40 comp rx=0 tx=0).stop 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3895791423 shutdown_connections 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/3895791423 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05c4034600 0x7f05c4036ac0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/3895791423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5581999d3c20 0x5581999d4040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3895791423 >> 172.21.15.167:0/3895791423 conn(0x5581999c8d70 msgr2=0x5581999cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3895791423 shutdown_connections 2024-09-18T02:04:19.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/3895791423 wait complete. 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5581999bf740 msgr2=0x5581999c1b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5581999bf740 0x5581999c1b30 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5581998c7a90 msgr2=0x5581999bcde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5581998c7a90 0x5581999bcde0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5581999c3660 msgr2=0x5581999c5a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5581999c3660 0x5581999c5a50 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05d4034650 msgr2=0x7f05d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f05d4034650 0x7f05d4036b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06e40ad000 tx=0x7f06e40a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 msgr2=0x5581999b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 --2- 172.21.15.167:0/2926169357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558199837ac0 0x5581999b5e50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f06e8001e20 tx=0x7f06e8000ee0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06edcb7640 1 -- 172.21.15.167:0/2926169357 reap_dead start 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 shutdown_connections 2024-09-18T02:04:19.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 >> 172.21.15.167:0/2926169357 conn(0x5581998be060 msgr2=0x5581999a9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 shutdown_connections 2024-09-18T02:04:19.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.016+0000 7f06ef9a6980 1 -- 172.21.15.167:0/2926169357 wait complete. 2024-09-18T02:04:19.029 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:19.029 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-18T02:04:19.029 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-18T02:04:19.029 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-18T02:04:19.102 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:19.102 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:19.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.100+0000 7f905c784980 1 Processor -- start 2024-09-18T02:04:19.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.100+0000 7f905c784980 1 -- start start 2024-09-18T02:04:19.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.100+0000 7f905c784980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ebc5c91b30 0x55ebc5c902f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.100+0000 7f905c784980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ebc5ba3ae0 con 0x55ebc5c91f40 2024-09-18T02:04:19.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.100+0000 7f905c784980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55ebc5bc7e30 con 0x55ebc5c91b30 2024-09-18T02:04:19.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.100+0000 7f905a294640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ebc5c91b30 0x55ebc5c902f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.100+0000 7f9059a93640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55ebc5c91f40 0x55ebc5c90830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55510/0 (socket says 172.21.15.167:55510) 2024-09-18T02:04:19.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.100+0000 7f905a294640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ebc5c91b30 0x55ebc5c902f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56602/0 (socket says 172.21.15.167:56602) 2024-09-18T02:04:19.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.100+0000 7f9059a93640 1 -- 172.21.15.167:0/182444264 learned_addr learned my addr 172.21.15.167:0/182444264 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:19.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.100+0000 7f905a294640 1 -- 172.21.15.167:0/182444264 >> v1:172.21.15.81:6789/0 conn(0x55ebc5c91f40 legacy=0x55ebc5c90830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.100+0000 7f905a294640 1 -- 172.21.15.167:0/182444264 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc5c91060 con 0x55ebc5c91b30 2024-09-18T02:04:19.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.104+0000 7f905a294640 1 --2- 172.21.15.167:0/182444264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91b30 0x55ebc5c902f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f904400a480 tx=0x7f904401b0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a4d7c7f0148160 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.104+0000 7f9059292640 1 -- 172.21.15.167:0/182444264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440af070 con 0x55ebc5c91b30 2024-09-18T02:04:19.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.104+0000 7f9059292640 1 -- 172.21.15.167:0/182444264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90440aa530 con 0x55ebc5c91b30 2024-09-18T02:04:19.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.104+0000 7f9059292640 1 -- 172.21.15.167:0/182444264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440a3e60 con 0x55ebc5c91b30 2024-09-18T02:04:19.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.104+0000 7f905c784980 1 -- 172.21.15.167:0/182444264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91b30 msgr2=0x55ebc5c902f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.104+0000 7f905c784980 1 --2- 172.21.15.167:0/182444264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91b30 0x55ebc5c902f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f904400a480 tx=0x7f904401b0a0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.104+0000 7f905c784980 1 -- 172.21.15.167:0/182444264 shutdown_connections 2024-09-18T02:04:19.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.104+0000 7f905c784980 1 --2- 172.21.15.167:0/182444264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91b30 0x55ebc5c902f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.104+0000 7f905c784980 1 -- 172.21.15.167:0/182444264 >> 172.21.15.167:0/182444264 conn(0x55ebc5d17110 msgr2=0x55ebc5d19530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.104+0000 7f905c784980 1 -- 172.21.15.167:0/182444264 shutdown_connections 2024-09-18T02:04:19.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.104+0000 7f905c784980 1 -- 172.21.15.167:0/182444264 wait complete. 2024-09-18T02:04:19.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.116+0000 7f905c784980 1 Processor -- start 2024-09-18T02:04:19.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.116+0000 7f905c784980 1 -- start start 2024-09-18T02:04:19.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.116+0000 7f905c784980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91b30 0x55ebc5e0d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.116+0000 7f905c784980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebc5bc9200 con 0x55ebc5c91b30 2024-09-18T02:04:19.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.116+0000 7f905a294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91b30 0x55ebc5e0d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.116+0000 7f905a294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91b30 0x55ebc5e0d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56610/0 (socket says 172.21.15.167:56610) 2024-09-18T02:04:19.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.116+0000 7f905a294640 1 -- 172.21.15.167:0/3830264330 learned_addr learned my addr 172.21.15.167:0/3830264330 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.116+0000 7f905a294640 1 -- 172.21.15.167:0/3830264330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc5e0da50 con 0x55ebc5c91b30 2024-09-18T02:04:19.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905a294640 1 --2- 172.21.15.167:0/3830264330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91b30 0x55ebc5e0d480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f90440ad040 tx=0x7f9044003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4aaa5656c2e499 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f8f48608640 1 -- 172.21.15.167:0/3830264330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440af040 con 0x55ebc5c91b30 2024-09-18T02:04:19.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f8f48608640 1 -- 172.21.15.167:0/3830264330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90440aa9d0 con 0x55ebc5c91b30 2024-09-18T02:04:19.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f8f48608640 1 -- 172.21.15.167:0/3830264330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440aad30 con 0x55ebc5c91b30 2024-09-18T02:04:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 -- 172.21.15.167:0/3830264330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91b30 msgr2=0x55ebc5e0d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 --2- 172.21.15.167:0/3830264330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91b30 0x55ebc5e0d480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f90440ad040 tx=0x7f9044003030 comp rx=0 tx=0).stop 2024-09-18T02:04:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 -- 172.21.15.167:0/3830264330 shutdown_connections 2024-09-18T02:04:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 --2- 172.21.15.167:0/3830264330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91b30 0x55ebc5e0d480 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 -- 172.21.15.167:0/3830264330 >> 172.21.15.167:0/3830264330 conn(0x55ebc5d17110 msgr2=0x55ebc5e090b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 -- 172.21.15.167:0/3830264330 shutdown_connections 2024-09-18T02:04:19.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 -- 172.21.15.167:0/3830264330 wait complete. 2024-09-18T02:04:19.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 Processor -- start 2024-09-18T02:04:19.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 -- start start 2024-09-18T02:04:19.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91f40 0x55ebc5e14a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebc5d2b950 con 0x55ebc5c91f40 2024-09-18T02:04:19.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905a294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91f40 0x55ebc5e14a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905a294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91f40 0x55ebc5e14a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56618/0 (socket says 172.21.15.167:56618) 2024-09-18T02:04:19.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905a294640 1 -- 172.21.15.167:0/1873799352 learned_addr learned my addr 172.21.15.167:0/1873799352 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905a294640 1 -- 172.21.15.167:0/1873799352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc5e14f40 con 0x55ebc5c91f40 2024-09-18T02:04:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905a294640 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91f40 0x55ebc5e14a00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9044018cd0 tx=0x7f9044017e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f8f46e05640 1 -- 172.21.15.167:0/1873799352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440af070 con 0x55ebc5c91f40 2024-09-18T02:04:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebc5e151d0 con 0x55ebc5c91f40 2024-09-18T02:04:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f8f46e05640 1 -- 172.21.15.167:0/1873799352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90440b57b0 con 0x55ebc5c91f40 2024-09-18T02:04:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f8f46e05640 1 -- 172.21.15.167:0/1873799352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440b5ad0 con 0x55ebc5c91f40 2024-09-18T02:04:19.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.120+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebc5e17eb0 con 0x55ebc5c91f40 2024-09-18T02:04:19.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f8f46e05640 1 -- 172.21.15.167:0/1873799352 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f90440b5c70 con 0x55ebc5c91f40 2024-09-18T02:04:19.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f8f46e05640 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f40034650 0x7f8f40036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f8f46e05640 1 -- 172.21.15.167:0/1873799352 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f90440bb070 con 0x55ebc5c91f40 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f9059a93640 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f40034650 0x7f8f40036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905c784980 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebc5e19af0 0x55ebc5e1bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e1c420 con 0x55ebc5e19af0 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905aa95640 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebc5e19af0 0x55ebc5e1bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f9059a93640 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f40034650 0x7f8f40036b10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f904c001650 tx=0x7f904c006740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905aa95640 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebc5e19af0 0x55ebc5e1bee0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905aa95640 1 -- 172.21.15.167:0/1873799352 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90540083f0 con 0x55ebc5e19af0 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e190d0 con 0x55ebc5e19af0 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905aa95640 1 -- 172.21.15.167:0/1873799352 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90540083f0 con 0x55ebc5e19af0 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905c784980 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebc5e1e6e0 0x55ebc5e20ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e211a0 con 0x55ebc5e1e6e0 2024-09-18T02:04:19.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905a294640 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebc5e1e6e0 0x55ebc5e20ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905a294640 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebc5e1e6e0 0x55ebc5e20ad0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905a294640 1 -- 172.21.15.167:0/1873799352 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f90440b2040 con 0x55ebc5e1e6e0 2024-09-18T02:04:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.124+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e1d580 con 0x55ebc5e19af0 2024-09-18T02:04:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905aa95640 1 -- 172.21.15.167:0/1873799352 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90540083f0 con 0x55ebc5e19af0 2024-09-18T02:04:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905c784980 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebc5e225e0 0x55ebc5e249d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e25160 con 0x55ebc5e225e0 2024-09-18T02:04:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f9059a93640 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebc5e225e0 0x55ebc5e249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f9059a93640 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebc5e225e0 0x55ebc5e249d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f9059a93640 1 -- 172.21.15.167:0/1873799352 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f904c00f070 con 0x55ebc5e225e0 2024-09-18T02:04:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905c784980 1 Processor -- start 2024-09-18T02:04:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905c784980 1 -- start start 2024-09-18T02:04:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905c784980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e32bf0 0x55ebc5e33030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905c784980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebc5c22800 con 0x55ebc5e32bf0 2024-09-18T02:04:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905a294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e32bf0 0x55ebc5e33030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905a294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e32bf0 0x55ebc5e33030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56630/0 (socket says 172.21.15.167:56630) 2024-09-18T02:04:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905a294640 1 -- 172.21.15.167:0/1257553185 learned_addr learned my addr 172.21.15.167:0/1257553185 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905a294640 1 -- 172.21.15.167:0/1257553185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc5e33570 con 0x55ebc5e32bf0 2024-09-18T02:04:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905a294640 1 --2- 172.21.15.167:0/1257553185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e32bf0 0x55ebc5e33030 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f90440bd6b0 tx=0x7f9044006dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f8f3ffff640 1 -- 172.21.15.167:0/1257553185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440bd950 con 0x55ebc5e32bf0 2024-09-18T02:04:19.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f8f3ffff640 1 -- 172.21.15.167:0/1257553185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90440d5070 con 0x55ebc5e32bf0 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905c784980 1 -- 172.21.15.167:0/1257553185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebc5e361a0 con 0x55ebc5e32bf0 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f8f3ffff640 1 -- 172.21.15.167:0/1257553185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440bdc60 con 0x55ebc5e32bf0 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.128+0000 7f905c784980 1 -- 172.21.15.167:0/1257553185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebc5e36550 con 0x55ebc5e32bf0 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f8f3ffff640 1 -- 172.21.15.167:0/1257553185 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f90440d7030 con 0x55ebc5e32bf0 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f8f3ffff640 1 --2- 172.21.15.167:0/1257553185 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f34034650 0x7f8f34036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f8f3ffff640 1 -- 172.21.15.167:0/1257553185 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f90440daac0 con 0x55ebc5e32bf0 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f9059a93640 1 --2- 172.21.15.167:0/1257553185 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f34034650 0x7f8f34036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 Processor -- start 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 -- start start 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 0x55ebc5e3f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebc5e0dd70 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f9059a93640 1 --2- 172.21.15.167:0/1257553185 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f34034650 0x7f8f34036b10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f904c006340 tx=0x7f904c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905a294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 0x55ebc5e3f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905a294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 0x55ebc5e3f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56644/0 (socket says 172.21.15.167:56644) 2024-09-18T02:04:19.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905a294640 1 -- 172.21.15.167:0/2186362947 learned_addr learned my addr 172.21.15.167:0/2186362947 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905a294640 1 -- 172.21.15.167:0/2186362947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc5e3fe60 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905a294640 1 --2- 172.21.15.167:0/2186362947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 0x55ebc5e3f890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f90440e2fb0 tx=0x7f90440e5830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5a39b63d9e2586 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f8f3dffb640 1 -- 172.21.15.167:0/2186362947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440f4070 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f8f3dffb640 1 -- 172.21.15.167:0/2186362947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90440e5a10 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f8f3dffb640 1 -- 172.21.15.167:0/2186362947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440dc4e0 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 -- 172.21.15.167:0/2186362947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 msgr2=0x55ebc5e3f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 --2- 172.21.15.167:0/2186362947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 0x55ebc5e3f890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f90440e2fb0 tx=0x7f90440e5830 comp rx=0 tx=0).stop 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 -- 172.21.15.167:0/2186362947 shutdown_connections 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 --2- 172.21.15.167:0/2186362947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 0x55ebc5e3f890 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 -- 172.21.15.167:0/2186362947 >> 172.21.15.167:0/2186362947 conn(0x55ebc5e3b890 msgr2=0x55ebc5e39990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 -- 172.21.15.167:0/2186362947 shutdown_connections 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 -- 172.21.15.167:0/2186362947 wait complete. 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 Processor -- start 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 -- start start 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 0x55ebc5e46620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905c784980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebc5e40300 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905a294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 0x55ebc5e46620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905a294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 0x55ebc5e46620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56656/0 (socket says 172.21.15.167:56656) 2024-09-18T02:04:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.132+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 learned_addr learned my addr 172.21.15.167:0/3680744239 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc5e46b60 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905a294640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 0x55ebc5e46620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f90440e5870 tx=0x7f90440b9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f8f2bfff640 1 -- 172.21.15.167:0/3680744239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9044109070 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebc5e46b60 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f8f2bfff640 1 -- 172.21.15.167:0/3680744239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90440bcc00 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebc5e46b60 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f8f2bfff640 1 -- 172.21.15.167:0/3680744239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440dc0b0 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f8f2bfff640 1 -- 172.21.15.167:0/3680744239 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f904410c070 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f8f2bfff640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f24034650 0x7f8f24036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f8f2bfff640 1 -- 172.21.15.167:0/3680744239 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f90440ff030 con 0x55ebc5e3f4b0 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f9059a93640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f24034650 0x7f8f24036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebc5e517a0 0x55ebc5e53c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e543b0 con 0x55ebc5e517a0 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905aa95640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebc5e517a0 0x55ebc5e53c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f9059a93640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f24034650 0x7f8f24036b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55ebc5e25560 tx=0x7f904c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905aa95640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebc5e517a0 0x55ebc5e53c60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90540083f0 con 0x55ebc5e517a0 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 20 realm 2024-09-18T02:04:19.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e547c0 con 0x55ebc5e517a0 2024-09-18T02:04:19.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90540083f0 con 0x55ebc5e517a0 2024-09-18T02:04:19.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:19.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55090 con 0x55ebc5e517a0 2024-09-18T02:04:19.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90540083f0 con 0x55ebc5e517a0 2024-09-18T02:04:19.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e517a0 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90540083f0 con 0x55ebc5e517a0 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebc5e56190 0x55ebc5e58580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e58b90 con 0x55ebc5e56190 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.136+0000 7f905a294640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebc5e56190 0x55ebc5e58580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905a294640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebc5e56190 0x55ebc5e58580 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905c784980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:19.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905c784980 20 searching for the correct realm 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905c784980 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebc5e5aae0 0x55ebc5e5cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e5d600 con 0x55ebc5e5aae0 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f9059a93640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebc5e5aae0 0x55ebc5e5cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f9059a93640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebc5e5aae0 0x55ebc5e5cf30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904c00f070 con 0x55ebc5e5aae0 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f9059a93640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f904c024070 0x7f904c031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e5d600 con 0x7f904c024070 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905aa95640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f904c024070 0x7f904c031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905aa95640 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f904c024070 0x7f904c031970 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90540083f0 con 0x7f904c024070 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e56190 2024-09-18T02:04:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e517a0 2024-09-18T02:04:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90540083f0 con 0x55ebc5e517a0 2024-09-18T02:04:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e517a0 2024-09-18T02:04:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.140+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e56190 2024-09-18T02:04:19.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e56190 2024-09-18T02:04:19.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x7f904c024070 2024-09-18T02:04:19.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e5aae0 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904c00f070 con 0x55ebc5e5aae0 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e517a0 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e56190 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e517a0 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x7f904c024070 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e5aae0 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e5aae0 2024-09-18T02:04:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e56190 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.144+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e5aae0 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e5aae0 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e517a0 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e517a0 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e56190 2024-09-18T02:04:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e5aae0 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x7f904c024070 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e517a0 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e56190 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e5aae0 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e56190 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x7f904c024070 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e5aae0 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.148+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e56190 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x55ebc5e517a0 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e55430 con 0x7f904c024070 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e59450 con 0x55ebc5e517a0 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e59450 con 0x55ebc5e517a0 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e59450 con 0x55ebc5e5aae0 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 zone default found 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 4 Realm: () 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 zonegroup default 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e59e50 con 0x55ebc5e56190 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e599e0 con 0x55ebc5e5aae0 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e5fa20 con 0x55ebc5e5aae0 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 started sync module instance, tier type = 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e5eda0 con 0x7f904c024070 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.152+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.156+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94471125856960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e5eda0 con 0x7f904c024070 2024-09-18T02:04:19.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.156+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e60540 con 0x55ebc5e517a0 2024-09-18T02:04:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.156+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94471125856960] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.156+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.156+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94471125860432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e5eda0 con 0x55ebc5e517a0 2024-09-18T02:04:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.156+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e60f80 con 0x55ebc5e5aae0 2024-09-18T02:04:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.156+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94471125860432] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.160+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.160+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94471125854448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e5ed10 con 0x55ebc5e5aae0 2024-09-18T02:04:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.160+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e61cd0 con 0x7f904c024070 2024-09-18T02:04:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.160+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.160+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94471125866800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e623c0 con 0x7f904c024070 2024-09-18T02:04:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.160+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e62ee0 con 0x55ebc5e517a0 2024-09-18T02:04:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.160+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94471125866800] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.160+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94471125854448] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.160+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.160+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94471125865328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e62ea0 con 0x55ebc5e517a0 2024-09-18T02:04:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.160+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e632d0 con 0x55ebc5e56190 2024-09-18T02:04:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.164+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94471125865328] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.164+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.164+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94471125871024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e636c0 con 0x55ebc5e56190 2024-09-18T02:04:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.164+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e64080 con 0x55ebc5e56190 2024-09-18T02:04:19.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.164+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94471125871024] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.164+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.164+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94471125868048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e648d0 con 0x55ebc5e56190 2024-09-18T02:04:19.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.164+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e65160 con 0x55ebc5e56190 2024-09-18T02:04:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94471125868048] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94471125877792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e65340 con 0x55ebc5e56190 2024-09-18T02:04:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905c784980 20 add_watcher() i=0 2024-09-18T02:04:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905c784980 20 add_watcher() i=1 2024-09-18T02:04:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905c784980 20 add_watcher() i=2 2024-09-18T02:04:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905c784980 20 add_watcher() i=3 2024-09-18T02:04:19.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905c784980 20 add_watcher() i=4 2024-09-18T02:04:19.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905c784980 20 add_watcher() i=5 2024-09-18T02:04:19.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905c784980 20 add_watcher() i=6 2024-09-18T02:04:19.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94471125877792] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905c784980 20 add_watcher() i=7 2024-09-18T02:04:19.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905c784980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:19.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e68710 con 0x55ebc5e517a0 2024-09-18T02:04:19.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.168+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94471125881392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e65b00 con 0x55ebc5e517a0 2024-09-18T02:04:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94471125881392] v30'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f8f10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 5 note: GC not initialized 2024-09-18T02:04:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f8e8b7fe640 20 reqs_thread_entry: start 2024-09-18T02:04:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 20 Filter name: none 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f8e897fa640 20 reqs_thread_entry: start 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e8bd10 con 0x55ebc5e517a0 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e8caa0 con 0x7f904c024070 2024-09-18T02:04:19.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-18T02:04:19.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-18T02:04:19.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-18T02:04:19.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e92800 con 0x55ebc5e517a0 2024-09-18T02:04:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v30'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94471126065808 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e8f390 con 0x55ebc5e517a0 2024-09-18T02:04:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94471125865328 notify 128849018887 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f9054010040 con 0x55ebc5e517a0 2024-09-18T02:04:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f8f3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94471125865328 notifier 4396 bl.length()=849 2024-09-18T02:04:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f8f3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f8f3dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify cookie 94471126065808 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.172+0000 7f8f3dffb640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8f20003eb0 con 0x55ebc5e517a0 2024-09-18T02:04:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94471126065808 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f905400adb0 con 0x55ebc5e517a0 2024-09-18T02:04:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e92290 con 0x7f904c024070 2024-09-18T02:04:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905c784980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-18T02:04:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905c784980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-18T02:04:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905c784980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-18T02:04:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94471126065808 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e8f340 con 0x7f904c024070 2024-09-18T02:04:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== watch-notify(notify (1) cookie 94471125856960 notify 128849018883 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f905400adb0 con 0x7f904c024070 2024-09-18T02:04:19.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f8f3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94471125856960 notifier 4396 bl.length()=166 2024-09-18T02:04:19.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f8f3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-18T02:04:19.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f8f3d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-18T02:04:19.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(68 notify.0 [notify cookie 94471126065808 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f8f3d7fa640 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8e90003410 con 0x7f904c024070 2024-09-18T02:04:19.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== watch-notify(notify_complete (2) cookie 94471126065808 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f905402a9d0 con 0x7f904c024070 2024-09-18T02:04:19.182 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T02:04:19.175330Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.176+0000 7f8f10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.180+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94471125881392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e89b00 con 0x55ebc5e517a0 2024-09-18T02:04:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.180+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94471125881392] v30'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.180+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94471125856960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e89b00 con 0x7f904c024070 2024-09-18T02:04:19.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.180+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94471125856960] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.180+0000 7f905c784980 20 remove_watcher() i=0 2024-09-18T02:04:19.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.180+0000 7f905c784980 2 removed watcher, disabling cache 2024-09-18T02:04:19.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.180+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94471125860432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e5f2c0 con 0x55ebc5e517a0 2024-09-18T02:04:19.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.184+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94471125860432] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.184+0000 7f905c784980 20 remove_watcher() i=1 2024-09-18T02:04:19.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.184+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94471125854448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e89b00 con 0x55ebc5e5aae0 2024-09-18T02:04:19.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.184+0000 7f9059a93640 1 -- 172.21.15.167:0/3680744239 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94471125854448] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904c040040 con 0x55ebc5e5aae0 2024-09-18T02:04:19.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.184+0000 7f905c784980 20 remove_watcher() i=2 2024-09-18T02:04:19.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.184+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94471125866800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e60050 con 0x7f904c024070 2024-09-18T02:04:19.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.184+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94471125866800] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x7f904c024070 2024-09-18T02:04:19.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.184+0000 7f905c784980 20 remove_watcher() i=3 2024-09-18T02:04:19.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.184+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94471125865328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e5f2c0 con 0x55ebc5e517a0 2024-09-18T02:04:19.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.188+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94471125865328] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9054026040 con 0x55ebc5e517a0 2024-09-18T02:04:19.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.188+0000 7f905c784980 20 remove_watcher() i=4 2024-09-18T02:04:19.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.188+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94471125871024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e5e8f0 con 0x55ebc5e56190 2024-09-18T02:04:19.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.188+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94471125871024] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.188+0000 7f905c784980 20 remove_watcher() i=5 2024-09-18T02:04:19.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.188+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94471125868048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e61930 con 0x55ebc5e56190 2024-09-18T02:04:19.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.192+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94471125868048] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.192+0000 7f905c784980 20 remove_watcher() i=6 2024-09-18T02:04:19.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.192+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94471125877792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebc5e60050 con 0x55ebc5e56190 2024-09-18T02:04:19.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905a294640 1 -- 172.21.15.167:0/3680744239 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94471125877792] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904410b030 con 0x55ebc5e56190 2024-09-18T02:04:19.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 20 remove_watcher() i=7 2024-09-18T02:04:19.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebc5e56190 msgr2=0x55ebc5e58580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebc5e56190 0x55ebc5e58580 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebc5e517a0 msgr2=0x55ebc5e53c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebc5e517a0 0x55ebc5e53c60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f904c024070 msgr2=0x7f904c031970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f904c024070 0x7f904c031970 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebc5e5aae0 msgr2=0x55ebc5e5cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebc5e5aae0 0x55ebc5e5cf30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f24034650 msgr2=0x7f8f24036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f24034650 0x7f8f24036b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55ebc5e25560 tx=0x7f904c010000 comp rx=0 tx=0).stop 2024-09-18T02:04:19.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 msgr2=0x55ebc5e46620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/3680744239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e3f4b0 0x55ebc5e46620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f90440e5870 tx=0x7f90440b9fb0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905aa95640 1 -- 172.21.15.167:0/3680744239 reap_dead start 2024-09-18T02:04:19.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 shutdown_connections 2024-09-18T02:04:19.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 >> 172.21.15.167:0/3680744239 conn(0x55ebc5e3b890 msgr2=0x55ebc5e39960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 shutdown_connections 2024-09-18T02:04:19.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/3680744239 wait complete. 2024-09-18T02:04:19.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1257553185 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f34034650 msgr2=0x7f8f34036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/1257553185 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f34034650 0x7f8f34036b10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f904c006340 tx=0x7f904c00f000 comp rx=0 tx=0).stop 2024-09-18T02:04:19.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1257553185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e32bf0 msgr2=0x55ebc5e33030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/1257553185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e32bf0 0x55ebc5e33030 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f90440bd6b0 tx=0x7f9044006dd0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1257553185 shutdown_connections 2024-09-18T02:04:19.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/1257553185 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f34034650 0x7f8f34036b10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/1257553185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5e32bf0 0x55ebc5e33030 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1257553185 >> 172.21.15.167:0/1257553185 conn(0x55ebc5e27d40 msgr2=0x55ebc5e2a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1257553185 shutdown_connections 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1257553185 wait complete. 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebc5e1e6e0 msgr2=0x55ebc5e20ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebc5e1e6e0 0x55ebc5e20ad0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebc5e19af0 msgr2=0x55ebc5e1bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebc5e19af0 0x55ebc5e1bee0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebc5e225e0 msgr2=0x55ebc5e249d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebc5e225e0 0x55ebc5e249d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f40034650 msgr2=0x7f8f40036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8f40034650 0x7f8f40036b10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f904c001650 tx=0x7f904c006740 comp rx=0 tx=0).stop 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91f40 msgr2=0x55ebc5e14a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 --2- 172.21.15.167:0/1873799352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebc5c91f40 0x55ebc5e14a00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9044018cd0 tx=0x7f9044017e40 comp rx=0 tx=0).stop 2024-09-18T02:04:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905aa95640 1 -- 172.21.15.167:0/1873799352 reap_dead start 2024-09-18T02:04:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 shutdown_connections 2024-09-18T02:04:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 >> 172.21.15.167:0/1873799352 conn(0x55ebc5d17110 msgr2=0x55ebc5e07c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 shutdown_connections 2024-09-18T02:04:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.196+0000 7f905c784980 1 -- 172.21.15.167:0/1873799352 wait complete. 2024-09-18T02:04:19.208 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T02:04:19.175330Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:19.209 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T02:04:19.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T02:04:19.209 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T02:04:19.275 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:19.275 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:19.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.272+0000 7fb6253ca980 1 Processor -- start 2024-09-18T02:04:19.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.272+0000 7fb6253ca980 1 -- start start 2024-09-18T02:04:19.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.272+0000 7fb6253ca980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5609fa2d9a10 0x5609fa2dbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.272+0000 7fb6253ca980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5609fa15dae0 con 0x5609fa2d5690 2024-09-18T02:04:19.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.272+0000 7fb6253ca980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x5609fa181e30 con 0x5609fa2d9a10 2024-09-18T02:04:19.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.272+0000 7fb6226d9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5609fa2d9a10 0x5609fa2dbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.272+0000 7fb622eda640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5609fa2d5690 0x5609fa2d5a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55516/0 (socket says 172.21.15.167:55516) 2024-09-18T02:04:19.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.272+0000 7fb622eda640 1 -- 172.21.15.167:0/4023524290 learned_addr learned my addr 172.21.15.167:0/4023524290 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:19.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb6226d9640 1 -- 172.21.15.167:0/4023524290 >> v1:172.21.15.81:6789/0 conn(0x5609fa2d5690 legacy=0x5609fa2d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb6226d9640 1 -- 172.21.15.167:0/4023524290 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609fa2dd350 con 0x5609fa2d9a10 2024-09-18T02:04:19.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb6226d9640 1 --2- 172.21.15.167:0/4023524290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d9a10 0x5609fa2dbe00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb61800a480 tx=0x7fb61801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dad5a3529478f30 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb621ed8640 1 -- 172.21.15.167:0/4023524290 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6180b0070 con 0x5609fa2d9a10 2024-09-18T02:04:19.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb621ed8640 1 -- 172.21.15.167:0/4023524290 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6180ab540 con 0x5609fa2d9a10 2024-09-18T02:04:19.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb621ed8640 1 -- 172.21.15.167:0/4023524290 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6180ab840 con 0x5609fa2d9a10 2024-09-18T02:04:19.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb6253ca980 1 -- 172.21.15.167:0/4023524290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d9a10 msgr2=0x5609fa2dbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb6253ca980 1 --2- 172.21.15.167:0/4023524290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d9a10 0x5609fa2dbe00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb61800a480 tx=0x7fb61801b280 comp rx=0 tx=0).stop 2024-09-18T02:04:19.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb6253ca980 1 -- 172.21.15.167:0/4023524290 shutdown_connections 2024-09-18T02:04:19.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb6253ca980 1 --2- 172.21.15.167:0/4023524290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d9a10 0x5609fa2dbe00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb6253ca980 1 -- 172.21.15.167:0/4023524290 >> 172.21.15.167:0/4023524290 conn(0x5609fa2d11b0 msgr2=0x5609fa2d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb6253ca980 1 -- 172.21.15.167:0/4023524290 shutdown_connections 2024-09-18T02:04:19.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.276+0000 7fb6253ca980 1 -- 172.21.15.167:0/4023524290 wait complete. 2024-09-18T02:04:19.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 Processor -- start 2024-09-18T02:04:19.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 -- start start 2024-09-18T02:04:19.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 0x5609fa24c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5609fa183200 con 0x5609fa2d5690 2024-09-18T02:04:19.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb622eda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 0x5609fa24c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb622eda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 0x5609fa24c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56678/0 (socket says 172.21.15.167:56678) 2024-09-18T02:04:19.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb622eda640 1 -- 172.21.15.167:0/2658963458 learned_addr learned my addr 172.21.15.167:0/2658963458 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb622eda640 1 -- 172.21.15.167:0/2658963458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609fa24c940 con 0x5609fa2d5690 2024-09-18T02:04:19.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb622eda640 1 --2- 172.21.15.167:0/2658963458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 0x5609fa24c370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb6140017b0 tx=0x7fb614001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d76e59b5bdf5e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb510e09640 1 -- 172.21.15.167:0/2658963458 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb614016070 con 0x5609fa2d5690 2024-09-18T02:04:19.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb510e09640 1 -- 172.21.15.167:0/2658963458 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb614004530 con 0x5609fa2d5690 2024-09-18T02:04:19.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb510e09640 1 -- 172.21.15.167:0/2658963458 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb614004870 con 0x5609fa2d5690 2024-09-18T02:04:19.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 -- 172.21.15.167:0/2658963458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 msgr2=0x5609fa24c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 --2- 172.21.15.167:0/2658963458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 0x5609fa24c370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb6140017b0 tx=0x7fb614001c70 comp rx=0 tx=0).stop 2024-09-18T02:04:19.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 -- 172.21.15.167:0/2658963458 shutdown_connections 2024-09-18T02:04:19.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 --2- 172.21.15.167:0/2658963458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 0x5609fa24c370 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 -- 172.21.15.167:0/2658963458 >> 172.21.15.167:0/2658963458 conn(0x5609fa2d11b0 msgr2=0x5609fa3bc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 -- 172.21.15.167:0/2658963458 shutdown_connections 2024-09-18T02:04:19.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 -- 172.21.15.167:0/2658963458 wait complete. 2024-09-18T02:04:19.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 Processor -- start 2024-09-18T02:04:19.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 -- start start 2024-09-18T02:04:19.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 0x5609fa3ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb6253ca980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5609fa2dce50 con 0x5609fa2d5690 2024-09-18T02:04:19.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb622eda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 0x5609fa3ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb622eda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 0x5609fa3ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56682/0 (socket says 172.21.15.167:56682) 2024-09-18T02:04:19.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.292+0000 7fb622eda640 1 -- 172.21.15.167:0/113451281 learned_addr learned my addr 172.21.15.167:0/113451281 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb622eda640 1 -- 172.21.15.167:0/113451281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609fa3ca560 con 0x5609fa2d5690 2024-09-18T02:04:19.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb622eda640 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 0x5609fa3ca020 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb614014040 tx=0x7fb614001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb50f606640 1 -- 172.21.15.167:0/113451281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb614020070 con 0x5609fa2d5690 2024-09-18T02:04:19.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609fa3ca7f0 con 0x5609fa2d5690 2024-09-18T02:04:19.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb50f606640 1 -- 172.21.15.167:0/113451281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb614011400 con 0x5609fa2d5690 2024-09-18T02:04:19.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb50f606640 1 -- 172.21.15.167:0/113451281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb614016040 con 0x5609fa2d5690 2024-09-18T02:04:19.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609fa3cd4d0 con 0x5609fa2d5690 2024-09-18T02:04:19.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb50f606640 1 -- 172.21.15.167:0/113451281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb614023070 con 0x5609fa2d5690 2024-09-18T02:04:19.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb50f606640 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb508034650 0x7fb508036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb50f606640 1 -- 172.21.15.167:0/113451281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb614048f20 con 0x5609fa2d5690 2024-09-18T02:04:19.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6226d9640 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb508034650 0x7fb508036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6253ca980 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5609fa2d9a10 0x5609fa3d1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa3d1660 con 0x5609fa2d9a10 2024-09-18T02:04:19.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6236db640 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5609fa2d9a10 0x5609fa3d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6226d9640 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb508034650 0x7fb508036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb6180ad000 tx=0x7fb6180a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6236db640 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5609fa2d9a10 0x5609fa3d1120 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6236db640 1 -- 172.21.15.167:0/113451281 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb61c0083f0 con 0x5609fa2d9a10 2024-09-18T02:04:19.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa3ce6d0 con 0x5609fa2d9a10 2024-09-18T02:04:19.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6236db640 1 -- 172.21.15.167:0/113451281 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb61c0083f0 con 0x5609fa2d9a10 2024-09-18T02:04:19.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6253ca980 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5609fa3d3980 0x5609fa3d5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.296+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa3d6460 con 0x5609fa3d3980 2024-09-18T02:04:19.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb622eda640 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5609fa3d3980 0x5609fa3d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb622eda640 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5609fa3d3980 0x5609fa3d5d70 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb622eda640 1 -- 172.21.15.167:0/113451281 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb61402c070 con 0x5609fa3d3980 2024-09-18T02:04:19.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa3d27f0 con 0x5609fa2d9a10 2024-09-18T02:04:19.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb6236db640 1 -- 172.21.15.167:0/113451281 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb61c0083f0 con 0x5609fa2d9a10 2024-09-18T02:04:19.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb6253ca980 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5609fa3d78c0 0x5609fa3d9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa3da3b0 con 0x5609fa3d78c0 2024-09-18T02:04:19.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb6226d9640 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5609fa3d78c0 0x5609fa3d9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb6226d9640 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5609fa3d78c0 0x5609fa3d9cb0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb6226d9640 1 -- 172.21.15.167:0/113451281 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb6180b3040 con 0x5609fa3d78c0 2024-09-18T02:04:19.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb6253ca980 1 Processor -- start 2024-09-18T02:04:19.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb6253ca980 1 -- start start 2024-09-18T02:04:19.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb6253ca980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3e7e40 0x5609fa3e8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb6253ca980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5609fa1dc800 con 0x5609fa3e7e40 2024-09-18T02:04:19.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb622eda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3e7e40 0x5609fa3e8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb622eda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3e7e40 0x5609fa3e8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56684/0 (socket says 172.21.15.167:56684) 2024-09-18T02:04:19.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb622eda640 1 -- 172.21.15.167:0/4070352397 learned_addr learned my addr 172.21.15.167:0/4070352397 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.300+0000 7fb622eda640 1 -- 172.21.15.167:0/4070352397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609fa3e87a0 con 0x5609fa3e7e40 2024-09-18T02:04:19.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb622eda640 1 --2- 172.21.15.167:0/4070352397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3e7e40 0x5609fa3e8260 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb614047520 tx=0x7fb614024fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb50ce01640 1 -- 172.21.15.167:0/4070352397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb61403f070 con 0x5609fa3e7e40 2024-09-18T02:04:19.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb50ce01640 1 -- 172.21.15.167:0/4070352397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb61401bd50 con 0x5609fa3e7e40 2024-09-18T02:04:19.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb6253ca980 1 -- 172.21.15.167:0/4070352397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609fa3e8a30 con 0x5609fa3e7e40 2024-09-18T02:04:19.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb50ce01640 1 -- 172.21.15.167:0/4070352397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb614026ac0 con 0x5609fa3e7e40 2024-09-18T02:04:19.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb6253ca980 1 -- 172.21.15.167:0/4070352397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609fa3eb6b0 con 0x5609fa3e7e40 2024-09-18T02:04:19.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb50ce01640 1 -- 172.21.15.167:0/4070352397 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb614043040 con 0x5609fa3e7e40 2024-09-18T02:04:19.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb50ce01640 1 --2- 172.21.15.167:0/4070352397 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4fc034650 0x7fb4fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb50ce01640 1 -- 172.21.15.167:0/4070352397 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb61401d9d0 con 0x5609fa3e7e40 2024-09-18T02:04:19.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb6226d9640 1 --2- 172.21.15.167:0/4070352397 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4fc034650 0x7fb4fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb6253ca980 1 Processor -- start 2024-09-18T02:04:19.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb6253ca980 1 -- start start 2024-09-18T02:04:19.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb6226d9640 1 --2- 172.21.15.167:0/4070352397 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4fc034650 0x7fb4fc036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x5609fa3d1b20 tx=0x7fb618005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb6253ca980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb6253ca980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5609fa24ab60 con 0x5609fa3f4790 2024-09-18T02:04:19.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb622eda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb622eda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56686/0 (socket says 172.21.15.167:56686) 2024-09-18T02:04:19.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb622eda640 1 -- 172.21.15.167:0/773286345 learned_addr learned my addr 172.21.15.167:0/773286345 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.304+0000 7fb622eda640 1 -- 172.21.15.167:0/773286345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609fa3f5160 con 0x5609fa3f4790 2024-09-18T02:04:19.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb622eda640 1 --2- 172.21.15.167:0/773286345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3f4b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb6140117c0 tx=0x7fb61402f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80a88b0b7013233 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb5067fc640 1 -- 172.21.15.167:0/773286345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb61402f810 con 0x5609fa3f4790 2024-09-18T02:04:19.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb5067fc640 1 -- 172.21.15.167:0/773286345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb614041070 con 0x5609fa3f4790 2024-09-18T02:04:19.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb5067fc640 1 -- 172.21.15.167:0/773286345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb614026e40 con 0x5609fa3f4790 2024-09-18T02:04:19.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 -- 172.21.15.167:0/773286345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 msgr2=0x5609fa3f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 --2- 172.21.15.167:0/773286345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3f4b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb6140117c0 tx=0x7fb61402f630 comp rx=0 tx=0).stop 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 -- 172.21.15.167:0/773286345 shutdown_connections 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 --2- 172.21.15.167:0/773286345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3f4b90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 -- 172.21.15.167:0/773286345 >> 172.21.15.167:0/773286345 conn(0x5609fa3f0b70 msgr2=0x5609fa3eec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 -- 172.21.15.167:0/773286345 shutdown_connections 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 -- 172.21.15.167:0/773286345 wait complete. 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 Processor -- start 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 -- start start 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5609fa3f5580 con 0x5609fa3f4790 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb622eda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb622eda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56698/0 (socket says 172.21.15.167:56698) 2024-09-18T02:04:19.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 learned_addr learned my addr 172.21.15.167:0/1530828791 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609fa3fbeb0 con 0x5609fa3f4790 2024-09-18T02:04:19.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb622eda640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3fb970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb61401d740 tx=0x7fb61401d6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb504ff9640 1 -- 172.21.15.167:0/1530828791 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb61406f070 con 0x5609fa3f4790 2024-09-18T02:04:19.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb504ff9640 1 -- 172.21.15.167:0/1530828791 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb61402f810 con 0x5609fa3f4790 2024-09-18T02:04:19.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609fa3fbeb0 con 0x5609fa3f4790 2024-09-18T02:04:19.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb504ff9640 1 -- 172.21.15.167:0/1530828791 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb61402d690 con 0x5609fa3f4790 2024-09-18T02:04:19.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.308+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609fa3fbeb0 con 0x5609fa3f4790 2024-09-18T02:04:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb504ff9640 1 -- 172.21.15.167:0/1530828791 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb614072070 con 0x5609fa3f4790 2024-09-18T02:04:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb504ff9640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4ec034650 0x7fb4ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb504ff9640 1 -- 172.21.15.167:0/1530828791 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb614067070 con 0x5609fa3f4790 2024-09-18T02:04:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6226d9640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4ec034650 0x7fb4ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5609fa406890 0x5609fa408d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa4094a0 con 0x5609fa406890 2024-09-18T02:04:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6236db640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5609fa406890 0x5609fa408d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6226d9640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4ec034650 0x7fb4ec036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb61800a480 tx=0x7fb6180b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6236db640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5609fa406890 0x5609fa408d50 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb61c0083f0 con 0x5609fa406890 2024-09-18T02:04:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 20 realm 2024-09-18T02:04:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa4098b0 con 0x5609fa406890 2024-09-18T02:04:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb61c0083f0 con 0x5609fa406890 2024-09-18T02:04:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a150 con 0x5609fa406890 2024-09-18T02:04:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb61c0083f0 con 0x5609fa406890 2024-09-18T02:04:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa406890 2024-09-18T02:04:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb61c0083f0 con 0x5609fa406890 2024-09-18T02:04:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5609fa40b250 0x5609fa40d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40dbc0 con 0x5609fa40b250 2024-09-18T02:04:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb622eda640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5609fa40b250 0x5609fa40d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.312+0000 7fb622eda640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5609fa40b250 0x5609fa40d640 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6253ca980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:19.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6253ca980 20 searching for the correct realm 2024-09-18T02:04:19.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6253ca980 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5609fa40faf0 0x5609fa411fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa412680 con 0x5609fa40faf0 2024-09-18T02:04:19.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6226d9640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5609fa40faf0 0x5609fa411fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6226d9640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5609fa40faf0 0x5609fa411fb0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6226d9640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb6180dc040 0x7fb6180dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa412680 con 0x7fb6180dc040 2024-09-18T02:04:19.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6236db640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb6180dc040 0x7fb6180dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6236db640 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb6180dc040 0x7fb6180dd430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb61c0083f0 con 0x7fb6180dc040 2024-09-18T02:04:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40b250 2024-09-18T02:04:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa406890 2024-09-18T02:04:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb61c0083f0 con 0x5609fa406890 2024-09-18T02:04:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa406890 2024-09-18T02:04:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40b250 2024-09-18T02:04:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40b250 2024-09-18T02:04:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x7fb6180dc040 2024-09-18T02:04:19.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb61c026040 con 0x7fb6180dc040 2024-09-18T02:04:19.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.316+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40faf0 2024-09-18T02:04:19.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa406890 2024-09-18T02:04:19.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40b250 2024-09-18T02:04:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa406890 2024-09-18T02:04:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x7fb6180dc040 2024-09-18T02:04:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb61c026040 con 0x7fb6180dc040 2024-09-18T02:04:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40faf0 2024-09-18T02:04:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40faf0 2024-09-18T02:04:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40b250 2024-09-18T02:04:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40faf0 2024-09-18T02:04:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40faf0 2024-09-18T02:04:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa406890 2024-09-18T02:04:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa406890 2024-09-18T02:04:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.320+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40b250 2024-09-18T02:04:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40faf0 2024-09-18T02:04:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x7fb6180dc040 2024-09-18T02:04:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb61c026040 con 0x7fb6180dc040 2024-09-18T02:04:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa406890 2024-09-18T02:04:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40b250 2024-09-18T02:04:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40faf0 2024-09-18T02:04:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40b250 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x7fb6180dc040 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb61c026040 con 0x7fb6180dc040 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40faf0 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.324+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa40b250 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x5609fa406890 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40a4f0 con 0x7fb6180dc040 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb61c026040 con 0x7fb6180dc040 2024-09-18T02:04:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40e410 con 0x5609fa406890 2024-09-18T02:04:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40e410 con 0x5609fa406890 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40e410 con 0x5609fa40faf0 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 zone default found 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 4 Realm: () 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:19.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 zonegroup default 2024-09-18T02:04:19.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa40ecb0 con 0x5609fa40b250 2024-09-18T02:04:19.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa4144e0 con 0x5609fa40faf0 2024-09-18T02:04:19.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa414880 con 0x5609fa40faf0 2024-09-18T02:04:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 started sync module instance, tier type = 2024-09-18T02:04:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.328+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa413980 con 0x7fb6180dc040 2024-09-18T02:04:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.332+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x7fb6180dc040 2024-09-18T02:04:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.332+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94600853274272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa413980 con 0x7fb6180dc040 2024-09-18T02:04:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.332+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa4152c0 con 0x5609fa406890 2024-09-18T02:04:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.332+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94600853274272] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x7fb6180dc040 2024-09-18T02:04:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.332+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.332+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94600853278096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa413980 con 0x5609fa406890 2024-09-18T02:04:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.332+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa415cd0 con 0x5609fa40faf0 2024-09-18T02:04:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.332+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94600853278096] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.336+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.336+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94600853271760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa4138f0 con 0x5609fa40faf0 2024-09-18T02:04:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.336+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa416a60 con 0x7fb6180dc040 2024-09-18T02:04:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.336+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x7fb6180dc040 2024-09-18T02:04:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.336+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94600853284208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa417300 con 0x7fb6180dc040 2024-09-18T02:04:19.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.336+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa417cc0 con 0x5609fa406890 2024-09-18T02:04:19.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.336+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94600853284208] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x7fb6180dc040 2024-09-18T02:04:19.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.336+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94600853271760] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.336+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.336+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94600853288976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa417c30 con 0x5609fa406890 2024-09-18T02:04:19.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.336+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa417250 con 0x5609fa40b250 2024-09-18T02:04:19.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.340+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94600853288976] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.340+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.340+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94600853286304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa418560 con 0x5609fa40b250 2024-09-18T02:04:19.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.340+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa418db0 con 0x5609fa40b250 2024-09-18T02:04:19.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.340+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.340+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94600853293584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa419500 con 0x5609fa40b250 2024-09-18T02:04:19.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.340+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa41a020 con 0x5609fa40b250 2024-09-18T02:04:19.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.340+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94600853286304] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.344+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94600853293584] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.344+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.344+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94600853297904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa418f50 con 0x5609fa40b250 2024-09-18T02:04:19.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.344+0000 7fb6253ca980 20 add_watcher() i=0 2024-09-18T02:04:19.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.344+0000 7fb6253ca980 20 add_watcher() i=1 2024-09-18T02:04:19.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.344+0000 7fb6253ca980 20 add_watcher() i=2 2024-09-18T02:04:19.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.344+0000 7fb6253ca980 20 add_watcher() i=3 2024-09-18T02:04:19.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.344+0000 7fb6253ca980 20 add_watcher() i=4 2024-09-18T02:04:19.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.344+0000 7fb6253ca980 20 add_watcher() i=5 2024-09-18T02:04:19.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.344+0000 7fb6253ca980 20 add_watcher() i=6 2024-09-18T02:04:19.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94600853297904] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 20 add_watcher() i=7 2024-09-18T02:04:19.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:19.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa41d010 con 0x5609fa406890 2024-09-18T02:04:19.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94600853291104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa41a490 con 0x5609fa406890 2024-09-18T02:04:19.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94600853291104] v30'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb4d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:19.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:19.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 5 note: GC not initialized 2024-09-18T02:04:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb453fff640 20 reqs_thread_entry: start 2024-09-18T02:04:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 20 Filter name: none 2024-09-18T02:04:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb451ffb640 20 reqs_thread_entry: start 2024-09-18T02:04:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609fa4400e0 con 0x5609fa406890 2024-09-18T02:04:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 20 rados_obj.operate() r=0 bl.length=673 2024-09-18T02:04:19.355 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T02:04:19.175330Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:19.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb4d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.348+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94600853291104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa440620 con 0x5609fa406890 2024-09-18T02:04:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.352+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94600853291104] v30'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.352+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94600853274272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa418060 con 0x7fb6180dc040 2024-09-18T02:04:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.352+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94600853274272] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x7fb6180dc040 2024-09-18T02:04:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.352+0000 7fb6253ca980 20 remove_watcher() i=0 2024-09-18T02:04:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.352+0000 7fb6253ca980 2 removed watcher, disabling cache 2024-09-18T02:04:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.352+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94600853278096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa418060 con 0x5609fa406890 2024-09-18T02:04:19.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.352+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94600853278096] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.352+0000 7fb6253ca980 20 remove_watcher() i=1 2024-09-18T02:04:19.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.352+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94600853271760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa418060 con 0x5609fa40faf0 2024-09-18T02:04:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.356+0000 7fb6226d9640 1 -- 172.21.15.167:0/1530828791 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94600853271760] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6180c9030 con 0x5609fa40faf0 2024-09-18T02:04:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.356+0000 7fb6253ca980 20 remove_watcher() i=2 2024-09-18T02:04:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.356+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94600853284208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa418060 con 0x7fb6180dc040 2024-09-18T02:04:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.356+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94600853284208] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x7fb6180dc040 2024-09-18T02:04:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.356+0000 7fb6253ca980 20 remove_watcher() i=3 2024-09-18T02:04:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.356+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94600853288976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa418060 con 0x5609fa406890 2024-09-18T02:04:19.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.360+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94600853288976] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb61c026040 con 0x5609fa406890 2024-09-18T02:04:19.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.360+0000 7fb6253ca980 20 remove_watcher() i=4 2024-09-18T02:04:19.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.360+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94600853286304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa417810 con 0x5609fa40b250 2024-09-18T02:04:19.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.360+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94600853286304] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.360+0000 7fb6253ca980 20 remove_watcher() i=5 2024-09-18T02:04:19.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.360+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94600853293584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa418060 con 0x5609fa40b250 2024-09-18T02:04:19.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94600853293584] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 20 remove_watcher() i=6 2024-09-18T02:04:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94600853297904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609fa417810 con 0x5609fa40b250 2024-09-18T02:04:19.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb622eda640 1 -- 172.21.15.167:0/1530828791 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94600853297904] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb614071030 con 0x5609fa40b250 2024-09-18T02:04:19.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 20 remove_watcher() i=7 2024-09-18T02:04:19.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5609fa40b250 msgr2=0x5609fa40d640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5609fa40b250 0x5609fa40d640 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5609fa406890 msgr2=0x5609fa408d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5609fa406890 0x5609fa408d50 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb6180dc040 msgr2=0x7fb6180dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb6180dc040 0x7fb6180dd430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5609fa40faf0 msgr2=0x5609fa411fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5609fa40faf0 0x5609fa411fb0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4ec034650 msgr2=0x7fb4ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4ec034650 0x7fb4ec036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb61800a480 tx=0x7fb6180b9040 comp rx=0 tx=0).stop 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 msgr2=0x5609fa3fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6236db640 1 -- 172.21.15.167:0/1530828791 reap_dead start 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3fb970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb61401d740 tx=0x7fb61401d6d0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 shutdown_connections 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/1530828791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3f4790 0x5609fa3fb970 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 >> 172.21.15.167:0/1530828791 conn(0x5609fa3f0b70 msgr2=0x5609fa3eec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 shutdown_connections 2024-09-18T02:04:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/1530828791 wait complete. 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/4070352397 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4fc034650 msgr2=0x7fb4fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/4070352397 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4fc034650 0x7fb4fc036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x5609fa3d1b20 tx=0x7fb618005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/4070352397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3e7e40 msgr2=0x5609fa3e8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/4070352397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3e7e40 0x5609fa3e8260 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb614047520 tx=0x7fb614024fa0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/4070352397 shutdown_connections 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/4070352397 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4fc034650 0x7fb4fc036b10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/4070352397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa3e7e40 0x5609fa3e8260 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/4070352397 >> 172.21.15.167:0/4070352397 conn(0x5609fa3dcf90 msgr2=0x5609fa3dfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/4070352397 shutdown_connections 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/4070352397 wait complete. 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5609fa3d3980 msgr2=0x5609fa3d5d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.364+0000 7fb6253ca980 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5609fa3d3980 0x5609fa3d5d70 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5609fa2d9a10 msgr2=0x5609fa3d1120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5609fa2d9a10 0x5609fa3d1120 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5609fa3d78c0 msgr2=0x5609fa3d9cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5609fa3d78c0 0x5609fa3d9cb0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb508034650 msgr2=0x7fb508036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb508034650 0x7fb508036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb6180ad000 tx=0x7fb6180a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 msgr2=0x5609fa3ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 --2- 172.21.15.167:0/113451281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609fa2d5690 0x5609fa3ca020 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb614014040 tx=0x7fb614001260 comp rx=0 tx=0).stop 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6236db640 1 -- 172.21.15.167:0/113451281 reap_dead start 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 shutdown_connections 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 >> 172.21.15.167:0/113451281 conn(0x5609fa2d11b0 msgr2=0x5609fa3bc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 shutdown_connections 2024-09-18T02:04:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.368+0000 7fb6253ca980 1 -- 172.21.15.167:0/113451281 wait complete. 2024-09-18T02:04:19.379 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T02:04:19.175330Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:19.379 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-18T02:04:19.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-18T02:04:19.379 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-18T02:04:19.453 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:19.453 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:19.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.452+0000 7f3f77735980 1 Processor -- start 2024-09-18T02:04:19.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.452+0000 7f3f77735980 1 -- start start 2024-09-18T02:04:19.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.452+0000 7f3f77735980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55e8d47a0920 0x55e8d47a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.452+0000 7f3f77735980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e8d4625ae0 con 0x55e8d479c550 2024-09-18T02:04:19.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.452+0000 7f3f77735980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55e8d4649e30 con 0x55e8d47a0920 2024-09-18T02:04:19.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.452+0000 7f3f74a44640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55e8d47a0920 0x55e8d47a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.452+0000 7f3f75245640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55e8d479c550 0x55e8d479c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55518/0 (socket says 172.21.15.167:55518) 2024-09-18T02:04:19.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.452+0000 7f3f75245640 1 -- 172.21.15.167:0/27464511 learned_addr learned my addr 172.21.15.167:0/27464511 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:19.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.452+0000 7f3f74a44640 1 -- 172.21.15.167:0/27464511 >> v1:172.21.15.81:6789/0 conn(0x55e8d479c550 legacy=0x55e8d479c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.452+0000 7f3f74a44640 1 -- 172.21.15.167:0/27464511 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8d47a4260 con 0x55e8d47a0920 2024-09-18T02:04:19.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.456+0000 7f3f74a44640 1 --2- 172.21.15.167:0/27464511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d47a0920 0x55e8d47a2d10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000a480 tx=0x7f3f6001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ee9bf610caae81 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.456+0000 7f3f6ffff640 1 -- 172.21.15.167:0/27464511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f600b0070 con 0x55e8d47a0920 2024-09-18T02:04:19.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.456+0000 7f3f6ffff640 1 -- 172.21.15.167:0/27464511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f600ab540 con 0x55e8d47a0920 2024-09-18T02:04:19.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.456+0000 7f3f6ffff640 1 -- 172.21.15.167:0/27464511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f600ab840 con 0x55e8d47a0920 2024-09-18T02:04:19.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.456+0000 7f3f77735980 1 -- 172.21.15.167:0/27464511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d47a0920 msgr2=0x55e8d47a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.456+0000 7f3f77735980 1 --2- 172.21.15.167:0/27464511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d47a0920 0x55e8d47a2d10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000a480 tx=0x7f3f6001b280 comp rx=0 tx=0).stop 2024-09-18T02:04:19.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.456+0000 7f3f77735980 1 -- 172.21.15.167:0/27464511 shutdown_connections 2024-09-18T02:04:19.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.456+0000 7f3f77735980 1 --2- 172.21.15.167:0/27464511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d47a0920 0x55e8d47a2d10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.456+0000 7f3f77735980 1 -- 172.21.15.167:0/27464511 >> 172.21.15.167:0/27464511 conn(0x55e8d4798070 msgr2=0x55e8d479a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.456+0000 7f3f77735980 1 -- 172.21.15.167:0/27464511 shutdown_connections 2024-09-18T02:04:19.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.456+0000 7f3f77735980 1 -- 172.21.15.167:0/27464511 wait complete. 2024-09-18T02:04:19.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.468+0000 7f3f77735980 1 Processor -- start 2024-09-18T02:04:19.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.468+0000 7f3f77735980 1 -- start start 2024-09-18T02:04:19.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.468+0000 7f3f77735980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 0x55e8d48868b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.468+0000 7f3f77735980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e8d464b200 con 0x55e8d479c550 2024-09-18T02:04:19.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.468+0000 7f3f75245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 0x55e8d48868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.468+0000 7f3f75245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 0x55e8d48868b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56708/0 (socket says 172.21.15.167:56708) 2024-09-18T02:04:19.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.468+0000 7f3f75245640 1 -- 172.21.15.167:0/2468429593 learned_addr learned my addr 172.21.15.167:0/2468429593 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f75245640 1 -- 172.21.15.167:0/2468429593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8d4886e80 con 0x55e8d479c550 2024-09-18T02:04:19.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f75245640 1 --2- 172.21.15.167:0/2468429593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 0x55e8d48868b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f68001e20 tx=0x7f3f6800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac00f707b6b2fc4a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3e63606640 1 -- 172.21.15.167:0/2468429593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f68012020 con 0x55e8d479c550 2024-09-18T02:04:19.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3e63606640 1 -- 172.21.15.167:0/2468429593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f6800e7c0 con 0x55e8d479c550 2024-09-18T02:04:19.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3e63606640 1 -- 172.21.15.167:0/2468429593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f6800eb00 con 0x55e8d479c550 2024-09-18T02:04:19.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 -- 172.21.15.167:0/2468429593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 msgr2=0x55e8d48868b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 --2- 172.21.15.167:0/2468429593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 0x55e8d48868b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f68001e20 tx=0x7f3f6800b790 comp rx=0 tx=0).stop 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 -- 172.21.15.167:0/2468429593 shutdown_connections 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 --2- 172.21.15.167:0/2468429593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 0x55e8d48868b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 -- 172.21.15.167:0/2468429593 >> 172.21.15.167:0/2468429593 conn(0x55e8d4798070 msgr2=0x55e8d48824e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 -- 172.21.15.167:0/2468429593 shutdown_connections 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 -- 172.21.15.167:0/2468429593 wait complete. 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 Processor -- start 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 -- start start 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 0x55e8d4892050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e8d47a3d60 con 0x55e8d479c550 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f75245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 0x55e8d4892050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f75245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 0x55e8d4892050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56714/0 (socket says 172.21.15.167:56714) 2024-09-18T02:04:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f75245640 1 -- 172.21.15.167:0/3581366583 learned_addr learned my addr 172.21.15.167:0/3581366583 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f75245640 1 -- 172.21.15.167:0/3581366583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8d4892590 con 0x55e8d479c550 2024-09-18T02:04:19.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f75245640 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 0x55e8d4892050 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3f68001e20 tx=0x7f3f68000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3e61e03640 1 -- 172.21.15.167:0/3581366583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f68012030 con 0x55e8d479c550 2024-09-18T02:04:19.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8d4892820 con 0x55e8d479c550 2024-09-18T02:04:19.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3e61e03640 1 -- 172.21.15.167:0/3581366583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f68001480 con 0x55e8d479c550 2024-09-18T02:04:19.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3e61e03640 1 -- 172.21.15.167:0/3581366583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f6801a940 con 0x55e8d479c550 2024-09-18T02:04:19.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.472+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8d4895500 con 0x55e8d479c550 2024-09-18T02:04:19.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3e61e03640 1 -- 172.21.15.167:0/3581366583 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f68015020 con 0x55e8d479c550 2024-09-18T02:04:19.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3e61e03640 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e5c0346a0 0x7f3e5c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3e61e03640 1 -- 172.21.15.167:0/3581366583 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3f68020030 con 0x55e8d479c550 2024-09-18T02:04:19.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f74a44640 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e5c0346a0 0x7f3e5c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f77735980 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e8d47a0920 0x55e8d4899150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d4899690 con 0x55e8d47a0920 2024-09-18T02:04:19.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f75a46640 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e8d47a0920 0x55e8d4899150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f74a44640 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e5c0346a0 0x7f3e5c036b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3f600ad000 tx=0x7f3f600a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f75a46640 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e8d47a0920 0x55e8d4899150 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f75a46640 1 -- 172.21.15.167:0/3581366583 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d47a0920 2024-09-18T02:04:19.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d4896720 con 0x55e8d47a0920 2024-09-18T02:04:19.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f75a46640 1 -- 172.21.15.167:0/3581366583 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d47a0920 2024-09-18T02:04:19.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f77735980 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e8d489b9a0 0x55e8d489dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d489e480 con 0x55e8d489b9a0 2024-09-18T02:04:19.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f75245640 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e8d489b9a0 0x55e8d489dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.476+0000 7f3f75245640 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e8d489b9a0 0x55e8d489dd90 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f75245640 1 -- 172.21.15.167:0/3581366583 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f68008030 con 0x55e8d489b9a0 2024-09-18T02:04:19.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d489a840 con 0x55e8d47a0920 2024-09-18T02:04:19.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f75a46640 1 -- 172.21.15.167:0/3581366583 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d47a0920 2024-09-18T02:04:19.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f77735980 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e8d489f8e0 0x55e8d48a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48a2410 con 0x55e8d489f8e0 2024-09-18T02:04:19.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f74a44640 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e8d489f8e0 0x55e8d48a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f74a44640 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e8d489f8e0 0x55e8d48a1cd0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f74a44640 1 -- 172.21.15.167:0/3581366583 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3f600b3040 con 0x55e8d489f8e0 2024-09-18T02:04:19.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f77735980 1 Processor -- start 2024-09-18T02:04:19.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f77735980 1 -- start start 2024-09-18T02:04:19.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f77735980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48afee0 0x55e8d48b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f77735980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e8d46a4800 con 0x55e8d48afee0 2024-09-18T02:04:19.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f75245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48afee0 0x55e8d48b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f75245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48afee0 0x55e8d48b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56722/0 (socket says 172.21.15.167:56722) 2024-09-18T02:04:19.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f75245640 1 -- 172.21.15.167:0/1148005385 learned_addr learned my addr 172.21.15.167:0/1148005385 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f75245640 1 -- 172.21.15.167:0/1148005385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8d48b0840 con 0x55e8d48afee0 2024-09-18T02:04:19.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f75245640 1 --2- 172.21.15.167:0/1148005385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48afee0 0x55e8d48b0300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f68048480 tx=0x7f3f6800d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3e5affd640 1 -- 172.21.15.167:0/1148005385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f68041ce0 con 0x55e8d48afee0 2024-09-18T02:04:19.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3e5affd640 1 -- 172.21.15.167:0/1148005385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f68041e80 con 0x55e8d48afee0 2024-09-18T02:04:19.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3e5affd640 1 -- 172.21.15.167:0/1148005385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f680165c0 con 0x55e8d48afee0 2024-09-18T02:04:19.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f77735980 1 -- 172.21.15.167:0/1148005385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8d48b0840 con 0x55e8d48afee0 2024-09-18T02:04:19.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.480+0000 7f3f77735980 1 -- 172.21.15.167:0/1148005385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8d48b0840 con 0x55e8d48afee0 2024-09-18T02:04:19.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3e5affd640 1 -- 172.21.15.167:0/1148005385 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f68009070 con 0x55e8d48afee0 2024-09-18T02:04:19.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3e5affd640 1 --2- 172.21.15.167:0/1148005385 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e4c034650 0x7f3e4c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3e5affd640 1 -- 172.21.15.167:0/1148005385 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3f6803a070 con 0x55e8d48afee0 2024-09-18T02:04:19.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f74a44640 1 --2- 172.21.15.167:0/1148005385 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e4c034650 0x7f3e4c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 Processor -- start 2024-09-18T02:04:19.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 -- start start 2024-09-18T02:04:19.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f74a44640 1 --2- 172.21.15.167:0/1148005385 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e4c034650 0x7f3e4c036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55e8d4899b20 tx=0x7f3f60005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 0x55e8d48bc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e8d4887200 con 0x55e8d48bc460 2024-09-18T02:04:19.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f75245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 0x55e8d48bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f75245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 0x55e8d48bc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56728/0 (socket says 172.21.15.167:56728) 2024-09-18T02:04:19.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f75245640 1 -- 172.21.15.167:0/1176267428 learned_addr learned my addr 172.21.15.167:0/1176267428 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f75245640 1 -- 172.21.15.167:0/1176267428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8d48bce30 con 0x55e8d48bc460 2024-09-18T02:04:19.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f75245640 1 --2- 172.21.15.167:0/1176267428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 0x55e8d48bc860 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f68033fd0 tx=0x7f3f68050b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b29c1cfb841e0d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3e58ff9640 1 -- 172.21.15.167:0/1176267428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f68050560 con 0x55e8d48bc460 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3e58ff9640 1 -- 172.21.15.167:0/1176267428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f6805e070 con 0x55e8d48bc460 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3e58ff9640 1 -- 172.21.15.167:0/1176267428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f6802da40 con 0x55e8d48bc460 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 -- 172.21.15.167:0/1176267428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 msgr2=0x55e8d48bc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 --2- 172.21.15.167:0/1176267428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 0x55e8d48bc860 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f68033fd0 tx=0x7f3f68050b80 comp rx=0 tx=0).stop 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 -- 172.21.15.167:0/1176267428 shutdown_connections 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 --2- 172.21.15.167:0/1176267428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 0x55e8d48bc860 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 -- 172.21.15.167:0/1176267428 >> 172.21.15.167:0/1176267428 conn(0x55e8d48b87f0 msgr2=0x55e8d48b68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 -- 172.21.15.167:0/1176267428 shutdown_connections 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 -- 172.21.15.167:0/1176267428 wait complete. 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 Processor -- start 2024-09-18T02:04:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 -- start start 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 0x55e8d48c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.484+0000 7f3f77735980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e8d48bd380 con 0x55e8d48bc460 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f75245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 0x55e8d48c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f75245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 0x55e8d48c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56736/0 (socket says 172.21.15.167:56736) 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 learned_addr learned my addr 172.21.15.167:0/3467619901 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8d48c3b20 con 0x55e8d48bc460 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f75245640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 0x55e8d48c35e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3f6804f580 tx=0x7f3f6802cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3e4affd640 1 -- 172.21.15.167:0/3467619901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f68041910 con 0x55e8d48bc460 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3e4affd640 1 -- 172.21.15.167:0/3467619901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f68016760 con 0x55e8d48bc460 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8d48c3b20 con 0x55e8d48bc460 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3e4affd640 1 -- 172.21.15.167:0/3467619901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f68016a60 con 0x55e8d48bc460 2024-09-18T02:04:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8d48c3b20 con 0x55e8d48bc460 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3e4affd640 1 -- 172.21.15.167:0/3467619901 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f68058070 con 0x55e8d48bc460 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3e4affd640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e40034650 0x7f3e40036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3e4affd640 1 -- 172.21.15.167:0/3467619901 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3f68005050 con 0x55e8d48bc460 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f74a44640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e40034650 0x7f3e40036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e8d48ce530 0x55e8d48d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d1120 con 0x55e8d48ce530 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f75a46640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e8d48ce530 0x55e8d48d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f74a44640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e40034650 0x7f3e40036b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3f60000c10 tx=0x7f3f600b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f75a46640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e8d48ce530 0x55e8d48d09d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 20 realm 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d1530 con 0x55e8d48ce530 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.488+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d1dd0 con 0x55e8d48ce530 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f77735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48ce530 2024-09-18T02:04:19.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f77735980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f77735980 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e8d48d2ed0 0x55e8d48d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d5960 con 0x55e8d48d2ed0 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f75245640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e8d48d2ed0 0x55e8d48d52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f75245640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e8d48d2ed0 0x55e8d48d52c0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f77735980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f77735980 20 searching for the correct realm 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f77735980 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e8d48d7840 0x55e8d48d9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48da330 con 0x55e8d48d7840 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f74a44640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e8d48d7840 0x55e8d48d9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f74a44640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e8d48d7840 0x55e8d48d9cb0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f74a44640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3f600dc040 0x7f3f600dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48da330 con 0x7f3f600dc040 2024-09-18T02:04:19.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f75a46640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3f600dc040 0x7f3f600dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f75a46640 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3f600dc040 0x7f3f600dd430 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.492+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d2ed0 2024-09-18T02:04:19.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48ce530 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48ce530 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d2ed0 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d2ed0 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x7f3f600dc040 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d7840 2024-09-18T02:04:19.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48ce530 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d2ed0 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48ce530 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x7f3f600dc040 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d7840 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.496+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d7840 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d2ed0 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d7840 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d7840 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48ce530 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48ce530 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d2ed0 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d7840 2024-09-18T02:04:19.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x7f3f600dc040 2024-09-18T02:04:19.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48ce530 2024-09-18T02:04:19.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.500+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d2ed0 2024-09-18T02:04:19.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d7840 2024-09-18T02:04:19.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d2ed0 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x7f3f600dc040 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d7840 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48d2ed0 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x55e8d48ce530 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d2170 con 0x7f3f600dc040 2024-09-18T02:04:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d61b0 con 0x55e8d48ce530 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d61b0 con 0x55e8d48ce530 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d61b0 con 0x55e8d48d7840 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 zone default found 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 4 Realm: () 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 zonegroup default 2024-09-18T02:04:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.504+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48d6b50 con 0x55e8d48d2ed0 2024-09-18T02:04:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48dc1f0 con 0x55e8d48d7840 2024-09-18T02:04:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48dc630 con 0x55e8d48d7840 2024-09-18T02:04:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 20 started sync module instance, tier type = 2024-09-18T02:04:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48db630 con 0x7f3f600dc040 2024-09-18T02:04:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94458486831920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48db630 con 0x7f3f600dc040 2024-09-18T02:04:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48dd110 con 0x55e8d48ce530 2024-09-18T02:04:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.508+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94458486831920] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.512+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.512+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94458486836224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48db630 con 0x55e8d48ce530 2024-09-18T02:04:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.512+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48ddb20 con 0x55e8d48d7840 2024-09-18T02:04:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.512+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94458486836224] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.512+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.512+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94458486829440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48db5a0 con 0x55e8d48d7840 2024-09-18T02:04:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.512+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48de820 con 0x7f3f600dc040 2024-09-18T02:04:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.512+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.512+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94458486842528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48df0c0 con 0x7f3f600dc040 2024-09-18T02:04:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.512+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48dfa80 con 0x55e8d48ce530 2024-09-18T02:04:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.516+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94458486829440] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.516+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94458486842528] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.516+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.516+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94458486846928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48df030 con 0x55e8d48ce530 2024-09-18T02:04:19.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.516+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48df9f0 con 0x55e8d48d2ed0 2024-09-18T02:04:19.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.516+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94458486846928] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.520+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.520+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94458486844560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48e0320 con 0x55e8d48d2ed0 2024-09-18T02:04:19.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.520+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48e0b70 con 0x55e8d48d2ed0 2024-09-18T02:04:19.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.520+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94458486844560] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.520+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.520+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94458486849136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48e13c0 con 0x55e8d48d2ed0 2024-09-18T02:04:19.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.520+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48e1c90 con 0x55e8d48d2ed0 2024-09-18T02:04:19.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94458486849136] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94458486853392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48e1e70 con 0x55e8d48d2ed0 2024-09-18T02:04:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 20 add_watcher() i=0 2024-09-18T02:04:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 20 add_watcher() i=1 2024-09-18T02:04:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 20 add_watcher() i=2 2024-09-18T02:04:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 20 add_watcher() i=3 2024-09-18T02:04:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 20 add_watcher() i=4 2024-09-18T02:04:19.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 20 add_watcher() i=5 2024-09-18T02:04:19.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 20 add_watcher() i=6 2024-09-18T02:04:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94458486853392] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 20 add_watcher() i=7 2024-09-18T02:04:19.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:19.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48e5240 con 0x55e8d48ce530 2024-09-18T02:04:19.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.524+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94458486857056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48e2630 con 0x55e8d48ce530 2024-09-18T02:04:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94458486857056] v30'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3e2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 5 note: GC not initialized 2024-09-18T02:04:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3e2a7e4640 20 reqs_thread_entry: start 2024-09-18T02:04:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 20 Filter name: none 2024-09-18T02:04:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3d9bfff640 20 reqs_thread_entry: start 2024-09-18T02:04:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d4908770 con 0x55e8d48ce530 2024-09-18T02:04:19.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 20 rados_obj.operate() r=0 bl.length=673 2024-09-18T02:04:19.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:19.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:19.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d490f350 con 0x55e8d48ce530 2024-09-18T02:04:19.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v30'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:19.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:19.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94458487041472 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d490aa80 con 0x55e8d48ce530 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94458486846928 notify 128849018888 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f3f70018ba0 con 0x55e8d48ce530 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3e58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94458486846928 notifier 4410 bl.length()=758 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3e58ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3e58ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(64 notify.4 [notify cookie 94458487041472 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3e58ff9640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3e38003eb0 con 0x55e8d48ce530 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94458487041472 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3f70018d70 con 0x55e8d48ce530 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.528+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d490edc0 con 0x55e8d48ce530 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(66 foo:foo1 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3f77735980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-18T02:04:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94458487041472 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e8d490a5d0 con 0x7f3f600dc040 2024-09-18T02:04:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== watch-notify(notify (1) cookie 94458486831920 notify 128849018884 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f3f70018d70 con 0x7f3f600dc040 2024-09-18T02:04:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3e58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94458486831920 notifier 4410 bl.length()=159 2024-09-18T02:04:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3e58ff9640 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3e38003eb0 con 0x7f3f600dc040 2024-09-18T02:04:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(67 notify.0 [notify cookie 94458487041472 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== watch-notify(notify_complete (2) cookie 94458487041472 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3f70044700 con 0x7f3f600dc040 2024-09-18T02:04:19.536 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T02:04:19.175330Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3e2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94458486857056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d49065a0 con 0x55e8d48ce530 2024-09-18T02:04:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94458486857056] v30'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.532+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94458486831920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d49065a0 con 0x7f3f600dc040 2024-09-18T02:04:19.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.536+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94458486831920] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.536+0000 7f3f77735980 20 remove_watcher() i=0 2024-09-18T02:04:19.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.536+0000 7f3f77735980 2 removed watcher, disabling cache 2024-09-18T02:04:19.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.536+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94458486836224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48dbb30 con 0x55e8d48ce530 2024-09-18T02:04:19.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.536+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94458486836224] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.536+0000 7f3f77735980 20 remove_watcher() i=1 2024-09-18T02:04:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.536+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94458486829440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d49065a0 con 0x55e8d48d7840 2024-09-18T02:04:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.536+0000 7f3f74a44640 1 -- 172.21.15.167:0/3467619901 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94458486829440] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f600c9030 con 0x55e8d48d7840 2024-09-18T02:04:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.536+0000 7f3f77735980 20 remove_watcher() i=2 2024-09-18T02:04:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.536+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94458486842528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48dcc00 con 0x7f3f600dc040 2024-09-18T02:04:19.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.540+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94458486842528] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x7f3f600dc040 2024-09-18T02:04:19.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.540+0000 7f3f77735980 20 remove_watcher() i=3 2024-09-18T02:04:19.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.540+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94458486846928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48dbb30 con 0x55e8d48ce530 2024-09-18T02:04:19.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.540+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94458486846928] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f7000a4d0 con 0x55e8d48ce530 2024-09-18T02:04:19.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.540+0000 7f3f77735980 20 remove_watcher() i=4 2024-09-18T02:04:19.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.540+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94458486844560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48db180 con 0x55e8d48d2ed0 2024-09-18T02:04:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.544+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94458486844560] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.544+0000 7f3f77735980 20 remove_watcher() i=5 2024-09-18T02:04:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.544+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94458486849136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d49065a0 con 0x55e8d48d2ed0 2024-09-18T02:04:19.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.544+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94458486849136] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.544+0000 7f3f77735980 20 remove_watcher() i=6 2024-09-18T02:04:19.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.544+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94458486853392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e8d48dcc00 con 0x55e8d48d2ed0 2024-09-18T02:04:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f75245640 1 -- 172.21.15.167:0/3467619901 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94458486853392] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f68073020 con 0x55e8d48d2ed0 2024-09-18T02:04:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 20 remove_watcher() i=7 2024-09-18T02:04:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e8d48d2ed0 msgr2=0x55e8d48d52c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e8d48d2ed0 0x55e8d48d52c0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e8d48ce530 msgr2=0x55e8d48d09d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e8d48ce530 0x55e8d48d09d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3f600dc040 msgr2=0x7f3f600dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3f600dc040 0x7f3f600dd430 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e8d48d7840 msgr2=0x55e8d48d9cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e8d48d7840 0x55e8d48d9cb0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e40034650 msgr2=0x7f3e40036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e40034650 0x7f3e40036b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3f60000c10 tx=0x7f3f600b9040 comp rx=0 tx=0).stop 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 msgr2=0x55e8d48c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/3467619901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48bc460 0x55e8d48c35e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3f6804f580 tx=0x7f3f6802cf10 comp rx=0 tx=0).stop 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 reap_dead start 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f75a46640 1 -- 172.21.15.167:0/3467619901 reap_dead start 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 shutdown_connections 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 >> 172.21.15.167:0/3467619901 conn(0x55e8d48b87f0 msgr2=0x55e8d48b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 shutdown_connections 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3467619901 wait complete. 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/1148005385 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e4c034650 msgr2=0x7f3e4c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/1148005385 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e4c034650 0x7f3e4c036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55e8d4899b20 tx=0x7f3f60005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/1148005385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48afee0 msgr2=0x55e8d48b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/1148005385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48afee0 0x55e8d48b0300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f68048480 tx=0x7f3f6800d610 comp rx=0 tx=0).stop 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/1148005385 shutdown_connections 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/1148005385 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e4c034650 0x7f3e4c036b10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/1148005385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d48afee0 0x55e8d48b0300 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/1148005385 >> 172.21.15.167:0/1148005385 conn(0x55e8d48a5030 msgr2=0x55e8d48a7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/1148005385 shutdown_connections 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/1148005385 wait complete. 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e8d489b9a0 msgr2=0x55e8d489dd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e8d489b9a0 0x55e8d489dd90 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e8d47a0920 msgr2=0x55e8d4899150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e8d47a0920 0x55e8d4899150 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e8d489f8e0 msgr2=0x55e8d48a1cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e8d489f8e0 0x55e8d48a1cd0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e5c0346a0 msgr2=0x7f3e5c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3e5c0346a0 0x7f3e5c036b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3f600ad000 tx=0x7f3f600a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 msgr2=0x55e8d4892050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 --2- 172.21.15.167:0/3581366583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8d479c550 0x55e8d4892050 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3f68001e20 tx=0x7f3f68000ee0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f75a46640 1 -- 172.21.15.167:0/3581366583 reap_dead start 2024-09-18T02:04:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 shutdown_connections 2024-09-18T02:04:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 >> 172.21.15.167:0/3581366583 conn(0x55e8d4798070 msgr2=0x55e8d4881060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 shutdown_connections 2024-09-18T02:04:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.548+0000 7f3f77735980 1 -- 172.21.15.167:0/3581366583 wait complete. 2024-09-18T02:04:19.560 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T02:04:19.175330Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:19.561 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-18T02:04:19.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-18T02:04:19.561 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-18T02:04:19.628 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:19.628 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:19.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.624+0000 7f882ac1b980 1 Processor -- start 2024-09-18T02:04:19.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.624+0000 7f882ac1b980 1 -- start start 2024-09-18T02:04:19.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.624+0000 7f882ac1b980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ada4c15ec0 0x55ada4c182b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.624+0000 7f882ac1b980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ada4a97ae0 con 0x55ada4b84290 2024-09-18T02:04:19.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.624+0000 7f882ac1b980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55ada4abbe30 con 0x55ada4c15ec0 2024-09-18T02:04:19.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f8827f2a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ada4c15ec0 0x55ada4c182b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f882872b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55ada4b84290 0x55ada4c147a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55532/0 (socket says 172.21.15.167:55532) 2024-09-18T02:04:19.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f882872b640 1 -- 172.21.15.167:0/3105405387 learned_addr learned my addr 172.21.15.167:0/3105405387 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:19.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f8827729640 1 -- 172.21.15.167:0/3105405387 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755924823 0 0) 0x55ada4a97ae0 con 0x55ada4b84290 2024-09-18T02:04:19.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f8827729640 1 -- 172.21.15.167:0/3105405387 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8814001e20 con 0x55ada4b84290 2024-09-18T02:04:19.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f8827f2a640 1 -- 172.21.15.167:0/3105405387 >> v1:172.21.15.81:6789/0 conn(0x55ada4b84290 legacy=0x55ada4c147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f8827f2a640 1 -- 172.21.15.167:0/3105405387 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada4b84670 con 0x55ada4c15ec0 2024-09-18T02:04:19.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f8827f2a640 1 --2- 172.21.15.167:0/3105405387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4c15ec0 0x55ada4c182b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f881000a480 tx=0x7f881001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4eacc25b259dfe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f8827729640 1 -- 172.21.15.167:0/3105405387 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88100b0070 con 0x55ada4c15ec0 2024-09-18T02:04:19.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f8827729640 1 -- 172.21.15.167:0/3105405387 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88100ab540 con 0x55ada4c15ec0 2024-09-18T02:04:19.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f8827729640 1 -- 172.21.15.167:0/3105405387 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88100ab820 con 0x55ada4c15ec0 2024-09-18T02:04:19.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f882ac1b980 1 -- 172.21.15.167:0/3105405387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4c15ec0 msgr2=0x55ada4c182b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3105405387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4c15ec0 0x55ada4c182b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f881000a480 tx=0x7f881001b280 comp rx=0 tx=0).stop 2024-09-18T02:04:19.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f882ac1b980 1 -- 172.21.15.167:0/3105405387 shutdown_connections 2024-09-18T02:04:19.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3105405387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4c15ec0 0x55ada4c182b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f882ac1b980 1 -- 172.21.15.167:0/3105405387 >> 172.21.15.167:0/3105405387 conn(0x55ada4c0a090 msgr2=0x55ada4c0c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f882ac1b980 1 -- 172.21.15.167:0/3105405387 shutdown_connections 2024-09-18T02:04:19.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.628+0000 7f882ac1b980 1 -- 172.21.15.167:0/3105405387 wait complete. 2024-09-18T02:04:19.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 Processor -- start 2024-09-18T02:04:19.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 -- start start 2024-09-18T02:04:19.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 0x55ada4cfca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ada4abd200 con 0x55ada4b84290 2024-09-18T02:04:19.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882872b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 0x55ada4cfca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882872b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 0x55ada4cfca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56744/0 (socket says 172.21.15.167:56744) 2024-09-18T02:04:19.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882872b640 1 -- 172.21.15.167:0/1409279743 learned_addr learned my addr 172.21.15.167:0/1409279743 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882872b640 1 -- 172.21.15.167:0/1409279743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada4cfd030 con 0x55ada4b84290 2024-09-18T02:04:19.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882872b640 1 --2- 172.21.15.167:0/1409279743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 0x55ada4cfca60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8818006fc0 tx=0x7f8818001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe05f38c796764c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f871660c640 1 -- 172.21.15.167:0/1409279743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8818004530 con 0x55ada4b84290 2024-09-18T02:04:19.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f871660c640 1 -- 172.21.15.167:0/1409279743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88180046d0 con 0x55ada4b84290 2024-09-18T02:04:19.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f871660c640 1 -- 172.21.15.167:0/1409279743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8818004a70 con 0x55ada4b84290 2024-09-18T02:04:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 -- 172.21.15.167:0/1409279743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 msgr2=0x55ada4cfca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1409279743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 0x55ada4cfca60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8818006fc0 tx=0x7f8818001af0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 -- 172.21.15.167:0/1409279743 shutdown_connections 2024-09-18T02:04:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1409279743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 0x55ada4cfca60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 -- 172.21.15.167:0/1409279743 >> 172.21.15.167:0/1409279743 conn(0x55ada4c0a090 msgr2=0x55ada4cf8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 -- 172.21.15.167:0/1409279743 shutdown_connections 2024-09-18T02:04:19.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 -- 172.21.15.167:0/1409279743 wait complete. 2024-09-18T02:04:19.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 Processor -- start 2024-09-18T02:04:19.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 -- start start 2024-09-18T02:04:19.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 0x55ada4d03d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882ac1b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ada4c1b220 con 0x55ada4b84290 2024-09-18T02:04:19.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.644+0000 7f882872b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 0x55ada4d03d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f882872b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 0x55ada4d03d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56748/0 (socket says 172.21.15.167:56748) 2024-09-18T02:04:19.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f882872b640 1 -- 172.21.15.167:0/3487806989 learned_addr learned my addr 172.21.15.167:0/3487806989 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f882872b640 1 -- 172.21.15.167:0/3487806989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada4d042d0 con 0x55ada4b84290 2024-09-18T02:04:19.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f882872b640 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 0x55ada4d03d90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8818002260 tx=0x7f8818000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8714e09640 1 -- 172.21.15.167:0/3487806989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8818013760 con 0x55ada4b84290 2024-09-18T02:04:19.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ada4d04560 con 0x55ada4b84290 2024-09-18T02:04:19.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8714e09640 1 -- 172.21.15.167:0/3487806989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8818013900 con 0x55ada4b84290 2024-09-18T02:04:19.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8714e09640 1 -- 172.21.15.167:0/3487806989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8818013c20 con 0x55ada4b84290 2024-09-18T02:04:19.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada4d07240 con 0x55ada4b84290 2024-09-18T02:04:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8714e09640 1 -- 172.21.15.167:0/3487806989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8818010070 con 0x55ada4b84290 2024-09-18T02:04:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8714e09640 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8710034650 0x7f8710036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8714e09640 1 -- 172.21.15.167:0/3487806989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8818018070 con 0x55ada4b84290 2024-09-18T02:04:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8827f2a640 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8710034650 0x7f8710036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ada4c15ec0 0x55ada4d0ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d0b410 con 0x55ada4c15ec0 2024-09-18T02:04:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8828f2c640 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ada4c15ec0 0x55ada4d0ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8827f2a640 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8710034650 0x7f8710036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f88100ad000 tx=0x7f88100a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8828f2c640 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ada4c15ec0 0x55ada4d0ae90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8828f2c640 1 -- 172.21.15.167:0/3487806989 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88200083f0 con 0x55ada4c15ec0 2024-09-18T02:04:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d08460 con 0x55ada4c15ec0 2024-09-18T02:04:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f8828f2c640 1 -- 172.21.15.167:0/3487806989 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88200083f0 con 0x55ada4c15ec0 2024-09-18T02:04:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ada4d0d790 0x55ada4d0fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.648+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d10270 con 0x55ada4d0d790 2024-09-18T02:04:19.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882872b640 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ada4d0d790 0x55ada4d0fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882872b640 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ada4d0d790 0x55ada4d0fb80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882872b640 1 -- 172.21.15.167:0/3487806989 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f881801b030 con 0x55ada4d0d790 2024-09-18T02:04:19.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d0c600 con 0x55ada4c15ec0 2024-09-18T02:04:19.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f8828f2c640 1 -- 172.21.15.167:0/3487806989 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88200083f0 con 0x55ada4c15ec0 2024-09-18T02:04:19.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ada4d116d0 0x55ada4d13ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d141c0 con 0x55ada4d116d0 2024-09-18T02:04:19.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f8827f2a640 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ada4d116d0 0x55ada4d13ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f8827f2a640 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ada4d116d0 0x55ada4d13ac0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f8827f2a640 1 -- 172.21.15.167:0/3487806989 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f88100abcb0 con 0x55ada4d116d0 2024-09-18T02:04:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882ac1b980 1 Processor -- start 2024-09-18T02:04:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882ac1b980 1 -- start start 2024-09-18T02:04:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882ac1b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d21c50 0x55ada4d22070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882ac1b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ada4b16800 con 0x55ada4d21c50 2024-09-18T02:04:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882872b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d21c50 0x55ada4d22070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882872b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d21c50 0x55ada4d22070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56762/0 (socket says 172.21.15.167:56762) 2024-09-18T02:04:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.652+0000 7f882872b640 1 -- 172.21.15.167:0/3457813425 learned_addr learned my addr 172.21.15.167:0/3457813425 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882872b640 1 -- 172.21.15.167:0/3457813425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada4d225b0 con 0x55ada4d21c50 2024-09-18T02:04:19.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882872b640 1 --2- 172.21.15.167:0/3457813425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d21c50 0x55ada4d22070 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f88180483f0 tx=0x7f8818021cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f870dffb640 1 -- 172.21.15.167:0/3457813425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8818029680 con 0x55ada4d21c50 2024-09-18T02:04:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f870dffb640 1 -- 172.21.15.167:0/3457813425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8818029820 con 0x55ada4d21c50 2024-09-18T02:04:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f870dffb640 1 -- 172.21.15.167:0/3457813425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88180123c0 con 0x55ada4d21c50 2024-09-18T02:04:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882ac1b980 1 -- 172.21.15.167:0/3457813425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ada4d22840 con 0x55ada4d21c50 2024-09-18T02:04:19.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882ac1b980 1 -- 172.21.15.167:0/3457813425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada4d22840 con 0x55ada4d21c50 2024-09-18T02:04:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f870dffb640 1 -- 172.21.15.167:0/3457813425 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8818012580 con 0x55ada4d21c50 2024-09-18T02:04:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f870dffb640 1 --2- 172.21.15.167:0/3457813425 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8700034650 0x7f8700036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f870dffb640 1 -- 172.21.15.167:0/3457813425 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8818014850 con 0x55ada4d21c50 2024-09-18T02:04:19.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f8827f2a640 1 --2- 172.21.15.167:0/3457813425 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8700034650 0x7f8700036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882ac1b980 1 Processor -- start 2024-09-18T02:04:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882ac1b980 1 -- start start 2024-09-18T02:04:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f8827f2a640 1 --2- 172.21.15.167:0/3457813425 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8700034650 0x7f8700036b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55ada4d0b910 tx=0x7f8810005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882ac1b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d2e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882ac1b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ada4cfd3b0 con 0x55ada4d2e3e0 2024-09-18T02:04:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882872b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d2e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882872b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d2e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56778/0 (socket says 172.21.15.167:56778) 2024-09-18T02:04:19.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882872b640 1 -- 172.21.15.167:0/3765304487 learned_addr learned my addr 172.21.15.167:0/3765304487 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882872b640 1 -- 172.21.15.167:0/3765304487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada4d2ed90 con 0x55ada4d2e3e0 2024-09-18T02:04:19.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.656+0000 7f882872b640 1 --2- 172.21.15.167:0/3765304487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d2e7c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8818010480 tx=0x7f881804ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c38053772dd9933 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f86ff7fe640 1 -- 172.21.15.167:0/3765304487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8818061070 con 0x55ada4d2e3e0 2024-09-18T02:04:19.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f86ff7fe640 1 -- 172.21.15.167:0/3765304487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8818048df0 con 0x55ada4d2e3e0 2024-09-18T02:04:19.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f86ff7fe640 1 -- 172.21.15.167:0/3765304487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f881804e040 con 0x55ada4d2e3e0 2024-09-18T02:04:19.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 -- 172.21.15.167:0/3765304487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 msgr2=0x55ada4d2e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3765304487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d2e7c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8818010480 tx=0x7f881804ce60 comp rx=0 tx=0).stop 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 -- 172.21.15.167:0/3765304487 shutdown_connections 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3765304487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d2e7c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 -- 172.21.15.167:0/3765304487 >> 172.21.15.167:0/3765304487 conn(0x55ada4d2a7c0 msgr2=0x55ada4d288c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 -- 172.21.15.167:0/3765304487 shutdown_connections 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 -- 172.21.15.167:0/3765304487 wait complete. 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 Processor -- start 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 -- start start 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d35520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ada4d2f230 con 0x55ada4d2e3e0 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882872b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d35520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882872b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d35520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56780/0 (socket says 172.21.15.167:56780) 2024-09-18T02:04:19.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 learned_addr learned my addr 172.21.15.167:0/1563281059 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada4d35a60 con 0x55ada4d2e3e0 2024-09-18T02:04:19.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882872b640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d35520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f881803db80 tx=0x7f8818014520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f86fdffb640 1 -- 172.21.15.167:0/1563281059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8818069070 con 0x55ada4d2e3e0 2024-09-18T02:04:19.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ada4d35a60 con 0x55ada4d2e3e0 2024-09-18T02:04:19.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f86fdffb640 1 -- 172.21.15.167:0/1563281059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8818011c70 con 0x55ada4d2e3e0 2024-09-18T02:04:19.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada4d35a60 con 0x55ada4d2e3e0 2024-09-18T02:04:19.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f86fdffb640 1 -- 172.21.15.167:0/1563281059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8818073060 con 0x55ada4d2e3e0 2024-09-18T02:04:19.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.660+0000 7f86fdffb640 1 -- 172.21.15.167:0/1563281059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f881806c070 con 0x55ada4d2e3e0 2024-09-18T02:04:19.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f86fdffb640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f86f0034650 0x7f86f0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f86fdffb640 1 -- 172.21.15.167:0/1563281059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8818059070 con 0x55ada4d2e3e0 2024-09-18T02:04:19.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f8827f2a640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f86f0034650 0x7f86f0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ada4d40640 0x55ada4d42ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d43230 con 0x55ada4d40640 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f8828f2c640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ada4d40640 0x55ada4d42ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f8827f2a640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f86f0034650 0x7f86f0036b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f88100abae0 tx=0x7f88100a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f8828f2c640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ada4d40640 0x55ada4d42ae0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88200083f0 con 0x55ada4d40640 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 realm 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d43640 con 0x55ada4d40640 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88200083f0 con 0x55ada4d40640 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:19.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d43ee0 con 0x55ada4d40640 2024-09-18T02:04:19.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88200083f0 con 0x55ada4d40640 2024-09-18T02:04:19.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d40640 2024-09-18T02:04:19.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88200083f0 con 0x55ada4d40640 2024-09-18T02:04:19.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:19.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ada4d44fe0 0x55ada4d473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d47a20 con 0x55ada4d44fe0 2024-09-18T02:04:19.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882872b640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ada4d44fe0 0x55ada4d473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882872b640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ada4d44fe0 0x55ada4d473d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:19.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 20 searching for the correct realm 2024-09-18T02:04:19.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ada4d49900 0x55ada4d4bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4c3d0 con 0x55ada4d49900 2024-09-18T02:04:19.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.664+0000 7f8827f2a640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ada4d49900 0x55ada4d4bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8827f2a640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ada4d49900 0x55ada4d4bd50 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8827f2a640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f88100de040 0x7f88100df430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4c3d0 con 0x7f88100de040 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f88100de040 0x7f88100df430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f88100de040 0x7f88100df430 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88200083f0 con 0x7f88100de040 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d44fe0 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d40640 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88200083f0 con 0x55ada4d40640 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d40640 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d44fe0 2024-09-18T02:04:19.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d44fe0 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x7f88100de040 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8820026040 con 0x7f88100de040 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d49900 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d40640 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.668+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d44fe0 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d40640 2024-09-18T02:04:19.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x7f88100de040 2024-09-18T02:04:19.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8820026040 con 0x7f88100de040 2024-09-18T02:04:19.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d49900 2024-09-18T02:04:19.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d49900 2024-09-18T02:04:19.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d44fe0 2024-09-18T02:04:19.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d49900 2024-09-18T02:04:19.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d49900 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d40640 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d40640 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.672+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d44fe0 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d49900 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x7f88100de040 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8820026040 con 0x7f88100de040 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d40640 2024-09-18T02:04:19.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d44fe0 2024-09-18T02:04:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d49900 2024-09-18T02:04:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d44fe0 2024-09-18T02:04:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x7f88100de040 2024-09-18T02:04:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8820026040 con 0x7f88100de040 2024-09-18T02:04:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d49900 2024-09-18T02:04:19.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d44fe0 2024-09-18T02:04:19.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.676+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x55ada4d40640 2024-09-18T02:04:19.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d44280 con 0x7f88100de040 2024-09-18T02:04:19.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8820026040 con 0x7f88100de040 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d48270 con 0x55ada4d40640 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d48270 con 0x55ada4d40640 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d48270 con 0x55ada4d49900 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 zone default found 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 4 Realm: () 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 zonegroup default 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d48c20 con 0x55ada4d44fe0 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d487c0 con 0x55ada4d49900 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4e730 con 0x55ada4d49900 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 started sync module instance, tier type = 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4db70 con 0x7f88100de040 2024-09-18T02:04:19.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x7f88100de040 2024-09-18T02:04:19.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94204283117712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4db70 con 0x7f88100de040 2024-09-18T02:04:19.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.680+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4f1f0 con 0x55ada4d40640 2024-09-18T02:04:19.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.684+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94204283117712] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x7f88100de040 2024-09-18T02:04:19.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.684+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.684+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94204283120896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4db70 con 0x55ada4d40640 2024-09-18T02:04:19.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.684+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4fc00 con 0x55ada4d49900 2024-09-18T02:04:19.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.684+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94204283120896] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.684+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.684+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94204283115200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4dae0 con 0x55ada4d49900 2024-09-18T02:04:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.684+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d50900 con 0x7f88100de040 2024-09-18T02:04:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.688+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x7f88100de040 2024-09-18T02:04:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.688+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94204283127168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d511a0 con 0x7f88100de040 2024-09-18T02:04:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.688+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d51b60 con 0x55ada4d40640 2024-09-18T02:04:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.688+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94204283115200] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.688+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94204283127168] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x7f88100de040 2024-09-18T02:04:19.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.688+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.688+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94204283131568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d51110 con 0x55ada4d40640 2024-09-18T02:04:19.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.688+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d51ad0 con 0x55ada4d44fe0 2024-09-18T02:04:19.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.692+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.692+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94204283133776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d51ad0 con 0x55ada4d44fe0 2024-09-18T02:04:19.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.692+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d52e40 con 0x55ada4d44fe0 2024-09-18T02:04:19.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.692+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94204283131568] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.692+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94204283133776] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.692+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.692+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94204283134832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d52990 con 0x55ada4d44fe0 2024-09-18T02:04:19.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.692+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d53260 con 0x55ada4d44fe0 2024-09-18T02:04:19.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94204283134832] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94204283136400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d52db0 con 0x55ada4d44fe0 2024-09-18T02:04:19.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 20 add_watcher() i=0 2024-09-18T02:04:19.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 20 add_watcher() i=1 2024-09-18T02:04:19.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 20 add_watcher() i=2 2024-09-18T02:04:19.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 20 add_watcher() i=3 2024-09-18T02:04:19.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 20 add_watcher() i=4 2024-09-18T02:04:19.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 20 add_watcher() i=5 2024-09-18T02:04:19.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 20 add_watcher() i=6 2024-09-18T02:04:19.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94204283136400] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 20 add_watcher() i=7 2024-09-18T02:04:19.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:19.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d56730 con 0x55ada4d40640 2024-09-18T02:04:19.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.696+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94204283138592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d53c50 con 0x55ada4d40640 2024-09-18T02:04:19.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94204283138592] v30'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f86de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:19.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:19.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 5 note: GC not initialized 2024-09-18T02:04:19.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f86dd7e2640 20 reqs_thread_entry: start 2024-09-18T02:04:19.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:19.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 20 Filter name: none 2024-09-18T02:04:19.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f864effd640 20 reqs_thread_entry: start 2024-09-18T02:04:19.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:19.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d79dd0 con 0x55ada4d40640 2024-09-18T02:04:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 20 rados_obj.operate() r=0 bl.length=582 2024-09-18T02:04:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d80430 con 0x55ada4d40640 2024-09-18T02:04:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94204283322016 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d7bdd0 con 0x55ada4d40640 2024-09-18T02:04:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94204283131568 notify 128849018889 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f8820010040 con 0x55ada4d40640 2024-09-18T02:04:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f86ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94204283131568 notifier 4417 bl.length()=732 2024-09-18T02:04:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f86ff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f86ff7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(64 notify.4 [notify cookie 94204283322016 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f86ff7fe640 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f86ec003eb0 con 0x55ada4d40640 2024-09-18T02:04:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.700+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94204283322016 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f882002a450 con 0x55ada4d40640 2024-09-18T02:04:19.707 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T02:04:19.175330Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:19.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.704+0000 7f86de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.704+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94204283138592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d77c00 con 0x55ada4d40640 2024-09-18T02:04:19.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.704+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94204283138592] v30'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.704+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94204283117712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d77c00 con 0x7f88100de040 2024-09-18T02:04:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.704+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94204283117712] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x7f88100de040 2024-09-18T02:04:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.704+0000 7f882ac1b980 20 remove_watcher() i=0 2024-09-18T02:04:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.704+0000 7f882ac1b980 2 removed watcher, disabling cache 2024-09-18T02:04:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.704+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94204283120896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d77c00 con 0x55ada4d40640 2024-09-18T02:04:19.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.708+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94204283120896] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.708+0000 7f882ac1b980 20 remove_watcher() i=1 2024-09-18T02:04:19.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.708+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94204283115200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d77c00 con 0x55ada4d49900 2024-09-18T02:04:19.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.708+0000 7f8827f2a640 1 -- 172.21.15.167:0/1563281059 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94204283115200] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88100cb030 con 0x55ada4d49900 2024-09-18T02:04:19.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.708+0000 7f882ac1b980 20 remove_watcher() i=2 2024-09-18T02:04:19.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.708+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94204283127168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4d6c0 con 0x7f88100de040 2024-09-18T02:04:19.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.708+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94204283127168] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x7f88100de040 2024-09-18T02:04:19.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.708+0000 7f882ac1b980 20 remove_watcher() i=3 2024-09-18T02:04:19.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.708+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94204283131568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4d6c0 con 0x55ada4d40640 2024-09-18T02:04:19.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.712+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94204283131568] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8820026040 con 0x55ada4d40640 2024-09-18T02:04:19.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.712+0000 7f882ac1b980 20 remove_watcher() i=4 2024-09-18T02:04:19.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.712+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94204283133776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d516b0 con 0x55ada4d44fe0 2024-09-18T02:04:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.712+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94204283133776] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.712+0000 7f882ac1b980 20 remove_watcher() i=5 2024-09-18T02:04:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.712+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94204283134832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d4d6c0 con 0x55ada4d44fe0 2024-09-18T02:04:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.716+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94204283134832] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.716+0000 7f882ac1b980 20 remove_watcher() i=6 2024-09-18T02:04:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.716+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94204283136400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ada4d516b0 con 0x55ada4d44fe0 2024-09-18T02:04:19.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.716+0000 7f882872b640 1 -- 172.21.15.167:0/1563281059 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94204283136400] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881806b030 con 0x55ada4d44fe0 2024-09-18T02:04:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.716+0000 7f882ac1b980 20 remove_watcher() i=7 2024-09-18T02:04:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ada4d44fe0 msgr2=0x55ada4d473d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ada4d44fe0 0x55ada4d473d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ada4d40640 msgr2=0x55ada4d42ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ada4d40640 0x55ada4d42ae0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f88100de040 msgr2=0x7f88100df430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f88100de040 0x7f88100df430 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ada4d49900 msgr2=0x55ada4d4bd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ada4d49900 0x55ada4d4bd50 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f86f0034650 msgr2=0x7f86f0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f86f0034650 0x7f86f0036b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f88100abae0 tx=0x7f88100a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 msgr2=0x55ada4d35520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f8828f2c640 1 -- 172.21.15.167:0/1563281059 reap_dead start 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d35520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f881803db80 tx=0x7f8818014520 comp rx=0 tx=0).stop 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 shutdown_connections 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/1563281059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d2e3e0 0x55ada4d35520 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 >> 172.21.15.167:0/1563281059 conn(0x55ada4d2a7c0 msgr2=0x55ada4d28890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 shutdown_connections 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/1563281059 wait complete. 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3457813425 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8700034650 msgr2=0x7f8700036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3457813425 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8700034650 0x7f8700036b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55ada4d0b910 tx=0x7f8810005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3457813425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d21c50 msgr2=0x55ada4d22070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3457813425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d21c50 0x55ada4d22070 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f88180483f0 tx=0x7f8818021cd0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3457813425 shutdown_connections 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3457813425 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8700034650 0x7f8700036b10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3457813425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4d21c50 0x55ada4d22070 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3457813425 >> 172.21.15.167:0/3457813425 conn(0x55ada4d16da0 msgr2=0x55ada4d19820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3457813425 shutdown_connections 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3457813425 wait complete. 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ada4d0d790 msgr2=0x55ada4d0fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ada4d0d790 0x55ada4d0fb80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ada4c15ec0 msgr2=0x55ada4d0ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ada4c15ec0 0x55ada4d0ae90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ada4d116d0 msgr2=0x55ada4d13ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ada4d116d0 0x55ada4d13ac0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8710034650 msgr2=0x7f8710036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8710034650 0x7f8710036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f88100ad000 tx=0x7f88100a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:19.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 msgr2=0x55ada4d03d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 --2- 172.21.15.167:0/3487806989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ada4b84290 0x55ada4d03d90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8818002260 tx=0x7f8818000f50 comp rx=0 tx=0).stop 2024-09-18T02:04:19.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f8828f2c640 1 -- 172.21.15.167:0/3487806989 reap_dead start 2024-09-18T02:04:19.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 shutdown_connections 2024-09-18T02:04:19.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 >> 172.21.15.167:0/3487806989 conn(0x55ada4c0a090 msgr2=0x55ada4cf7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 shutdown_connections 2024-09-18T02:04:19.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.720+0000 7f882ac1b980 1 -- 172.21.15.167:0/3487806989 wait complete. 2024-09-18T02:04:19.732 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T02:04:19.175330Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:19.732 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-18T02:04:19.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-18T02:04:19.732 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-18T02:04:19.810 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:19.810 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:19.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.808+0000 7fdbd1918980 1 Processor -- start 2024-09-18T02:04:19.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.808+0000 7fdbd1918980 1 -- start start 2024-09-18T02:04:19.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.808+0000 7fdbd1918980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55eae87dbc00 0x55eae87ddff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.808+0000 7fdbd1918980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eae865dae0 con 0x55eae87d7880 2024-09-18T02:04:19.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.808+0000 7fdbd1918980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55eae8681e30 con 0x55eae87dbc00 2024-09-18T02:04:19.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.808+0000 7fdbcec27640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55eae87dbc00 0x55eae87ddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.808+0000 7fdbcf428640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55eae87d7880 0x55eae87d7c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55542/0 (socket says 172.21.15.167:55542) 2024-09-18T02:04:19.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.808+0000 7fdbcf428640 1 -- 172.21.15.167:0/2769217652 learned_addr learned my addr 172.21.15.167:0/2769217652 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:19.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.808+0000 7fdbcec27640 1 -- 172.21.15.167:0/2769217652 >> v1:172.21.15.81:6789/0 conn(0x55eae87d7880 legacy=0x55eae87d7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.808+0000 7fdbcec27640 1 -- 172.21.15.167:0/2769217652 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eae87df540 con 0x55eae87dbc00 2024-09-18T02:04:19.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.812+0000 7fdbcec27640 1 --2- 172.21.15.167:0/2769217652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87dbc00 0x55eae87ddff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400a480 tx=0x7fdbc401b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969afb1fd7505d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.812+0000 7fdbce426640 1 -- 172.21.15.167:0/2769217652 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc40af070 con 0x55eae87dbc00 2024-09-18T02:04:19.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.812+0000 7fdbce426640 1 -- 172.21.15.167:0/2769217652 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc40a3e50 con 0x55eae87dbc00 2024-09-18T02:04:19.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.812+0000 7fdbce426640 1 -- 172.21.15.167:0/2769217652 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc40aa680 con 0x55eae87dbc00 2024-09-18T02:04:19.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.812+0000 7fdbd1918980 1 -- 172.21.15.167:0/2769217652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87dbc00 msgr2=0x55eae87ddff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.812+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2769217652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87dbc00 0x55eae87ddff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400a480 tx=0x7fdbc401b110 comp rx=0 tx=0).stop 2024-09-18T02:04:19.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.812+0000 7fdbd1918980 1 -- 172.21.15.167:0/2769217652 shutdown_connections 2024-09-18T02:04:19.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.812+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2769217652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87dbc00 0x55eae87ddff0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.812+0000 7fdbd1918980 1 -- 172.21.15.167:0/2769217652 >> 172.21.15.167:0/2769217652 conn(0x55eae874b1d0 msgr2=0x55eae874b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.812+0000 7fdbd1918980 1 -- 172.21.15.167:0/2769217652 shutdown_connections 2024-09-18T02:04:19.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.812+0000 7fdbd1918980 1 -- 172.21.15.167:0/2769217652 wait complete. 2024-09-18T02:04:19.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.824+0000 7fdbd1918980 1 Processor -- start 2024-09-18T02:04:19.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.824+0000 7fdbd1918980 1 -- start start 2024-09-18T02:04:19.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.824+0000 7fdbd1918980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 0x55eae88c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.824+0000 7fdbd1918980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55eae8683200 con 0x55eae87d7880 2024-09-18T02:04:19.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.824+0000 7fdbcf428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 0x55eae88c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.824+0000 7fdbcf428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 0x55eae88c2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56786/0 (socket says 172.21.15.167:56786) 2024-09-18T02:04:19.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.824+0000 7fdbcf428640 1 -- 172.21.15.167:0/2363025581 learned_addr learned my addr 172.21.15.167:0/2363025581 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.824+0000 7fdbcf428640 1 -- 172.21.15.167:0/2363025581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eae88c31a0 con 0x55eae87d7880 2024-09-18T02:04:19.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbcf428640 1 --2- 172.21.15.167:0/2363025581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 0x55eae88c2bd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8001860 tx=0x7fdbc8001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4fb32a6bb9e0b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdabd60a640 1 -- 172.21.15.167:0/2363025581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8003460 con 0x55eae87d7880 2024-09-18T02:04:19.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdabd60a640 1 -- 172.21.15.167:0/2363025581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc8003600 con 0x55eae87d7880 2024-09-18T02:04:19.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdabd60a640 1 -- 172.21.15.167:0/2363025581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8003920 con 0x55eae87d7880 2024-09-18T02:04:19.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 -- 172.21.15.167:0/2363025581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 msgr2=0x55eae88c2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2363025581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 0x55eae88c2bd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8001860 tx=0x7fdbc8001d20 comp rx=0 tx=0).stop 2024-09-18T02:04:19.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 -- 172.21.15.167:0/2363025581 shutdown_connections 2024-09-18T02:04:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2363025581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 0x55eae88c2bd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 -- 172.21.15.167:0/2363025581 >> 172.21.15.167:0/2363025581 conn(0x55eae874b1d0 msgr2=0x55eae88be800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 -- 172.21.15.167:0/2363025581 shutdown_connections 2024-09-18T02:04:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 -- 172.21.15.167:0/2363025581 wait complete. 2024-09-18T02:04:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 Processor -- start 2024-09-18T02:04:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 -- start start 2024-09-18T02:04:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 0x55eae88ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55eae87df040 con 0x55eae87d7880 2024-09-18T02:04:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbcf428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 0x55eae88ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbcf428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 0x55eae88ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56796/0 (socket says 172.21.15.167:56796) 2024-09-18T02:04:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbcf428640 1 -- 172.21.15.167:0/2619489006 learned_addr learned my addr 172.21.15.167:0/2619489006 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbcf428640 1 -- 172.21.15.167:0/2619489006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eae88ca590 con 0x55eae87d7880 2024-09-18T02:04:19.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbcf428640 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 0x55eae88ca050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8001d60 tx=0x7fdbc8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdabbe07640 1 -- 172.21.15.167:0/2619489006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8013760 con 0x55eae87d7880 2024-09-18T02:04:19.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eae88ca820 con 0x55eae87d7880 2024-09-18T02:04:19.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eae88cd500 con 0x55eae87d7880 2024-09-18T02:04:19.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdabbe07640 1 -- 172.21.15.167:0/2619489006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc8023070 con 0x55eae87d7880 2024-09-18T02:04:19.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.828+0000 7fdabbe07640 1 -- 172.21.15.167:0/2619489006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8013a30 con 0x55eae87d7880 2024-09-18T02:04:19.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdabbe07640 1 -- 172.21.15.167:0/2619489006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdbc8010070 con 0x55eae87d7880 2024-09-18T02:04:19.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdabbe07640 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdab40346a0 0x7fdab4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdabbe07640 1 -- 172.21.15.167:0/2619489006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdbc8049c10 con 0x55eae87d7880 2024-09-18T02:04:19.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbcec27640 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdab40346a0 0x7fdab4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55eae87dbc00 0x55eae88d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae88d1650 con 0x55eae87dbc00 2024-09-18T02:04:19.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbcfc29640 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55eae87dbc00 0x55eae88d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbcec27640 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdab40346a0 0x7fdab4036b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40ac000 tx=0x7fdbc40a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbcfc29640 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55eae87dbc00 0x55eae88d0fe0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbcfc29640 1 -- 172.21.15.167:0/2619489006 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbc00083f0 con 0x55eae87dbc00 2024-09-18T02:04:19.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae88ce720 con 0x55eae87dbc00 2024-09-18T02:04:19.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbcfc29640 1 -- 172.21.15.167:0/2619489006 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbc00083f0 con 0x55eae87dbc00 2024-09-18T02:04:19.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55eae88d39a0 0x55eae88d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae88d6480 con 0x55eae88d39a0 2024-09-18T02:04:19.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbcf428640 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55eae88d39a0 0x55eae88d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.832+0000 7fdbcf428640 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55eae88d39a0 0x55eae88d5d90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbcf428640 1 -- 172.21.15.167:0/2619489006 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdbc800f030 con 0x55eae88d39a0 2024-09-18T02:04:19.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae88d2840 con 0x55eae87dbc00 2024-09-18T02:04:19.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbcfc29640 1 -- 172.21.15.167:0/2619489006 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbc00083f0 con 0x55eae87dbc00 2024-09-18T02:04:19.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55eae88d78e0 0x55eae88d9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae88da410 con 0x55eae88d78e0 2024-09-18T02:04:19.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbcec27640 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55eae88d78e0 0x55eae88d9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbcec27640 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55eae88d78e0 0x55eae88d9cd0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbcec27640 1 -- 172.21.15.167:0/2619489006 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdbc40b2040 con 0x55eae88d78e0 2024-09-18T02:04:19.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbd1918980 1 Processor -- start 2024-09-18T02:04:19.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbd1918980 1 -- start start 2024-09-18T02:04:19.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbd1918980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88e7ee0 0x55eae88e8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbd1918980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55eae86dc800 con 0x55eae88e7ee0 2024-09-18T02:04:19.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbcf428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88e7ee0 0x55eae88e8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbcf428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88e7ee0 0x55eae88e8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56798/0 (socket says 172.21.15.167:56798) 2024-09-18T02:04:19.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbcf428640 1 -- 172.21.15.167:0/1785300651 learned_addr learned my addr 172.21.15.167:0/1785300651 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbcf428640 1 -- 172.21.15.167:0/1785300651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eae88e8840 con 0x55eae88e7ee0 2024-09-18T02:04:19.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbcf428640 1 --2- 172.21.15.167:0/1785300651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88e7ee0 0x55eae88e8300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8048150 tx=0x7fdbc800bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdab9602640 1 -- 172.21.15.167:0/1785300651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8041cf0 con 0x55eae88e7ee0 2024-09-18T02:04:19.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbd1918980 1 -- 172.21.15.167:0/1785300651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eae88e8ad0 con 0x55eae88e7ee0 2024-09-18T02:04:19.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdab9602640 1 -- 172.21.15.167:0/1785300651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc8019040 con 0x55eae88e7ee0 2024-09-18T02:04:19.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdab9602640 1 -- 172.21.15.167:0/1785300651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8041120 con 0x55eae88e7ee0 2024-09-18T02:04:19.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.836+0000 7fdbd1918980 1 -- 172.21.15.167:0/1785300651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eae88eb750 con 0x55eae88e7ee0 2024-09-18T02:04:19.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdab9602640 1 -- 172.21.15.167:0/1785300651 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdbc8041340 con 0x55eae88e7ee0 2024-09-18T02:04:19.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdab9602640 1 --2- 172.21.15.167:0/1785300651 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdaa80347a0 0x7fdaa8036c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdab9602640 1 -- 172.21.15.167:0/1785300651 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdbc8004170 con 0x55eae88e7ee0 2024-09-18T02:04:19.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbcec27640 1 --2- 172.21.15.167:0/1785300651 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdaa80347a0 0x7fdaa8036c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 Processor -- start 2024-09-18T02:04:19.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 -- start start 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55eae88c3520 con 0x55eae88f49e0 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbcec27640 1 --2- 172.21.15.167:0/1785300651 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdaa80347a0 0x7fdaa8036c60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55eae88d1b20 tx=0x7fdbc4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbcf428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbcf428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88f4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56800/0 (socket says 172.21.15.167:56800) 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbcf428640 1 -- 172.21.15.167:0/75984553 learned_addr learned my addr 172.21.15.167:0/75984553 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbcf428640 1 -- 172.21.15.167:0/75984553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eae88f5390 con 0x55eae88f49e0 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbcf428640 1 --2- 172.21.15.167:0/75984553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88f4dc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8002240 tx=0x7fdbc803e6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b00644001904d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdab2ffd640 1 -- 172.21.15.167:0/75984553 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8062020 con 0x55eae88f49e0 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdab2ffd640 1 -- 172.21.15.167:0/75984553 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc8057070 con 0x55eae88f49e0 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdab2ffd640 1 -- 172.21.15.167:0/75984553 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8014d80 con 0x55eae88f49e0 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 -- 172.21.15.167:0/75984553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 msgr2=0x55eae88f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 --2- 172.21.15.167:0/75984553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88f4dc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8002240 tx=0x7fdbc803e6a0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 -- 172.21.15.167:0/75984553 shutdown_connections 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 --2- 172.21.15.167:0/75984553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88f4dc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 -- 172.21.15.167:0/75984553 >> 172.21.15.167:0/75984553 conn(0x55eae88f0dc0 msgr2=0x55eae88eeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 -- 172.21.15.167:0/75984553 shutdown_connections 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 -- 172.21.15.167:0/75984553 wait complete. 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 Processor -- start 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 -- start start 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88fbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbd1918980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55eae88f5830 con 0x55eae88f49e0 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbcf428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88fbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbcf428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88fbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56802/0 (socket says 172.21.15.167:56802) 2024-09-18T02:04:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.840+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 learned_addr learned my addr 172.21.15.167:0/1779279091 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eae88fc100 con 0x55eae88f49e0 2024-09-18T02:04:19.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbcf428640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88fbbc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdbc803e6e0 tx=0x7fdbc8021f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdab17fa640 1 -- 172.21.15.167:0/1779279091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc806e020 con 0x55eae88f49e0 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eae88fc100 con 0x55eae88f49e0 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdab17fa640 1 -- 172.21.15.167:0/1779279091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc8033440 con 0x55eae88f49e0 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdab17fa640 1 -- 172.21.15.167:0/1779279091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8062030 con 0x55eae88f49e0 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eae88fc5d0 con 0x55eae88f49e0 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdab17fa640 1 -- 172.21.15.167:0/1779279091 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdbc8071020 con 0x55eae88f49e0 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdab17fa640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fda98034600 0x7fda98036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdab17fa640 1 -- 172.21.15.167:0/1779279091 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdbc8074ab0 con 0x55eae88f49e0 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbcec27640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fda98034600 0x7fda98036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55eae8906be0 0x55eae89090a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae89097f0 con 0x55eae8906be0 2024-09-18T02:04:19.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbcfc29640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55eae8906be0 0x55eae89090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbcec27640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fda98034600 0x7fda98036ac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdbc401b150 tx=0x7fdbc40b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbcfc29640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55eae8906be0 0x55eae89090a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbc00083f0 con 0x55eae8906be0 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 20 realm 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae8909c00 con 0x55eae8906be0 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbc00083f0 con 0x55eae8906be0 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a4a0 con 0x55eae8906be0 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbc00083f0 con 0x55eae8906be0 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.844+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x55eae8906be0 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbc00083f0 con 0x55eae8906be0 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbd1918980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55eae890b5a0 0x55eae890d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae890dfe0 con 0x55eae890b5a0 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcf428640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55eae890b5a0 0x55eae890d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcf428640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55eae890b5a0 0x55eae890d990 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbd1918980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbd1918980 20 searching for the correct realm 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55eae890fec0 0x55eae8912360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae89129e0 con 0x55eae890fec0 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcec27640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55eae890fec0 0x55eae8912360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcec27640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55eae890fec0 0x55eae8912360 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcec27640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fdbc40cc040 0x7fdbc40d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae89129e0 con 0x7fdbc40cc040 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcfc29640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fdbc40cc040 0x7fdbc40d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcfc29640 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fdbc40cc040 0x7fdbc40d9410 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc00083f0 con 0x7fdbc40cc040 2024-09-18T02:04:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x55eae890b5a0 2024-09-18T02:04:19.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.848+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x55eae8906be0 2024-09-18T02:04:19.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc00083f0 con 0x55eae8906be0 2024-09-18T02:04:19.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x55eae8906be0 2024-09-18T02:04:19.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x55eae890b5a0 2024-09-18T02:04:19.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x55eae890b5a0 2024-09-18T02:04:19.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x7fdbc40cc040 2024-09-18T02:04:19.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x55eae890fec0 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x55eae8906be0 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x55eae890b5a0 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x55eae8906be0 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x7fdbc40cc040 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eae890a840 con 0x55eae890fec0 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.852+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae890fec0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae890b5a0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae890fec0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae890fec0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae8906be0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae8906be0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae890b5a0 2024-09-18T02:04:19.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae890fec0 2024-09-18T02:04:19.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x7fdbc40cc040 2024-09-18T02:04:19.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae8906be0 2024-09-18T02:04:19.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae890b5a0 2024-09-18T02:04:19.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.856+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae890fec0 2024-09-18T02:04:19.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae890b5a0 2024-09-18T02:04:19.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x7fdbc40cc040 2024-09-18T02:04:19.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae890fec0 2024-09-18T02:04:19.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae890b5a0 2024-09-18T02:04:19.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x55eae8906be0 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdbc40e6080 con 0x7fdbc40cc040 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae890e830 con 0x55eae8906be0 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae890e830 con 0x55eae8906be0 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae890e830 con 0x55eae890fec0 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 zone default found 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 4 Realm: () 2024-09-18T02:04:19.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 zonegroup default 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.860+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae890f180 con 0x55eae890b5a0 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae89148a0 con 0x55eae890fec0 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae8914cf0 con 0x55eae890fec0 2024-09-18T02:04:19.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:19.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 20 started sync module instance, tier type = 2024-09-18T02:04:19.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:19.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8913ce0 con 0x7fdbc40cc040 2024-09-18T02:04:19.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94467412541920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8913ce0 con 0x7fdbc40cc040 2024-09-18T02:04:19.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae89157f0 con 0x55eae8906be0 2024-09-18T02:04:19.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94467412541920] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94467412546304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8913ce0 con 0x55eae8906be0 2024-09-18T02:04:19.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.864+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8916230 con 0x55eae890fec0 2024-09-18T02:04:19.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.868+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94467412546304] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.868+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.868+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94467412539440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8913c50 con 0x55eae890fec0 2024-09-18T02:04:19.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.868+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8916f80 con 0x7fdbc40cc040 2024-09-18T02:04:19.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.868+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.868+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94467412552400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae89173a0 con 0x7fdbc40cc040 2024-09-18T02:04:19.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.868+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8917e40 con 0x55eae8906be0 2024-09-18T02:04:19.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.872+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94467412552400] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.872+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94467412539440] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.872+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.872+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94467412556080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8916ef0 con 0x55eae8906be0 2024-09-18T02:04:19.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.872+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8918710 con 0x55eae890b5a0 2024-09-18T02:04:19.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.872+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94467412556080] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.872+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.872+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94467412558432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8916ef0 con 0x55eae890b5a0 2024-09-18T02:04:19.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.872+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8918f60 con 0x55eae890b5a0 2024-09-18T02:04:19.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94467412562688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8919bd0 con 0x55eae890b5a0 2024-09-18T02:04:19.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae891a590 con 0x55eae890b5a0 2024-09-18T02:04:19.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94467412558432] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94467412562688] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94467412563744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8919b40 con 0x55eae890b5a0 2024-09-18T02:04:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbd1918980 20 add_watcher() i=0 2024-09-18T02:04:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbd1918980 20 add_watcher() i=1 2024-09-18T02:04:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbd1918980 20 add_watcher() i=2 2024-09-18T02:04:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbd1918980 20 add_watcher() i=3 2024-09-18T02:04:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbd1918980 20 add_watcher() i=4 2024-09-18T02:04:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbd1918980 20 add_watcher() i=5 2024-09-18T02:04:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.876+0000 7fdbd1918980 20 add_watcher() i=6 2024-09-18T02:04:19.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94467412563744] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 20 add_watcher() i=7 2024-09-18T02:04:19.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:19.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae891d5c0 con 0x55eae8906be0 2024-09-18T02:04:19.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94467412566240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae891aa50 con 0x55eae8906be0 2024-09-18T02:04:19.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94467412566240] v30'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fda85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 5 note: GC not initialized 2024-09-18T02:04:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fda84fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 20 Filter name: none 2024-09-18T02:04:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fd9fe7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 20 rados->read ofs=0 len=0 2024-09-18T02:04:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae8940bc0 con 0x55eae8906be0 2024-09-18T02:04:19.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T02:04:19.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:19.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:19.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.880+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8947300 con 0x55eae8906be0 2024-09-18T02:04:19.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbd1918980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbd1918980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbd1918980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94467412749712 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae8942a90 con 0x55eae8906be0 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94467412556080 notify 128849018890 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fdbc0010040 con 0x55eae8906be0 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdab2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94467412556080 notifier 4424 bl.length()=567 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdab2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdab2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(64 notify.4 [notify cookie 94467412749712 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdab2ffd640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fda94003eb0 con 0x55eae8906be0 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94467412749712 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdbc002a450 con 0x55eae8906be0 2024-09-18T02:04:19.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8946d90 con 0x7fdbc40cc040 2024-09-18T02:04:19.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 foo:foo2 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbd1918980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-18T02:04:19.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94467412749712 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eae89425e0 con 0x7fdbc40cc040 2024-09-18T02:04:19.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== watch-notify(notify (1) cookie 94467412541920 notify 128849018885 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fdbc002a450 con 0x7fdbc40cc040 2024-09-18T02:04:19.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdab2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94467412541920 notifier 4424 bl.length()=159 2024-09-18T02:04:19.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.884+0000 7fdab2ffd640 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fda94003eb0 con 0x7fdbc40cc040 2024-09-18T02:04:19.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.888+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [notify cookie 94467412749712 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.888+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.888+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== watch-notify(notify_complete (2) cookie 94467412749712 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdbc002a7c0 con 0x7fdbc40cc040 2024-09-18T02:04:19.890 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:19.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.888+0000 7fda85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:19.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.888+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94467412566240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae893e9f0 con 0x55eae8906be0 2024-09-18T02:04:19.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.888+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94467412566240] v30'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.888+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94467412541920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae893e9f0 con 0x7fdbc40cc040 2024-09-18T02:04:19.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.888+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94467412541920] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.888+0000 7fdbd1918980 20 remove_watcher() i=0 2024-09-18T02:04:19.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.888+0000 7fdbd1918980 2 removed watcher, disabling cache 2024-09-18T02:04:19.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.888+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94467412546304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae89141e0 con 0x55eae8906be0 2024-09-18T02:04:19.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.892+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94467412546304] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.892+0000 7fdbd1918980 20 remove_watcher() i=1 2024-09-18T02:04:19.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.892+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94467412539440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae893e9f0 con 0x55eae890fec0 2024-09-18T02:04:19.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.892+0000 7fdbcec27640 1 -- 172.21.15.167:0/1779279091 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94467412539440] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc40d7070 con 0x55eae890fec0 2024-09-18T02:04:19.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.892+0000 7fdbd1918980 20 remove_watcher() i=2 2024-09-18T02:04:19.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.892+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94467412552400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8915300 con 0x7fdbc40cc040 2024-09-18T02:04:19.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.892+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94467412552400] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x7fdbc40cc040 2024-09-18T02:04:19.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.892+0000 7fdbd1918980 20 remove_watcher() i=3 2024-09-18T02:04:19.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.892+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94467412556080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae89141e0 con 0x55eae8906be0 2024-09-18T02:04:19.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.896+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94467412556080] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc0026040 con 0x55eae8906be0 2024-09-18T02:04:19.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.896+0000 7fdbd1918980 20 remove_watcher() i=4 2024-09-18T02:04:19.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.896+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94467412558432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae893e9f0 con 0x55eae890b5a0 2024-09-18T02:04:19.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.900+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94467412558432] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.900+0000 7fdbd1918980 20 remove_watcher() i=5 2024-09-18T02:04:19.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.900+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94467412562688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8916ad0 con 0x55eae890b5a0 2024-09-18T02:04:19.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.900+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94467412562688] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.900+0000 7fdbd1918980 20 remove_watcher() i=6 2024-09-18T02:04:19.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.900+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94467412563744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eae8915300 con 0x55eae890b5a0 2024-09-18T02:04:19.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.900+0000 7fdbcf428640 1 -- 172.21.15.167:0/1779279091 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94467412563744] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc8064040 con 0x55eae890b5a0 2024-09-18T02:04:19.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.900+0000 7fdbd1918980 20 remove_watcher() i=7 2024-09-18T02:04:19.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.900+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55eae890b5a0 msgr2=0x55eae890d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.900+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55eae890b5a0 0x55eae890d990 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55eae8906be0 msgr2=0x55eae89090a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55eae8906be0 0x55eae89090a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fdbc40cc040 msgr2=0x7fdbc40d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fdbc40cc040 0x7fdbc40d9410 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55eae890fec0 msgr2=0x55eae8912360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55eae890fec0 0x55eae8912360 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fda98034600 msgr2=0x7fda98036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fda98034600 0x7fda98036ac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdbc401b150 tx=0x7fdbc40b8040 comp rx=0 tx=0).stop 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 msgr2=0x55eae88fbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88fbbc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdbc803e6e0 tx=0x7fdbc8021f00 comp rx=0 tx=0).stop 2024-09-18T02:04:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbcfc29640 1 -- 172.21.15.167:0/1779279091 reap_dead start 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 shutdown_connections 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1779279091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88f49e0 0x55eae88fbbc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 >> 172.21.15.167:0/1779279091 conn(0x55eae88f0dc0 msgr2=0x55eae88eee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 shutdown_connections 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1779279091 wait complete. 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1785300651 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdaa80347a0 msgr2=0x7fdaa8036c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1785300651 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdaa80347a0 0x7fdaa8036c60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55eae88d1b20 tx=0x7fdbc4005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1785300651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88e7ee0 msgr2=0x55eae88e8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1785300651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88e7ee0 0x55eae88e8300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8048150 tx=0x7fdbc800bb30 comp rx=0 tx=0).stop 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1785300651 shutdown_connections 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1785300651 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdaa80347a0 0x7fdaa8036c60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/1785300651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae88e7ee0 0x55eae88e8300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1785300651 >> 172.21.15.167:0/1785300651 conn(0x55eae88dd030 msgr2=0x55eae88dfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1785300651 shutdown_connections 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/1785300651 wait complete. 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55eae88d39a0 msgr2=0x55eae88d5d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55eae88d39a0 0x55eae88d5d90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55eae87dbc00 msgr2=0x55eae88d0fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55eae87dbc00 0x55eae88d0fe0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55eae88d78e0 msgr2=0x55eae88d9cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55eae88d78e0 0x55eae88d9cd0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdab40346a0 msgr2=0x7fdab4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdab40346a0 0x7fdab4036b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40ac000 tx=0x7fdbc40a5000 comp rx=0 tx=0).stop 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 msgr2=0x55eae88ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 --2- 172.21.15.167:0/2619489006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eae87d7880 0x55eae88ca050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8001d60 tx=0x7fdbc8000f50 comp rx=0 tx=0).stop 2024-09-18T02:04:19.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbcfc29640 1 -- 172.21.15.167:0/2619489006 reap_dead start 2024-09-18T02:04:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 shutdown_connections 2024-09-18T02:04:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 >> 172.21.15.167:0/2619489006 conn(0x55eae874b1d0 msgr2=0x55eae88bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 shutdown_connections 2024-09-18T02:04:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.904+0000 7fdbd1918980 1 -- 172.21.15.167:0/2619489006 wait complete. 2024-09-18T02:04:19.916 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:19.916 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-18T02:04:19.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-18T02:04:19.916 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-18T02:04:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:19.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.980+0000 7fa25072b980 1 Processor -- start 2024-09-18T02:04:19.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.980+0000 7fa25072b980 1 -- start start 2024-09-18T02:04:19.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.980+0000 7fa25072b980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x560d4cb9b570 0x560d4cb9b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:19.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.980+0000 7fa25072b980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560d4ca24ae0 con 0x560d4cb9bec0 2024-09-18T02:04:19.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.980+0000 7fa25072b980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x560d4ca48e30 con 0x560d4cb9b570 2024-09-18T02:04:19.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.984+0000 7fa24e23b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x560d4cb9b570 0x560d4cb9b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:19.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.984+0000 7fa24e23b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x560d4cb9b570 0x560d4cb9b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56818/0 (socket says 172.21.15.167:56818) 2024-09-18T02:04:19.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.984+0000 7fa24e23b640 1 -- 172.21.15.167:0/3588184086 learned_addr learned my addr 172.21.15.167:0/3588184086 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:19.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.984+0000 7fa24da3a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x560d4cb9bec0 0x560d4cba08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55548/0 (socket says 172.21.15.167:55548) 2024-09-18T02:04:19.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.984+0000 7fa24e23b640 1 -- 172.21.15.167:0/3588184086 >> v1:172.21.15.81:6789/0 conn(0x560d4cb9bec0 legacy=0x560d4cba08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.984+0000 7fa24e23b640 1 -- 172.21.15.167:0/3588184086 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d4cb108e0 con 0x560d4cb9b570 2024-09-18T02:04:19.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.984+0000 7fa24e23b640 1 --2- 172.21.15.167:0/3588184086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cb9b950 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa24800a4e0 tx=0x7fa24801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9423531565bc6836 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:19.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.984+0000 7fa24d239640 1 -- 172.21.15.167:0/3588184086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2480aa540 con 0x560d4cb9b570 2024-09-18T02:04:19.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.984+0000 7fa24d239640 1 -- 172.21.15.167:0/3588184086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2480aa6e0 con 0x560d4cb9b570 2024-09-18T02:04:19.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.984+0000 7fa24d239640 1 -- 172.21.15.167:0/3588184086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2480aaa40 con 0x560d4cb9b570 2024-09-18T02:04:19.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.988+0000 7fa25072b980 1 -- 172.21.15.167:0/3588184086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 msgr2=0x560d4cb9b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:19.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.988+0000 7fa25072b980 1 --2- 172.21.15.167:0/3588184086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cb9b950 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa24800a4e0 tx=0x7fa24801b090 comp rx=0 tx=0).stop 2024-09-18T02:04:19.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.988+0000 7fa25072b980 1 -- 172.21.15.167:0/3588184086 shutdown_connections 2024-09-18T02:04:19.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.988+0000 7fa25072b980 1 --2- 172.21.15.167:0/3588184086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cb9b950 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:19.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.988+0000 7fa25072b980 1 -- 172.21.15.167:0/3588184086 >> 172.21.15.167:0/3588184086 conn(0x560d4cb97090 msgr2=0x560d4cb994b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:19.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.988+0000 7fa25072b980 1 -- 172.21.15.167:0/3588184086 shutdown_connections 2024-09-18T02:04:19.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:19.988+0000 7fa25072b980 1 -- 172.21.15.167:0/3588184086 wait complete. 2024-09-18T02:04:20.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 Processor -- start 2024-09-18T02:04:20.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 -- start start 2024-09-18T02:04:20.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cc87a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560d4ca4a200 con 0x560d4cb9b570 2024-09-18T02:04:20.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa24e23b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cc87a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa24e23b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cc87a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56828/0 (socket says 172.21.15.167:56828) 2024-09-18T02:04:20.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa24e23b640 1 -- 172.21.15.167:0/231678187 learned_addr learned my addr 172.21.15.167:0/231678187 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa24e23b640 1 -- 172.21.15.167:0/231678187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d4cc87fd0 con 0x560d4cb9b570 2024-09-18T02:04:20.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa24e23b640 1 --2- 172.21.15.167:0/231678187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cc87a00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa248017ca0 tx=0x7fa2480033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f61de8e272ea921 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa13c608640 1 -- 172.21.15.167:0/231678187 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2480b9030 con 0x560d4cb9b570 2024-09-18T02:04:20.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa13c608640 1 -- 172.21.15.167:0/231678187 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2480aaac0 con 0x560d4cb9b570 2024-09-18T02:04:20.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa13c608640 1 -- 172.21.15.167:0/231678187 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2480aada0 con 0x560d4cb9b570 2024-09-18T02:04:20.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 -- 172.21.15.167:0/231678187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 msgr2=0x560d4cc87a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 --2- 172.21.15.167:0/231678187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cc87a00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa248017ca0 tx=0x7fa2480033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 -- 172.21.15.167:0/231678187 shutdown_connections 2024-09-18T02:04:20.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 --2- 172.21.15.167:0/231678187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cc87a00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 -- 172.21.15.167:0/231678187 >> 172.21.15.167:0/231678187 conn(0x560d4cb97090 msgr2=0x560d4cc83630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 -- 172.21.15.167:0/231678187 shutdown_connections 2024-09-18T02:04:20.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 -- 172.21.15.167:0/231678187 wait complete. 2024-09-18T02:04:20.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 Processor -- start 2024-09-18T02:04:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 -- start start 2024-09-18T02:04:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cc8ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.000+0000 7fa25072b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560d4cb11680 con 0x560d4cb9b570 2024-09-18T02:04:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa24e23b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cc8ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa24e23b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cc8ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56844/0 (socket says 172.21.15.167:56844) 2024-09-18T02:04:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa24e23b640 1 -- 172.21.15.167:0/715645187 learned_addr learned my addr 172.21.15.167:0/715645187 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa24e23b640 1 -- 172.21.15.167:0/715645187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d4cc8f130 con 0x560d4cb9b570 2024-09-18T02:04:20.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa24e23b640 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cc8ebf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa248005cc0 tx=0x7fa248017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa13ae05640 1 -- 172.21.15.167:0/715645187 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2480b9030 con 0x560d4cb9b570 2024-09-18T02:04:20.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa13ae05640 1 -- 172.21.15.167:0/715645187 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2480c3070 con 0x560d4cb9b570 2024-09-18T02:04:20.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d4cc8f3c0 con 0x560d4cb9b570 2024-09-18T02:04:20.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa13ae05640 1 -- 172.21.15.167:0/715645187 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2480bf750 con 0x560d4cb9b570 2024-09-18T02:04:20.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d4cc920a0 con 0x560d4cb9b570 2024-09-18T02:04:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa13ae05640 1 -- 172.21.15.167:0/715645187 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa2480c5030 con 0x560d4cb9b570 2024-09-18T02:04:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa13ae05640 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa134034650 0x7fa134036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa13ae05640 1 -- 172.21.15.167:0/715645187 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa2480ba070 con 0x560d4cb9b570 2024-09-18T02:04:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa24da3a640 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa134034650 0x7fa134036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa25072b980 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560d4cb9bec0 0x560d4cc95b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4cc961f0 con 0x560d4cb9bec0 2024-09-18T02:04:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa24ea3c640 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560d4cb9bec0 0x560d4cc95b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa24da3a640 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa134034650 0x7fa134036b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa244000f70 tx=0x7fa244001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.004+0000 7fa24ea3c640 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560d4cb9bec0 0x560d4cc95b80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa24ea3c640 1 -- 172.21.15.167:0/715645187 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2400083f0 con 0x560d4cb9bec0 2024-09-18T02:04:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4cc932a0 con 0x560d4cb9bec0 2024-09-18T02:04:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa24ea3c640 1 -- 172.21.15.167:0/715645187 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2400083f0 con 0x560d4cb9bec0 2024-09-18T02:04:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa25072b980 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560d4cc98570 0x560d4cc9a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4cc9b030 con 0x560d4cc98570 2024-09-18T02:04:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa24e23b640 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560d4cc98570 0x560d4cc9a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa24e23b640 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560d4cc98570 0x560d4cc9a960 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa24e23b640 1 -- 172.21.15.167:0/715645187 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa2480ce070 con 0x560d4cc98570 2024-09-18T02:04:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4cc97410 con 0x560d4cb9bec0 2024-09-18T02:04:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa24ea3c640 1 -- 172.21.15.167:0/715645187 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2400083f0 con 0x560d4cb9bec0 2024-09-18T02:04:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa25072b980 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560d4cc9c490 0x560d4cc9e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4cc9ef80 con 0x560d4cc9c490 2024-09-18T02:04:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa24da3a640 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560d4cc9c490 0x560d4cc9e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa24da3a640 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560d4cc9c490 0x560d4cc9e880 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa24da3a640 1 -- 172.21.15.167:0/715645187 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa24400f6a0 con 0x560d4cc9c490 2024-09-18T02:04:20.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa25072b980 1 Processor -- start 2024-09-18T02:04:20.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa25072b980 1 -- start start 2024-09-18T02:04:20.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa25072b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cba4cc0 0x560d4cba3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa25072b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560d4caa3800 con 0x560d4cba4cc0 2024-09-18T02:04:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.008+0000 7fa24e23b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cba4cc0 0x560d4cba3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa24e23b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cba4cc0 0x560d4cba3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56858/0 (socket says 172.21.15.167:56858) 2024-09-18T02:04:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa24e23b640 1 -- 172.21.15.167:0/2888053022 learned_addr learned my addr 172.21.15.167:0/2888053022 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa24e23b640 1 -- 172.21.15.167:0/2888053022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d4cba50e0 con 0x560d4cba4cc0 2024-09-18T02:04:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa24e23b640 1 --2- 172.21.15.167:0/2888053022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cba4cc0 0x560d4cba3340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa248008030 tx=0x7fa2480a9720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa133fff640 1 -- 172.21.15.167:0/2888053022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2480c65d0 con 0x560d4cba4cc0 2024-09-18T02:04:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa133fff640 1 -- 172.21.15.167:0/2888053022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2480c6770 con 0x560d4cba4cc0 2024-09-18T02:04:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa133fff640 1 -- 172.21.15.167:0/2888053022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2480b4b50 con 0x560d4cba4cc0 2024-09-18T02:04:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa25072b980 1 -- 172.21.15.167:0/2888053022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d4cba38e0 con 0x560d4cba4cc0 2024-09-18T02:04:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa25072b980 1 -- 172.21.15.167:0/2888053022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d4cba3db0 con 0x560d4cba4cc0 2024-09-18T02:04:20.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa133fff640 1 -- 172.21.15.167:0/2888053022 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa2480df040 con 0x560d4cba4cc0 2024-09-18T02:04:20.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa133fff640 1 --2- 172.21.15.167:0/2888053022 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa1280346a0 0x7fa128036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa133fff640 1 -- 172.21.15.167:0/2888053022 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa2480d2b00 con 0x560d4cba4cc0 2024-09-18T02:04:20.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa24da3a640 1 --2- 172.21.15.167:0/2888053022 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa1280346a0 0x7fa128036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa25072b980 1 Processor -- start 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa25072b980 1 -- start start 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa24da3a640 1 --2- 172.21.15.167:0/2888053022 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa1280346a0 0x7fa128036b60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x560d4cc96b20 tx=0x7fa24400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa25072b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 0x560d4ccbb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa25072b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560d4cc88290 con 0x560d4ccbb5f0 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa24e23b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 0x560d4ccbb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa24e23b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 0x560d4ccbb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56860/0 (socket says 172.21.15.167:56860) 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa24e23b640 1 -- 172.21.15.167:0/1344700308 learned_addr learned my addr 172.21.15.167:0/1344700308 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa24e23b640 1 -- 172.21.15.167:0/1344700308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d4ccbbfa0 con 0x560d4ccbb5f0 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.012+0000 7fa24e23b640 1 --2- 172.21.15.167:0/1344700308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 0x560d4ccbb9d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa2480c9000 tx=0x7fa2480c7410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180e4672422d4eed server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa131ffb640 1 -- 172.21.15.167:0/1344700308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2480c8dc0 con 0x560d4ccbb5f0 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa131ffb640 1 -- 172.21.15.167:0/1344700308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2480f1030 con 0x560d4ccbb5f0 2024-09-18T02:04:20.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa131ffb640 1 -- 172.21.15.167:0/1344700308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2480d2da0 con 0x560d4ccbb5f0 2024-09-18T02:04:20.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 -- 172.21.15.167:0/1344700308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 msgr2=0x560d4ccbb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 --2- 172.21.15.167:0/1344700308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 0x560d4ccbb9d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa2480c9000 tx=0x7fa2480c7410 comp rx=0 tx=0).stop 2024-09-18T02:04:20.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 -- 172.21.15.167:0/1344700308 shutdown_connections 2024-09-18T02:04:20.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 --2- 172.21.15.167:0/1344700308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 0x560d4ccbb9d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 -- 172.21.15.167:0/1344700308 >> 172.21.15.167:0/1344700308 conn(0x560d4ccb7920 msgr2=0x560d4ccb5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 -- 172.21.15.167:0/1344700308 shutdown_connections 2024-09-18T02:04:20.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 -- 172.21.15.167:0/1344700308 wait complete. 2024-09-18T02:04:20.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 Processor -- start 2024-09-18T02:04:20.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 -- start start 2024-09-18T02:04:20.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 0x560d4ccc2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560d4ccbc330 con 0x560d4ccbb5f0 2024-09-18T02:04:20.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa24e23b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 0x560d4ccc2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa24e23b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 0x560d4ccc2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56862/0 (socket says 172.21.15.167:56862) 2024-09-18T02:04:20.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 learned_addr learned my addr 172.21.15.167:0/3659470635 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d4ccc2c80 con 0x560d4ccbb5f0 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa24e23b640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 0x560d4ccc2740 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa2480c8d40 tx=0x7fa248009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa11ffff640 1 -- 172.21.15.167:0/3659470635 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa248106070 con 0x560d4ccbb5f0 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d4ccc2c80 con 0x560d4ccbb5f0 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa11ffff640 1 -- 172.21.15.167:0/3659470635 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2480d2e10 con 0x560d4ccbb5f0 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa11ffff640 1 -- 172.21.15.167:0/3659470635 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2480dd020 con 0x560d4ccbb5f0 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d4ccc30f0 con 0x560d4ccbb5f0 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.016+0000 7fa11ffff640 1 -- 172.21.15.167:0/3659470635 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa248109070 con 0x560d4ccbb5f0 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa11ffff640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa118034650 0x7fa118036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa11ffff640 1 -- 172.21.15.167:0/3659470635 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa2480fd030 con 0x560d4ccbb5f0 2024-09-18T02:04:20.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24da3a640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa118034650 0x7fa118036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560d4cccd6b0 0x560d4cccfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd02c0 con 0x560d4cccd6b0 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24ea3c640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560d4cccd6b0 0x560d4cccfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24da3a640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa118034650 0x7fa118036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa24400ffd0 tx=0x7fa244010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24ea3c640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560d4cccd6b0 0x560d4cccfb70 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2400083f0 con 0x560d4cccd6b0 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 20 realm 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd06d0 con 0x560d4cccd6b0 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2400083f0 con 0x560d4cccd6b0 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd0f70 con 0x560d4cccd6b0 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2400083f0 con 0x560d4cccd6b0 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4cccd6b0 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2400083f0 con 0x560d4cccd6b0 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560d4ccd2070 0x560d4ccd4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd49a0 con 0x560d4ccd2070 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24e23b640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560d4ccd2070 0x560d4ccd4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24e23b640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560d4ccd2070 0x560d4ccd4460 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:20.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 20 searching for the correct realm 2024-09-18T02:04:20.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560d4ccd6910 0x560d4ccd8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd94a0 con 0x560d4ccd6910 2024-09-18T02:04:20.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24da3a640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560d4ccd6910 0x560d4ccd8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24da3a640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560d4ccd6910 0x560d4ccd8dd0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24da3a640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa24401fbe0 0x7fa24403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd94a0 con 0x7fa24401fbe0 2024-09-18T02:04:20.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24ea3c640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa24401fbe0 0x7fa24403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.020+0000 7fa24ea3c640 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa24401fbe0 0x7fa24403a3c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2400083f0 con 0x7fa24401fbe0 2024-09-18T02:04:20.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd2070 2024-09-18T02:04:20.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4cccd6b0 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2400083f0 con 0x560d4cccd6b0 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4cccd6b0 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd2070 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd2070 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x7fa24401fbe0 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd6910 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4cccd6b0 2024-09-18T02:04:20.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd2070 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.024+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4cccd6b0 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x7fa24401fbe0 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd6910 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd6910 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd2070 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd6910 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd6910 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4cccd6b0 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4cccd6b0 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd2070 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd6910 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x7fa24401fbe0 2024-09-18T02:04:20.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4cccd6b0 2024-09-18T02:04:20.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.028+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd2070 2024-09-18T02:04:20.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd6910 2024-09-18T02:04:20.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd2070 2024-09-18T02:04:20.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x7fa24401fbe0 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd6910 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4ccd2070 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x560d4cccd6b0 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd1310 con 0x7fa24401fbe0 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:20.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd51f0 con 0x560d4cccd6b0 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd51f0 con 0x560d4cccd6b0 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.032+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd51f0 con 0x560d4ccd6910 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 20 zone default found 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 4 Realm: () 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 20 zonegroup default 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccd5a90 con 0x560d4ccd2070 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdb300 con 0x560d4ccd6910 2024-09-18T02:04:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdb6a0 con 0x560d4ccd6910 2024-09-18T02:04:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 20 started sync module instance, tier type = 2024-09-18T02:04:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccda7a0 con 0x7fa24401fbe0 2024-09-18T02:04:20.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94615123111104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccda7a0 con 0x7fa24401fbe0 2024-09-18T02:04:20.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdc0d0 con 0x560d4cccd6b0 2024-09-18T02:04:20.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.036+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94615123111104] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.040+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.040+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94615123114976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccda7a0 con 0x560d4cccd6b0 2024-09-18T02:04:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.040+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdcb10 con 0x560d4ccd6910 2024-09-18T02:04:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.040+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94615123114976] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.040+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.040+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94615123108592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccda710 con 0x560d4ccd6910 2024-09-18T02:04:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.040+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdd860 con 0x7fa24401fbe0 2024-09-18T02:04:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.040+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.040+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94615123121376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccde100 con 0x7fa24401fbe0 2024-09-18T02:04:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.040+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdeac0 con 0x560d4cccd6b0 2024-09-18T02:04:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.044+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94615123108592] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.044+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94615123121376] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.044+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.044+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94615123125776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccde070 con 0x560d4cccd6b0 2024-09-18T02:04:20.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.044+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdea30 con 0x560d4ccd2070 2024-09-18T02:04:20.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.044+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94615123125776] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.048+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.048+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94615123123440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdf390 con 0x560d4ccd2070 2024-09-18T02:04:20.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.048+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdfbe0 con 0x560d4ccd2070 2024-09-18T02:04:20.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.048+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.048+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94615123132288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4cce0850 con 0x560d4ccd2070 2024-09-18T02:04:20.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.048+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94615123123440] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.048+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4cce1290 con 0x560d4ccd2070 2024-09-18T02:04:20.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.048+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94615123132288] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94615123135840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4cce03a0 con 0x560d4ccd2070 2024-09-18T02:04:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 20 add_watcher() i=0 2024-09-18T02:04:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 20 add_watcher() i=1 2024-09-18T02:04:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 20 add_watcher() i=2 2024-09-18T02:04:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 20 add_watcher() i=3 2024-09-18T02:04:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 20 add_watcher() i=4 2024-09-18T02:04:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 20 add_watcher() i=5 2024-09-18T02:04:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 20 add_watcher() i=6 2024-09-18T02:04:20.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94615123135840] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 20 add_watcher() i=7 2024-09-18T02:04:20.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:20.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4cce03a0 con 0x560d4cccd6b0 2024-09-18T02:04:20.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94615123127952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4cce03a0 con 0x560d4cccd6b0 2024-09-18T02:04:20.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94615123127952] v30'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa104fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 5 note: GC not initialized 2024-09-18T02:04:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa07f7fe640 20 reqs_thread_entry: start 2024-09-18T02:04:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.052+0000 7fa25072b980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa25072b980 20 Filter name: none 2024-09-18T02:04:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa07d7fa640 20 reqs_thread_entry: start 2024-09-18T02:04:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4cd07340 con 0x560d4cccd6b0 2024-09-18T02:04:20.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa25072b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa25072b980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4cd07d30 con 0x560d4cccd6b0 2024-09-18T02:04:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa25072b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560d4cd08d40 con 0x7fa24401fbe0 2024-09-18T02:04:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa104fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94615123127952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4cd05220 con 0x560d4cccd6b0 2024-09-18T02:04:20.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94615123127952] v30'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.056+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94615123111104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4cd05220 con 0x7fa24401fbe0 2024-09-18T02:04:20.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.060+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94615123111104] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.060+0000 7fa25072b980 20 remove_watcher() i=0 2024-09-18T02:04:20.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.060+0000 7fa25072b980 2 removed watcher, disabling cache 2024-09-18T02:04:20.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.060+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94615123114976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4cd05220 con 0x560d4cccd6b0 2024-09-18T02:04:20.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.060+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94615123114976] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.060+0000 7fa25072b980 20 remove_watcher() i=1 2024-09-18T02:04:20.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.060+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94615123108592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4cd05220 con 0x560d4ccd6910 2024-09-18T02:04:20.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.060+0000 7fa24da3a640 1 -- 172.21.15.167:0/3659470635 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94615123108592] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa244037040 con 0x560d4ccd6910 2024-09-18T02:04:20.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.060+0000 7fa25072b980 20 remove_watcher() i=2 2024-09-18T02:04:20.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.060+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94615123121376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdbbe0 con 0x7fa24401fbe0 2024-09-18T02:04:20.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.064+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94615123121376] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x7fa24401fbe0 2024-09-18T02:04:20.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.064+0000 7fa25072b980 20 remove_watcher() i=3 2024-09-18T02:04:20.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.064+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94615123125776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccda2f0 con 0x560d4cccd6b0 2024-09-18T02:04:20.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.064+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94615123125776] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa240026040 con 0x560d4cccd6b0 2024-09-18T02:04:20.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.064+0000 7fa25072b980 20 remove_watcher() i=4 2024-09-18T02:04:20.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.064+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94615123123440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdd4e0 con 0x560d4ccd2070 2024-09-18T02:04:20.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.068+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94615123123440] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.068+0000 7fa25072b980 20 remove_watcher() i=5 2024-09-18T02:04:20.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.068+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94615123132288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccdbbe0 con 0x560d4ccd2070 2024-09-18T02:04:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.068+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94615123132288] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.068+0000 7fa25072b980 20 remove_watcher() i=6 2024-09-18T02:04:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.068+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94615123135840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560d4ccde610 con 0x560d4ccd2070 2024-09-18T02:04:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa24e23b640 1 -- 172.21.15.167:0/3659470635 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94615123135840] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa248108030 con 0x560d4ccd2070 2024-09-18T02:04:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 20 remove_watcher() i=7 2024-09-18T02:04:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560d4ccd2070 msgr2=0x560d4ccd4460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560d4ccd2070 0x560d4ccd4460 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560d4cccd6b0 msgr2=0x560d4cccfb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560d4cccd6b0 0x560d4cccfb70 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa24401fbe0 msgr2=0x7fa24403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa24401fbe0 0x7fa24403a3c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560d4ccd6910 msgr2=0x560d4ccd8dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560d4ccd6910 0x560d4ccd8dd0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa118034650 msgr2=0x7fa118036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa118034650 0x7fa118036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa24400ffd0 tx=0x7fa244010000 comp rx=0 tx=0).stop 2024-09-18T02:04:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 msgr2=0x560d4ccc2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/3659470635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4ccbb5f0 0x560d4ccc2740 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa2480c8d40 tx=0x7fa248009f30 comp rx=0 tx=0).stop 2024-09-18T02:04:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa24ea3c640 1 -- 172.21.15.167:0/3659470635 reap_dead start 2024-09-18T02:04:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 shutdown_connections 2024-09-18T02:04:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 >> 172.21.15.167:0/3659470635 conn(0x560d4ccb7920 msgr2=0x560d4ccb59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 shutdown_connections 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/3659470635 wait complete. 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/2888053022 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa1280346a0 msgr2=0x7fa128036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/2888053022 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa1280346a0 0x7fa128036b60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x560d4cc96b20 tx=0x7fa24400f000 comp rx=0 tx=0).stop 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/2888053022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cba4cc0 msgr2=0x560d4cba3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/2888053022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cba4cc0 0x560d4cba3340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa248008030 tx=0x7fa2480a9720 comp rx=0 tx=0).stop 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/2888053022 shutdown_connections 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/2888053022 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa1280346a0 0x7fa128036b60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/2888053022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cba4cc0 0x560d4cba3340 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/2888053022 >> 172.21.15.167:0/2888053022 conn(0x560d4cca1ba0 msgr2=0x560d4cca4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/2888053022 shutdown_connections 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/2888053022 wait complete. 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560d4cc98570 msgr2=0x560d4cc9a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560d4cc98570 0x560d4cc9a960 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560d4cb9bec0 msgr2=0x560d4cc95b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560d4cb9bec0 0x560d4cc95b80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560d4cc9c490 msgr2=0x560d4cc9e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560d4cc9c490 0x560d4cc9e880 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa134034650 msgr2=0x7fa134036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa134034650 0x7fa134036b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa244000f70 tx=0x7fa244001380 comp rx=0 tx=0).stop 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 msgr2=0x560d4cc8ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 --2- 172.21.15.167:0/715645187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d4cb9b570 0x560d4cc8ebf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa248005cc0 tx=0x7fa248017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa24ea3c640 1 -- 172.21.15.167:0/715645187 reap_dead start 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 shutdown_connections 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 >> 172.21.15.167:0/715645187 conn(0x560d4cb97090 msgr2=0x560d4cc821b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 shutdown_connections 2024-09-18T02:04:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.072+0000 7fa25072b980 1 -- 172.21.15.167:0/715645187 wait complete. 2024-09-18T02:04:20.084 INFO:teuthology.orchestra.run.smithi167.stdout:[] 2024-09-18T02:04:20.084 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T02:04:20.084 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-18T02:04:20.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-18T02:04:20.085 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-18T02:04:20.152 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:20.152 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.148+0000 7fd60783f980 1 Processor -- start 2024-09-18T02:04:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.148+0000 7fd60783f980 1 -- start start 2024-09-18T02:04:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.148+0000 7fd60783f980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562934290570 0x562934290950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.148+0000 7fd60783f980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562934119ae0 con 0x562934290ec0 2024-09-18T02:04:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.148+0000 7fd60783f980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x56293413de30 con 0x562934290570 2024-09-18T02:04:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd60534f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562934290570 0x562934290950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd604b4e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x562934290ec0 0x5629342958f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55550/0 (socket says 172.21.15.167:55550) 2024-09-18T02:04:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd604b4e640 1 -- 172.21.15.167:0/631114277 learned_addr learned my addr 172.21.15.167:0/631114277 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:20.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd5f7fff640 1 -- 172.21.15.167:0/631114277 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172677017 0 0) 0x562934119ae0 con 0x562934290ec0 2024-09-18T02:04:20.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd5f7fff640 1 -- 172.21.15.167:0/631114277 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f0001e20 con 0x562934290ec0 2024-09-18T02:04:20.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd60534f640 1 -- 172.21.15.167:0/631114277 >> v1:172.21.15.81:6789/0 conn(0x562934290ec0 legacy=0x5629342958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd60534f640 1 -- 172.21.15.167:0/631114277 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562934298140 con 0x562934290570 2024-09-18T02:04:20.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd60534f640 1 --2- 172.21.15.167:0/631114277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x562934290950 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd60000a420 tx=0x7fd60001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145a6b18a6f0d51c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd5f7fff640 1 -- 172.21.15.167:0/631114277 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000af070 con 0x562934290570 2024-09-18T02:04:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd5f7fff640 1 -- 172.21.15.167:0/631114277 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6000aa530 con 0x562934290570 2024-09-18T02:04:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd5f7fff640 1 -- 172.21.15.167:0/631114277 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000aa850 con 0x562934290570 2024-09-18T02:04:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd60783f980 1 -- 172.21.15.167:0/631114277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 msgr2=0x562934290950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd60783f980 1 --2- 172.21.15.167:0/631114277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x562934290950 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd60000a420 tx=0x7fd60001afd0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd60783f980 1 -- 172.21.15.167:0/631114277 shutdown_connections 2024-09-18T02:04:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd60783f980 1 --2- 172.21.15.167:0/631114277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x562934290950 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.152+0000 7fd60783f980 1 -- 172.21.15.167:0/631114277 >> 172.21.15.167:0/631114277 conn(0x56293428c090 msgr2=0x56293428e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.156+0000 7fd60783f980 1 -- 172.21.15.167:0/631114277 shutdown_connections 2024-09-18T02:04:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.156+0000 7fd60783f980 1 -- 172.21.15.167:0/631114277 wait complete. 2024-09-18T02:04:20.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 Processor -- start 2024-09-18T02:04:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 -- start start 2024-09-18T02:04:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x56293437c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56293413f200 con 0x562934290570 2024-09-18T02:04:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60534f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x56293437c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60534f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x56293437c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56880/0 (socket says 172.21.15.167:56880) 2024-09-18T02:04:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60534f640 1 -- 172.21.15.167:0/77300701 learned_addr learned my addr 172.21.15.167:0/77300701 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60534f640 1 -- 172.21.15.167:0/77300701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56293437ce10 con 0x562934290570 2024-09-18T02:04:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60534f640 1 --2- 172.21.15.167:0/77300701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x56293437c840 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd600017be0 tx=0x7fd6000033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e8be9db8d24cd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd4f3606640 1 -- 172.21.15.167:0/77300701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000af050 con 0x562934290570 2024-09-18T02:04:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd4f3606640 1 -- 172.21.15.167:0/77300701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6000b0040 con 0x562934290570 2024-09-18T02:04:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd4f3606640 1 -- 172.21.15.167:0/77300701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000aaaf0 con 0x562934290570 2024-09-18T02:04:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 -- 172.21.15.167:0/77300701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 msgr2=0x56293437c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 --2- 172.21.15.167:0/77300701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x56293437c840 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd600017be0 tx=0x7fd6000033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 -- 172.21.15.167:0/77300701 shutdown_connections 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 --2- 172.21.15.167:0/77300701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x56293437c840 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 -- 172.21.15.167:0/77300701 >> 172.21.15.167:0/77300701 conn(0x56293428c090 msgr2=0x562934378470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 -- 172.21.15.167:0/77300701 shutdown_connections 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 -- 172.21.15.167:0/77300701 wait complete. 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 Processor -- start 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 -- start start 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x5629343839f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.168+0000 7fd60783f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562934297b80 con 0x562934290570 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd60534f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x5629343839f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd60534f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x5629343839f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56892/0 (socket says 172.21.15.167:56892) 2024-09-18T02:04:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd60534f640 1 -- 172.21.15.167:0/1087770083 learned_addr learned my addr 172.21.15.167:0/1087770083 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd60534f640 1 -- 172.21.15.167:0/1087770083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562934383f30 con 0x562934290570 2024-09-18T02:04:20.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd60534f640 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x5629343839f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd60001b870 tx=0x7fd600019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd4f1e03640 1 -- 172.21.15.167:0/1087770083 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000b6bf0 con 0x562934290570 2024-09-18T02:04:20.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629343841c0 con 0x562934290570 2024-09-18T02:04:20.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd4f1e03640 1 -- 172.21.15.167:0/1087770083 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6000b6d90 con 0x562934290570 2024-09-18T02:04:20.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd4f1e03640 1 -- 172.21.15.167:0/1087770083 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000bf530 con 0x562934290570 2024-09-18T02:04:20.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562934386ea0 con 0x562934290570 2024-09-18T02:04:20.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd4f1e03640 1 -- 172.21.15.167:0/1087770083 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd6000bf7e0 con 0x562934290570 2024-09-18T02:04:20.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd4f1e03640 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4ec034650 0x7fd4ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd4f1e03640 1 -- 172.21.15.167:0/1087770083 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd6000bb070 con 0x562934290570 2024-09-18T02:04:20.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd604b4e640 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4ec034650 0x7fd4ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd60783f980 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562934290ec0 0x56293438a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56293438aff0 con 0x562934290ec0 2024-09-18T02:04:20.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd605b50640 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562934290ec0 0x56293438a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd604b4e640 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4ec034650 0x7fd4ec036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc000f70 tx=0x7fd5fc0010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd605b50640 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562934290ec0 0x56293438a980 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd605b50640 1 -- 172.21.15.167:0/1087770083 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5f80083f0 con 0x562934290ec0 2024-09-18T02:04:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.172+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343880a0 con 0x562934290ec0 2024-09-18T02:04:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd605b50640 1 -- 172.21.15.167:0/1087770083 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5f80083f0 con 0x562934290ec0 2024-09-18T02:04:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60783f980 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56293438d320 0x56293438f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56293438fe00 con 0x56293438d320 2024-09-18T02:04:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60534f640 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56293438d320 0x56293438f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60534f640 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56293438d320 0x56293438f710 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60534f640 1 -- 172.21.15.167:0/1087770083 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd6000b2070 con 0x56293438d320 2024-09-18T02:04:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56293438c1c0 con 0x562934290ec0 2024-09-18T02:04:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd605b50640 1 -- 172.21.15.167:0/1087770083 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5f80083f0 con 0x562934290ec0 2024-09-18T02:04:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60783f980 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562934391260 0x562934393650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562934393d90 con 0x562934391260 2024-09-18T02:04:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd604b4e640 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562934391260 0x562934393650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd604b4e640 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562934391260 0x562934393650 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd604b4e640 1 -- 172.21.15.167:0/1087770083 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x562934391260 2024-09-18T02:04:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60783f980 1 Processor -- start 2024-09-18T02:04:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60783f980 1 -- start start 2024-09-18T02:04:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60783f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343a1860 0x5629343a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.176+0000 7fd60783f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562934198800 con 0x5629343a1860 2024-09-18T02:04:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60534f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343a1860 0x5629343a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60534f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343a1860 0x5629343a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56906/0 (socket says 172.21.15.167:56906) 2024-09-18T02:04:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60534f640 1 -- 172.21.15.167:0/2134559120 learned_addr learned my addr 172.21.15.167:0/2134559120 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60534f640 1 -- 172.21.15.167:0/2134559120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629343a21c0 con 0x5629343a1860 2024-09-18T02:04:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60534f640 1 --2- 172.21.15.167:0/2134559120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343a1860 0x5629343a1c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd600018c00 tx=0x7fd6000d62e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd4eaffd640 1 -- 172.21.15.167:0/2134559120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000be670 con 0x5629343a1860 2024-09-18T02:04:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60783f980 1 -- 172.21.15.167:0/2134559120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629343a2450 con 0x5629343a1860 2024-09-18T02:04:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd4eaffd640 1 -- 172.21.15.167:0/2134559120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6000be810 con 0x5629343a1860 2024-09-18T02:04:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd4eaffd640 1 -- 172.21.15.167:0/2134559120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000e4180 con 0x5629343a1860 2024-09-18T02:04:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60783f980 1 -- 172.21.15.167:0/2134559120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629343a50d0 con 0x5629343a1860 2024-09-18T02:04:20.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd4eaffd640 1 -- 172.21.15.167:0/2134559120 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd600004610 con 0x5629343a1860 2024-09-18T02:04:20.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd4eaffd640 1 --2- 172.21.15.167:0/2134559120 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4dc034650 0x7fd4dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd4eaffd640 1 -- 172.21.15.167:0/2134559120 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd6000dd070 con 0x5629343a1860 2024-09-18T02:04:20.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd604b4e640 1 --2- 172.21.15.167:0/2134559120 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4dc034650 0x7fd4dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60783f980 1 Processor -- start 2024-09-18T02:04:20.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60783f980 1 -- start start 2024-09-18T02:04:20.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd604b4e640 1 --2- 172.21.15.167:0/2134559120 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4dc034650 0x7fd4dc036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x56293438b4c0 tx=0x7fd5fc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60783f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60783f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56293437d0d0 con 0x5629343ae110 2024-09-18T02:04:20.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60534f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60534f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56918/0 (socket says 172.21.15.167:56918) 2024-09-18T02:04:20.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60534f640 1 -- 172.21.15.167:0/120030105 learned_addr learned my addr 172.21.15.167:0/120030105 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.180+0000 7fd60534f640 1 -- 172.21.15.167:0/120030105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629343aeae0 con 0x5629343ae110 2024-09-18T02:04:20.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60534f640 1 --2- 172.21.15.167:0/120030105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343ae510 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd6000e0bc0 tx=0x7fd6000e06b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a32a119bb14a51b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd4e8ff9640 1 -- 172.21.15.167:0/120030105 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600004900 con 0x5629343ae110 2024-09-18T02:04:20.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd4e8ff9640 1 -- 172.21.15.167:0/120030105 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6000b58d0 con 0x5629343ae110 2024-09-18T02:04:20.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd4e8ff9640 1 -- 172.21.15.167:0/120030105 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000b53b0 con 0x5629343ae110 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 -- 172.21.15.167:0/120030105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 msgr2=0x5629343ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 --2- 172.21.15.167:0/120030105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343ae510 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd6000e0bc0 tx=0x7fd6000e06b0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 -- 172.21.15.167:0/120030105 shutdown_connections 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 --2- 172.21.15.167:0/120030105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343ae510 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 -- 172.21.15.167:0/120030105 >> 172.21.15.167:0/120030105 conn(0x5629343aa530 msgr2=0x5629343a8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 -- 172.21.15.167:0/120030105 shutdown_connections 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 -- 172.21.15.167:0/120030105 wait complete. 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 Processor -- start 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 -- start start 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5629343aef40 con 0x5629343ae110 2024-09-18T02:04:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60534f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60534f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56922/0 (socket says 172.21.15.167:56922) 2024-09-18T02:04:20.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 learned_addr learned my addr 172.21.15.167:0/4069079303 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629343b58b0 con 0x5629343ae110 2024-09-18T02:04:20.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60534f640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343b5370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd6000e19d0 tx=0x7fd6000b9f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd4daffd640 1 -- 172.21.15.167:0/4069079303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000d7d90 con 0x5629343ae110 2024-09-18T02:04:20.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629343b58b0 con 0x5629343ae110 2024-09-18T02:04:20.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd4daffd640 1 -- 172.21.15.167:0/4069079303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6000051b0 con 0x5629343ae110 2024-09-18T02:04:20.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd4daffd640 1 -- 172.21.15.167:0/4069079303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600110060 con 0x5629343ae110 2024-09-18T02:04:20.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.184+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629343b58b0 con 0x5629343ae110 2024-09-18T02:04:20.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd4daffd640 1 -- 172.21.15.167:0/4069079303 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd6000d6650 con 0x5629343ae110 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd4daffd640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4d0034650 0x7fd4d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd4daffd640 1 -- 172.21.15.167:0/4069079303 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd60010cab0 con 0x5629343ae110 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd604b4e640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4d0034650 0x7fd4d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629343c0350 0x5629343c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343c2f60 con 0x5629343c0350 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd605b50640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629343c0350 0x5629343c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd604b4e640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4d0034650 0x7fd4d0036b10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00c010 tx=0x7fd5fc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd605b50640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629343c0350 0x5629343c2810 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5f80083f0 con 0x5629343c0350 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 realm 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3370 con 0x5629343c0350 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5f80083f0 con 0x5629343c0350 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3c10 con 0x5629343c0350 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5f80083f0 con 0x5629343c0350 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c0350 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5f80083f0 con 0x5629343c0350 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629343c4d10 0x5629343c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343c7640 con 0x5629343c4d10 2024-09-18T02:04:20.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60534f640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629343c4d10 0x5629343c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60534f640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629343c4d10 0x5629343c7100 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:20.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 20 searching for the correct realm 2024-09-18T02:04:20.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629343c95b0 0x5629343cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343cc140 con 0x5629343c95b0 2024-09-18T02:04:20.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.188+0000 7fd604b4e640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629343c95b0 0x5629343cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd604b4e640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629343c95b0 0x5629343cba70 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd604b4e640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fd5fc037040 0x7fd5fc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343cc140 con 0x7fd5fc037040 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fd5fc037040 0x7fd5fc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fd5fc037040 0x7fd5fc036410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f80083f0 con 0x7fd5fc037040 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c4d10 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c0350 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f80083f0 con 0x5629343c0350 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c0350 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c4d10 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c4d10 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x7fd5fc037040 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c95b0 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c0350 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.192+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c4d10 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c0350 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x7fd5fc037040 2024-09-18T02:04:20.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c95b0 2024-09-18T02:04:20.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c95b0 2024-09-18T02:04:20.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c4d10 2024-09-18T02:04:20.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c95b0 2024-09-18T02:04:20.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c95b0 2024-09-18T02:04:20.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c0350 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c0350 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c4d10 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c95b0 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.196+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x7fd5fc037040 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c0350 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c4d10 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c95b0 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c4d10 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x7fd5fc037040 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c95b0 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c4d10 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x5629343c0350 2024-09-18T02:04:20.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5629343c3fb0 con 0x7fd5fc037040 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60783f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60783f980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60783f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60783f980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60783f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60783f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343c7e90 con 0x5629343c0350 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60783f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.200+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343c7e90 con 0x5629343c0350 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343c7e90 con 0x5629343c95b0 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 zone default found 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 4 Realm: () 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 zonegroup default 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343c8730 con 0x5629343c4d10 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343cdfa0 con 0x5629343c95b0 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343ce340 con 0x5629343c95b0 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 started sync module instance, tier type = 2024-09-18T02:04:20.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:20.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343cd440 con 0x7fd5fc037040 2024-09-18T02:04:20.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94734970050928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343cd440 con 0x7fd5fc037040 2024-09-18T02:04:20.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343ced90 con 0x5629343c0350 2024-09-18T02:04:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.204+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94734970050928] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.208+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.208+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94734970054816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343cd440 con 0x5629343c0350 2024-09-18T02:04:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.208+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343cf7a0 con 0x5629343c95b0 2024-09-18T02:04:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.208+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.208+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94734970057456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d0040 con 0x5629343c95b0 2024-09-18T02:04:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.208+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d0a60 con 0x7fd5fc037040 2024-09-18T02:04:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.208+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94734970054816] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.212+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.212+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94734970062160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d0e50 con 0x7fd5fc037040 2024-09-18T02:04:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.212+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d1810 con 0x5629343c0350 2024-09-18T02:04:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.212+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94734970057456] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.212+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94734970062160] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.212+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.212+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94734970048400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d1360 con 0x5629343c0350 2024-09-18T02:04:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.212+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d1bb0 con 0x5629343c4d10 2024-09-18T02:04:20.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.212+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94734970048400] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.216+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.216+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94734970065760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d1780 con 0x5629343c4d10 2024-09-18T02:04:20.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.216+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d28b0 con 0x5629343c4d10 2024-09-18T02:04:20.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.216+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.216+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94734970072144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d3520 con 0x5629343c4d10 2024-09-18T02:04:20.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.216+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d3ee0 con 0x5629343c4d10 2024-09-18T02:04:20.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.216+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94734970065760] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94734970072144] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94734970068816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d3ee0 con 0x5629343c4d10 2024-09-18T02:04:20.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 20 add_watcher() i=0 2024-09-18T02:04:20.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 20 add_watcher() i=1 2024-09-18T02:04:20.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 20 add_watcher() i=2 2024-09-18T02:04:20.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 20 add_watcher() i=3 2024-09-18T02:04:20.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 20 add_watcher() i=4 2024-09-18T02:04:20.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 20 add_watcher() i=5 2024-09-18T02:04:20.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 20 add_watcher() i=6 2024-09-18T02:04:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94734970068816] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 20 add_watcher() i=7 2024-09-18T02:04:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343d70f0 con 0x5629343c0350 2024-09-18T02:04:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94734970076064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343d4470 con 0x5629343c0350 2024-09-18T02:04:20.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94734970076064] v30'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.220+0000 7fd4bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:20.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:20.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:20.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 5 note: GC not initialized 2024-09-18T02:04:20.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd4ba7e4640 20 reqs_thread_entry: start 2024-09-18T02:04:20.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:20.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 20 Filter name: none 2024-09-18T02:04:20.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd42bfff640 20 reqs_thread_entry: start 2024-09-18T02:04:20.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343fa340 con 0x5629343c0350 2024-09-18T02:04:20.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:20.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343fad30 con 0x5629343c0350 2024-09-18T02:04:20.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:20.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5629343fbd40 con 0x7fd5fc037040 2024-09-18T02:04:20.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd4bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:20.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94734970076064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343f8230 con 0x5629343c0350 2024-09-18T02:04:20.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94734970076064] v30'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.224+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94734970050928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343f8230 con 0x7fd5fc037040 2024-09-18T02:04:20.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.228+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94734970050928] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.228+0000 7fd60783f980 20 remove_watcher() i=0 2024-09-18T02:04:20.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.228+0000 7fd60783f980 2 removed watcher, disabling cache 2024-09-18T02:04:20.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.228+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94734970054816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343f8230 con 0x5629343c0350 2024-09-18T02:04:20.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.228+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94734970054816] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.228+0000 7fd60783f980 20 remove_watcher() i=1 2024-09-18T02:04:20.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.228+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94734970057456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343f8230 con 0x5629343c95b0 2024-09-18T02:04:20.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.232+0000 7fd604b4e640 1 -- 172.21.15.167:0/4069079303 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94734970057456] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5fc00e6c0 con 0x5629343c95b0 2024-09-18T02:04:20.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.232+0000 7fd60783f980 20 remove_watcher() i=2 2024-09-18T02:04:20.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.232+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94734970062160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343f8230 con 0x7fd5fc037040 2024-09-18T02:04:20.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.232+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94734970062160] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x7fd5fc037040 2024-09-18T02:04:20.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.232+0000 7fd60783f980 20 remove_watcher() i=3 2024-09-18T02:04:20.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.232+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94734970048400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343f8230 con 0x5629343c0350 2024-09-18T02:04:20.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.232+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94734970048400] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8026040 con 0x5629343c0350 2024-09-18T02:04:20.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.232+0000 7fd60783f980 20 remove_watcher() i=4 2024-09-18T02:04:20.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.232+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94734970065760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343f8230 con 0x5629343c4d10 2024-09-18T02:04:20.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.236+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94734970065760] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.236+0000 7fd60783f980 20 remove_watcher() i=5 2024-09-18T02:04:20.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.236+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94734970072144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343f8230 con 0x5629343c4d10 2024-09-18T02:04:20.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.236+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94734970072144] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.236+0000 7fd60783f980 20 remove_watcher() i=6 2024-09-18T02:04:20.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.236+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94734970068816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5629343f8230 con 0x5629343c4d10 2024-09-18T02:04:20.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60534f640 1 -- 172.21.15.167:0/4069079303 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94734970068816] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600108020 con 0x5629343c4d10 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 20 remove_watcher() i=7 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629343c4d10 msgr2=0x5629343c7100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629343c4d10 0x5629343c7100 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629343c0350 msgr2=0x5629343c2810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629343c0350 0x5629343c2810 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fd5fc037040 msgr2=0x7fd5fc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fd5fc037040 0x7fd5fc036410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629343c95b0 msgr2=0x5629343cba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629343c95b0 0x5629343cba70 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4d0034650 msgr2=0x7fd4d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4d0034650 0x7fd4d0036b10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00c010 tx=0x7fd5fc010000 comp rx=0 tx=0).stop 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd605b50640 1 -- 172.21.15.167:0/4069079303 reap_dead start 2024-09-18T02:04:20.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 msgr2=0x5629343b5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343b5370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd6000e19d0 tx=0x7fd6000b9f00 comp rx=0 tx=0).stop 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 shutdown_connections 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/4069079303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343ae110 0x5629343b5370 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 >> 172.21.15.167:0/4069079303 conn(0x5629343aa530 msgr2=0x5629343a8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 shutdown_connections 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/4069079303 wait complete. 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/2134559120 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4dc034650 msgr2=0x7fd4dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/2134559120 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4dc034650 0x7fd4dc036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x56293438b4c0 tx=0x7fd5fc00f000 comp rx=0 tx=0).stop 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/2134559120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343a1860 msgr2=0x5629343a1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/2134559120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343a1860 0x5629343a1c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd600018c00 tx=0x7fd6000d62e0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/2134559120 shutdown_connections 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/2134559120 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4dc034650 0x7fd4dc036b10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/2134559120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629343a1860 0x5629343a1c80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/2134559120 >> 172.21.15.167:0/2134559120 conn(0x5629343969b0 msgr2=0x562934399430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/2134559120 shutdown_connections 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/2134559120 wait complete. 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56293438d320 msgr2=0x56293438f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56293438d320 0x56293438f710 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562934290ec0 msgr2=0x56293438a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562934290ec0 0x56293438a980 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562934391260 msgr2=0x562934393650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562934391260 0x562934393650 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4ec034650 msgr2=0x7fd4ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd4ec034650 0x7fd4ec036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc000f70 tx=0x7fd5fc0010b0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 msgr2=0x5629343839f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 --2- 172.21.15.167:0/1087770083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562934290570 0x5629343839f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd60001b870 tx=0x7fd600019810 comp rx=0 tx=0).stop 2024-09-18T02:04:20.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd605b50640 1 -- 172.21.15.167:0/1087770083 reap_dead start 2024-09-18T02:04:20.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 shutdown_connections 2024-09-18T02:04:20.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 >> 172.21.15.167:0/1087770083 conn(0x56293428c090 msgr2=0x562934376ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 shutdown_connections 2024-09-18T02:04:20.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.240+0000 7fd60783f980 1 -- 172.21.15.167:0/1087770083 wait complete. 2024-09-18T02:04:20.254 INFO:teuthology.orchestra.run.smithi167.stdout:[] 2024-09-18T02:04:20.254 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T02:04:20.276 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:20.276 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-18T02:04:20.276 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-18T02:04:20.276 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-18T02:04:20.333 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:20.333 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.332+0000 7f1c86616980 1 Processor -- start 2024-09-18T02:04:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.332+0000 7f1c86616980 1 -- start start 2024-09-18T02:04:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.332+0000 7f1c86616980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564d0123db00 0x564d012cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.332+0000 7f1c86616980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d01151ae0 con 0x564d012cc870 2024-09-18T02:04:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.332+0000 7f1c86616980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x564d01175e30 con 0x564d0123db00 2024-09-18T02:04:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.332+0000 7f1c84126640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564d0123db00 0x564d012cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.332+0000 7f1c83925640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x564d012cc870 0x564d012cec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55562/0 (socket says 172.21.15.167:55562) 2024-09-18T02:04:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.332+0000 7f1c83925640 1 -- 172.21.15.167:0/4217565025 learned_addr learned my addr 172.21.15.167:0/4217565025 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.332+0000 7f1c84126640 1 --2- 172.21.15.167:0/4217565025 >> v2:172.21.15.81:3300/0 conn(0x564d0123db00 0x564d012cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56930/0 (socket says 172.21.15.167:56930) 2024-09-18T02:04:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.332+0000 7f1c84126640 1 -- 172.21.15.167:0/4217565025 >> v1:172.21.15.81:6789/0 conn(0x564d012cc870 legacy=0x564d012cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.332+0000 7f1c84126640 1 -- 172.21.15.167:0/4217565025 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d012d1390 con 0x564d0123db00 2024-09-18T02:04:20.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.336+0000 7f1c84126640 1 --2- 172.21.15.167:0/4217565025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d012cc330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400a480 tx=0x7f1c7401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853fc653a6ee62dc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.336+0000 7f1c83124640 1 -- 172.21.15.167:0/4217565025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c740b0070 con 0x564d0123db00 2024-09-18T02:04:20.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.336+0000 7f1c83124640 1 -- 172.21.15.167:0/4217565025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c740ab540 con 0x564d0123db00 2024-09-18T02:04:20.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.336+0000 7f1c83124640 1 -- 172.21.15.167:0/4217565025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c740ab840 con 0x564d0123db00 2024-09-18T02:04:20.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.336+0000 7f1c86616980 1 -- 172.21.15.167:0/4217565025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 msgr2=0x564d012cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.336+0000 7f1c86616980 1 --2- 172.21.15.167:0/4217565025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d012cc330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400a480 tx=0x7f1c7401b280 comp rx=0 tx=0).stop 2024-09-18T02:04:20.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.336+0000 7f1c86616980 1 -- 172.21.15.167:0/4217565025 shutdown_connections 2024-09-18T02:04:20.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.336+0000 7f1c86616980 1 --2- 172.21.15.167:0/4217565025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d012cc330 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.336+0000 7f1c86616980 1 -- 172.21.15.167:0/4217565025 >> 172.21.15.167:0/4217565025 conn(0x564d012c4060 msgr2=0x564d012c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.336+0000 7f1c86616980 1 -- 172.21.15.167:0/4217565025 shutdown_connections 2024-09-18T02:04:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.336+0000 7f1c86616980 1 -- 172.21.15.167:0/4217565025 wait complete. 2024-09-18T02:04:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.348+0000 7f1c86616980 1 Processor -- start 2024-09-18T02:04:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 -- start start 2024-09-18T02:04:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d012c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564d01177200 con 0x564d0123db00 2024-09-18T02:04:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c84126640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d012c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c84126640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d012c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56942/0 (socket says 172.21.15.167:56942) 2024-09-18T02:04:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c84126640 1 -- 172.21.15.167:0/2753009235 learned_addr learned my addr 172.21.15.167:0/2753009235 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c84126640 1 -- 172.21.15.167:0/2753009235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d012ca060 con 0x564d0123db00 2024-09-18T02:04:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c84126640 1 --2- 172.21.15.167:0/2753009235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d012c9a90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1c740ae040 tx=0x7f1c74003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff020143bd64370 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1b7260c640 1 -- 172.21.15.167:0/2753009235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c740b0040 con 0x564d0123db00 2024-09-18T02:04:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1b7260c640 1 -- 172.21.15.167:0/2753009235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c740ab9b0 con 0x564d0123db00 2024-09-18T02:04:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1b7260c640 1 -- 172.21.15.167:0/2753009235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c740abc90 con 0x564d0123db00 2024-09-18T02:04:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 -- 172.21.15.167:0/2753009235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 msgr2=0x564d012c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 --2- 172.21.15.167:0/2753009235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d012c9a90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1c740ae040 tx=0x7f1c74003030 comp rx=0 tx=0).stop 2024-09-18T02:04:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 -- 172.21.15.167:0/2753009235 shutdown_connections 2024-09-18T02:04:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 --2- 172.21.15.167:0/2753009235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d012c9a90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 -- 172.21.15.167:0/2753009235 >> 172.21.15.167:0/2753009235 conn(0x564d012c4060 msgr2=0x564d013b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 -- 172.21.15.167:0/2753009235 shutdown_connections 2024-09-18T02:04:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 -- 172.21.15.167:0/2753009235 wait complete. 2024-09-18T02:04:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 Processor -- start 2024-09-18T02:04:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 -- start start 2024-09-18T02:04:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d013bde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c86616980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564d012d0e30 con 0x564d0123db00 2024-09-18T02:04:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c84126640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d013bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c84126640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d013bde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56944/0 (socket says 172.21.15.167:56944) 2024-09-18T02:04:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c84126640 1 -- 172.21.15.167:0/2368325829 learned_addr learned my addr 172.21.15.167:0/2368325829 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.352+0000 7f1c84126640 1 -- 172.21.15.167:0/2368325829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d013be3c0 con 0x564d0123db00 2024-09-18T02:04:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c84126640 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d013bde80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1c740030b0 tx=0x7f1c74018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1b70e09640 1 -- 172.21.15.167:0/2368325829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c740c5070 con 0x564d0123db00 2024-09-18T02:04:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d013be650 con 0x564d0123db00 2024-09-18T02:04:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1b70e09640 1 -- 172.21.15.167:0/2368325829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c740b6970 con 0x564d0123db00 2024-09-18T02:04:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d013c1330 con 0x564d0123db00 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1b70e09640 1 -- 172.21.15.167:0/2368325829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c740b0050 con 0x564d0123db00 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1b70e09640 1 -- 172.21.15.167:0/2368325829 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1c740c8070 con 0x564d0123db00 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1b70e09640 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b6c034650 0x7f1b6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1b70e09640 1 -- 172.21.15.167:0/2368325829 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1c740bc070 con 0x564d0123db00 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c83925640 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b6c034650 0x7f1b6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c86616980 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564d012cc870 0x564d013c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d013c54e0 con 0x564d012cc870 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c84927640 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564d012cc870 0x564d013c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c83925640 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b6c034650 0x7f1b6c036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c78000f70 tx=0x7f1c780012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c84927640 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564d012cc870 0x564d013c4e90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c84927640 1 -- 172.21.15.167:0/2368325829 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d012cc870 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d013c2550 con 0x564d012cc870 2024-09-18T02:04:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c84927640 1 -- 172.21.15.167:0/2368325829 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d012cc870 2024-09-18T02:04:20.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c86616980 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564d013c7880 0x564d013c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d013ca340 con 0x564d013c7880 2024-09-18T02:04:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.356+0000 7f1c84126640 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564d013c7880 0x564d013c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c84126640 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564d013c7880 0x564d013c9c70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c84126640 1 -- 172.21.15.167:0/2368325829 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1c740c7030 con 0x564d013c7880 2024-09-18T02:04:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d013c6720 con 0x564d012cc870 2024-09-18T02:04:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c84927640 1 -- 172.21.15.167:0/2368325829 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d012cc870 2024-09-18T02:04:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c86616980 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564d013cb780 0x564d013cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d013ce2e0 con 0x564d013cb780 2024-09-18T02:04:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c83925640 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564d013cb780 0x564d013cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c83925640 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564d013cb780 0x564d013cdb70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c83925640 1 -- 172.21.15.167:0/2368325829 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1c7800e620 con 0x564d013cb780 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c86616980 1 Processor -- start 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c86616980 1 -- start start 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c86616980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013dbd70 0x564d013dc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c86616980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564d011d0800 con 0x564d013dbd70 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c84126640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013dbd70 0x564d013dc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c84126640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013dbd70 0x564d013dc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56954/0 (socket says 172.21.15.167:56954) 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c84126640 1 -- 172.21.15.167:0/3457263502 learned_addr learned my addr 172.21.15.167:0/3457263502 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c84126640 1 -- 172.21.15.167:0/3457263502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d013dc6d0 con 0x564d013dbd70 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c84126640 1 --2- 172.21.15.167:0/3457263502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013dbd70 0x564d013dc190 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1c740e1eb0 tx=0x7f1c740aaee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1b69ffb640 1 -- 172.21.15.167:0/3457263502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c740e3b90 con 0x564d013dbd70 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.360+0000 7f1c86616980 1 -- 172.21.15.167:0/3457263502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d013dc900 con 0x564d013dbd70 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1b69ffb640 1 -- 172.21.15.167:0/3457263502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c740e3d30 con 0x564d013dbd70 2024-09-18T02:04:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 -- 172.21.15.167:0/3457263502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d013df580 con 0x564d013dbd70 2024-09-18T02:04:20.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1b69ffb640 1 -- 172.21.15.167:0/3457263502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c740e3100 con 0x564d013dbd70 2024-09-18T02:04:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1b69ffb640 1 -- 172.21.15.167:0/3457263502 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1c740e32a0 con 0x564d013dbd70 2024-09-18T02:04:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1b69ffb640 1 --2- 172.21.15.167:0/3457263502 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b5c034650 0x7f1b5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1b69ffb640 1 -- 172.21.15.167:0/3457263502 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1c740db070 con 0x564d013dbd70 2024-09-18T02:04:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c83925640 1 --2- 172.21.15.167:0/3457263502 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b5c034650 0x7f1b5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 Processor -- start 2024-09-18T02:04:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 -- start start 2024-09-18T02:04:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c83925640 1 --2- 172.21.15.167:0/3457263502 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b5c034650 0x7f1b5c036b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800bf60 tx=0x7f1c7800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013e8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564d012c81c0 con 0x564d013e8690 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c84126640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013e8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c84126640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013e8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56964/0 (socket says 172.21.15.167:56964) 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c84126640 1 -- 172.21.15.167:0/685944104 learned_addr learned my addr 172.21.15.167:0/685944104 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c84126640 1 -- 172.21.15.167:0/685944104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d013e9060 con 0x564d013e8690 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c84126640 1 --2- 172.21.15.167:0/685944104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013e8a90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1c740cad80 tx=0x7f1c740cab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da5ff06237c7bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1b637fe640 1 -- 172.21.15.167:0/685944104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c740c9710 con 0x564d013e8690 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1b637fe640 1 -- 172.21.15.167:0/685944104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c740d6070 con 0x564d013e8690 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1b637fe640 1 -- 172.21.15.167:0/685944104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c740c9bf0 con 0x564d013e8690 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 -- 172.21.15.167:0/685944104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 msgr2=0x564d013e8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 --2- 172.21.15.167:0/685944104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013e8a90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1c740cad80 tx=0x7f1c740cab90 comp rx=0 tx=0).stop 2024-09-18T02:04:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 -- 172.21.15.167:0/685944104 shutdown_connections 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 --2- 172.21.15.167:0/685944104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013e8a90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 -- 172.21.15.167:0/685944104 >> 172.21.15.167:0/685944104 conn(0x564d013e4a70 msgr2=0x564d013e2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 -- 172.21.15.167:0/685944104 shutdown_connections 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.364+0000 7f1c86616980 1 -- 172.21.15.167:0/685944104 wait complete. 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c86616980 1 Processor -- start 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c86616980 1 -- start start 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c86616980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013ef850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c86616980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564d013e94e0 con 0x564d013e8690 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c84126640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c84126640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013ef850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56980/0 (socket says 172.21.15.167:56980) 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 learned_addr learned my addr 172.21.15.167:0/953240973 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d013efd90 con 0x564d013e8690 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c84126640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013ef850 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1c740d1f40 tx=0x7f1c740dee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1b61ffb640 1 -- 172.21.15.167:0/953240973 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c7410a070 con 0x564d013e8690 2024-09-18T02:04:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d013efd90 con 0x564d013e8690 2024-09-18T02:04:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d013efd90 con 0x564d013e8690 2024-09-18T02:04:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1b61ffb640 1 -- 172.21.15.167:0/953240973 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c740ca440 con 0x564d013e8690 2024-09-18T02:04:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1b61ffb640 1 -- 172.21.15.167:0/953240973 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c740c93b0 con 0x564d013e8690 2024-09-18T02:04:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1b61ffb640 1 -- 172.21.15.167:0/953240973 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1c7410d070 con 0x564d013e8690 2024-09-18T02:04:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1b61ffb640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b54034650 0x7f1b54036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1b61ffb640 1 -- 172.21.15.167:0/953240973 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1c74100030 con 0x564d013e8690 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c83925640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b54034650 0x7f1b54036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c86616980 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564d013fa720 0x564d013fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d013fd310 con 0x564d013fa720 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c84927640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564d013fa720 0x564d013fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c83925640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b54034650 0x7f1b54036b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x564d013ce6e0 tx=0x7f1c78010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.368+0000 7f1c84927640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564d013fa720 0x564d013fcbc0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 20 realm 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d013fd720 con 0x564d013fa720 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d013fdfc0 con 0x564d013fa720 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013fa720 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564d013ff0c0 0x564d014014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d01401a30 con 0x564d013ff0c0 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c84126640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564d013ff0c0 0x564d014014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c84126640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564d013ff0c0 0x564d014014b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 20 searching for the correct realm 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564d01403960 0x564d01405e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d014064f0 con 0x564d01403960 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c83925640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564d01403960 0x564d01405e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c83925640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564d01403960 0x564d01405e20 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c83925640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f1c78037040 0x7f1c78036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d014064f0 con 0x7f1c78037040 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c84927640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f1c78037040 0x7f1c78036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c84927640 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f1c78037040 0x7f1c78036410 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.372+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013ff0c0 2024-09-18T02:04:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013fa720 2024-09-18T02:04:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013fa720 2024-09-18T02:04:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013ff0c0 2024-09-18T02:04:20.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013ff0c0 2024-09-18T02:04:20.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x7f1c78037040 2024-09-18T02:04:20.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d01403960 2024-09-18T02:04:20.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013fa720 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013ff0c0 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013fa720 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.376+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x7f1c78037040 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d01403960 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d01403960 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013ff0c0 2024-09-18T02:04:20.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d01403960 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d01403960 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013fa720 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013fa720 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013ff0c0 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d01403960 2024-09-18T02:04:20.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x7f1c78037040 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013fa720 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013ff0c0 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.380+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d01403960 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013ff0c0 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x7f1c78037040 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d01403960 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013ff0c0 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x564d013fa720 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d013fe360 con 0x7f1c78037040 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:20.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d01402280 con 0x564d013fa720 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d01402280 con 0x564d013fa720 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d01402280 con 0x564d01403960 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 zone default found 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 4 Realm: () 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 zonegroup default 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d01402b20 con 0x564d013ff0c0 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d01408350 con 0x564d01403960 2024-09-18T02:04:20.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.384+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d014086f0 con 0x564d01403960 2024-09-18T02:04:20.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c86616980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c86616980 20 started sync module instance, tier type = 2024-09-18T02:04:20.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c86616980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:20.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d014077f0 con 0x7f1c78037040 2024-09-18T02:04:20.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94888733474032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d014077f0 con 0x7f1c78037040 2024-09-18T02:04:20.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d014090f0 con 0x564d013fa720 2024-09-18T02:04:20.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94888733474032] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94888733477888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d014077f0 con 0x564d013fa720 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.388+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d01409b00 con 0x564d01403960 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.392+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94888733477888] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.392+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.392+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94888733471552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d01407760 con 0x564d01403960 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.392+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d0140a860 con 0x7f1c78037040 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.392+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.392+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94888733483856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d0140b100 con 0x7f1c78037040 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.392+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d0140bb00 con 0x564d013fa720 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.392+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94888733471552] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.392+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94888733483856] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.396+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.396+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94888733482656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d0140abd0 con 0x564d013fa720 2024-09-18T02:04:20.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.396+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d0140c3a0 con 0x564d013ff0c0 2024-09-18T02:04:20.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.396+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94888733482656] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.396+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.396+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94888733490928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d0140abd0 con 0x564d013ff0c0 2024-09-18T02:04:20.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.396+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d0140cbf0 con 0x564d013ff0c0 2024-09-18T02:04:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94888733490928] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94888733493056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d0140d010 con 0x564d013ff0c0 2024-09-18T02:04:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d0140d9d0 con 0x564d013ff0c0 2024-09-18T02:04:20.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94888733493056] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94888733494592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d0140d9d0 con 0x564d013ff0c0 2024-09-18T02:04:20.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c86616980 20 add_watcher() i=0 2024-09-18T02:04:20.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c86616980 20 add_watcher() i=1 2024-09-18T02:04:20.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c86616980 20 add_watcher() i=2 2024-09-18T02:04:20.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c86616980 20 add_watcher() i=3 2024-09-18T02:04:20.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c86616980 20 add_watcher() i=4 2024-09-18T02:04:20.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c86616980 20 add_watcher() i=5 2024-09-18T02:04:20.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.400+0000 7f1c86616980 20 add_watcher() i=6 2024-09-18T02:04:20.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94888733494592] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 20 add_watcher() i=7 2024-09-18T02:04:20.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:20.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d01410d20 con 0x564d013fa720 2024-09-18T02:04:20.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94888733509424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d0140db40 con 0x564d013fa720 2024-09-18T02:04:20.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94888733509424] v30'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1b3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:20.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:20.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 5 note: GC not initialized 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1b397e2640 20 reqs_thread_entry: start 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 20 Filter name: none 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1aaaffd640 20 reqs_thread_entry: start 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d01433fc0 con 0x564d013fa720 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d014349b0 con 0x564d013fa720 2024-09-18T02:04:20.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:20.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.404+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d014359c0 con 0x7f1c78037040 2024-09-18T02:04:20.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.408+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.408+0000 7f1b3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:20.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.408+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94888733509424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d01431e80 con 0x564d013fa720 2024-09-18T02:04:20.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.408+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94888733509424] v30'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.408+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94888733474032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d01431e80 con 0x7f1c78037040 2024-09-18T02:04:20.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.408+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94888733474032] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.408+0000 7f1c86616980 20 remove_watcher() i=0 2024-09-18T02:04:20.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.408+0000 7f1c86616980 2 removed watcher, disabling cache 2024-09-18T02:04:20.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.408+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94888733477888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d01431e80 con 0x564d013fa720 2024-09-18T02:04:20.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.412+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94888733477888] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.412+0000 7f1c86616980 20 remove_watcher() i=1 2024-09-18T02:04:20.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.412+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94888733471552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d01431e80 con 0x564d01403960 2024-09-18T02:04:20.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.412+0000 7f1c83925640 1 -- 172.21.15.167:0/953240973 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94888733471552] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7800e620 con 0x564d01403960 2024-09-18T02:04:20.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.412+0000 7f1c86616980 20 remove_watcher() i=2 2024-09-18T02:04:20.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.412+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94888733483856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d01431e80 con 0x7f1c78037040 2024-09-18T02:04:20.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.416+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94888733483856] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x7f1c78037040 2024-09-18T02:04:20.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.416+0000 7f1c86616980 20 remove_watcher() i=3 2024-09-18T02:04:20.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.416+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94888733482656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d01431e80 con 0x564d013fa720 2024-09-18T02:04:20.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.416+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94888733482656] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7c00a4d0 con 0x564d013fa720 2024-09-18T02:04:20.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.416+0000 7f1c86616980 20 remove_watcher() i=4 2024-09-18T02:04:20.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.416+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94888733490928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d01431e80 con 0x564d013ff0c0 2024-09-18T02:04:20.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.416+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94888733490928] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.416+0000 7f1c86616980 20 remove_watcher() i=5 2024-09-18T02:04:20.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.416+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94888733493056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d01431e80 con 0x564d013ff0c0 2024-09-18T02:04:20.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94888733493056] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c86616980 20 remove_watcher() i=6 2024-09-18T02:04:20.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94888733494592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d01431e80 con 0x564d013ff0c0 2024-09-18T02:04:20.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c84126640 1 -- 172.21.15.167:0/953240973 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94888733494592] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7410c030 con 0x564d013ff0c0 2024-09-18T02:04:20.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c86616980 20 remove_watcher() i=7 2024-09-18T02:04:20.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564d013ff0c0 msgr2=0x564d014014b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c86616980 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564d013ff0c0 0x564d014014b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564d013fa720 msgr2=0x564d013fcbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c86616980 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564d013fa720 0x564d013fcbc0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f1c78037040 msgr2=0x7f1c78036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c86616980 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f1c78037040 0x7f1c78036410 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564d01403960 msgr2=0x564d01405e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.420+0000 7f1c86616980 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564d01403960 0x564d01405e20 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b54034650 msgr2=0x7f1b54036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b54034650 0x7f1b54036b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x564d013ce6e0 tx=0x7f1c78010000 comp rx=0 tx=0).stop 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 msgr2=0x564d013ef850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013ef850 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1c740d1f40 tx=0x7f1c740dee80 comp rx=0 tx=0).stop 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c84927640 1 -- 172.21.15.167:0/953240973 reap_dead start 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 shutdown_connections 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/953240973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013e8690 0x564d013ef850 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 >> 172.21.15.167:0/953240973 conn(0x564d013e4a70 msgr2=0x564d013e2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 shutdown_connections 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/953240973 wait complete. 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/3457263502 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b5c034650 msgr2=0x7f1b5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/3457263502 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b5c034650 0x7f1b5c036b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800bf60 tx=0x7f1c7800f000 comp rx=0 tx=0).stop 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/3457263502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013dbd70 msgr2=0x564d013dc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/3457263502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013dbd70 0x564d013dc190 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1c740e1eb0 tx=0x7f1c740aaee0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/3457263502 shutdown_connections 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/3457263502 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b5c034650 0x7f1b5c036b10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/3457263502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d013dbd70 0x564d013dc190 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/3457263502 >> 172.21.15.167:0/3457263502 conn(0x564d013d0ec0 msgr2=0x564d013d3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/3457263502 shutdown_connections 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/3457263502 wait complete. 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564d013c7880 msgr2=0x564d013c9c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564d013c7880 0x564d013c9c70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564d012cc870 msgr2=0x564d013c4e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564d012cc870 0x564d013c4e90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564d013cb780 msgr2=0x564d013cdb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564d013cb780 0x564d013cdb70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b6c034650 msgr2=0x7f1b6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1b6c034650 0x7f1b6c036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c78000f70 tx=0x7f1c780012c0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 msgr2=0x564d013bde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 --2- 172.21.15.167:0/2368325829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d0123db00 0x564d013bde80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1c740030b0 tx=0x7f1c74018020 comp rx=0 tx=0).stop 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c84927640 1 -- 172.21.15.167:0/2368325829 reap_dead start 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 shutdown_connections 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 >> 172.21.15.167:0/2368325829 conn(0x564d012c4060 msgr2=0x564d012c86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 shutdown_connections 2024-09-18T02:04:20.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.424+0000 7f1c86616980 1 -- 172.21.15.167:0/2368325829 wait complete. 2024-09-18T02:04:20.435 INFO:teuthology.orchestra.run.smithi167.stdout:["myfoo"] 2024-09-18T02:04:20.436 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-18T02:04:20.439 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:20.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-18T02:04:20.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-18T02:04:20.439 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-18T02:04:20.507 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:20.507 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:20.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.504+0000 7f9b43961980 1 Processor -- start 2024-09-18T02:04:20.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.504+0000 7f9b43961980 1 -- start start 2024-09-18T02:04:20.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.504+0000 7f9b43961980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c7deaa2c50 0x55c7deaa5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.504+0000 7f9b43961980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c7de924ae0 con 0x55c7dea9e8d0 2024-09-18T02:04:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.504+0000 7f9b43961980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55c7de948e30 con 0x55c7deaa2c50 2024-09-18T02:04:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.504+0000 7f9b40c70640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c7deaa2c50 0x55c7deaa5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.504+0000 7f9b40c70640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c7deaa2c50 0x55c7deaa5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56984/0 (socket says 172.21.15.167:56984) 2024-09-18T02:04:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.504+0000 7f9b40c70640 1 -- 172.21.15.167:0/1193075044 learned_addr learned my addr 172.21.15.167:0/1193075044 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b40c70640 1 -- 172.21.15.167:0/1193075044 >> v1:172.21.15.81:6789/0 conn(0x55c7dea9e8d0 legacy=0x55c7dea9ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b40c70640 1 -- 172.21.15.167:0/1193075044 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7deaa6590 con 0x55c7deaa2c50 2024-09-18T02:04:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b40c70640 1 --2- 172.21.15.167:0/1193075044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7deaa2c50 0x55c7deaa5040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00a5c0 tx=0x7f9b2c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f272df72de4ec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b3bfff640 1 -- 172.21.15.167:0/1193075044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b2c0a6070 con 0x55c7deaa2c50 2024-09-18T02:04:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b3bfff640 1 -- 172.21.15.167:0/1193075044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2c0af070 con 0x55c7deaa2c50 2024-09-18T02:04:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b3bfff640 1 -- 172.21.15.167:0/1193075044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b2c0aa5c0 con 0x55c7deaa2c50 2024-09-18T02:04:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b43961980 1 -- 172.21.15.167:0/1193075044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7deaa2c50 msgr2=0x55c7deaa5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b43961980 1 --2- 172.21.15.167:0/1193075044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7deaa2c50 0x55c7deaa5040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00a5c0 tx=0x7f9b2c01b340 comp rx=0 tx=0).stop 2024-09-18T02:04:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b43961980 1 -- 172.21.15.167:0/1193075044 shutdown_connections 2024-09-18T02:04:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b43961980 1 --2- 172.21.15.167:0/1193075044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7deaa2c50 0x55c7deaa5040 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b43961980 1 -- 172.21.15.167:0/1193075044 >> 172.21.15.167:0/1193075044 conn(0x55c7dea12220 msgr2=0x55c7dea12630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b43961980 1 -- 172.21.15.167:0/1193075044 shutdown_connections 2024-09-18T02:04:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.508+0000 7f9b43961980 1 -- 172.21.15.167:0/1193075044 wait complete. 2024-09-18T02:04:20.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 Processor -- start 2024-09-18T02:04:20.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 -- start start 2024-09-18T02:04:20.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 0x55c7deb89c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c7de94a200 con 0x55c7dea9e8d0 2024-09-18T02:04:20.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b41471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 0x55c7deb89c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b41471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 0x55c7deb89c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:56990/0 (socket says 172.21.15.167:56990) 2024-09-18T02:04:20.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b41471640 1 -- 172.21.15.167:0/3249707124 learned_addr learned my addr 172.21.15.167:0/3249707124 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b41471640 1 -- 172.21.15.167:0/3249707124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7deb8a1f0 con 0x55c7dea9e8d0 2024-09-18T02:04:20.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b41471640 1 --2- 172.21.15.167:0/3249707124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 0x55c7deb89c20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0015f0 tx=0x7f9b3c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4b6987e4cfd73c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9a2f606640 1 -- 172.21.15.167:0/3249707124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c016070 con 0x55c7dea9e8d0 2024-09-18T02:04:20.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9a2f606640 1 -- 172.21.15.167:0/3249707124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3c00f640 con 0x55c7dea9e8d0 2024-09-18T02:04:20.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9a2f606640 1 -- 172.21.15.167:0/3249707124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c00f960 con 0x55c7dea9e8d0 2024-09-18T02:04:20.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 -- 172.21.15.167:0/3249707124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 msgr2=0x55c7deb89c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 --2- 172.21.15.167:0/3249707124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 0x55c7deb89c20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0015f0 tx=0x7f9b3c001ab0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 -- 172.21.15.167:0/3249707124 shutdown_connections 2024-09-18T02:04:20.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 --2- 172.21.15.167:0/3249707124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 0x55c7deb89c20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 -- 172.21.15.167:0/3249707124 >> 172.21.15.167:0/3249707124 conn(0x55c7dea12220 msgr2=0x55c7deb85850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 -- 172.21.15.167:0/3249707124 shutdown_connections 2024-09-18T02:04:20.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 -- 172.21.15.167:0/3249707124 wait complete. 2024-09-18T02:04:20.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 Processor -- start 2024-09-18T02:04:20.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 -- start start 2024-09-18T02:04:20.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 0x55c7deb91020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.524+0000 7f9b43961980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c7deaa6090 con 0x55c7dea9e8d0 2024-09-18T02:04:20.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b41471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 0x55c7deb91020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b41471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 0x55c7deb91020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57006/0 (socket says 172.21.15.167:57006) 2024-09-18T02:04:20.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b41471640 1 -- 172.21.15.167:0/911976653 learned_addr learned my addr 172.21.15.167:0/911976653 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b41471640 1 -- 172.21.15.167:0/911976653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7deb91560 con 0x55c7dea9e8d0 2024-09-18T02:04:20.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b41471640 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 0x55c7deb91020 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00f610 tx=0x7f9b3c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9a2de03640 1 -- 172.21.15.167:0/911976653 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c021020 con 0x55c7dea9e8d0 2024-09-18T02:04:20.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7deb917f0 con 0x55c7dea9e8d0 2024-09-18T02:04:20.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7deb944d0 con 0x55c7dea9e8d0 2024-09-18T02:04:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9a2de03640 1 -- 172.21.15.167:0/911976653 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3c011670 con 0x55c7dea9e8d0 2024-09-18T02:04:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9a2de03640 1 -- 172.21.15.167:0/911976653 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c016040 con 0x55c7dea9e8d0 2024-09-18T02:04:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9a2de03640 1 -- 172.21.15.167:0/911976653 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9b3c024020 con 0x55c7dea9e8d0 2024-09-18T02:04:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9a2de03640 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a280346a0 0x7f9a28036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9a2de03640 1 -- 172.21.15.167:0/911976653 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9b3c0490c0 con 0x55c7dea9e8d0 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b40c70640 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a280346a0 0x7f9a28036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b43961980 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c7deaa2c50 0x55c7deb97fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7deb98640 con 0x55c7deaa2c50 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b41c72640 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c7deaa2c50 0x55c7deb97fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b40c70640 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a280346a0 0x7f9a28036b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0ae000 tx=0x7f9b2c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b41c72640 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c7deaa2c50 0x55c7deb97fd0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b41c72640 1 -- 172.21.15.167:0/911976653 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b340083f0 con 0x55c7deaa2c50 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.528+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7deb956f0 con 0x55c7deaa2c50 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b41c72640 1 -- 172.21.15.167:0/911976653 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b340083f0 con 0x55c7deaa2c50 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b43961980 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c7deb9a990 0x55c7deb9cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7deb9d470 con 0x55c7deb9a990 2024-09-18T02:04:20.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b41471640 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c7deb9a990 0x55c7deb9cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b41471640 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c7deb9a990 0x55c7deb9cd80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b41471640 1 -- 172.21.15.167:0/911976653 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7deb9a990 2024-09-18T02:04:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7deb99830 con 0x55c7deaa2c50 2024-09-18T02:04:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b41c72640 1 -- 172.21.15.167:0/911976653 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b340083f0 con 0x55c7deaa2c50 2024-09-18T02:04:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b43961980 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c7deb9e8d0 0x55c7deba0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7deba1400 con 0x55c7deb9e8d0 2024-09-18T02:04:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b40c70640 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c7deb9e8d0 0x55c7deba0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b40c70640 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c7deb9e8d0 0x55c7deba0cc0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b40c70640 1 -- 172.21.15.167:0/911976653 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7deb9e8d0 2024-09-18T02:04:20.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b43961980 1 Processor -- start 2024-09-18T02:04:20.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b43961980 1 -- start start 2024-09-18T02:04:20.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b43961980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debaeed0 0x55c7debaf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b43961980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c7de9a3800 con 0x55c7debaeed0 2024-09-18T02:04:20.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b41471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debaeed0 0x55c7debaf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b41471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debaeed0 0x55c7debaf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57012/0 (socket says 172.21.15.167:57012) 2024-09-18T02:04:20.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.532+0000 7f9b41471640 1 -- 172.21.15.167:0/4131683635 learned_addr learned my addr 172.21.15.167:0/4131683635 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b41471640 1 -- 172.21.15.167:0/4131683635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7debaf830 con 0x55c7debaeed0 2024-09-18T02:04:20.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b41471640 1 --2- 172.21.15.167:0/4131683635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debaeed0 0x55c7debaf2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0476c0 tx=0x7f9b3c01cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9a26ffd640 1 -- 172.21.15.167:0/4131683635 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c011950 con 0x55c7debaeed0 2024-09-18T02:04:20.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b43961980 1 -- 172.21.15.167:0/4131683635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7debafac0 con 0x55c7debaeed0 2024-09-18T02:04:20.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9a26ffd640 1 -- 172.21.15.167:0/4131683635 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3c011af0 con 0x55c7debaeed0 2024-09-18T02:04:20.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b43961980 1 -- 172.21.15.167:0/4131683635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7debb2740 con 0x55c7debaeed0 2024-09-18T02:04:20.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9a26ffd640 1 -- 172.21.15.167:0/4131683635 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c011ca0 con 0x55c7debaeed0 2024-09-18T02:04:20.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9a26ffd640 1 -- 172.21.15.167:0/4131683635 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9b3c040cf0 con 0x55c7debaeed0 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9a26ffd640 1 --2- 172.21.15.167:0/4131683635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a18034650 0x7f9a18036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9a26ffd640 1 -- 172.21.15.167:0/4131683635 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9b3c036070 con 0x55c7debaeed0 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b40c70640 1 --2- 172.21.15.167:0/4131683635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a18034650 0x7f9a18036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b43961980 1 Processor -- start 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b43961980 1 -- start start 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b40c70640 1 --2- 172.21.15.167:0/4131683635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a18034650 0x7f9a18036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55c7deb98b10 tx=0x7f9b2c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b43961980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debbbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b43961980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c7deb8a570 con 0x55c7debbb770 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b41471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debbbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b41471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debbbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57018/0 (socket says 172.21.15.167:57018) 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b41471640 1 -- 172.21.15.167:0/4124161857 learned_addr learned my addr 172.21.15.167:0/4124161857 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b41471640 1 -- 172.21.15.167:0/4124161857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7debbc140 con 0x55c7debbb770 2024-09-18T02:04:20.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.536+0000 7f9b41471640 1 --2- 172.21.15.167:0/4124161857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debbbb70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c03ac00 tx=0x7f9b3c03ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae2d479d84e43af server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9a24ff9640 1 -- 172.21.15.167:0/4124161857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c058020 con 0x55c7debbb770 2024-09-18T02:04:20.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9a24ff9640 1 -- 172.21.15.167:0/4124161857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3c041d00 con 0x55c7debbb770 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9a24ff9640 1 -- 172.21.15.167:0/4124161857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c01a2f0 con 0x55c7debbb770 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 -- 172.21.15.167:0/4124161857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 msgr2=0x55c7debbbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 --2- 172.21.15.167:0/4124161857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debbbb70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c03ac00 tx=0x7f9b3c03ad60 comp rx=0 tx=0).stop 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 -- 172.21.15.167:0/4124161857 shutdown_connections 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 --2- 172.21.15.167:0/4124161857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debbbb70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 -- 172.21.15.167:0/4124161857 >> 172.21.15.167:0/4124161857 conn(0x55c7debb7b50 msgr2=0x55c7debb5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 -- 172.21.15.167:0/4124161857 shutdown_connections 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 -- 172.21.15.167:0/4124161857 wait complete. 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 Processor -- start 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 -- start start 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debc2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c7debbc560 con 0x55c7debbb770 2024-09-18T02:04:20.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b41471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debc2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b41471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debc2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57028/0 (socket says 172.21.15.167:57028) 2024-09-18T02:04:20.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 learned_addr learned my addr 172.21.15.167:0/1022493389 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7debc2e90 con 0x55c7debbb770 2024-09-18T02:04:20.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b41471640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debc2950 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c03ac00 tx=0x7f9b3c00ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9a16ffd640 1 -- 172.21.15.167:0/1022493389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c02ec70 con 0x55c7debbb770 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7debc2e90 con 0x55c7debbb770 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7debc2e90 con 0x55c7debbb770 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9a16ffd640 1 -- 172.21.15.167:0/1022493389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3c02ee10 con 0x55c7debbb770 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9a16ffd640 1 -- 172.21.15.167:0/1022493389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c041580 con 0x55c7debbb770 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.540+0000 7f9b43961980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9a16ffd640 1 -- 172.21.15.167:0/1022493389 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9b3c05b020 con 0x55c7debbb770 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9a16ffd640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a0c0346a0 0x7f9a0c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9a16ffd640 1 -- 172.21.15.167:0/1022493389 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9b3c063050 con 0x55c7debbb770 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b40c70640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a0c0346a0 0x7f9a0c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c7debcd960 0x55c7debcfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd0550 con 0x55c7debcd960 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b41c72640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c7debcd960 0x55c7debcfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b41c72640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c7debcd960 0x55c7debcfe00 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b40c70640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a0c0346a0 0x7f9a0c036b60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c01b380 tx=0x7f9b2c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b340083f0 con 0x55c7debcd960 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 20 realm 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd0960 con 0x55c7debcd960 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b340083f0 con 0x55c7debcd960 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd1200 con 0x55c7debcd960 2024-09-18T02:04:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b340083f0 con 0x55c7debcd960 2024-09-18T02:04:20.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b340083f0 con 0x55c7debcd960 2024-09-18T02:04:20.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:20.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c7debd2300 0x55c7debd46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd4c30 con 0x55c7debd2300 2024-09-18T02:04:20.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b41471640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c7debd2300 0x55c7debd46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b41471640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c7debd2300 0x55c7debd46f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 20 searching for the correct realm 2024-09-18T02:04:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c7debd6ba0 0x55c7debd9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd9730 con 0x55c7debd6ba0 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b40c70640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c7debd6ba0 0x55c7debd9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.544+0000 7f9b40c70640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c7debd6ba0 0x55c7debd9060 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b40c70640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f9b2c0e0040 0x7f9b2c0e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd9730 con 0x7f9b2c0e0040 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f9b2c0e0040 0x7f9b2c0e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f9b2c0e0040 0x7f9b2c0e0930 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b340083f0 con 0x7f9b2c0e0040 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd2300 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b340083f0 con 0x55c7debcd960 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd2300 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd2300 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x7f9b2c0e0040 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.548+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd2300 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x7f9b2c0e0040 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd2300 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd2300 2024-09-18T02:04:20.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.552+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x7f9b2c0e0040 2024-09-18T02:04:20.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd2300 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd2300 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x7f9b2c0e0040 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd2300 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x7f9b2c0e0040 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b43961980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b43961980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b43961980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b43961980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b43961980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b43961980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:20.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b43961980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd5480 con 0x55c7debcd960 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b43961980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b43961980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.556+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd5480 con 0x55c7debcd960 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd5480 con 0x55c7debd6ba0 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:20.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 zone default found 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 4 Realm: () 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 zonegroup default 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd5d20 con 0x55c7debd2300 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdb590 con 0x55c7debd6ba0 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdb930 con 0x55c7debd6ba0 2024-09-18T02:04:20.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 started sync module instance, tier type = 2024-09-18T02:04:20.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:20.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdaa30 con 0x7f9b2c0e0040 2024-09-18T02:04:20.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94316923825968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdaa30 con 0x7f9b2c0e0040 2024-09-18T02:04:20.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdc2f0 con 0x55c7debcd960 2024-09-18T02:04:20.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.560+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94316923825968] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.564+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.564+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94316923830096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdaa30 con 0x55c7debcd960 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.564+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdcd00 con 0x55c7debd6ba0 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.564+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.564+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94316923830096] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.564+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94316923823488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debda9a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.564+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debddab0 con 0x7f9b2c0e0040 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.564+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.564+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94316923835808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debde350 con 0x7f9b2c0e0040 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.568+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debded50 con 0x55c7debcd960 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.568+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94316923823488] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.568+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94316923835808] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.568+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.568+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94316923834608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdde20 con 0x55c7debcd960 2024-09-18T02:04:20.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.568+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdf5f0 con 0x55c7debd2300 2024-09-18T02:04:20.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.568+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94316923834608] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.568+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.568+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94316923842880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdde20 con 0x55c7debd2300 2024-09-18T02:04:20.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.568+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdfe40 con 0x55c7debd2300 2024-09-18T02:04:20.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94316923842880] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94316923840608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd2300 2024-09-18T02:04:20.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0f40 con 0x55c7debd2300 2024-09-18T02:04:20.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94316923840608] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94316923849264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe11c0 con 0x55c7debd2300 2024-09-18T02:04:20.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b43961980 20 add_watcher() i=0 2024-09-18T02:04:20.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b43961980 20 add_watcher() i=1 2024-09-18T02:04:20.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b43961980 20 add_watcher() i=2 2024-09-18T02:04:20.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b43961980 20 add_watcher() i=3 2024-09-18T02:04:20.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b43961980 20 add_watcher() i=4 2024-09-18T02:04:20.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b43961980 20 add_watcher() i=5 2024-09-18T02:04:20.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.572+0000 7f9b43961980 20 add_watcher() i=6 2024-09-18T02:04:20.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94316923849264] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b43961980 20 add_watcher() i=7 2024-09-18T02:04:20.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b43961980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:20.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe4730 con 0x55c7debcd960 2024-09-18T02:04:20.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94316923847136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe1c80 con 0x55c7debcd960 2024-09-18T02:04:20.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94316923847136] v30'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f99f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b43961980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b43961980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b43961980 5 note: GC not initialized 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f99f67e4640 20 reqs_thread_entry: start 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b43961980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b43961980 20 Filter name: none 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9967fff640 20 reqs_thread_entry: start 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7dec07470 con 0x55c7debd6ba0 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.576+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debda9a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(63 [pgnls start_epoch 30 out=127b] v30'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debda9a0 con 0x55c7debcd960 2024-09-18T02:04:20.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x7f9b2c0e0040 2024-09-18T02:04:20.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x7f9b2c0e0040 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debcd960 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd2300 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd2300 2024-09-18T02:04:20.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd6ba0 2024-09-18T02:04:20.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.580+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd2300 2024-09-18T02:04:20.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd2300 2024-09-18T02:04:20.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd2300 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd6ba0 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x7f9b2c0e0040 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debcd960 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debcd960 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd6ba0 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x7f9b2c0e0040 2024-09-18T02:04:20.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd2300 2024-09-18T02:04:20.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debcd960 2024-09-18T02:04:20.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.584+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd2300 2024-09-18T02:04:20.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd6ba0 2024-09-18T02:04:20.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x7f9b2c0e0040 2024-09-18T02:04:20.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd2300 2024-09-18T02:04:20.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debcd960 2024-09-18T02:04:20.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x55c7debd6ba0 2024-09-18T02:04:20.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c7debe0690 con 0x7f9b2c0e0040 2024-09-18T02:04:20.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b43961980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:20.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b43961980 20 RGWRados::pool_iterate: got myfoo 2024-09-18T02:04:20.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f99f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:20.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.588+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94316923847136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debda9a0 con 0x55c7debcd960 2024-09-18T02:04:20.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.592+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94316923847136] v30'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.592+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94316923825968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x7f9b2c0e0040 2024-09-18T02:04:20.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.592+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94316923825968] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.592+0000 7f9b43961980 20 remove_watcher() i=0 2024-09-18T02:04:20.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.592+0000 7f9b43961980 2 removed watcher, disabling cache 2024-09-18T02:04:20.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.592+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94316923830096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debda9a0 con 0x55c7debcd960 2024-09-18T02:04:20.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.592+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94316923830096] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.592+0000 7f9b43961980 20 remove_watcher() i=1 2024-09-18T02:04:20.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.592+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94316923823488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debd15a0 con 0x55c7debd6ba0 2024-09-18T02:04:20.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.596+0000 7f9b40c70640 1 -- 172.21.15.167:0/1022493389 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94316923823488] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b2c0aab60 con 0x55c7debd6ba0 2024-09-18T02:04:20.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.596+0000 7f9b43961980 20 remove_watcher() i=2 2024-09-18T02:04:20.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.596+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94316923835808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7dec057b0 con 0x7f9b2c0e0040 2024-09-18T02:04:20.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.596+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94316923835808] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x7f9b2c0e0040 2024-09-18T02:04:20.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.596+0000 7f9b43961980 20 remove_watcher() i=3 2024-09-18T02:04:20.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.596+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94316923834608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7dec057b0 con 0x55c7debcd960 2024-09-18T02:04:20.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.600+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94316923834608] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b34026040 con 0x55c7debcd960 2024-09-18T02:04:20.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.600+0000 7f9b43961980 20 remove_watcher() i=4 2024-09-18T02:04:20.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.600+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94316923842880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7dec057b0 con 0x55c7debd2300 2024-09-18T02:04:20.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.600+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94316923842880] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.600+0000 7f9b43961980 20 remove_watcher() i=5 2024-09-18T02:04:20.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.600+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94316923840608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdaf30 con 0x55c7debd2300 2024-09-18T02:04:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.600+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94316923840608] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.600+0000 7f9b43961980 20 remove_watcher() i=6 2024-09-18T02:04:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.600+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94316923849264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c7debdbf50 con 0x55c7debd2300 2024-09-18T02:04:20.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b41471640 1 -- 172.21.15.167:0/1022493389 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94316923849264] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b3c00f070 con 0x55c7debd2300 2024-09-18T02:04:20.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 20 remove_watcher() i=7 2024-09-18T02:04:20.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c7debd2300 msgr2=0x55c7debd46f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c7debd2300 0x55c7debd46f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c7debcd960 msgr2=0x55c7debcfe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c7debcd960 0x55c7debcfe00 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f9b2c0e0040 msgr2=0x7f9b2c0e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f9b2c0e0040 0x7f9b2c0e0930 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c7debd6ba0 msgr2=0x55c7debd9060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c7debd6ba0 0x55c7debd9060 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a0c0346a0 msgr2=0x7f9a0c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a0c0346a0 0x7f9a0c036b60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c01b380 tx=0x7f9b2c0c1040 comp rx=0 tx=0).stop 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 msgr2=0x55c7debc2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b41c72640 1 -- 172.21.15.167:0/1022493389 reap_dead start 2024-09-18T02:04:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debc2950 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c03ac00 tx=0x7f9b3c00ef50 comp rx=0 tx=0).stop 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 shutdown_connections 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/1022493389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debbb770 0x55c7debc2950 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 >> 172.21.15.167:0/1022493389 conn(0x55c7debb7b50 msgr2=0x55c7debb5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 shutdown_connections 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/1022493389 wait complete. 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/4131683635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a18034650 msgr2=0x7f9a18036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/4131683635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a18034650 0x7f9a18036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55c7deb98b10 tx=0x7f9b2c005ad0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/4131683635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debaeed0 msgr2=0x55c7debaf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/4131683635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debaeed0 0x55c7debaf2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0476c0 tx=0x7f9b3c01cdf0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/4131683635 shutdown_connections 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/4131683635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a18034650 0x7f9a18036b10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/4131683635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7debaeed0 0x55c7debaf2f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/4131683635 >> 172.21.15.167:0/4131683635 conn(0x55c7deba4020 msgr2=0x55c7deba6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/4131683635 shutdown_connections 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/4131683635 wait complete. 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c7deb9a990 msgr2=0x55c7deb9cd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c7deb9a990 0x55c7deb9cd80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c7deaa2c50 msgr2=0x55c7deb97fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c7deaa2c50 0x55c7deb97fd0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c7deb9e8d0 msgr2=0x55c7deba0cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c7deb9e8d0 0x55c7deba0cc0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a280346a0 msgr2=0x7f9a28036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9a280346a0 0x7f9a28036b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0ae000 tx=0x7f9b2c0a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 msgr2=0x55c7deb91020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 --2- 172.21.15.167:0/911976653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7dea9e8d0 0x55c7deb91020 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00f610 tx=0x7f9b3c000f50 comp rx=0 tx=0).stop 2024-09-18T02:04:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b41c72640 1 -- 172.21.15.167:0/911976653 reap_dead start 2024-09-18T02:04:20.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 shutdown_connections 2024-09-18T02:04:20.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 >> 172.21.15.167:0/911976653 conn(0x55c7dea12220 msgr2=0x55c7deb843d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 shutdown_connections 2024-09-18T02:04:20.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.604+0000 7f9b43961980 1 -- 172.21.15.167:0/911976653 wait complete. 2024-09-18T02:04:20.618 INFO:teuthology.orchestra.run.smithi167.stdout:["myfoo"] 2024-09-18T02:04:20.618 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-18T02:04:20.631 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:20.645 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:20.656 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:20.701 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-18T02:04:20.769 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:20.840 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:20.912 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:20.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T02:04:20.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T02:04:20.913 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-18T02:04:20.951 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:20.951 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:20.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.948+0000 7fc84fc83980 1 Processor -- start 2024-09-18T02:04:20.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.948+0000 7fc84fc83980 1 -- start start 2024-09-18T02:04:20.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.948+0000 7fc84fc83980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562dfdc82570 0x562dfdc82950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.948+0000 7fc84fc83980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562dfdb0bae0 con 0x562dfdc82ec0 2024-09-18T02:04:20.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.948+0000 7fc84fc83980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x562dfdb2fe30 con 0x562dfdc82570 2024-09-18T02:04:20.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.948+0000 7fc84d793640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562dfdc82570 0x562dfdc82950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.948+0000 7fc84d793640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562dfdc82570 0x562dfdc82950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57044/0 (socket says 172.21.15.167:57044) 2024-09-18T02:04:20.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.948+0000 7fc84cf92640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x562dfdc82ec0 0x562dfdc878f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55586/0 (socket says 172.21.15.167:55586) 2024-09-18T02:04:20.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.948+0000 7fc84d793640 1 -- 172.21.15.167:0/3460799227 learned_addr learned my addr 172.21.15.167:0/3460799227 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.948+0000 7fc84d793640 1 -- 172.21.15.167:0/3460799227 >> v1:172.21.15.81:6789/0 conn(0x562dfdc82ec0 legacy=0x562dfdc878f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.948+0000 7fc84d793640 1 -- 172.21.15.167:0/3460799227 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dfdc8a140 con 0x562dfdc82570 2024-09-18T02:04:20.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.952+0000 7fc84d793640 1 --2- 172.21.15.167:0/3460799227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdc82950 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc84000a7a0 tx=0x7fc84001d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe7e54fc3629848 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.952+0000 7fc847fff640 1 -- 172.21.15.167:0/3460799227 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8400b3070 con 0x562dfdc82570 2024-09-18T02:04:20.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.952+0000 7fc847fff640 1 -- 172.21.15.167:0/3460799227 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400a6820 con 0x562dfdc82570 2024-09-18T02:04:20.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.952+0000 7fc847fff640 1 -- 172.21.15.167:0/3460799227 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8400a6b20 con 0x562dfdc82570 2024-09-18T02:04:20.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.952+0000 7fc84fc83980 1 -- 172.21.15.167:0/3460799227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 msgr2=0x562dfdc82950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.952+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3460799227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdc82950 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc84000a7a0 tx=0x7fc84001d800 comp rx=0 tx=0).stop 2024-09-18T02:04:20.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.952+0000 7fc84fc83980 1 -- 172.21.15.167:0/3460799227 shutdown_connections 2024-09-18T02:04:20.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.952+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3460799227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdc82950 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.952+0000 7fc84fc83980 1 -- 172.21.15.167:0/3460799227 >> 172.21.15.167:0/3460799227 conn(0x562dfdc7e090 msgr2=0x562dfdc804b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.952+0000 7fc84fc83980 1 -- 172.21.15.167:0/3460799227 shutdown_connections 2024-09-18T02:04:20.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.952+0000 7fc84fc83980 1 -- 172.21.15.167:0/3460799227 wait complete. 2024-09-18T02:04:20.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.968+0000 7fc84fc83980 1 Processor -- start 2024-09-18T02:04:20.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.968+0000 7fc84fc83980 1 -- start start 2024-09-18T02:04:20.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.968+0000 7fc84fc83980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdd6c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.968+0000 7fc84fc83980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562dfdb31200 con 0x562dfdc82570 2024-09-18T02:04:20.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.968+0000 7fc84d793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdd6c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.968+0000 7fc84d793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdd6c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57048/0 (socket says 172.21.15.167:57048) 2024-09-18T02:04:20.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.968+0000 7fc84d793640 1 -- 172.21.15.167:0/936356566 learned_addr learned my addr 172.21.15.167:0/936356566 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84d793640 1 -- 172.21.15.167:0/936356566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dfdd6cd90 con 0x562dfdc82570 2024-09-18T02:04:20.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84d793640 1 --2- 172.21.15.167:0/936356566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdd6c7c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc8400b1040 tx=0x7fc8400033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1884689ad7d0378 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc73b606640 1 -- 172.21.15.167:0/936356566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8400b3070 con 0x562dfdc82570 2024-09-18T02:04:20.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc73b606640 1 -- 172.21.15.167:0/936356566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400b4040 con 0x562dfdc82570 2024-09-18T02:04:20.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc73b606640 1 -- 172.21.15.167:0/936356566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8400a6d30 con 0x562dfdc82570 2024-09-18T02:04:20.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 -- 172.21.15.167:0/936356566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 msgr2=0x562dfdd6c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 --2- 172.21.15.167:0/936356566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdd6c7c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc8400b1040 tx=0x7fc8400033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 -- 172.21.15.167:0/936356566 shutdown_connections 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 --2- 172.21.15.167:0/936356566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdd6c7c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 -- 172.21.15.167:0/936356566 >> 172.21.15.167:0/936356566 conn(0x562dfdc7e090 msgr2=0x562dfdd683f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 -- 172.21.15.167:0/936356566 shutdown_connections 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 -- 172.21.15.167:0/936356566 wait complete. 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 Processor -- start 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 -- start start 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdd73990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562dfdc89b80 con 0x562dfdc82570 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84d793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdd73990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84d793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdd73990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57056/0 (socket says 172.21.15.167:57056) 2024-09-18T02:04:20.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84d793640 1 -- 172.21.15.167:0/3167643467 learned_addr learned my addr 172.21.15.167:0/3167643467 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84d793640 1 -- 172.21.15.167:0/3167643467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dfdd73ed0 con 0x562dfdc82570 2024-09-18T02:04:20.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84d793640 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdd73990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc84001e0a0 tx=0x7fc84001a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc739e03640 1 -- 172.21.15.167:0/3167643467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8400c7070 con 0x562dfdc82570 2024-09-18T02:04:20.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562dfdd74160 con 0x562dfdc82570 2024-09-18T02:04:20.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc739e03640 1 -- 172.21.15.167:0/3167643467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400aee50 con 0x562dfdc82570 2024-09-18T02:04:20.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dfdd76e40 con 0x562dfdc82570 2024-09-18T02:04:20.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.972+0000 7fc739e03640 1 -- 172.21.15.167:0/3167643467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8400cc580 con 0x562dfdc82570 2024-09-18T02:04:20.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc739e03640 1 -- 172.21.15.167:0/3167643467 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc8400cc720 con 0x562dfdc82570 2024-09-18T02:04:20.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc739e03640 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc734034650 0x7fc734036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc739e03640 1 -- 172.21.15.167:0/3167643467 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc8400bd070 con 0x562dfdc82570 2024-09-18T02:04:20.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84cf92640 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc734034650 0x7fc734036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562dfdc82ec0 0x562dfdd7a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfdd7af90 con 0x562dfdc82ec0 2024-09-18T02:04:20.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84df94640 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562dfdc82ec0 0x562dfdd7a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84cf92640 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc734034650 0x7fc734036b10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc838001e50 tx=0x7fc8380013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84df94640 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562dfdc82ec0 0x562dfdd7a920 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84df94640 1 -- 172.21.15.167:0/3167643467 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8480083f0 con 0x562dfdc82ec0 2024-09-18T02:04:20.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfdd78040 con 0x562dfdc82ec0 2024-09-18T02:04:20.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84df94640 1 -- 172.21.15.167:0/3167643467 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8480083f0 con 0x562dfdc82ec0 2024-09-18T02:04:20.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562dfdd7d2c0 0x562dfdd7f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfdd7fda0 con 0x562dfdd7d2c0 2024-09-18T02:04:20.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84d793640 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562dfdd7d2c0 0x562dfdd7f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.976+0000 7fc84d793640 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562dfdd7d2c0 0x562dfdd7f6b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84d793640 1 -- 172.21.15.167:0/3167643467 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8400c9070 con 0x562dfdd7d2c0 2024-09-18T02:04:20.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfdd7c160 con 0x562dfdc82ec0 2024-09-18T02:04:20.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84df94640 1 -- 172.21.15.167:0/3167643467 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8480083f0 con 0x562dfdc82ec0 2024-09-18T02:04:20.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562dfdd81200 0x562dfdd835f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfdd83d30 con 0x562dfdd81200 2024-09-18T02:04:20.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84cf92640 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562dfdd81200 0x562dfdd835f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84cf92640 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562dfdd81200 0x562dfdd835f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84cf92640 1 -- 172.21.15.167:0/3167643467 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc83800f700 con 0x562dfdd81200 2024-09-18T02:04:20.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84fc83980 1 Processor -- start 2024-09-18T02:04:20.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84fc83980 1 -- start start 2024-09-18T02:04:20.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84fc83980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd91800 0x562dfdd91c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84fc83980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562dfdb8a800 con 0x562dfdd91800 2024-09-18T02:04:20.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84d793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd91800 0x562dfdd91c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84d793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd91800 0x562dfdd91c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57060/0 (socket says 172.21.15.167:57060) 2024-09-18T02:04:20.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84d793640 1 -- 172.21.15.167:0/316640613 learned_addr learned my addr 172.21.15.167:0/316640613 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84d793640 1 -- 172.21.15.167:0/316640613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dfdd92160 con 0x562dfdd91800 2024-09-18T02:04:20.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84d793640 1 --2- 172.21.15.167:0/316640613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd91800 0x562dfdd91c20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc8400a7ab0 tx=0x7fc8400c16d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc732ffd640 1 -- 172.21.15.167:0/316640613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8400eb070 con 0x562dfdd91800 2024-09-18T02:04:20.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84fc83980 1 -- 172.21.15.167:0/316640613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562dfdd923f0 con 0x562dfdd91800 2024-09-18T02:04:20.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc732ffd640 1 -- 172.21.15.167:0/316640613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400acde0 con 0x562dfdd91800 2024-09-18T02:04:20.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc732ffd640 1 -- 172.21.15.167:0/316640613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8400e6c70 con 0x562dfdd91800 2024-09-18T02:04:20.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.980+0000 7fc84fc83980 1 -- 172.21.15.167:0/316640613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dfdd95070 con 0x562dfdd91800 2024-09-18T02:04:20.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc732ffd640 1 -- 172.21.15.167:0/316640613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc8400ee070 con 0x562dfdd91800 2024-09-18T02:04:20.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc732ffd640 1 --2- 172.21.15.167:0/316640613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc7240346a0 0x7fc724036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc732ffd640 1 -- 172.21.15.167:0/316640613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc8400e2030 con 0x562dfdd91800 2024-09-18T02:04:20.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc84cf92640 1 --2- 172.21.15.167:0/316640613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc7240346a0 0x7fc724036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc84fc83980 1 Processor -- start 2024-09-18T02:04:20.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc84fc83980 1 -- start start 2024-09-18T02:04:20.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc84cf92640 1 --2- 172.21.15.167:0/316640613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc7240346a0 0x7fc724036b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x562dfdd7b460 tx=0x7fc83800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc84fc83980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdd9e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc84fc83980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562dfdd6d050 con 0x562dfdd9e0c0 2024-09-18T02:04:20.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc84d793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdd9e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc84d793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdd9e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57064/0 (socket says 172.21.15.167:57064) 2024-09-18T02:04:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc84d793640 1 -- 172.21.15.167:0/390336236 learned_addr learned my addr 172.21.15.167:0/390336236 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc84d793640 1 -- 172.21.15.167:0/390336236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dfdd9ea90 con 0x562dfdd9e0c0 2024-09-18T02:04:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc84d793640 1 --2- 172.21.15.167:0/390336236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdd9e4c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc8400c5610 tx=0x7fc8400e36a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726b84eb181a6a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc730ff9640 1 -- 172.21.15.167:0/390336236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc840104070 con 0x562dfdd9e0c0 2024-09-18T02:04:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc730ff9640 1 -- 172.21.15.167:0/390336236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400ad3a0 con 0x562dfdd9e0c0 2024-09-18T02:04:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.984+0000 7fc730ff9640 1 -- 172.21.15.167:0/390336236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8400e6e10 con 0x562dfdd9e0c0 2024-09-18T02:04:20.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 -- 172.21.15.167:0/390336236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 msgr2=0x562dfdd9e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:20.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 --2- 172.21.15.167:0/390336236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdd9e4c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc8400c5610 tx=0x7fc8400e36a0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 -- 172.21.15.167:0/390336236 shutdown_connections 2024-09-18T02:04:20.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 --2- 172.21.15.167:0/390336236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdd9e4c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:20.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 -- 172.21.15.167:0/390336236 >> 172.21.15.167:0/390336236 conn(0x562dfdd9a4e0 msgr2=0x562dfdd985e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:20.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 -- 172.21.15.167:0/390336236 shutdown_connections 2024-09-18T02:04:20.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 -- 172.21.15.167:0/390336236 wait complete. 2024-09-18T02:04:20.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 Processor -- start 2024-09-18T02:04:20.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 -- start start 2024-09-18T02:04:20.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdda52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562dfdd9eef0 con 0x562dfdd9e0c0 2024-09-18T02:04:20.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84d793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdda52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84d793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdda52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57074/0 (socket says 172.21.15.167:57074) 2024-09-18T02:04:20.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 learned_addr learned my addr 172.21.15.167:0/3412673465 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:20.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dfdda5820 con 0x562dfdd9e0c0 2024-09-18T02:04:20.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84d793640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdda52e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc8400ad550 tx=0x7fc8400b3e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc722ffd640 1 -- 172.21.15.167:0/3412673465 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc840104040 con 0x562dfdd9e0c0 2024-09-18T02:04:20.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562dfdda5820 con 0x562dfdd9e0c0 2024-09-18T02:04:20.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dfdda5820 con 0x562dfdd9e0c0 2024-09-18T02:04:20.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc722ffd640 1 -- 172.21.15.167:0/3412673465 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400e6e10 con 0x562dfdd9e0c0 2024-09-18T02:04:20.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc722ffd640 1 -- 172.21.15.167:0/3412673465 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8400ad5c0 con 0x562dfdd9e0c0 2024-09-18T02:04:20.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc722ffd640 1 -- 172.21.15.167:0/3412673465 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc840112020 con 0x562dfdd9e0c0 2024-09-18T02:04:20.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.988+0000 7fc722ffd640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc718034650 0x7fc718036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc722ffd640 1 -- 172.21.15.167:0/3412673465 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc840110020 con 0x562dfdd9e0c0 2024-09-18T02:04:20.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84cf92640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc718034650 0x7fc718036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562dfddb03f0 0x562dfddb2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb2fe0 con 0x562dfddb03f0 2024-09-18T02:04:20.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84df94640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562dfddb03f0 0x562dfddb2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:20.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84cf92640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc718034650 0x7fc718036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x562dfdd84130 tx=0x7fc838010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84df94640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562dfddb03f0 0x562dfddb2890 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8480083f0 con 0x562dfddb03f0 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 20 realm 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb33f0 con 0x562dfddb03f0 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8480083f0 con 0x562dfddb03f0 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb3c90 con 0x562dfddb03f0 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8480083f0 con 0x562dfddb03f0 2024-09-18T02:04:20.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:20.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb03f0 2024-09-18T02:04:20.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8480083f0 con 0x562dfddb03f0 2024-09-18T02:04:20.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:20.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:20.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562dfddb4d90 0x562dfddb7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:20.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb76c0 con 0x562dfddb4d90 2024-09-18T02:04:20.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84d793640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562dfddb4d90 0x562dfddb7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84d793640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562dfddb4d90 0x562dfddb7180 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:21.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 20 searching for the correct realm 2024-09-18T02:04:21.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562dfddb9630 0x562dfddbbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddbc1c0 con 0x562dfddb9630 2024-09-18T02:04:21.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.992+0000 7fc84cf92640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562dfddb9630 0x562dfddbbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84cf92640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562dfddb9630 0x562dfddbbaf0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84cf92640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc83801fc60 0x7fc83803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddbc1c0 con 0x7fc83801fc60 2024-09-18T02:04:21.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84df94640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc83801fc60 0x7fc83803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84df94640 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc83801fc60 0x7fc83803a3c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480083f0 con 0x7fc83801fc60 2024-09-18T02:04:21.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb4d90 2024-09-18T02:04:21.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb03f0 2024-09-18T02:04:21.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480083f0 con 0x562dfddb03f0 2024-09-18T02:04:21.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb03f0 2024-09-18T02:04:21.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb4d90 2024-09-18T02:04:21.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb4d90 2024-09-18T02:04:21.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:20.996+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x7fc83801fc60 2024-09-18T02:04:21.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb9630 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb03f0 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb4d90 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb03f0 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x7fc83801fc60 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb9630 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb9630 2024-09-18T02:04:21.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb4d90 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb9630 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.000+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb9630 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb03f0 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb03f0 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb4d90 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb9630 2024-09-18T02:04:21.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x7fc83801fc60 2024-09-18T02:04:21.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb03f0 2024-09-18T02:04:21.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb4d90 2024-09-18T02:04:21.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb9630 2024-09-18T02:04:21.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.004+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb4d90 2024-09-18T02:04:21.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x7fc83801fc60 2024-09-18T02:04:21.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb9630 2024-09-18T02:04:21.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb4d90 2024-09-18T02:04:21.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x562dfddb03f0 2024-09-18T02:04:21.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb4030 con 0x7fc83801fc60 2024-09-18T02:04:21.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:21.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:21.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb7f10 con 0x562dfddb03f0 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb7f10 con 0x562dfddb03f0 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb7f10 con 0x562dfddb9630 2024-09-18T02:04:21.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:21.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 zone default found 2024-09-18T02:04:21.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 4 Realm: () 2024-09-18T02:04:21.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:21.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:21.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:21.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 zonegroup default 2024-09-18T02:04:21.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.008+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddb87b0 con 0x562dfddb4d90 2024-09-18T02:04:21.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddbe020 con 0x562dfddb9630 2024-09-18T02:04:21.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddbe3c0 con 0x562dfddb9630 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 20 started sync module instance, tier type = 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddbd4c0 con 0x7fc83801fc60 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94755532560832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddbd4c0 con 0x7fc83801fc60 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddbede0 con 0x562dfddb03f0 2024-09-18T02:04:21.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.012+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94755532560832] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.016+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.016+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94755532564688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddbd4c0 con 0x562dfddb03f0 2024-09-18T02:04:21.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.016+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddbf7f0 con 0x562dfddb9630 2024-09-18T02:04:21.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.016+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.016+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94755532564688] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.016+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94755532558352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddbd430 con 0x562dfddb9630 2024-09-18T02:04:21.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.016+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc06b0 con 0x7fc83801fc60 2024-09-18T02:04:21.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.020+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.020+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94755532571408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc0d40 con 0x7fc83801fc60 2024-09-18T02:04:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.020+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc1860 con 0x562dfddb03f0 2024-09-18T02:04:21.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.020+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94755532558352] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.020+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94755532571408] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.020+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.020+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94755532575536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc1820 con 0x562dfddb03f0 2024-09-18T02:04:21.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.020+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc1c50 con 0x562dfddb4d90 2024-09-18T02:04:21.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.024+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94755532575536] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.024+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.024+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94755532572560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc1ff0 con 0x562dfddb4d90 2024-09-18T02:04:21.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.024+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc28a0 con 0x562dfddb4d90 2024-09-18T02:04:21.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.024+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94755532572560] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.024+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.024+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94755532569568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc2a80 con 0x562dfddb4d90 2024-09-18T02:04:21.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.024+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc32d0 con 0x562dfddb4d90 2024-09-18T02:04:21.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.028+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94755532569568] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.028+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.028+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94755532581504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc3350 con 0x562dfddb4d90 2024-09-18T02:04:21.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.028+0000 7fc84fc83980 20 add_watcher() i=0 2024-09-18T02:04:21.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.028+0000 7fc84fc83980 20 add_watcher() i=1 2024-09-18T02:04:21.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.028+0000 7fc84fc83980 20 add_watcher() i=2 2024-09-18T02:04:21.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.028+0000 7fc84fc83980 20 add_watcher() i=3 2024-09-18T02:04:21.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.028+0000 7fc84fc83980 20 add_watcher() i=4 2024-09-18T02:04:21.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.028+0000 7fc84fc83980 20 add_watcher() i=5 2024-09-18T02:04:21.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.028+0000 7fc84fc83980 20 add_watcher() i=6 2024-09-18T02:04:21.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94755532581504] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 20 add_watcher() i=7 2024-09-18T02:04:21.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:21.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc6750 con 0x562dfddb03f0 2024-09-18T02:04:21.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94755532583024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc3c70 con 0x562dfddb03f0 2024-09-18T02:04:21.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94755532583024] v30'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc7037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:21.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:21.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:21.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 5 note: GC not initialized 2024-09-18T02:04:21.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc7027e4640 20 reqs_thread_entry: start 2024-09-18T02:04:21.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:21.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 20 Filter name: none 2024-09-18T02:04:21.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc673fff640 20 reqs_thread_entry: start 2024-09-18T02:04:21.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfdde9e30 con 0x7fc83801fc60 2024-09-18T02:04:21.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.032+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:63 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddea6c0 con 0x562dfddb9630 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(63 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddea290 con 0x7fc83801fc60 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:65 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddea290 con 0x562dfddb9630 2024-09-18T02:04:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(65 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:66 4.24 4:2438aa61:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddeb7c0 con 0x562dfddb4d90 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 4.29 4:9642b720:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddf08d0 con 0x562dfddb9630 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 4.f 4:f090116b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddeb7c0 con 0x562dfddb03f0 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 4.29 4:949287a7:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddf5980 con 0x562dfddb9630 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:70 4.5 4:a2069307:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddf8440 con 0x562dfddb9630 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 4.2d 4:b5ed9a3b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddfad60 con 0x562dfddb4d90 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:72 4.16 4:680d0d24:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddfd5d0 con 0x562dfddb9630 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:73 4.9 4:9363ad15:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfddffe40 con 0x562dfddb03f0 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 4.24 4:24630749:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfde02c70 con 0x562dfddb4d90 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 4.3 4:c118e1af:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfde05b30 con 0x562dfddb03f0 2024-09-18T02:04:21.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 4.36 4:6d2a8929:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562dfde08920 con 0x562dfddb03f0 2024-09-18T02:04:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(68 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(67 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(70 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(69 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(71 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(66 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(73 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(75 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(76 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(72 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(74 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc7037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:21.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.036+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94755532583024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc65f0 con 0x562dfddb03f0 2024-09-18T02:04:21.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.040+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94755532583024] v30'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.040+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94755532560832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc65f0 con 0x7fc83801fc60 2024-09-18T02:04:21.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.040+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94755532560832] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.040+0000 7fc84fc83980 20 remove_watcher() i=0 2024-09-18T02:04:21.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.040+0000 7fc84fc83980 2 removed watcher, disabling cache 2024-09-18T02:04:21.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.040+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94755532564688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc65f0 con 0x562dfddb03f0 2024-09-18T02:04:21.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.044+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94755532564688] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.044+0000 7fc84fc83980 20 remove_watcher() i=1 2024-09-18T02:04:21.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.044+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94755532558352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc65f0 con 0x562dfddb9630 2024-09-18T02:04:21.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.044+0000 7fc84cf92640 1 -- 172.21.15.167:0/3412673465 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94755532558352] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838037040 con 0x562dfddb9630 2024-09-18T02:04:21.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.044+0000 7fc84fc83980 20 remove_watcher() i=2 2024-09-18T02:04:21.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.044+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94755532571408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc65f0 con 0x7fc83801fc60 2024-09-18T02:04:21.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.044+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94755532571408] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x7fc83801fc60 2024-09-18T02:04:21.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.044+0000 7fc84fc83980 20 remove_watcher() i=3 2024-09-18T02:04:21.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.044+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94755532575536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc65f0 con 0x562dfddb03f0 2024-09-18T02:04:21.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.048+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94755532575536] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848026040 con 0x562dfddb03f0 2024-09-18T02:04:21.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.048+0000 7fc84fc83980 20 remove_watcher() i=4 2024-09-18T02:04:21.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.048+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94755532572560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc65f0 con 0x562dfddb4d90 2024-09-18T02:04:21.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.048+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94755532572560] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.052+0000 7fc84fc83980 20 remove_watcher() i=5 2024-09-18T02:04:21.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.052+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94755532569568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc65f0 con 0x562dfddb4d90 2024-09-18T02:04:21.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.052+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94755532569568] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.052+0000 7fc84fc83980 20 remove_watcher() i=6 2024-09-18T02:04:21.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.052+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94755532581504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562dfddc65f0 con 0x562dfddb4d90 2024-09-18T02:04:21.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84d793640 1 -- 172.21.15.167:0/3412673465 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94755532581504] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc840107040 con 0x562dfddb4d90 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 20 remove_watcher() i=7 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562dfddb4d90 msgr2=0x562dfddb7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562dfddb4d90 0x562dfddb7180 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562dfddb03f0 msgr2=0x562dfddb2890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562dfddb03f0 0x562dfddb2890 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc83801fc60 msgr2=0x7fc83803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc83801fc60 0x7fc83803a3c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562dfddb9630 msgr2=0x562dfddbbaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562dfddb9630 0x562dfddbbaf0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc718034650 msgr2=0x7fc718036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc718034650 0x7fc718036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x562dfdd84130 tx=0x7fc838010000 comp rx=0 tx=0).stop 2024-09-18T02:04:21.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84df94640 1 -- 172.21.15.167:0/3412673465 reap_dead start 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 msgr2=0x562dfdda52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdda52e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc8400ad550 tx=0x7fc8400b3e30 comp rx=0 tx=0).stop 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 shutdown_connections 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3412673465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd9e0c0 0x562dfdda52e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 >> 172.21.15.167:0/3412673465 conn(0x562dfdd9a4e0 msgr2=0x562dfdd985b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 shutdown_connections 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3412673465 wait complete. 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/316640613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc7240346a0 msgr2=0x7fc724036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/316640613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc7240346a0 0x7fc724036b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x562dfdd7b460 tx=0x7fc83800f000 comp rx=0 tx=0).stop 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/316640613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd91800 msgr2=0x562dfdd91c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/316640613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd91800 0x562dfdd91c20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc8400a7ab0 tx=0x7fc8400c16d0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/316640613 shutdown_connections 2024-09-18T02:04:21.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/316640613 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc7240346a0 0x7fc724036b60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/316640613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdd91800 0x562dfdd91c20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/316640613 >> 172.21.15.167:0/316640613 conn(0x562dfdd86950 msgr2=0x562dfdd893d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/316640613 shutdown_connections 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/316640613 wait complete. 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562dfdd7d2c0 msgr2=0x562dfdd7f6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562dfdd7d2c0 0x562dfdd7f6b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562dfdc82ec0 msgr2=0x562dfdd7a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562dfdc82ec0 0x562dfdd7a920 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562dfdd81200 msgr2=0x562dfdd835f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562dfdd81200 0x562dfdd835f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc734034650 msgr2=0x7fc734036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc734034650 0x7fc734036b10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc838001e50 tx=0x7fc8380013b0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 msgr2=0x562dfdd73990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 --2- 172.21.15.167:0/3167643467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfdc82570 0x562dfdd73990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc84001e0a0 tx=0x7fc84001a5a0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84df94640 1 -- 172.21.15.167:0/3167643467 reap_dead start 2024-09-18T02:04:21.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 shutdown_connections 2024-09-18T02:04:21.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 >> 172.21.15.167:0/3167643467 conn(0x562dfdc7e090 msgr2=0x562dfdd66f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 shutdown_connections 2024-09-18T02:04:21.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.056+0000 7fc84fc83980 1 -- 172.21.15.167:0/3167643467 wait complete. 2024-09-18T02:04:21.071 INFO:teuthology.orchestra.run.smithi167.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b6f58232-12d9-447d-8d4f-091dad0fc7cc","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","marker":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T02:04:20.265935Z","creation_time":"2024-09-18T02:04:20.260735Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-18T02:04:21.071 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b6f58232-12d9-447d-8d4f-091dad0fc7cc', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'marker': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T02:04:20.265935Z', 'creation_time': '2024-09-18T02:04:20.260735Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T02:04:21.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-18T02:04:21.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-18T02:04:21.072 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-18T02:04:21.149 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:21.149 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:21.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.148+0000 7f867ec97980 1 Processor -- start 2024-09-18T02:04:21.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.148+0000 7f867ec97980 1 -- start start 2024-09-18T02:04:21.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.148+0000 7f867ec97980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55640042db00 0x5564004bc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.148+0000 7f867ec97980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556400341ae0 con 0x5564004bc870 2024-09-18T02:04:21.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.148+0000 7f867ec97980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x556400365e30 con 0x55640042db00 2024-09-18T02:04:21.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.148+0000 7f867c7a7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55640042db00 0x5564004bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.148+0000 7f867c7a7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55640042db00 0x5564004bc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57084/0 (socket says 172.21.15.167:57084) 2024-09-18T02:04:21.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.148+0000 7f867bfa6640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5564004bc870 0x5564004bec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55594/0 (socket says 172.21.15.167:55594) 2024-09-18T02:04:21.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.148+0000 7f867c7a7640 1 -- 172.21.15.167:0/2079853773 learned_addr learned my addr 172.21.15.167:0/2079853773 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.148+0000 7f867c7a7640 1 -- 172.21.15.167:0/2079853773 >> v1:172.21.15.81:6789/0 conn(0x5564004bc870 legacy=0x5564004bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.148+0000 7f867c7a7640 1 -- 172.21.15.167:0/2079853773 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564004c1390 con 0x55640042db00 2024-09-18T02:04:21.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.152+0000 7f867c7a7640 1 --2- 172.21.15.167:0/2079853773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55640042db00 0x5564004bc330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f867400a4e0 tx=0x7f867401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279837cb568dad97 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.152+0000 7f867b7a5640 1 -- 172.21.15.167:0/2079853773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740aa540 con 0x55640042db00 2024-09-18T02:04:21.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.152+0000 7f867b7a5640 1 -- 172.21.15.167:0/2079853773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86740aa6e0 con 0x55640042db00 2024-09-18T02:04:21.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.152+0000 7f867b7a5640 1 -- 172.21.15.167:0/2079853773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740aaa40 con 0x55640042db00 2024-09-18T02:04:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.152+0000 7f867ec97980 1 -- 172.21.15.167:0/2079853773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55640042db00 msgr2=0x5564004bc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.152+0000 7f867ec97980 1 --2- 172.21.15.167:0/2079853773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55640042db00 0x5564004bc330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f867400a4e0 tx=0x7f867401b090 comp rx=0 tx=0).stop 2024-09-18T02:04:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.152+0000 7f867ec97980 1 -- 172.21.15.167:0/2079853773 shutdown_connections 2024-09-18T02:04:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.152+0000 7f867ec97980 1 --2- 172.21.15.167:0/2079853773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55640042db00 0x5564004bc330 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.152+0000 7f867ec97980 1 -- 172.21.15.167:0/2079853773 >> 172.21.15.167:0/2079853773 conn(0x5564004b4060 msgr2=0x5564004b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.152+0000 7f867ec97980 1 -- 172.21.15.167:0/2079853773 shutdown_connections 2024-09-18T02:04:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.152+0000 7f867ec97980 1 -- 172.21.15.167:0/2079853773 wait complete. 2024-09-18T02:04:21.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f867ec97980 1 Processor -- start 2024-09-18T02:04:21.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f867ec97980 1 -- start start 2024-09-18T02:04:21.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f867ec97980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55640042db00 0x5564004b9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f867ec97980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556400367200 con 0x55640042db00 2024-09-18T02:04:21.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f867c7a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55640042db00 0x5564004b9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f867c7a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55640042db00 0x5564004b9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57098/0 (socket says 172.21.15.167:57098) 2024-09-18T02:04:21.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f867c7a7640 1 -- 172.21.15.167:0/3090114540 learned_addr learned my addr 172.21.15.167:0/3090114540 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f867c7a7640 1 -- 172.21.15.167:0/3090114540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564004ba060 con 0x55640042db00 2024-09-18T02:04:21.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f867c7a7640 1 --2- 172.21.15.167:0/3090114540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55640042db00 0x5564004b9a90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8674017ca0 tx=0x7f86740033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e2ba5f18eb4438 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f856a60c640 1 -- 172.21.15.167:0/3090114540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740b9070 con 0x55640042db00 2024-09-18T02:04:21.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f856a60c640 1 -- 172.21.15.167:0/3090114540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86740aaa80 con 0x55640042db00 2024-09-18T02:04:21.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.168+0000 7f856a60c640 1 -- 172.21.15.167:0/3090114540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740aad60 con 0x55640042db00 2024-09-18T02:04:21.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 -- 172.21.15.167:0/3090114540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55640042db00 msgr2=0x5564004b9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 --2- 172.21.15.167:0/3090114540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55640042db00 0x5564004b9a90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8674017ca0 tx=0x7f86740033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 -- 172.21.15.167:0/3090114540 shutdown_connections 2024-09-18T02:04:21.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 --2- 172.21.15.167:0/3090114540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55640042db00 0x5564004b9a90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 -- 172.21.15.167:0/3090114540 >> 172.21.15.167:0/3090114540 conn(0x5564004b4060 msgr2=0x5564005a0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 -- 172.21.15.167:0/3090114540 shutdown_connections 2024-09-18T02:04:21.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 -- 172.21.15.167:0/3090114540 wait complete. 2024-09-18T02:04:21.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 Processor -- start 2024-09-18T02:04:21.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 -- start start 2024-09-18T02:04:21.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564004bc870 0x5564005ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5564004c0e30 con 0x5564004bc870 2024-09-18T02:04:21.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867c7a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564004bc870 0x5564005ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867c7a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564004bc870 0x5564005ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57112/0 (socket says 172.21.15.167:57112) 2024-09-18T02:04:21.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867c7a7640 1 -- 172.21.15.167:0/750418673 learned_addr learned my addr 172.21.15.167:0/750418673 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867c7a7640 1 -- 172.21.15.167:0/750418673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564005ae630 con 0x5564004bc870 2024-09-18T02:04:21.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867c7a7640 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564004bc870 0x5564005ae0f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f867401aec0 tx=0x7f8674017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f8568e09640 1 -- 172.21.15.167:0/750418673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740cc070 con 0x5564004bc870 2024-09-18T02:04:21.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f8568e09640 1 -- 172.21.15.167:0/750418673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86740c7470 con 0x5564004bc870 2024-09-18T02:04:21.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564005ae8c0 con 0x5564004bc870 2024-09-18T02:04:21.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f8568e09640 1 -- 172.21.15.167:0/750418673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740b9050 con 0x5564004bc870 2024-09-18T02:04:21.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.172+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564005b15a0 con 0x5564004bc870 2024-09-18T02:04:21.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f8568e09640 1 -- 172.21.15.167:0/750418673 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86740b3040 con 0x5564004bc870 2024-09-18T02:04:21.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f8568e09640 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8564034650 0x7f8564036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f8568e09640 1 -- 172.21.15.167:0/750418673 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f86740c3030 con 0x5564004bc870 2024-09-18T02:04:21.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867bfa6640 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8564034650 0x7f8564036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867ec97980 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5564005b31e0 0x5564005b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005b5ba0 con 0x5564005b31e0 2024-09-18T02:04:21.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867cfa8640 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5564005b31e0 0x5564005b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867bfa6640 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8564034650 0x7f8564036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8664000f70 tx=0x7f8664001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867cfa8640 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5564005b31e0 0x5564005b55d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867cfa8640 1 -- 172.21.15.167:0/750418673 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f866c0083f0 con 0x5564005b31e0 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005b27c0 con 0x5564005b31e0 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867cfa8640 1 -- 172.21.15.167:0/750418673 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f866c0083f0 con 0x5564005b31e0 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867ec97980 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5564005b7f00 0x5564005ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005ba9e0 con 0x5564005b7f00 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867c7a7640 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5564005b7f00 0x5564005ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867c7a7640 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5564005b7f00 0x5564005ba2f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867c7a7640 1 -- 172.21.15.167:0/750418673 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f86740cf3a0 con 0x5564005b7f00 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.176+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005b6da0 con 0x5564005b31e0 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867cfa8640 1 -- 172.21.15.167:0/750418673 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f866c0083f0 con 0x5564005b31e0 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867ec97980 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5564005bbe40 0x5564005be230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005be970 con 0x5564005bbe40 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867bfa6640 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5564005bbe40 0x5564005be230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867bfa6640 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5564005bbe40 0x5564005be230 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867bfa6640 1 -- 172.21.15.167:0/750418673 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f866400f6a0 con 0x5564005bbe40 2024-09-18T02:04:21.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867ec97980 1 Processor -- start 2024-09-18T02:04:21.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867ec97980 1 -- start start 2024-09-18T02:04:21.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867ec97980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005cc440 0x5564005cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867ec97980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5564003c0800 con 0x5564005cc440 2024-09-18T02:04:21.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867c7a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005cc440 0x5564005cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867c7a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005cc440 0x5564005cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57122/0 (socket says 172.21.15.167:57122) 2024-09-18T02:04:21.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867c7a7640 1 -- 172.21.15.167:0/1464849370 learned_addr learned my addr 172.21.15.167:0/1464849370 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867c7a7640 1 -- 172.21.15.167:0/1464849370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564005ccda0 con 0x5564005cc440 2024-09-18T02:04:21.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867c7a7640 1 --2- 172.21.15.167:0/1464849370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005cc440 0x5564005cc860 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f86740b4f20 tx=0x7f86740bd400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f8561ffb640 1 -- 172.21.15.167:0/1464849370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740e9070 con 0x5564005cc440 2024-09-18T02:04:21.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867ec97980 1 -- 172.21.15.167:0/1464849370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564005cd030 con 0x5564005cc440 2024-09-18T02:04:21.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f8561ffb640 1 -- 172.21.15.167:0/1464849370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86740c5bc0 con 0x5564005cc440 2024-09-18T02:04:21.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f867ec97980 1 -- 172.21.15.167:0/1464849370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564005cfcb0 con 0x5564005cc440 2024-09-18T02:04:21.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.180+0000 7f8561ffb640 1 -- 172.21.15.167:0/1464849370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740e0070 con 0x5564005cc440 2024-09-18T02:04:21.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f8561ffb640 1 -- 172.21.15.167:0/1464849370 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86740ec070 con 0x5564005cc440 2024-09-18T02:04:21.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f8561ffb640 1 --2- 172.21.15.167:0/1464849370 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8554034650 0x7f8554036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f8561ffb640 1 -- 172.21.15.167:0/1464849370 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f86740d6040 con 0x5564005cc440 2024-09-18T02:04:21.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867bfa6640 1 --2- 172.21.15.167:0/1464849370 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8554034650 0x7f8554036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867ec97980 1 Processor -- start 2024-09-18T02:04:21.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867ec97980 1 -- start start 2024-09-18T02:04:21.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867bfa6640 1 --2- 172.21.15.167:0/1464849370 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8554034650 0x7f8554036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5564005b6080 tx=0x7f866400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867ec97980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005d91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867ec97980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5564004b81c0 con 0x5564005d8dd0 2024-09-18T02:04:21.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867c7a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005d91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867c7a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005d91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57138/0 (socket says 172.21.15.167:57138) 2024-09-18T02:04:21.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867c7a7640 1 -- 172.21.15.167:0/1304740050 learned_addr learned my addr 172.21.15.167:0/1304740050 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867c7a7640 1 -- 172.21.15.167:0/1304740050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564005d97a0 con 0x5564005d8dd0 2024-09-18T02:04:21.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867c7a7640 1 --2- 172.21.15.167:0/1304740050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005d91d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f86740c6fa0 tx=0x7f86740c63d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b464885516d5adcc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f855b7fe640 1 -- 172.21.15.167:0/1304740050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740c01f0 con 0x5564005d8dd0 2024-09-18T02:04:21.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f855b7fe640 1 -- 172.21.15.167:0/1304740050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8674100070 con 0x5564005d8dd0 2024-09-18T02:04:21.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f855b7fe640 1 -- 172.21.15.167:0/1304740050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740c6820 con 0x5564005d8dd0 2024-09-18T02:04:21.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867ec97980 1 -- 172.21.15.167:0/1304740050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 msgr2=0x5564005d91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867ec97980 1 --2- 172.21.15.167:0/1304740050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005d91d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f86740c6fa0 tx=0x7f86740c63d0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867ec97980 1 -- 172.21.15.167:0/1304740050 shutdown_connections 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867ec97980 1 --2- 172.21.15.167:0/1304740050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005d91d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867ec97980 1 -- 172.21.15.167:0/1304740050 >> 172.21.15.167:0/1304740050 conn(0x5564005d5150 msgr2=0x5564005d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867ec97980 1 -- 172.21.15.167:0/1304740050 shutdown_connections 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.184+0000 7f867ec97980 1 -- 172.21.15.167:0/1304740050 wait complete. 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867ec97980 1 Processor -- start 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867ec97980 1 -- start start 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867ec97980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005dff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867ec97980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5564005d9b60 con 0x5564005d8dd0 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867c7a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867c7a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005dff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57154/0 (socket says 172.21.15.167:57154) 2024-09-18T02:04:21.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 learned_addr learned my addr 172.21.15.167:0/2325697212 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564005e0470 con 0x5564005d8dd0 2024-09-18T02:04:21.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867c7a7640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005dff30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f86740c6410 tx=0x7f86740b3ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f8559ffb640 1 -- 172.21.15.167:0/2325697212 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740c0dd0 con 0x5564005d8dd0 2024-09-18T02:04:21.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564005e0470 con 0x5564005d8dd0 2024-09-18T02:04:21.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f8559ffb640 1 -- 172.21.15.167:0/2325697212 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86740e3880 con 0x5564005d8dd0 2024-09-18T02:04:21.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f8559ffb640 1 -- 172.21.15.167:0/2325697212 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740e3b80 con 0x5564005d8dd0 2024-09-18T02:04:21.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564005e08e0 con 0x5564005d8dd0 2024-09-18T02:04:21.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f8559ffb640 1 -- 172.21.15.167:0/2325697212 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86740fa070 con 0x5564005d8dd0 2024-09-18T02:04:21.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f8559ffb640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f854c034650 0x7f854c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f8559ffb640 1 -- 172.21.15.167:0/2325697212 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f86740e0210 con 0x5564005d8dd0 2024-09-18T02:04:21.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867bfa6640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f854c034650 0x7f854c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867ec97980 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5564005eaeb0 0x5564005ed350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005edaa0 con 0x5564005eaeb0 2024-09-18T02:04:21.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.188+0000 7f867cfa8640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5564005eaeb0 0x5564005ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867bfa6640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f854c034650 0x7f854c036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f866400ffd0 tx=0x7f8664010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867cfa8640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5564005eaeb0 0x5564005ed350 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f866c0083f0 con 0x5564005eaeb0 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 20 realm 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005edf00 con 0x5564005eaeb0 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f866c0083f0 con 0x5564005eaeb0 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005ee7a0 con 0x5564005eaeb0 2024-09-18T02:04:21.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f866c0083f0 con 0x5564005eaeb0 2024-09-18T02:04:21.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005eaeb0 2024-09-18T02:04:21.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f866c0083f0 con 0x5564005eaeb0 2024-09-18T02:04:21.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:21.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5564005ef8a0 0x5564005f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005f21d0 con 0x5564005ef8a0 2024-09-18T02:04:21.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867c7a7640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5564005ef8a0 0x5564005f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867c7a7640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5564005ef8a0 0x5564005f1c90 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:21.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 20 searching for the correct realm 2024-09-18T02:04:21.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5564005f4120 0x5564005f65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005f6cb0 con 0x5564005f4120 2024-09-18T02:04:21.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867bfa6640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5564005f4120 0x5564005f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.192+0000 7f867bfa6640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5564005f4120 0x5564005f65e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867bfa6640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f866401fbe0 0x7f866403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005f6cb0 con 0x7f866401fbe0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867cfa8640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f866401fbe0 0x7f866403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867cfa8640 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f866401fbe0 0x7f866403a3c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c0083f0 con 0x7f866401fbe0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005ef8a0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005eaeb0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c0083f0 con 0x5564005eaeb0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005eaeb0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005ef8a0 2024-09-18T02:04:21.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005ef8a0 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x7f866401fbe0 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005f4120 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.196+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005eaeb0 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005ef8a0 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005eaeb0 2024-09-18T02:04:21.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x7f866401fbe0 2024-09-18T02:04:21.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005f4120 2024-09-18T02:04:21.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005f4120 2024-09-18T02:04:21.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005ef8a0 2024-09-18T02:04:21.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005f4120 2024-09-18T02:04:21.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005f4120 2024-09-18T02:04:21.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005eaeb0 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005eaeb0 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.200+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005ef8a0 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005f4120 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x7f866401fbe0 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005eaeb0 2024-09-18T02:04:21.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005ef8a0 2024-09-18T02:04:21.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005f4120 2024-09-18T02:04:21.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005ef8a0 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x7f866401fbe0 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005f4120 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.204+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005ef8a0 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x5564005eaeb0 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564005eeb40 con 0x7f866401fbe0 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:21.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005f2a20 con 0x5564005eaeb0 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005f2a20 con 0x5564005eaeb0 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005f2a20 con 0x5564005f4120 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 zone default found 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 4 Realm: () 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 zonegroup default 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005f32c0 con 0x5564005ef8a0 2024-09-18T02:04:21.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005f8b10 con 0x5564005f4120 2024-09-18T02:04:21.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564005f8eb0 con 0x5564005f4120 2024-09-18T02:04:21.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 started sync module instance, tier type = 2024-09-18T02:04:21.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:21.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.208+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005f7fb0 con 0x7f866401fbe0 2024-09-18T02:04:21.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.212+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.212+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93887991350448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005f7fb0 con 0x7f866401fbe0 2024-09-18T02:04:21.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.212+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005f98f0 con 0x5564005eaeb0 2024-09-18T02:04:21.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.212+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93887991350448] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.212+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.212+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93887991354304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005f7fb0 con 0x5564005eaeb0 2024-09-18T02:04:21.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.212+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005fa300 con 0x5564005f4120 2024-09-18T02:04:21.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.216+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93887991354304] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.216+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.216+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93887991347968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005f7f20 con 0x5564005f4120 2024-09-18T02:04:21.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.216+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005fb090 con 0x7f866401fbe0 2024-09-18T02:04:21.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.216+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.216+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93887991360416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005fb930 con 0x7f866401fbe0 2024-09-18T02:04:21.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.216+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005fc330 con 0x5564005eaeb0 2024-09-18T02:04:21.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.216+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93887991347968] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.220+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93887991360416] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.220+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.220+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93887991359216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005fb400 con 0x5564005eaeb0 2024-09-18T02:04:21.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.220+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005fcbd0 con 0x5564005ef8a0 2024-09-18T02:04:21.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.220+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.220+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93887991367456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005fb400 con 0x5564005ef8a0 2024-09-18T02:04:21.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.220+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005fd910 con 0x5564005ef8a0 2024-09-18T02:04:21.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.220+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93887991359216] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.224+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93887991367456] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.224+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.224+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93887991369584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005fdcb0 con 0x5564005ef8a0 2024-09-18T02:04:21.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.224+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005fe540 con 0x5564005ef8a0 2024-09-18T02:04:21.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93887991369584] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93887991370640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005fe720 con 0x5564005ef8a0 2024-09-18T02:04:21.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 20 add_watcher() i=0 2024-09-18T02:04:21.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 20 add_watcher() i=1 2024-09-18T02:04:21.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 20 add_watcher() i=2 2024-09-18T02:04:21.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 20 add_watcher() i=3 2024-09-18T02:04:21.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 20 add_watcher() i=4 2024-09-18T02:04:21.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 20 add_watcher() i=5 2024-09-18T02:04:21.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 20 add_watcher() i=6 2024-09-18T02:04:21.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93887991370640] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 20 add_watcher() i=7 2024-09-18T02:04:21.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:21.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556400601af0 con 0x5564005eaeb0 2024-09-18T02:04:21.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.228+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93887991375376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564005feee0 con 0x5564005eaeb0 2024-09-18T02:04:21.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93887991375376] v30'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f85327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:21.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:21.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:21.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 5 note: GC not initialized 2024-09-18T02:04:21.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f85317e2640 20 reqs_thread_entry: start 2024-09-18T02:04:21.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:21.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 Filter name: none 2024-09-18T02:04:21.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f84a2ffd640 20 reqs_thread_entry: start 2024-09-18T02:04:21.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556400624af0 con 0x5564005eaeb0 2024-09-18T02:04:21.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:21.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564006254e0 con 0x5564005eaeb0 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564006264f0 con 0x7f866401fbe0 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556400623da0 con 0x7f866401fbe0 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564006264b0 con 0x5564005f4120 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:67 4.24 4:2438aa61:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556400625f80 con 0x5564005ef8a0 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 4.29 4:9642b720:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55640062afc0 con 0x5564005f4120 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 4.f 4:f090116b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55640062db80 con 0x5564005eaeb0 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:70 4.29 4:949287a7:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564006304f0 con 0x5564005f4120 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 4.5 4:a2069307:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564006304f0 con 0x5564005f4120 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 4.2d 4:b5ed9a3b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556400635500 con 0x5564005ef8a0 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 4.16 4:680d0d24:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556400638240 con 0x5564005f4120 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:74 4.9 4:9363ad15:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55640063ac50 con 0x5564005eaeb0 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 4.24 4:24630749:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55640063da60 con 0x5564005ef8a0 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.232+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 4.3 4:c118e1af:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556400640820 con 0x5564005eaeb0 2024-09-18T02:04:21.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:77 4.36 4:6d2a8929:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564006432a0 con 0x5564005eaeb0 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(69 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(68 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(74 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(77 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(73 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(67 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(71 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(72 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(70 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(75 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f85327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:21.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93887991375376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564006432a0 con 0x5564005eaeb0 2024-09-18T02:04:21.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93887991375376] v30'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.236+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93887991350448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564006157d0 con 0x7f866401fbe0 2024-09-18T02:04:21.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.240+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93887991350448] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.240+0000 7f867ec97980 20 remove_watcher() i=0 2024-09-18T02:04:21.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.240+0000 7f867ec97980 2 removed watcher, disabling cache 2024-09-18T02:04:21.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.240+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93887991354304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564006157d0 con 0x5564005eaeb0 2024-09-18T02:04:21.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.240+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93887991354304] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.240+0000 7f867ec97980 20 remove_watcher() i=1 2024-09-18T02:04:21.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.240+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93887991347968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564006157d0 con 0x5564005f4120 2024-09-18T02:04:21.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.244+0000 7f867bfa6640 1 -- 172.21.15.167:0/2325697212 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93887991347968] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664037040 con 0x5564005f4120 2024-09-18T02:04:21.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.244+0000 7f867ec97980 20 remove_watcher() i=2 2024-09-18T02:04:21.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.244+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93887991360416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564006157d0 con 0x7f866401fbe0 2024-09-18T02:04:21.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.244+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93887991360416] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x7f866401fbe0 2024-09-18T02:04:21.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.244+0000 7f867ec97980 20 remove_watcher() i=3 2024-09-18T02:04:21.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.244+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93887991359216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564006157d0 con 0x5564005eaeb0 2024-09-18T02:04:21.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.244+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93887991359216] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c026040 con 0x5564005eaeb0 2024-09-18T02:04:21.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.244+0000 7f867ec97980 20 remove_watcher() i=4 2024-09-18T02:04:21.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.244+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93887991367456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564006157d0 con 0x5564005ef8a0 2024-09-18T02:04:21.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.248+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93887991367456] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.248+0000 7f867ec97980 20 remove_watcher() i=5 2024-09-18T02:04:21.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.248+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93887991369584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564006157d0 con 0x5564005ef8a0 2024-09-18T02:04:21.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.248+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93887991369584] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.248+0000 7f867ec97980 20 remove_watcher() i=6 2024-09-18T02:04:21.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.248+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93887991370640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564006157d0 con 0x5564005ef8a0 2024-09-18T02:04:21.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867c7a7640 1 -- 172.21.15.167:0/2325697212 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93887991370640] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86740f9030 con 0x5564005ef8a0 2024-09-18T02:04:21.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 20 remove_watcher() i=7 2024-09-18T02:04:21.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5564005ef8a0 msgr2=0x5564005f1c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5564005ef8a0 0x5564005f1c90 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5564005eaeb0 msgr2=0x5564005ed350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5564005eaeb0 0x5564005ed350 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f866401fbe0 msgr2=0x7f866403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f866401fbe0 0x7f866403a3c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5564005f4120 msgr2=0x5564005f65e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5564005f4120 0x5564005f65e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f854c034650 msgr2=0x7f854c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f854c034650 0x7f854c036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f866400ffd0 tx=0x7f8664010000 comp rx=0 tx=0).stop 2024-09-18T02:04:21.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 msgr2=0x5564005dff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867cfa8640 1 -- 172.21.15.167:0/2325697212 reap_dead start 2024-09-18T02:04:21.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005dff30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f86740c6410 tx=0x7f86740b3ee0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 shutdown_connections 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/2325697212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005d8dd0 0x5564005dff30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 >> 172.21.15.167:0/2325697212 conn(0x5564005d5150 msgr2=0x5564005d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 shutdown_connections 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/2325697212 wait complete. 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/1464849370 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8554034650 msgr2=0x7f8554036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/1464849370 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8554034650 0x7f8554036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5564005b6080 tx=0x7f866400f000 comp rx=0 tx=0).stop 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/1464849370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005cc440 msgr2=0x5564005cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/1464849370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005cc440 0x5564005cc860 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f86740b4f20 tx=0x7f86740bd400 comp rx=0 tx=0).stop 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/1464849370 shutdown_connections 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/1464849370 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8554034650 0x7f8554036b10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/1464849370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564005cc440 0x5564005cc860 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/1464849370 >> 172.21.15.167:0/1464849370 conn(0x5564005c1590 msgr2=0x5564005c4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/1464849370 shutdown_connections 2024-09-18T02:04:21.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/1464849370 wait complete. 2024-09-18T02:04:21.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5564005b7f00 msgr2=0x5564005ba2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5564005b7f00 0x5564005ba2f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5564005b31e0 msgr2=0x5564005b55d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5564005b31e0 0x5564005b55d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5564005bbe40 msgr2=0x5564005be230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5564005bbe40 0x5564005be230 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8564034650 msgr2=0x7f8564036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8564034650 0x7f8564036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8664000f70 tx=0x7f8664001380 comp rx=0 tx=0).stop 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564004bc870 msgr2=0x5564005ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 --2- 172.21.15.167:0/750418673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564004bc870 0x5564005ae0f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f867401aec0 tx=0x7f8674017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867cfa8640 1 -- 172.21.15.167:0/750418673 reap_dead start 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 shutdown_connections 2024-09-18T02:04:21.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 >> 172.21.15.167:0/750418673 conn(0x5564004b4060 msgr2=0x5564004b8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 shutdown_connections 2024-09-18T02:04:21.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.252+0000 7f867ec97980 1 -- 172.21.15.167:0/750418673 wait complete. 2024-09-18T02:04:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b6f58232-12d9-447d-8d4f-091dad0fc7cc","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","marker":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T02:04:20.265935Z","creation_time":"2024-09-18T02:04:20.260735Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-18T02:04:21.268 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b6f58232-12d9-447d-8d4f-091dad0fc7cc', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'marker': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T02:04:20.265935Z', 'creation_time': '2024-09-18T02:04:20.260735Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-18T02:04:21.277 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T02:04:21.277 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T02:04:21.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T02:04:21.277 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-18T02:04:21.345 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:21.345 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:21.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.344+0000 7f874ae37980 1 Processor -- start 2024-09-18T02:04:21.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.344+0000 7f874ae37980 1 -- start start 2024-09-18T02:04:21.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.344+0000 7f874ae37980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55b3fbd32290 0x55b3fbdc27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.344+0000 7f874ae37980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b3fbc45ae0 con 0x55b3fbdc2ce0 2024-09-18T02:04:21.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.344+0000 7f874ae37980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55b3fbc69e30 con 0x55b3fbd32290 2024-09-18T02:04:21.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.344+0000 7f8748947640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55b3fbd32290 0x55b3fbdc27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.344+0000 7f8743fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55b3fbdc2ce0 0x55b3fbdc50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55596/0 (socket says 172.21.15.167:55596) 2024-09-18T02:04:21.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.344+0000 7f8743fff640 1 -- 172.21.15.167:0/1215223778 learned_addr learned my addr 172.21.15.167:0/1215223778 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:21.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.344+0000 7f8748947640 1 -- 172.21.15.167:0/1215223778 >> v1:172.21.15.81:6789/0 conn(0x55b3fbdc2ce0 legacy=0x55b3fbdc50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.344+0000 7f8748947640 1 -- 172.21.15.167:0/1215223778 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3fbd32670 con 0x55b3fbd32290 2024-09-18T02:04:21.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.348+0000 7f8748947640 1 --2- 172.21.15.167:0/1215223778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbdc27a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f873c00a480 tx=0x7f873c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639690a4558b69cd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.348+0000 7f87437fe640 1 -- 172.21.15.167:0/1215223778 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c0b0070 con 0x55b3fbd32290 2024-09-18T02:04:21.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.348+0000 7f87437fe640 1 -- 172.21.15.167:0/1215223778 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c0ab540 con 0x55b3fbd32290 2024-09-18T02:04:21.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.348+0000 7f87437fe640 1 -- 172.21.15.167:0/1215223778 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c0ab840 con 0x55b3fbd32290 2024-09-18T02:04:21.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.348+0000 7f874ae37980 1 -- 172.21.15.167:0/1215223778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 msgr2=0x55b3fbdc27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.348+0000 7f874ae37980 1 --2- 172.21.15.167:0/1215223778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbdc27a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f873c00a480 tx=0x7f873c01b280 comp rx=0 tx=0).stop 2024-09-18T02:04:21.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.348+0000 7f874ae37980 1 -- 172.21.15.167:0/1215223778 shutdown_connections 2024-09-18T02:04:21.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.348+0000 7f874ae37980 1 --2- 172.21.15.167:0/1215223778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbdc27a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.348+0000 7f874ae37980 1 -- 172.21.15.167:0/1215223778 >> 172.21.15.167:0/1215223778 conn(0x55b3fbdb8090 msgr2=0x55b3fbdba4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.348+0000 7f874ae37980 1 -- 172.21.15.167:0/1215223778 shutdown_connections 2024-09-18T02:04:21.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.348+0000 7f874ae37980 1 -- 172.21.15.167:0/1215223778 wait complete. 2024-09-18T02:04:21.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f874ae37980 1 Processor -- start 2024-09-18T02:04:21.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f874ae37980 1 -- start start 2024-09-18T02:04:21.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f874ae37980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbeaacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f874ae37980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b3fbc6b200 con 0x55b3fbd32290 2024-09-18T02:04:21.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f8748947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbeaacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f8748947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbeaacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57168/0 (socket says 172.21.15.167:57168) 2024-09-18T02:04:21.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f8748947640 1 -- 172.21.15.167:0/1677450160 learned_addr learned my addr 172.21.15.167:0/1677450160 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f8748947640 1 -- 172.21.15.167:0/1677450160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3fbeab280 con 0x55b3fbd32290 2024-09-18T02:04:21.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f8748947640 1 --2- 172.21.15.167:0/1677450160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbeaacb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f873c017e90 tx=0x7f873c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32053c07233ba5a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f8636e05640 1 -- 172.21.15.167:0/1677450160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c0b0070 con 0x55b3fbd32290 2024-09-18T02:04:21.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f8636e05640 1 -- 172.21.15.167:0/1677450160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c0b1040 con 0x55b3fbd32290 2024-09-18T02:04:21.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f8636e05640 1 -- 172.21.15.167:0/1677450160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c0ab6f0 con 0x55b3fbd32290 2024-09-18T02:04:21.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f874ae37980 1 -- 172.21.15.167:0/1677450160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 msgr2=0x55b3fbeaacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f874ae37980 1 --2- 172.21.15.167:0/1677450160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbeaacb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f873c017e90 tx=0x7f873c003030 comp rx=0 tx=0).stop 2024-09-18T02:04:21.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f874ae37980 1 -- 172.21.15.167:0/1677450160 shutdown_connections 2024-09-18T02:04:21.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f874ae37980 1 --2- 172.21.15.167:0/1677450160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbeaacb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.364+0000 7f874ae37980 1 -- 172.21.15.167:0/1677450160 >> 172.21.15.167:0/1677450160 conn(0x55b3fbdb8090 msgr2=0x55b3fbea68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f874ae37980 1 -- 172.21.15.167:0/1677450160 shutdown_connections 2024-09-18T02:04:21.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f874ae37980 1 -- 172.21.15.167:0/1677450160 wait complete. 2024-09-18T02:04:21.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f874ae37980 1 Processor -- start 2024-09-18T02:04:21.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f874ae37980 1 -- start start 2024-09-18T02:04:21.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f874ae37980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbeb1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f874ae37980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b3fbdc9220 con 0x55b3fbd32290 2024-09-18T02:04:21.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8748947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbeb1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8748947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbeb1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57180/0 (socket says 172.21.15.167:57180) 2024-09-18T02:04:21.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8748947640 1 -- 172.21.15.167:0/695082018 learned_addr learned my addr 172.21.15.167:0/695082018 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8748947640 1 -- 172.21.15.167:0/695082018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3fbeb23e0 con 0x55b3fbd32290 2024-09-18T02:04:21.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8748947640 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbeb1ea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f873c017e90 tx=0x7f873c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8635602640 1 -- 172.21.15.167:0/695082018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c0b7480 con 0x55b3fbd32290 2024-09-18T02:04:21.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3fbeb2670 con 0x55b3fbd32290 2024-09-18T02:04:21.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8635602640 1 -- 172.21.15.167:0/695082018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c0b7620 con 0x55b3fbd32290 2024-09-18T02:04:21.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8635602640 1 -- 172.21.15.167:0/695082018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c0b7900 con 0x55b3fbd32290 2024-09-18T02:04:21.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3fbeb5350 con 0x55b3fbd32290 2024-09-18T02:04:21.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8635602640 1 -- 172.21.15.167:0/695082018 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f873c0b7af0 con 0x55b3fbd32290 2024-09-18T02:04:21.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8635602640 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8630034650 0x7f8630036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8635602640 1 -- 172.21.15.167:0/695082018 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f873c0bc070 con 0x55b3fbd32290 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f8743fff640 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8630034650 0x7f8630036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f874ae37980 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b3fbdc2ce0 0x55b3fbeb8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.368+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbeb9450 con 0x55b3fbdc2ce0 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f8749148640 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b3fbdc2ce0 0x55b3fbeb8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f8743fff640 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8630034650 0x7f8630036b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8734000f70 tx=0x7f87340012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f8749148640 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b3fbdc2ce0 0x55b3fbeb8e30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f8749148640 1 -- 172.21.15.167:0/695082018 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbdc2ce0 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbeb6570 con 0x55b3fbdc2ce0 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f8749148640 1 -- 172.21.15.167:0/695082018 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbdc2ce0 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f874ae37980 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b3fbebb7a0 0x55b3fbebdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbebe260 con 0x55b3fbebb7a0 2024-09-18T02:04:21.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f8748947640 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b3fbebb7a0 0x55b3fbebdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f8748947640 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b3fbebb7a0 0x55b3fbebdb90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f8748947640 1 -- 172.21.15.167:0/695082018 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f873c0d1070 con 0x55b3fbebb7a0 2024-09-18T02:04:21.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbeba610 con 0x55b3fbdc2ce0 2024-09-18T02:04:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f8749148640 1 -- 172.21.15.167:0/695082018 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbdc2ce0 2024-09-18T02:04:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f874ae37980 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b3fbebf6a0 0x55b3fbec1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbec2200 con 0x55b3fbebf6a0 2024-09-18T02:04:21.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.372+0000 7f8743fff640 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b3fbebf6a0 0x55b3fbec1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f8743fff640 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b3fbebf6a0 0x55b3fbec1a90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f8743fff640 1 -- 172.21.15.167:0/695082018 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbebf6a0 2024-09-18T02:04:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f874ae37980 1 Processor -- start 2024-09-18T02:04:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f874ae37980 1 -- start start 2024-09-18T02:04:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f874ae37980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbecfc70 0x55b3fbed0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f874ae37980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b3fbcc4800 con 0x55b3fbecfc70 2024-09-18T02:04:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f8748947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbecfc70 0x55b3fbed0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f8748947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbecfc70 0x55b3fbed0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57182/0 (socket says 172.21.15.167:57182) 2024-09-18T02:04:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f8748947640 1 -- 172.21.15.167:0/3450599635 learned_addr learned my addr 172.21.15.167:0/3450599635 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f8748947640 1 -- 172.21.15.167:0/3450599635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3fbed05d0 con 0x55b3fbecfc70 2024-09-18T02:04:21.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f8748947640 1 --2- 172.21.15.167:0/3450599635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbecfc70 0x55b3fbed0090 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f873c0e33c0 tx=0x7f873c0d73b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f862e7fc640 1 -- 172.21.15.167:0/3450599635 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c0e9070 con 0x55b3fbecfc70 2024-09-18T02:04:21.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f874ae37980 1 -- 172.21.15.167:0/3450599635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3fbed0860 con 0x55b3fbecfc70 2024-09-18T02:04:21.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f862e7fc640 1 -- 172.21.15.167:0/3450599635 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c0bede0 con 0x55b3fbecfc70 2024-09-18T02:04:21.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f862e7fc640 1 -- 172.21.15.167:0/3450599635 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c0aa520 con 0x55b3fbecfc70 2024-09-18T02:04:21.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f874ae37980 1 -- 172.21.15.167:0/3450599635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3fbed34e0 con 0x55b3fbecfc70 2024-09-18T02:04:21.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f862e7fc640 1 -- 172.21.15.167:0/3450599635 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f873c0ec070 con 0x55b3fbecfc70 2024-09-18T02:04:21.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f862e7fc640 1 --2- 172.21.15.167:0/3450599635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8620034650 0x7f8620036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.376+0000 7f862e7fc640 1 -- 172.21.15.167:0/3450599635 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f873c0da030 con 0x55b3fbecfc70 2024-09-18T02:04:21.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f8743fff640 1 --2- 172.21.15.167:0/3450599635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8620034650 0x7f8620036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 Processor -- start 2024-09-18T02:04:21.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 -- start start 2024-09-18T02:04:21.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f8743fff640 1 --2- 172.21.15.167:0/3450599635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8620034650 0x7f8620036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f873400bf60 tx=0x7f873400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbedc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b3fbeab540 con 0x55b3fbedc5c0 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f8748947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbedc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f8748947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbedc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57186/0 (socket says 172.21.15.167:57186) 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f8748947640 1 -- 172.21.15.167:0/4086608096 learned_addr learned my addr 172.21.15.167:0/4086608096 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f8748947640 1 -- 172.21.15.167:0/4086608096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3fbedcf90 con 0x55b3fbedc5c0 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f8748947640 1 --2- 172.21.15.167:0/4086608096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbedc9c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f873c0b7ac0 tx=0x7f873c0d7930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4404d9a224f964f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f861ffff640 1 -- 172.21.15.167:0/4086608096 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c102070 con 0x55b3fbedc5c0 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f861ffff640 1 -- 172.21.15.167:0/4086608096 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c0020c0 con 0x55b3fbedc5c0 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f861ffff640 1 -- 172.21.15.167:0/4086608096 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c0f9040 con 0x55b3fbedc5c0 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 -- 172.21.15.167:0/4086608096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 msgr2=0x55b3fbedc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 --2- 172.21.15.167:0/4086608096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbedc9c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f873c0b7ac0 tx=0x7f873c0d7930 comp rx=0 tx=0).stop 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 -- 172.21.15.167:0/4086608096 shutdown_connections 2024-09-18T02:04:21.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 --2- 172.21.15.167:0/4086608096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbedc9c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 -- 172.21.15.167:0/4086608096 >> 172.21.15.167:0/4086608096 conn(0x55b3fbed89f0 msgr2=0x55b3fbed6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 -- 172.21.15.167:0/4086608096 shutdown_connections 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 -- 172.21.15.167:0/4086608096 wait complete. 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 Processor -- start 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 -- start start 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbee3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f874ae37980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b3fbedd460 con 0x55b3fbedc5c0 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f8748947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbee3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f8748947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbee3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57194/0 (socket says 172.21.15.167:57194) 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.380+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 learned_addr learned my addr 172.21.15.167:0/1709601675 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3fbee3cd0 con 0x55b3fbedc5c0 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f8748947640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbee3790 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f873c0b7ac0 tx=0x7f873c002290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f861e7fc640 1 -- 172.21.15.167:0/1709601675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c102070 con 0x55b3fbedc5c0 2024-09-18T02:04:21.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3fbee3cd0 con 0x55b3fbedc5c0 2024-09-18T02:04:21.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f861e7fc640 1 -- 172.21.15.167:0/1709601675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c103040 con 0x55b3fbedc5c0 2024-09-18T02:04:21.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f861e7fc640 1 -- 172.21.15.167:0/1709601675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c0e4b30 con 0x55b3fbedc5c0 2024-09-18T02:04:21.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3fbee4140 con 0x55b3fbedc5c0 2024-09-18T02:04:21.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f861e7fc640 1 -- 172.21.15.167:0/1709601675 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f873c10e020 con 0x55b3fbedc5c0 2024-09-18T02:04:21.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f861e7fc640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8614034650 0x7f8614036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f861e7fc640 1 -- 172.21.15.167:0/1709601675 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f873c10c020 con 0x55b3fbedc5c0 2024-09-18T02:04:21.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f8743fff640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8614034650 0x7f8614036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b3fbeee720 0x55b3fbef0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef1310 con 0x55b3fbeee720 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f8749148640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b3fbeee720 0x55b3fbef0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f8743fff640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8614034650 0x7f8614036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55b3fbec25e0 tx=0x7f8734010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f8749148640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b3fbeee720 0x55b3fbef0bc0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 20 realm 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef1720 con 0x55b3fbeee720 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.384+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef1fc0 con 0x55b3fbeee720 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f874ae37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbeee720 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f874ae37980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f874ae37980 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b3fbef30c0 0x55b3fbef54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef5a30 con 0x55b3fbef30c0 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8748947640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b3fbef30c0 0x55b3fbef54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8748947640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b3fbef30c0 0x55b3fbef54b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f874ae37980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f874ae37980 20 searching for the correct realm 2024-09-18T02:04:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f874ae37980 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b3fbef7960 0x55b3fbef9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbefa4c0 con 0x55b3fbef7960 2024-09-18T02:04:21.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8743fff640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b3fbef7960 0x55b3fbef9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8743fff640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b3fbef7960 0x55b3fbef9df0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8743fff640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f8734037040 0x7f8734036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbefa4c0 con 0x7f8734037040 2024-09-18T02:04:21.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8749148640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f8734037040 0x7f8734036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8749148640 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f8734037040 0x7f8734036410 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.388+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef30c0 2024-09-18T02:04:21.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbeee720 2024-09-18T02:04:21.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbeee720 2024-09-18T02:04:21.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef30c0 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef30c0 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x7f8734037040 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef7960 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbeee720 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef30c0 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.392+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbeee720 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x7f8734037040 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef7960 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef7960 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef30c0 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef7960 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef7960 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbeee720 2024-09-18T02:04:21.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbeee720 2024-09-18T02:04:21.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef30c0 2024-09-18T02:04:21.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.396+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef7960 2024-09-18T02:04:21.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x7f8734037040 2024-09-18T02:04:21.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbeee720 2024-09-18T02:04:21.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef30c0 2024-09-18T02:04:21.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef7960 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef30c0 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x7f8734037040 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef7960 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbef30c0 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x55b3fbeee720 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.400+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef2360 con 0x7f8734037040 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef6280 con 0x55b3fbeee720 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef6280 con 0x55b3fbeee720 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef6280 con 0x55b3fbef7960 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 zone default found 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 4 Realm: () 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 zonegroup default 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbef6b20 con 0x55b3fbef30c0 2024-09-18T02:04:21.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbefc320 con 0x55b3fbef7960 2024-09-18T02:04:21.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbefc6c0 con 0x55b3fbef7960 2024-09-18T02:04:21.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 started sync module instance, tier type = 2024-09-18T02:04:21.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:21.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.404+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbefb7c0 con 0x7f8734037040 2024-09-18T02:04:21.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.408+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.408+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94231514299616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbefb7c0 con 0x7f8734037040 2024-09-18T02:04:21.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.408+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbefd0e0 con 0x55b3fbeee720 2024-09-18T02:04:21.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.408+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94231514299616] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.408+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.408+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94231514303440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbefb7c0 con 0x55b3fbeee720 2024-09-18T02:04:21.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.408+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbefdaf0 con 0x55b3fbef7960 2024-09-18T02:04:21.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.412+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.412+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94231514306112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbefe340 con 0x55b3fbef7960 2024-09-18T02:04:21.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.412+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbefed40 con 0x7f8734037040 2024-09-18T02:04:21.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.412+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94231514303440] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.412+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.412+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94231514297104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbeff130 con 0x7f8734037040 2024-09-18T02:04:21.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.412+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbeffaf0 con 0x55b3fbeee720 2024-09-18T02:04:21.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.412+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94231514306112] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.412+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94231514297104] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.416+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.416+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94231514310736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbeff640 con 0x55b3fbeee720 2024-09-18T02:04:21.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.416+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbeffe90 con 0x55b3fbef30c0 2024-09-18T02:04:21.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.416+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94231514310736] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.416+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.416+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94231514314304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbeffa60 con 0x55b3fbef30c0 2024-09-18T02:04:21.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.416+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf00b90 con 0x55b3fbef30c0 2024-09-18T02:04:21.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.420+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.420+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94231514314304] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.420+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94231514319072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf002f0 con 0x55b3fbef30c0 2024-09-18T02:04:21.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.420+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf01960 con 0x55b3fbef30c0 2024-09-18T02:04:21.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94231514319072] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94231514322000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf01920 con 0x55b3fbef30c0 2024-09-18T02:04:21.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 20 add_watcher() i=0 2024-09-18T02:04:21.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 20 add_watcher() i=1 2024-09-18T02:04:21.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 20 add_watcher() i=2 2024-09-18T02:04:21.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 20 add_watcher() i=3 2024-09-18T02:04:21.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 20 add_watcher() i=4 2024-09-18T02:04:21.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 20 add_watcher() i=5 2024-09-18T02:04:21.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 20 add_watcher() i=6 2024-09-18T02:04:21.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94231514322000] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 20 add_watcher() i=7 2024-09-18T02:04:21.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:21.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf04db0 con 0x55b3fbeee720 2024-09-18T02:04:21.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94231514320256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf022d0 con 0x55b3fbeee720 2024-09-18T02:04:21.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94231514320256] v30'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f85fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.424+0000 7f874ae37980 5 note: GC not initialized 2024-09-18T02:04:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f85fdfe3640 20 reqs_thread_entry: start 2024-09-18T02:04:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 Filter name: none 2024-09-18T02:04:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f856f7fe640 20 reqs_thread_entry: start 2024-09-18T02:04:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf284a0 con 0x7f8734037040 2024-09-18T02:04:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:63 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf28d30 con 0x55b3fbef7960 2024-09-18T02:04:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(63 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T02:04:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf27840 con 0x7f8734037040 2024-09-18T02:04:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:65 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf2a360 con 0x55b3fbef7960 2024-09-18T02:04:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(65 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T02:04:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:66 4.24 4:2438aa61:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf29d00 con 0x55b3fbef30c0 2024-09-18T02:04:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 4.29 4:9642b720:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf2ea50 con 0x55b3fbef7960 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 4.f 4:f090116b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf31530 con 0x55b3fbeee720 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 4.29 4:949287a7:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf33da0 con 0x55b3fbef7960 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:70 4.5 4:a2069307:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf368e0 con 0x55b3fbef7960 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 4.2d 4:b5ed9a3b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf396f0 con 0x55b3fbef30c0 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:72 4.16 4:680d0d24:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf368e0 con 0x55b3fbef7960 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:73 4.9 4:9363ad15:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf3e430 con 0x55b3fbeee720 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 4.24 4:24630749:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf40ff0 con 0x55b3fbef30c0 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 4.3 4:c118e1af:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf43af0 con 0x55b3fbeee720 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 4.36 4:6d2a8929:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf46780 con 0x55b3fbeee720 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(67 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(70 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(69 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(72 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(68 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(75 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(66 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(73 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(71 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(76 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.428+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(74 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.432+0000 7f85fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.432+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94231514320256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf25e80 con 0x55b3fbeee720 2024-09-18T02:04:21.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.432+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94231514320256] v30'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.432+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94231514299616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf25e80 con 0x7f8734037040 2024-09-18T02:04:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.432+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94231514299616] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.432+0000 7f874ae37980 20 remove_watcher() i=0 2024-09-18T02:04:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.432+0000 7f874ae37980 2 removed watcher, disabling cache 2024-09-18T02:04:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.432+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94231514303440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf25e80 con 0x55b3fbeee720 2024-09-18T02:04:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.436+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94231514303440] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.436+0000 7f874ae37980 20 remove_watcher() i=1 2024-09-18T02:04:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.436+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94231514306112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf25e80 con 0x55b3fbef7960 2024-09-18T02:04:21.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.436+0000 7f8743fff640 1 -- 172.21.15.167:0/1709601675 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94231514306112] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873400e620 con 0x55b3fbef7960 2024-09-18T02:04:21.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.436+0000 7f874ae37980 20 remove_watcher() i=2 2024-09-18T02:04:21.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.436+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94231514297104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf25e80 con 0x7f8734037040 2024-09-18T02:04:21.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.440+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94231514297104] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f8734037040 2024-09-18T02:04:21.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.440+0000 7f874ae37980 20 remove_watcher() i=3 2024-09-18T02:04:21.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.440+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94231514310736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf25e80 con 0x55b3fbeee720 2024-09-18T02:04:21.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.440+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94231514310736] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55b3fbeee720 2024-09-18T02:04:21.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.440+0000 7f874ae37980 20 remove_watcher() i=4 2024-09-18T02:04:21.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.440+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94231514314304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf25e80 con 0x55b3fbef30c0 2024-09-18T02:04:21.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.444+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94231514314304] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.444+0000 7f874ae37980 20 remove_watcher() i=5 2024-09-18T02:04:21.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.444+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94231514319072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf25e80 con 0x55b3fbef30c0 2024-09-18T02:04:21.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.444+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94231514319072] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.444+0000 7f874ae37980 20 remove_watcher() i=6 2024-09-18T02:04:21.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.444+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94231514322000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b3fbf25e80 con 0x55b3fbef30c0 2024-09-18T02:04:21.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f8748947640 1 -- 172.21.15.167:0/1709601675 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94231514322000] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c105070 con 0x55b3fbef30c0 2024-09-18T02:04:21.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 20 remove_watcher() i=7 2024-09-18T02:04:21.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b3fbef30c0 msgr2=0x55b3fbef54b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b3fbef30c0 0x55b3fbef54b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b3fbeee720 msgr2=0x55b3fbef0bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b3fbeee720 0x55b3fbef0bc0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f8734037040 msgr2=0x7f8734036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f8734037040 0x7f8734036410 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b3fbef7960 msgr2=0x55b3fbef9df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b3fbef7960 0x55b3fbef9df0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8614034650 msgr2=0x7f8614036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8614034650 0x7f8614036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55b3fbec25e0 tx=0x7f8734010000 comp rx=0 tx=0).stop 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 msgr2=0x55b3fbee3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f8749148640 1 -- 172.21.15.167:0/1709601675 reap_dead start 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbee3790 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f873c0b7ac0 tx=0x7f873c002290 comp rx=0 tx=0).stop 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 shutdown_connections 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/1709601675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbedc5c0 0x55b3fbee3790 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 >> 172.21.15.167:0/1709601675 conn(0x55b3fbed89f0 msgr2=0x55b3fbed6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 shutdown_connections 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/1709601675 wait complete. 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/3450599635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8620034650 msgr2=0x7f8620036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/3450599635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8620034650 0x7f8620036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f873400bf60 tx=0x7f873400f000 comp rx=0 tx=0).stop 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/3450599635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbecfc70 msgr2=0x55b3fbed0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/3450599635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbecfc70 0x55b3fbed0090 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f873c0e33c0 tx=0x7f873c0d73b0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/3450599635 shutdown_connections 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/3450599635 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8620034650 0x7f8620036b10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/3450599635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbecfc70 0x55b3fbed0090 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/3450599635 >> 172.21.15.167:0/3450599635 conn(0x55b3fbec4dc0 msgr2=0x55b3fbec7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/3450599635 shutdown_connections 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/3450599635 wait complete. 2024-09-18T02:04:21.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b3fbebb7a0 msgr2=0x55b3fbebdb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55b3fbebb7a0 0x55b3fbebdb90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b3fbdc2ce0 msgr2=0x55b3fbeb8e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55b3fbdc2ce0 0x55b3fbeb8e30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b3fbebf6a0 msgr2=0x55b3fbec1a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55b3fbebf6a0 0x55b3fbec1a90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8630034650 msgr2=0x7f8630036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8630034650 0x7f8630036b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8734000f70 tx=0x7f87340012c0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 msgr2=0x55b3fbeb1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 --2- 172.21.15.167:0/695082018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3fbd32290 0x55b3fbeb1ea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f873c017e90 tx=0x7f873c018020 comp rx=0 tx=0).stop 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f8749148640 1 -- 172.21.15.167:0/695082018 reap_dead start 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 shutdown_connections 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 >> 172.21.15.167:0/695082018 conn(0x55b3fbdb8090 msgr2=0x55b3fbea5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 shutdown_connections 2024-09-18T02:04:21.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.448+0000 7f874ae37980 1 -- 172.21.15.167:0/695082018 wait complete. 2024-09-18T02:04:21.463 INFO:teuthology.orchestra.run.smithi167.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b6f58232-12d9-447d-8d4f-091dad0fc7cc","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","marker":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T02:04:20.265935Z","creation_time":"2024-09-18T02:04:20.260735Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-18T02:04:21.463 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b6f58232-12d9-447d-8d4f-091dad0fc7cc', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'marker': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T02:04:20.265935Z', 'creation_time': '2024-09-18T02:04:20.260735Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T02:04:21.463 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-18T02:04:21.463 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-18T02:04:21.464 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-18T02:04:21.546 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:21.546 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:21.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.544+0000 7f0bd5e17980 1 Processor -- start 2024-09-18T02:04:21.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.544+0000 7f0bd5e17980 1 -- start start 2024-09-18T02:04:21.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.544+0000 7f0bd5e17980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d342c98550 0x55d342c98930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.544+0000 7f0bd5e17980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d342b21ae0 con 0x55d342c98ea0 2024-09-18T02:04:21.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.544+0000 7f0bd5e17980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55d342b45e30 con 0x55d342c98550 2024-09-18T02:04:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.544+0000 7f0bd3927640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d342c98550 0x55d342c98930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.544+0000 7f0bd3126640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55d342c98ea0 0x55d342c9d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55602/0 (socket says 172.21.15.167:55602) 2024-09-18T02:04:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.544+0000 7f0bd3927640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d342c98550 0x55d342c98930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57198/0 (socket says 172.21.15.167:57198) 2024-09-18T02:04:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.544+0000 7f0bd3126640 1 -- 172.21.15.167:0/3522037425 learned_addr learned my addr 172.21.15.167:0/3522037425 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.544+0000 7f0bd3927640 1 -- 172.21.15.167:0/3522037425 >> v1:172.21.15.81:6789/0 conn(0x55d342c98ea0 legacy=0x55d342c9d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.544+0000 7f0bd3927640 1 -- 172.21.15.167:0/3522037425 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d342ca0170 con 0x55d342c98550 2024-09-18T02:04:21.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.548+0000 7f0bd3927640 1 --2- 172.21.15.167:0/3522037425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98550 0x55d342c98930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400a480 tx=0x7f0bc401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36963d82a921fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.548+0000 7f0bd2925640 1 -- 172.21.15.167:0/3522037425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40b0070 con 0x55d342c98550 2024-09-18T02:04:21.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.548+0000 7f0bd2925640 1 -- 172.21.15.167:0/3522037425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc40ab540 con 0x55d342c98550 2024-09-18T02:04:21.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.548+0000 7f0bd2925640 1 -- 172.21.15.167:0/3522037425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40ab840 con 0x55d342c98550 2024-09-18T02:04:21.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.548+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3522037425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98550 msgr2=0x55d342c98930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.548+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3522037425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98550 0x55d342c98930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400a480 tx=0x7f0bc401b280 comp rx=0 tx=0).stop 2024-09-18T02:04:21.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.548+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3522037425 shutdown_connections 2024-09-18T02:04:21.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.548+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3522037425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98550 0x55d342c98930 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.548+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3522037425 >> 172.21.15.167:0/3522037425 conn(0x55d342c94070 msgr2=0x55d342c96490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.548+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3522037425 shutdown_connections 2024-09-18T02:04:21.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.548+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3522037425 wait complete. 2024-09-18T02:04:21.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.564+0000 7f0bd5e17980 1 Processor -- start 2024-09-18T02:04:21.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.564+0000 7f0bd5e17980 1 -- start start 2024-09-18T02:04:21.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.564+0000 7f0bd5e17980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98550 0x55d342c0d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.564+0000 7f0bd5e17980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d342b47200 con 0x55d342c98550 2024-09-18T02:04:21.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.564+0000 7f0bd3927640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98550 0x55d342c0d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.564+0000 7f0bd3927640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98550 0x55d342c0d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57210/0 (socket says 172.21.15.167:57210) 2024-09-18T02:04:21.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.564+0000 7f0bd3927640 1 -- 172.21.15.167:0/2599325003 learned_addr learned my addr 172.21.15.167:0/2599325003 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.564+0000 7f0bd3927640 1 -- 172.21.15.167:0/2599325003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d342c0d9c0 con 0x55d342c98550 2024-09-18T02:04:21.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.564+0000 7f0bd3927640 1 --2- 172.21.15.167:0/2599325003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98550 0x55d342c0d3f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ae040 tx=0x7f0bc4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f991aab1ae7ea8d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.564+0000 7f0ac1e0b640 1 -- 172.21.15.167:0/2599325003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40b0040 con 0x55d342c98550 2024-09-18T02:04:21.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0ac1e0b640 1 -- 172.21.15.167:0/2599325003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc40ab9b0 con 0x55d342c98550 2024-09-18T02:04:21.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0ac1e0b640 1 -- 172.21.15.167:0/2599325003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40abc90 con 0x55d342c98550 2024-09-18T02:04:21.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 -- 172.21.15.167:0/2599325003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98550 msgr2=0x55d342c0d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/2599325003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98550 0x55d342c0d3f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ae040 tx=0x7f0bc4003030 comp rx=0 tx=0).stop 2024-09-18T02:04:21.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 -- 172.21.15.167:0/2599325003 shutdown_connections 2024-09-18T02:04:21.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/2599325003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98550 0x55d342c0d3f0 secure :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ae040 tx=0x7f0bc4003030 comp rx=0 tx=0).stop 2024-09-18T02:04:21.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 -- 172.21.15.167:0/2599325003 >> 172.21.15.167:0/2599325003 conn(0x55d342c94070 msgr2=0x55d342d7f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 -- 172.21.15.167:0/2599325003 shutdown_connections 2024-09-18T02:04:21.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 -- 172.21.15.167:0/2599325003 wait complete. 2024-09-18T02:04:21.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 Processor -- start 2024-09-18T02:04:21.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 -- start start 2024-09-18T02:04:21.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98ea0 0x55d342d8bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d342c9fbb0 con 0x55d342c98ea0 2024-09-18T02:04:21.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd3927640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98ea0 0x55d342d8bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd3927640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98ea0 0x55d342d8bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57214/0 (socket says 172.21.15.167:57214) 2024-09-18T02:04:21.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd3927640 1 -- 172.21.15.167:0/626497338 learned_addr learned my addr 172.21.15.167:0/626497338 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd3927640 1 -- 172.21.15.167:0/626497338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d342d8c4a0 con 0x55d342c98ea0 2024-09-18T02:04:21.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd3927640 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98ea0 0x55d342d8bf60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ab510 tx=0x7f0bc4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0abbfff640 1 -- 172.21.15.167:0/626497338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40b0070 con 0x55d342c98ea0 2024-09-18T02:04:21.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0abbfff640 1 -- 172.21.15.167:0/626497338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc40b6830 con 0x55d342c98ea0 2024-09-18T02:04:21.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d342d8c730 con 0x55d342c98ea0 2024-09-18T02:04:21.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0abbfff640 1 -- 172.21.15.167:0/626497338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40b6b10 con 0x55d342c98ea0 2024-09-18T02:04:21.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.568+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d342d8f410 con 0x55d342c98ea0 2024-09-18T02:04:21.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0abbfff640 1 -- 172.21.15.167:0/626497338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0bc40b6cb0 con 0x55d342c98ea0 2024-09-18T02:04:21.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0abbfff640 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0abc034650 0x7f0abc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0abbfff640 1 -- 172.21.15.167:0/626497338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0bc40bc070 con 0x55d342c98ea0 2024-09-18T02:04:21.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd3126640 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0abc034650 0x7f0abc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d342d90ee0 0x55d342d932d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342d93940 con 0x55d342d90ee0 2024-09-18T02:04:21.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd4128640 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d342d90ee0 0x55d342d932d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd3126640 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0abc034650 0x7f0abc036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000f70 tx=0x7f0bc80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd4128640 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d342d90ee0 0x55d342d932d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd4128640 1 -- 172.21.15.167:0/626497338 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342d90ee0 2024-09-18T02:04:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342d90630 con 0x55d342d90ee0 2024-09-18T02:04:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd4128640 1 -- 172.21.15.167:0/626497338 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342d90ee0 2024-09-18T02:04:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d342d95c90 0x55d342d98080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342d98770 con 0x55d342d95c90 2024-09-18T02:04:21.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd3927640 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d342d95c90 0x55d342d98080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.572+0000 7f0bd3927640 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d342d95c90 0x55d342d98080 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd3927640 1 -- 172.21.15.167:0/626497338 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342d95c90 2024-09-18T02:04:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342d94b30 con 0x55d342d90ee0 2024-09-18T02:04:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd4128640 1 -- 172.21.15.167:0/626497338 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342d90ee0 2024-09-18T02:04:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d342d99bd0 0x55d342d9bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342d9c700 con 0x55d342d99bd0 2024-09-18T02:04:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd3126640 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d342d99bd0 0x55d342d9bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd3126640 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d342d99bd0 0x55d342d9bfc0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd3126640 1 -- 172.21.15.167:0/626497338 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342d99bd0 2024-09-18T02:04:21.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd5e17980 1 Processor -- start 2024-09-18T02:04:21.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd5e17980 1 -- start start 2024-09-18T02:04:21.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd5e17980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342daa1d0 0x55d342daa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd5e17980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d342ba0800 con 0x55d342daa1d0 2024-09-18T02:04:21.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd3927640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342daa1d0 0x55d342daa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd3927640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342daa1d0 0x55d342daa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57226/0 (socket says 172.21.15.167:57226) 2024-09-18T02:04:21.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd3927640 1 -- 172.21.15.167:0/334565125 learned_addr learned my addr 172.21.15.167:0/334565125 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd3927640 1 -- 172.21.15.167:0/334565125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d342daab30 con 0x55d342daa1d0 2024-09-18T02:04:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd3927640 1 --2- 172.21.15.167:0/334565125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342daa1d0 0x55d342daa5f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ab980 tx=0x7f0bc40aa740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0ab97fa640 1 -- 172.21.15.167:0/334565125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40b53d0 con 0x55d342daa1d0 2024-09-18T02:04:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd5e17980 1 -- 172.21.15.167:0/334565125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d342daadc0 con 0x55d342daa1d0 2024-09-18T02:04:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0ab97fa640 1 -- 172.21.15.167:0/334565125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc40b5570 con 0x55d342daa1d0 2024-09-18T02:04:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0ab97fa640 1 -- 172.21.15.167:0/334565125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40b5850 con 0x55d342daa1d0 2024-09-18T02:04:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.576+0000 7f0bd5e17980 1 -- 172.21.15.167:0/334565125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d342dada40 con 0x55d342daa1d0 2024-09-18T02:04:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0ab97fa640 1 -- 172.21.15.167:0/334565125 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0bc40dc0c0 con 0x55d342daa1d0 2024-09-18T02:04:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0ab97fa640 1 --2- 172.21.15.167:0/334565125 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0aac034650 0x7f0aac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0ab97fa640 1 -- 172.21.15.167:0/334565125 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0bc40d6070 con 0x55d342daa1d0 2024-09-18T02:04:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0bd3126640 1 --2- 172.21.15.167:0/334565125 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0aac034650 0x7f0aac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0bd5e17980 1 Processor -- start 2024-09-18T02:04:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0bd5e17980 1 -- start start 2024-09-18T02:04:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0bd5e17980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342db6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0bd5e17980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d342c0dc80 con 0x55d342db6a70 2024-09-18T02:04:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0bd3126640 1 --2- 172.21.15.167:0/334565125 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0aac034650 0x7f0aac036b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800bf60 tx=0x7f0bc800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0bd3927640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342db6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0bd3927640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342db6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57242/0 (socket says 172.21.15.167:57242) 2024-09-18T02:04:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0bd3927640 1 -- 172.21.15.167:0/2728160364 learned_addr learned my addr 172.21.15.167:0/2728160364 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0bd3927640 1 -- 172.21.15.167:0/2728160364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d342db7420 con 0x55d342db6a70 2024-09-18T02:04:21.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0bd3927640 1 --2- 172.21.15.167:0/2728160364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342db6e50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ceea0 tx=0x7f0bc40d3420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12ff39a41873d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0ab2ffd640 1 -- 172.21.15.167:0/2728160364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40ce300 con 0x55d342db6a70 2024-09-18T02:04:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0ab2ffd640 1 -- 172.21.15.167:0/2728160364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc40dc590 con 0x55d342db6a70 2024-09-18T02:04:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.580+0000 7f0ab2ffd640 1 -- 172.21.15.167:0/2728160364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40ddd70 con 0x55d342db6a70 2024-09-18T02:04:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 -- 172.21.15.167:0/2728160364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 msgr2=0x55d342db6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/2728160364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342db6e50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ceea0 tx=0x7f0bc40d3420 comp rx=0 tx=0).stop 2024-09-18T02:04:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 -- 172.21.15.167:0/2728160364 shutdown_connections 2024-09-18T02:04:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/2728160364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342db6e50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 -- 172.21.15.167:0/2728160364 >> 172.21.15.167:0/2728160364 conn(0x55d342db2e50 msgr2=0x55d342db0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 -- 172.21.15.167:0/2728160364 shutdown_connections 2024-09-18T02:04:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 -- 172.21.15.167:0/2728160364 wait complete. 2024-09-18T02:04:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 Processor -- start 2024-09-18T02:04:21.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 -- start start 2024-09-18T02:04:21.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342dbdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d342db78c0 con 0x55d342db6a70 2024-09-18T02:04:21.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd3927640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342dbdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd3927640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342dbdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57248/0 (socket says 172.21.15.167:57248) 2024-09-18T02:04:21.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 learned_addr learned my addr 172.21.15.167:0/3378256268 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d342dbe190 con 0x55d342db6a70 2024-09-18T02:04:21.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd3927640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342dbdc50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40e1890 tx=0x7f0bc40ad0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0ab17fa640 1 -- 172.21.15.167:0/3378256268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40d0e30 con 0x55d342db6a70 2024-09-18T02:04:21.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d342dbe190 con 0x55d342db6a70 2024-09-18T02:04:21.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d342dbe190 con 0x55d342db6a70 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0ab17fa640 1 -- 172.21.15.167:0/3378256268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc40fc040 con 0x55d342db6a70 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0ab17fa640 1 -- 172.21.15.167:0/3378256268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40dd850 con 0x55d342db6a70 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0ab17fa640 1 -- 172.21.15.167:0/3378256268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0bc40b7900 con 0x55d342db6a70 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.584+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0ab17fa640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a9c034650 0x7f0a9c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0ab17fa640 1 -- 172.21.15.167:0/3378256268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0bc40a8070 con 0x55d342db6a70 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd3126640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a9c034650 0x7f0a9c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d342dc8d20 0x55d342dcb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcb910 con 0x55d342dc8d20 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd4128640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d342dc8d20 0x55d342dcb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd3126640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a9c034650 0x7f0a9c036b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55d342d93e10 tx=0x7f0bc8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd4128640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d342dc8d20 0x55d342dcb1c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 20 realm 2024-09-18T02:04:21.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcbd20 con 0x55d342dc8d20 2024-09-18T02:04:21.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:21.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc5c0 con 0x55d342dc8d20 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dc8d20 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d342dcd6c0 0x55d342dcfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd0030 con 0x55d342dcd6c0 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd3927640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d342dcd6c0 0x55d342dcfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd3927640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d342dcd6c0 0x55d342dcfab0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:21.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.588+0000 7f0bd5e17980 20 searching for the correct realm 2024-09-18T02:04:21.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d342dd1fa0 0x55d342dd4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd4b30 con 0x55d342dd1fa0 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd3126640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d342dd1fa0 0x55d342dd4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd3126640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d342dd1fa0 0x55d342dd4460 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd3126640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0bc8037040 0x7f0bc8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd4b30 con 0x7f0bc8037040 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd4128640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0bc8037040 0x7f0bc8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd4128640 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0bc8037040 0x7f0bc8036410 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dcd6c0 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dc8d20 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dc8d20 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dcd6c0 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.592+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dcd6c0 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x7f0bc8037040 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dd1fa0 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dc8d20 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dcd6c0 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dc8d20 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x7f0bc8037040 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dd1fa0 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dd1fa0 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dcd6c0 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dd1fa0 2024-09-18T02:04:21.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.596+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dd1fa0 2024-09-18T02:04:21.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dc8d20 2024-09-18T02:04:21.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dc8d20 2024-09-18T02:04:21.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dcd6c0 2024-09-18T02:04:21.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dd1fa0 2024-09-18T02:04:21.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x7f0bc8037040 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dc8d20 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dcd6c0 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dd1fa0 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.600+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dcd6c0 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x7f0bc8037040 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dd1fa0 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dcd6c0 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x55d342dc8d20 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d342dcc960 con 0x7f0bc8037040 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:21.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd0880 con 0x55d342dc8d20 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd0880 con 0x55d342dc8d20 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd0880 con 0x55d342dd1fa0 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 zone default found 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 4 Realm: () 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 zonegroup default 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd1120 con 0x55d342dcd6c0 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd6990 con 0x55d342dd1fa0 2024-09-18T02:04:21.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.604+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd5e17980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd6d30 con 0x55d342dd1fa0 2024-09-18T02:04:21.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd5e17980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd5e17980 20 started sync module instance, tier type = 2024-09-18T02:04:21.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd5e17980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:21.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd5e30 con 0x7f0bc8037040 2024-09-18T02:04:21.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94365848265520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd5e30 con 0x7f0bc8037040 2024-09-18T02:04:21.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd7730 con 0x55d342dc8d20 2024-09-18T02:04:21.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94365848265520] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94365848269376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd5e30 con 0x55d342dc8d20 2024-09-18T02:04:21.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.608+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd8140 con 0x55d342dd1fa0 2024-09-18T02:04:21.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.612+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94365848269376] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.612+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.612+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94365848263040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd5da0 con 0x55d342dd1fa0 2024-09-18T02:04:21.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.612+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd8e80 con 0x7f0bc8037040 2024-09-18T02:04:21.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.612+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.612+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94365848275344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd9720 con 0x7f0bc8037040 2024-09-18T02:04:21.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.612+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dda120 con 0x55d342dc8d20 2024-09-18T02:04:21.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.616+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94365848263040] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.616+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94365848275344] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.616+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.616+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94365848274144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd9220 con 0x55d342dc8d20 2024-09-18T02:04:21.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.616+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dda9c0 con 0x55d342dcd6c0 2024-09-18T02:04:21.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.616+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94365848274144] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.616+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.616+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94365848282384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd9220 con 0x55d342dcd6c0 2024-09-18T02:04:21.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.620+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342ddb210 con 0x55d342dcd6c0 2024-09-18T02:04:21.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.620+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.620+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94365848286720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342ddbed0 con 0x55d342dcd6c0 2024-09-18T02:04:21.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.620+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342ddc8f0 con 0x55d342dcd6c0 2024-09-18T02:04:21.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.620+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94365848282384] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94365848286720] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94365848290272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342ddba60 con 0x55d342dcd6c0 2024-09-18T02:04:21.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 20 add_watcher() i=0 2024-09-18T02:04:21.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 20 add_watcher() i=1 2024-09-18T02:04:21.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 20 add_watcher() i=2 2024-09-18T02:04:21.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 20 add_watcher() i=3 2024-09-18T02:04:21.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 20 add_watcher() i=4 2024-09-18T02:04:21.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 20 add_watcher() i=5 2024-09-18T02:04:21.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 20 add_watcher() i=6 2024-09-18T02:04:21.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94365848290272] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 20 add_watcher() i=7 2024-09-18T02:04:21.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:21.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342ddf9f0 con 0x55d342dc8d20 2024-09-18T02:04:21.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94365848280112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342ddce70 con 0x55d342dc8d20 2024-09-18T02:04:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94365848280112] v30'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.624+0000 7f0a89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 5 note: GC not initialized 2024-09-18T02:04:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0a88fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 20 Filter name: none 2024-09-18T02:04:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0a027fc640 20 reqs_thread_entry: start 2024-09-18T02:04:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e02980 con 0x55d342dc8d20 2024-09-18T02:04:21.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:21.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e03ed0 con 0x7f0bc8037040 2024-09-18T02:04:21.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e03ed0 con 0x55d342dd1fa0 2024-09-18T02:04:21.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:21.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:65 4.24 4:2438aa61:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e05980 con 0x55d342dcd6c0 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 4.29 4:9642b720:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e08650 con 0x55d342dd1fa0 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 4.f 4:f090116b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e0b260 con 0x55d342dc8d20 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 4.29 4:949287a7:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e0dbd0 con 0x55d342dd1fa0 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 4.5 4:a2069307:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e10950 con 0x55d342dd1fa0 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 4.2d 4:b5ed9a3b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e0b260 con 0x55d342dcd6c0 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 4.16 4:680d0d24:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e0b260 con 0x55d342dd1fa0 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 4.9 4:9363ad15:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e17ce0 con 0x55d342dc8d20 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 4.24 4:24630749:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e1a550 con 0x55d342dcd6c0 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:74 4.3 4:c118e1af:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e1d1d0 con 0x55d342dc8d20 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 4.36 4:6d2a8929:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e1fbb0 con 0x55d342dc8d20 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(69 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(67 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(66 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(68 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(70 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(65 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(72 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(74 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(75 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.628+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342e102c0 con 0x7f0bc8037040 2024-09-18T02:04:21.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.632+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(76 foo.buckets [call] v30'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.632+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342e102c0 con 0x7f0bc8037040 2024-09-18T02:04:21.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.632+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(77 foo.buckets [call] v30'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.632+0000 7f0bd5e17980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.632+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e102c0 con 0x55d342dc8d20 2024-09-18T02:04:21.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0bd5e17980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:21.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d342e102c0 con 0x7f0bc8037040 2024-09-18T02:04:21.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0a89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:21.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94365848280112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342e102c0 con 0x55d342dc8d20 2024-09-18T02:04:21.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94365848280112] v30'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94365848265520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342e102c0 con 0x7f0bc8037040 2024-09-18T02:04:21.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94365848265520] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0bd5e17980 20 remove_watcher() i=0 2024-09-18T02:04:21.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0bd5e17980 2 removed watcher, disabling cache 2024-09-18T02:04:21.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.636+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94365848269376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd9c30 con 0x55d342dc8d20 2024-09-18T02:04:21.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.640+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94365848269376] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.640+0000 7f0bd5e17980 20 remove_watcher() i=1 2024-09-18T02:04:21.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.640+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94365848263040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd7240 con 0x55d342dd1fa0 2024-09-18T02:04:21.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.640+0000 7f0bd3126640 1 -- 172.21.15.167:0/3378256268 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94365848263040] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc800e620 con 0x55d342dd1fa0 2024-09-18T02:04:21.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.640+0000 7f0bd5e17980 20 remove_watcher() i=2 2024-09-18T02:04:21.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.640+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94365848275344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd7240 con 0x7f0bc8037040 2024-09-18T02:04:21.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.644+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94365848275344] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8037040 2024-09-18T02:04:21.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.644+0000 7f0bd5e17980 20 remove_watcher() i=3 2024-09-18T02:04:21.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.644+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94365848274144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd7240 con 0x55d342dc8d20 2024-09-18T02:04:21.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.644+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94365848274144] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x55d342dc8d20 2024-09-18T02:04:21.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.644+0000 7f0bd5e17980 20 remove_watcher() i=4 2024-09-18T02:04:21.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.644+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94365848282384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd84e0 con 0x55d342dcd6c0 2024-09-18T02:04:21.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.648+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94365848282384] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.648+0000 7f0bd5e17980 20 remove_watcher() i=5 2024-09-18T02:04:21.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.648+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94365848286720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dd7240 con 0x55d342dcd6c0 2024-09-18T02:04:21.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.648+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94365848286720] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.648+0000 7f0bd5e17980 20 remove_watcher() i=6 2024-09-18T02:04:21.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.648+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94365848290272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d342dda510 con 0x55d342dcd6c0 2024-09-18T02:04:21.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd3927640 1 -- 172.21.15.167:0/3378256268 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94365848290272] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bc40b3040 con 0x55d342dcd6c0 2024-09-18T02:04:21.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 20 remove_watcher() i=7 2024-09-18T02:04:21.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d342dcd6c0 msgr2=0x55d342dcfab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d342dcd6c0 0x55d342dcfab0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d342dc8d20 msgr2=0x55d342dcb1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d342dc8d20 0x55d342dcb1c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0bc8037040 msgr2=0x7f0bc8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0bc8037040 0x7f0bc8036410 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d342dd1fa0 msgr2=0x55d342dd4460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d342dd1fa0 0x55d342dd4460 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a9c034650 msgr2=0x7f0a9c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0a9c034650 0x7f0a9c036b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55d342d93e10 tx=0x7f0bc8010000 comp rx=0 tx=0).stop 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd4128640 1 -- 172.21.15.167:0/3378256268 reap_dead start 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 msgr2=0x55d342dbdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342dbdc50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40e1890 tx=0x7f0bc40ad0b0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 shutdown_connections 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/3378256268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342db6a70 0x55d342dbdc50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 >> 172.21.15.167:0/3378256268 conn(0x55d342db2e50 msgr2=0x55d342db0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 shutdown_connections 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/3378256268 wait complete. 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/334565125 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0aac034650 msgr2=0x7f0aac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/334565125 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0aac034650 0x7f0aac036b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800bf60 tx=0x7f0bc800f000 comp rx=0 tx=0).stop 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/334565125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342daa1d0 msgr2=0x55d342daa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/334565125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342daa1d0 0x55d342daa5f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ab980 tx=0x7f0bc40aa740 comp rx=0 tx=0).stop 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/334565125 shutdown_connections 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/334565125 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0aac034650 0x7f0aac036b10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/334565125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342daa1d0 0x55d342daa5f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/334565125 >> 172.21.15.167:0/334565125 conn(0x55d342d9f320 msgr2=0x55d342da1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/334565125 shutdown_connections 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/334565125 wait complete. 2024-09-18T02:04:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d342d95c90 msgr2=0x55d342d98080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d342d95c90 0x55d342d98080 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d342d90ee0 msgr2=0x55d342d932d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d342d90ee0 0x55d342d932d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d342d99bd0 msgr2=0x55d342d9bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d342d99bd0 0x55d342d9bfc0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0abc034650 msgr2=0x7f0abc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0abc034650 0x7f0abc036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000f70 tx=0x7f0bc80012c0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98ea0 msgr2=0x55d342d8bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 --2- 172.21.15.167:0/626497338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d342c98ea0 0x55d342d8bf60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ab510 tx=0x7f0bc4018020 comp rx=0 tx=0).stop 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd4128640 1 -- 172.21.15.167:0/626497338 reap_dead start 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 shutdown_connections 2024-09-18T02:04:21.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 >> 172.21.15.167:0/626497338 conn(0x55d342c94070 msgr2=0x55d342d7e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 shutdown_connections 2024-09-18T02:04:21.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.652+0000 7f0bd5e17980 1 -- 172.21.15.167:0/626497338 wait complete. 2024-09-18T02:04:21.667 INFO:teuthology.orchestra.run.smithi167.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-18T02:04:21.634528Z","last_stats_update":"2024-09-18T02:04:21.632565Z"} 2024-09-18T02:04:21.667 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-18T02:04:21.634528Z', 'last_stats_update': '2024-09-18T02:04:21.632565Z'} 2024-09-18T02:04:21.676 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:21.676 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-18T02:04:21.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-18T02:04:21.677 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-18T02:04:21.744 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:21.744 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:21.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.740+0000 7fbe31846980 1 Processor -- start 2024-09-18T02:04:21.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.740+0000 7fbe31846980 1 -- start start 2024-09-18T02:04:21.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.740+0000 7fbe31846980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56168930e2e0 0x56168939c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.740+0000 7fbe31846980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561689221ae0 con 0x56168939c8b0 2024-09-18T02:04:21.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.740+0000 7fbe31846980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x561689245e30 con 0x56168930e2e0 2024-09-18T02:04:21.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.744+0000 7fbe2f356640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56168930e2e0 0x56168939c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.744+0000 7fbe2f356640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56168930e2e0 0x56168939c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57250/0 (socket says 172.21.15.167:57250) 2024-09-18T02:04:21.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.744+0000 7fbe2f356640 1 -- 172.21.15.167:0/3192230517 learned_addr learned my addr 172.21.15.167:0/3192230517 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.744+0000 7fbe2f356640 1 -- 172.21.15.167:0/3192230517 >> v1:172.21.15.81:6789/0 conn(0x56168939c8b0 legacy=0x56168939eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.744+0000 7fbe2f356640 1 -- 172.21.15.167:0/3192230517 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616893a13d0 con 0x56168930e2e0 2024-09-18T02:04:21.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.744+0000 7fbe2f356640 1 --2- 172.21.15.167:0/3192230517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x56168939c370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000a5c0 tx=0x7fbe2001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54ddfbfa204629b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.744+0000 7fbe2e354640 1 -- 172.21.15.167:0/3192230517 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe200a6070 con 0x56168930e2e0 2024-09-18T02:04:21.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.744+0000 7fbe2e354640 1 -- 172.21.15.167:0/3192230517 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe200af070 con 0x56168930e2e0 2024-09-18T02:04:21.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.744+0000 7fbe2e354640 1 -- 172.21.15.167:0/3192230517 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe200aa5c0 con 0x56168930e2e0 2024-09-18T02:04:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.748+0000 7fbe31846980 1 -- 172.21.15.167:0/3192230517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 msgr2=0x56168939c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.748+0000 7fbe31846980 1 --2- 172.21.15.167:0/3192230517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x56168939c370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000a5c0 tx=0x7fbe2001b340 comp rx=0 tx=0).stop 2024-09-18T02:04:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.748+0000 7fbe31846980 1 -- 172.21.15.167:0/3192230517 shutdown_connections 2024-09-18T02:04:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.748+0000 7fbe31846980 1 --2- 172.21.15.167:0/3192230517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x56168939c370 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.748+0000 7fbe31846980 1 -- 172.21.15.167:0/3192230517 >> 172.21.15.167:0/3192230517 conn(0x5616893940a0 msgr2=0x5616893964c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.748+0000 7fbe31846980 1 -- 172.21.15.167:0/3192230517 shutdown_connections 2024-09-18T02:04:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.748+0000 7fbe31846980 1 -- 172.21.15.167:0/3192230517 wait complete. 2024-09-18T02:04:21.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.760+0000 7fbe31846980 1 Processor -- start 2024-09-18T02:04:21.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.760+0000 7fbe31846980 1 -- start start 2024-09-18T02:04:21.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.760+0000 7fbe31846980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x561689484a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.760+0000 7fbe31846980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561689247200 con 0x56168930e2e0 2024-09-18T02:04:21.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.760+0000 7fbe2f356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x561689484a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe2f356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x561689484a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57256/0 (socket says 172.21.15.167:57256) 2024-09-18T02:04:21.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe2f356640 1 -- 172.21.15.167:0/4261729977 learned_addr learned my addr 172.21.15.167:0/4261729977 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe2f356640 1 -- 172.21.15.167:0/4261729977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561689484fd0 con 0x56168930e2e0 2024-09-18T02:04:21.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe2f356640 1 --2- 172.21.15.167:0/4261729977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x561689484a00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbe200199f0 tx=0x7fbe20003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73b800489b8aba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbd1d60a640 1 -- 172.21.15.167:0/4261729977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe200aaa00 con 0x56168930e2e0 2024-09-18T02:04:21.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbd1d60a640 1 -- 172.21.15.167:0/4261729977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe200aaba0 con 0x56168930e2e0 2024-09-18T02:04:21.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbd1d60a640 1 -- 172.21.15.167:0/4261729977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe200bd3f0 con 0x56168930e2e0 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe31846980 1 -- 172.21.15.167:0/4261729977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 msgr2=0x561689484a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe31846980 1 --2- 172.21.15.167:0/4261729977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x561689484a00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbe200199f0 tx=0x7fbe20003030 comp rx=0 tx=0).stop 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe31846980 1 -- 172.21.15.167:0/4261729977 shutdown_connections 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe31846980 1 --2- 172.21.15.167:0/4261729977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x561689484a00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe31846980 1 -- 172.21.15.167:0/4261729977 >> 172.21.15.167:0/4261729977 conn(0x5616893940a0 msgr2=0x561689480630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe31846980 1 -- 172.21.15.167:0/4261729977 shutdown_connections 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe31846980 1 -- 172.21.15.167:0/4261729977 wait complete. 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe31846980 1 Processor -- start 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe31846980 1 -- start start 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe31846980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x56168948bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe31846980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5616893a0e40 con 0x56168930e2e0 2024-09-18T02:04:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe2f356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x56168948bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe2f356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x56168948bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57258/0 (socket says 172.21.15.167:57258) 2024-09-18T02:04:21.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe2f356640 1 -- 172.21.15.167:0/1972767982 learned_addr learned my addr 172.21.15.167:0/1972767982 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.764+0000 7fbe2f356640 1 -- 172.21.15.167:0/1972767982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168948c150 con 0x56168930e2e0 2024-09-18T02:04:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe2f356640 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x56168948bc10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbe200199f0 tx=0x7fbe200180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbd1be07640 1 -- 172.21.15.167:0/1972767982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe200bd7c0 con 0x56168930e2e0 2024-09-18T02:04:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbd1be07640 1 -- 172.21.15.167:0/1972767982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe200bd960 con 0x56168930e2e0 2024-09-18T02:04:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56168948c3e0 con 0x56168930e2e0 2024-09-18T02:04:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbd1be07640 1 -- 172.21.15.167:0/1972767982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe200bdc40 con 0x56168930e2e0 2024-09-18T02:04:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56168948f0c0 con 0x56168930e2e0 2024-09-18T02:04:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbd1be07640 1 -- 172.21.15.167:0/1972767982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe200ce020 con 0x56168930e2e0 2024-09-18T02:04:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbd1be07640 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbd14034650 0x7fbd14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbd1be07640 1 -- 172.21.15.167:0/1972767982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbe200cc020 con 0x56168930e2e0 2024-09-18T02:04:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe2eb55640 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbd14034650 0x7fbd14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe31846980 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56168939c8b0 0x561689492be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561689493250 con 0x56168939c8b0 2024-09-18T02:04:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe2fb57640 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56168939c8b0 0x561689492be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe2eb55640 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbd14034650 0x7fbd14036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe24001e20 tx=0x7fbe240013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe2fb57640 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56168939c8b0 0x561689492be0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe2fb57640 1 -- 172.21.15.167:0/1972767982 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x56168939c8b0 2024-09-18T02:04:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894902e0 con 0x56168939c8b0 2024-09-18T02:04:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe2fb57640 1 -- 172.21.15.167:0/1972767982 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe2800a4d0 con 0x56168939c8b0 2024-09-18T02:04:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe31846980 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5616894955a0 0x561689497990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561689498060 con 0x5616894955a0 2024-09-18T02:04:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.768+0000 7fbe2f356640 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5616894955a0 0x561689497990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe2f356640 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5616894955a0 0x561689497990 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe2f356640 1 -- 172.21.15.167:0/1972767982 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe200cf3d0 con 0x5616894955a0 2024-09-18T02:04:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561689494440 con 0x56168939c8b0 2024-09-18T02:04:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe2fb57640 1 -- 172.21.15.167:0/1972767982 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe2800a4d0 con 0x56168939c8b0 2024-09-18T02:04:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe31846980 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5616894994c0 0x56168949b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56168949bfb0 con 0x5616894994c0 2024-09-18T02:04:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe2eb55640 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5616894994c0 0x56168949b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe2eb55640 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5616894994c0 0x56168949b8b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe2eb55640 1 -- 172.21.15.167:0/1972767982 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe2400d040 con 0x5616894994c0 2024-09-18T02:04:21.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe31846980 1 Processor -- start 2024-09-18T02:04:21.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe31846980 1 -- start start 2024-09-18T02:04:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe31846980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894a9a80 0x5616894a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe31846980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5616892a0800 con 0x5616894a9a80 2024-09-18T02:04:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe2f356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894a9a80 0x5616894a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe2f356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894a9a80 0x5616894a9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57262/0 (socket says 172.21.15.167:57262) 2024-09-18T02:04:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe2f356640 1 -- 172.21.15.167:0/737654122 learned_addr learned my addr 172.21.15.167:0/737654122 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.772+0000 7fbe2f356640 1 -- 172.21.15.167:0/737654122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616894aa3e0 con 0x5616894a9a80 2024-09-18T02:04:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe2f356640 1 --2- 172.21.15.167:0/737654122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894a9a80 0x5616894a9ea0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe200cf900 tx=0x7fbe200e3ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbd19602640 1 -- 172.21.15.167:0/737654122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe200cfde0 con 0x5616894a9a80 2024-09-18T02:04:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe31846980 1 -- 172.21.15.167:0/737654122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616894aa670 con 0x5616894a9a80 2024-09-18T02:04:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbd19602640 1 -- 172.21.15.167:0/737654122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe200e32d0 con 0x5616894a9a80 2024-09-18T02:04:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbd19602640 1 -- 172.21.15.167:0/737654122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe200e35d0 con 0x5616894a9a80 2024-09-18T02:04:21.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe31846980 1 -- 172.21.15.167:0/737654122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616894ad2f0 con 0x5616894a9a80 2024-09-18T02:04:21.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbd19602640 1 -- 172.21.15.167:0/737654122 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe200c6480 con 0x5616894a9a80 2024-09-18T02:04:21.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbd19602640 1 --2- 172.21.15.167:0/737654122 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbd08034650 0x7fbd08036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbd19602640 1 -- 172.21.15.167:0/737654122 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbe200eeaa0 con 0x5616894a9a80 2024-09-18T02:04:21.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe2eb55640 1 --2- 172.21.15.167:0/737654122 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbd08034650 0x7fbd08036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe31846980 1 Processor -- start 2024-09-18T02:04:21.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe31846980 1 -- start start 2024-09-18T02:04:21.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe31846980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe31846980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561689485290 con 0x5616894b6380 2024-09-18T02:04:21.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe2eb55640 1 --2- 172.21.15.167:0/737654122 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbd08034650 0x7fbd08036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x561689493b50 tx=0x7fbe24006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe2f356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe2f356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894b6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57274/0 (socket says 172.21.15.167:57274) 2024-09-18T02:04:21.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe2f356640 1 -- 172.21.15.167:0/3745807931 learned_addr learned my addr 172.21.15.167:0/3745807931 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe2f356640 1 -- 172.21.15.167:0/3745807931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616894b6d30 con 0x5616894b6380 2024-09-18T02:04:21.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbe2f356640 1 --2- 172.21.15.167:0/3745807931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894b6760 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbe200e5fd0 tx=0x7fbe200e5ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a69d77d8c0b642 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbd12ffd640 1 -- 172.21.15.167:0/3745807931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe20106070 con 0x5616894b6380 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbd12ffd640 1 -- 172.21.15.167:0/3745807931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe200eed70 con 0x5616894b6380 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.776+0000 7fbd12ffd640 1 -- 172.21.15.167:0/3745807931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe200bc610 con 0x5616894b6380 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 -- 172.21.15.167:0/3745807931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 msgr2=0x5616894b6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 --2- 172.21.15.167:0/3745807931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894b6760 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbe200e5fd0 tx=0x7fbe200e5ba0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 -- 172.21.15.167:0/3745807931 shutdown_connections 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 --2- 172.21.15.167:0/3745807931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894b6760 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 -- 172.21.15.167:0/3745807931 >> 172.21.15.167:0/3745807931 conn(0x5616894b2760 msgr2=0x5616894b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 -- 172.21.15.167:0/3745807931 shutdown_connections 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 -- 172.21.15.167:0/3745807931 wait complete. 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 Processor -- start 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 -- start start 2024-09-18T02:04:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5616894b71d0 con 0x5616894b6380 2024-09-18T02:04:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe2f356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe2f356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894bd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57286/0 (socket says 172.21.15.167:57286) 2024-09-18T02:04:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 learned_addr learned my addr 172.21.15.167:0/629492939 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616894bdae0 con 0x5616894b6380 2024-09-18T02:04:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe2f356640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894bd5a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbe200e5fd0 tx=0x7fbe200c3ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbd117fa640 1 -- 172.21.15.167:0/629492939 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2010e020 con 0x5616894b6380 2024-09-18T02:04:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616894bdae0 con 0x5616894b6380 2024-09-18T02:04:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbd117fa640 1 -- 172.21.15.167:0/629492939 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe200e5450 con 0x5616894b6380 2024-09-18T02:04:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616894bdae0 con 0x5616894b6380 2024-09-18T02:04:21.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbd117fa640 1 -- 172.21.15.167:0/629492939 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe20106040 con 0x5616894b6380 2024-09-18T02:04:21.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbd117fa640 1 -- 172.21.15.167:0/629492939 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe20111020 con 0x5616894b6380 2024-09-18T02:04:21.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbd117fa640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbcf8034650 0x7fbcf8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.780+0000 7fbd117fa640 1 -- 172.21.15.167:0/629492939 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbe200fd030 con 0x5616894b6380 2024-09-18T02:04:21.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2eb55640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbcf8034650 0x7fbcf8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5616894c8560 0x5616894caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894cb170 con 0x5616894c8560 2024-09-18T02:04:21.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2fb57640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5616894c8560 0x5616894caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2eb55640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbcf8034650 0x7fbcf8036b10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x56168949c3b0 tx=0x7fbe24011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2fb57640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5616894c8560 0x5616894caa20 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 realm 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894cb580 con 0x5616894c8560 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894cbe50 con 0x5616894c8560 2024-09-18T02:04:21.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894c8560 2024-09-18T02:04:21.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:21.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5616894ccf50 0x5616894cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894cf950 con 0x5616894ccf50 2024-09-18T02:04:21.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2f356640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5616894ccf50 0x5616894cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2f356640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5616894ccf50 0x5616894cf340 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 20 searching for the correct realm 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5616894d18a0 0x5616894d3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894d4380 con 0x5616894d18a0 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.784+0000 7fbe2eb55640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5616894d18a0 0x5616894d3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2eb55640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5616894d18a0 0x5616894d3cb0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2eb55640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fbe2400f3d0 0x7fbe2400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894d4380 con 0x7fbe2400f3d0 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2fb57640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fbe2400f3d0 0x7fbe2400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2fb57640 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fbe2400f3d0 0x7fbe2400f7f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894ccf50 2024-09-18T02:04:21.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894c8560 2024-09-18T02:04:21.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894c8560 2024-09-18T02:04:21.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894ccf50 2024-09-18T02:04:21.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.788+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894ccf50 2024-09-18T02:04:21.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894d18a0 2024-09-18T02:04:21.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894c8560 2024-09-18T02:04:21.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894ccf50 2024-09-18T02:04:21.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894c8560 2024-09-18T02:04:21.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894d18a0 2024-09-18T02:04:21.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894d18a0 2024-09-18T02:04:21.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.792+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894ccf50 2024-09-18T02:04:21.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894d18a0 2024-09-18T02:04:21.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894d18a0 2024-09-18T02:04:21.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894c8560 2024-09-18T02:04:21.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894c8560 2024-09-18T02:04:21.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894ccf50 2024-09-18T02:04:21.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894d18a0 2024-09-18T02:04:21.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894c8560 2024-09-18T02:04:21.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894ccf50 2024-09-18T02:04:21.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.796+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894d18a0 2024-09-18T02:04:21.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894ccf50 2024-09-18T02:04:21.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894d18a0 2024-09-18T02:04:21.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894ccf50 2024-09-18T02:04:21.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x5616894c8560 2024-09-18T02:04:21.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5616894cc1f0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:21.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894d0210 con 0x5616894c8560 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894d0210 con 0x5616894c8560 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:21.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.800+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894d0210 con 0x5616894d18a0 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 20 zone default found 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 4 Realm: () 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 20 zonegroup default 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894d0c10 con 0x5616894ccf50 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894d07a0 con 0x5616894d18a0 2024-09-18T02:04:21.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894d67e0 con 0x5616894d18a0 2024-09-18T02:04:21.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:21.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 20 started sync module instance, tier type = 2024-09-18T02:04:21.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:21.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d5b20 con 0x7fbe2400f3d0 2024-09-18T02:04:21.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94654792818720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d5b20 con 0x7fbe2400f3d0 2024-09-18T02:04:21.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.804+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d7260 con 0x5616894c8560 2024-09-18T02:04:21.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.808+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94654792818720] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.808+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.808+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94654792822496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d5b20 con 0x5616894c8560 2024-09-18T02:04:21.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.808+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d7c70 con 0x5616894d18a0 2024-09-18T02:04:21.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.808+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.808+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94654792824768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d8510 con 0x5616894d18a0 2024-09-18T02:04:21.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.808+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d8f50 con 0x7fbe2400f3d0 2024-09-18T02:04:21.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.812+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94654792822496] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.812+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.812+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94654792829472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d8f10 con 0x7fbe2400f3d0 2024-09-18T02:04:21.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.812+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d9960 con 0x5616894c8560 2024-09-18T02:04:21.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.812+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94654792824768] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.812+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94654792829472] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.812+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.812+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94654792816240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d94b0 con 0x5616894c8560 2024-09-18T02:04:21.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.812+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d9d00 con 0x5616894ccf50 2024-09-18T02:04:21.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.816+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94654792816240] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.816+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.816+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94654792832176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d98d0 con 0x5616894ccf50 2024-09-18T02:04:21.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.816+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894daa00 con 0x5616894ccf50 2024-09-18T02:04:21.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.816+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94654792832176] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.816+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.816+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94654792835504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894dac20 con 0x5616894ccf50 2024-09-18T02:04:21.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.816+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894db740 con 0x5616894ccf50 2024-09-18T02:04:21.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94654792835504] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94654792839696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894db700 con 0x5616894ccf50 2024-09-18T02:04:21.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 20 add_watcher() i=0 2024-09-18T02:04:21.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 20 add_watcher() i=1 2024-09-18T02:04:21.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 20 add_watcher() i=2 2024-09-18T02:04:21.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 20 add_watcher() i=3 2024-09-18T02:04:21.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 20 add_watcher() i=4 2024-09-18T02:04:21.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 20 add_watcher() i=5 2024-09-18T02:04:21.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 20 add_watcher() i=6 2024-09-18T02:04:21.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94654792839696] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 20 add_watcher() i=7 2024-09-18T02:04:21.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:21.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5616894deb90 con 0x5616894c8560 2024-09-18T02:04:21.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.820+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94654792836720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894dc080 con 0x5616894c8560 2024-09-18T02:04:21.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94654792836720] v30'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:21.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:21.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:21.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 5 note: GC not initialized 2024-09-18T02:04:21.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbce4fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:21.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:21.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 20 Filter name: none 2024-09-18T02:04:21.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbc5e7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:21.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:21.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561689502270 con 0x5616894c8560 2024-09-18T02:04:21.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:21.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:21.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:21.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:21.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:04:21.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561689504350 con 0x7fbe2400f3d0 2024-09-18T02:04:21.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 : miss 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561689505b50 con 0x5616894d18a0 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-18T02:04:21.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.824+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616895070e0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.828+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(65 foo.buckets [call] v30'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.828+0000 7fbe31846980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-18T02:04:21.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.828+0000 7fbe31846980 20 rados->read ofs=0 len=0 2024-09-18T02:04:21.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.828+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561689506c30 con 0x7fbe2400f3d0 2024-09-18T02:04:21.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.828+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.828+0000 7fbe31846980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:21.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.828+0000 7fbe31846980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-18T02:04:21.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.828+0000 7fbe31846980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:21.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.828+0000 7fbe31846980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:21.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.828+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56168950d110 con 0x7fbe2400f3d0 2024-09-18T02:04:21.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbe31846980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T02:04:21.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbe31846980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:21.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbe31846980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T02:04:21.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94654793026592 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56168950a540 con 0x5616894ccf50 2024-09-18T02:04:21.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== watch-notify(notify (1) cookie 94654792835504 notify 128849018882 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5616894aa670 con 0x5616894ccf50 2024-09-18T02:04:21.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbd12ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94654792835504 notifier 4487 bl.length()=338 2024-09-18T02:04:21.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(68 notify.6 [notify cookie 94654793026592 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbd12ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T02:04:21.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbd12ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:21.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbd12ffd640 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fbcf4003eb0 con 0x5616894ccf50 2024-09-18T02:04:21.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== watch-notify(notify_complete (2) cookie 94654793026592 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5616894aa3e0 con 0x5616894ccf50 2024-09-18T02:04:21.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:21.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.832+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94654792836720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616895000a0 con 0x5616894c8560 2024-09-18T02:04:21.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.836+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94654792836720] v30'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.836+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94654792818720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616895000a0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.836+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94654792818720] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.836+0000 7fbe31846980 20 remove_watcher() i=0 2024-09-18T02:04:21.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.836+0000 7fbe31846980 2 removed watcher, disabling cache 2024-09-18T02:04:21.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.836+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94654792822496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d6020 con 0x5616894c8560 2024-09-18T02:04:21.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.840+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94654792822496] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.840+0000 7fbe31846980 20 remove_watcher() i=1 2024-09-18T02:04:21.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.840+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94654792824768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616895000a0 con 0x5616894d18a0 2024-09-18T02:04:21.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.840+0000 7fbe2eb55640 1 -- 172.21.15.167:0/629492939 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94654792824768] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe24036040 con 0x5616894d18a0 2024-09-18T02:04:21.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.840+0000 7fbe31846980 20 remove_watcher() i=2 2024-09-18T02:04:21.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.840+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94654792829472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d6020 con 0x7fbe2400f3d0 2024-09-18T02:04:21.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.840+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94654792829472] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x7fbe2400f3d0 2024-09-18T02:04:21.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.840+0000 7fbe31846980 20 remove_watcher() i=3 2024-09-18T02:04:21.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.840+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94654792816240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616895000a0 con 0x5616894c8560 2024-09-18T02:04:21.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.844+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94654792816240] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x5616894c8560 2024-09-18T02:04:21.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.844+0000 7fbe31846980 20 remove_watcher() i=4 2024-09-18T02:04:21.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.844+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94654792832176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d8a20 con 0x5616894ccf50 2024-09-18T02:04:21.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.844+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94654792832176] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.844+0000 7fbe31846980 20 remove_watcher() i=5 2024-09-18T02:04:21.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.844+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94654792835504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616894d6020 con 0x5616894ccf50 2024-09-18T02:04:21.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94654792835504] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 20 remove_watcher() i=6 2024-09-18T02:04:21.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94654792839696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5616895000a0 con 0x5616894ccf50 2024-09-18T02:04:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe2f356640 1 -- 172.21.15.167:0/629492939 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94654792839696] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe200f4070 con 0x5616894ccf50 2024-09-18T02:04:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 20 remove_watcher() i=7 2024-09-18T02:04:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5616894ccf50 msgr2=0x5616894cf340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5616894ccf50 0x5616894cf340 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5616894c8560 msgr2=0x5616894caa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5616894c8560 0x5616894caa20 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fbe2400f3d0 msgr2=0x7fbe2400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fbe2400f3d0 0x7fbe2400f7f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5616894d18a0 msgr2=0x5616894d3cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5616894d18a0 0x5616894d3cb0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbcf8034650 msgr2=0x7fbcf8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbcf8034650 0x7fbcf8036b10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x56168949c3b0 tx=0x7fbe24011000 comp rx=0 tx=0).stop 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 msgr2=0x5616894bd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894bd5a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbe200e5fd0 tx=0x7fbe200c3ed0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe2fb57640 1 -- 172.21.15.167:0/629492939 reap_dead start 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 shutdown_connections 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 --2- 172.21.15.167:0/629492939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894b6380 0x5616894bd5a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 >> 172.21.15.167:0/629492939 conn(0x5616894b2760 msgr2=0x5616894b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 shutdown_connections 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.848+0000 7fbe31846980 1 -- 172.21.15.167:0/629492939 wait complete. 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/737654122 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbd08034650 msgr2=0x7fbd08036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 --2- 172.21.15.167:0/737654122 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbd08034650 0x7fbd08036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x561689493b50 tx=0x7fbe24006000 comp rx=0 tx=0).stop 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/737654122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894a9a80 msgr2=0x5616894a9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 --2- 172.21.15.167:0/737654122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894a9a80 0x5616894a9ea0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe200cf900 tx=0x7fbe200e3ab0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/737654122 shutdown_connections 2024-09-18T02:04:21.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 --2- 172.21.15.167:0/737654122 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbd08034650 0x7fbd08036b10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 --2- 172.21.15.167:0/737654122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616894a9a80 0x5616894a9ea0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/737654122 >> 172.21.15.167:0/737654122 conn(0x56168949ebd0 msgr2=0x5616894a1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/737654122 shutdown_connections 2024-09-18T02:04:21.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/737654122 wait complete. 2024-09-18T02:04:21.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5616894955a0 msgr2=0x561689497990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5616894955a0 0x561689497990 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56168939c8b0 msgr2=0x561689492be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56168939c8b0 0x561689492be0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5616894994c0 msgr2=0x56168949b8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5616894994c0 0x56168949b8b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbd14034650 msgr2=0x7fbd14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fbd14034650 0x7fbd14036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe24001e20 tx=0x7fbe240013a0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 msgr2=0x56168948bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 --2- 172.21.15.167:0/1972767982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56168930e2e0 0x56168948bc10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbe200199f0 tx=0x7fbe200180e0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe2fb57640 1 -- 172.21.15.167:0/1972767982 reap_dead start 2024-09-18T02:04:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 shutdown_connections 2024-09-18T02:04:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 >> 172.21.15.167:0/1972767982 conn(0x5616893940a0 msgr2=0x56168947f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 shutdown_connections 2024-09-18T02:04:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.852+0000 7fbe31846980 1 -- 172.21.15.167:0/1972767982 wait complete. 2024-09-18T02:04:21.865 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T02:04:21.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T02:04:21.866 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-18T02:04:21.954 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:21.955 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:21.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.952+0000 7f4e22be0980 1 Processor -- start 2024-09-18T02:04:21.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.952+0000 7f4e22be0980 1 -- start start 2024-09-18T02:04:21.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.952+0000 7f4e22be0980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558303fc3310 0x5583040513a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.952+0000 7f4e22be0980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558303ed6ae0 con 0x5583040518e0 2024-09-18T02:04:21.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.952+0000 7f4e22be0980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x558303efae30 con 0x558303fc3310 2024-09-18T02:04:21.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.952+0000 7f4e206f0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558303fc3310 0x5583040513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.952+0000 7f4e206f0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558303fc3310 0x5583040513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57294/0 (socket says 172.21.15.167:57294) 2024-09-18T02:04:21.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.952+0000 7f4e1feef640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5583040518e0 0x558304053cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55624/0 (socket says 172.21.15.167:55624) 2024-09-18T02:04:21.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.952+0000 7f4e206f0640 1 -- 172.21.15.167:0/1363338598 learned_addr learned my addr 172.21.15.167:0/1363338598 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.952+0000 7f4e206f0640 1 -- 172.21.15.167:0/1363338598 >> v1:172.21.15.81:6789/0 conn(0x5583040518e0 legacy=0x558304053cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.952+0000 7f4e206f0640 1 -- 172.21.15.167:0/1363338598 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558304056400 con 0x558303fc3310 2024-09-18T02:04:21.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.956+0000 7f4e206f0640 1 --2- 172.21.15.167:0/1363338598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x5583040513a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000a4e0 tx=0x7f4e1001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954308bc72db60a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.956+0000 7f4e1f6ee640 1 -- 172.21.15.167:0/1363338598 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e100aa540 con 0x558303fc3310 2024-09-18T02:04:21.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.956+0000 7f4e1f6ee640 1 -- 172.21.15.167:0/1363338598 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e100aa6e0 con 0x558303fc3310 2024-09-18T02:04:21.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.956+0000 7f4e1f6ee640 1 -- 172.21.15.167:0/1363338598 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e100aaa40 con 0x558303fc3310 2024-09-18T02:04:21.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.956+0000 7f4e22be0980 1 -- 172.21.15.167:0/1363338598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 msgr2=0x5583040513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.956+0000 7f4e22be0980 1 --2- 172.21.15.167:0/1363338598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x5583040513a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000a4e0 tx=0x7f4e1001b090 comp rx=0 tx=0).stop 2024-09-18T02:04:21.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.956+0000 7f4e22be0980 1 -- 172.21.15.167:0/1363338598 shutdown_connections 2024-09-18T02:04:21.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.956+0000 7f4e22be0980 1 --2- 172.21.15.167:0/1363338598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x5583040513a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.956+0000 7f4e22be0980 1 -- 172.21.15.167:0/1363338598 >> 172.21.15.167:0/1363338598 conn(0x5583040490d0 msgr2=0x55830404b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.956+0000 7f4e22be0980 1 -- 172.21.15.167:0/1363338598 shutdown_connections 2024-09-18T02:04:21.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.956+0000 7f4e22be0980 1 -- 172.21.15.167:0/1363338598 wait complete. 2024-09-18T02:04:21.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4e22be0980 1 Processor -- start 2024-09-18T02:04:21.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4e22be0980 1 -- start start 2024-09-18T02:04:21.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4e22be0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x558304139af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4e22be0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558303efc200 con 0x558303fc3310 2024-09-18T02:04:21.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4e206f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x558304139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4e206f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x558304139af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57310/0 (socket says 172.21.15.167:57310) 2024-09-18T02:04:21.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4e206f0640 1 -- 172.21.15.167:0/2820671731 learned_addr learned my addr 172.21.15.167:0/2820671731 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4e206f0640 1 -- 172.21.15.167:0/2820671731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830413a0c0 con 0x558303fc3310 2024-09-18T02:04:21.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4e206f0640 1 --2- 172.21.15.167:0/2820671731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x558304139af0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4e10017ca0 tx=0x7f4e100033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce58df2f2001930 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4d0e60c640 1 -- 172.21.15.167:0/2820671731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e100b9070 con 0x558303fc3310 2024-09-18T02:04:21.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4d0e60c640 1 -- 172.21.15.167:0/2820671731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e100aaa80 con 0x558303fc3310 2024-09-18T02:04:21.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4d0e60c640 1 -- 172.21.15.167:0/2820671731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e100aad60 con 0x558303fc3310 2024-09-18T02:04:21.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4e22be0980 1 -- 172.21.15.167:0/2820671731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 msgr2=0x558304139af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.972+0000 7f4e22be0980 1 --2- 172.21.15.167:0/2820671731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x558304139af0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4e10017ca0 tx=0x7f4e100033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 -- 172.21.15.167:0/2820671731 shutdown_connections 2024-09-18T02:04:21.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 --2- 172.21.15.167:0/2820671731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x558304139af0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 -- 172.21.15.167:0/2820671731 >> 172.21.15.167:0/2820671731 conn(0x5583040490d0 msgr2=0x558304135720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 -- 172.21.15.167:0/2820671731 shutdown_connections 2024-09-18T02:04:21.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 -- 172.21.15.167:0/2820671731 wait complete. 2024-09-18T02:04:21.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 Processor -- start 2024-09-18T02:04:21.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 -- start start 2024-09-18T02:04:21.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x558304140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558304055e70 con 0x558303fc3310 2024-09-18T02:04:21.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e206f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x558304140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e206f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x558304140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57322/0 (socket says 172.21.15.167:57322) 2024-09-18T02:04:21.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e206f0640 1 -- 172.21.15.167:0/3382003047 learned_addr learned my addr 172.21.15.167:0/3382003047 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e206f0640 1 -- 172.21.15.167:0/3382003047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558304141240 con 0x558303fc3310 2024-09-18T02:04:21.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e206f0640 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x558304140d00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4e1001aec0 tx=0x7f4e10017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4d0ce09640 1 -- 172.21.15.167:0/3382003047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e100cc070 con 0x558303fc3310 2024-09-18T02:04:21.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583041414d0 con 0x558303fc3310 2024-09-18T02:04:21.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4d0ce09640 1 -- 172.21.15.167:0/3382003047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e100c7410 con 0x558303fc3310 2024-09-18T02:04:21.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4d0ce09640 1 -- 172.21.15.167:0/3382003047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e100b9070 con 0x558303fc3310 2024-09-18T02:04:21.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583041441b0 con 0x558303fc3310 2024-09-18T02:04:21.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4d0ce09640 1 -- 172.21.15.167:0/3382003047 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4e100b3040 con 0x558303fc3310 2024-09-18T02:04:21.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4d0ce09640 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4d08034650 0x7f4d08036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4d0ce09640 1 -- 172.21.15.167:0/3382003047 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4e100c4070 con 0x558303fc3310 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e1feef640 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4d08034650 0x7f4d08036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5583040518e0 0x558304147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.976+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041483d0 con 0x5583040518e0 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e20ef1640 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5583040518e0 0x558304147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e1feef640 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4d08034650 0x7f4d08036b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e08000f70 tx=0x7f4e08001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e20ef1640 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5583040518e0 0x558304147e00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e20ef1640 1 -- 172.21.15.167:0/3382003047 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e180083f0 con 0x5583040518e0 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041453d0 con 0x5583040518e0 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e20ef1640 1 -- 172.21.15.167:0/3382003047 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e180083f0 con 0x5583040518e0 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e22be0980 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55830414a730 0x55830414cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55830414d210 con 0x55830414a730 2024-09-18T02:04:21.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e206f0640 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55830414a730 0x55830414cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e206f0640 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55830414a730 0x55830414cb20 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e206f0640 1 -- 172.21.15.167:0/3382003047 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4e100d1c90 con 0x55830414a730 2024-09-18T02:04:21.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041495d0 con 0x5583040518e0 2024-09-18T02:04:21.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e20ef1640 1 -- 172.21.15.167:0/3382003047 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e180083f0 con 0x5583040518e0 2024-09-18T02:04:21.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e22be0980 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55830414e670 0x558304150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041511a0 con 0x55830414e670 2024-09-18T02:04:21.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e1feef640 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55830414e670 0x558304150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e1feef640 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55830414e670 0x558304150a60 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.980+0000 7f4e1feef640 1 -- 172.21.15.167:0/3382003047 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4e0800f6a0 con 0x55830414e670 2024-09-18T02:04:21.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4e22be0980 1 Processor -- start 2024-09-18T02:04:21.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4e22be0980 1 -- start start 2024-09-18T02:04:21.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4e22be0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830415ec70 0x55830415f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4e22be0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558303f55800 con 0x55830415ec70 2024-09-18T02:04:21.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4e206f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830415ec70 0x55830415f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4e206f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830415ec70 0x55830415f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57332/0 (socket says 172.21.15.167:57332) 2024-09-18T02:04:21.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4e206f0640 1 -- 172.21.15.167:0/2445253193 learned_addr learned my addr 172.21.15.167:0/2445253193 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4e206f0640 1 -- 172.21.15.167:0/2445253193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830415f5d0 con 0x55830415ec70 2024-09-18T02:04:21.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4e206f0640 1 --2- 172.21.15.167:0/2445253193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830415ec70 0x55830415f090 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4e100e2e90 tx=0x7f4e100c66b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4d05ffb640 1 -- 172.21.15.167:0/2445253193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e100c6e30 con 0x55830415ec70 2024-09-18T02:04:21.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4d05ffb640 1 -- 172.21.15.167:0/2445253193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e100e4a70 con 0x55830415ec70 2024-09-18T02:04:21.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4e22be0980 1 -- 172.21.15.167:0/2445253193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55830415f860 con 0x55830415ec70 2024-09-18T02:04:21.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4d05ffb640 1 -- 172.21.15.167:0/2445253193 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e100e4d50 con 0x55830415ec70 2024-09-18T02:04:21.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4e22be0980 1 -- 172.21.15.167:0/2445253193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583041624e0 con 0x55830415ec70 2024-09-18T02:04:21.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4d05ffb640 1 -- 172.21.15.167:0/2445253193 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4e100cf360 con 0x55830415ec70 2024-09-18T02:04:21.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4d05ffb640 1 --2- 172.21.15.167:0/2445253193 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4cf80346a0 0x7f4cf8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.984+0000 7f4d05ffb640 1 -- 172.21.15.167:0/2445253193 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4e100e1050 con 0x55830415ec70 2024-09-18T02:04:21.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e1feef640 1 --2- 172.21.15.167:0/2445253193 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4cf80346a0 0x7f4cf8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 Processor -- start 2024-09-18T02:04:21.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 -- start start 2024-09-18T02:04:21.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x55830416b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e1feef640 1 --2- 172.21.15.167:0/2445253193 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4cf80346a0 0x7f4cf8036b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5583041488b0 tx=0x7f4e0800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55830413a380 con 0x55830416b560 2024-09-18T02:04:21.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e206f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x55830416b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e206f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x55830416b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57344/0 (socket says 172.21.15.167:57344) 2024-09-18T02:04:21.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e206f0640 1 -- 172.21.15.167:0/2649969322 learned_addr learned my addr 172.21.15.167:0/2649969322 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e206f0640 1 -- 172.21.15.167:0/2649969322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830416bf10 con 0x55830416b560 2024-09-18T02:04:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e206f0640 1 --2- 172.21.15.167:0/2649969322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x55830416b940 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4e100e8fd0 tx=0x7f4e100a9f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf7bb681a846d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4cff7fe640 1 -- 172.21.15.167:0/2649969322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e100a9c80 con 0x55830416b560 2024-09-18T02:04:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4cff7fe640 1 -- 172.21.15.167:0/2649969322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e100b8e20 con 0x55830416b560 2024-09-18T02:04:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4cff7fe640 1 -- 172.21.15.167:0/2649969322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e100a9aa0 con 0x55830416b560 2024-09-18T02:04:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 -- 172.21.15.167:0/2649969322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 msgr2=0x55830416b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 --2- 172.21.15.167:0/2649969322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x55830416b940 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4e100e8fd0 tx=0x7f4e100a9f80 comp rx=0 tx=0).stop 2024-09-18T02:04:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 -- 172.21.15.167:0/2649969322 shutdown_connections 2024-09-18T02:04:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 --2- 172.21.15.167:0/2649969322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x55830416b940 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 -- 172.21.15.167:0/2649969322 >> 172.21.15.167:0/2649969322 conn(0x558304167940 msgr2=0x558304165a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 -- 172.21.15.167:0/2649969322 shutdown_connections 2024-09-18T02:04:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 -- 172.21.15.167:0/2649969322 wait complete. 2024-09-18T02:04:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 Processor -- start 2024-09-18T02:04:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 -- start start 2024-09-18T02:04:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x558304172720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e22be0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55830416c3b0 con 0x55830416b560 2024-09-18T02:04:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e206f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x558304172720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e206f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x558304172720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57356/0 (socket says 172.21.15.167:57356) 2024-09-18T02:04:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.988+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 learned_addr learned my addr 172.21.15.167:0/145012063 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558304172c60 con 0x55830416b560 2024-09-18T02:04:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e206f0640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x558304172720 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b5c20 tx=0x7f4e100abd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4cfdffb640 1 -- 172.21.15.167:0/145012063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e10111070 con 0x55830416b560 2024-09-18T02:04:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558304172c60 con 0x55830416b560 2024-09-18T02:04:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4cfdffb640 1 -- 172.21.15.167:0/145012063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e100c7730 con 0x55830416b560 2024-09-18T02:04:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4cfdffb640 1 -- 172.21.15.167:0/145012063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e100a9590 con 0x55830416b560 2024-09-18T02:04:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558304172c60 con 0x55830416b560 2024-09-18T02:04:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4cfdffb640 1 -- 172.21.15.167:0/145012063 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4e10114070 con 0x55830416b560 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4cfdffb640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4cf0034650 0x7f4cf0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4cfdffb640 1 -- 172.21.15.167:0/145012063 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4e10109070 con 0x55830416b560 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e1feef640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4cf0034650 0x7f4cf0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55830417d830 0x55830417fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558304180440 con 0x55830417d830 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e20ef1640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55830417d830 0x55830417fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e20ef1640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55830417d830 0x55830417fcf0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e1feef640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4cf0034650 0x7f4cf0036b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800ffd0 tx=0x7f4e08010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e180083f0 con 0x55830417d830 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 20 realm 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558304180850 con 0x55830417d830 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e180083f0 con 0x55830417d830 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.992+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558304181120 con 0x55830417d830 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e180083f0 con 0x55830417d830 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e22be0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x55830417d830 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e180083f0 con 0x55830417d830 2024-09-18T02:04:22.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e22be0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:22.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e22be0980 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558304182220 0x558304184610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558304184be0 con 0x558304182220 2024-09-18T02:04:22.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e206f0640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558304182220 0x558304184610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e206f0640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558304182220 0x558304184610 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e22be0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:22.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e22be0980 20 searching for the correct realm 2024-09-18T02:04:22.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e22be0980 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558304186b30 0x558304188f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558304189630 con 0x558304186b30 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e1feef640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558304186b30 0x558304188f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e1feef640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558304186b30 0x558304188f60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e1feef640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4e0801fbe0 0x7f4e0803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558304189630 con 0x7f4e0801fbe0 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e20ef1640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4e0801fbe0 0x7f4e0803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e20ef1640 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4e0801fbe0 0x7f4e0803a3c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e180083f0 con 0x7f4e0801fbe0 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:21.996+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304182220 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x55830417d830 2024-09-18T02:04:22.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e180083f0 con 0x55830417d830 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x55830417d830 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304182220 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304182220 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x7f4e0801fbe0 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e18026040 con 0x7f4e0801fbe0 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304186b30 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x55830417d830 2024-09-18T02:04:22.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.000+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304182220 2024-09-18T02:04:22.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x55830417d830 2024-09-18T02:04:22.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x7f4e0801fbe0 2024-09-18T02:04:22.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4e18026040 con 0x7f4e0801fbe0 2024-09-18T02:04:22.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304186b30 2024-09-18T02:04:22.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304186b30 2024-09-18T02:04:22.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304182220 2024-09-18T02:04:22.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304186b30 2024-09-18T02:04:22.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304186b30 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x55830417d830 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x55830417d830 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304182220 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.004+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304186b30 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x7f4e0801fbe0 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e18026040 con 0x7f4e0801fbe0 2024-09-18T02:04:22.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x55830417d830 2024-09-18T02:04:22.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304182220 2024-09-18T02:04:22.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304186b30 2024-09-18T02:04:22.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304182220 2024-09-18T02:04:22.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x7f4e0801fbe0 2024-09-18T02:04:22.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e18026040 con 0x7f4e0801fbe0 2024-09-18T02:04:22.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304186b30 2024-09-18T02:04:22.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x558304182220 2024-09-18T02:04:22.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.008+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x55830417d830 2024-09-18T02:04:22.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583041814c0 con 0x7f4e0801fbe0 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e18026040 con 0x7f4e0801fbe0 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041854a0 con 0x55830417d830 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041854a0 con 0x55830417d830 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041854a0 con 0x558304186b30 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 zone default found 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 4 Realm: () 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 zonegroup default 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558304185e90 con 0x558304182220 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558304185a40 con 0x558304186b30 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55830418ba10 con 0x558304186b30 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 started sync module instance, tier type = 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:22.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.012+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418add0 con 0x7f4e0801fbe0 2024-09-18T02:04:22.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.016+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x7f4e0801fbe0 2024-09-18T02:04:22.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.016+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94021197804240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418add0 con 0x7f4e0801fbe0 2024-09-18T02:04:22.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.016+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418c490 con 0x55830417d830 2024-09-18T02:04:22.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.016+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94021197804240] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x7f4e0801fbe0 2024-09-18T02:04:22.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.016+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.016+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94021197807856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418add0 con 0x55830417d830 2024-09-18T02:04:22.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.016+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418ced0 con 0x558304186b30 2024-09-18T02:04:22.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94021197810208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418d720 con 0x558304186b30 2024-09-18T02:04:22.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418e120 con 0x7f4e0801fbe0 2024-09-18T02:04:22.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94021197807856] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x7f4e0801fbe0 2024-09-18T02:04:22.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94021197801760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418e510 con 0x7f4e0801fbe0 2024-09-18T02:04:22.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418eed0 con 0x55830417d830 2024-09-18T02:04:22.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94021197810208] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94021197801760] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x7f4e0801fbe0 2024-09-18T02:04:22.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94021197814832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418ea20 con 0x55830417d830 2024-09-18T02:04:22.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.020+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418f270 con 0x558304182220 2024-09-18T02:04:22.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.024+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94021197814832] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.024+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.024+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94021197818400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418ee40 con 0x558304182220 2024-09-18T02:04:22.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.024+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418ff70 con 0x558304182220 2024-09-18T02:04:22.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94021197818400] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94021197821456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55830418fee0 con 0x558304182220 2024-09-18T02:04:22.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041908a0 con 0x558304182220 2024-09-18T02:04:22.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94021197821456] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94021197822512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558304190a80 con 0x558304182220 2024-09-18T02:04:22.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e22be0980 20 add_watcher() i=0 2024-09-18T02:04:22.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e22be0980 20 add_watcher() i=1 2024-09-18T02:04:22.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e22be0980 20 add_watcher() i=2 2024-09-18T02:04:22.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e22be0980 20 add_watcher() i=3 2024-09-18T02:04:22.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e22be0980 20 add_watcher() i=4 2024-09-18T02:04:22.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e22be0980 20 add_watcher() i=5 2024-09-18T02:04:22.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.028+0000 7f4e22be0980 20 add_watcher() i=6 2024-09-18T02:04:22.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94021197822512] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 20 add_watcher() i=7 2024-09-18T02:04:22.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:22.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558304193c60 con 0x55830417d830 2024-09-18T02:04:22.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94021197837840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558304190a20 con 0x55830417d830 2024-09-18T02:04:22.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94021197837840] v30'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4cd67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:22.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:22.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:22.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 5 note: GC not initialized 2024-09-18T02:04:22.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4cd57e2640 20 reqs_thread_entry: start 2024-09-18T02:04:22.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:22.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 20 Filter name: none 2024-09-18T02:04:22.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4c46ffd640 20 reqs_thread_entry: start 2024-09-18T02:04:22.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T02:04:22.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.032+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041b7430 con 0x558304182220 2024-09-18T02:04:22.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041b5bd0 con 0x558304182220 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T02:04:22.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041b64a0 con 0x558304182220 2024-09-18T02:04:22.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T02:04:22.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:04:22.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T02:04:22.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94021197979632 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041baa20 con 0x558304182220 2024-09-18T02:04:22.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== watch-notify(notify (1) cookie 94021197818400 notify 128849018883 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5583041b6e80 con 0x558304182220 2024-09-18T02:04:22.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4cff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94021197818400 notifier 4494 bl.length()=556 2024-09-18T02:04:22.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4cff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T02:04:22.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4cff7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:04:22.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4cff7fe640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4ce4003eb0 con 0x558304182220 2024-09-18T02:04:22.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.036+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(65 notify.5 [notify cookie 94021197979632 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== watch-notify(notify_complete (2) cookie 94021197979632 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55830415f5d0 con 0x558304182220 2024-09-18T02:04:22.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041b6400 con 0x558304182220 2024-09-18T02:04:22.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e22be0980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T02:04:22.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e22be0980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:04:22.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e22be0980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T02:04:22.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94021197979472 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583041baed0 con 0x558304186b30 2024-09-18T02:04:22.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== watch-notify(notify (1) cookie 94021197810208 notify 128849018888 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f4e08018040 con 0x558304186b30 2024-09-18T02:04:22.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4cfeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94021197810208 notifier 4494 bl.length()=177 2024-09-18T02:04:22.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4cfeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T02:04:22.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4cfeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:04:22.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(68 notify.2 [notify cookie 94021197979472 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4cfeffd640 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4c54003410 con 0x558304186b30 2024-09-18T02:04:22.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== watch-notify(notify_complete (2) cookie 94021197979472 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558303ed6ae0 con 0x558304186b30 2024-09-18T02:04:22.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.040+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.046 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T02:04:22.037526Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:22.037513Z","tags":[],"group_ids":[]} 2024-09-18T02:04:22.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.044+0000 7f4cd67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:22.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.044+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94021197837840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041b5200 con 0x55830417d830 2024-09-18T02:04:22.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.044+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94021197837840] v30'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.044+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94021197804240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041b5200 con 0x7f4e0801fbe0 2024-09-18T02:04:22.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.044+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94021197804240] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x7f4e0801fbe0 2024-09-18T02:04:22.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.044+0000 7f4e22be0980 20 remove_watcher() i=0 2024-09-18T02:04:22.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.044+0000 7f4e22be0980 2 removed watcher, disabling cache 2024-09-18T02:04:22.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.044+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94021197807856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041b5200 con 0x55830417d830 2024-09-18T02:04:22.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.048+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94021197807856] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.048+0000 7f4e22be0980 20 remove_watcher() i=1 2024-09-18T02:04:22.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.048+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94021197810208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041b5200 con 0x558304186b30 2024-09-18T02:04:22.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.048+0000 7f4e1feef640 1 -- 172.21.15.167:0/145012063 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94021197810208] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e08037040 con 0x558304186b30 2024-09-18T02:04:22.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.048+0000 7f4e22be0980 20 remove_watcher() i=2 2024-09-18T02:04:22.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.048+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94021197801760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041b5200 con 0x7f4e0801fbe0 2024-09-18T02:04:22.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.052+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94021197801760] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x7f4e0801fbe0 2024-09-18T02:04:22.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.052+0000 7f4e22be0980 20 remove_watcher() i=3 2024-09-18T02:04:22.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.052+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94021197814832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041b5200 con 0x55830417d830 2024-09-18T02:04:22.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.052+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94021197814832] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e18026040 con 0x55830417d830 2024-09-18T02:04:22.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.052+0000 7f4e22be0980 20 remove_watcher() i=4 2024-09-18T02:04:22.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.052+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94021197818400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041b5200 con 0x558304182220 2024-09-18T02:04:22.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.056+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94021197818400] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.056+0000 7f4e22be0980 20 remove_watcher() i=5 2024-09-18T02:04:22.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.056+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94021197821456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041b5200 con 0x558304182220 2024-09-18T02:04:22.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.056+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94021197821456] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.056+0000 7f4e22be0980 20 remove_watcher() i=6 2024-09-18T02:04:22.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.056+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94021197822512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583041b5200 con 0x558304182220 2024-09-18T02:04:22.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e206f0640 1 -- 172.21.15.167:0/145012063 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94021197822512] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e10113030 con 0x558304182220 2024-09-18T02:04:22.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 20 remove_watcher() i=7 2024-09-18T02:04:22.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558304182220 msgr2=0x558304184610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558304182220 0x558304184610 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55830417d830 msgr2=0x55830417fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55830417d830 0x55830417fcf0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4e0801fbe0 msgr2=0x7f4e0803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4e0801fbe0 0x7f4e0803a3c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558304186b30 msgr2=0x558304188f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558304186b30 0x558304188f60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4cf0034650 msgr2=0x7f4cf0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4cf0034650 0x7f4cf0036b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800ffd0 tx=0x7f4e08010000 comp rx=0 tx=0).stop 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 msgr2=0x558304172720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e20ef1640 1 -- 172.21.15.167:0/145012063 reap_dead start 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x558304172720 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b5c20 tx=0x7f4e100abd80 comp rx=0 tx=0).stop 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 shutdown_connections 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/145012063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830416b560 0x558304172720 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 >> 172.21.15.167:0/145012063 conn(0x558304167940 msgr2=0x558304165a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 shutdown_connections 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/145012063 wait complete. 2024-09-18T02:04:22.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/2445253193 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4cf80346a0 msgr2=0x7f4cf8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/2445253193 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4cf80346a0 0x7f4cf8036b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5583041488b0 tx=0x7f4e0800f000 comp rx=0 tx=0).stop 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/2445253193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830415ec70 msgr2=0x55830415f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/2445253193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830415ec70 0x55830415f090 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4e100e2e90 tx=0x7f4e100c66b0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/2445253193 shutdown_connections 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/2445253193 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4cf80346a0 0x7f4cf8036b60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/2445253193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55830415ec70 0x55830415f090 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/2445253193 >> 172.21.15.167:0/2445253193 conn(0x558304153dc0 msgr2=0x558304156840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/2445253193 shutdown_connections 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/2445253193 wait complete. 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55830414a730 msgr2=0x55830414cb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55830414a730 0x55830414cb20 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5583040518e0 msgr2=0x558304147e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5583040518e0 0x558304147e00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55830414e670 msgr2=0x558304150a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55830414e670 0x558304150a60 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4d08034650 msgr2=0x7f4d08036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4d08034650 0x7f4d08036b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e08000f70 tx=0x7f4e08001380 comp rx=0 tx=0).stop 2024-09-18T02:04:22.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 msgr2=0x558304140d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 --2- 172.21.15.167:0/3382003047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558303fc3310 0x558304140d00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4e1001aec0 tx=0x7f4e10017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:22.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e20ef1640 1 -- 172.21.15.167:0/3382003047 reap_dead start 2024-09-18T02:04:22.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 shutdown_connections 2024-09-18T02:04:22.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 >> 172.21.15.167:0/3382003047 conn(0x5583040490d0 msgr2=0x5583041342a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 shutdown_connections 2024-09-18T02:04:22.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.060+0000 7f4e22be0980 1 -- 172.21.15.167:0/3382003047 wait complete. 2024-09-18T02:04:22.074 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T02:04:22.037526Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:22.037513Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:22.081 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T02:04:22.087 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:22.087 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-18T02:04:22.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-18T02:04:22.087 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-18T02:04:22.118 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:22.118 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:22.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.116+0000 7f3b09973980 1 Processor -- start 2024-09-18T02:04:22.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.116+0000 7f3b09973980 1 -- start start 2024-09-18T02:04:22.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.116+0000 7f3b09973980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c5857ef3b0 0x55c5857edb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.116+0000 7f3b09973980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c585700ae0 con 0x55c5857ef7c0 2024-09-18T02:04:22.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.116+0000 7f3b09973980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55c585724e30 con 0x55c5857ef3b0 2024-09-18T02:04:22.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.116+0000 7f3b07483640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c5857ef3b0 0x55c5857edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.116+0000 7f3b07483640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c5857ef3b0 0x55c5857edb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57362/0 (socket says 172.21.15.167:57362) 2024-09-18T02:04:22.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.116+0000 7f3b06c82640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55c5857ef7c0 0x55c5857ee0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55640/0 (socket says 172.21.15.167:55640) 2024-09-18T02:04:22.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.116+0000 7f3b07483640 1 -- 172.21.15.167:0/819908587 learned_addr learned my addr 172.21.15.167:0/819908587 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.116+0000 7f3b07483640 1 -- 172.21.15.167:0/819908587 >> v1:172.21.15.81:6789/0 conn(0x55c5857ef7c0 legacy=0x55c5857ee0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.116+0000 7f3b07483640 1 -- 172.21.15.167:0/819908587 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5857ee8e0 con 0x55c5857ef3b0 2024-09-18T02:04:22.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.120+0000 7f3b07483640 1 --2- 172.21.15.167:0/819908587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c5857edb70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000a4e0 tx=0x7f3b0001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9178c132d7c8178 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.120+0000 7f3b06481640 1 -- 172.21.15.167:0/819908587 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000aa540 con 0x55c5857ef3b0 2024-09-18T02:04:22.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.120+0000 7f3b06481640 1 -- 172.21.15.167:0/819908587 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b000aa6e0 con 0x55c5857ef3b0 2024-09-18T02:04:22.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.120+0000 7f3b06481640 1 -- 172.21.15.167:0/819908587 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000aaa40 con 0x55c5857ef3b0 2024-09-18T02:04:22.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.120+0000 7f3b09973980 1 -- 172.21.15.167:0/819908587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 msgr2=0x55c5857edb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.120+0000 7f3b09973980 1 --2- 172.21.15.167:0/819908587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c5857edb70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000a4e0 tx=0x7f3b0001b090 comp rx=0 tx=0).stop 2024-09-18T02:04:22.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.120+0000 7f3b09973980 1 -- 172.21.15.167:0/819908587 shutdown_connections 2024-09-18T02:04:22.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.120+0000 7f3b09973980 1 --2- 172.21.15.167:0/819908587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c5857edb70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.120+0000 7f3b09973980 1 -- 172.21.15.167:0/819908587 >> 172.21.15.167:0/819908587 conn(0x55c5858741b0 msgr2=0x55c5858765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.120+0000 7f3b09973980 1 -- 172.21.15.167:0/819908587 shutdown_connections 2024-09-18T02:04:22.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.120+0000 7f3b09973980 1 -- 172.21.15.167:0/819908587 wait complete. 2024-09-18T02:04:22.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 Processor -- start 2024-09-18T02:04:22.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 -- start start 2024-09-18T02:04:22.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c585965bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c585726200 con 0x55c5857ef3b0 2024-09-18T02:04:22.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b07483640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c585965bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b07483640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c585965bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57366/0 (socket says 172.21.15.167:57366) 2024-09-18T02:04:22.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b07483640 1 -- 172.21.15.167:0/3305833736 learned_addr learned my addr 172.21.15.167:0/3305833736 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b07483640 1 -- 172.21.15.167:0/3305833736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c585966190 con 0x55c5857ef3b0 2024-09-18T02:04:22.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b07483640 1 --2- 172.21.15.167:0/3305833736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c585965bc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3b00018cc0 tx=0x7f3b000033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e741c51384a46b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f39f560a640 1 -- 172.21.15.167:0/3305833736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000b9070 con 0x55c5857ef3b0 2024-09-18T02:04:22.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f39f560a640 1 -- 172.21.15.167:0/3305833736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b000aab00 con 0x55c5857ef3b0 2024-09-18T02:04:22.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f39f560a640 1 -- 172.21.15.167:0/3305833736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000aae20 con 0x55c5857ef3b0 2024-09-18T02:04:22.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 -- 172.21.15.167:0/3305833736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 msgr2=0x55c585965bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 --2- 172.21.15.167:0/3305833736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c585965bc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3b00018cc0 tx=0x7f3b000033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 -- 172.21.15.167:0/3305833736 shutdown_connections 2024-09-18T02:04:22.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 --2- 172.21.15.167:0/3305833736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c585965bc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 -- 172.21.15.167:0/3305833736 >> 172.21.15.167:0/3305833736 conn(0x55c5858741b0 msgr2=0x55c5859617f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 -- 172.21.15.167:0/3305833736 shutdown_connections 2024-09-18T02:04:22.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 -- 172.21.15.167:0/3305833736 wait complete. 2024-09-18T02:04:22.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 Processor -- start 2024-09-18T02:04:22.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 -- start start 2024-09-18T02:04:22.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.136+0000 7f3b09973980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c58596ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b09973980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c585884200 con 0x55c5857ef3b0 2024-09-18T02:04:22.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b07483640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c58596ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b07483640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c58596ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57382/0 (socket says 172.21.15.167:57382) 2024-09-18T02:04:22.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b07483640 1 -- 172.21.15.167:0/3511169917 learned_addr learned my addr 172.21.15.167:0/3511169917 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b07483640 1 -- 172.21.15.167:0/3511169917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c58596d350 con 0x55c5857ef3b0 2024-09-18T02:04:22.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b07483640 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c58596ce10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000a4e0 tx=0x7f3b00017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f39f3e07640 1 -- 172.21.15.167:0/3511169917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000b9070 con 0x55c5857ef3b0 2024-09-18T02:04:22.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f39f3e07640 1 -- 172.21.15.167:0/3511169917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b000c7410 con 0x55c5857ef3b0 2024-09-18T02:04:22.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f39f3e07640 1 -- 172.21.15.167:0/3511169917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000c76f0 con 0x55c5857ef3b0 2024-09-18T02:04:22.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c58596d5e0 con 0x55c5857ef3b0 2024-09-18T02:04:22.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5859702c0 con 0x55c5857ef3b0 2024-09-18T02:04:22.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f39f3e07640 1 -- 172.21.15.167:0/3511169917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3b000b3040 con 0x55c5857ef3b0 2024-09-18T02:04:22.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f39f3e07640 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39ec034650 0x7f39ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f39f3e07640 1 -- 172.21.15.167:0/3511169917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3b000c4070 con 0x55c5857ef3b0 2024-09-18T02:04:22.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b06c82640 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39ec034650 0x7f39ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b09973980 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5857ef7c0 0x55c585973e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c585974440 con 0x55c5857ef7c0 2024-09-18T02:04:22.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b07c84640 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5857ef7c0 0x55c585973e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b06c82640 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39ec034650 0x7f39ec036b10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3af0000f70 tx=0x7f3af0001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b07c84640 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5857ef7c0 0x55c585973e00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.140+0000 7f3b07c84640 1 -- 172.21.15.167:0/3511169917 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3af80083f0 con 0x55c5857ef7c0 2024-09-18T02:04:22.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859714c0 con 0x55c5857ef7c0 2024-09-18T02:04:22.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b07c84640 1 -- 172.21.15.167:0/3511169917 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3af80083f0 con 0x55c5857ef7c0 2024-09-18T02:04:22.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b09973980 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c585976770 0x55c585978b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c585979230 con 0x55c585976770 2024-09-18T02:04:22.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b07483640 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c585976770 0x55c585978b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b07483640 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c585976770 0x55c585978b60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b07483640 1 -- 172.21.15.167:0/3511169917 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3b000cf3a0 con 0x55c585976770 2024-09-18T02:04:22.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c585975610 con 0x55c5857ef7c0 2024-09-18T02:04:22.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b07c84640 1 -- 172.21.15.167:0/3511169917 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3af80083f0 con 0x55c5857ef7c0 2024-09-18T02:04:22.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b09973980 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c58597a670 0x55c58597ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c58597d1f0 con 0x55c58597a670 2024-09-18T02:04:22.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b06c82640 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c58597a670 0x55c58597ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b06c82640 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c58597a670 0x55c58597ca60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b06c82640 1 -- 172.21.15.167:0/3511169917 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3af000f6a0 con 0x55c58597a670 2024-09-18T02:04:22.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b09973980 1 Processor -- start 2024-09-18T02:04:22.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b09973980 1 -- start start 2024-09-18T02:04:22.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b09973980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c58598ac80 0x55c58598b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.144+0000 7f3b09973980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c58577f800 con 0x55c58598ac80 2024-09-18T02:04:22.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b07483640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c58598ac80 0x55c58598b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b07483640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c58598ac80 0x55c58598b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57392/0 (socket says 172.21.15.167:57392) 2024-09-18T02:04:22.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b07483640 1 -- 172.21.15.167:0/4091133367 learned_addr learned my addr 172.21.15.167:0/4091133367 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b07483640 1 -- 172.21.15.167:0/4091133367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c58598b5e0 con 0x55c58598ac80 2024-09-18T02:04:22.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b07483640 1 --2- 172.21.15.167:0/4091133367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c58598ac80 0x55c58598b0a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3b000e3500 tx=0x7f3b000b4690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f39f1602640 1 -- 172.21.15.167:0/4091133367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000c7aa0 con 0x55c58598ac80 2024-09-18T02:04:22.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f39f1602640 1 -- 172.21.15.167:0/4091133367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b000c7c40 con 0x55c58598ac80 2024-09-18T02:04:22.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b09973980 1 -- 172.21.15.167:0/4091133367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c58598b870 con 0x55c58598ac80 2024-09-18T02:04:22.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f39f1602640 1 -- 172.21.15.167:0/4091133367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000cf800 con 0x55c58598ac80 2024-09-18T02:04:22.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b09973980 1 -- 172.21.15.167:0/4091133367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c58598e4f0 con 0x55c58598ac80 2024-09-18T02:04:22.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f39f1602640 1 -- 172.21.15.167:0/4091133367 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3b000da040 con 0x55c58598ac80 2024-09-18T02:04:22.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f39f1602640 1 --2- 172.21.15.167:0/4091133367 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39e0034650 0x7f39e0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f39f1602640 1 -- 172.21.15.167:0/4091133367 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3b000d7040 con 0x55c58598ac80 2024-09-18T02:04:22.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b06c82640 1 --2- 172.21.15.167:0/4091133367 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39e0034650 0x7f39e0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b09973980 1 Processor -- start 2024-09-18T02:04:22.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b09973980 1 -- start start 2024-09-18T02:04:22.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b06c82640 1 --2- 172.21.15.167:0/4091133367 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39e0034650 0x7f39e0036b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55c58597d5f0 tx=0x7f3af000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b09973980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c5859979a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b09973980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c585966450 con 0x55c5859975a0 2024-09-18T02:04:22.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b07483640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c5859979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b07483640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c5859979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57404/0 (socket says 172.21.15.167:57404) 2024-09-18T02:04:22.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.148+0000 7f3b07483640 1 -- 172.21.15.167:0/1391720064 learned_addr learned my addr 172.21.15.167:0/1391720064 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b07483640 1 -- 172.21.15.167:0/1391720064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c585997f70 con 0x55c5859975a0 2024-09-18T02:04:22.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b07483640 1 --2- 172.21.15.167:0/1391720064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c5859979a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3b000bb670 tx=0x7f3b000ed3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314df564a51c126c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f39eaffd640 1 -- 172.21.15.167:0/1391720064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000fc020 con 0x55c5859975a0 2024-09-18T02:04:22.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f39eaffd640 1 -- 172.21.15.167:0/1391720064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b000dc830 con 0x55c5859975a0 2024-09-18T02:04:22.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f39eaffd640 1 -- 172.21.15.167:0/1391720064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000dddd0 con 0x55c5859975a0 2024-09-18T02:04:22.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 -- 172.21.15.167:0/1391720064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 msgr2=0x55c5859979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 --2- 172.21.15.167:0/1391720064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c5859979a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3b000bb670 tx=0x7f3b000ed3e0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 -- 172.21.15.167:0/1391720064 shutdown_connections 2024-09-18T02:04:22.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 --2- 172.21.15.167:0/1391720064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c5859979a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 -- 172.21.15.167:0/1391720064 >> 172.21.15.167:0/1391720064 conn(0x55c585993980 msgr2=0x55c585991a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 -- 172.21.15.167:0/1391720064 shutdown_connections 2024-09-18T02:04:22.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 -- 172.21.15.167:0/1391720064 wait complete. 2024-09-18T02:04:22.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 Processor -- start 2024-09-18T02:04:22.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 -- start start 2024-09-18T02:04:22.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c58599e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c585998390 con 0x55c5859975a0 2024-09-18T02:04:22.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b07483640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c58599e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b07483640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c58599e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57418/0 (socket says 172.21.15.167:57418) 2024-09-18T02:04:22.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 learned_addr learned my addr 172.21.15.167:0/3309579562 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c58599ed00 con 0x55c5859975a0 2024-09-18T02:04:22.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b07483640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c58599e7c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3b000bb670 tx=0x7f3b000f0e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f39e97fa640 1 -- 172.21.15.167:0/3309579562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b00111070 con 0x55c5859975a0 2024-09-18T02:04:22.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f39e97fa640 1 -- 172.21.15.167:0/3309579562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b000bd530 con 0x55c5859975a0 2024-09-18T02:04:22.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c58599ed00 con 0x55c5859975a0 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f39e97fa640 1 -- 172.21.15.167:0/3309579562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000db540 con 0x55c5859975a0 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.152+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c58599ed00 con 0x55c5859975a0 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f39e97fa640 1 -- 172.21.15.167:0/3309579562 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3b00114070 con 0x55c5859975a0 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f39e97fa640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39d0034650 0x7f39d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f39e97fa640 1 -- 172.21.15.167:0/3309579562 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3b00107030 con 0x55c5859975a0 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b06c82640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39d0034650 0x7f39d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5859a96a0 0x55c5859abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ac2b0 con 0x55c5859a96a0 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b07c84640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5859a96a0 0x55c5859abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b06c82640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39d0034650 0x7f39d0036b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c010 tx=0x7f3af0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b07c84640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5859a96a0 0x55c5859abb60 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3af80083f0 con 0x55c5859a96a0 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 20 realm 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ac6c0 con 0x55c5859a96a0 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3af80083f0 con 0x55c5859a96a0 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859acf60 con 0x55c5859a96a0 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3af80083f0 con 0x55c5859a96a0 2024-09-18T02:04:22.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859a96a0 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3af80083f0 con 0x55c5859a96a0 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5859ae060 0x55c5859b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b09d0 con 0x55c5859ae060 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.156+0000 7f3b07483640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5859ae060 0x55c5859b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07483640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5859ae060 0x55c5859b0450 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b09973980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:22.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b09973980 20 searching for the correct realm 2024-09-18T02:04:22.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b09973980 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5859b2920 0x55c5859b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b54b0 con 0x55c5859b2920 2024-09-18T02:04:22.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b06c82640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5859b2920 0x55c5859b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b06c82640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5859b2920 0x55c5859b4de0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b06c82640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3af001fbe0 0x7f3af003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b54b0 con 0x7f3af001fbe0 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07c84640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3af001fbe0 0x7f3af003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07c84640 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3af001fbe0 0x7f3af003a3c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af80083f0 con 0x7f3af001fbe0 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859ae060 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859a96a0 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af80083f0 con 0x55c5859a96a0 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859a96a0 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.160+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859ae060 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859ae060 2024-09-18T02:04:22.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x7f3af001fbe0 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859b2920 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859a96a0 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859ae060 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859a96a0 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x7f3af001fbe0 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859b2920 2024-09-18T02:04:22.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859b2920 2024-09-18T02:04:22.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.164+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859ae060 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859b2920 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859b2920 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859a96a0 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859a96a0 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859ae060 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859b2920 2024-09-18T02:04:22.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x7f3af001fbe0 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859a96a0 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859ae060 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.168+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859b2920 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859ae060 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x7f3af001fbe0 2024-09-18T02:04:22.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859b2920 2024-09-18T02:04:22.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859ae060 2024-09-18T02:04:22.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x55c5859a96a0 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5859ad300 con 0x7f3af001fbe0 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b1220 con 0x55c5859a96a0 2024-09-18T02:04:22.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b1220 con 0x55c5859a96a0 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b1220 con 0x55c5859b2920 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 zone default found 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 4 Realm: () 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:22.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 zonegroup default 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.172+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b1ac0 con 0x55c5859ae060 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b7310 con 0x55c5859b2920 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b76b0 con 0x55c5859b2920 2024-09-18T02:04:22.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 20 started sync module instance, tier type = 2024-09-18T02:04:22.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:22.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b67b0 con 0x7f3af001fbe0 2024-09-18T02:04:22.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94306838473984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b67b0 con 0x7f3af001fbe0 2024-09-18T02:04:22.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b8180 con 0x55c5859a96a0 2024-09-18T02:04:22.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.176+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94306838473984] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.180+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.180+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94306838477920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b67b0 con 0x55c5859a96a0 2024-09-18T02:04:22.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.180+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b8b90 con 0x55c5859b2920 2024-09-18T02:04:22.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.180+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94306838477920] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.180+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.180+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94306838471424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b6720 con 0x55c5859b2920 2024-09-18T02:04:22.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.180+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b98e0 con 0x7f3af001fbe0 2024-09-18T02:04:22.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.180+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.180+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94306838484288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b9fd0 con 0x7f3af001fbe0 2024-09-18T02:04:22.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.180+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859baaf0 con 0x55c5859a96a0 2024-09-18T02:04:22.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.184+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94306838471424] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.184+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94306838484288] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.184+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.184+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94306838488512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859baab0 con 0x55c5859a96a0 2024-09-18T02:04:22.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.184+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859baee0 con 0x55c5859ae060 2024-09-18T02:04:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.184+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94306838488512] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.188+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.188+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94306838485536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859bb2d0 con 0x55c5859ae060 2024-09-18T02:04:22.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.188+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859bbb60 con 0x55c5859ae060 2024-09-18T02:04:22.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.188+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.188+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94306838494976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859bc7d0 con 0x55c5859ae060 2024-09-18T02:04:22.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.188+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859bd240 con 0x55c5859ae060 2024-09-18T02:04:22.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.188+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94306838485536] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94306838494976] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94306838498576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859bc360 con 0x55c5859ae060 2024-09-18T02:04:22.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 20 add_watcher() i=0 2024-09-18T02:04:22.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 20 add_watcher() i=1 2024-09-18T02:04:22.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 20 add_watcher() i=2 2024-09-18T02:04:22.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 20 add_watcher() i=3 2024-09-18T02:04:22.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 20 add_watcher() i=4 2024-09-18T02:04:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 20 add_watcher() i=5 2024-09-18T02:04:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 20 add_watcher() i=6 2024-09-18T02:04:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94306838498576] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 20 add_watcher() i=7 2024-09-18T02:04:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859c0340 con 0x55c5859a96a0 2024-09-18T02:04:22.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.192+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94306838482816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859bd7c0 con 0x55c5859a96a0 2024-09-18T02:04:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94306838482816] v30'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f39bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f3b09973980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f3b09973980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f3b09973980 5 note: GC not initialized 2024-09-18T02:04:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f39bcfe1640 20 reqs_thread_entry: start 2024-09-18T02:04:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f3b09973980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f3b09973980 20 Filter name: none 2024-09-18T02:04:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f39367fc640 20 reqs_thread_entry: start 2024-09-18T02:04:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f3b09973980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5859e3250 con 0x7f3af001fbe0 2024-09-18T02:04:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f3b09973980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f39bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.196+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94306838482816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859e11a0 con 0x55c5859a96a0 2024-09-18T02:04:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.200+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94306838482816] v30'115 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.200+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94306838473984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859e11a0 con 0x7f3af001fbe0 2024-09-18T02:04:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.200+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94306838473984] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.200+0000 7f3b09973980 20 remove_watcher() i=0 2024-09-18T02:04:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.200+0000 7f3b09973980 2 removed watcher, disabling cache 2024-09-18T02:04:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.200+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94306838477920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859e11a0 con 0x55c5859a96a0 2024-09-18T02:04:22.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.200+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94306838477920] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.200+0000 7f3b09973980 20 remove_watcher() i=1 2024-09-18T02:04:22.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.200+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94306838471424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859e11a0 con 0x55c5859b2920 2024-09-18T02:04:22.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.204+0000 7f3b06c82640 1 -- 172.21.15.167:0/3309579562 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94306838471424] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0037040 con 0x55c5859b2920 2024-09-18T02:04:22.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.204+0000 7f3b09973980 20 remove_watcher() i=2 2024-09-18T02:04:22.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.204+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94306838484288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b6d00 con 0x7f3af001fbe0 2024-09-18T02:04:22.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.204+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94306838484288] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x7f3af001fbe0 2024-09-18T02:04:22.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.204+0000 7f3b09973980 20 remove_watcher() i=3 2024-09-18T02:04:22.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.204+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94306838488512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b7c60 con 0x55c5859a96a0 2024-09-18T02:04:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.208+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94306838488512] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8026040 con 0x55c5859a96a0 2024-09-18T02:04:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.208+0000 7f3b09973980 20 remove_watcher() i=4 2024-09-18T02:04:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.208+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94306838485536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b6300 con 0x55c5859ae060 2024-09-18T02:04:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.208+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94306838485536] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.208+0000 7f3b09973980 20 remove_watcher() i=5 2024-09-18T02:04:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.208+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94306838494976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b9540 con 0x55c5859ae060 2024-09-18T02:04:22.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94306838494976] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 20 remove_watcher() i=6 2024-09-18T02:04:22.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94306838498576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5859b7c60 con 0x55c5859ae060 2024-09-18T02:04:22.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b07483640 1 -- 172.21.15.167:0/3309579562 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94306838498576] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b00113030 con 0x55c5859ae060 2024-09-18T02:04:22.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 20 remove_watcher() i=7 2024-09-18T02:04:22.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5859ae060 msgr2=0x55c5859b0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5859ae060 0x55c5859b0450 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5859a96a0 msgr2=0x55c5859abb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5859a96a0 0x55c5859abb60 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3af001fbe0 msgr2=0x7f3af003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3af001fbe0 0x7f3af003a3c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5859b2920 msgr2=0x55c5859b4de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5859b2920 0x55c5859b4de0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39d0034650 msgr2=0x7f39d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39d0034650 0x7f39d0036b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c010 tx=0x7f3af0010000 comp rx=0 tx=0).stop 2024-09-18T02:04:22.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 msgr2=0x55c58599e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b07c84640 1 -- 172.21.15.167:0/3309579562 reap_dead start 2024-09-18T02:04:22.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c58599e7c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3b000bb670 tx=0x7f3b000f0e80 comp rx=0 tx=0).stop 2024-09-18T02:04:22.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 shutdown_connections 2024-09-18T02:04:22.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 --2- 172.21.15.167:0/3309579562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5859975a0 0x55c58599e7c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 >> 172.21.15.167:0/3309579562 conn(0x55c585993980 msgr2=0x55c585991a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 shutdown_connections 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/3309579562 wait complete. 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/4091133367 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39e0034650 msgr2=0x7f39e0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 --2- 172.21.15.167:0/4091133367 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39e0034650 0x7f39e0036b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55c58597d5f0 tx=0x7f3af000f000 comp rx=0 tx=0).stop 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/4091133367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c58598ac80 msgr2=0x55c58598b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 --2- 172.21.15.167:0/4091133367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c58598ac80 0x55c58598b0a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3b000e3500 tx=0x7f3b000b4690 comp rx=0 tx=0).stop 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/4091133367 shutdown_connections 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 --2- 172.21.15.167:0/4091133367 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39e0034650 0x7f39e0036b10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 --2- 172.21.15.167:0/4091133367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c58598ac80 0x55c58598b0a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/4091133367 >> 172.21.15.167:0/4091133367 conn(0x55c58597fdd0 msgr2=0x55c585982850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/4091133367 shutdown_connections 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.212+0000 7f3b09973980 1 -- 172.21.15.167:0/4091133367 wait complete. 2024-09-18T02:04:22.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c585976770 msgr2=0x55c585978b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c585976770 0x55c585978b60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5857ef7c0 msgr2=0x55c585973e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5857ef7c0 0x55c585973e00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c58597a670 msgr2=0x55c58597ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c58597a670 0x55c58597ca60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39ec034650 msgr2=0x7f39ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f39ec034650 0x7f39ec036b10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3af0000f70 tx=0x7f3af0001380 comp rx=0 tx=0).stop 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 msgr2=0x55c58596ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 --2- 172.21.15.167:0/3511169917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5857ef3b0 0x55c58596ce10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000a4e0 tx=0x7f3b00017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b07c84640 1 -- 172.21.15.167:0/3511169917 reap_dead start 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 shutdown_connections 2024-09-18T02:04:22.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 >> 172.21.15.167:0/3511169917 conn(0x55c5858741b0 msgr2=0x55c585960370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 shutdown_connections 2024-09-18T02:04:22.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.216+0000 7f3b09973980 1 -- 172.21.15.167:0/3511169917 wait complete. 2024-09-18T02:04:22.228 INFO:teuthology.orchestra.run.smithi167.stdout:{"key":"bucket:myfoo","ver":{"tag":"_YTES1PqYUNBpk7MxhPRoK2F","ver":2},"mtime":"2024-09-18T02:04:21.831175Z","data":{"bucket":{"name":"myfoo","marker":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","bucket_id":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-18T02:04:20.260735Z","linked":false,"has_bucket_info":false}} 2024-09-18T02:04:22.229 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_YTES1PqYUNBpk7MxhPRoK2F', 'ver': 2}, 'mtime': '2024-09-18T02:04:21.831175Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'bucket_id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-18T02:04:20.260735Z', 'linked': False, 'has_bucket_info': False}} 2024-09-18T02:04:22.229 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1'] 2024-09-18T02:04:22.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1'] 2024-09-18T02:04:22.229 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:22.305 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:22.305 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:22.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.304+0000 7f568ce99980 1 Processor -- start 2024-09-18T02:04:22.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.304+0000 7f568ce99980 1 -- start start 2024-09-18T02:04:22.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.304+0000 7f568ce99980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55837614b970 0x55837614dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.304+0000 7f568ce99980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558375fcfae0 con 0x5583761475f0 2024-09-18T02:04:22.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.304+0000 7f568ce99980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x558375ff3e30 con 0x55837614b970 2024-09-18T02:04:22.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.304+0000 7f568a1a8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55837614b970 0x55837614dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.304+0000 7f568a1a8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55837614b970 0x55837614dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57420/0 (socket says 172.21.15.167:57420) 2024-09-18T02:04:22.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.304+0000 7f568a1a8640 1 -- 172.21.15.167:0/2271934891 learned_addr learned my addr 172.21.15.167:0/2271934891 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.304+0000 7f568a1a8640 1 -- 172.21.15.167:0/2271934891 >> v1:172.21.15.81:6789/0 conn(0x5583761475f0 legacy=0x5583761479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.304+0000 7f568a1a8640 1 -- 172.21.15.167:0/2271934891 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837614f2b0 con 0x55837614b970 2024-09-18T02:04:22.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.308+0000 7f568a1a8640 1 --2- 172.21.15.167:0/2271934891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55837614b970 0x55837614dd60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f568000a5c0 tx=0x7f568001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9f0d2d5db8cac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.308+0000 7f56899a7640 1 -- 172.21.15.167:0/2271934891 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56800a6070 con 0x55837614b970 2024-09-18T02:04:22.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.312+0000 7f56899a7640 1 -- 172.21.15.167:0/2271934891 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56800af070 con 0x55837614b970 2024-09-18T02:04:22.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.312+0000 7f56899a7640 1 -- 172.21.15.167:0/2271934891 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56800aa5c0 con 0x55837614b970 2024-09-18T02:04:22.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.312+0000 7f568ce99980 1 -- 172.21.15.167:0/2271934891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55837614b970 msgr2=0x55837614dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.312+0000 7f568ce99980 1 --2- 172.21.15.167:0/2271934891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55837614b970 0x55837614dd60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f568000a5c0 tx=0x7f568001b340 comp rx=0 tx=0).stop 2024-09-18T02:04:22.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.312+0000 7f568ce99980 1 -- 172.21.15.167:0/2271934891 shutdown_connections 2024-09-18T02:04:22.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.312+0000 7f568ce99980 1 --2- 172.21.15.167:0/2271934891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55837614b970 0x55837614dd60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.312+0000 7f568ce99980 1 -- 172.21.15.167:0/2271934891 >> 172.21.15.167:0/2271934891 conn(0x558376143110 msgr2=0x558376145530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.312+0000 7f568ce99980 1 -- 172.21.15.167:0/2271934891 shutdown_connections 2024-09-18T02:04:22.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.312+0000 7f568ce99980 1 -- 172.21.15.167:0/2271934891 wait complete. 2024-09-18T02:04:22.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.328+0000 7f568ce99980 1 Processor -- start 2024-09-18T02:04:22.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.328+0000 7f568ce99980 1 -- start start 2024-09-18T02:04:22.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.328+0000 7f568ce99980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 0x558376232a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.328+0000 7f568ce99980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558375ff5200 con 0x5583761475f0 2024-09-18T02:04:22.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.328+0000 7f568a9a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 0x558376232a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.328+0000 7f568a9a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 0x558376232a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57430/0 (socket says 172.21.15.167:57430) 2024-09-18T02:04:22.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.328+0000 7f568a9a9640 1 -- 172.21.15.167:0/2213959955 learned_addr learned my addr 172.21.15.167:0/2213959955 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.328+0000 7f568a9a9640 1 -- 172.21.15.167:0/2213959955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558376233050 con 0x5583761475f0 2024-09-18T02:04:22.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.328+0000 7f568a9a9640 1 --2- 172.21.15.167:0/2213959955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 0x558376232a80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f567c00b1f0 tx=0x7f567c00b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6b46dc0645c17b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f5578e09640 1 -- 172.21.15.167:0/2213959955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567c00a040 con 0x5583761475f0 2024-09-18T02:04:22.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f5578e09640 1 -- 172.21.15.167:0/2213959955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c00f750 con 0x5583761475f0 2024-09-18T02:04:22.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f5578e09640 1 -- 172.21.15.167:0/2213959955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567c00fa70 con 0x5583761475f0 2024-09-18T02:04:22.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 -- 172.21.15.167:0/2213959955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 msgr2=0x558376232a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 --2- 172.21.15.167:0/2213959955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 0x558376232a80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f567c00b1f0 tx=0x7f567c00b6b0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 -- 172.21.15.167:0/2213959955 shutdown_connections 2024-09-18T02:04:22.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 --2- 172.21.15.167:0/2213959955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 0x558376232a80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 -- 172.21.15.167:0/2213959955 >> 172.21.15.167:0/2213959955 conn(0x558376143110 msgr2=0x55837622e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 -- 172.21.15.167:0/2213959955 shutdown_connections 2024-09-18T02:04:22.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 -- 172.21.15.167:0/2213959955 wait complete. 2024-09-18T02:04:22.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 Processor -- start 2024-09-18T02:04:22.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 -- start start 2024-09-18T02:04:22.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 0x5583760bdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55837614edb0 con 0x5583761475f0 2024-09-18T02:04:22.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568a9a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 0x5583760bdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568a9a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 0x5583760bdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57436/0 (socket says 172.21.15.167:57436) 2024-09-18T02:04:22.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568a9a9640 1 -- 172.21.15.167:0/1269258040 learned_addr learned my addr 172.21.15.167:0/1269258040 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568a9a9640 1 -- 172.21.15.167:0/1269258040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583760bc3b0 con 0x5583761475f0 2024-09-18T02:04:22.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568a9a9640 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 0x5583760bdc90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f567c00b6f0 tx=0x7f567c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f5577606640 1 -- 172.21.15.167:0/1269258040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567c001300 con 0x5583761475f0 2024-09-18T02:04:22.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583760bc640 con 0x5583761475f0 2024-09-18T02:04:22.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f5577606640 1 -- 172.21.15.167:0/1269258040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c01c9c0 con 0x5583761475f0 2024-09-18T02:04:22.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f5577606640 1 -- 172.21.15.167:0/1269258040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567c01cca0 con 0x5583761475f0 2024-09-18T02:04:22.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.332+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583760bcb90 con 0x5583761475f0 2024-09-18T02:04:22.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f5577606640 1 -- 172.21.15.167:0/1269258040 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f567c017050 con 0x5583761475f0 2024-09-18T02:04:22.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f5577606640 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5570034650 0x7f5570036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f5577606640 1 -- 172.21.15.167:0/1269258040 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f567c015020 con 0x5583761475f0 2024-09-18T02:04:22.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568a1a8640 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5570034650 0x7f5570036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568ce99980 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55837614b970 0x5583762432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558376243810 con 0x55837614b970 2024-09-18T02:04:22.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568b1aa640 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55837614b970 0x5583762432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568a1a8640 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5570034650 0x7f5570036b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f56800ae000 tx=0x7f56800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568b1aa640 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55837614b970 0x5583762432d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568b1aa640 1 -- 172.21.15.167:0/1269258040 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x55837614b970 2024-09-18T02:04:22.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558376243c60 con 0x55837614b970 2024-09-18T02:04:22.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568b1aa640 1 -- 172.21.15.167:0/1269258040 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f568400a4d0 con 0x55837614b970 2024-09-18T02:04:22.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568ce99980 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558376245a70 0x558376247e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558376248550 con 0x558376245a70 2024-09-18T02:04:22.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568a9a9640 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558376245a70 0x558376247e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.336+0000 7f568a9a9640 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558376245a70 0x558376247e60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568a9a9640 1 -- 172.21.15.167:0/1269258040 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f567c02e070 con 0x558376245a70 2024-09-18T02:04:22.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583762448e0 con 0x55837614b970 2024-09-18T02:04:22.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568b1aa640 1 -- 172.21.15.167:0/1269258040 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f568400a4d0 con 0x55837614b970 2024-09-18T02:04:22.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568ce99980 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5583762499b0 0x55837624bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55837624c4a0 con 0x5583762499b0 2024-09-18T02:04:22.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568a1a8640 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5583762499b0 0x55837624bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568a1a8640 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5583762499b0 0x55837624bda0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568a1a8640 1 -- 172.21.15.167:0/1269258040 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f56800aaad0 con 0x5583762499b0 2024-09-18T02:04:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568ce99980 1 Processor -- start 2024-09-18T02:04:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568ce99980 1 -- start start 2024-09-18T02:04:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568ce99980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376259f30 0x55837625a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568ce99980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55837604e800 con 0x558376259f30 2024-09-18T02:04:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568a9a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376259f30 0x55837625a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568a9a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376259f30 0x55837625a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57452/0 (socket says 172.21.15.167:57452) 2024-09-18T02:04:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568a9a9640 1 -- 172.21.15.167:0/4286421194 learned_addr learned my addr 172.21.15.167:0/4286421194 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568a9a9640 1 -- 172.21.15.167:0/4286421194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837625a890 con 0x558376259f30 2024-09-18T02:04:22.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568a9a9640 1 --2- 172.21.15.167:0/4286421194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376259f30 0x55837625a350 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f567c048710 tx=0x7f567c00e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f5574e01640 1 -- 172.21.15.167:0/4286421194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567c01bfc0 con 0x558376259f30 2024-09-18T02:04:22.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568ce99980 1 -- 172.21.15.167:0/4286421194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55837625ab20 con 0x558376259f30 2024-09-18T02:04:22.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f5574e01640 1 -- 172.21.15.167:0/4286421194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c01c160 con 0x558376259f30 2024-09-18T02:04:22.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f5574e01640 1 -- 172.21.15.167:0/4286421194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567c02fa90 con 0x558376259f30 2024-09-18T02:04:22.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.340+0000 7f568ce99980 1 -- 172.21.15.167:0/4286421194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837625d7a0 con 0x558376259f30 2024-09-18T02:04:22.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f5574e01640 1 -- 172.21.15.167:0/4286421194 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f567c02fc30 con 0x558376259f30 2024-09-18T02:04:22.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f5574e01640 1 --2- 172.21.15.167:0/4286421194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5564034650 0x7f5564036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f5574e01640 1 -- 172.21.15.167:0/4286421194 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f567c03db00 con 0x558376259f30 2024-09-18T02:04:22.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568a1a8640 1 --2- 172.21.15.167:0/4286421194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5564034650 0x7f5564036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 Processor -- start 2024-09-18T02:04:22.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 -- start start 2024-09-18T02:04:22.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x558376266c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5583762333d0 con 0x558376266800 2024-09-18T02:04:22.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568a1a8640 1 --2- 172.21.15.167:0/4286421194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5564034650 0x7f5564036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5583760bcf70 tx=0x7f5680005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568a9a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x558376266c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568a9a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x558376266c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57456/0 (socket says 172.21.15.167:57456) 2024-09-18T02:04:22.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568a9a9640 1 -- 172.21.15.167:0/47049648 learned_addr learned my addr 172.21.15.167:0/47049648 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568a9a9640 1 -- 172.21.15.167:0/47049648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583762671d0 con 0x558376266800 2024-09-18T02:04:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568a9a9640 1 --2- 172.21.15.167:0/47049648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x558376266c00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f567c029fd0 tx=0x7f567c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dddb93b17e36b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f556e7fc640 1 -- 172.21.15.167:0/47049648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567c052040 con 0x558376266800 2024-09-18T02:04:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f556e7fc640 1 -- 172.21.15.167:0/47049648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c05c070 con 0x558376266800 2024-09-18T02:04:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f556e7fc640 1 -- 172.21.15.167:0/47049648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567c03de20 con 0x558376266800 2024-09-18T02:04:22.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 -- 172.21.15.167:0/47049648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 msgr2=0x558376266c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 --2- 172.21.15.167:0/47049648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x558376266c00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f567c029fd0 tx=0x7f567c0317b0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 -- 172.21.15.167:0/47049648 shutdown_connections 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 --2- 172.21.15.167:0/47049648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x558376266c00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 -- 172.21.15.167:0/47049648 >> 172.21.15.167:0/47049648 conn(0x558376262be0 msgr2=0x558376260ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 -- 172.21.15.167:0/47049648 shutdown_connections 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 -- 172.21.15.167:0/47049648 wait complete. 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.344+0000 7f568ce99980 1 Processor -- start 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568ce99980 1 -- start start 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568ce99980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x55837626da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568ce99980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558376267650 con 0x558376266800 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568a9a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x55837626da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568a9a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x55837626da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57462/0 (socket says 172.21.15.167:57462) 2024-09-18T02:04:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 learned_addr learned my addr 172.21.15.167:0/2043168503 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837626df40 con 0x558376266800 2024-09-18T02:04:22.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568a9a9640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x55837626da00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f567c0474e0 tx=0x7f567c002550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f556cff9640 1 -- 172.21.15.167:0/2043168503 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567c03de20 con 0x558376266800 2024-09-18T02:04:22.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55837626df40 con 0x558376266800 2024-09-18T02:04:22.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f556cff9640 1 -- 172.21.15.167:0/2043168503 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c067070 con 0x558376266800 2024-09-18T02:04:22.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f556cff9640 1 -- 172.21.15.167:0/2043168503 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567c01a480 con 0x558376266800 2024-09-18T02:04:22.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837626e3b0 con 0x558376266800 2024-09-18T02:04:22.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f556cff9640 1 -- 172.21.15.167:0/2043168503 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f567c01a620 con 0x558376266800 2024-09-18T02:04:22.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f556cff9640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5554034650 0x7f5554036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f556cff9640 1 -- 172.21.15.167:0/2043168503 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f567c066a50 con 0x558376266800 2024-09-18T02:04:22.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568a1a8640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5554034650 0x7f5554036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568ce99980 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558376278aa0 0x55837627af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55837627b6b0 con 0x558376278aa0 2024-09-18T02:04:22.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568b1aa640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558376278aa0 0x55837627af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.348+0000 7f568a1a8640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5554034650 0x7f5554036b10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5680000c10 tx=0x7f56800c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568b1aa640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558376278aa0 0x55837627af60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 20 realm 2024-09-18T02:04:22.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55837627bac0 con 0x558376278aa0 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55837627c390 con 0x558376278aa0 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55837627c730 con 0x558376278aa0 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55837627d490 0x55837627f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x55837627d490 2024-09-18T02:04:22.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568a9a9640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55837627d490 0x55837627f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568a9a9640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55837627d490 0x55837627f880 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 20 searching for the correct realm 2024-09-18T02:04:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558376281de0 0x5583762841f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583762848c0 con 0x558376281de0 2024-09-18T02:04:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568a1a8640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558376281de0 0x5583762841f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568a1a8640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558376281de0 0x5583762841f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.352+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568a1a8640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f56800e0040 0x7f56800e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5583762848c0 con 0x7f56800e0040 2024-09-18T02:04:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568b1aa640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f56800e0040 0x7f56800e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568b1aa640 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f56800e0040 0x7f56800e0420 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627c730 con 0x55837627d490 2024-09-18T02:04:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376278aa0 2024-09-18T02:04:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376278aa0 2024-09-18T02:04:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x55837627d490 2024-09-18T02:04:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x55837627d490 2024-09-18T02:04:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x7f56800e0040 2024-09-18T02:04:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376281de0 2024-09-18T02:04:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.356+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376278aa0 2024-09-18T02:04:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x55837627d490 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376278aa0 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x7f56800e0040 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376281de0 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376281de0 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x55837627d490 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376281de0 2024-09-18T02:04:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376281de0 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376278aa0 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376278aa0 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.360+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x55837627d490 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376281de0 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x7f56800e0040 2024-09-18T02:04:22.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376278aa0 2024-09-18T02:04:22.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x55837627d490 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376281de0 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x55837627d490 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x7f56800e0040 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376281de0 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.364+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x55837627d490 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x558376278aa0 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55837627fe90 con 0x7f56800e0040 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55837627c730 con 0x558376278aa0 2024-09-18T02:04:22.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55837627c730 con 0x558376278aa0 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55837627c730 con 0x558376281de0 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 zone default found 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 4 Realm: () 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:22.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 zonegroup default 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558376280d30 con 0x55837627d490 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558376286720 con 0x558376281de0 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558376286ac0 con 0x558376281de0 2024-09-18T02:04:22.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 started sync module instance, tier type = 2024-09-18T02:04:22.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:22.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.368+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558376285bc0 con 0x7f56800e0040 2024-09-18T02:04:22.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.372+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.372+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94023111434208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558376285bc0 con 0x7f56800e0040 2024-09-18T02:04:22.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.372+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558376287370 con 0x558376278aa0 2024-09-18T02:04:22.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.372+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.372+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94023111437920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558376287330 con 0x558376278aa0 2024-09-18T02:04:22.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.372+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762882d0 con 0x558376281de0 2024-09-18T02:04:22.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.372+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94023111434208] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.376+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.376+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94023111431952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762886f0 con 0x558376281de0 2024-09-18T02:04:22.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.376+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762890b0 con 0x7f56800e0040 2024-09-18T02:04:22.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.376+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94023111437920] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.376+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.376+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94023111445504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762894d0 con 0x7f56800e0040 2024-09-18T02:04:22.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.376+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558376289d20 con 0x558376278aa0 2024-09-18T02:04:22.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.376+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94023111431952] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.376+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94023111445504] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.380+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.380+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94023111446560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762898f0 con 0x558376278aa0 2024-09-18T02:04:22.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.380+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55837628a5c0 con 0x55837627d490 2024-09-18T02:04:22.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.380+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.380+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94023111450896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762898f0 con 0x55837627d490 2024-09-18T02:04:22.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.380+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55837628b000 con 0x55837627d490 2024-09-18T02:04:22.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.380+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94023111446560] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94023111450896] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94023111447616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558376289860 con 0x55837627d490 2024-09-18T02:04:22.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55837628b4b0 con 0x55837627d490 2024-09-18T02:04:22.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94023111447616] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94023111453520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55837628b420 con 0x55837627d490 2024-09-18T02:04:22.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568ce99980 20 add_watcher() i=0 2024-09-18T02:04:22.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568ce99980 20 add_watcher() i=1 2024-09-18T02:04:22.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568ce99980 20 add_watcher() i=2 2024-09-18T02:04:22.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568ce99980 20 add_watcher() i=3 2024-09-18T02:04:22.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568ce99980 20 add_watcher() i=4 2024-09-18T02:04:22.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568ce99980 20 add_watcher() i=5 2024-09-18T02:04:22.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.384+0000 7f568ce99980 20 add_watcher() i=6 2024-09-18T02:04:22.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.388+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94023111453520] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.388+0000 7f568ce99980 20 add_watcher() i=7 2024-09-18T02:04:22.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.388+0000 7f568ce99980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:22.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.388+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55837628e960 con 0x558376278aa0 2024-09-18T02:04:22.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.388+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.392 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.388+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94023111455248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55837628bd30 con 0x558376278aa0 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.388+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94023111455248] v30'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.388+0000 7f55417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.388+0000 7f568ce99980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.388+0000 7f568ce99980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.388+0000 7f568ce99980 5 note: GC not initialized 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f54bbfff640 20 reqs_thread_entry: start 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 20 Filter name: none 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f54b9ffb640 20 reqs_thread_entry: start 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583762b1fb0 con 0x55837627d490 2024-09-18T02:04:22.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T02:04:22.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T02:04:22.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:04:22.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:22.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583762b4090 con 0x7f56800e0040 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 : miss 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583762b58c0 con 0x558376281de0 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:22.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:22.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:22.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:22.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:22.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-18T02:04:22.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.392+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762b9f10 con 0x7f56800e0040 2024-09-18T02:04:22.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762bfe50 con 0x558376281de0 2024-09-18T02:04:22.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(66 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568ce99980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568ce99980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568ce99980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568ce99980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1, ofs0, ns] 2024-09-18T02:04:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94023111627152 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583762ba340 con 0x55837627d490 2024-09-18T02:04:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== watch-notify(notify (1) cookie 94023111453520 notify 128849018884 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55837625ab20 con 0x55837627d490 2024-09-18T02:04:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f556e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94023111453520 notifier 4508 bl.length()=752 2024-09-18T02:04:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f556e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:22.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f556e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:22.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f556e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:22.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f556e7fc640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5550003eb0 con 0x55837627d490 2024-09-18T02:04:22.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(67 notify.7 [notify cookie 94023111627152 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.396+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== watch-notify(notify_complete (2) cookie 94023111627152 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55837625a890 con 0x55837627d490 2024-09-18T02:04:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.400+0000 7f568ce99980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_sources= new_sources= 2024-09-18T02:04:22.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.400+0000 7f568ce99980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential sources added=[] removed=[] 2024-09-18T02:04:22.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.400+0000 7f568ce99980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_dests= new_dests= 2024-09-18T02:04:22.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.400+0000 7f568ce99980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential dests added=[] removed=[] 2024-09-18T02:04:22.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.400+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762be630 con 0x55837627d490 2024-09-18T02:04:22.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.400+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(69 fud.buckets [call] v30'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.400+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762bf640 con 0x7f56800e0040 2024-09-18T02:04:22.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f568ce99980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T02:04:22.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f568ce99980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:22.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f568ce99980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T02:04:22.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94023111627152 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5583762beae0 con 0x55837627d490 2024-09-18T02:04:22.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== watch-notify(notify (1) cookie 94023111447616 notify 128849018885 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5583760bcb90 con 0x55837627d490 2024-09-18T02:04:22.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f556dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94023111447616 notifier 4508 bl.length()=314 2024-09-18T02:04:22.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f556dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T02:04:22.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f556dffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:22.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f556dffb640 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f54c0003410 con 0x55837627d490 2024-09-18T02:04:22.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(71 notify.6 [notify cookie 94023111627152 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.404+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== watch-notify(notify_complete (2) cookie 94023111627152 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5583760bc640 con 0x55837627d490 2024-09-18T02:04:22.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.408+0000 7f55417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:22.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.408+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94023111455248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762afde0 con 0x558376278aa0 2024-09-18T02:04:22.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.408+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94023111455248] v30'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.408+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94023111434208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762afde0 con 0x7f56800e0040 2024-09-18T02:04:22.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.408+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94023111434208] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.408+0000 7f568ce99980 20 remove_watcher() i=0 2024-09-18T02:04:22.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.408+0000 7f568ce99980 2 removed watcher, disabling cache 2024-09-18T02:04:22.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.408+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94023111437920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558376285fe0 con 0x558376278aa0 2024-09-18T02:04:22.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.412+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94023111437920] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.412+0000 7f568ce99980 20 remove_watcher() i=1 2024-09-18T02:04:22.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.412+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94023111431952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762afde0 con 0x558376281de0 2024-09-18T02:04:22.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.412+0000 7f568a1a8640 1 -- 172.21.15.167:0/2043168503 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94023111431952] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56800aaad0 con 0x558376281de0 2024-09-18T02:04:22.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.412+0000 7f568ce99980 20 remove_watcher() i=2 2024-09-18T02:04:22.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.412+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94023111445504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558376285710 con 0x7f56800e0040 2024-09-18T02:04:22.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.416+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94023111445504] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x7f56800e0040 2024-09-18T02:04:22.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.416+0000 7f568ce99980 20 remove_watcher() i=3 2024-09-18T02:04:22.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.416+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94023111446560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762afde0 con 0x558376278aa0 2024-09-18T02:04:22.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.416+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94023111446560] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f568400a4d0 con 0x558376278aa0 2024-09-18T02:04:22.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.416+0000 7f568ce99980 20 remove_watcher() i=4 2024-09-18T02:04:22.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.416+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94023111450896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762afde0 con 0x55837627d490 2024-09-18T02:04:22.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.420+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94023111450896] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.420+0000 7f568ce99980 20 remove_watcher() i=5 2024-09-18T02:04:22.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.420+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94023111447616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55837628a110 con 0x55837627d490 2024-09-18T02:04:22.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.420+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94023111447616] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.420+0000 7f568ce99980 20 remove_watcher() i=6 2024-09-18T02:04:22.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.420+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94023111453520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5583762afde0 con 0x55837627d490 2024-09-18T02:04:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568a9a9640 1 -- 172.21.15.167:0/2043168503 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94023111453520] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567c055040 con 0x55837627d490 2024-09-18T02:04:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 20 remove_watcher() i=7 2024-09-18T02:04:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55837627d490 msgr2=0x55837627f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55837627d490 0x55837627f880 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558376278aa0 msgr2=0x55837627af60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558376278aa0 0x55837627af60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f56800e0040 msgr2=0x7f56800e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f56800e0040 0x7f56800e0420 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558376281de0 msgr2=0x5583762841f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558376281de0 0x5583762841f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5554034650 msgr2=0x7f5554036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5554034650 0x7f5554036b10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5680000c10 tx=0x7f56800c1040 comp rx=0 tx=0).stop 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568b1aa640 1 -- 172.21.15.167:0/2043168503 reap_dead start 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 msgr2=0x55837626da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x55837626da00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f567c0474e0 tx=0x7f567c002550 comp rx=0 tx=0).stop 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 shutdown_connections 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/2043168503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376266800 0x55837626da00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 >> 172.21.15.167:0/2043168503 conn(0x558376262be0 msgr2=0x558376260cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 shutdown_connections 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/2043168503 wait complete. 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/4286421194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5564034650 msgr2=0x7f5564036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/4286421194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5564034650 0x7f5564036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5583760bcf70 tx=0x7f5680005ad0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/4286421194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376259f30 msgr2=0x55837625a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/4286421194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376259f30 0x55837625a350 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f567c048710 tx=0x7f567c00e900 comp rx=0 tx=0).stop 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/4286421194 shutdown_connections 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/4286421194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5564034650 0x7f5564036b10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/4286421194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558376259f30 0x55837625a350 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/4286421194 >> 172.21.15.167:0/4286421194 conn(0x55837624f080 msgr2=0x558376251b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/4286421194 shutdown_connections 2024-09-18T02:04:22.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/4286421194 wait complete. 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558376245a70 msgr2=0x558376247e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558376245a70 0x558376247e60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55837614b970 msgr2=0x5583762432d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55837614b970 0x5583762432d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5583762499b0 msgr2=0x55837624bda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5583762499b0 0x55837624bda0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5570034650 msgr2=0x7f5570036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5570034650 0x7f5570036b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f56800ae000 tx=0x7f56800a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 msgr2=0x5583760bdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 --2- 172.21.15.167:0/1269258040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583761475f0 0x5583760bdc90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f567c00b6f0 tx=0x7f567c000ee0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568b1aa640 1 -- 172.21.15.167:0/1269258040 reap_dead start 2024-09-18T02:04:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 shutdown_connections 2024-09-18T02:04:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 >> 172.21.15.167:0/1269258040 conn(0x558376143110 msgr2=0x55837622d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 shutdown_connections 2024-09-18T02:04:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.424+0000 7f568ce99980 1 -- 172.21.15.167:0/1269258040 wait complete. 2024-09-18T02:04:22.440 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-18T02:04:22.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-18T02:04:22.441 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-18T02:04:22.522 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:22.522 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:22.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.520+0000 7ff423da4980 1 Processor -- start 2024-09-18T02:04:22.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.520+0000 7ff423da4980 1 -- start start 2024-09-18T02:04:22.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.520+0000 7ff423da4980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55bf43401e50 0x55bf43404240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.520+0000 7ff423da4980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bf43283ae0 con 0x55bf4336fb00 2024-09-18T02:04:22.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.520+0000 7ff423da4980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55bf432a7e30 con 0x55bf43401e50 2024-09-18T02:04:22.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.520+0000 7ff4210b3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55bf43401e50 0x55bf43404240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.520+0000 7ff4210b3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55bf43401e50 0x55bf43404240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57466/0 (socket says 172.21.15.167:57466) 2024-09-18T02:04:22.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.520+0000 7ff4210b3640 1 -- 172.21.15.167:0/1048231418 learned_addr learned my addr 172.21.15.167:0/1048231418 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.520+0000 7ff4218b4640 1 --1- 172.21.15.167:0/1048231418 >> v1:172.21.15.81:6789/0 conn(0x55bf4336fb00 0x55bf43400730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55658/0 (socket says 172.21.15.167:55658) 2024-09-18T02:04:22.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.520+0000 7ff4210b3640 1 -- 172.21.15.167:0/1048231418 >> v1:172.21.15.81:6789/0 conn(0x55bf4336fb00 legacy=0x55bf43400730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.520+0000 7ff4210b3640 1 -- 172.21.15.167:0/1048231418 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf4336fee0 con 0x55bf43401e50 2024-09-18T02:04:22.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.524+0000 7ff4210b3640 1 --2- 172.21.15.167:0/1048231418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf43401e50 0x55bf43404240 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00a5c0 tx=0x7ff40c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470c4a2ed3848c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.524+0000 7ff4208b2640 1 -- 172.21.15.167:0/1048231418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff40c0a6070 con 0x55bf43401e50 2024-09-18T02:04:22.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.524+0000 7ff4208b2640 1 -- 172.21.15.167:0/1048231418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40c0af070 con 0x55bf43401e50 2024-09-18T02:04:22.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.524+0000 7ff4208b2640 1 -- 172.21.15.167:0/1048231418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff40c0aa5c0 con 0x55bf43401e50 2024-09-18T02:04:22.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.524+0000 7ff423da4980 1 -- 172.21.15.167:0/1048231418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf43401e50 msgr2=0x55bf43404240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.524+0000 7ff423da4980 1 --2- 172.21.15.167:0/1048231418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf43401e50 0x55bf43404240 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00a5c0 tx=0x7ff40c01b340 comp rx=0 tx=0).stop 2024-09-18T02:04:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.524+0000 7ff423da4980 1 -- 172.21.15.167:0/1048231418 shutdown_connections 2024-09-18T02:04:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.524+0000 7ff423da4980 1 --2- 172.21.15.167:0/1048231418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf43401e50 0x55bf43404240 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.524+0000 7ff423da4980 1 -- 172.21.15.167:0/1048231418 >> 172.21.15.167:0/1048231418 conn(0x55bf433f6060 msgr2=0x55bf433f8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.524+0000 7ff423da4980 1 -- 172.21.15.167:0/1048231418 shutdown_connections 2024-09-18T02:04:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.524+0000 7ff423da4980 1 -- 172.21.15.167:0/1048231418 wait complete. 2024-09-18T02:04:22.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff423da4980 1 Processor -- start 2024-09-18T02:04:22.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff423da4980 1 -- start start 2024-09-18T02:04:22.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff423da4980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 0x55bf434e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff423da4980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bf432a9200 con 0x55bf4336fb00 2024-09-18T02:04:22.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff4218b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 0x55bf434e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff4218b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 0x55bf434e8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57468/0 (socket says 172.21.15.167:57468) 2024-09-18T02:04:22.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff4218b4640 1 -- 172.21.15.167:0/3815634625 learned_addr learned my addr 172.21.15.167:0/3815634625 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff4218b4640 1 -- 172.21.15.167:0/3815634625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf434e91e0 con 0x55bf4336fb00 2024-09-18T02:04:22.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff4218b4640 1 --2- 172.21.15.167:0/3815634625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 0x55bf434e8c10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff4140015f0 tx=0x7ff414001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5369366773420c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff30fe07640 1 -- 172.21.15.167:0/3815634625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff414013420 con 0x55bf4336fb00 2024-09-18T02:04:22.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff30fe07640 1 -- 172.21.15.167:0/3815634625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4140135e0 con 0x55bf4336fb00 2024-09-18T02:04:22.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.540+0000 7ff30fe07640 1 -- 172.21.15.167:0/3815634625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff414013940 con 0x55bf4336fb00 2024-09-18T02:04:22.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 -- 172.21.15.167:0/3815634625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 msgr2=0x55bf434e8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 --2- 172.21.15.167:0/3815634625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 0x55bf434e8c10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff4140015f0 tx=0x7ff414001ab0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 -- 172.21.15.167:0/3815634625 shutdown_connections 2024-09-18T02:04:22.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 --2- 172.21.15.167:0/3815634625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 0x55bf434e8c10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 -- 172.21.15.167:0/3815634625 >> 172.21.15.167:0/3815634625 conn(0x55bf433f6060 msgr2=0x55bf434e4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 -- 172.21.15.167:0/3815634625 shutdown_connections 2024-09-18T02:04:22.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 -- 172.21.15.167:0/3815634625 wait complete. 2024-09-18T02:04:22.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 Processor -- start 2024-09-18T02:04:22.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 -- start start 2024-09-18T02:04:22.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 0x55bf434effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bf43407210 con 0x55bf4336fb00 2024-09-18T02:04:22.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff4218b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 0x55bf434effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff4218b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 0x55bf434effe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57482/0 (socket says 172.21.15.167:57482) 2024-09-18T02:04:22.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff4218b4640 1 -- 172.21.15.167:0/2532373914 learned_addr learned my addr 172.21.15.167:0/2532373914 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff4218b4640 1 -- 172.21.15.167:0/2532373914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf434f0520 con 0x55bf4336fb00 2024-09-18T02:04:22.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff4218b4640 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 0x55bf434effe0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff414006640 tx=0x7ff414000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff30e604640 1 -- 172.21.15.167:0/2532373914 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff414022020 con 0x55bf4336fb00 2024-09-18T02:04:22.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf434f07b0 con 0x55bf4336fb00 2024-09-18T02:04:22.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff30e604640 1 -- 172.21.15.167:0/2532373914 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff414006320 con 0x55bf4336fb00 2024-09-18T02:04:22.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff30e604640 1 -- 172.21.15.167:0/2532373914 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff414004ab0 con 0x55bf4336fb00 2024-09-18T02:04:22.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.544+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf434f3490 con 0x55bf4336fb00 2024-09-18T02:04:22.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff30e604640 1 -- 172.21.15.167:0/2532373914 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff414025020 con 0x55bf4336fb00 2024-09-18T02:04:22.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff30e604640 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff308034650 0x7ff308036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff30e604640 1 -- 172.21.15.167:0/2532373914 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff414018030 con 0x55bf4336fb00 2024-09-18T02:04:22.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff4210b3640 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff308034650 0x7ff308036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff423da4980 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bf43401e50 0x55bf434f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf434f7660 con 0x55bf43401e50 2024-09-18T02:04:22.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff4220b5640 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bf43401e50 0x55bf434f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff4210b3640 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff308034650 0x7ff308036b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0ae000 tx=0x7ff40c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff4220b5640 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bf43401e50 0x55bf434f7020 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff4220b5640 1 -- 172.21.15.167:0/2532373914 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff41c0083f0 con 0x55bf43401e50 2024-09-18T02:04:22.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf434f4690 con 0x55bf43401e50 2024-09-18T02:04:22.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff4220b5640 1 -- 172.21.15.167:0/2532373914 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff41c0083f0 con 0x55bf43401e50 2024-09-18T02:04:22.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff423da4980 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bf434f9990 0x55bf434fbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf434fc450 con 0x55bf434f9990 2024-09-18T02:04:22.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff4218b4640 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bf434f9990 0x55bf434fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff4218b4640 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bf434f9990 0x55bf434fbd80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff4218b4640 1 -- 172.21.15.167:0/2532373914 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff41401b070 con 0x55bf434f9990 2024-09-18T02:04:22.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf434f8830 con 0x55bf43401e50 2024-09-18T02:04:22.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff4220b5640 1 -- 172.21.15.167:0/2532373914 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff41c0083f0 con 0x55bf43401e50 2024-09-18T02:04:22.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff423da4980 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55bf434fd890 0x55bf434ffc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.548+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf43500410 con 0x55bf434fd890 2024-09-18T02:04:22.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff4210b3640 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55bf434fd890 0x55bf434ffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff4210b3640 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55bf434fd890 0x55bf434ffc80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff4210b3640 1 -- 172.21.15.167:0/2532373914 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf434fd890 2024-09-18T02:04:22.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff423da4980 1 Processor -- start 2024-09-18T02:04:22.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff423da4980 1 -- start start 2024-09-18T02:04:22.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff423da4980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4350dea0 0x55bf4350e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff423da4980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bf43302800 con 0x55bf4350dea0 2024-09-18T02:04:22.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff4218b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4350dea0 0x55bf4350e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff4218b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4350dea0 0x55bf4350e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57494/0 (socket says 172.21.15.167:57494) 2024-09-18T02:04:22.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff4218b4640 1 -- 172.21.15.167:0/2017456517 learned_addr learned my addr 172.21.15.167:0/2017456517 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff4218b4640 1 -- 172.21.15.167:0/2017456517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf4350e800 con 0x55bf4350dea0 2024-09-18T02:04:22.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff4218b4640 1 --2- 172.21.15.167:0/2017456517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4350dea0 0x55bf4350e2c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff4140069a0 tx=0x7ff414010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff3077fe640 1 -- 172.21.15.167:0/2017456517 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff414041f80 con 0x55bf4350dea0 2024-09-18T02:04:22.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff3077fe640 1 -- 172.21.15.167:0/2017456517 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41401d580 con 0x55bf4350dea0 2024-09-18T02:04:22.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff423da4980 1 -- 172.21.15.167:0/2017456517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf4350ea90 con 0x55bf4350dea0 2024-09-18T02:04:22.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff3077fe640 1 -- 172.21.15.167:0/2017456517 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff41401d8a0 con 0x55bf4350dea0 2024-09-18T02:04:22.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.552+0000 7ff423da4980 1 -- 172.21.15.167:0/2017456517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf43511710 con 0x55bf4350dea0 2024-09-18T02:04:22.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff3077fe640 1 -- 172.21.15.167:0/2017456517 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff414010070 con 0x55bf4350dea0 2024-09-18T02:04:22.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff3077fe640 1 --2- 172.21.15.167:0/2017456517 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff2fc034650 0x7ff2fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff3077fe640 1 -- 172.21.15.167:0/2017456517 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff41404a060 con 0x55bf4350dea0 2024-09-18T02:04:22.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff4210b3640 1 --2- 172.21.15.167:0/2017456517 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff2fc034650 0x7ff2fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 Processor -- start 2024-09-18T02:04:22.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 -- start start 2024-09-18T02:04:22.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 0x55bf4351ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bf434e9560 con 0x55bf4351a770 2024-09-18T02:04:22.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff4210b3640 1 --2- 172.21.15.167:0/2017456517 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff2fc034650 0x7ff2fc036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff40c000c10 tx=0x7ff40c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff4218b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 0x55bf4351ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff4218b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 0x55bf4351ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57506/0 (socket says 172.21.15.167:57506) 2024-09-18T02:04:22.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff4218b4640 1 -- 172.21.15.167:0/2214149893 learned_addr learned my addr 172.21.15.167:0/2214149893 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff4218b4640 1 -- 172.21.15.167:0/2214149893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf4351b120 con 0x55bf4351a770 2024-09-18T02:04:22.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff4218b4640 1 --2- 172.21.15.167:0/2214149893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 0x55bf4351ab50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff414011ff0 tx=0x7ff41403b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98090ec0152ceafe server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff3057fa640 1 -- 172.21.15.167:0/2214149893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4140412c0 con 0x55bf4351a770 2024-09-18T02:04:22.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff3057fa640 1 -- 172.21.15.167:0/2214149893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff414059070 con 0x55bf4351a770 2024-09-18T02:04:22.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff3057fa640 1 -- 172.21.15.167:0/2214149893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff41401da40 con 0x55bf4351a770 2024-09-18T02:04:22.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 -- 172.21.15.167:0/2214149893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 msgr2=0x55bf4351ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 --2- 172.21.15.167:0/2214149893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 0x55bf4351ab50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff414011ff0 tx=0x7ff41403b500 comp rx=0 tx=0).stop 2024-09-18T02:04:22.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 -- 172.21.15.167:0/2214149893 shutdown_connections 2024-09-18T02:04:22.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 --2- 172.21.15.167:0/2214149893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 0x55bf4351ab50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 -- 172.21.15.167:0/2214149893 >> 172.21.15.167:0/2214149893 conn(0x55bf43516b50 msgr2=0x55bf43514c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 -- 172.21.15.167:0/2214149893 shutdown_connections 2024-09-18T02:04:22.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 -- 172.21.15.167:0/2214149893 wait complete. 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 Processor -- start 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 -- start start 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 0x55bf435218b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff423da4980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bf4351b5c0 con 0x55bf4351a770 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.556+0000 7ff4218b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 0x55bf435218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff4218b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 0x55bf435218b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57512/0 (socket says 172.21.15.167:57512) 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 learned_addr learned my addr 172.21.15.167:0/1824546068 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf43521df0 con 0x55bf4351a770 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff4218b4640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 0x55bf435218b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff414011ff0 tx=0x7ff414018e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff2f37fe640 1 -- 172.21.15.167:0/1824546068 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff41406d070 con 0x55bf4351a770 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf43521df0 con 0x55bf4351a770 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff2f37fe640 1 -- 172.21.15.167:0/1824546068 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41402f390 con 0x55bf4351a770 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff2f37fe640 1 -- 172.21.15.167:0/1824546068 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff414026ab0 con 0x55bf4351a770 2024-09-18T02:04:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf435222c0 con 0x55bf4351a770 2024-09-18T02:04:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff2f37fe640 1 -- 172.21.15.167:0/1824546068 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff414070070 con 0x55bf4351a770 2024-09-18T02:04:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff2f37fe640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff2ec034650 0x7ff2ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff2f37fe640 1 -- 172.21.15.167:0/1824546068 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff414065070 con 0x55bf4351a770 2024-09-18T02:04:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff4210b3640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff2ec034650 0x7ff2ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff423da4980 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bf4352c9e0 0x55bf4352eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf4352f5f0 con 0x55bf4352c9e0 2024-09-18T02:04:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff4220b5640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bf4352c9e0 0x55bf4352eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff4210b3640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff2ec034650 0x7ff2ec036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0aa910 tx=0x7ff40c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff4220b5640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bf4352c9e0 0x55bf4352eea0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff41c0083f0 con 0x55bf4352c9e0 2024-09-18T02:04:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff423da4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff423da4980 20 realm 2024-09-18T02:04:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.560+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf4352fa00 con 0x55bf4352c9e0 2024-09-18T02:04:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff41c0083f0 con 0x55bf4352c9e0 2024-09-18T02:04:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf435302a0 con 0x55bf4352c9e0 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff41c0083f0 con 0x55bf4352c9e0 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf4352c9e0 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff41c0083f0 con 0x55bf4352c9e0 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bf435313a0 0x55bf43533790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf43533e30 con 0x55bf435313a0 2024-09-18T02:04:22.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4218b4640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bf435313a0 0x55bf43533790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4218b4640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bf435313a0 0x55bf43533790 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:22.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 20 searching for the correct realm 2024-09-18T02:04:22.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55bf43535d10 0x55bf43538180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43538800 con 0x55bf43535d10 2024-09-18T02:04:22.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4210b3640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55bf43535d10 0x55bf43538180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4210b3640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55bf43535d10 0x55bf43538180 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4210b3640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff40c0e0040 0x7ff40c0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43538800 con 0x7ff40c0e0040 2024-09-18T02:04:22.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4220b5640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff40c0e0040 0x7ff40c0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.564+0000 7ff4220b5640 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff40c0e0040 0x7ff40c0e0420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41c0083f0 con 0x7ff40c0e0040 2024-09-18T02:04:22.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf435313a0 2024-09-18T02:04:22.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf4352c9e0 2024-09-18T02:04:22.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41c0083f0 con 0x55bf4352c9e0 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf4352c9e0 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf435313a0 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf435313a0 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x7ff40c0e0040 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf43535d10 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf4352c9e0 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.568+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf435313a0 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf4352c9e0 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x7ff40c0e0040 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf43535d10 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf43535d10 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf435313a0 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf43535d10 2024-09-18T02:04:22.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf43535d10 2024-09-18T02:04:22.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf4352c9e0 2024-09-18T02:04:22.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf4352c9e0 2024-09-18T02:04:22.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.572+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf435313a0 2024-09-18T02:04:22.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf43535d10 2024-09-18T02:04:22.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x7ff40c0e0040 2024-09-18T02:04:22.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf4352c9e0 2024-09-18T02:04:22.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf435313a0 2024-09-18T02:04:22.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf43535d10 2024-09-18T02:04:22.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf435313a0 2024-09-18T02:04:22.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x7ff40c0e0040 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf43535d10 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf435313a0 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.576+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x55bf4352c9e0 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bf43530640 con 0x7ff40c0e0040 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:22.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf43534680 con 0x55bf4352c9e0 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf43534680 con 0x55bf4352c9e0 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf43534680 con 0x55bf43535d10 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 zone default found 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 4 Realm: () 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 zonegroup default 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf43535000 con 0x55bf435313a0 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353a6c0 con 0x55bf43535d10 2024-09-18T02:04:22.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353ab50 con 0x55bf43535d10 2024-09-18T02:04:22.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 started sync module instance, tier type = 2024-09-18T02:04:22.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:22.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.580+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf43539b00 con 0x7ff40c0e0040 2024-09-18T02:04:22.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.584+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.584+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94279956668448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf43539b00 con 0x7ff40c0e0040 2024-09-18T02:04:22.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.584+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353b610 con 0x55bf4352c9e0 2024-09-18T02:04:22.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.584+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94279956668448] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.584+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.584+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94279956672800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf43539b00 con 0x55bf4352c9e0 2024-09-18T02:04:22.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.584+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353c050 con 0x55bf43535d10 2024-09-18T02:04:22.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.588+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94279956672800] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.588+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.588+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94279956665936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf43539a70 con 0x55bf43535d10 2024-09-18T02:04:22.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.588+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353cda0 con 0x7ff40c0e0040 2024-09-18T02:04:22.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.588+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.588+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94279956679168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353d490 con 0x7ff40c0e0040 2024-09-18T02:04:22.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.588+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353dfb0 con 0x55bf4352c9e0 2024-09-18T02:04:22.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.588+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94279956665936] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.588+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94279956679168] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.592+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.592+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94279956683392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353df70 con 0x55bf4352c9e0 2024-09-18T02:04:22.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.592+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353e3a0 con 0x55bf435313a0 2024-09-18T02:04:22.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.592+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94279956683392] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.592+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.592+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94279956677696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353e790 con 0x55bf435313a0 2024-09-18T02:04:22.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.592+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353f150 con 0x55bf435313a0 2024-09-18T02:04:22.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94279956677696] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94279956680416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353f150 con 0x55bf435313a0 2024-09-18T02:04:22.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353fb10 con 0x55bf435313a0 2024-09-18T02:04:22.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94279956680416] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94279956688032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353fcf0 con 0x55bf435313a0 2024-09-18T02:04:22.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff423da4980 20 add_watcher() i=0 2024-09-18T02:04:22.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff423da4980 20 add_watcher() i=1 2024-09-18T02:04:22.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff423da4980 20 add_watcher() i=2 2024-09-18T02:04:22.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff423da4980 20 add_watcher() i=3 2024-09-18T02:04:22.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff423da4980 20 add_watcher() i=4 2024-09-18T02:04:22.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff423da4980 20 add_watcher() i=5 2024-09-18T02:04:22.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.596+0000 7ff423da4980 20 add_watcher() i=6 2024-09-18T02:04:22.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.600+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94279956688032] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.600+0000 7ff423da4980 20 add_watcher() i=7 2024-09-18T02:04:22.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.600+0000 7ff423da4980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:22.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.600+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf43542ef0 con 0x55bf4352c9e0 2024-09-18T02:04:22.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.600+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.600+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94279956691104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf43540170 con 0x55bf4352c9e0 2024-09-18T02:04:22.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.600+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94279956691104] v30'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.600+0000 7ff2d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:22.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.600+0000 7ff423da4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:22.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.600+0000 7ff423da4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:22.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.600+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf43542680 con 0x55bf4352c9e0 2024-09-18T02:04:22.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.604+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'44 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.604+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354bfb0 con 0x55bf435313a0 2024-09-18T02:04:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.604+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'20 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.604+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354bfb0 con 0x55bf43535d10 2024-09-18T02:04:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.608+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.608+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354bfb0 con 0x55bf4352c9e0 2024-09-18T02:04:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.608+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'119 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.608+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354c8c0 con 0x7ff40c0e0040 2024-09-18T02:04:22.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.608+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.608+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354ce30 con 0x55bf43535d10 2024-09-18T02:04:22.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.612+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.612+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d2e0 con 0x55bf4352c9e0 2024-09-18T02:04:22.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.612+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.612+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d1a0 con 0x55bf435313a0 2024-09-18T02:04:22.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.616+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.616+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d230 con 0x7ff40c0e0040 2024-09-18T02:04:22.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.616+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.616+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d230 con 0x55bf43535d10 2024-09-18T02:04:22.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.620+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.620+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d880 con 0x7ff40c0e0040 2024-09-18T02:04:22.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.620+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.620+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d860 con 0x55bf435313a0 2024-09-18T02:04:22.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.620+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.620+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d860 con 0x7ff40c0e0040 2024-09-18T02:04:22.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.624+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.624+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d840 con 0x55bf435313a0 2024-09-18T02:04:22.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.624+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'41 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.624+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d840 con 0x55bf4352c9e0 2024-09-18T02:04:22.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.628+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'120 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.628+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d840 con 0x55bf43535d10 2024-09-18T02:04:22.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.628+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.628+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d8d0 con 0x7ff40c0e0040 2024-09-18T02:04:22.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.628+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'40 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.628+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d8d0 con 0x55bf43535d10 2024-09-18T02:04:22.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.632+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.632+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d960 con 0x55bf4352c9e0 2024-09-18T02:04:22.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.632+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.632+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d960 con 0x55bf4352c9e0 2024-09-18T02:04:22.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.636+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'121 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.636+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354d960 con 0x55bf43535d10 2024-09-18T02:04:22.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.636+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.636+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354da10 con 0x7ff40c0e0040 2024-09-18T02:04:22.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.636+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.636+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354da10 con 0x55bf43535d10 2024-09-18T02:04:22.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.640+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.640+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354da10 con 0x55bf43535d10 2024-09-18T02:04:22.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.640+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.640+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354da10 con 0x55bf43535d10 2024-09-18T02:04:22.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.640+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.640+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354da10 con 0x55bf43535d10 2024-09-18T02:04:22.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.644+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'34 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.644+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354da10 con 0x55bf435313a0 2024-09-18T02:04:22.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.644+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.644+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354da10 con 0x55bf43535d10 2024-09-18T02:04:22.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.648+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.648+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354da10 con 0x55bf435313a0 2024-09-18T02:04:22.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.648+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.648+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354da10 con 0x55bf43535d10 2024-09-18T02:04:22.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.652+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.652+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354da10 con 0x55bf435313a0 2024-09-18T02:04:22.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.652+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'42 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.652+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4354da10 con 0x7ff40c0e0040 2024-09-18T02:04:22.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff2d27fc640 20 reqs_thread_entry: start 2024-09-18T02:04:22.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff423da4980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:22.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff423da4980 20 Filter name: none 2024-09-18T02:04:22.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff243fff640 20 reqs_thread_entry: start 2024-09-18T02:04:22.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff423da4980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T02:04:22.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff423da4980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf43569060 con 0x55bf435313a0 2024-09-18T02:04:22.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff423da4980 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T02:04:22.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff423da4980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T02:04:22.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff423da4980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:04:22.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff423da4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:22.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.656+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bf4356b530 con 0x55bf435313a0 2024-09-18T02:04:22.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.660+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.662 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-18T02:04:22.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.660+0000 7ff2d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:22.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.660+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94279956691104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf43526c40 con 0x55bf4352c9e0 2024-09-18T02:04:22.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.660+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94279956691104] v30'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.660+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94279956668448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353f8a0 con 0x7ff40c0e0040 2024-09-18T02:04:22.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.664+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94279956668448] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.664+0000 7ff423da4980 20 remove_watcher() i=0 2024-09-18T02:04:22.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.664+0000 7ff423da4980 2 removed watcher, disabling cache 2024-09-18T02:04:22.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.664+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94279956672800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353f8a0 con 0x55bf4352c9e0 2024-09-18T02:04:22.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.664+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94279956672800] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.664+0000 7ff423da4980 20 remove_watcher() i=1 2024-09-18T02:04:22.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.664+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94279956665936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353b120 con 0x55bf43535d10 2024-09-18T02:04:22.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.668+0000 7ff4210b3640 1 -- 172.21.15.167:0/1824546068 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94279956665936] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40c0aaae0 con 0x55bf43535d10 2024-09-18T02:04:22.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.668+0000 7ff423da4980 20 remove_watcher() i=2 2024-09-18T02:04:22.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.668+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94279956679168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf43539650 con 0x7ff40c0e0040 2024-09-18T02:04:22.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.668+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94279956679168] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x7ff40c0e0040 2024-09-18T02:04:22.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.668+0000 7ff423da4980 20 remove_watcher() i=3 2024-09-18T02:04:22.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.668+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94279956683392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353b120 con 0x55bf4352c9e0 2024-09-18T02:04:22.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.672+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94279956683392] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41c026040 con 0x55bf4352c9e0 2024-09-18T02:04:22.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.672+0000 7ff423da4980 20 remove_watcher() i=4 2024-09-18T02:04:22.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.672+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94279956677696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353ca00 con 0x55bf435313a0 2024-09-18T02:04:22.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.672+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94279956677696] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.672+0000 7ff423da4980 20 remove_watcher() i=5 2024-09-18T02:04:22.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.672+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94279956680416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf43539650 con 0x55bf435313a0 2024-09-18T02:04:22.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94279956680416] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 20 remove_watcher() i=6 2024-09-18T02:04:22.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94279956688032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bf4353da80 con 0x55bf435313a0 2024-09-18T02:04:22.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff4218b4640 1 -- 172.21.15.167:0/1824546068 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94279956688032] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff41406f030 con 0x55bf435313a0 2024-09-18T02:04:22.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 20 remove_watcher() i=7 2024-09-18T02:04:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bf435313a0 msgr2=0x55bf43533790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bf435313a0 0x55bf43533790 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bf4352c9e0 msgr2=0x55bf4352eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bf4352c9e0 0x55bf4352eea0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff40c0e0040 msgr2=0x7ff40c0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff40c0e0040 0x7ff40c0e0420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55bf43535d10 msgr2=0x55bf43538180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55bf43535d10 0x55bf43538180 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff2ec034650 msgr2=0x7ff2ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff2ec034650 0x7ff2ec036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0aa910 tx=0x7ff40c0c1040 comp rx=0 tx=0).stop 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 msgr2=0x55bf435218b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 --2- 172.21.15.167:0/1824546068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4351a770 0x55bf435218b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff414011ff0 tx=0x7ff414018e70 comp rx=0 tx=0).stop 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 reap_dead start 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff4220b5640 1 -- 172.21.15.167:0/1824546068 reap_dead start 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 shutdown_connections 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 >> 172.21.15.167:0/1824546068 conn(0x55bf43516b50 msgr2=0x55bf43514c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 shutdown_connections 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/1824546068 wait complete. 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/2017456517 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff2fc034650 msgr2=0x7ff2fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 --2- 172.21.15.167:0/2017456517 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff2fc034650 0x7ff2fc036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff40c000c10 tx=0x7ff40c005ad0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 -- 172.21.15.167:0/2017456517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4350dea0 msgr2=0x55bf4350e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.676+0000 7ff423da4980 1 --2- 172.21.15.167:0/2017456517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4350dea0 0x55bf4350e2c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff4140069a0 tx=0x7ff414010ab0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2017456517 shutdown_connections 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 --2- 172.21.15.167:0/2017456517 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff2fc034650 0x7ff2fc036b10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 --2- 172.21.15.167:0/2017456517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4350dea0 0x55bf4350e2c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2017456517 >> 172.21.15.167:0/2017456517 conn(0x55bf43502ff0 msgr2=0x55bf43505a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2017456517 shutdown_connections 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2017456517 wait complete. 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bf434f9990 msgr2=0x55bf434fbd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bf434f9990 0x55bf434fbd80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bf43401e50 msgr2=0x55bf434f7020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bf43401e50 0x55bf434f7020 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55bf434fd890 msgr2=0x55bf434ffc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55bf434fd890 0x55bf434ffc80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff308034650 msgr2=0x7ff308036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff308034650 0x7ff308036b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0ae000 tx=0x7ff40c0a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 msgr2=0x55bf434effe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 --2- 172.21.15.167:0/2532373914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf4336fb00 0x55bf434effe0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff414006640 tx=0x7ff414000f50 comp rx=0 tx=0).stop 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff4220b5640 1 -- 172.21.15.167:0/2532373914 reap_dead start 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 shutdown_connections 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 >> 172.21.15.167:0/2532373914 conn(0x55bf433f6060 msgr2=0x55bf434e33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 shutdown_connections 2024-09-18T02:04:22.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.680+0000 7ff423da4980 1 -- 172.21.15.167:0/2532373914 wait complete. 2024-09-18T02:04:22.694 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T02:04:22.694 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-18T02:04:22.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-18T02:04:22.695 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-18T02:04:22.775 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:22.775 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:22.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.772+0000 7f5e0d262980 1 Processor -- start 2024-09-18T02:04:22.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.772+0000 7f5e0d262980 1 -- start start 2024-09-18T02:04:22.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.772+0000 7f5e0d262980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d8c9d858f0 0x55d8c9d85cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.772+0000 7f5e0d262980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8c9c0bae0 con 0x55d8c9d86240 2024-09-18T02:04:22.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.772+0000 7f5e0d262980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55d8c9c2fe30 con 0x55d8c9d858f0 2024-09-18T02:04:22.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.772+0000 7f5e0ad72640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d8c9d858f0 0x55d8c9d85cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.772+0000 7f5e0ad72640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d8c9d858f0 0x55d8c9d85cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57524/0 (socket says 172.21.15.167:57524) 2024-09-18T02:04:22.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.772+0000 7f5e0ad72640 1 -- 172.21.15.167:0/3076543277 learned_addr learned my addr 172.21.15.167:0/3076543277 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e0ad72640 1 -- 172.21.15.167:0/3076543277 >> v1:172.21.15.81:6789/0 conn(0x55d8c9d86240 legacy=0x55d8c9d8ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e0ad72640 1 -- 172.21.15.167:0/3076543277 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c9d8d4c0 con 0x55d8c9d858f0 2024-09-18T02:04:22.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e0ad72640 1 --2- 172.21.15.167:0/3076543277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9d85cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00a4e0 tx=0x7f5dfc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e323567e3d7d358b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e09d70640 1 -- 172.21.15.167:0/3076543277 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc0aa540 con 0x55d8c9d858f0 2024-09-18T02:04:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e09d70640 1 -- 172.21.15.167:0/3076543277 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dfc0aa6e0 con 0x55d8c9d858f0 2024-09-18T02:04:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e09d70640 1 -- 172.21.15.167:0/3076543277 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc0aaa40 con 0x55d8c9d858f0 2024-09-18T02:04:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e0d262980 1 -- 172.21.15.167:0/3076543277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 msgr2=0x55d8c9d85cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e0d262980 1 --2- 172.21.15.167:0/3076543277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9d85cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00a4e0 tx=0x7f5dfc01b090 comp rx=0 tx=0).stop 2024-09-18T02:04:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e0d262980 1 -- 172.21.15.167:0/3076543277 shutdown_connections 2024-09-18T02:04:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e0d262980 1 --2- 172.21.15.167:0/3076543277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9d85cd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e0d262980 1 -- 172.21.15.167:0/3076543277 >> 172.21.15.167:0/3076543277 conn(0x55d8c9cf9240 msgr2=0x55d8c9cf9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e0d262980 1 -- 172.21.15.167:0/3076543277 shutdown_connections 2024-09-18T02:04:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.776+0000 7f5e0d262980 1 -- 172.21.15.167:0/3076543277 wait complete. 2024-09-18T02:04:22.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.792+0000 7f5e0d262980 1 Processor -- start 2024-09-18T02:04:22.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.792+0000 7f5e0d262980 1 -- start start 2024-09-18T02:04:22.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.792+0000 7f5e0d262980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9e70be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.792+0000 7f5e0d262980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d8c9c31200 con 0x55d8c9d858f0 2024-09-18T02:04:22.798 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.792+0000 7f5e0ad72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9e70be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.798 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0ad72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9e70be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57534/0 (socket says 172.21.15.167:57534) 2024-09-18T02:04:22.798 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0ad72640 1 -- 172.21.15.167:0/3860600915 learned_addr learned my addr 172.21.15.167:0/3860600915 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.798 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0ad72640 1 -- 172.21.15.167:0/3860600915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c9e711b0 con 0x55d8c9d858f0 2024-09-18T02:04:22.798 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0ad72640 1 --2- 172.21.15.167:0/3860600915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9e70be0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc017ca0 tx=0x7f5dfc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ee230c12c693cc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5cf8e09640 1 -- 172.21.15.167:0/3860600915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc0b9070 con 0x55d8c9d858f0 2024-09-18T02:04:22.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5cf8e09640 1 -- 172.21.15.167:0/3860600915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dfc0aaa80 con 0x55d8c9d858f0 2024-09-18T02:04:22.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5cf8e09640 1 -- 172.21.15.167:0/3860600915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc0aad60 con 0x55d8c9d858f0 2024-09-18T02:04:22.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0d262980 1 -- 172.21.15.167:0/3860600915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 msgr2=0x55d8c9e70be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0d262980 1 --2- 172.21.15.167:0/3860600915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9e70be0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc017ca0 tx=0x7f5dfc0033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0d262980 1 -- 172.21.15.167:0/3860600915 shutdown_connections 2024-09-18T02:04:22.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0d262980 1 --2- 172.21.15.167:0/3860600915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9e70be0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0d262980 1 -- 172.21.15.167:0/3860600915 >> 172.21.15.167:0/3860600915 conn(0x55d8c9cf9240 msgr2=0x55d8c9e6c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0d262980 1 -- 172.21.15.167:0/3860600915 shutdown_connections 2024-09-18T02:04:22.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0d262980 1 -- 172.21.15.167:0/3860600915 wait complete. 2024-09-18T02:04:22.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0d262980 1 Processor -- start 2024-09-18T02:04:22.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0d262980 1 -- start start 2024-09-18T02:04:22.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0d262980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9e77e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0d262980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d8c9d8cf00 con 0x55d8c9d858f0 2024-09-18T02:04:22.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0ad72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9e77e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0ad72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9e77e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57538/0 (socket says 172.21.15.167:57538) 2024-09-18T02:04:22.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0ad72640 1 -- 172.21.15.167:0/2100666625 learned_addr learned my addr 172.21.15.167:0/2100666625 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0ad72640 1 -- 172.21.15.167:0/2100666625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c9e78390 con 0x55d8c9d858f0 2024-09-18T02:04:22.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.796+0000 7f5e0ad72640 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9e77e50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc01aec0 tx=0x7f5dfc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5cf7606640 1 -- 172.21.15.167:0/2100666625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc0cc070 con 0x55d8c9d858f0 2024-09-18T02:04:22.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5cf7606640 1 -- 172.21.15.167:0/2100666625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dfc0c7410 con 0x55d8c9d858f0 2024-09-18T02:04:22.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8c9e78620 con 0x55d8c9d858f0 2024-09-18T02:04:22.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5cf7606640 1 -- 172.21.15.167:0/2100666625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc0b9070 con 0x55d8c9d858f0 2024-09-18T02:04:22.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8c9e7b300 con 0x55d8c9d858f0 2024-09-18T02:04:22.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5cf7606640 1 -- 172.21.15.167:0/2100666625 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5dfc0b3040 con 0x55d8c9d858f0 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5cf7606640 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5cf0034650 0x7f5cf0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5cf7606640 1 -- 172.21.15.167:0/2100666625 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5dfc0c4070 con 0x55d8c9d858f0 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0a571640 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5cf0034650 0x7f5cf0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0d262980 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d8c9d86240 0x55d8c9e7ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9e7f520 con 0x55d8c9d86240 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0b573640 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d8c9d86240 0x55d8c9e7ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0a571640 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5cf0034650 0x7f5cf0036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5e00001e20 tx=0x7f5e000013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0b573640 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d8c9d86240 0x55d8c9e7ef50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0b573640 1 -- 172.21.15.167:0/2100666625 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e040083f0 con 0x55d8c9d86240 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9e7c520 con 0x55d8c9d86240 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0b573640 1 -- 172.21.15.167:0/2100666625 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e040083f0 con 0x55d8c9d86240 2024-09-18T02:04:22.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0d262980 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d8c9e818a0 0x55d8c9e83c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9e84380 con 0x55d8c9e818a0 2024-09-18T02:04:22.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.800+0000 7f5e0ad72640 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d8c9e818a0 0x55d8c9e83c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0ad72640 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d8c9e818a0 0x55d8c9e83c90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0ad72640 1 -- 172.21.15.167:0/2100666625 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5dfc0ce310 con 0x55d8c9e818a0 2024-09-18T02:04:22.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9e80740 con 0x55d8c9d86240 2024-09-18T02:04:22.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0b573640 1 -- 172.21.15.167:0/2100666625 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e040083f0 con 0x55d8c9d86240 2024-09-18T02:04:22.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0d262980 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d8c9e857e0 0x55d8c9e87bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9e88310 con 0x55d8c9e857e0 2024-09-18T02:04:22.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0a571640 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d8c9e857e0 0x55d8c9e87bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0a571640 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d8c9e857e0 0x55d8c9e87bd0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0a571640 1 -- 172.21.15.167:0/2100666625 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e0000d040 con 0x55d8c9e857e0 2024-09-18T02:04:22.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0d262980 1 Processor -- start 2024-09-18T02:04:22.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0d262980 1 -- start start 2024-09-18T02:04:22.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0d262980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9e95de0 0x55d8c9e96200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0d262980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d8c9c8a800 con 0x55d8c9e95de0 2024-09-18T02:04:22.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0ad72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9e95de0 0x55d8c9e96200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0ad72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9e95de0 0x55d8c9e96200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57552/0 (socket says 172.21.15.167:57552) 2024-09-18T02:04:22.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.804+0000 7f5e0ad72640 1 -- 172.21.15.167:0/921278081 learned_addr learned my addr 172.21.15.167:0/921278081 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0ad72640 1 -- 172.21.15.167:0/921278081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c9e96740 con 0x55d8c9e95de0 2024-09-18T02:04:22.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0ad72640 1 --2- 172.21.15.167:0/921278081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9e95de0 0x55d8c9e96200 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc005790 tx=0x7f5dfc0e47f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5cf4e01640 1 -- 172.21.15.167:0/921278081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc0e9070 con 0x55d8c9e95de0 2024-09-18T02:04:22.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0d262980 1 -- 172.21.15.167:0/921278081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8c9e969d0 con 0x55d8c9e95de0 2024-09-18T02:04:22.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5cf4e01640 1 -- 172.21.15.167:0/921278081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dfc0c6e70 con 0x55d8c9e95de0 2024-09-18T02:04:22.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5cf4e01640 1 -- 172.21.15.167:0/921278081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc0e0030 con 0x55d8c9e95de0 2024-09-18T02:04:22.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0d262980 1 -- 172.21.15.167:0/921278081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8c9e99650 con 0x55d8c9e95de0 2024-09-18T02:04:22.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5cf4e01640 1 -- 172.21.15.167:0/921278081 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5dfc0ec070 con 0x55d8c9e95de0 2024-09-18T02:04:22.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5cf4e01640 1 --2- 172.21.15.167:0/921278081 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ce4034650 0x7f5ce4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5cf4e01640 1 -- 172.21.15.167:0/921278081 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5dfc0e1070 con 0x55d8c9e95de0 2024-09-18T02:04:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0a571640 1 --2- 172.21.15.167:0/921278081 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ce4034650 0x7f5ce4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0d262980 1 Processor -- start 2024-09-18T02:04:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0d262980 1 -- start start 2024-09-18T02:04:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0a571640 1 --2- 172.21.15.167:0/921278081 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ce4034650 0x7f5ce4036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55d8c9e7fa20 tx=0x7f5e00006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0d262980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 0x55d8c9ea2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0d262980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d8c9e71470 con 0x55d8c9ea2690 2024-09-18T02:04:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0ad72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 0x55d8c9ea2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0ad72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 0x55d8c9ea2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57562/0 (socket says 172.21.15.167:57562) 2024-09-18T02:04:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0ad72640 1 -- 172.21.15.167:0/4061207458 learned_addr learned my addr 172.21.15.167:0/4061207458 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0ad72640 1 -- 172.21.15.167:0/4061207458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c9ea3060 con 0x55d8c9ea2690 2024-09-18T02:04:22.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.808+0000 7f5e0ad72640 1 --2- 172.21.15.167:0/4061207458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 0x55d8c9ea2a90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0b5c20 tx=0x7f5dfc0d1570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd47ecd90529173 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5cee7fc640 1 -- 172.21.15.167:0/4061207458 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc0d1e70 con 0x55d8c9ea2690 2024-09-18T02:04:22.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5cee7fc640 1 -- 172.21.15.167:0/4061207458 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dfc100070 con 0x55d8c9ea2690 2024-09-18T02:04:22.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5cee7fc640 1 -- 172.21.15.167:0/4061207458 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc0cf4b0 con 0x55d8c9ea2690 2024-09-18T02:04:22.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 -- 172.21.15.167:0/4061207458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 msgr2=0x55d8c9ea2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 --2- 172.21.15.167:0/4061207458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 0x55d8c9ea2a90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0b5c20 tx=0x7f5dfc0d1570 comp rx=0 tx=0).stop 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 -- 172.21.15.167:0/4061207458 shutdown_connections 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 --2- 172.21.15.167:0/4061207458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 0x55d8c9ea2a90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 -- 172.21.15.167:0/4061207458 >> 172.21.15.167:0/4061207458 conn(0x55d8c9e9eb00 msgr2=0x55d8c9e9cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 -- 172.21.15.167:0/4061207458 shutdown_connections 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 -- 172.21.15.167:0/4061207458 wait complete. 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 Processor -- start 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 -- start start 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 0x55d8c9ea98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d8c9ea3570 con 0x55d8c9ea2690 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0ad72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 0x55d8c9ea98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0ad72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 0x55d8c9ea98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57572/0 (socket says 172.21.15.167:57572) 2024-09-18T02:04:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 learned_addr learned my addr 172.21.15.167:0/927890031 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c9ea9e30 con 0x55d8c9ea2690 2024-09-18T02:04:22.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0ad72640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 0x55d8c9ea98f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0cfa20 tx=0x7f5dfc0c0100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5cecff9640 1 -- 172.21.15.167:0/927890031 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc10a070 con 0x55d8c9ea2690 2024-09-18T02:04:22.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8c9ea9e30 con 0x55d8c9ea2690 2024-09-18T02:04:22.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5cecff9640 1 -- 172.21.15.167:0/927890031 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dfc0efd40 con 0x55d8c9ea2690 2024-09-18T02:04:22.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5cecff9640 1 -- 172.21.15.167:0/927890031 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dfc0b8aa0 con 0x55d8c9ea2690 2024-09-18T02:04:22.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.812+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8c9ea9e30 con 0x55d8c9ea2690 2024-09-18T02:04:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5cecff9640 1 -- 172.21.15.167:0/927890031 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5dfc115060 con 0x55d8c9ea2690 2024-09-18T02:04:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5cecff9640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5cd4034650 0x7f5cd4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5cecff9640 1 -- 172.21.15.167:0/927890031 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5dfc0d6040 con 0x55d8c9ea2690 2024-09-18T02:04:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0a571640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5cd4034650 0x7f5cd4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d8c9eb4a00 0x55d8c9eb6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb7610 con 0x55d8c9eb4a00 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0b573640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d8c9eb4a00 0x55d8c9eb6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0a571640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5cd4034650 0x7f5cd4036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d8c9e88710 tx=0x7f5e00011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0b573640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d8c9eb4a00 0x55d8c9eb6ec0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e040083f0 con 0x55d8c9eb4a00 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 20 realm 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb7a20 con 0x55d8c9eb4a00 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e040083f0 con 0x55d8c9eb4a00 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb82f0 con 0x55d8c9eb4a00 2024-09-18T02:04:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e040083f0 con 0x55d8c9eb4a00 2024-09-18T02:04:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb4a00 2024-09-18T02:04:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e040083f0 con 0x55d8c9eb4a00 2024-09-18T02:04:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d8c9eb93f0 0x55d8c9ebb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ebbdb0 con 0x55d8c9eb93f0 2024-09-18T02:04:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.816+0000 7f5e0ad72640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d8c9eb93f0 0x55d8c9ebb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0ad72640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d8c9eb93f0 0x55d8c9ebb7e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0d262980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0d262980 20 searching for the correct realm 2024-09-18T02:04:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0d262980 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d8c9ebdd00 0x55d8c9ec0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec0800 con 0x55d8c9ebdd00 2024-09-18T02:04:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0a571640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d8c9ebdd00 0x55d8c9ec0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0a571640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d8c9ebdd00 0x55d8c9ec0130 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0a571640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5e0000f3d0 0x7f5e0000f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec0800 con 0x7f5e0000f3d0 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0b573640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5e0000f3d0 0x7f5e0000f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0b573640 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5e0000f3d0 0x7f5e0000f7f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e040083f0 con 0x7f5e0000f3d0 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb93f0 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb4a00 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e040083f0 con 0x55d8c9eb4a00 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb4a00 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.820+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb93f0 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb93f0 2024-09-18T02:04:22.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x7f5e0000f3d0 2024-09-18T02:04:22.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9ebdd00 2024-09-18T02:04:22.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb4a00 2024-09-18T02:04:22.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb93f0 2024-09-18T02:04:22.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb4a00 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x7f5e0000f3d0 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9ebdd00 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9ebdd00 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.824+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb93f0 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9ebdd00 2024-09-18T02:04:22.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9ebdd00 2024-09-18T02:04:22.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb4a00 2024-09-18T02:04:22.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb4a00 2024-09-18T02:04:22.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb93f0 2024-09-18T02:04:22.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9ebdd00 2024-09-18T02:04:22.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x7f5e0000f3d0 2024-09-18T02:04:22.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb4a00 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb93f0 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.828+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9ebdd00 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb93f0 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x7f5e0000f3d0 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9ebdd00 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb93f0 2024-09-18T02:04:22.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x55d8c9eb4a00 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eb8690 con 0x7f5e0000f3d0 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ebc670 con 0x55d8c9eb4a00 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ebc670 con 0x55d8c9eb4a00 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.832+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ebc670 con 0x55d8c9ebdd00 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 20 zone default found 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 4 Realm: () 2024-09-18T02:04:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 20 zonegroup default 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ebd070 con 0x55d8c9eb93f0 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ebcc40 con 0x55d8c9ebdd00 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec2b90 con 0x55d8c9ebdd00 2024-09-18T02:04:22.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:22.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 20 started sync module instance, tier type = 2024-09-18T02:04:22.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:22.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec1fa0 con 0x7f5e0000f3d0 2024-09-18T02:04:22.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94389588993184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec1fa0 con 0x7f5e0000f3d0 2024-09-18T02:04:22.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.836+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec3620 con 0x55d8c9eb4a00 2024-09-18T02:04:22.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.840+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94389588993184] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.840+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.840+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94389588996400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec1fa0 con 0x55d8c9eb4a00 2024-09-18T02:04:22.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.840+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec4060 con 0x55d8c9ebdd00 2024-09-18T02:04:22.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.840+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94389588996400] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.840+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.840+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94389588990704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec1f10 con 0x55d8c9ebdd00 2024-09-18T02:04:22.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.844+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec4e30 con 0x7f5e0000f3d0 2024-09-18T02:04:22.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.844+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.844+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94389589002496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec4df0 con 0x7f5e0000f3d0 2024-09-18T02:04:22.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.844+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec5cf0 con 0x55d8c9eb4a00 2024-09-18T02:04:22.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.844+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94389588990704] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.844+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94389589002496] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.844+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.844+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94389589001296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec5840 con 0x55d8c9eb4a00 2024-09-18T02:04:22.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.844+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec6590 con 0x55d8c9eb93f0 2024-09-18T02:04:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.848+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94389589001296] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.848+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.848+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94389589008608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec5840 con 0x55d8c9eb93f0 2024-09-18T02:04:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.848+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec6de0 con 0x55d8c9eb93f0 2024-09-18T02:04:22.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94389589008608] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94389589004032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec7630 con 0x55d8c9eb93f0 2024-09-18T02:04:22.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec7ec0 con 0x55d8c9eb93f0 2024-09-18T02:04:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94389589014064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec8570 con 0x55d8c9eb93f0 2024-09-18T02:04:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0d262980 20 add_watcher() i=0 2024-09-18T02:04:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0d262980 20 add_watcher() i=1 2024-09-18T02:04:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0d262980 20 add_watcher() i=2 2024-09-18T02:04:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0d262980 20 add_watcher() i=3 2024-09-18T02:04:22.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0d262980 20 add_watcher() i=4 2024-09-18T02:04:22.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0d262980 20 add_watcher() i=5 2024-09-18T02:04:22.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94389589004032] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.852+0000 7f5e0d262980 20 add_watcher() i=6 2024-09-18T02:04:22.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94389589014064] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 20 add_watcher() i=7 2024-09-18T02:04:22.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:22.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ecb470 con 0x55d8c9eb4a00 2024-09-18T02:04:22.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94389589016464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec8860 con 0x55d8c9eb4a00 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94389589016464] v30'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5cc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 5 note: GC not initialized 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5c3bfff640 20 reqs_thread_entry: start 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 20 Filter name: none 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5c39ffb640 20 reqs_thread_entry: start 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.856+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eeea10 con 0x55d8c9eb93f0 2024-09-18T02:04:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T02:04:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T02:04:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:04:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:04:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ef0af0 con 0x7f5e0000f3d0 2024-09-18T02:04:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T02:04:22.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:22.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 : miss 2024-09-18T02:04:22.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ef2320 con 0x55d8c9ebdd00 2024-09-18T02:04:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-18T02:04:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.860+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ef5a00 con 0x55d8c9eb93f0 2024-09-18T02:04:22.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(65 fud.buckets [call] v30'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-18T02:04:22.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 20 rados->read ofs=0 len=0 2024-09-18T02:04:22.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ef4b10 con 0x7f5e0000f3d0 2024-09-18T02:04:22.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-18T02:04:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ef96d0 con 0x7f5e0000f3d0 2024-09-18T02:04:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T02:04:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T02:04:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.864+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94389589217632 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ef64d0 con 0x55d8c9eb93f0 2024-09-18T02:04:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.868+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== watch-notify(notify (1) cookie 94389589004032 notify 128849018886 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55d8c9e969d0 con 0x55d8c9eb93f0 2024-09-18T02:04:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.868+0000 7f5cee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94389589004032 notifier 4522 bl.length()=338 2024-09-18T02:04:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.868+0000 7f5cee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T02:04:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.868+0000 7f5cee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.868+0000 7f5cee7fc640 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5cd0003eb0 con 0x55d8c9eb93f0 2024-09-18T02:04:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.868+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(68 notify.6 [notify cookie 94389589217632 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.868+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== watch-notify(notify_complete (2) cookie 94389589217632 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d8c9e96740 con 0x55d8c9eb93f0 2024-09-18T02:04:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.868+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.868+0000 7f5cc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.868+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94389589016464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eec840 con 0x55d8c9eb4a00 2024-09-18T02:04:22.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.872+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94389589016464] v30'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.872+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94389588993184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eec840 con 0x7f5e0000f3d0 2024-09-18T02:04:22.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.872+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94389588993184] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.872+0000 7f5e0d262980 20 remove_watcher() i=0 2024-09-18T02:04:22.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.872+0000 7f5e0d262980 2 removed watcher, disabling cache 2024-09-18T02:04:22.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.872+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94389588996400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec24a0 con 0x55d8c9eb4a00 2024-09-18T02:04:22.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.872+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94389588996400] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.872+0000 7f5e0d262980 20 remove_watcher() i=1 2024-09-18T02:04:22.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.872+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94389588990704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eec840 con 0x55d8c9ebdd00 2024-09-18T02:04:22.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.876+0000 7f5e0a571640 1 -- 172.21.15.167:0/927890031 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94389588990704] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e00036040 con 0x55d8c9ebdd00 2024-09-18T02:04:22.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.876+0000 7f5e0d262980 20 remove_watcher() i=2 2024-09-18T02:04:22.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.876+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94389589002496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec3130 con 0x7f5e0000f3d0 2024-09-18T02:04:22.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.876+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94389589002496] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x7f5e0000f3d0 2024-09-18T02:04:22.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.876+0000 7f5e0d262980 20 remove_watcher() i=3 2024-09-18T02:04:22.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.876+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94389589001296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec1af0 con 0x55d8c9eb4a00 2024-09-18T02:04:22.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.880+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94389589001296] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e04026040 con 0x55d8c9eb4a00 2024-09-18T02:04:22.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.880+0000 7f5e0d262980 20 remove_watcher() i=4 2024-09-18T02:04:22.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.880+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94389589008608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9eec840 con 0x55d8c9eb93f0 2024-09-18T02:04:22.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.880+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94389589008608] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.880+0000 7f5e0d262980 20 remove_watcher() i=5 2024-09-18T02:04:22.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.880+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94389589004032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec4900 con 0x55d8c9eb93f0 2024-09-18T02:04:22.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.884+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94389589004032] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.884+0000 7f5e0d262980 20 remove_watcher() i=6 2024-09-18T02:04:22.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.884+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94389589014064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8c9ec3130 con 0x55d8c9eb93f0 2024-09-18T02:04:22.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0ad72640 1 -- 172.21.15.167:0/927890031 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94389589014064] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dfc0f9030 con 0x55d8c9eb93f0 2024-09-18T02:04:22.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 20 remove_watcher() i=7 2024-09-18T02:04:22.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d8c9eb93f0 msgr2=0x55d8c9ebb7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d8c9eb93f0 0x55d8c9ebb7e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d8c9eb4a00 msgr2=0x55d8c9eb6ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d8c9eb4a00 0x55d8c9eb6ec0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5e0000f3d0 msgr2=0x7f5e0000f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5e0000f3d0 0x7f5e0000f7f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d8c9ebdd00 msgr2=0x55d8c9ec0130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d8c9ebdd00 0x55d8c9ec0130 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5cd4034650 msgr2=0x7f5cd4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5cd4034650 0x7f5cd4036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d8c9e88710 tx=0x7f5e00011000 comp rx=0 tx=0).stop 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 msgr2=0x55d8c9ea98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/927890031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9ea2690 0x55d8c9ea98f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0cfa20 tx=0x7f5dfc0c0100 comp rx=0 tx=0).stop 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 reap_dead start 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0b573640 1 -- 172.21.15.167:0/927890031 reap_dead start 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 shutdown_connections 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 >> 172.21.15.167:0/927890031 conn(0x55d8c9e9eb00 msgr2=0x55d8c9e9cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 shutdown_connections 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/927890031 wait complete. 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/921278081 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ce4034650 msgr2=0x7f5ce4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/921278081 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ce4034650 0x7f5ce4036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55d8c9e7fa20 tx=0x7f5e00006000 comp rx=0 tx=0).stop 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/921278081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9e95de0 msgr2=0x55d8c9e96200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/921278081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9e95de0 0x55d8c9e96200 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc005790 tx=0x7f5dfc0e47f0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/921278081 shutdown_connections 2024-09-18T02:04:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/921278081 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ce4034650 0x7f5ce4036b10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/921278081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9e95de0 0x55d8c9e96200 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/921278081 >> 172.21.15.167:0/921278081 conn(0x55d8c9e8af30 msgr2=0x55d8c9e8d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/921278081 shutdown_connections 2024-09-18T02:04:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/921278081 wait complete. 2024-09-18T02:04:22.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d8c9e818a0 msgr2=0x55d8c9e83c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d8c9e818a0 0x55d8c9e83c90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d8c9d86240 msgr2=0x55d8c9e7ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d8c9d86240 0x55d8c9e7ef50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d8c9e857e0 msgr2=0x55d8c9e87bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d8c9e857e0 0x55d8c9e87bd0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5cf0034650 msgr2=0x7f5cf0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5cf0034650 0x7f5cf0036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5e00001e20 tx=0x7f5e000013a0 comp rx=0 tx=0).stop 2024-09-18T02:04:22.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 msgr2=0x55d8c9e77e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 --2- 172.21.15.167:0/2100666625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8c9d858f0 0x55d8c9e77e50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc01aec0 tx=0x7f5dfc017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:22.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0b573640 1 -- 172.21.15.167:0/2100666625 reap_dead start 2024-09-18T02:04:22.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 shutdown_connections 2024-09-18T02:04:22.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 >> 172.21.15.167:0/2100666625 conn(0x55d8c9cf9240 msgr2=0x55d8c9e6b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:22.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 shutdown_connections 2024-09-18T02:04:22.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.888+0000 7f5e0d262980 1 -- 172.21.15.167:0/2100666625 wait complete. 2024-09-18T02:04:22.903 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1'] 2024-09-18T02:04:22.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1'] 2024-09-18T02:04:22.903 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:22.994 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:22.994 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:22.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.992+0000 7f5f3faa8980 1 Processor -- start 2024-09-18T02:04:22.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.992+0000 7f5f3faa8980 1 -- start start 2024-09-18T02:04:22.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.992+0000 7f5f3faa8980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f2c18089f0 0x55f2c180ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:22.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.992+0000 7f5f3faa8980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f2c168cae0 con 0x55f2c1778aa0 2024-09-18T02:04:22.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.992+0000 7f5f3faa8980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55f2c16b0e30 con 0x55f2c18089f0 2024-09-18T02:04:22.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.992+0000 7f5f3cdb7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f2c18089f0 0x55f2c180ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:22.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.992+0000 7f5f3cdb7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f2c18089f0 0x55f2c180ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57588/0 (socket says 172.21.15.167:57588) 2024-09-18T02:04:22.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.992+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/4196772820 learned_addr learned my addr 172.21.15.167:0/4196772820 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:22.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.992+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/4196772820 >> v1:172.21.15.81:6789/0 conn(0x55f2c1778aa0 legacy=0x55f2c18072d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:22.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.992+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/4196772820 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c180c330 con 0x55f2c18089f0 2024-09-18T02:04:22.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.996+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/4196772820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c18089f0 0x55f2c180ade0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400a5c0 tx=0x7f5f3401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1643020eb96c9dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.996+0000 7f5f2ffff640 1 -- 172.21.15.167:0/4196772820 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f340a6070 con 0x55f2c18089f0 2024-09-18T02:04:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.996+0000 7f5f2ffff640 1 -- 172.21.15.167:0/4196772820 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f340af070 con 0x55f2c18089f0 2024-09-18T02:04:22.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.996+0000 7f5f2ffff640 1 -- 172.21.15.167:0/4196772820 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f340aa5c0 con 0x55f2c18089f0 2024-09-18T02:04:23.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.996+0000 7f5f3faa8980 1 -- 172.21.15.167:0/4196772820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c18089f0 msgr2=0x55f2c180ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.996+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/4196772820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c18089f0 0x55f2c180ade0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400a5c0 tx=0x7f5f3401b340 comp rx=0 tx=0).stop 2024-09-18T02:04:23.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.996+0000 7f5f3faa8980 1 -- 172.21.15.167:0/4196772820 shutdown_connections 2024-09-18T02:04:23.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.996+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/4196772820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c18089f0 0x55f2c180ade0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.996+0000 7f5f3faa8980 1 -- 172.21.15.167:0/4196772820 >> 172.21.15.167:0/4196772820 conn(0x55f2c17ff000 msgr2=0x55f2c1801420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.996+0000 7f5f3faa8980 1 -- 172.21.15.167:0/4196772820 shutdown_connections 2024-09-18T02:04:23.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:22.996+0000 7f5f3faa8980 1 -- 172.21.15.167:0/4196772820 wait complete. 2024-09-18T02:04:23.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5f3faa8980 1 Processor -- start 2024-09-18T02:04:23.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5f3faa8980 1 -- start start 2024-09-18T02:04:23.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5f3faa8980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 0x55f2c18efab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5f3faa8980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f2c16b2200 con 0x55f2c1778aa0 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5f3d5b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 0x55f2c18efab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5f3d5b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 0x55f2c18efab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57602/0 (socket says 172.21.15.167:57602) 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/1124851177 learned_addr learned my addr 172.21.15.167:0/1124851177 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/1124851177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c18f0080 con 0x55f2c1778aa0 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5f3d5b8640 1 --2- 172.21.15.167:0/1124851177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 0x55f2c18efab0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b1f0 tx=0x7f5f3000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04f8af30b1b34df server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5e2b606640 1 -- 172.21.15.167:0/1124851177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3000a040 con 0x55f2c1778aa0 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5e2b606640 1 -- 172.21.15.167:0/1124851177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3000f750 con 0x55f2c1778aa0 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.012+0000 7f5e2b606640 1 -- 172.21.15.167:0/1124851177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3000fa70 con 0x55f2c1778aa0 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 -- 172.21.15.167:0/1124851177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 msgr2=0x55f2c18efab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/1124851177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 0x55f2c18efab0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b1f0 tx=0x7f5f3000b6b0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 -- 172.21.15.167:0/1124851177 shutdown_connections 2024-09-18T02:04:23.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/1124851177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 0x55f2c18efab0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 -- 172.21.15.167:0/1124851177 >> 172.21.15.167:0/1124851177 conn(0x55f2c17ff000 msgr2=0x55f2c18eb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 -- 172.21.15.167:0/1124851177 shutdown_connections 2024-09-18T02:04:23.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 -- 172.21.15.167:0/1124851177 wait complete. 2024-09-18T02:04:23.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 Processor -- start 2024-09-18T02:04:23.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 -- start start 2024-09-18T02:04:23.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 0x55f2c18f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f2c180bdd0 con 0x55f2c1778aa0 2024-09-18T02:04:23.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3d5b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 0x55f2c18f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3d5b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 0x55f2c18f6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57604/0 (socket says 172.21.15.167:57604) 2024-09-18T02:04:23.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/3140682228 learned_addr learned my addr 172.21.15.167:0/3140682228 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/3140682228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c18f7440 con 0x55f2c1778aa0 2024-09-18T02:04:23.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3d5b8640 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 0x55f2c18f6f00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b6f0 tx=0x7f5f30000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5e29e03640 1 -- 172.21.15.167:0/3140682228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f30001300 con 0x55f2c1778aa0 2024-09-18T02:04:23.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5e29e03640 1 -- 172.21.15.167:0/3140682228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3001c9c0 con 0x55f2c1778aa0 2024-09-18T02:04:23.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2c18f76d0 con 0x55f2c1778aa0 2024-09-18T02:04:23.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5e29e03640 1 -- 172.21.15.167:0/3140682228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3001cca0 con 0x55f2c1778aa0 2024-09-18T02:04:23.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c18fa3b0 con 0x55f2c1778aa0 2024-09-18T02:04:23.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5e29e03640 1 -- 172.21.15.167:0/3140682228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5f30017050 con 0x55f2c1778aa0 2024-09-18T02:04:23.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5e29e03640 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e24034650 0x7f5e24036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.016+0000 7f5e29e03640 1 -- 172.21.15.167:0/3140682228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5f30015020 con 0x55f2c1778aa0 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e24034650 0x7f5e24036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f2c18089f0 0x55f2c18fe000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c18fe540 con 0x55f2c18089f0 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3ddb9640 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f2c18089f0 0x55f2c18fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e24034650 0x7f5e24036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5f340ae000 tx=0x7f5f340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3ddb9640 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f2c18089f0 0x55f2c18fe000 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/3140682228 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c18089f0 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c18fb5d0 con 0x55f2c18089f0 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/3140682228 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c18089f0 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f2c19008c0 0x55f2c1902cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1903380 con 0x55f2c19008c0 2024-09-18T02:04:23.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3d5b8640 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f2c19008c0 0x55f2c1902cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3d5b8640 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f2c19008c0 0x55f2c1902cb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/3140682228 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f3002e070 con 0x55f2c19008c0 2024-09-18T02:04:23.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c18ff760 con 0x55f2c18089f0 2024-09-18T02:04:23.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/3140682228 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c18089f0 2024-09-18T02:04:23.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f2c19047c0 0x55f2c1906bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1907340 con 0x55f2c19047c0 2024-09-18T02:04:23.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f2c19047c0 0x55f2c1906bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.020+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f2c19047c0 0x55f2c1906bb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/3140682228 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c19047c0 2024-09-18T02:04:23.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3faa8980 1 Processor -- start 2024-09-18T02:04:23.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3faa8980 1 -- start start 2024-09-18T02:04:23.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3faa8980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1914d90 0x55f2c19151b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3faa8980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f2c170b800 con 0x55f2c1914d90 2024-09-18T02:04:23.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3d5b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1914d90 0x55f2c19151b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3d5b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1914d90 0x55f2c19151b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57620/0 (socket says 172.21.15.167:57620) 2024-09-18T02:04:23.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/572353514 learned_addr learned my addr 172.21.15.167:0/572353514 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/572353514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c19156f0 con 0x55f2c1914d90 2024-09-18T02:04:23.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3d5b8640 1 --2- 172.21.15.167:0/572353514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1914d90 0x55f2c19151b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5f300186e0 tx=0x7f5f30028eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5e22ffd640 1 -- 172.21.15.167:0/572353514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f30041070 con 0x55f2c1914d90 2024-09-18T02:04:23.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3faa8980 1 -- 172.21.15.167:0/572353514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2c1915980 con 0x55f2c1914d90 2024-09-18T02:04:23.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5e22ffd640 1 -- 172.21.15.167:0/572353514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f30027770 con 0x55f2c1914d90 2024-09-18T02:04:23.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5f3faa8980 1 -- 172.21.15.167:0/572353514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c1918600 con 0x55f2c1914d90 2024-09-18T02:04:23.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5e22ffd640 1 -- 172.21.15.167:0/572353514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f30048ba0 con 0x55f2c1914d90 2024-09-18T02:04:23.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5e22ffd640 1 -- 172.21.15.167:0/572353514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5f30018980 con 0x55f2c1914d90 2024-09-18T02:04:23.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5e22ffd640 1 --2- 172.21.15.167:0/572353514 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e14034650 0x7f5e14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.024+0000 7f5e22ffd640 1 -- 172.21.15.167:0/572353514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5f30010330 con 0x55f2c1914d90 2024-09-18T02:04:23.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/572353514 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e14034650 0x7f5e14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 Processor -- start 2024-09-18T02:04:23.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 -- start start 2024-09-18T02:04:23.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1921a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/572353514 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e14034650 0x7f5e14036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f34017f50 tx=0x7f5f34005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f2c18f0400 con 0x55f2c19216b0 2024-09-18T02:04:23.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3d5b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1921a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3d5b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1921a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57634/0 (socket says 172.21.15.167:57634) 2024-09-18T02:04:23.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/3960429757 learned_addr learned my addr 172.21.15.167:0/3960429757 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/3960429757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c1922060 con 0x55f2c19216b0 2024-09-18T02:04:23.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3d5b8640 1 --2- 172.21.15.167:0/3960429757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1921a90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5f30041e60 tx=0x7f5f30031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe3a443d4df0944 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5e20ff9640 1 -- 172.21.15.167:0/3960429757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f30041210 con 0x55f2c19216b0 2024-09-18T02:04:23.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5e20ff9640 1 -- 172.21.15.167:0/3960429757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3005d070 con 0x55f2c19216b0 2024-09-18T02:04:23.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5e20ff9640 1 -- 172.21.15.167:0/3960429757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f30010130 con 0x55f2c19216b0 2024-09-18T02:04:23.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3960429757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 msgr2=0x55f2c1921a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/3960429757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1921a90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5f30041e60 tx=0x7f5f30031450 comp rx=0 tx=0).stop 2024-09-18T02:04:23.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3960429757 shutdown_connections 2024-09-18T02:04:23.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/3960429757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1921a90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3960429757 >> 172.21.15.167:0/3960429757 conn(0x55f2c191da90 msgr2=0x55f2c191bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3960429757 shutdown_connections 2024-09-18T02:04:23.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3960429757 wait complete. 2024-09-18T02:04:23.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 Processor -- start 2024-09-18T02:04:23.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 -- start start 2024-09-18T02:04:23.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1804bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.028+0000 7f5f3faa8980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f2c1922500 con 0x55f2c19216b0 2024-09-18T02:04:23.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3d5b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1804bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3d5b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1804bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57642/0 (socket says 172.21.15.167:57642) 2024-09-18T02:04:23.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 learned_addr learned my addr 172.21.15.167:0/2747801754 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c18050f0 con 0x55f2c19216b0 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3d5b8640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1804bb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5f30047490 tx=0x7f5f30010070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5e12ffd640 1 -- 172.21.15.167:0/2747801754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3001a950 con 0x55f2c19216b0 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2c18050f0 con 0x55f2c19216b0 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5e12ffd640 1 -- 172.21.15.167:0/2747801754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f30068070 con 0x55f2c19216b0 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5e12ffd640 1 -- 172.21.15.167:0/2747801754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f300256c0 con 0x55f2c19216b0 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c18050f0 con 0x55f2c19216b0 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5e12ffd640 1 -- 172.21.15.167:0/2747801754 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5f30041430 con 0x55f2c19216b0 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5e12ffd640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e08034600 0x7f5e08036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5e12ffd640 1 -- 172.21.15.167:0/2747801754 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5f30067680 con 0x55f2c19216b0 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e08034600 0x7f5e08036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f2c1935b60 0x55f2c1938020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1938770 con 0x55f2c1935b60 2024-09-18T02:04:23.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3ddb9640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f2c1935b60 0x55f2c1938020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e08034600 0x7f5e08036ac0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5f34000c10 tx=0x7f5f340c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.032+0000 7f5f3ddb9640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f2c1935b60 0x55f2c1938020 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 20 realm 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1938b80 con 0x55f2c1935b60 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1939450 con 0x55f2c1935b60 2024-09-18T02:04:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c1935b60 2024-09-18T02:04:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f2c193a550 0x55f2c193c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c193cf10 con 0x55f2c193a550 2024-09-18T02:04:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3d5b8640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f2c193a550 0x55f2c193c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3d5b8640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f2c193a550 0x55f2c193c940 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 20 searching for the correct realm 2024-09-18T02:04:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f2c193ee60 0x55f2c1941290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1941960 con 0x55f2c193ee60 2024-09-18T02:04:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f2c193ee60 0x55f2c1941290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f2c193ee60 0x55f2c1941290 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3cdb7640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5f340e0040 0x7f5f340e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1941960 con 0x7f5f340e0040 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.036+0000 7f5f3ddb9640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5f340e0040 0x7f5f340e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3ddb9640 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5f340e0040 0x7f5f340e0420 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193a550 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c1935b60 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c1935b60 2024-09-18T02:04:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193a550 2024-09-18T02:04:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193a550 2024-09-18T02:04:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x7f5f340e0040 2024-09-18T02:04:23.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193ee60 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.040+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c1935b60 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193a550 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c1935b60 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x7f5f340e0040 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193ee60 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193ee60 2024-09-18T02:04:23.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193a550 2024-09-18T02:04:23.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193ee60 2024-09-18T02:04:23.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193ee60 2024-09-18T02:04:23.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c1935b60 2024-09-18T02:04:23.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c1935b60 2024-09-18T02:04:23.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.044+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193a550 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193ee60 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x7f5f340e0040 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c1935b60 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193a550 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193ee60 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193a550 2024-09-18T02:04:23.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x7f5f340e0040 2024-09-18T02:04:23.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193ee60 2024-09-18T02:04:23.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.048+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c193a550 2024-09-18T02:04:23.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x55f2c1935b60 2024-09-18T02:04:23.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19397f0 con 0x7f5f340e0040 2024-09-18T02:04:23.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c193d7d0 con 0x55f2c1935b60 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c193d7d0 con 0x55f2c1935b60 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c193d7d0 con 0x55f2c193ee60 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 zone default found 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 4 Realm: () 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 zonegroup default 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c193e120 con 0x55f2c193a550 2024-09-18T02:04:23.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1943820 con 0x55f2c193ee60 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1943c90 con 0x55f2c193ee60 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 started sync module instance, tier type = 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:23.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.052+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1942c60 con 0x7f5f340e0040 2024-09-18T02:04:23.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.056+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.056+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94501118161248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1942c60 con 0x7f5f340e0040 2024-09-18T02:04:23.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.056+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19447b0 con 0x55f2c1935b60 2024-09-18T02:04:23.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.056+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94501118161248] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.056+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.056+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94501118165664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1942c60 con 0x55f2c1935b60 2024-09-18T02:04:23.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.056+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19451c0 con 0x55f2c193ee60 2024-09-18T02:04:23.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94501118165664] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94501118158768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1942bd0 con 0x55f2c193ee60 2024-09-18T02:04:23.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1945ec0 con 0x7f5f340e0040 2024-09-18T02:04:23.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94501118171936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19465d0 con 0x7f5f340e0040 2024-09-18T02:04:23.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19470f0 con 0x55f2c1935b60 2024-09-18T02:04:23.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94501118158768] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94501118171936] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94501118176192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19470b0 con 0x55f2c1935b60 2024-09-18T02:04:23.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.060+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19474e0 con 0x55f2c193a550 2024-09-18T02:04:23.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.064+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94501118176192] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.064+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.064+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94501118173216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19478d0 con 0x55f2c193a550 2024-09-18T02:04:23.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.064+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1948160 con 0x55f2c193a550 2024-09-18T02:04:23.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94501118173216] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94501118170464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1948340 con 0x55f2c193a550 2024-09-18T02:04:23.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1948bd0 con 0x55f2c193a550 2024-09-18T02:04:23.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94501118182208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1949260 con 0x55f2c193a550 2024-09-18T02:04:23.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3faa8980 20 add_watcher() i=0 2024-09-18T02:04:23.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3faa8980 20 add_watcher() i=1 2024-09-18T02:04:23.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3faa8980 20 add_watcher() i=2 2024-09-18T02:04:23.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3faa8980 20 add_watcher() i=3 2024-09-18T02:04:23.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3faa8980 20 add_watcher() i=4 2024-09-18T02:04:23.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3faa8980 20 add_watcher() i=5 2024-09-18T02:04:23.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94501118170464] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.068+0000 7f5f3faa8980 20 add_watcher() i=6 2024-09-18T02:04:23.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94501118182208] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 20 add_watcher() i=7 2024-09-18T02:04:23.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:23.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c194c180 con 0x55f2c1935b60 2024-09-18T02:04:23.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94501118184608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1949570 con 0x55f2c1935b60 2024-09-18T02:04:23.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94501118184608] v30'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5df3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:23.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:23.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:23.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 5 note: GC not initialized 2024-09-18T02:04:23.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5df2fe5640 20 reqs_thread_entry: start 2024-09-18T02:04:23.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:23.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 20 Filter name: none 2024-09-18T02:04:23.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5df0fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:23.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:23.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.072+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c196f660 con 0x55f2c1935b60 2024-09-18T02:04:23.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:23.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1971740 con 0x7f5f340e0040 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 : miss 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1972f80 con 0x55f2c193ee60 2024-09-18T02:04:23.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:23.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:23.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:23.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:23.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:23.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:23.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-18T02:04:23.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1977690 con 0x55f2c193a550 2024-09-18T02:04:23.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(65 fud.buckets [call] v30'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.076+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c197d5d0 con 0x55f2c193ee60 2024-09-18T02:04:23.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(66 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3faa8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:23.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3faa8980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:23.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3faa8980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:23.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3faa8980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1, ofs0, ns] 2024-09-18T02:04:23.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94501118359104 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1977ac0 con 0x55f2c193a550 2024-09-18T02:04:23.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== watch-notify(notify (1) cookie 94501118182208 notify 128849018887 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55f2c1915980 con 0x55f2c193a550 2024-09-18T02:04:23.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5e20ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94501118182208 notifier 4529 bl.length()=752 2024-09-18T02:04:23.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5e20ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:23.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5e20ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:23.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(67 notify.7 [notify cookie 94501118359104 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5e20ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:23.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5e20ff9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5e00003eb0 con 0x55f2c193a550 2024-09-18T02:04:23.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== watch-notify(notify_complete (2) cookie 94501118359104 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f2c19156f0 con 0x55f2c193a550 2024-09-18T02:04:23.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3faa8980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_sources= new_sources= 2024-09-18T02:04:23.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3faa8980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential sources added=[] removed=[] 2024-09-18T02:04:23.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3faa8980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_dests= new_dests= 2024-09-18T02:04:23.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3faa8980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential dests added=[] removed=[] 2024-09-18T02:04:23.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.080+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1973620 con 0x7f5f340e0040 2024-09-18T02:04:23.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(69 foo.buckets [call] v30'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c1973620 con 0x7f5f340e0040 2024-09-18T02:04:23.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5f3faa8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T02:04:23.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5f3faa8980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:23.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5f3faa8980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T02:04:23.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94501118359072 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f2c197c260 con 0x55f2c193a550 2024-09-18T02:04:23.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== watch-notify(notify (1) cookie 94501118170464 notify 128849018888 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55f2c18fa3b0 con 0x55f2c193a550 2024-09-18T02:04:23.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5e20ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94501118170464 notifier 4529 bl.length()=314 2024-09-18T02:04:23.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5e20ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T02:04:23.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5e20ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:23.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(71 notify.6 [notify cookie 94501118359072 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.084+0000 7f5e20ff9640 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5e00003eb0 con 0x55f2c193a550 2024-09-18T02:04:23.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.088+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.088+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== watch-notify(notify_complete (2) cookie 94501118359072 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f2c18f76d0 con 0x55f2c193a550 2024-09-18T02:04:23.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.088+0000 7f5df3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:23.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.088+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94501118184608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c196d490 con 0x55f2c1935b60 2024-09-18T02:04:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.088+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94501118184608] v30'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.088+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94501118161248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c196d490 con 0x7f5f340e0040 2024-09-18T02:04:23.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.092+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94501118161248] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.092+0000 7f5f3faa8980 20 remove_watcher() i=0 2024-09-18T02:04:23.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.092+0000 7f5f3faa8980 2 removed watcher, disabling cache 2024-09-18T02:04:23.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.092+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94501118165664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c196d490 con 0x55f2c1935b60 2024-09-18T02:04:23.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.092+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94501118165664] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.092+0000 7f5f3faa8980 20 remove_watcher() i=1 2024-09-18T02:04:23.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.092+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94501118158768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19442a0 con 0x55f2c193ee60 2024-09-18T02:04:23.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.096+0000 7f5f3cdb7640 1 -- 172.21.15.167:0/2747801754 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94501118158768] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340aaad0 con 0x55f2c193ee60 2024-09-18T02:04:23.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.096+0000 7f5f3faa8980 20 remove_watcher() i=2 2024-09-18T02:04:23.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.096+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94501118171936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c196d490 con 0x7f5f340e0040 2024-09-18T02:04:23.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.096+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94501118171936] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x7f5f340e0040 2024-09-18T02:04:23.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.096+0000 7f5f3faa8980 20 remove_watcher() i=3 2024-09-18T02:04:23.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.096+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94501118176192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19427b0 con 0x55f2c1935b60 2024-09-18T02:04:23.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.096+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94501118176192] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3800a4d0 con 0x55f2c1935b60 2024-09-18T02:04:23.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.096+0000 7f5f3faa8980 20 remove_watcher() i=4 2024-09-18T02:04:23.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.096+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94501118173216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19442a0 con 0x55f2c193a550 2024-09-18T02:04:23.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.100+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94501118173216] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.100+0000 7f5f3faa8980 20 remove_watcher() i=5 2024-09-18T02:04:23.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.100+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94501118170464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c196d490 con 0x55f2c193a550 2024-09-18T02:04:23.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.100+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94501118170464] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.100+0000 7f5f3faa8980 20 remove_watcher() i=6 2024-09-18T02:04:23.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.100+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94501118182208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f2c19427b0 con 0x55f2c193a550 2024-09-18T02:04:23.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3d5b8640 1 -- 172.21.15.167:0/2747801754 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94501118182208] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3003a070 con 0x55f2c193a550 2024-09-18T02:04:23.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 20 remove_watcher() i=7 2024-09-18T02:04:23.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f2c193a550 msgr2=0x55f2c193c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f2c193a550 0x55f2c193c940 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f2c1935b60 msgr2=0x55f2c1938020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f2c1935b60 0x55f2c1938020 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5f340e0040 msgr2=0x7f5f340e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5f340e0040 0x7f5f340e0420 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f2c193ee60 msgr2=0x55f2c1941290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f2c193ee60 0x55f2c1941290 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e08034600 msgr2=0x7f5e08036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e08034600 0x7f5e08036ac0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5f34000c10 tx=0x7f5f340c1040 comp rx=0 tx=0).stop 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/2747801754 reap_dead start 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 msgr2=0x55f2c1804bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1804bb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5f30047490 tx=0x7f5f30010070 comp rx=0 tx=0).stop 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 shutdown_connections 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/2747801754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c19216b0 0x55f2c1804bb0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 >> 172.21.15.167:0/2747801754 conn(0x55f2c191da90 msgr2=0x55f2c191bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 shutdown_connections 2024-09-18T02:04:23.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/2747801754 wait complete. 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/572353514 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e14034650 msgr2=0x7f5e14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/572353514 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e14034650 0x7f5e14036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f34017f50 tx=0x7f5f34005ad0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/572353514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1914d90 msgr2=0x55f2c19151b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/572353514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1914d90 0x55f2c19151b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5f300186e0 tx=0x7f5f30028eb0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/572353514 shutdown_connections 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/572353514 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e14034650 0x7f5e14036b10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/572353514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1914d90 0x55f2c19151b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/572353514 >> 172.21.15.167:0/572353514 conn(0x55f2c1909ee0 msgr2=0x55f2c190c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/572353514 shutdown_connections 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/572353514 wait complete. 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f2c19008c0 msgr2=0x55f2c1902cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f2c19008c0 0x55f2c1902cb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f2c18089f0 msgr2=0x55f2c18fe000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f2c18089f0 0x55f2c18fe000 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f2c19047c0 msgr2=0x55f2c1906bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f2c19047c0 0x55f2c1906bb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e24034650 msgr2=0x7f5e24036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5e24034650 0x7f5e24036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5f340ae000 tx=0x7f5f340a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 msgr2=0x55f2c18f6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 --2- 172.21.15.167:0/3140682228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2c1778aa0 0x55f2c18f6f00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b6f0 tx=0x7f5f30000ee0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3ddb9640 1 -- 172.21.15.167:0/3140682228 reap_dead start 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 shutdown_connections 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 >> 172.21.15.167:0/3140682228 conn(0x55f2c17ff000 msgr2=0x55f2c18ea260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 shutdown_connections 2024-09-18T02:04:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.104+0000 7f5f3faa8980 1 -- 172.21.15.167:0/3140682228 wait complete. 2024-09-18T02:04:23.119 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-18T02:04:23.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-18T02:04:23.120 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-18T02:04:23.193 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:23.194 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:23.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.192+0000 7f46260ff980 1 Processor -- start 2024-09-18T02:04:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.192+0000 7f46260ff980 1 -- start start 2024-09-18T02:04:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.192+0000 7f46260ff980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x559cdb811690 0x559cdb811a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.192+0000 7f46260ff980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559cdb699ae0 con 0x559cdb811fe0 2024-09-18T02:04:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.192+0000 7f46260ff980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x559cdb6bde30 con 0x559cdb811690 2024-09-18T02:04:23.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.192+0000 7f4623c0f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x559cdb811690 0x559cdb811a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.192+0000 7f4623c0f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x559cdb811690 0x559cdb811a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57654/0 (socket says 172.21.15.167:57654) 2024-09-18T02:04:23.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.192+0000 7f4623c0f640 1 -- 172.21.15.167:0/2220272132 learned_addr learned my addr 172.21.15.167:0/2220272132 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.192+0000 7f4623c0f640 1 -- 172.21.15.167:0/2220272132 >> v1:172.21.15.81:6789/0 conn(0x559cdb811fe0 legacy=0x559cdb816a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.192+0000 7f4623c0f640 1 -- 172.21.15.167:0/2220272132 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cdb819260 con 0x559cdb811690 2024-09-18T02:04:23.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.196+0000 7f4623c0f640 1 --2- 172.21.15.167:0/2220272132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb811a70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f461400a4e0 tx=0x7f461401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2eeec2d7bee5262 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.196+0000 7f4622c0d640 1 -- 172.21.15.167:0/2220272132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46140aa540 con 0x559cdb811690 2024-09-18T02:04:23.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.196+0000 7f4622c0d640 1 -- 172.21.15.167:0/2220272132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46140aa6e0 con 0x559cdb811690 2024-09-18T02:04:23.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.196+0000 7f4622c0d640 1 -- 172.21.15.167:0/2220272132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46140aaa40 con 0x559cdb811690 2024-09-18T02:04:23.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.196+0000 7f46260ff980 1 -- 172.21.15.167:0/2220272132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 msgr2=0x559cdb811a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.196+0000 7f46260ff980 1 --2- 172.21.15.167:0/2220272132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb811a70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f461400a4e0 tx=0x7f461401b090 comp rx=0 tx=0).stop 2024-09-18T02:04:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.196+0000 7f46260ff980 1 -- 172.21.15.167:0/2220272132 shutdown_connections 2024-09-18T02:04:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.196+0000 7f46260ff980 1 --2- 172.21.15.167:0/2220272132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb811a70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.196+0000 7f46260ff980 1 -- 172.21.15.167:0/2220272132 >> 172.21.15.167:0/2220272132 conn(0x559cdb80d1b0 msgr2=0x559cdb80f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.196+0000 7f46260ff980 1 -- 172.21.15.167:0/2220272132 shutdown_connections 2024-09-18T02:04:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.196+0000 7f46260ff980 1 -- 172.21.15.167:0/2220272132 wait complete. 2024-09-18T02:04:23.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.212+0000 7f46260ff980 1 Processor -- start 2024-09-18T02:04:23.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.212+0000 7f46260ff980 1 -- start start 2024-09-18T02:04:23.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.212+0000 7f46260ff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb8fca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.212+0000 7f46260ff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559cdb6bf200 con 0x559cdb811690 2024-09-18T02:04:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.212+0000 7f4623c0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb8fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.212+0000 7f4623c0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb8fca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57668/0 (socket says 172.21.15.167:57668) 2024-09-18T02:04:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.212+0000 7f4623c0f640 1 -- 172.21.15.167:0/797309337 learned_addr learned my addr 172.21.15.167:0/797309337 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.212+0000 7f4623c0f640 1 -- 172.21.15.167:0/797309337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cdb8fd040 con 0x559cdb811690 2024-09-18T02:04:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.212+0000 7f4623c0f640 1 --2- 172.21.15.167:0/797309337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb8fca70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4614018cc0 tx=0x7f46140033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521c4ab7366a98b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f4511e0b640 1 -- 172.21.15.167:0/797309337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46140b9070 con 0x559cdb811690 2024-09-18T02:04:23.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f4511e0b640 1 -- 172.21.15.167:0/797309337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46140aab50 con 0x559cdb811690 2024-09-18T02:04:23.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f4511e0b640 1 -- 172.21.15.167:0/797309337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46140aae50 con 0x559cdb811690 2024-09-18T02:04:23.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 -- 172.21.15.167:0/797309337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 msgr2=0x559cdb8fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 --2- 172.21.15.167:0/797309337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb8fca70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4614018cc0 tx=0x7f46140033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 -- 172.21.15.167:0/797309337 shutdown_connections 2024-09-18T02:04:23.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 --2- 172.21.15.167:0/797309337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb8fca70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 -- 172.21.15.167:0/797309337 >> 172.21.15.167:0/797309337 conn(0x559cdb80d1b0 msgr2=0x559cdb8f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 -- 172.21.15.167:0/797309337 shutdown_connections 2024-09-18T02:04:23.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 -- 172.21.15.167:0/797309337 wait complete. 2024-09-18T02:04:23.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 Processor -- start 2024-09-18T02:04:23.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 -- start start 2024-09-18T02:04:23.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb903cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559cdb818ca0 con 0x559cdb811690 2024-09-18T02:04:23.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f4623c0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb903cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f4623c0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb903cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57680/0 (socket says 172.21.15.167:57680) 2024-09-18T02:04:23.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f4623c0f640 1 -- 172.21.15.167:0/4116597536 learned_addr learned my addr 172.21.15.167:0/4116597536 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f4623c0f640 1 -- 172.21.15.167:0/4116597536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cdb9041f0 con 0x559cdb811690 2024-09-18T02:04:23.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f4623c0f640 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb903cb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4614017ca0 tx=0x7f4614017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f450bfff640 1 -- 172.21.15.167:0/4116597536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46140b9070 con 0x559cdb811690 2024-09-18T02:04:23.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f450bfff640 1 -- 172.21.15.167:0/4116597536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46140b5e40 con 0x559cdb811690 2024-09-18T02:04:23.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cdb904480 con 0x559cdb811690 2024-09-18T02:04:23.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f450bfff640 1 -- 172.21.15.167:0/4116597536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46140c7580 con 0x559cdb811690 2024-09-18T02:04:23.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.216+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cdb907160 con 0x559cdb811690 2024-09-18T02:04:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f450bfff640 1 -- 172.21.15.167:0/4116597536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46140b3040 con 0x559cdb811690 2024-09-18T02:04:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f450bfff640 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f450c034650 0x7f450c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f450bfff640 1 -- 172.21.15.167:0/4116597536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f46140c4070 con 0x559cdb811690 2024-09-18T02:04:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f462340e640 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f450c034650 0x7f450c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f46260ff980 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559cdb811fe0 0x559cdb90adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb90b2f0 con 0x559cdb811fe0 2024-09-18T02:04:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f4624410640 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559cdb811fe0 0x559cdb90adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f462340e640 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f450c034650 0x7f450c036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f460c000f70 tx=0x7f460c001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f4624410640 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559cdb811fe0 0x559cdb90adb0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f4624410640 1 -- 172.21.15.167:0/4116597536 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461c0083f0 con 0x559cdb811fe0 2024-09-18T02:04:23.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb90bc00 con 0x559cdb811fe0 2024-09-18T02:04:23.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f4624410640 1 -- 172.21.15.167:0/4116597536 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f461c0083f0 con 0x559cdb811fe0 2024-09-18T02:04:23.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f46260ff980 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559cdb90d510 0x559cdb90f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb910140 con 0x559cdb90d510 2024-09-18T02:04:23.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f4623c0f640 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559cdb90d510 0x559cdb90f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.225 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.220+0000 7f4623c0f640 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559cdb90d510 0x559cdb90f9b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f4623c0f640 1 -- 172.21.15.167:0/4116597536 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f46140cd060 con 0x559cdb90d510 2024-09-18T02:04:23.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb90c450 con 0x559cdb811fe0 2024-09-18T02:04:23.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f4624410640 1 -- 172.21.15.167:0/4116597536 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f461c0083f0 con 0x559cdb811fe0 2024-09-18T02:04:23.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f46260ff980 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559cdb9115a0 0x559cdb913990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb914100 con 0x559cdb9115a0 2024-09-18T02:04:23.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f462340e640 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559cdb9115a0 0x559cdb913990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f462340e640 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559cdb9115a0 0x559cdb913990 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f462340e640 1 -- 172.21.15.167:0/4116597536 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f460c00d040 con 0x559cdb9115a0 2024-09-18T02:04:23.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f46260ff980 1 Processor -- start 2024-09-18T02:04:23.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f46260ff980 1 -- start start 2024-09-18T02:04:23.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f46260ff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb788590 0x559cdb786c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f46260ff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559cdb718800 con 0x559cdb788590 2024-09-18T02:04:23.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f4623c0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb788590 0x559cdb786c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f4623c0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb788590 0x559cdb786c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57694/0 (socket says 172.21.15.167:57694) 2024-09-18T02:04:23.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f4623c0f640 1 -- 172.21.15.167:0/3203438547 learned_addr learned my addr 172.21.15.167:0/3203438547 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f4623c0f640 1 -- 172.21.15.167:0/3203438547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cdb7889b0 con 0x559cdb788590 2024-09-18T02:04:23.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f4623c0f640 1 --2- 172.21.15.167:0/3203438547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb788590 0x559cdb786c10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f46140b3900 tx=0x7f46140c6db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f45097fa640 1 -- 172.21.15.167:0/3203438547 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46140e43f0 con 0x559cdb788590 2024-09-18T02:04:23.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f45097fa640 1 -- 172.21.15.167:0/3203438547 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46140bd5e0 con 0x559cdb788590 2024-09-18T02:04:23.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f46260ff980 1 -- 172.21.15.167:0/3203438547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cdb787150 con 0x559cdb788590 2024-09-18T02:04:23.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f45097fa640 1 -- 172.21.15.167:0/3203438547 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46140bd8c0 con 0x559cdb788590 2024-09-18T02:04:23.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.224+0000 7f46260ff980 1 -- 172.21.15.167:0/3203438547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cdb787150 con 0x559cdb788590 2024-09-18T02:04:23.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f45097fa640 1 -- 172.21.15.167:0/3203438547 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46140b3970 con 0x559cdb788590 2024-09-18T02:04:23.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f45097fa640 1 --2- 172.21.15.167:0/3203438547 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f44fc034650 0x7f44fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f45097fa640 1 -- 172.21.15.167:0/3203438547 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f46140dc070 con 0x559cdb788590 2024-09-18T02:04:23.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f462340e640 1 --2- 172.21.15.167:0/3203438547 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f44fc034650 0x7f44fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f46260ff980 1 Processor -- start 2024-09-18T02:04:23.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f46260ff980 1 -- start start 2024-09-18T02:04:23.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f46260ff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9306d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f46260ff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559cdb8fd300 con 0x559cdb9302f0 2024-09-18T02:04:23.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f462340e640 1 --2- 172.21.15.167:0/3203438547 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f44fc034650 0x7f44fc036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x559cdb9104e0 tx=0x7f460c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f4623c0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f4623c0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9306d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57704/0 (socket says 172.21.15.167:57704) 2024-09-18T02:04:23.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f4623c0f640 1 -- 172.21.15.167:0/2514935563 learned_addr learned my addr 172.21.15.167:0/2514935563 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f4623c0f640 1 -- 172.21.15.167:0/2514935563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cdb930ca0 con 0x559cdb9302f0 2024-09-18T02:04:23.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f4623c0f640 1 --2- 172.21.15.167:0/2514935563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9306d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f46140c6f00 tx=0x7f46140d6860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332a740f83aa32c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f4502ffd640 1 -- 172.21.15.167:0/2514935563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46140fb070 con 0x559cdb9302f0 2024-09-18T02:04:23.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f4502ffd640 1 -- 172.21.15.167:0/2514935563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46140c7d50 con 0x559cdb9302f0 2024-09-18T02:04:23.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f4502ffd640 1 -- 172.21.15.167:0/2514935563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46140b3cb0 con 0x559cdb9302f0 2024-09-18T02:04:23.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f46260ff980 1 -- 172.21.15.167:0/2514935563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 msgr2=0x559cdb9306d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f46260ff980 1 --2- 172.21.15.167:0/2514935563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9306d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f46140c6f00 tx=0x7f46140d6860 comp rx=0 tx=0).stop 2024-09-18T02:04:23.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f46260ff980 1 -- 172.21.15.167:0/2514935563 shutdown_connections 2024-09-18T02:04:23.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f46260ff980 1 --2- 172.21.15.167:0/2514935563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9306d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f46260ff980 1 -- 172.21.15.167:0/2514935563 >> 172.21.15.167:0/2514935563 conn(0x559cdb92c6d0 msgr2=0x559cdb92a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f46260ff980 1 -- 172.21.15.167:0/2514935563 shutdown_connections 2024-09-18T02:04:23.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.228+0000 7f46260ff980 1 -- 172.21.15.167:0/2514935563 wait complete. 2024-09-18T02:04:23.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f46260ff980 1 Processor -- start 2024-09-18T02:04:23.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f46260ff980 1 -- start start 2024-09-18T02:04:23.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f46260ff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9375a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f46260ff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559cdb931140 con 0x559cdb9302f0 2024-09-18T02:04:23.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f4623c0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f4623c0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9375a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57718/0 (socket says 172.21.15.167:57718) 2024-09-18T02:04:23.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 learned_addr learned my addr 172.21.15.167:0/2246874459 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cdb937ae0 con 0x559cdb9302f0 2024-09-18T02:04:23.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f4623c0f640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9375a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f46140df000 tx=0x7f46140d66e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f45017fa640 1 -- 172.21.15.167:0/2246874459 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4614104020 con 0x559cdb9302f0 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cdb937ae0 con 0x559cdb9302f0 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f45017fa640 1 -- 172.21.15.167:0/2246874459 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46140fc040 con 0x559cdb9302f0 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f45017fa640 1 -- 172.21.15.167:0/2246874459 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46140fb050 con 0x559cdb9302f0 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cdb937ae0 con 0x559cdb9302f0 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f45017fa640 1 -- 172.21.15.167:0/2246874459 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4614107020 con 0x559cdb9302f0 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f45017fa640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f44ec034600 0x7f44ec036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.232+0000 7f45017fa640 1 -- 172.21.15.167:0/2246874459 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f461410aab0 con 0x559cdb9302f0 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f462340e640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f44ec034600 0x7f44ec036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559cdb942610 0x559cdb944ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb945220 con 0x559cdb942610 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f4624410640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559cdb942610 0x559cdb944ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f462340e640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f44ec034600 0x7f44ec036ac0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x559cdb9144e0 tx=0x7f460c011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f4624410640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559cdb942610 0x559cdb944ad0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461c0083f0 con 0x559cdb942610 2024-09-18T02:04:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 realm 2024-09-18T02:04:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb945630 con 0x559cdb942610 2024-09-18T02:04:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461c0083f0 con 0x559cdb942610 2024-09-18T02:04:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb945f00 con 0x559cdb942610 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461c0083f0 con 0x559cdb942610 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb942610 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f461c0083f0 con 0x559cdb942610 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559cdb947000 0x559cdb9493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9499b0 con 0x559cdb947000 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f4623c0f640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559cdb947000 0x559cdb9493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f4623c0f640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559cdb947000 0x559cdb9493f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 20 searching for the correct realm 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559cdb94b900 0x559cdb94dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94e3e0 con 0x559cdb94b900 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.236+0000 7f462340e640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559cdb94b900 0x559cdb94dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f462340e640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559cdb94b900 0x559cdb94dd10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f462340e640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f460c00f3d0 0x7f460c00f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94e3e0 con 0x7f460c00f3d0 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4624410640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f460c00f3d0 0x7f460c00f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4624410640 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f460c00f3d0 0x7f460c00f7f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0083f0 con 0x7f460c00f3d0 2024-09-18T02:04:23.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb947000 2024-09-18T02:04:23.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb942610 2024-09-18T02:04:23.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0083f0 con 0x559cdb942610 2024-09-18T02:04:23.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb942610 2024-09-18T02:04:23.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb947000 2024-09-18T02:04:23.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb947000 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.240+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x7f460c00f3d0 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb94b900 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb942610 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb947000 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb942610 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x7f460c00f3d0 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb94b900 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb94b900 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb947000 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb94b900 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb94b900 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.244+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb942610 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb942610 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb947000 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb94b900 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x7f460c00f3d0 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb942610 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb947000 2024-09-18T02:04:23.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb94b900 2024-09-18T02:04:23.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.248+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb947000 2024-09-18T02:04:23.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x7f460c00f3d0 2024-09-18T02:04:23.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb94b900 2024-09-18T02:04:23.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb947000 2024-09-18T02:04:23.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x559cdb942610 2024-09-18T02:04:23.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9462a0 con 0x7f460c00f3d0 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94a270 con 0x559cdb942610 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94a270 con 0x559cdb942610 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94a270 con 0x559cdb94b900 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 zone default found 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 4 Realm: () 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 zonegroup default 2024-09-18T02:04:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94ac10 con 0x559cdb947000 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.252+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94a770 con 0x559cdb94b900 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f46260ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9507f0 con 0x559cdb94b900 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f46260ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f46260ff980 20 started sync module instance, tier type = 2024-09-18T02:04:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f46260ff980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:23.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94fb80 con 0x7f460c00f3d0 2024-09-18T02:04:23.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94132187234464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94fb80 con 0x7f460c00f3d0 2024-09-18T02:04:23.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb951270 con 0x559cdb942610 2024-09-18T02:04:23.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94132187234464] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.256+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.260+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94132187238096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94fb80 con 0x559cdb942610 2024-09-18T02:04:23.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.260+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb951cb0 con 0x559cdb94b900 2024-09-18T02:04:23.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.260+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94132187238096] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.260+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.260+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94132187231952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94faf0 con 0x559cdb94b900 2024-09-18T02:04:23.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.260+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9529f0 con 0x7f460c00f3d0 2024-09-18T02:04:23.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.260+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.260+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94132187243776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb952920 con 0x7f460c00f3d0 2024-09-18T02:04:23.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.260+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9538b0 con 0x559cdb942610 2024-09-18T02:04:23.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.264+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94132187231952] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.264+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94132187243776] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.264+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.264+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94132187242576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb953400 con 0x559cdb942610 2024-09-18T02:04:23.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.264+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb954150 con 0x559cdb947000 2024-09-18T02:04:23.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.264+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94132187242576] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.268+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.268+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94132187249824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb953400 con 0x559cdb947000 2024-09-18T02:04:23.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.268+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9549a0 con 0x559cdb947000 2024-09-18T02:04:23.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.268+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.268+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94132187254080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb955610 con 0x559cdb947000 2024-09-18T02:04:23.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.268+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb956010 con 0x559cdb947000 2024-09-18T02:04:23.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.268+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94132187249824] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94132187254080] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94132187245968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb955160 con 0x559cdb947000 2024-09-18T02:04:23.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 20 add_watcher() i=0 2024-09-18T02:04:23.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 20 add_watcher() i=1 2024-09-18T02:04:23.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 20 add_watcher() i=2 2024-09-18T02:04:23.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 20 add_watcher() i=3 2024-09-18T02:04:23.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 20 add_watcher() i=4 2024-09-18T02:04:23.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 20 add_watcher() i=5 2024-09-18T02:04:23.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 20 add_watcher() i=6 2024-09-18T02:04:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94132187245968] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 20 add_watcher() i=7 2024-09-18T02:04:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb955160 con 0x559cdb942610 2024-09-18T02:04:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.272+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94132187257632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb955160 con 0x559cdb942610 2024-09-18T02:04:23.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.276+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94132187257632] v30'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.276+0000 7f44d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:23.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.276+0000 7f46260ff980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:23.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.276+0000 7f46260ff980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:23.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.276+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb961810 con 0x559cdb942610 2024-09-18T02:04:23.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.276+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'45 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.276+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb961e60 con 0x559cdb947000 2024-09-18T02:04:23.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.280+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'21 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.280+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9622c0 con 0x559cdb94b900 2024-09-18T02:04:23.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.280+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.280+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb962640 con 0x559cdb942610 2024-09-18T02:04:23.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.280+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'128 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.280+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb962a60 con 0x7f460c00f3d0 2024-09-18T02:04:23.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.284+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.284+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb962ea0 con 0x559cdb94b900 2024-09-18T02:04:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.284+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.284+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963410 con 0x559cdb942610 2024-09-18T02:04:23.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.288+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.288+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963410 con 0x559cdb947000 2024-09-18T02:04:23.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.288+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.288+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9634a0 con 0x7f460c00f3d0 2024-09-18T02:04:23.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.292+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.292+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9634a0 con 0x559cdb94b900 2024-09-18T02:04:23.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.292+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.292+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963a30 con 0x7f460c00f3d0 2024-09-18T02:04:23.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.292+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.292+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963a30 con 0x559cdb947000 2024-09-18T02:04:23.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.296+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.296+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963ac0 con 0x7f460c00f3d0 2024-09-18T02:04:23.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.296+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.296+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963ac0 con 0x559cdb947000 2024-09-18T02:04:23.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.300+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'43 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.300+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963b50 con 0x559cdb942610 2024-09-18T02:04:23.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.300+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'129 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.300+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963b50 con 0x559cdb94b900 2024-09-18T02:04:23.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.304+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.304+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963be0 con 0x7f460c00f3d0 2024-09-18T02:04:23.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.304+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'43 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.304+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963be0 con 0x559cdb94b900 2024-09-18T02:04:23.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.304+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.304+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb942610 2024-09-18T02:04:23.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.308+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.308+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb942610 2024-09-18T02:04:23.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.308+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'130 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.308+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb94b900 2024-09-18T02:04:23.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.312+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.312+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x7f460c00f3d0 2024-09-18T02:04:23.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.312+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.312+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb94b900 2024-09-18T02:04:23.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.312+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.312+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb94b900 2024-09-18T02:04:23.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.316+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.316+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb94b900 2024-09-18T02:04:23.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.316+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.316+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb94b900 2024-09-18T02:04:23.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.316+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'36 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.316+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb947000 2024-09-18T02:04:23.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.320+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.320+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb94b900 2024-09-18T02:04:23.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.320+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.320+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb947000 2024-09-18T02:04:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.324+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.324+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb94b900 2024-09-18T02:04:23.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.324+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.324+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x559cdb947000 2024-09-18T02:04:23.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.328+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'44 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.328+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb963c90 con 0x7f460c00f3d0 2024-09-18T02:04:23.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f44d8fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 20 Filter name: none 2024-09-18T02:04:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f44527fc640 20 reqs_thread_entry: start 2024-09-18T02:04:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T02:04:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb97f490 con 0x559cdb947000 2024-09-18T02:04:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T02:04:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T02:04:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:04:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb981960 con 0x559cdb947000 2024-09-18T02:04:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-18T02:04:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.332+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb97f940 con 0x559cdb947000 2024-09-18T02:04:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f46260ff980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T02:04:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94132187432096 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb981fa0 con 0x559cdb94b900 2024-09-18T02:04:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== watch-notify(notify (1) cookie 94132187231952 notify 128849018889 ret 0) ==== 212+0+0 (crc 0 0 0) 0x559cdb9641b0 con 0x559cdb94b900 2024-09-18T02:04:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f4502ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94132187231952 notifier 4536 bl.length()=170 2024-09-18T02:04:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(97 notify.2 [notify cookie 94132187432096 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f4502ffd640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f44e8003d70 con 0x559cdb94b900 2024-09-18T02:04:23.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== watch-notify(notify_complete (2) cookie 94132187432096 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559cdb962ea0 con 0x559cdb94b900 2024-09-18T02:04:23.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f46260ff980 10 removing email index: 2024-09-18T02:04:23.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f46260ff980 10 removing user buckets index 2024-09-18T02:04:23.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb981ea0 con 0x559cdb947000 2024-09-18T02:04:23.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(99 fud.buckets [delete] v30'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f46260ff980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-18T02:04:23.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.336+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94132187437552 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9814b0 con 0x559cdb947000 2024-09-18T02:04:23.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== watch-notify(notify (1) cookie 94132187254080 notify 128849018889 ret 0) ==== 202+0+0 (crc 0 0 0) 0x559cdb9634f0 con 0x559cdb947000 2024-09-18T02:04:23.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f45027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94132187254080 notifier 4536 bl.length()=160 2024-09-18T02:04:23.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== osd_op_reply(100 notify.6 [notify cookie 94132187437552 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f45027fc640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f44580032d0 con 0x559cdb947000 2024-09-18T02:04:23.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== watch-notify(notify_complete (2) cookie 94132187437552 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f46140d5420 con 0x559cdb947000 2024-09-18T02:04:23.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f46260ff980 10 removing user index: fud 2024-09-18T02:04:23.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb981ea0 con 0x559cdb947000 2024-09-18T02:04:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 33 ==== osd_op_reply(102 fud [call,call,delete] v30'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f46260ff980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-18T02:04:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f46260ff980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T02:04:23.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.340+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94132187437552 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559cdb9804a0 con 0x559cdb947000 2024-09-18T02:04:23.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.344+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 34 ==== watch-notify(notify (1) cookie 94132187249824 notify 128849018890 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f46140d5420 con 0x559cdb947000 2024-09-18T02:04:23.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.344+0000 7f45027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94132187249824 notifier 4536 bl.length()=152 2024-09-18T02:04:23.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.344+0000 7f45027fc640 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4458003270 con 0x559cdb947000 2024-09-18T02:04:23.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.344+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 35 ==== osd_op_reply(103 notify.5 [notify cookie 94132187437552 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.344+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.344+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 37 ==== watch-notify(notify_complete (2) cookie 94132187437552 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559cdb907160 con 0x559cdb947000 2024-09-18T02:04:23.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.344+0000 7f44d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:23.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.344+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94132187257632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb95dc80 con 0x559cdb942610 2024-09-18T02:04:23.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.348+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94132187257632] v30'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.348+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94132187234464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb955b20 con 0x7f460c00f3d0 2024-09-18T02:04:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.348+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94132187234464] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.348+0000 7f46260ff980 20 remove_watcher() i=0 2024-09-18T02:04:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.348+0000 7f46260ff980 2 removed watcher, disabling cache 2024-09-18T02:04:23.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.348+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94132187238096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb955b20 con 0x559cdb942610 2024-09-18T02:04:23.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.348+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94132187238096] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.348+0000 7f46260ff980 20 remove_watcher() i=1 2024-09-18T02:04:23.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.348+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94132187231952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb955b20 con 0x559cdb94b900 2024-09-18T02:04:23.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.352+0000 7f462340e640 1 -- 172.21.15.167:0/2246874459 <== osd.3 v2:172.21.15.167:6808/2476454287 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94132187231952] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c036040 con 0x559cdb94b900 2024-09-18T02:04:23.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.352+0000 7f46260ff980 20 remove_watcher() i=2 2024-09-18T02:04:23.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.352+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94132187243776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94f6d0 con 0x7f460c00f3d0 2024-09-18T02:04:23.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.352+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94132187243776] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x7f460c00f3d0 2024-09-18T02:04:23.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.352+0000 7f46260ff980 20 remove_watcher() i=3 2024-09-18T02:04:23.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.352+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94132187242576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb955b20 con 0x559cdb942610 2024-09-18T02:04:23.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.356+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94132187242576] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c026040 con 0x559cdb942610 2024-09-18T02:04:23.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.356+0000 7f46260ff980 20 remove_watcher() i=4 2024-09-18T02:04:23.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.356+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94132187249824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94f6d0 con 0x559cdb947000 2024-09-18T02:04:23.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.356+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94132187249824] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.356+0000 7f46260ff980 20 remove_watcher() i=5 2024-09-18T02:04:23.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.356+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94132187254080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb955b20 con 0x559cdb947000 2024-09-18T02:04:23.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.360+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94132187254080] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.360+0000 7f46260ff980 20 remove_watcher() i=6 2024-09-18T02:04:23.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.360+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94132187245968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559cdb94f6d0 con 0x559cdb947000 2024-09-18T02:04:23.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.360+0000 7f4623c0f640 1 -- 172.21.15.167:0/2246874459 <== osd.0 v2:172.21.15.81:6800/3087415523 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94132187245968] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46140fe070 con 0x559cdb947000 2024-09-18T02:04:23.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.360+0000 7f46260ff980 20 remove_watcher() i=7 2024-09-18T02:04:23.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559cdb947000 msgr2=0x559cdb9493f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559cdb947000 0x559cdb9493f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559cdb942610 msgr2=0x559cdb944ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559cdb942610 0x559cdb944ad0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f460c00f3d0 msgr2=0x7f460c00f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f460c00f3d0 0x7f460c00f7f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559cdb94b900 msgr2=0x559cdb94dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559cdb94b900 0x559cdb94dd10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f44ec034600 msgr2=0x7f44ec036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f44ec034600 0x7f44ec036ac0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x559cdb9144e0 tx=0x7f460c011000 comp rx=0 tx=0).stop 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 msgr2=0x559cdb9375a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9375a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f46140df000 tx=0x7f46140d66e0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f4624410640 1 -- 172.21.15.167:0/2246874459 reap_dead start 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 shutdown_connections 2024-09-18T02:04:23.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/2246874459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb9302f0 0x559cdb9375a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 >> 172.21.15.167:0/2246874459 conn(0x559cdb92c6d0 msgr2=0x559cdb92a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 shutdown_connections 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/2246874459 wait complete. 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/3203438547 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f44fc034650 msgr2=0x7f44fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/3203438547 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f44fc034650 0x7f44fc036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x559cdb9104e0 tx=0x7f460c006000 comp rx=0 tx=0).stop 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/3203438547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb788590 msgr2=0x559cdb786c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/3203438547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb788590 0x559cdb786c10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f46140b3900 tx=0x7f46140c6db0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/3203438547 shutdown_connections 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/3203438547 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f44fc034650 0x7f44fc036b10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/3203438547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb788590 0x559cdb786c10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/3203438547 >> 172.21.15.167:0/3203438547 conn(0x559cdb916d00 msgr2=0x559cdb919780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/3203438547 shutdown_connections 2024-09-18T02:04:23.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/3203438547 wait complete. 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559cdb90d510 msgr2=0x559cdb90f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x559cdb90d510 0x559cdb90f9b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559cdb811fe0 msgr2=0x559cdb90adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559cdb811fe0 0x559cdb90adb0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559cdb9115a0 msgr2=0x559cdb913990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x559cdb9115a0 0x559cdb913990 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f450c034650 msgr2=0x7f450c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f450c034650 0x7f450c036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f460c000f70 tx=0x7f460c001420 comp rx=0 tx=0).stop 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 msgr2=0x559cdb903cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 --2- 172.21.15.167:0/4116597536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559cdb811690 0x559cdb903cb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4614017ca0 tx=0x7f4614017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f4624410640 1 -- 172.21.15.167:0/4116597536 reap_dead start 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 shutdown_connections 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 >> 172.21.15.167:0/4116597536 conn(0x559cdb80d1b0 msgr2=0x559cdb8f7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 shutdown_connections 2024-09-18T02:04:23.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.364+0000 7f46260ff980 1 -- 172.21.15.167:0/4116597536 wait complete. 2024-09-18T02:04:23.379 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T02:04:23.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T02:04:23.379 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-18T02:04:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.468+0000 7f0d4bfd5980 1 Processor -- start 2024-09-18T02:04:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.468+0000 7f0d4bfd5980 1 -- start start 2024-09-18T02:04:23.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.468+0000 7f0d4bfd5980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55850381ca60 0x5585038ab310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.468+0000 7f0d4bfd5980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558503730ae0 con 0x5585038ab850 2024-09-18T02:04:23.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.468+0000 7f0d4bfd5980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x558503754e30 con 0x55850381ca60 2024-09-18T02:04:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.468+0000 7f0d49ae5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55850381ca60 0x5585038ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.468+0000 7f0d49ae5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55850381ca60 0x5585038ab310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57728/0 (socket says 172.21.15.167:57728) 2024-09-18T02:04:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.468+0000 7f0d49ae5640 1 -- 172.21.15.167:0/1668664449 learned_addr learned my addr 172.21.15.167:0/1668664449 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.468+0000 7f0d492e4640 1 --1- 172.21.15.167:0/1668664449 >> v1:172.21.15.81:6789/0 conn(0x5585038ab850 0x5585038adc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55688/0 (socket says 172.21.15.167:55688) 2024-09-18T02:04:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.468+0000 7f0d49ae5640 1 -- 172.21.15.167:0/1668664449 >> v1:172.21.15.81:6789/0 conn(0x5585038ab850 legacy=0x5585038adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.468+0000 7f0d49ae5640 1 -- 172.21.15.167:0/1668664449 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585038b0370 con 0x55850381ca60 2024-09-18T02:04:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.472+0000 7f0d49ae5640 1 --2- 172.21.15.167:0/1668664449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x5585038ab310 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00a5c0 tx=0x7f0d3c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652e995a17f3120c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.472+0000 7f0d48ae3640 1 -- 172.21.15.167:0/1668664449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c0a6070 con 0x55850381ca60 2024-09-18T02:04:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.472+0000 7f0d48ae3640 1 -- 172.21.15.167:0/1668664449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0af070 con 0x55850381ca60 2024-09-18T02:04:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.472+0000 7f0d48ae3640 1 -- 172.21.15.167:0/1668664449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c0aa5c0 con 0x55850381ca60 2024-09-18T02:04:23.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.472+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/1668664449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 msgr2=0x5585038ab310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.472+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/1668664449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x5585038ab310 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00a5c0 tx=0x7f0d3c01b340 comp rx=0 tx=0).stop 2024-09-18T02:04:23.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.472+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/1668664449 shutdown_connections 2024-09-18T02:04:23.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.472+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/1668664449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x5585038ab310 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.472+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/1668664449 >> 172.21.15.167:0/1668664449 conn(0x5585038a3000 msgr2=0x5585038a5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.472+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/1668664449 shutdown_connections 2024-09-18T02:04:23.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.472+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/1668664449 wait complete. 2024-09-18T02:04:23.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0d4bfd5980 1 Processor -- start 2024-09-18T02:04:23.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0d4bfd5980 1 -- start start 2024-09-18T02:04:23.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0d4bfd5980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x5585038a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0d4bfd5980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558503756200 con 0x55850381ca60 2024-09-18T02:04:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0d49ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x5585038a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0d49ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x5585038a8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57742/0 (socket says 172.21.15.167:57742) 2024-09-18T02:04:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0d49ae5640 1 -- 172.21.15.167:0/93561752 learned_addr learned my addr 172.21.15.167:0/93561752 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0d49ae5640 1 -- 172.21.15.167:0/93561752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585038a9040 con 0x55850381ca60 2024-09-18T02:04:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0d49ae5640 1 --2- 172.21.15.167:0/93561752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x5585038a8a70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0199f0 tx=0x7f0d3c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475331eeb09aca33 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0c37e07640 1 -- 172.21.15.167:0/93561752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c0aaa00 con 0x55850381ca60 2024-09-18T02:04:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0c37e07640 1 -- 172.21.15.167:0/93561752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0aaba0 con 0x55850381ca60 2024-09-18T02:04:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.488+0000 7f0c37e07640 1 -- 172.21.15.167:0/93561752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c0bd3f0 con 0x55850381ca60 2024-09-18T02:04:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/93561752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 msgr2=0x5585038a8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/93561752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x5585038a8a70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0199f0 tx=0x7f0d3c003030 comp rx=0 tx=0).stop 2024-09-18T02:04:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/93561752 shutdown_connections 2024-09-18T02:04:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/93561752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x5585038a8a70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/93561752 >> 172.21.15.167:0/93561752 conn(0x5585038a3000 msgr2=0x55850398f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/93561752 shutdown_connections 2024-09-18T02:04:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/93561752 wait complete. 2024-09-18T02:04:23.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 Processor -- start 2024-09-18T02:04:23.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 -- start start 2024-09-18T02:04:23.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x55850399ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585038afdb0 con 0x55850381ca60 2024-09-18T02:04:23.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d49ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x55850399ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d49ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x55850399ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57756/0 (socket says 172.21.15.167:57756) 2024-09-18T02:04:23.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2023407645 learned_addr learned my addr 172.21.15.167:0/2023407645 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2023407645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55850399d3f0 con 0x55850381ca60 2024-09-18T02:04:23.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d49ae5640 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x55850399ceb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0199f0 tx=0x7f0d3c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0c36604640 1 -- 172.21.15.167:0/2023407645 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c0bd7c0 con 0x55850381ca60 2024-09-18T02:04:23.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55850399d680 con 0x55850381ca60 2024-09-18T02:04:23.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0c36604640 1 -- 172.21.15.167:0/2023407645 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0bd960 con 0x55850381ca60 2024-09-18T02:04:23.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0c36604640 1 -- 172.21.15.167:0/2023407645 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c0bdc40 con 0x55850381ca60 2024-09-18T02:04:23.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585039a0360 con 0x55850381ca60 2024-09-18T02:04:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0c36604640 1 -- 172.21.15.167:0/2023407645 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d3c0ce020 con 0x55850381ca60 2024-09-18T02:04:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.492+0000 7f0c36604640 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c30034650 0x7f0c30036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0c36604640 1 -- 172.21.15.167:0/2023407645 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0d3c0cc020 con 0x55850381ca60 2024-09-18T02:04:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d492e4640 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c30034650 0x7f0c30036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585038ab850 0x5585039a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039a44b0 con 0x5585038ab850 2024-09-18T02:04:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4a2e6640 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585038ab850 0x5585039a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d492e4640 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c30034650 0x7f0c30036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d40001e50 tx=0x7f0d400013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4a2e6640 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585038ab850 0x5585039a3e60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2023407645 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585038ab850 2024-09-18T02:04:23.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039a4d90 con 0x5585038ab850 2024-09-18T02:04:23.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2023407645 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585038ab850 2024-09-18T02:04:23.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585039a66a0 0x5585039a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039a92f0 con 0x5585039a66a0 2024-09-18T02:04:23.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d49ae5640 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585039a66a0 0x5585039a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d49ae5640 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585039a66a0 0x5585039a8b60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2023407645 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0d3c0cf370 con 0x5585039a66a0 2024-09-18T02:04:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039a55e0 con 0x5585038ab850 2024-09-18T02:04:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2023407645 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585038ab850 2024-09-18T02:04:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585039aa750 0x5585039acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039ad230 con 0x5585039aa750 2024-09-18T02:04:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.496+0000 7f0d492e4640 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585039aa750 0x5585039acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d492e4640 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585039aa750 0x5585039acb40 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d492e4640 1 -- 172.21.15.167:0/2023407645 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0d4000f700 con 0x5585039aa750 2024-09-18T02:04:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d4bfd5980 1 Processor -- start 2024-09-18T02:04:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d4bfd5980 1 -- start start 2024-09-18T02:04:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d4bfd5980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039bad00 0x5585039bb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d4bfd5980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585037af800 con 0x5585039bad00 2024-09-18T02:04:23.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d49ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039bad00 0x5585039bb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d49ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039bad00 0x5585039bb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57772/0 (socket says 172.21.15.167:57772) 2024-09-18T02:04:23.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2669066964 learned_addr learned my addr 172.21.15.167:0/2669066964 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2669066964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585039bb660 con 0x5585039bad00 2024-09-18T02:04:23.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d49ae5640 1 --2- 172.21.15.167:0/2669066964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039bad00 0x5585039bb120 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c000c10 tx=0x7f0d3c0e3a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0c2f7fe640 1 -- 172.21.15.167:0/2669066964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c0e34e0 con 0x5585039bad00 2024-09-18T02:04:23.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2669066964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585039bb8f0 con 0x5585039bad00 2024-09-18T02:04:23.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0c2f7fe640 1 -- 172.21.15.167:0/2669066964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0e3680 con 0x5585039bad00 2024-09-18T02:04:23.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0c2f7fe640 1 -- 172.21.15.167:0/2669066964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c0c65d0 con 0x5585039bad00 2024-09-18T02:04:23.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2669066964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585039be570 con 0x5585039bad00 2024-09-18T02:04:23.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.500+0000 7f0c2f7fe640 1 -- 172.21.15.167:0/2669066964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d3c0c6770 con 0x5585039bad00 2024-09-18T02:04:23.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0c2f7fe640 1 --2- 172.21.15.167:0/2669066964 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c24034650 0x7f0c24036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0c2f7fe640 1 -- 172.21.15.167:0/2669066964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0d3c0eeaa0 con 0x5585039bad00 2024-09-18T02:04:23.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d492e4640 1 --2- 172.21.15.167:0/2669066964 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c24034650 0x7f0c24036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 Processor -- start 2024-09-18T02:04:23.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 -- start start 2024-09-18T02:04:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d492e4640 1 --2- 172.21.15.167:0/2669066964 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c24034650 0x7f0c24036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5585039a15c0 tx=0x7f0d4000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 0x5585039c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585038a71a0 con 0x5585039c7600 2024-09-18T02:04:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d49ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 0x5585039c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d49ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 0x5585039c79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57774/0 (socket says 172.21.15.167:57774) 2024-09-18T02:04:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d49ae5640 1 -- 172.21.15.167:0/56958120 learned_addr learned my addr 172.21.15.167:0/56958120 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d49ae5640 1 -- 172.21.15.167:0/56958120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585039c7fb0 con 0x5585039c7600 2024-09-18T02:04:23.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d49ae5640 1 --2- 172.21.15.167:0/56958120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 0x5585039c79e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0c2010 tx=0x7f0d3c0db8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4de12cb0bd2aa1b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0c2d7fa640 1 -- 172.21.15.167:0/56958120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c0e5d50 con 0x5585039c7600 2024-09-18T02:04:23.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0c2d7fa640 1 -- 172.21.15.167:0/56958120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0bc3a0 con 0x5585039c7600 2024-09-18T02:04:23.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0c2d7fa640 1 -- 172.21.15.167:0/56958120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c0bfcb0 con 0x5585039c7600 2024-09-18T02:04:23.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/56958120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 msgr2=0x5585039c79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/56958120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 0x5585039c79e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0c2010 tx=0x7f0d3c0db8c0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/56958120 shutdown_connections 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/56958120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 0x5585039c79e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/56958120 >> 172.21.15.167:0/56958120 conn(0x5585039c39e0 msgr2=0x5585039c1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/56958120 shutdown_connections 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/56958120 wait complete. 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 Processor -- start 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 -- start start 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 0x5585039ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.504+0000 7f0d4bfd5980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585039c8450 con 0x5585039c7600 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d49ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 0x5585039ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d49ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 0x5585039ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57788/0 (socket says 172.21.15.167:57788) 2024-09-18T02:04:23.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 learned_addr learned my addr 172.21.15.167:0/2224253739 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585039ced40 con 0x5585039c7600 2024-09-18T02:04:23.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d49ae5640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 0x5585039ce800 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0dbbb0 tx=0x7f0d3c0b0fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0c1b7fe640 1 -- 172.21.15.167:0/2224253739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c10f020 con 0x5585039c7600 2024-09-18T02:04:23.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585039ced40 con 0x5585039c7600 2024-09-18T02:04:23.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0c1b7fe640 1 -- 172.21.15.167:0/2224253739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0b3db0 con 0x5585039c7600 2024-09-18T02:04:23.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0c1b7fe640 1 -- 172.21.15.167:0/2224253739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3c0bc720 con 0x5585039c7600 2024-09-18T02:04:23.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585039cf1b0 con 0x5585039c7600 2024-09-18T02:04:23.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0c1b7fe640 1 -- 172.21.15.167:0/2224253739 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d3c112020 con 0x5585039c7600 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0c1b7fe640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c14034650 0x7f0c14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0c1b7fe640 1 -- 172.21.15.167:0/2224253739 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0d3c106050 con 0x5585039c7600 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d492e4640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c14034650 0x7f0c14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585039d9970 0x5585039dbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039dc580 con 0x5585039d9970 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d4a2e6640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585039d9970 0x5585039dbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.508+0000 7f0d492e4640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c14034650 0x7f0c14036b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5585039ad630 tx=0x7f0d40010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4a2e6640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585039d9970 0x5585039dbe30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 20 realm 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039dc990 con 0x5585039d9970 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd230 con 0x5585039d9970 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039d9970 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:23.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585039de330 0x5585039e0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039e0d70 con 0x5585039de330 2024-09-18T02:04:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d49ae5640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585039de330 0x5585039e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d49ae5640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585039de330 0x5585039e0720 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 20 searching for the correct realm 2024-09-18T02:04:23.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585039e2c50 0x5585039e50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039e5740 con 0x5585039e2c50 2024-09-18T02:04:23.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d492e4640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585039e2c50 0x5585039e50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d492e4640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585039e2c50 0x5585039e50c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d492e4640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0d4001fc60 0x7f0d4003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.512+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039e5740 con 0x7f0d4001fc60 2024-09-18T02:04:23.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d4a2e6640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0d4001fc60 0x7f0d4003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d4a2e6640 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0d4001fc60 0x7f0d4003a3c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039de330 2024-09-18T02:04:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039d9970 2024-09-18T02:04:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039d9970 2024-09-18T02:04:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039de330 2024-09-18T02:04:23.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039de330 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.516+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039e2c50 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039d9970 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039de330 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039d9970 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039e2c50 2024-09-18T02:04:23.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039e2c50 2024-09-18T02:04:23.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039de330 2024-09-18T02:04:23.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039e2c50 2024-09-18T02:04:23.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039e2c50 2024-09-18T02:04:23.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039d9970 2024-09-18T02:04:23.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039d9970 2024-09-18T02:04:23.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.520+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039de330 2024-09-18T02:04:23.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039e2c50 2024-09-18T02:04:23.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039d9970 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039de330 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039e2c50 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039de330 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039e2c50 2024-09-18T02:04:23.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.524+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039de330 2024-09-18T02:04:23.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x5585039d9970 2024-09-18T02:04:23.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5585039dd5d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:23.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:23.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:23.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:23.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:23.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039e15c0 con 0x5585039d9970 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039e15c0 con 0x5585039d9970 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039e15c0 con 0x5585039e2c50 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 zone default found 2024-09-18T02:04:23.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 4 Realm: () 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 zonegroup default 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039e2030 con 0x5585039de330 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039e7a50 con 0x5585039e2c50 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039e7df0 con 0x5585039e2c50 2024-09-18T02:04:23.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 started sync module instance, tier type = 2024-09-18T02:04:23.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:23.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.528+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e6e90 con 0x7f0d4001fc60 2024-09-18T02:04:23.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.532+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.532+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94029779727248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e6e90 con 0x7f0d4001fc60 2024-09-18T02:04:23.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.532+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e86c0 con 0x5585039d9970 2024-09-18T02:04:23.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.532+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94029779727248] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.532+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.532+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94029779730832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e6e90 con 0x5585039d9970 2024-09-18T02:04:23.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.532+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e90d0 con 0x5585039e2c50 2024-09-18T02:04:23.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.536+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.536+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94029779733536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e9970 con 0x5585039e2c50 2024-09-18T02:04:23.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.536+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039ea370 con 0x7f0d4001fc60 2024-09-18T02:04:23.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.536+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94029779730832] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.536+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94029779733536] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.536+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.536+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94029779735744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e9e80 con 0x7f0d4001fc60 2024-09-18T02:04:23.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.536+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039eac10 con 0x5585039d9970 2024-09-18T02:04:23.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.540+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94029779735744] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.540+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.540+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94029779724768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039eab60 con 0x5585039d9970 2024-09-18T02:04:23.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.540+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039eb3f0 con 0x5585039de330 2024-09-18T02:04:23.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.540+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94029779724768] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.540+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.540+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94029779740608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039eb7e0 con 0x5585039de330 2024-09-18T02:04:23.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.540+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039ec0b0 con 0x5585039de330 2024-09-18T02:04:23.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94029779745664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039ec8e0 con 0x5585039de330 2024-09-18T02:04:23.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039ed400 con 0x5585039de330 2024-09-18T02:04:23.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94029779740608] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94029779745664] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94029779750608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039ec330 con 0x5585039de330 2024-09-18T02:04:23.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d4bfd5980 20 add_watcher() i=0 2024-09-18T02:04:23.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d4bfd5980 20 add_watcher() i=1 2024-09-18T02:04:23.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d4bfd5980 20 add_watcher() i=2 2024-09-18T02:04:23.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d4bfd5980 20 add_watcher() i=3 2024-09-18T02:04:23.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d4bfd5980 20 add_watcher() i=4 2024-09-18T02:04:23.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d4bfd5980 20 add_watcher() i=5 2024-09-18T02:04:23.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.544+0000 7f0d4bfd5980 20 add_watcher() i=6 2024-09-18T02:04:23.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94029779750608] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0d4bfd5980 20 add_watcher() i=7 2024-09-18T02:04:23.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0d4bfd5980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:23.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5585039f03f0 con 0x5585039d9970 2024-09-18T02:04:23.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94029779741728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039ed870 con 0x5585039d9970 2024-09-18T02:04:23.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94029779741728] v30'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0bfffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:23.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0d4bfd5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:23.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0d4bfd5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:23.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0d4bfd5980 5 note: GC not initialized 2024-09-18T02:04:23.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.548+0000 7f0bfefe5640 20 reqs_thread_entry: start 2024-09-18T02:04:23.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:23.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 20 Filter name: none 2024-09-18T02:04:23.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0bfcfe1640 20 reqs_thread_entry: start 2024-09-18T02:04:23.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-18T02:04:23.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558503a13bf0 con 0x5585039de330 2024-09-18T02:04:23.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-18T02:04:23.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T02:04:23.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T02:04:23.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558503a122e0 con 0x5585039de330 2024-09-18T02:04:23.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T02:04:23.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:04:23.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T02:04:23.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T02:04:23.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.552+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558503a16970 con 0x5585039de330 2024-09-18T02:04:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v30'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4bfd5980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-18T02:04:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4bfd5980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T02:04:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4bfd5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-18T02:04:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94029779919776 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558503a17440 con 0x7f0d4001fc60 2024-09-18T02:04:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== watch-notify(notify (1) cookie 94029779735744 notify 128849018892 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f0d44018a00 con 0x7f0d4001fc60 2024-09-18T02:04:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0c2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94029779735744 notifier 4543 bl.length()=610 2024-09-18T02:04:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0c2d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-18T02:04:23.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0c2d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T02:04:23.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0c2d7fa640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f0c0c003eb0 con 0x7f0d4001fc60 2024-09-18T02:04:23.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(65 notify.3 [notify cookie 94029779919776 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== watch-notify(notify_complete (2) cookie 94029779919776 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0d44018ca0 con 0x7f0d4001fc60 2024-09-18T02:04:23.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558503a16950 con 0x5585039de330 2024-09-18T02:04:23.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4bfd5980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T02:04:23.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4bfd5980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:04:23.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4bfd5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T02:04:23.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94029779915040 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558503a16950 con 0x5585039e2c50 2024-09-18T02:04:23.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== watch-notify(notify (1) cookie 94029779733536 notify 128849018890 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7f0d40018040 con 0x5585039e2c50 2024-09-18T02:04:23.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0c2cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94029779733536 notifier 4543 bl.length()=192 2024-09-18T02:04:23.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0c2cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T02:04:23.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0c2cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:04:23.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0c2cff9640 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f0b7c003450 con 0x5585039e2c50 2024-09-18T02:04:23.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.556+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(68 notify.2 [notify cookie 94029779915040 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.560+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.560+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== watch-notify(notify_complete (2) cookie 94029779915040 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558503730ae0 con 0x5585039e2c50 2024-09-18T02:04:23.563 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T02:04:23.554631Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:23.554610Z","tags":[],"group_ids":[]} 2024-09-18T02:04:23.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.560+0000 7f0bfffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:23.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.560+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94029779741728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558503a117f0 con 0x5585039d9970 2024-09-18T02:04:23.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.560+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94029779741728] v30'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.560+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94029779727248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558503a117f0 con 0x7f0d4001fc60 2024-09-18T02:04:23.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.560+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94029779727248] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.560+0000 7f0d4bfd5980 20 remove_watcher() i=0 2024-09-18T02:04:23.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.560+0000 7f0d4bfd5980 2 removed watcher, disabling cache 2024-09-18T02:04:23.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.560+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94029779730832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e7390 con 0x5585039d9970 2024-09-18T02:04:23.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.564+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94029779730832] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.564+0000 7f0d4bfd5980 20 remove_watcher() i=1 2024-09-18T02:04:23.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.564+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94029779733536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558503a117f0 con 0x5585039e2c50 2024-09-18T02:04:23.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.568+0000 7f0d492e4640 1 -- 172.21.15.167:0/2224253739 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94029779733536] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d40037040 con 0x5585039e2c50 2024-09-18T02:04:23.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.568+0000 7f0d4bfd5980 20 remove_watcher() i=2 2024-09-18T02:04:23.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.568+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94029779735744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e8190 con 0x7f0d4001fc60 2024-09-18T02:04:23.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.568+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94029779735744] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x7f0d4001fc60 2024-09-18T02:04:23.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.568+0000 7f0d4bfd5980 20 remove_watcher() i=3 2024-09-18T02:04:23.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.568+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94029779724768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e7390 con 0x5585039d9970 2024-09-18T02:04:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.568+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94029779724768] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d4400a4d0 con 0x5585039d9970 2024-09-18T02:04:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.568+0000 7f0d4bfd5980 20 remove_watcher() i=4 2024-09-18T02:04:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.568+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94029779740608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558503a117f0 con 0x5585039de330 2024-09-18T02:04:23.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.572+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94029779740608] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.572+0000 7f0d4bfd5980 20 remove_watcher() i=5 2024-09-18T02:04:23.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.572+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94029779745664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e8190 con 0x5585039de330 2024-09-18T02:04:23.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.572+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94029779745664] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.572+0000 7f0d4bfd5980 20 remove_watcher() i=6 2024-09-18T02:04:23.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.572+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94029779750608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5585039e7390 con 0x5585039de330 2024-09-18T02:04:23.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d49ae5640 1 -- 172.21.15.167:0/2224253739 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94029779750608] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3c0f4070 con 0x5585039de330 2024-09-18T02:04:23.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 20 remove_watcher() i=7 2024-09-18T02:04:23.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585039de330 msgr2=0x5585039e0720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585039de330 0x5585039e0720 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585039d9970 msgr2=0x5585039dbe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585039d9970 0x5585039dbe30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0d4001fc60 msgr2=0x7f0d4003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0d4001fc60 0x7f0d4003a3c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585039e2c50 msgr2=0x5585039e50c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585039e2c50 0x5585039e50c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c14034650 msgr2=0x7f0c14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c14034650 0x7f0c14036b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5585039ad630 tx=0x7f0d40010000 comp rx=0 tx=0).stop 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 msgr2=0x5585039ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2224253739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039c7600 0x5585039ce800 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0dbbb0 tx=0x7f0d3c0b0fd0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2224253739 reap_dead start 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 shutdown_connections 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 >> 172.21.15.167:0/2224253739 conn(0x5585039c39e0 msgr2=0x5585039c1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 shutdown_connections 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2224253739 wait complete. 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2669066964 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c24034650 msgr2=0x7f0c24036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2669066964 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c24034650 0x7f0c24036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5585039a15c0 tx=0x7f0d4000f000 comp rx=0 tx=0).stop 2024-09-18T02:04:23.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2669066964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039bad00 msgr2=0x5585039bb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2669066964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039bad00 0x5585039bb120 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c000c10 tx=0x7f0d3c0e3a10 comp rx=0 tx=0).stop 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2669066964 shutdown_connections 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2669066964 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c24034650 0x7f0c24036b10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2669066964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585039bad00 0x5585039bb120 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2669066964 >> 172.21.15.167:0/2669066964 conn(0x5585039afe50 msgr2=0x5585039b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2669066964 shutdown_connections 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2669066964 wait complete. 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585039a66a0 msgr2=0x5585039a8b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585039a66a0 0x5585039a8b60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585038ab850 msgr2=0x5585039a3e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585038ab850 0x5585039a3e60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585039aa750 msgr2=0x5585039acb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585039aa750 0x5585039acb40 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c30034650 msgr2=0x7f0c30036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0c30034650 0x7f0c30036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d40001e50 tx=0x7f0d400013b0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 msgr2=0x55850399ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 --2- 172.21.15.167:0/2023407645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55850381ca60 0x55850399ceb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0199f0 tx=0x7f0d3c0180e0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4a2e6640 1 -- 172.21.15.167:0/2023407645 reap_dead start 2024-09-18T02:04:23.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 shutdown_connections 2024-09-18T02:04:23.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 >> 172.21.15.167:0/2023407645 conn(0x5585038a3000 msgr2=0x5585038a76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 shutdown_connections 2024-09-18T02:04:23.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.576+0000 7f0d4bfd5980 1 -- 172.21.15.167:0/2023407645 wait complete. 2024-09-18T02:04:23.591 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T02:04:23.554631Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:23.554610Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:23.591 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T02:04:23.591 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T02:04:23.591 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-18T02:04:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.624+0000 7f1bc1fa0980 1 Processor -- start 2024-09-18T02:04:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.624+0000 7f1bc1fa0980 1 -- start start 2024-09-18T02:04:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.624+0000 7f1bc1fa0980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558d23811e60 0x558d23814250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.624+0000 7f1bc1fa0980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558d23693ae0 con 0x558d23780230 2024-09-18T02:04:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.624+0000 7f1bc1fa0980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x558d236b7e30 con 0x558d23811e60 2024-09-18T02:04:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.624+0000 7f1bbf2af640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558d23811e60 0x558d23814250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.624+0000 7f1bbf2af640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558d23811e60 0x558d23814250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57800/0 (socket says 172.21.15.167:57800) 2024-09-18T02:04:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.624+0000 7f1bbfab0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x558d23780230 0x558d23810740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55702/0 (socket says 172.21.15.167:55702) 2024-09-18T02:04:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.624+0000 7f1bbf2af640 1 -- 172.21.15.167:0/558639747 learned_addr learned my addr 172.21.15.167:0/558639747 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bbf2af640 1 -- 172.21.15.167:0/558639747 >> v1:172.21.15.81:6789/0 conn(0x558d23780230 legacy=0x558d23810740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bbf2af640 1 -- 172.21.15.167:0/558639747 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d23780610 con 0x558d23811e60 2024-09-18T02:04:23.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/558639747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23811e60 0x558d23814250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800a5c0 tx=0x7f1ba801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d9ac91803ca959 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bbeaae640 1 -- 172.21.15.167:0/558639747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ba80a6070 con 0x558d23811e60 2024-09-18T02:04:23.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bbeaae640 1 -- 172.21.15.167:0/558639747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba80af070 con 0x558d23811e60 2024-09-18T02:04:23.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bbeaae640 1 -- 172.21.15.167:0/558639747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ba80aa5c0 con 0x558d23811e60 2024-09-18T02:04:23.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/558639747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23811e60 msgr2=0x558d23814250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/558639747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23811e60 0x558d23814250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800a5c0 tx=0x7f1ba801b340 comp rx=0 tx=0).stop 2024-09-18T02:04:23.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/558639747 shutdown_connections 2024-09-18T02:04:23.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/558639747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23811e60 0x558d23814250 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/558639747 >> 172.21.15.167:0/558639747 conn(0x558d23806030 msgr2=0x558d23808450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/558639747 shutdown_connections 2024-09-18T02:04:23.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.628+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/558639747 wait complete. 2024-09-18T02:04:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1bc1fa0980 1 Processor -- start 2024-09-18T02:04:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1bc1fa0980 1 -- start start 2024-09-18T02:04:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1bc1fa0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 0x558d238f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1bc1fa0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558d236b9200 con 0x558d23780230 2024-09-18T02:04:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1bbfab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 0x558d238f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1bbfab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 0x558d238f8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57806/0 (socket says 172.21.15.167:57806) 2024-09-18T02:04:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1bbfab0640 1 -- 172.21.15.167:0/2535977825 learned_addr learned my addr 172.21.15.167:0/2535977825 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1bbfab0640 1 -- 172.21.15.167:0/2535977825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d238f91d0 con 0x558d23780230 2024-09-18T02:04:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1bbfab0640 1 --2- 172.21.15.167:0/2535977825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 0x558d238f8c00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80015f0 tx=0x7f1bb8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da3f166f5edea04 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1aade0b640 1 -- 172.21.15.167:0/2535977825 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8013420 con 0x558d23780230 2024-09-18T02:04:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1aade0b640 1 -- 172.21.15.167:0/2535977825 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb80135e0 con 0x558d23780230 2024-09-18T02:04:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.644+0000 7f1aade0b640 1 -- 172.21.15.167:0/2535977825 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8013940 con 0x558d23780230 2024-09-18T02:04:23.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/2535977825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 msgr2=0x558d238f8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/2535977825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 0x558d238f8c00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80015f0 tx=0x7f1bb8001ab0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/2535977825 shutdown_connections 2024-09-18T02:04:23.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/2535977825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 0x558d238f8c00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/2535977825 >> 172.21.15.167:0/2535977825 conn(0x558d23806030 msgr2=0x558d238f4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/2535977825 shutdown_connections 2024-09-18T02:04:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/2535977825 wait complete. 2024-09-18T02:04:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 Processor -- start 2024-09-18T02:04:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 -- start start 2024-09-18T02:04:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 0x558d238fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558d238171c0 con 0x558d23780230 2024-09-18T02:04:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bbfab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 0x558d238fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bbfab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 0x558d238fffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57812/0 (socket says 172.21.15.167:57812) 2024-09-18T02:04:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1647480968 learned_addr learned my addr 172.21.15.167:0/1647480968 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1647480968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d239004f0 con 0x558d23780230 2024-09-18T02:04:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bbfab0640 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 0x558d238fffb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8006640 tx=0x7f1bb8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1aa7fff640 1 -- 172.21.15.167:0/1647480968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8022020 con 0x558d23780230 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d23900780 con 0x558d23780230 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1aa7fff640 1 -- 172.21.15.167:0/1647480968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb8006320 con 0x558d23780230 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1aa7fff640 1 -- 172.21.15.167:0/1647480968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8004af0 con 0x558d23780230 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d23903460 con 0x558d23780230 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1aa7fff640 1 -- 172.21.15.167:0/1647480968 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1bb8025020 con 0x558d23780230 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1aa7fff640 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1aa8034650 0x7f1aa8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1aa7fff640 1 -- 172.21.15.167:0/1647480968 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1bb8018030 con 0x558d23780230 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1aa8034650 0x7f1aa8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558d23811e60 0x558d23906f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.648+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d239075c0 con 0x558d23811e60 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bc02b1640 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558d23811e60 0x558d23906f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1aa8034650 0x7f1aa8036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80ae000 tx=0x7f1ba80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bc02b1640 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558d23811e60 0x558d23906f80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1647480968 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bb00083f0 con 0x558d23811e60 2024-09-18T02:04:23.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23904680 con 0x558d23811e60 2024-09-18T02:04:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1647480968 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bb00083f0 con 0x558d23811e60 2024-09-18T02:04:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558d23909910 0x558d2390bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d2390c3d0 con 0x558d23909910 2024-09-18T02:04:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bbfab0640 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558d23909910 0x558d2390bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bbfab0640 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558d23909910 0x558d2390bd00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1647480968 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1bb801b070 con 0x558d23909910 2024-09-18T02:04:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d239087b0 con 0x558d23811e60 2024-09-18T02:04:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1647480968 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bb00083f0 con 0x558d23811e60 2024-09-18T02:04:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558d2390d810 0x558d2390fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23910390 con 0x558d2390d810 2024-09-18T02:04:23.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558d2390d810 0x558d2390fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.652+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558d2390d810 0x558d2390fc00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1647480968 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d2390d810 2024-09-18T02:04:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bc1fa0980 1 Processor -- start 2024-09-18T02:04:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bc1fa0980 1 -- start start 2024-09-18T02:04:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bc1fa0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2391de20 0x558d2391e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bc1fa0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558d23712800 con 0x558d2391de20 2024-09-18T02:04:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bbfab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2391de20 0x558d2391e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bbfab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2391de20 0x558d2391e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57816/0 (socket says 172.21.15.167:57816) 2024-09-18T02:04:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bbfab0640 1 -- 172.21.15.167:0/3613815532 learned_addr learned my addr 172.21.15.167:0/3613815532 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bbfab0640 1 -- 172.21.15.167:0/3613815532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d2391e780 con 0x558d2391de20 2024-09-18T02:04:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bbfab0640 1 --2- 172.21.15.167:0/3613815532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2391de20 0x558d2391e240 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8014fd0 tx=0x7f1bb8005070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1aa57fa640 1 -- 172.21.15.167:0/3613815532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb801db60 con 0x558d2391de20 2024-09-18T02:04:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1aa57fa640 1 -- 172.21.15.167:0/3613815532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb801dd00 con 0x558d2391de20 2024-09-18T02:04:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/3613815532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d2391ea10 con 0x558d2391de20 2024-09-18T02:04:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1aa57fa640 1 -- 172.21.15.167:0/3613815532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb801e3f0 con 0x558d2391de20 2024-09-18T02:04:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/3613815532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d23921690 con 0x558d2391de20 2024-09-18T02:04:23.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1aa57fa640 1 -- 172.21.15.167:0/3613815532 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1bb8046040 con 0x558d2391de20 2024-09-18T02:04:23.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1aa57fa640 1 --2- 172.21.15.167:0/3613815532 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a98034600 0x7f1a98036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1aa57fa640 1 -- 172.21.15.167:0/3613815532 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1bb803daa0 con 0x558d2391de20 2024-09-18T02:04:23.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.656+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/3613815532 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a98034600 0x7f1a98036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 Processor -- start 2024-09-18T02:04:23.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 -- start start 2024-09-18T02:04:23.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/3613815532 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a98034600 0x7f1a98036ac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ba801b380 tx=0x7f1ba8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 0x558d2392aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558d238f9550 con 0x558d2392a6d0 2024-09-18T02:04:23.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bbfab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 0x558d2392aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bbfab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 0x558d2392aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57828/0 (socket says 172.21.15.167:57828) 2024-09-18T02:04:23.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1375224923 learned_addr learned my addr 172.21.15.167:0/1375224923 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1375224923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d2392b0a0 con 0x558d2392a6d0 2024-09-18T02:04:23.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bbfab0640 1 --2- 172.21.15.167:0/1375224923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 0x558d2392aad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1bb801d660 tx=0x7f1bb80274c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7ba7f3aeb22e6a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1a9effd640 1 -- 172.21.15.167:0/1375224923 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb804a080 con 0x558d2392a6d0 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1a9effd640 1 -- 172.21.15.167:0/1375224923 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb8031410 con 0x558d2392a6d0 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1a9effd640 1 -- 172.21.15.167:0/1375224923 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb804a220 con 0x558d2392a6d0 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1375224923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 msgr2=0x558d2392aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1375224923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 0x558d2392aad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1bb801d660 tx=0x7f1bb80274c0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1375224923 shutdown_connections 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1375224923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 0x558d2392aad0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1375224923 >> 172.21.15.167:0/1375224923 conn(0x558d23926b40 msgr2=0x558d23924c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1375224923 shutdown_connections 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1375224923 wait complete. 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 Processor -- start 2024-09-18T02:04:23.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 -- start start 2024-09-18T02:04:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 0x558d239318b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bc1fa0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558d2392b5b0 con 0x558d2392a6d0 2024-09-18T02:04:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bbfab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 0x558d239318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bbfab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 0x558d239318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57842/0 (socket says 172.21.15.167:57842) 2024-09-18T02:04:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.660+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 learned_addr learned my addr 172.21.15.167:0/1026500490 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d23931df0 con 0x558d2392a6d0 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bbfab0640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 0x558d239318b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80472c0 tx=0x7f1bb802cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1a9d7fa640 1 -- 172.21.15.167:0/1026500490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb806d070 con 0x558d2392a6d0 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d23931df0 con 0x558d2392a6d0 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1a9d7fa640 1 -- 172.21.15.167:0/1026500490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb801e7a0 con 0x558d2392a6d0 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1a9d7fa640 1 -- 172.21.15.167:0/1026500490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8005700 con 0x558d2392a6d0 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d23931df0 con 0x558d2392a6d0 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1a9d7fa640 1 -- 172.21.15.167:0/1026500490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1bb8070070 con 0x558d2392a6d0 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1a9d7fa640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a88034650 0x7f1a88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1a9d7fa640 1 -- 172.21.15.167:0/1026500490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1bb8059030 con 0x558d2392a6d0 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a88034650 0x7f1a88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558d2393c880 0x558d2393ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d2393f490 con 0x558d2393c880 2024-09-18T02:04:23.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc02b1640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558d2393c880 0x558d2393ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a88034650 0x7f1a88036b10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x558d23910790 tx=0x7f1ba80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc02b1640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558d2393c880 0x558d2393ed40 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bb00083f0 con 0x558d2393c880 2024-09-18T02:04:23.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 20 realm 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d2393f8a0 con 0x558d2393c880 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bb00083f0 con 0x558d2393c880 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23940170 con 0x558d2393c880 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bb00083f0 con 0x558d2393c880 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.664+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d2393c880 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bb00083f0 con 0x558d2393c880 2024-09-18T02:04:23.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc1fa0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558d23941270 0x558d23943660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23943c70 con 0x558d23941270 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bbfab0640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558d23941270 0x558d23943660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bbfab0640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558d23941270 0x558d23943660 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc1fa0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc1fa0980 20 searching for the correct realm 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558d23945bc0 0x558d23947fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d239486a0 con 0x558d23945bc0 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558d23945bc0 0x558d23947fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558d23945bc0 0x558d23947fd0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bbf2af640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f1ba80e0040 0x7f1ba80e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d239486a0 con 0x7f1ba80e0040 2024-09-18T02:04:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc02b1640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f1ba80e0040 0x7f1ba80e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc02b1640 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f1ba80e0040 0x7f1ba80e0420 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb00083f0 con 0x7f1ba80e0040 2024-09-18T02:04:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23941270 2024-09-18T02:04:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.668+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d2393c880 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb00083f0 con 0x558d2393c880 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d2393c880 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23941270 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23941270 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x7f1ba80e0040 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23945bc0 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d2393c880 2024-09-18T02:04:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23941270 2024-09-18T02:04:23.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d2393c880 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x7f1ba80e0040 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23945bc0 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.672+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23945bc0 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23941270 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23945bc0 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23945bc0 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d2393c880 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d2393c880 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23941270 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23945bc0 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x7f1ba80e0040 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d2393c880 2024-09-18T02:04:23.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23941270 2024-09-18T02:04:23.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.676+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23945bc0 2024-09-18T02:04:23.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23941270 2024-09-18T02:04:23.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x7f1ba80e0040 2024-09-18T02:04:23.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23945bc0 2024-09-18T02:04:23.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d23941270 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x558d2393c880 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d23940510 con 0x7f1ba80e0040 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:23.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23944530 con 0x558d2393c880 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23944530 con 0x558d2393c880 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23944530 con 0x558d23945bc0 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 zone default found 2024-09-18T02:04:23.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 4 Realm: () 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 zonegroup default 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.680+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23944f20 con 0x558d23941270 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23944af0 con 0x558d23945bc0 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d2394aa60 con 0x558d23945bc0 2024-09-18T02:04:23.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 20 started sync module instance, tier type = 2024-09-18T02:04:23.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:23.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d23949e40 con 0x7f1ba80e0040 2024-09-18T02:04:23.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94064675693376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d23949e40 con 0x7f1ba80e0040 2024-09-18T02:04:23.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394b4e0 con 0x558d2393c880 2024-09-18T02:04:23.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.684+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94064675693376] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.688+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.688+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94064675696960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d23949e40 con 0x558d2393c880 2024-09-18T02:04:23.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.688+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394bef0 con 0x558d23945bc0 2024-09-18T02:04:23.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.688+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.688+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94064675696960] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.688+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94064675699264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394c740 con 0x558d23945bc0 2024-09-18T02:04:23.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.688+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d23949990 con 0x7f1ba80e0040 2024-09-18T02:04:23.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.692+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.692+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94064675703888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394d520 con 0x7f1ba80e0040 2024-09-18T02:04:23.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.692+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394dee0 con 0x558d2393c880 2024-09-18T02:04:23.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.692+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94064675699264] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.692+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94064675703888] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.692+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.692+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94064675704944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394c3a0 con 0x558d2393c880 2024-09-18T02:04:23.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.692+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394e390 con 0x558d23941270 2024-09-18T02:04:23.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.692+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94064675704944] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.696+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.696+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94064675707440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394c3a0 con 0x558d23941270 2024-09-18T02:04:23.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.696+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394eeb0 con 0x558d23941270 2024-09-18T02:04:23.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.696+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94064675707440] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.696+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.696+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94064675708496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394f700 con 0x558d23941270 2024-09-18T02:04:23.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.696+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d239500c0 con 0x558d23941270 2024-09-18T02:04:23.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94064675716112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d239504e0 con 0x558d23941270 2024-09-18T02:04:23.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 20 add_watcher() i=0 2024-09-18T02:04:23.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 20 add_watcher() i=1 2024-09-18T02:04:23.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 20 add_watcher() i=2 2024-09-18T02:04:23.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 20 add_watcher() i=3 2024-09-18T02:04:23.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 20 add_watcher() i=4 2024-09-18T02:04:23.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 20 add_watcher() i=5 2024-09-18T02:04:23.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94064675708496] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 20 add_watcher() i=6 2024-09-18T02:04:23.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94064675716112] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 20 add_watcher() i=7 2024-09-18T02:04:23.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:23.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d239504e0 con 0x558d2393c880 2024-09-18T02:04:23.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94064675717168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d23950450 con 0x558d2393c880 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94064675717168] v30'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1a75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.700+0000 7f1bc1fa0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 5 note: GC not initialized 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1a74fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 20 Filter name: none 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f19ee7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23976d60 con 0x558d23941270 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 20 rados_obj.operate() r=0 bl.length=419 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23978990 con 0x7f1ba80e0040 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T02:04:23.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:23.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 : miss 2024-09-18T02:04:23.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d2397a430 con 0x558d23945bc0 2024-09-18T02:04:23.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:23.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:23.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:23.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:23.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:23.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:23.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-18T02:04:23.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.704+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2397ea60 con 0x7f1ba80e0040 2024-09-18T02:04:23.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(65 foo.buckets [call] v30'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 8.16 8:6d7fea2b:root::.bucket.meta.testx%3amyfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d23982370 con 0x558d23945bc0 2024-09-18T02:04:23.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [create,call,writefull 0~412,setxattr (203)] v30'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1bc1fa0980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x7 2024-09-18T02:04:23.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1bc1fa0980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:23.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1bc1fa0980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-18T02:04:23.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1bc1fa0980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1, ofs0, ns] 2024-09-18T02:04:23.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94064675914144 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23981e80 con 0x558d23941270 2024-09-18T02:04:23.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== watch-notify(notify (1) cookie 94064675708496 notify 128849018891 ret 0) ==== 889+0+0 (crc 0 0 0) 0x558d2391ea10 con 0x558d23941270 2024-09-18T02:04:23.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1a9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94064675708496 notifier 4550 bl.length()=847 2024-09-18T02:04:23.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1a9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x7 2024-09-18T02:04:23.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1a9effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:23.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1a9effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-18T02:04:23.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1a9effd640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1a84003eb0 con 0x558d23941270 2024-09-18T02:04:23.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(67 notify.6 [notify cookie 94064675914144 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.708+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== watch-notify(notify_complete (2) cookie 94064675914144 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558d2391e780 con 0x558d23941270 2024-09-18T02:04:23.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc1fa0980 20 handle_bi_update(): bucket=testx:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_sources= new_sources= 2024-09-18T02:04:23.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc1fa0980 20 handle_bi_update(): bucket=testx:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential sources added=[] removed=[] 2024-09-18T02:04:23.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc1fa0980 20 handle_bi_update(): bucket=testx:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_dests= new_dests= 2024-09-18T02:04:23.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc1fa0980 20 handle_bi_update(): bucket=testx:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential dests added=[] removed=[] 2024-09-18T02:04:23.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d23981f80 con 0x558d2393c880 2024-09-18T02:04:23.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d23981f80 con 0x558d2393c880 2024-09-18T02:04:23.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc1fa0980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-18T02:04:23.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc1fa0980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-18T02:04:23.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc1fa0980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-18T02:04:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94064675920592 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23981ef0 con 0x558d2393c880 2024-09-18T02:04:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94064675704944 notify 128849018891 ret 0) ==== 390+0+0 (crc 0 0 0) 0x558d23982320 con 0x558d2393c880 2024-09-18T02:04:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1a9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94064675704944 notifier 4550 bl.length()=348 2024-09-18T02:04:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1a9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-18T02:04:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1a9e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-18T02:04:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(71 notify.4 [notify cookie 94064675920592 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1a9e7fc640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f19f4003410 con 0x558d2393c880 2024-09-18T02:04:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94064675920592 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558d239811b0 con 0x558d2393c880 2024-09-18T02:04:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.712+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d23981f80 con 0x7f1ba80e0040 2024-09-18T02:04:23.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(73 myfoo [call,delete] v30'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bc1fa0980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-18T02:04:23.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bc1fa0980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T02:04:23.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94064675920592 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23981ef0 con 0x558d23941270 2024-09-18T02:04:23.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== watch-notify(notify (1) cookie 94064675708496 notify 128849018892 ret 0) ==== 191+0+0 (crc 0 0 0) 0x558d2391e780 con 0x558d23941270 2024-09-18T02:04:23.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1a9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94064675708496 notifier 4550 bl.length()=149 2024-09-18T02:04:23.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1a9e7fc640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f19f4003410 con 0x558d23941270 2024-09-18T02:04:23.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(74 notify.6 [notify cookie 94064675920592 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== watch-notify(notify_complete (2) cookie 94064675920592 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558d23903460 con 0x558d23941270 2024-09-18T02:04:23.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:76 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d23981f80 con 0x558d23945bc0 2024-09-18T02:04:23.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(76 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call,delete] v30'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bc1fa0980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 from cache 2024-09-18T02:04:23.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bc1fa0980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1, ofs0, ns] 2024-09-18T02:04:23.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.716+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94064675888384 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d23981f80 con 0x558d23941270 2024-09-18T02:04:23.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.720+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== watch-notify(notify (1) cookie 94064675716112 notify 128849018893 ret 0) ==== 248+0+0 (crc 0 0 0) 0x558d23903460 con 0x558d23941270 2024-09-18T02:04:23.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.720+0000 7f1a9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94064675716112 notifier 4550 bl.length()=206 2024-09-18T02:04:23.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.720+0000 7f1a9effd640 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1a84003eb0 con 0x558d23941270 2024-09-18T02:04:23.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.720+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(77 notify.7 [notify cookie 94064675888384 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.720+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.720+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== watch-notify(notify_complete (2) cookie 94064675888384 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558d23900780 con 0x558d23941270 2024-09-18T02:04:23.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.720+0000 7f1a75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:23.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.720+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94064675717168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d239749f0 con 0x558d2393c880 2024-09-18T02:04:23.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.720+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94064675717168] v30'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.720+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94064675693376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d239749f0 con 0x7f1ba80e0040 2024-09-18T02:04:23.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.724+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94064675693376] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.724+0000 7f1bc1fa0980 20 remove_watcher() i=0 2024-09-18T02:04:23.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.724+0000 7f1bc1fa0980 2 removed watcher, disabling cache 2024-09-18T02:04:23.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.724+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94064675696960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394a340 con 0x558d2393c880 2024-09-18T02:04:23.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.724+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94064675696960] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.724+0000 7f1bc1fa0980 20 remove_watcher() i=1 2024-09-18T02:04:23.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.724+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94064675699264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d239749f0 con 0x558d23945bc0 2024-09-18T02:04:23.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.724+0000 7f1bbf2af640 1 -- 172.21.15.167:0/1026500490 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94064675699264] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba80aaa80 con 0x558d23945bc0 2024-09-18T02:04:23.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.724+0000 7f1bc1fa0980 20 remove_watcher() i=2 2024-09-18T02:04:23.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.724+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94064675703888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394a340 con 0x7f1ba80e0040 2024-09-18T02:04:23.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.728+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94064675703888] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x7f1ba80e0040 2024-09-18T02:04:23.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.728+0000 7f1bc1fa0980 20 remove_watcher() i=3 2024-09-18T02:04:23.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.728+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94064675704944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394ba40 con 0x558d2393c880 2024-09-18T02:04:23.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.728+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94064675704944] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0026040 con 0x558d2393c880 2024-09-18T02:04:23.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.728+0000 7f1bc1fa0980 20 remove_watcher() i=4 2024-09-18T02:04:23.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.728+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94064675707440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d239749f0 con 0x558d23941270 2024-09-18T02:04:23.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.732+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94064675707440] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.732+0000 7f1bc1fa0980 20 remove_watcher() i=5 2024-09-18T02:04:23.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.732+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94064675708496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394a340 con 0x558d23941270 2024-09-18T02:04:23.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.732+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94064675708496] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.732+0000 7f1bc1fa0980 20 remove_watcher() i=6 2024-09-18T02:04:23.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.732+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94064675716112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d2394ba40 con 0x558d23941270 2024-09-18T02:04:23.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bbfab0640 1 -- 172.21.15.167:0/1026500490 <== osd.0 v2:172.21.15.81:6800/3087415523 33 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94064675716112] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb806f030 con 0x558d23941270 2024-09-18T02:04:23.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 20 remove_watcher() i=7 2024-09-18T02:04:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558d23941270 msgr2=0x558d23943660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558d23941270 0x558d23943660 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558d2393c880 msgr2=0x558d2393ed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558d2393c880 0x558d2393ed40 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f1ba80e0040 msgr2=0x7f1ba80e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f1ba80e0040 0x7f1ba80e0420 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558d23945bc0 msgr2=0x558d23947fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558d23945bc0 0x558d23947fd0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a88034650 msgr2=0x7f1a88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a88034650 0x7f1a88036b10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x558d23910790 tx=0x7f1ba80c1040 comp rx=0 tx=0).stop 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 msgr2=0x558d239318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1026500490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2392a6d0 0x558d239318b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80472c0 tx=0x7f1bb802cfb0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 reap_dead start 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1026500490 reap_dead start 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 shutdown_connections 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 >> 172.21.15.167:0/1026500490 conn(0x558d23926b40 msgr2=0x558d23924c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 shutdown_connections 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1026500490 wait complete. 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/3613815532 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a98034600 msgr2=0x7f1a98036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/3613815532 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a98034600 0x7f1a98036ac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ba801b380 tx=0x7f1ba8005ad0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/3613815532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2391de20 msgr2=0x558d2391e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/3613815532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2391de20 0x558d2391e240 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8014fd0 tx=0x7f1bb8005070 comp rx=0 tx=0).stop 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/3613815532 shutdown_connections 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/3613815532 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a98034600 0x7f1a98036ac0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/3613815532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d2391de20 0x558d2391e240 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/3613815532 >> 172.21.15.167:0/3613815532 conn(0x558d23912f70 msgr2=0x558d239159f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/3613815532 shutdown_connections 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/3613815532 wait complete. 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558d23909910 msgr2=0x558d2390bd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558d23909910 0x558d2390bd00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558d23811e60 msgr2=0x558d23906f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558d23811e60 0x558d23906f80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558d2390d810 msgr2=0x558d2390fc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558d2390d810 0x558d2390fc00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1aa8034650 msgr2=0x7f1aa8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1aa8034650 0x7f1aa8036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80ae000 tx=0x7f1ba80a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 msgr2=0x558d238fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 --2- 172.21.15.167:0/1647480968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558d23780230 0x558d238fffb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8006640 tx=0x7f1bb8000f50 comp rx=0 tx=0).stop 2024-09-18T02:04:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc02b1640 1 -- 172.21.15.167:0/1647480968 reap_dead start 2024-09-18T02:04:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 shutdown_connections 2024-09-18T02:04:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 >> 172.21.15.167:0/1647480968 conn(0x558d23806030 msgr2=0x558d238f33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 shutdown_connections 2024-09-18T02:04:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.736+0000 7f1bc1fa0980 1 -- 172.21.15.167:0/1647480968 wait complete. 2024-09-18T02:04:23.748 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-18T02:04:23.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-18T02:04:23.749 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-18T02:04:23.815 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:23.816 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:23.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.812+0000 7f7a051bf980 1 Processor -- start 2024-09-18T02:04:23.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.812+0000 7f7a051bf980 1 -- start start 2024-09-18T02:04:23.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.812+0000 7f7a051bf980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x560e1c3fa570 0x560e1c3fa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.812+0000 7f7a051bf980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e1c283ae0 con 0x560e1c3faec0 2024-09-18T02:04:23.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.812+0000 7f7a051bf980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x560e1c2a7e30 con 0x560e1c3fa570 2024-09-18T02:04:23.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.812+0000 7f7a02ccf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x560e1c3fa570 0x560e1c3fa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a024ce640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x560e1c3faec0 0x560e1c3ff8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55708/0 (socket says 172.21.15.167:55708) 2024-09-18T02:04:23.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a024ce640 1 -- 172.21.15.167:0/4155001356 learned_addr learned my addr 172.21.15.167:0/4155001356 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:23.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a02ccf640 1 -- 172.21.15.167:0/4155001356 >> v1:172.21.15.81:6789/0 conn(0x560e1c3faec0 legacy=0x560e1c3ff8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a02ccf640 1 -- 172.21.15.167:0/4155001356 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e1c402140 con 0x560e1c3fa570 2024-09-18T02:04:23.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a02ccf640 1 --2- 172.21.15.167:0/4155001356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c3fa950 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00a420 tx=0x7f79fc01d1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393898d90093f7b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a01ccd640 1 -- 172.21.15.167:0/4155001356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0b1070 con 0x560e1c3fa570 2024-09-18T02:04:23.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a01ccd640 1 -- 172.21.15.167:0/4155001356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc0ac530 con 0x560e1c3fa570 2024-09-18T02:04:23.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a01ccd640 1 -- 172.21.15.167:0/4155001356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0ac850 con 0x560e1c3fa570 2024-09-18T02:04:23.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a051bf980 1 -- 172.21.15.167:0/4155001356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 msgr2=0x560e1c3fa950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a051bf980 1 --2- 172.21.15.167:0/4155001356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c3fa950 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00a420 tx=0x7f79fc01d1e0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a051bf980 1 -- 172.21.15.167:0/4155001356 shutdown_connections 2024-09-18T02:04:23.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a051bf980 1 --2- 172.21.15.167:0/4155001356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c3fa950 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.816+0000 7f7a051bf980 1 -- 172.21.15.167:0/4155001356 >> 172.21.15.167:0/4155001356 conn(0x560e1c3f6090 msgr2=0x560e1c3f84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.820+0000 7f7a051bf980 1 -- 172.21.15.167:0/4155001356 shutdown_connections 2024-09-18T02:04:23.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.820+0000 7f7a051bf980 1 -- 172.21.15.167:0/4155001356 wait complete. 2024-09-18T02:04:23.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 Processor -- start 2024-09-18T02:04:23.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 -- start start 2024-09-18T02:04:23.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c4e4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560e1c2a9200 con 0x560e1c3fa570 2024-09-18T02:04:23.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a02ccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c4e4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a02ccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c4e4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57870/0 (socket says 172.21.15.167:57870) 2024-09-18T02:04:23.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a02ccf640 1 -- 172.21.15.167:0/545280658 learned_addr learned my addr 172.21.15.167:0/545280658 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a02ccf640 1 -- 172.21.15.167:0/545280658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e1c4e4ed0 con 0x560e1c3fa570 2024-09-18T02:04:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a02ccf640 1 --2- 172.21.15.167:0/545280658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c4e4900 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0af040 tx=0x7f79fc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200480338ee80d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f78f0e09640 1 -- 172.21.15.167:0/545280658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0b1050 con 0x560e1c3fa570 2024-09-18T02:04:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f78f0e09640 1 -- 172.21.15.167:0/545280658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc0b2040 con 0x560e1c3fa570 2024-09-18T02:04:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f78f0e09640 1 -- 172.21.15.167:0/545280658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0acca0 con 0x560e1c3fa570 2024-09-18T02:04:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 -- 172.21.15.167:0/545280658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 msgr2=0x560e1c4e4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 --2- 172.21.15.167:0/545280658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c4e4900 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0af040 tx=0x7f79fc0033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 -- 172.21.15.167:0/545280658 shutdown_connections 2024-09-18T02:04:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 --2- 172.21.15.167:0/545280658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c4e4900 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 -- 172.21.15.167:0/545280658 >> 172.21.15.167:0/545280658 conn(0x560e1c3f6090 msgr2=0x560e1c4e0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 -- 172.21.15.167:0/545280658 shutdown_connections 2024-09-18T02:04:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 -- 172.21.15.167:0/545280658 wait complete. 2024-09-18T02:04:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 Processor -- start 2024-09-18T02:04:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 -- start start 2024-09-18T02:04:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c4efec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.832+0000 7f7a051bf980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560e1c401b80 con 0x560e1c3fa570 2024-09-18T02:04:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a02ccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c4efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a02ccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c4efec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57874/0 (socket says 172.21.15.167:57874) 2024-09-18T02:04:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1018684267 learned_addr learned my addr 172.21.15.167:0/1018684267 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1018684267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e1c4f0400 con 0x560e1c3fa570 2024-09-18T02:04:23.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a02ccf640 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c4efec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f79fc01b890 tx=0x7f79fc01ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f78ef606640 1 -- 172.21.15.167:0/1018684267 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0c5070 con 0x560e1c3fa570 2024-09-18T02:04:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f78ef606640 1 -- 172.21.15.167:0/1018684267 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc0b8c30 con 0x560e1c3fa570 2024-09-18T02:04:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f78ef606640 1 -- 172.21.15.167:0/1018684267 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0c1400 con 0x560e1c3fa570 2024-09-18T02:04:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e1c4f0690 con 0x560e1c3fa570 2024-09-18T02:04:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e1c4f3370 con 0x560e1c3fa570 2024-09-18T02:04:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f78ef606640 1 -- 172.21.15.167:0/1018684267 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79fc0c8070 con 0x560e1c3fa570 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f78ef606640 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78e8034650 0x7f78e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f78ef606640 1 -- 172.21.15.167:0/1018684267 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f79fc0bd070 con 0x560e1c3fa570 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a024ce640 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78e8034650 0x7f78e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560e1c3faec0 0x560e1c4f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c4f7490 con 0x560e1c3faec0 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a034d0640 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560e1c3faec0 0x560e1c4f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a024ce640 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78e8034650 0x7f78e8036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f79f8001da0 tx=0x7f79f8001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a034d0640 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560e1c3faec0 0x560e1c4f6e50 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a034d0640 1 -- 172.21.15.167:0/1018684267 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79f40083f0 con 0x560e1c3faec0 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.836+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c4f7d30 con 0x560e1c3faec0 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a034d0640 1 -- 172.21.15.167:0/1018684267 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79f40083f0 con 0x560e1c3faec0 2024-09-18T02:04:23.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560e1c4f9640 0x560e1c4fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c4fc270 con 0x560e1c4f9640 2024-09-18T02:04:23.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a02ccf640 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560e1c4f9640 0x560e1c4fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a02ccf640 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560e1c4f9640 0x560e1c4fbae0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1018684267 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f79fc0d1070 con 0x560e1c4f9640 2024-09-18T02:04:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c4f8580 con 0x560e1c3faec0 2024-09-18T02:04:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a034d0640 1 -- 172.21.15.167:0/1018684267 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79f40083f0 con 0x560e1c3faec0 2024-09-18T02:04:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560e1c4fd6d0 0x560e1c4ffac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c500230 con 0x560e1c4fd6d0 2024-09-18T02:04:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a024ce640 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560e1c4fd6d0 0x560e1c4ffac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a024ce640 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560e1c4fd6d0 0x560e1c4ffac0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a024ce640 1 -- 172.21.15.167:0/1018684267 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c4fd6d0 2024-09-18T02:04:23.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a051bf980 1 Processor -- start 2024-09-18T02:04:23.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a051bf980 1 -- start start 2024-09-18T02:04:23.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a051bf980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c50dce0 0x560e1c50e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a051bf980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560e1c302800 con 0x560e1c50dce0 2024-09-18T02:04:23.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a02ccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c50dce0 0x560e1c50e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a02ccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c50dce0 0x560e1c50e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57884/0 (socket says 172.21.15.167:57884) 2024-09-18T02:04:23.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.840+0000 7f7a02ccf640 1 -- 172.21.15.167:0/3000374412 learned_addr learned my addr 172.21.15.167:0/3000374412 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f7a02ccf640 1 -- 172.21.15.167:0/3000374412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e1c50e640 con 0x560e1c50dce0 2024-09-18T02:04:23.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f7a02ccf640 1 --2- 172.21.15.167:0/3000374412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c50dce0 0x560e1c50e100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f79fc01d220 tx=0x7f79fc0c0590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f78ece01640 1 -- 172.21.15.167:0/3000374412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0c06f0 con 0x560e1c50dce0 2024-09-18T02:04:23.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f7a051bf980 1 -- 172.21.15.167:0/3000374412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e1c50e8d0 con 0x560e1c50dce0 2024-09-18T02:04:23.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f7a051bf980 1 -- 172.21.15.167:0/3000374412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e1c511550 con 0x560e1c50dce0 2024-09-18T02:04:23.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f78ece01640 1 -- 172.21.15.167:0/3000374412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc0c0890 con 0x560e1c50dce0 2024-09-18T02:04:23.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f78ece01640 1 -- 172.21.15.167:0/3000374412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0c8a40 con 0x560e1c50dce0 2024-09-18T02:04:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f78ece01640 1 -- 172.21.15.167:0/3000374412 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79fc0c8be0 con 0x560e1c50dce0 2024-09-18T02:04:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f78ece01640 1 --2- 172.21.15.167:0/3000374412 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78dc034650 0x7f78dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f78ece01640 1 -- 172.21.15.167:0/3000374412 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f79fc0e0070 con 0x560e1c50dce0 2024-09-18T02:04:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f7a024ce640 1 --2- 172.21.15.167:0/3000374412 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78dc034650 0x7f78dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f7a051bf980 1 Processor -- start 2024-09-18T02:04:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f7a051bf980 1 -- start start 2024-09-18T02:04:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f7a024ce640 1 --2- 172.21.15.167:0/3000374412 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78dc034650 0x7f78dc036b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x560e1c4fc610 tx=0x7f79f800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f7a051bf980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c51aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f7a051bf980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560e1c4e5190 con 0x560e1c51a660 2024-09-18T02:04:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.844+0000 7f7a02ccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c51aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a02ccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c51aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57900/0 (socket says 172.21.15.167:57900) 2024-09-18T02:04:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a02ccf640 1 -- 172.21.15.167:0/3664721355 learned_addr learned my addr 172.21.15.167:0/3664721355 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a02ccf640 1 -- 172.21.15.167:0/3664721355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e1c51b030 con 0x560e1c51a660 2024-09-18T02:04:23.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a02ccf640 1 --2- 172.21.15.167:0/3664721355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c51aa60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0edd80 tx=0x7f79fc0e1440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229a44fc71e58ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f78e67fc640 1 -- 172.21.15.167:0/3664721355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0ccde0 con 0x560e1c51a660 2024-09-18T02:04:23.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f78e67fc640 1 -- 172.21.15.167:0/3664721355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc0a7140 con 0x560e1c51a660 2024-09-18T02:04:23.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f78e67fc640 1 -- 172.21.15.167:0/3664721355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0a72f0 con 0x560e1c51a660 2024-09-18T02:04:23.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 -- 172.21.15.167:0/3664721355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 msgr2=0x560e1c51aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 --2- 172.21.15.167:0/3664721355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c51aa60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0edd80 tx=0x7f79fc0e1440 comp rx=0 tx=0).stop 2024-09-18T02:04:23.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 -- 172.21.15.167:0/3664721355 shutdown_connections 2024-09-18T02:04:23.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 --2- 172.21.15.167:0/3664721355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c51aa60 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 -- 172.21.15.167:0/3664721355 >> 172.21.15.167:0/3664721355 conn(0x560e1c5169f0 msgr2=0x560e1c514af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 -- 172.21.15.167:0/3664721355 shutdown_connections 2024-09-18T02:04:23.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 -- 172.21.15.167:0/3664721355 wait complete. 2024-09-18T02:04:23.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 Processor -- start 2024-09-18T02:04:23.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 -- start start 2024-09-18T02:04:23.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c5217a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560e1c51b580 con 0x560e1c51a660 2024-09-18T02:04:23.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a02ccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c5217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a02ccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c5217a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57910/0 (socket says 172.21.15.167:57910) 2024-09-18T02:04:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 learned_addr learned my addr 172.21.15.167:0/1859106474 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e1c521ce0 con 0x560e1c51a660 2024-09-18T02:04:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a02ccf640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c5217a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0edd80 tx=0x7f79fc0d0fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f78e4ff9640 1 -- 172.21.15.167:0/1859106474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0ccde0 con 0x560e1c51a660 2024-09-18T02:04:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e1c521ce0 con 0x560e1c51a660 2024-09-18T02:04:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f78e4ff9640 1 -- 172.21.15.167:0/1859106474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc0dee20 con 0x560e1c51a660 2024-09-18T02:04:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f78e4ff9640 1 -- 172.21.15.167:0/1859106474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79fc0c1930 con 0x560e1c51a660 2024-09-18T02:04:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.848+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e1c522150 con 0x560e1c51a660 2024-09-18T02:04:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f78e4ff9640 1 -- 172.21.15.167:0/1859106474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79fc100020 con 0x560e1c51a660 2024-09-18T02:04:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f78e4ff9640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78cc034650 0x7f78cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f78e4ff9640 1 -- 172.21.15.167:0/1859106474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f79fc1117d0 con 0x560e1c51a660 2024-09-18T02:04:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a024ce640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78cc034650 0x7f78cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560e1c52c720 0x560e1c52ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c52f330 con 0x560e1c52c720 2024-09-18T02:04:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a034d0640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560e1c52c720 0x560e1c52ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a024ce640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78cc034650 0x7f78cc036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x560e1c500610 tx=0x7f79f8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a034d0640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560e1c52c720 0x560e1c52ebe0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79f40083f0 con 0x560e1c52c720 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 20 realm 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c52f740 con 0x560e1c52c720 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79f40083f0 con 0x560e1c52c720 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c52ffe0 con 0x560e1c52c720 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79f40083f0 con 0x560e1c52c720 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c52c720 2024-09-18T02:04:23.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79f40083f0 con 0x560e1c52c720 2024-09-18T02:04:23.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:23.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560e1c5310e0 0x560e1c5334d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c533a50 con 0x560e1c5310e0 2024-09-18T02:04:23.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a02ccf640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560e1c5310e0 0x560e1c5334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.852+0000 7f7a02ccf640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560e1c5310e0 0x560e1c5334d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a051bf980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:23.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a051bf980 20 searching for the correct realm 2024-09-18T02:04:23.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560e1c535980 0x560e1c537e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c5384e0 con 0x560e1c535980 2024-09-18T02:04:23.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a024ce640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560e1c535980 0x560e1c537e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a024ce640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560e1c535980 0x560e1c537e10 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a024ce640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f79f8037040 0x7f79f8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c5384e0 con 0x7f79f8037040 2024-09-18T02:04:23.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a034d0640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f79f8037040 0x7f79f8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a034d0640 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f79f8037040 0x7f79f8036410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f40083f0 con 0x7f79f8037040 2024-09-18T02:04:23.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c5310e0 2024-09-18T02:04:23.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c52c720 2024-09-18T02:04:23.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f40083f0 con 0x560e1c52c720 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c52c720 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c5310e0 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.856+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c5310e0 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x7f79f8037040 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f4026040 con 0x7f79f8037040 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c535980 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c52c720 2024-09-18T02:04:23.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c5310e0 2024-09-18T02:04:23.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c52c720 2024-09-18T02:04:23.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x7f79f8037040 2024-09-18T02:04:23.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f79f4026040 con 0x7f79f8037040 2024-09-18T02:04:23.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c535980 2024-09-18T02:04:23.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c535980 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c5310e0 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c535980 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.860+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c535980 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c52c720 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c52c720 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c5310e0 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c535980 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x7f79f8037040 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f4026040 con 0x7f79f8037040 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c52c720 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c5310e0 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c535980 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c5310e0 2024-09-18T02:04:23.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x7f79f8037040 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f4026040 con 0x7f79f8037040 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c535980 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.864+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c5310e0 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x560e1c52c720 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560e1c530380 con 0x7f79f8037040 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79f4026040 con 0x7f79f8037040 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:23.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c5342a0 con 0x560e1c52c720 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c5342a0 con 0x560e1c52c720 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c5342a0 con 0x560e1c535980 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 zone default found 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 4 Realm: () 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 zonegroup default 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c534b40 con 0x560e1c5310e0 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53a340 con 0x560e1c535980 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53a6e0 con 0x560e1c535980 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 started sync module instance, tier type = 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c5397e0 con 0x7f79f8037040 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x7f79f8037040 2024-09-18T02:04:23.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94618604772608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c5397e0 con 0x7f79f8037040 2024-09-18T02:04:23.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.868+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53b120 con 0x560e1c52c720 2024-09-18T02:04:23.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.872+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94618604772608] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x7f79f8037040 2024-09-18T02:04:23.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.872+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.872+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94618604776432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c5397e0 con 0x560e1c52c720 2024-09-18T02:04:23.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.872+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53bb30 con 0x560e1c535980 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.872+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94618604776432] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.876+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.876+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94618604770096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c539750 con 0x560e1c535980 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.876+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53c8c0 con 0x7f79f8037040 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.876+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x7f79f8037040 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.876+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94618604782544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53d160 con 0x7f79f8037040 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.876+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53db60 con 0x560e1c52c720 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.876+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94618604770096] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.876+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94618604782544] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x7f79f8037040 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.876+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.876+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94618604781344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53cc30 con 0x560e1c52c720 2024-09-18T02:04:23.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.876+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53e400 con 0x560e1c5310e0 2024-09-18T02:04:23.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.880+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94618604781344] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.880+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.880+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94618604789584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53cc30 con 0x560e1c5310e0 2024-09-18T02:04:23.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.880+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53ec50 con 0x560e1c5310e0 2024-09-18T02:04:23.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.880+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94618604789584] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.880+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.880+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94618604787312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53f4a0 con 0x560e1c5310e0 2024-09-18T02:04:23.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.880+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53fe60 con 0x560e1c5310e0 2024-09-18T02:04:23.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94618604787312] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94618604794144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53fe60 con 0x560e1c5310e0 2024-09-18T02:04:23.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a051bf980 20 add_watcher() i=0 2024-09-18T02:04:23.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a051bf980 20 add_watcher() i=1 2024-09-18T02:04:23.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a051bf980 20 add_watcher() i=2 2024-09-18T02:04:23.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a051bf980 20 add_watcher() i=3 2024-09-18T02:04:23.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a051bf980 20 add_watcher() i=4 2024-09-18T02:04:23.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a051bf980 20 add_watcher() i=5 2024-09-18T02:04:23.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a051bf980 20 add_watcher() i=6 2024-09-18T02:04:23.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94618604794144] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a051bf980 20 add_watcher() i=7 2024-09-18T02:04:23.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a051bf980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:23.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.884+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c543190 con 0x560e1c52c720 2024-09-18T02:04:23.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94618604796704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c5403f0 con 0x560e1c52c720 2024-09-18T02:04:23.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94618604796704] v30'136 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f78b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:23.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a051bf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:23.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a051bf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:23.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a051bf980 5 note: GC not initialized 2024-09-18T02:04:23.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7833fff640 20 reqs_thread_entry: start 2024-09-18T02:04:23.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a051bf980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:23.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a051bf980 20 Filter name: none 2024-09-18T02:04:23.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7831ffb640 20 reqs_thread_entry: start 2024-09-18T02:04:23.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a051bf980 20 rados->read ofs=0 len=0 2024-09-18T02:04:23.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560e1c566320 con 0x560e1c52c720 2024-09-18T02:04:23.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a051bf980 20 rados_obj.operate() r=0 bl.length=193 2024-09-18T02:04:23.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f78b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:23.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.888+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94618604796704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c526490 con 0x560e1c52c720 2024-09-18T02:04:23.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.892+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94618604796704] v30'137 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.892+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94618604772608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53fb20 con 0x7f79f8037040 2024-09-18T02:04:23.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.892+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94618604772608] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x7f79f8037040 2024-09-18T02:04:23.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.892+0000 7f7a051bf980 20 remove_watcher() i=0 2024-09-18T02:04:23.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.892+0000 7f7a051bf980 2 removed watcher, disabling cache 2024-09-18T02:04:23.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.892+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94618604776432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53fb20 con 0x560e1c52c720 2024-09-18T02:04:23.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.892+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94618604776432] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.892+0000 7f7a051bf980 20 remove_watcher() i=1 2024-09-18T02:04:23.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.892+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94618604770096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53fb20 con 0x560e1c535980 2024-09-18T02:04:23.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.896+0000 7f7a024ce640 1 -- 172.21.15.167:0/1859106474 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94618604770096] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f800e6c0 con 0x560e1c535980 2024-09-18T02:04:23.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.896+0000 7f7a051bf980 20 remove_watcher() i=2 2024-09-18T02:04:23.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.896+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94618604782544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c539330 con 0x7f79f8037040 2024-09-18T02:04:23.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.896+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94618604782544] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x7f79f8037040 2024-09-18T02:04:23.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.896+0000 7f7a051bf980 20 remove_watcher() i=3 2024-09-18T02:04:23.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.896+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94618604781344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53fb20 con 0x560e1c52c720 2024-09-18T02:04:23.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.900+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94618604781344] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79f4026040 con 0x560e1c52c720 2024-09-18T02:04:23.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.900+0000 7f7a051bf980 20 remove_watcher() i=4 2024-09-18T02:04:23.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.900+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94618604789584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c539330 con 0x560e1c5310e0 2024-09-18T02:04:23.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.900+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94618604789584] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.900+0000 7f7a051bf980 20 remove_watcher() i=5 2024-09-18T02:04:23.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.900+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94618604787312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53bf20 con 0x560e1c5310e0 2024-09-18T02:04:23.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94618604787312] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 20 remove_watcher() i=6 2024-09-18T02:04:23.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94618604794144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560e1c53fb20 con 0x560e1c5310e0 2024-09-18T02:04:23.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a02ccf640 1 -- 172.21.15.167:0/1859106474 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94618604794144] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79fc116020 con 0x560e1c5310e0 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 20 remove_watcher() i=7 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560e1c5310e0 msgr2=0x560e1c5334d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560e1c5310e0 0x560e1c5334d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560e1c52c720 msgr2=0x560e1c52ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560e1c52c720 0x560e1c52ebe0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f79f8037040 msgr2=0x7f79f8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f79f8037040 0x7f79f8036410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560e1c535980 msgr2=0x560e1c537e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560e1c535980 0x560e1c537e10 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78cc034650 msgr2=0x7f78cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78cc034650 0x7f78cc036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x560e1c500610 tx=0x7f79f8010000 comp rx=0 tx=0).stop 2024-09-18T02:04:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a034d0640 1 -- 172.21.15.167:0/1859106474 reap_dead start 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 msgr2=0x560e1c5217a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c5217a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0edd80 tx=0x7f79fc0d0fb0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 shutdown_connections 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1859106474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c51a660 0x560e1c5217a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 >> 172.21.15.167:0/1859106474 conn(0x560e1c5169f0 msgr2=0x560e1c514ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 shutdown_connections 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/1859106474 wait complete. 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/3000374412 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78dc034650 msgr2=0x7f78dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 --2- 172.21.15.167:0/3000374412 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78dc034650 0x7f78dc036b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x560e1c4fc610 tx=0x7f79f800f000 comp rx=0 tx=0).stop 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/3000374412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c50dce0 msgr2=0x560e1c50e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 --2- 172.21.15.167:0/3000374412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c50dce0 0x560e1c50e100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f79fc01d220 tx=0x7f79fc0c0590 comp rx=0 tx=0).stop 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/3000374412 shutdown_connections 2024-09-18T02:04:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 --2- 172.21.15.167:0/3000374412 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78dc034650 0x7f78dc036b10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 --2- 172.21.15.167:0/3000374412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c50dce0 0x560e1c50e100 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/3000374412 >> 172.21.15.167:0/3000374412 conn(0x560e1c502e30 msgr2=0x560e1c5058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/3000374412 shutdown_connections 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.904+0000 7f7a051bf980 1 -- 172.21.15.167:0/3000374412 wait complete. 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560e1c4f9640 msgr2=0x560e1c4fbae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x560e1c4f9640 0x560e1c4fbae0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560e1c3faec0 msgr2=0x560e1c4f6e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x560e1c3faec0 0x560e1c4f6e50 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560e1c4fd6d0 msgr2=0x560e1c4ffac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x560e1c4fd6d0 0x560e1c4ffac0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78e8034650 msgr2=0x7f78e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78e8034650 0x7f78e8036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f79f8001da0 tx=0x7f79f8001300 comp rx=0 tx=0).stop 2024-09-18T02:04:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 msgr2=0x560e1c4efec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 --2- 172.21.15.167:0/1018684267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e1c3fa570 0x560e1c4efec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f79fc01b890 tx=0x7f79fc01ba20 comp rx=0 tx=0).stop 2024-09-18T02:04:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a034d0640 1 -- 172.21.15.167:0/1018684267 reap_dead start 2024-09-18T02:04:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 shutdown_connections 2024-09-18T02:04:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 >> 172.21.15.167:0/1018684267 conn(0x560e1c3f6090 msgr2=0x560e1c4df0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 shutdown_connections 2024-09-18T02:04:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.908+0000 7f7a051bf980 1 -- 172.21.15.167:0/1018684267 wait complete. 2024-09-18T02:04:23.918 INFO:teuthology.orchestra.run.smithi167.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"5Ybj+51HteilejPSqNhhfCyd","ver":2},"mtime":"2024-09-18T02:04:23.714191Z","data":{"bucket":{"name":"myfoo","marker":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","bucket_id":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-18T02:04:20.260735Z","linked":true,"has_bucket_info":false}} 2024-09-18T02:04:23.919 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '5Ybj+51HteilejPSqNhhfCyd', 'ver': 2}, 'mtime': '2024-09-18T02:04:23.714191Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'bucket_id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-18T02:04:20.260735Z', 'linked': True, 'has_bucket_info': False}} 2024-09-18T02:04:23.919 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-18T02:04:23.919 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-18T02:04:23.919 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-18T02:04:23.993 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:23.993 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:23.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d5879980 1 Processor -- start 2024-09-18T02:04:23.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d5879980 1 -- start start 2024-09-18T02:04:23.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d5879980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f1de867ed0 0x55f1de86a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:23.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d5879980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1de6e9ae0 con 0x55f1de7d62a0 2024-09-18T02:04:23.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d5879980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55f1de70de30 con 0x55f1de867ed0 2024-09-18T02:04:23.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d2b88640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f1de867ed0 0x55f1de86a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:23.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d3389640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55f1de7d62a0 0x55f1de8667b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55714/0 (socket says 172.21.15.167:55714) 2024-09-18T02:04:23.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d3389640 1 -- 172.21.15.167:0/4235943480 learned_addr learned my addr 172.21.15.167:0/4235943480 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:23.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d2b88640 1 -- 172.21.15.167:0/4235943480 >> v1:172.21.15.81:6789/0 conn(0x55f1de7d62a0 legacy=0x55f1de8667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d2b88640 1 -- 172.21.15.167:0/4235943480 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1de7d6680 con 0x55f1de867ed0 2024-09-18T02:04:23.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d2b88640 1 --2- 172.21.15.167:0/4235943480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de867ed0 0x55f1de86a2c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f53c800a480 tx=0x7f53c801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730e9068b61d379e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:23.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d2387640 1 -- 172.21.15.167:0/4235943480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c80b0070 con 0x55f1de867ed0 2024-09-18T02:04:23.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.992+0000 7f53d2387640 1 -- 172.21.15.167:0/4235943480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c80ab540 con 0x55f1de867ed0 2024-09-18T02:04:23.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.996+0000 7f53d2387640 1 -- 172.21.15.167:0/4235943480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c80ab840 con 0x55f1de867ed0 2024-09-18T02:04:23.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.996+0000 7f53d5879980 1 -- 172.21.15.167:0/4235943480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de867ed0 msgr2=0x55f1de86a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:23.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.996+0000 7f53d5879980 1 --2- 172.21.15.167:0/4235943480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de867ed0 0x55f1de86a2c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f53c800a480 tx=0x7f53c801b280 comp rx=0 tx=0).stop 2024-09-18T02:04:23.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.996+0000 7f53d5879980 1 -- 172.21.15.167:0/4235943480 shutdown_connections 2024-09-18T02:04:23.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.996+0000 7f53d5879980 1 --2- 172.21.15.167:0/4235943480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de867ed0 0x55f1de86a2c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:23.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.996+0000 7f53d5879980 1 -- 172.21.15.167:0/4235943480 >> 172.21.15.167:0/4235943480 conn(0x55f1de85c0a0 msgr2=0x55f1de85e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:23.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.996+0000 7f53d5879980 1 -- 172.21.15.167:0/4235943480 shutdown_connections 2024-09-18T02:04:23.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:23.996+0000 7f53d5879980 1 -- 172.21.15.167:0/4235943480 wait complete. 2024-09-18T02:04:24.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d5879980 1 Processor -- start 2024-09-18T02:04:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d5879980 1 -- start start 2024-09-18T02:04:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d5879980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 0x55f1de94ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d5879980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f1de70f200 con 0x55f1de7d62a0 2024-09-18T02:04:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d3389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 0x55f1de94ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d3389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 0x55f1de94ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57934/0 (socket says 172.21.15.167:57934) 2024-09-18T02:04:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d3389640 1 -- 172.21.15.167:0/4210158249 learned_addr learned my addr 172.21.15.167:0/4210158249 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d3389640 1 -- 172.21.15.167:0/4210158249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1de94f2b0 con 0x55f1de7d62a0 2024-09-18T02:04:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d3389640 1 --2- 172.21.15.167:0/4210158249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 0x55f1de94ece0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0017b0 tx=0x7f53cc001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa44274617cee813 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f52c160a640 1 -- 172.21.15.167:0/4210158249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc016070 con 0x55f1de7d62a0 2024-09-18T02:04:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f52c160a640 1 -- 172.21.15.167:0/4210158249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc004530 con 0x55f1de7d62a0 2024-09-18T02:04:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f52c160a640 1 -- 172.21.15.167:0/4210158249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc004870 con 0x55f1de7d62a0 2024-09-18T02:04:24.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d5879980 1 -- 172.21.15.167:0/4210158249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 msgr2=0x55f1de94ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d5879980 1 --2- 172.21.15.167:0/4210158249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 0x55f1de94ece0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0017b0 tx=0x7f53cc001c70 comp rx=0 tx=0).stop 2024-09-18T02:04:24.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d5879980 1 -- 172.21.15.167:0/4210158249 shutdown_connections 2024-09-18T02:04:24.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d5879980 1 --2- 172.21.15.167:0/4210158249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 0x55f1de94ece0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d5879980 1 -- 172.21.15.167:0/4210158249 >> 172.21.15.167:0/4210158249 conn(0x55f1de85c0a0 msgr2=0x55f1de94a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d5879980 1 -- 172.21.15.167:0/4210158249 shutdown_connections 2024-09-18T02:04:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.008+0000 7f53d5879980 1 -- 172.21.15.167:0/4210158249 wait complete. 2024-09-18T02:04:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d5879980 1 Processor -- start 2024-09-18T02:04:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d5879980 1 -- start start 2024-09-18T02:04:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d5879980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 0x55f1de955ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d5879980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f1de86d230 con 0x55f1de7d62a0 2024-09-18T02:04:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d3389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 0x55f1de955ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d3389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 0x55f1de955ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57950/0 (socket says 172.21.15.167:57950) 2024-09-18T02:04:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d3389640 1 -- 172.21.15.167:0/2063529845 learned_addr learned my addr 172.21.15.167:0/2063529845 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d3389640 1 -- 172.21.15.167:0/2063529845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1de956530 con 0x55f1de7d62a0 2024-09-18T02:04:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d3389640 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 0x55f1de955ff0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f53cc000f90 tx=0x7f53cc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f52bfe07640 1 -- 172.21.15.167:0/2063529845 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc020070 con 0x55f1de7d62a0 2024-09-18T02:04:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1de9567c0 con 0x55f1de7d62a0 2024-09-18T02:04:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f52bfe07640 1 -- 172.21.15.167:0/2063529845 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc011400 con 0x55f1de7d62a0 2024-09-18T02:04:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f52bfe07640 1 -- 172.21.15.167:0/2063529845 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc016040 con 0x55f1de7d62a0 2024-09-18T02:04:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1de9594a0 con 0x55f1de7d62a0 2024-09-18T02:04:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f52bfe07640 1 -- 172.21.15.167:0/2063529845 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f53cc023070 con 0x55f1de7d62a0 2024-09-18T02:04:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f52bfe07640 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f52b8034650 0x7f52b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f52bfe07640 1 -- 172.21.15.167:0/2063529845 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f53cc048fc0 con 0x55f1de7d62a0 2024-09-18T02:04:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d2b88640 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f52b8034650 0x7f52b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d5879980 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f1de867ed0 0x55f1de95d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de95d630 con 0x55f1de867ed0 2024-09-18T02:04:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d3b8a640 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f1de867ed0 0x55f1de95d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d2b88640 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f52b8034650 0x7f52b8036b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f53c80ad000 tx=0x7f53c80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.012+0000 7f53d3b8a640 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f1de867ed0 0x55f1de95d0f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d3b8a640 1 -- 172.21.15.167:0/2063529845 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53c40083f0 con 0x55f1de867ed0 2024-09-18T02:04:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de95a6a0 con 0x55f1de867ed0 2024-09-18T02:04:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d3b8a640 1 -- 172.21.15.167:0/2063529845 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53c40083f0 con 0x55f1de867ed0 2024-09-18T02:04:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d5879980 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f1de95f8d0 0x55f1de961cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9623b0 con 0x55f1de95f8d0 2024-09-18T02:04:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d3389640 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f1de95f8d0 0x55f1de961cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d3389640 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f1de95f8d0 0x55f1de961cc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d3389640 1 -- 172.21.15.167:0/2063529845 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f53cc02c070 con 0x55f1de95f8d0 2024-09-18T02:04:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de95e740 con 0x55f1de867ed0 2024-09-18T02:04:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d3b8a640 1 -- 172.21.15.167:0/2063529845 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53c40083f0 con 0x55f1de867ed0 2024-09-18T02:04:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d5879980 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f1de963810 0x55f1de965c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de966300 con 0x55f1de963810 2024-09-18T02:04:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d2b88640 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f1de963810 0x55f1de965c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d2b88640 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f1de963810 0x55f1de965c00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d2b88640 1 -- 172.21.15.167:0/2063529845 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f53c80ab8a0 con 0x55f1de963810 2024-09-18T02:04:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d5879980 1 Processor -- start 2024-09-18T02:04:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d5879980 1 -- start start 2024-09-18T02:04:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d5879980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de973dd0 0x55f1de9741f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.016+0000 7f53d5879980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f1de768800 con 0x55f1de973dd0 2024-09-18T02:04:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d3389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de973dd0 0x55f1de9741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d3389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de973dd0 0x55f1de9741f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57958/0 (socket says 172.21.15.167:57958) 2024-09-18T02:04:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d3389640 1 -- 172.21.15.167:0/3987147090 learned_addr learned my addr 172.21.15.167:0/3987147090 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d3389640 1 -- 172.21.15.167:0/3987147090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1de974730 con 0x55f1de973dd0 2024-09-18T02:04:24.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d3389640 1 --2- 172.21.15.167:0/3987147090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de973dd0 0x55f1de9741f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0475c0 tx=0x7f53cc023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f52bd602640 1 -- 172.21.15.167:0/3987147090 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc02a040 con 0x55f1de973dd0 2024-09-18T02:04:24.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d5879980 1 -- 172.21.15.167:0/3987147090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1de9749c0 con 0x55f1de973dd0 2024-09-18T02:04:24.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f52bd602640 1 -- 172.21.15.167:0/3987147090 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc0116e0 con 0x55f1de973dd0 2024-09-18T02:04:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d5879980 1 -- 172.21.15.167:0/3987147090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1de977640 con 0x55f1de973dd0 2024-09-18T02:04:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f52bd602640 1 -- 172.21.15.167:0/3987147090 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc02a420 con 0x55f1de973dd0 2024-09-18T02:04:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f52bd602640 1 -- 172.21.15.167:0/3987147090 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f53cc0119c0 con 0x55f1de973dd0 2024-09-18T02:04:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f52bd602640 1 --2- 172.21.15.167:0/3987147090 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f52ac034650 0x7f52ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f52bd602640 1 -- 172.21.15.167:0/3987147090 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f53cc036070 con 0x55f1de973dd0 2024-09-18T02:04:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d2b88640 1 --2- 172.21.15.167:0/3987147090 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f52ac034650 0x7f52ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d5879980 1 Processor -- start 2024-09-18T02:04:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d5879980 1 -- start start 2024-09-18T02:04:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d2b88640 1 --2- 172.21.15.167:0/3987147090 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f52ac034650 0x7f52ac036b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55f1de95da70 tx=0x7f53c8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d5879980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 0x55f1de980b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d5879980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f1de94f630 con 0x55f1de980780 2024-09-18T02:04:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d3389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 0x55f1de980b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d3389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 0x55f1de980b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57974/0 (socket says 172.21.15.167:57974) 2024-09-18T02:04:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.020+0000 7f53d3389640 1 -- 172.21.15.167:0/1097740560 learned_addr learned my addr 172.21.15.167:0/1097740560 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d3389640 1 -- 172.21.15.167:0/1097740560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1de981150 con 0x55f1de980780 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d3389640 1 --2- 172.21.15.167:0/1097740560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 0x55f1de980b80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00bfe0 tx=0x7f53cc03a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa7f2a205b65c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f52b6ffd640 1 -- 172.21.15.167:0/1097740560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc05a020 con 0x55f1de980780 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f52b6ffd640 1 -- 172.21.15.167:0/1097740560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc005db0 con 0x55f1de980780 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f52b6ffd640 1 -- 172.21.15.167:0/1097740560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc03adb0 con 0x55f1de980780 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 -- 172.21.15.167:0/1097740560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 msgr2=0x55f1de980b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 --2- 172.21.15.167:0/1097740560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 0x55f1de980b80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00bfe0 tx=0x7f53cc03a460 comp rx=0 tx=0).stop 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 -- 172.21.15.167:0/1097740560 shutdown_connections 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 --2- 172.21.15.167:0/1097740560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 0x55f1de980b80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 -- 172.21.15.167:0/1097740560 >> 172.21.15.167:0/1097740560 conn(0x55f1de97cb00 msgr2=0x55f1de97ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 -- 172.21.15.167:0/1097740560 shutdown_connections 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 -- 172.21.15.167:0/1097740560 wait complete. 2024-09-18T02:04:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 Processor -- start 2024-09-18T02:04:24.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 -- start start 2024-09-18T02:04:24.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 0x55f1de987890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f1de981510 con 0x55f1de980780 2024-09-18T02:04:24.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d3389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 0x55f1de987890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d3389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 0x55f1de987890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:57990/0 (socket says 172.21.15.167:57990) 2024-09-18T02:04:24.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 learned_addr learned my addr 172.21.15.167:0/4229045965 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1de987dd0 con 0x55f1de980780 2024-09-18T02:04:24.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d3389640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 0x55f1de987890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f53cc03a4a0 tx=0x7f53cc02cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f52b57fa640 1 -- 172.21.15.167:0/4229045965 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc06e070 con 0x55f1de980780 2024-09-18T02:04:24.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1de987dd0 con 0x55f1de980780 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f52b57fa640 1 -- 172.21.15.167:0/4229045965 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc014ca0 con 0x55f1de980780 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f52b57fa640 1 -- 172.21.15.167:0/4229045965 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc025450 con 0x55f1de980780 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.024+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1de987dd0 con 0x55f1de980780 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f52b57fa640 1 -- 172.21.15.167:0/4229045965 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f53cc071070 con 0x55f1de980780 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f52b57fa640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f529c034650 0x7f529c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f52b57fa640 1 -- 172.21.15.167:0/4229045965 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f53cc066070 con 0x55f1de980780 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d2b88640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f529c034650 0x7f529c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f1de9929c0 0x55f1de994e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9955d0 con 0x55f1de9929c0 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d3b8a640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f1de9929c0 0x55f1de994e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d2b88640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f529c034650 0x7f529c036b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f53c801b2c0 tx=0x7f53c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d3b8a640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f1de9929c0 0x55f1de994e80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53c40083f0 con 0x55f1de9929c0 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 realm 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9959e0 con 0x55f1de9929c0 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53c40083f0 con 0x55f1de9929c0 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9962b0 con 0x55f1de9929c0 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53c40083f0 con 0x55f1de9929c0 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x55f1de9929c0 2024-09-18T02:04:24.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53c40083f0 con 0x55f1de9929c0 2024-09-18T02:04:24.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:24.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f1de9973b0 0x55f1de9997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de999db0 con 0x55f1de9973b0 2024-09-18T02:04:24.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d3389640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f1de9973b0 0x55f1de9997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d3389640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f1de9973b0 0x55f1de9997a0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:24.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 20 searching for the correct realm 2024-09-18T02:04:24.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f1de99bd00 0x55f1de99e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.028+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de99e7e0 con 0x55f1de99bd00 2024-09-18T02:04:24.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d2b88640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f1de99bd00 0x55f1de99e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d2b88640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f1de99bd00 0x55f1de99e110 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d2b88640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f53c80cf040 0x7f53c80dc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de99e7e0 con 0x7f53c80cf040 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3b8a640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f53c80cf040 0x7f53c80dc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3b8a640 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f53c80cf040 0x7f53c80dc410 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c40083f0 con 0x7f53c80cf040 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x55f1de9973b0 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x55f1de9929c0 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c40083f0 con 0x55f1de9929c0 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x55f1de9929c0 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x55f1de9973b0 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x55f1de9973b0 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x7f53c80cf040 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x55f1de99bd00 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.032+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x55f1de9929c0 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x55f1de9973b0 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x55f1de9929c0 2024-09-18T02:04:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x7f53c80cf040 2024-09-18T02:04:24.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1de996650 con 0x55f1de99bd00 2024-09-18T02:04:24.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de99bd00 2024-09-18T02:04:24.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de9973b0 2024-09-18T02:04:24.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de99bd00 2024-09-18T02:04:24.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de99bd00 2024-09-18T02:04:24.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de9929c0 2024-09-18T02:04:24.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de9929c0 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de9973b0 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de99bd00 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.036+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x7f53c80cf040 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de9929c0 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de9973b0 2024-09-18T02:04:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de99bd00 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de9973b0 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x7f53c80cf040 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de99bd00 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de9973b0 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x55f1de9929c0 2024-09-18T02:04:24.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f53c80e9080 con 0x7f53c80cf040 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de99a670 con 0x55f1de9929c0 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de99a670 con 0x55f1de9929c0 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.040+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de99a670 con 0x55f1de99bd00 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 20 zone default found 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 4 Realm: () 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 20 zonegroup default 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de99af80 con 0x55f1de9973b0 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a0640 con 0x55f1de99bd00 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a0a80 con 0x55f1de99bd00 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 20 started sync module instance, tier type = 2024-09-18T02:04:24.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:24.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de99fae0 con 0x7f53c80cf040 2024-09-18T02:04:24.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94497310113792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de99fae0 con 0x7f53c80cf040 2024-09-18T02:04:24.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a1510 con 0x55f1de9929c0 2024-09-18T02:04:24.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.044+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94497310113792] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.048+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.048+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94497310117888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de99fae0 con 0x55f1de9929c0 2024-09-18T02:04:24.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.048+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a1f50 con 0x55f1de99bd00 2024-09-18T02:04:24.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.048+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94497310117888] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.048+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.048+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94497310111280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de99fa50 con 0x55f1de99bd00 2024-09-18T02:04:24.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.048+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a2d20 con 0x7f53c80cf040 2024-09-18T02:04:24.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.052+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.052+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94497310124016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a35c0 con 0x7f53c80cf040 2024-09-18T02:04:24.056 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.052+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a3fc0 con 0x55f1de9929c0 2024-09-18T02:04:24.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.052+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94497310111280] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.052+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94497310124016] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.052+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.052+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94497310122816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a3090 con 0x55f1de9929c0 2024-09-18T02:04:24.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.052+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a4860 con 0x55f1de9973b0 2024-09-18T02:04:24.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.056+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94497310122816] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.056+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.056+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94497310131120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a3090 con 0x55f1de9973b0 2024-09-18T02:04:24.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.056+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a50b0 con 0x55f1de9973b0 2024-09-18T02:04:24.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.056+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.056+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94497310131120] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.056+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94497310135376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a5870 con 0x55f1de9973b0 2024-09-18T02:04:24.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.056+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a6230 con 0x55f1de9973b0 2024-09-18T02:04:24.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94497310135376] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94497310128848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a6230 con 0x55f1de9973b0 2024-09-18T02:04:24.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 20 add_watcher() i=0 2024-09-18T02:04:24.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 20 add_watcher() i=1 2024-09-18T02:04:24.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 20 add_watcher() i=2 2024-09-18T02:04:24.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 20 add_watcher() i=3 2024-09-18T02:04:24.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 20 add_watcher() i=4 2024-09-18T02:04:24.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 20 add_watcher() i=5 2024-09-18T02:04:24.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 20 add_watcher() i=6 2024-09-18T02:04:24.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94497310128848] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 20 add_watcher() i=7 2024-09-18T02:04:24.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:24.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a9630 con 0x55f1de9929c0 2024-09-18T02:04:24.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.060+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94497310138192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a6b80 con 0x55f1de9929c0 2024-09-18T02:04:24.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94497310138192] v30'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f5289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:24.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 5 note: GC not initialized 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f5288fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 20 Filter name: none 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f52027fc640 20 reqs_thread_entry: start 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9ccc40 con 0x55f1de9929c0 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:24.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9ced20 con 0x55f1de9929c0 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 20 rados_obj.operate() r=0 bl.length=193 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 : miss 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 8.16 8:6d7fea2b:root::.bucket.meta.testx%3amyfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9d0580 con 0x55f1de99bd00 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 20 rados_obj.operate() r=0 bl.length=412 2024-09-18T02:04:24.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:24.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:24.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:24.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-18T02:04:24.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:24.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-18T02:04:24.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.064+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9d4c60 con 0x55f1de9929c0 2024-09-18T02:04:24.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9d8570 con 0x55f1de99bd00 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(66 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [create,call,writefull 0~379,setxattr (123)] v30'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d5879980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x7 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d5879980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d5879980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d5879980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1, ofs0, ns] 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94497310335664 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9d7fb0 con 0x55f1de9973b0 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== watch-notify(notify (1) cookie 94497310128848 notify 128849018894 ret 0) ==== 770+0+0 (crc 0 0 0) 0x55f1de9749c0 con 0x55f1de9973b0 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f52b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94497310128848 notifier 4564 bl.length()=728 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f52b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x7 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f52b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:24.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f52b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:24.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(67 notify.7 [notify cookie 94497310335664 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f52b6ffd640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5298003eb0 con 0x55f1de9973b0 2024-09-18T02:04:24.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== watch-notify(notify_complete (2) cookie 94497310335664 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1de974730 con 0x55f1de9973b0 2024-09-18T02:04:24.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d5879980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_sources= new_sources= 2024-09-18T02:04:24.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d5879980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential sources added=[] removed=[] 2024-09-18T02:04:24.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d5879980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_dests= new_dests= 2024-09-18T02:04:24.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d5879980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential dests added=[] removed=[] 2024-09-18T02:04:24.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.068+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9d80b0 con 0x7f53c80cf040 2024-09-18T02:04:24.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.072+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(69 foo.buckets [call] v30'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.072+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9d80b0 con 0x7f53c80cf040 2024-09-18T02:04:24.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.072+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.072+0000 7f53d5879980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T02:04:24.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.072+0000 7f53d5879980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:24.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.072+0000 7f53d5879980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T02:04:24.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.072+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94497310342144 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9d8020 con 0x55f1de9973b0 2024-09-18T02:04:24.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== watch-notify(notify (1) cookie 94497310135376 notify 128849018895 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55f1de9594a0 con 0x55f1de9973b0 2024-09-18T02:04:24.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f52b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94497310135376 notifier 4564 bl.length()=314 2024-09-18T02:04:24.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f52b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T02:04:24.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f52b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:24.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f52b6ffd640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5298003eb0 con 0x55f1de9973b0 2024-09-18T02:04:24.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(71 notify.6 [notify cookie 94497310342144 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== watch-notify(notify_complete (2) cookie 94497310342144 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1de9567c0 con 0x55f1de9973b0 2024-09-18T02:04:24.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9d80b0 con 0x55f1de9929c0 2024-09-18T02:04:24.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(73 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d5879980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-18T02:04:24.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d5879980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-18T02:04:24.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94497310342144 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9d8020 con 0x55f1de9929c0 2024-09-18T02:04:24.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== watch-notify(notify (1) cookie 94497310122816 notify 128849018892 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55f1de9d8450 con 0x55f1de9929c0 2024-09-18T02:04:24.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f52b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94497310122816 notifier 4564 bl.length()=155 2024-09-18T02:04:24.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(74 notify.4 [notify cookie 94497310342144 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f52b67fc640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f52080032d0 con 0x55f1de9929c0 2024-09-18T02:04:24.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== watch-notify(notify_complete (2) cookie 94497310342144 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1de9d72c0 con 0x55f1de9929c0 2024-09-18T02:04:24.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:76 8.16 8:6d7fea2b:root::.bucket.meta.testx%3amyfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9d80b0 con 0x55f1de99bd00 2024-09-18T02:04:24.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call,delete] v30'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d5879980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 from cache 2024-09-18T02:04:24.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d5879980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1, ofs0, ns] 2024-09-18T02:04:24.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.076+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94497310309904 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9d80b0 con 0x55f1de9973b0 2024-09-18T02:04:24.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.080+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== watch-notify(notify (1) cookie 94497310135376 notify 128849018896 ret 0) ==== 254+0+0 (crc 0 0 0) 0x55f1de9567c0 con 0x55f1de9973b0 2024-09-18T02:04:24.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.080+0000 7f52b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94497310135376 notifier 4564 bl.length()=212 2024-09-18T02:04:24.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.080+0000 7f52b67fc640 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5208003340 con 0x55f1de9973b0 2024-09-18T02:04:24.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.080+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(77 notify.6 [notify cookie 94497310309904 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.080+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== watch-notify(notify_complete (2) cookie 94497310309904 notify 128849018896 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1de956530 con 0x55f1de9973b0 2024-09-18T02:04:24.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.080+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.080+0000 7f5289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:24.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.080+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94497310138192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9caa70 con 0x55f1de9929c0 2024-09-18T02:04:24.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.080+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94497310138192] v30'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.080+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94497310113792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9caa70 con 0x7f53c80cf040 2024-09-18T02:04:24.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.084+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94497310113792] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.084+0000 7f53d5879980 20 remove_watcher() i=0 2024-09-18T02:04:24.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.084+0000 7f53d5879980 2 removed watcher, disabling cache 2024-09-18T02:04:24.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.084+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94497310117888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9caa70 con 0x55f1de9929c0 2024-09-18T02:04:24.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.084+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94497310117888] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.084+0000 7f53d5879980 20 remove_watcher() i=1 2024-09-18T02:04:24.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.084+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94497310111280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9caa70 con 0x55f1de99bd00 2024-09-18T02:04:24.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.088+0000 7f53d2b88640 1 -- 172.21.15.167:0/4229045965 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94497310111280] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c80da070 con 0x55f1de99bd00 2024-09-18T02:04:24.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.088+0000 7f53d5879980 20 remove_watcher() i=2 2024-09-18T02:04:24.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.088+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94497310124016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9caa70 con 0x7f53c80cf040 2024-09-18T02:04:24.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.088+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94497310124016] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x7f53c80cf040 2024-09-18T02:04:24.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.088+0000 7f53d5879980 20 remove_watcher() i=3 2024-09-18T02:04:24.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.088+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94497310122816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9caa70 con 0x55f1de9929c0 2024-09-18T02:04:24.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.088+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94497310122816] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4026040 con 0x55f1de9929c0 2024-09-18T02:04:24.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.088+0000 7f53d5879980 20 remove_watcher() i=4 2024-09-18T02:04:24.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.088+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94497310131120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a2340 con 0x55f1de9973b0 2024-09-18T02:04:24.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.092+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94497310131120] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.092+0000 7f53d5879980 20 remove_watcher() i=5 2024-09-18T02:04:24.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.092+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94497310135376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9caa70 con 0x55f1de9973b0 2024-09-18T02:04:24.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.092+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94497310135376] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.092+0000 7f53d5879980 20 remove_watcher() i=6 2024-09-18T02:04:24.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.092+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94497310128848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1de9a2340 con 0x55f1de9973b0 2024-09-18T02:04:24.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d3389640 1 -- 172.21.15.167:0/4229045965 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94497310128848] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc070030 con 0x55f1de9973b0 2024-09-18T02:04:24.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 20 remove_watcher() i=7 2024-09-18T02:04:24.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f1de9973b0 msgr2=0x55f1de9997a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f1de9973b0 0x55f1de9997a0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f1de9929c0 msgr2=0x55f1de994e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f1de9929c0 0x55f1de994e80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f53c80cf040 msgr2=0x7f53c80dc410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f53c80cf040 0x7f53c80dc410 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f1de99bd00 msgr2=0x55f1de99e110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f1de99bd00 0x55f1de99e110 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f529c034650 msgr2=0x7f529c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f529c034650 0x7f529c036b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f53c801b2c0 tx=0x7f53c80a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 msgr2=0x55f1de987890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/4229045965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de980780 0x55f1de987890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f53cc03a4a0 tx=0x7f53cc02cf10 comp rx=0 tx=0).stop 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 reap_dead start 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d3b8a640 1 -- 172.21.15.167:0/4229045965 reap_dead start 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 shutdown_connections 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 >> 172.21.15.167:0/4229045965 conn(0x55f1de97cb00 msgr2=0x55f1de97abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 shutdown_connections 2024-09-18T02:04:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/4229045965 wait complete. 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/3987147090 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f52ac034650 msgr2=0x7f52ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/3987147090 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f52ac034650 0x7f52ac036b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55f1de95da70 tx=0x7f53c8005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/3987147090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de973dd0 msgr2=0x55f1de9741f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/3987147090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de973dd0 0x55f1de9741f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0475c0 tx=0x7f53cc023ac0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/3987147090 shutdown_connections 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/3987147090 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f52ac034650 0x7f52ac036b10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/3987147090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de973dd0 0x55f1de9741f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/3987147090 >> 172.21.15.167:0/3987147090 conn(0x55f1de968f20 msgr2=0x55f1de96b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/3987147090 shutdown_connections 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/3987147090 wait complete. 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f1de95f8d0 msgr2=0x55f1de961cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f1de95f8d0 0x55f1de961cc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f1de867ed0 msgr2=0x55f1de95d0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f1de867ed0 0x55f1de95d0f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f1de963810 msgr2=0x55f1de965c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f1de963810 0x55f1de965c00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f52b8034650 msgr2=0x7f52b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f52b8034650 0x7f52b8036b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f53c80ad000 tx=0x7f53c80a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 msgr2=0x55f1de955ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 --2- 172.21.15.167:0/2063529845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1de7d62a0 0x55f1de955ff0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f53cc000f90 tx=0x7f53cc001260 comp rx=0 tx=0).stop 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d3b8a640 1 -- 172.21.15.167:0/2063529845 reap_dead start 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 shutdown_connections 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 >> 172.21.15.167:0/2063529845 conn(0x55f1de85c0a0 msgr2=0x55f1de949490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 shutdown_connections 2024-09-18T02:04:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.096+0000 7f53d5879980 1 -- 172.21.15.167:0/2063529845 wait complete. 2024-09-18T02:04:24.108 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T02:04:24.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T02:04:24.109 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-18T02:04:24.185 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:24.185 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.184+0000 7f7a33132980 1 Processor -- start 2024-09-18T02:04:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.184+0000 7f7a33132980 1 -- start start 2024-09-18T02:04:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.184+0000 7f7a33132980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562b294ca6a0 0x562b294caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.184+0000 7f7a33132980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b29352ae0 con 0x562b294caff0 2024-09-18T02:04:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.184+0000 7f7a33132980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x562b29376e30 con 0x562b294ca6a0 2024-09-18T02:04:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.184+0000 7f7a30c42640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562b294ca6a0 0x562b294caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.184+0000 7f7a30441640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x562b294caff0 0x562b294cfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55726/0 (socket says 172.21.15.167:55726) 2024-09-18T02:04:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.184+0000 7f7a30441640 1 -- 172.21.15.167:0/1023022114 learned_addr learned my addr 172.21.15.167:0/1023022114 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:24.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.184+0000 7f7a30c42640 1 -- 172.21.15.167:0/1023022114 >> v1:172.21.15.81:6789/0 conn(0x562b294caff0 legacy=0x562b294cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.184+0000 7f7a30c42640 1 -- 172.21.15.167:0/1023022114 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b294d2270 con 0x562b294ca6a0 2024-09-18T02:04:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.188+0000 7f7a30c42640 1 --2- 172.21.15.167:0/1023022114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b294caa80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800a420 tx=0x7f7a2801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755c6dd838ef4ab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.188+0000 7f7a2fc40640 1 -- 172.21.15.167:0/1023022114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280af070 con 0x562b294ca6a0 2024-09-18T02:04:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.188+0000 7f7a2fc40640 1 -- 172.21.15.167:0/1023022114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280aa530 con 0x562b294ca6a0 2024-09-18T02:04:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.188+0000 7f7a2fc40640 1 -- 172.21.15.167:0/1023022114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280aa850 con 0x562b294ca6a0 2024-09-18T02:04:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.188+0000 7f7a33132980 1 -- 172.21.15.167:0/1023022114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 msgr2=0x562b294caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.188+0000 7f7a33132980 1 --2- 172.21.15.167:0/1023022114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b294caa80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800a420 tx=0x7f7a2801afd0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.188+0000 7f7a33132980 1 -- 172.21.15.167:0/1023022114 shutdown_connections 2024-09-18T02:04:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.188+0000 7f7a33132980 1 --2- 172.21.15.167:0/1023022114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b294caa80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.188+0000 7f7a33132980 1 -- 172.21.15.167:0/1023022114 >> 172.21.15.167:0/1023022114 conn(0x562b294c61c0 msgr2=0x562b294c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.188+0000 7f7a33132980 1 -- 172.21.15.167:0/1023022114 shutdown_connections 2024-09-18T02:04:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.188+0000 7f7a33132980 1 -- 172.21.15.167:0/1023022114 wait complete. 2024-09-18T02:04:24.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.200+0000 7f7a33132980 1 Processor -- start 2024-09-18T02:04:24.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.200+0000 7f7a33132980 1 -- start start 2024-09-18T02:04:24.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.200+0000 7f7a33132980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b295b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.200+0000 7f7a33132980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562b29378200 con 0x562b294ca6a0 2024-09-18T02:04:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.200+0000 7f7a30c42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b295b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.200+0000 7f7a30c42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b295b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58002/0 (socket says 172.21.15.167:58002) 2024-09-18T02:04:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.200+0000 7f7a30c42640 1 -- 172.21.15.167:0/2490361354 learned_addr learned my addr 172.21.15.167:0/2490361354 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.200+0000 7f7a30c42640 1 -- 172.21.15.167:0/2490361354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b295b6090 con 0x562b294ca6a0 2024-09-18T02:04:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a30c42640 1 --2- 172.21.15.167:0/2490361354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b295b5ac0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7a280ad040 tx=0x7f7a280033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8696d2099515e8d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f791ee0d640 1 -- 172.21.15.167:0/2490361354 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280af050 con 0x562b294ca6a0 2024-09-18T02:04:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f791ee0d640 1 -- 172.21.15.167:0/2490361354 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280b0040 con 0x562b294ca6a0 2024-09-18T02:04:24.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f791ee0d640 1 -- 172.21.15.167:0/2490361354 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280aaca0 con 0x562b294ca6a0 2024-09-18T02:04:24.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 -- 172.21.15.167:0/2490361354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 msgr2=0x562b295b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 --2- 172.21.15.167:0/2490361354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b295b5ac0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7a280ad040 tx=0x7f7a280033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 -- 172.21.15.167:0/2490361354 shutdown_connections 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 --2- 172.21.15.167:0/2490361354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b295b5ac0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 -- 172.21.15.167:0/2490361354 >> 172.21.15.167:0/2490361354 conn(0x562b294c61c0 msgr2=0x562b295b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 -- 172.21.15.167:0/2490361354 shutdown_connections 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 -- 172.21.15.167:0/2490361354 wait complete. 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 Processor -- start 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 -- start start 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b294414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562b294d1cb0 con 0x562b294ca6a0 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a30c42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b294414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a30c42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b294414e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58014/0 (socket says 172.21.15.167:58014) 2024-09-18T02:04:24.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a30c42640 1 -- 172.21.15.167:0/4256295300 learned_addr learned my addr 172.21.15.167:0/4256295300 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a30c42640 1 -- 172.21.15.167:0/4256295300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b29441a20 con 0x562b294ca6a0 2024-09-18T02:04:24.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a30c42640 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b294414e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7a28019680 tx=0x7f7a28019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f791d60a640 1 -- 172.21.15.167:0/4256295300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280c5070 con 0x562b294ca6a0 2024-09-18T02:04:24.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f791d60a640 1 -- 172.21.15.167:0/4256295300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280b6d60 con 0x562b294ca6a0 2024-09-18T02:04:24.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f791d60a640 1 -- 172.21.15.167:0/4256295300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280c15f0 con 0x562b294ca6a0 2024-09-18T02:04:24.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b2943fc00 con 0x562b294ca6a0 2024-09-18T02:04:24.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.204+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b294400f0 con 0x562b294ca6a0 2024-09-18T02:04:24.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f791d60a640 1 -- 172.21.15.167:0/4256295300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7a280c8070 con 0x562b294ca6a0 2024-09-18T02:04:24.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f791d60a640 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f79180346a0 0x7f7918036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f791d60a640 1 -- 172.21.15.167:0/4256295300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7a280bb070 con 0x562b294ca6a0 2024-09-18T02:04:24.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a30441640 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f79180346a0 0x7f7918036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a33132980 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562b294caff0 0x562b295c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b295c6610 con 0x562b294caff0 2024-09-18T02:04:24.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a31443640 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562b294caff0 0x562b295c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a30441640 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f79180346a0 0x7f7918036b60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001da0 tx=0x7f7a18001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a31443640 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562b294caff0 0x562b295c60d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a31443640 1 -- 172.21.15.167:0/4256295300 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a200083f0 con 0x562b294caff0 2024-09-18T02:04:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b295c69b0 con 0x562b294caff0 2024-09-18T02:04:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a31443640 1 -- 172.21.15.167:0/4256295300 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a200083f0 con 0x562b294caff0 2024-09-18T02:04:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a33132980 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562b295c87a0 0x562b295cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b295cb230 con 0x562b295c87a0 2024-09-18T02:04:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a30c42640 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562b295c87a0 0x562b295cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.208+0000 7f7a30c42640 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562b295c87a0 0x562b295cab90 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a30c42640 1 -- 172.21.15.167:0/4256295300 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7a280d1070 con 0x562b295c87a0 2024-09-18T02:04:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b295c7610 con 0x562b294caff0 2024-09-18T02:04:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a31443640 1 -- 172.21.15.167:0/4256295300 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a200083f0 con 0x562b294caff0 2024-09-18T02:04:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a33132980 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562b295cc670 0x562b295cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b295cf1d0 con 0x562b295cc670 2024-09-18T02:04:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a30441640 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562b295cc670 0x562b295cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a30441640 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562b295cc670 0x562b295cea60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a30441640 1 -- 172.21.15.167:0/4256295300 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b295cc670 2024-09-18T02:04:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a33132980 1 Processor -- start 2024-09-18T02:04:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a33132980 1 -- start start 2024-09-18T02:04:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a33132980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295dcca0 0x562b295dd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a33132980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562b293d1800 con 0x562b295dcca0 2024-09-18T02:04:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a30c42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295dcca0 0x562b295dd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a30c42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295dcca0 0x562b295dd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58030/0 (socket says 172.21.15.167:58030) 2024-09-18T02:04:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a30c42640 1 -- 172.21.15.167:0/433892767 learned_addr learned my addr 172.21.15.167:0/433892767 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a30c42640 1 -- 172.21.15.167:0/433892767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b295dd600 con 0x562b295dcca0 2024-09-18T02:04:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a30c42640 1 --2- 172.21.15.167:0/433892767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295dcca0 0x562b295dd0c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7a280e36a0 tx=0x7f7a280a9690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f79167fc640 1 -- 172.21.15.167:0/433892767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280e2170 con 0x562b295dcca0 2024-09-18T02:04:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a33132980 1 -- 172.21.15.167:0/433892767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b295dd890 con 0x562b295dcca0 2024-09-18T02:04:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f7a33132980 1 -- 172.21.15.167:0/433892767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b295e0510 con 0x562b295dcca0 2024-09-18T02:04:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f79167fc640 1 -- 172.21.15.167:0/433892767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280e3a50 con 0x562b295dcca0 2024-09-18T02:04:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.212+0000 7f79167fc640 1 -- 172.21.15.167:0/433892767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280e3d30 con 0x562b295dcca0 2024-09-18T02:04:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f79167fc640 1 -- 172.21.15.167:0/433892767 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7a280dd030 con 0x562b295dcca0 2024-09-18T02:04:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f79167fc640 1 --2- 172.21.15.167:0/433892767 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7908034650 0x7f7908036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f79167fc640 1 -- 172.21.15.167:0/433892767 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7a280ca450 con 0x562b295dcca0 2024-09-18T02:04:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a30441640 1 --2- 172.21.15.167:0/433892767 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7908034650 0x7f7908036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 Processor -- start 2024-09-18T02:04:24.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 -- start start 2024-09-18T02:04:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a30441640 1 --2- 172.21.15.167:0/433892767 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7908034650 0x7f7908036b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x562b29440420 tx=0x7f7a1800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562b295b6350 con 0x562b295e9640 2024-09-18T02:04:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a30c42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a30c42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295e9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58040/0 (socket says 172.21.15.167:58040) 2024-09-18T02:04:24.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a30c42640 1 -- 172.21.15.167:0/2687627675 learned_addr learned my addr 172.21.15.167:0/2687627675 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a30c42640 1 -- 172.21.15.167:0/2687627675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b295ea010 con 0x562b295e9640 2024-09-18T02:04:24.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a30c42640 1 --2- 172.21.15.167:0/2687627675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295e9a40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7a280e2040 tx=0x7f7a280d4df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf9bb7c4b225dde server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7907fff640 1 -- 172.21.15.167:0/2687627675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280f9070 con 0x562b295e9640 2024-09-18T02:04:24.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7907fff640 1 -- 172.21.15.167:0/2687627675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280dfd80 con 0x562b295e9640 2024-09-18T02:04:24.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7907fff640 1 -- 172.21.15.167:0/2687627675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280cb7b0 con 0x562b295e9640 2024-09-18T02:04:24.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 -- 172.21.15.167:0/2687627675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 msgr2=0x562b295e9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 --2- 172.21.15.167:0/2687627675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295e9a40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7a280e2040 tx=0x7f7a280d4df0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 -- 172.21.15.167:0/2687627675 shutdown_connections 2024-09-18T02:04:24.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 --2- 172.21.15.167:0/2687627675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295e9a40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 -- 172.21.15.167:0/2687627675 >> 172.21.15.167:0/2687627675 conn(0x562b295e5a20 msgr2=0x562b295e3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 -- 172.21.15.167:0/2687627675 shutdown_connections 2024-09-18T02:04:24.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 -- 172.21.15.167:0/2687627675 wait complete. 2024-09-18T02:04:24.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 Processor -- start 2024-09-18T02:04:24.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 -- start start 2024-09-18T02:04:24.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.216+0000 7f7a33132980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562b295ea490 con 0x562b295e9640 2024-09-18T02:04:24.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a30c42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a30c42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295f08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58048/0 (socket says 172.21.15.167:58048) 2024-09-18T02:04:24.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 learned_addr learned my addr 172.21.15.167:0/2141050885 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b295f0e20 con 0x562b295e9640 2024-09-18T02:04:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a30c42640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295f08e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7a280e1d80 tx=0x7f7a280b3f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f79067fc640 1 -- 172.21.15.167:0/2141050885 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a2810e070 con 0x562b295e9640 2024-09-18T02:04:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b295f0e20 con 0x562b295e9640 2024-09-18T02:04:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f79067fc640 1 -- 172.21.15.167:0/2141050885 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280a9e40 con 0x562b295e9640 2024-09-18T02:04:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f79067fc640 1 -- 172.21.15.167:0/2141050885 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280c1790 con 0x562b295e9640 2024-09-18T02:04:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b295f1290 con 0x562b295e9640 2024-09-18T02:04:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f79067fc640 1 -- 172.21.15.167:0/2141050885 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7a28111070 con 0x562b295e9640 2024-09-18T02:04:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f79067fc640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78fc034650 0x7f78fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f79067fc640 1 -- 172.21.15.167:0/2141050885 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7a28114af0 con 0x562b295e9640 2024-09-18T02:04:24.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a30441640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78fc034650 0x7f78fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a33132980 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562b295fb8c0 0x562b295fdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b295fe4d0 con 0x562b295fb8c0 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a31443640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562b295fb8c0 0x562b295fdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a30441640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78fc034650 0x7f78fc036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x562b295cf5d0 tx=0x7f7a18010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a31443640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562b295fb8c0 0x562b295fdd80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a200083f0 con 0x562b295fb8c0 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a33132980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a33132980 20 realm 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b295fe8e0 con 0x562b295fb8c0 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a200083f0 con 0x562b295fb8c0 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.220+0000 7f7a33132980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff180 con 0x562b295fb8c0 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a200083f0 con 0x562b295fb8c0 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b295fb8c0 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a200083f0 con 0x562b295fb8c0 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562b29600280 0x562b29602670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b29602d10 con 0x562b29600280 2024-09-18T02:04:24.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a30c42640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562b29600280 0x562b29602670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a30c42640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562b29600280 0x562b29602670 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:24.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 20 searching for the correct realm 2024-09-18T02:04:24.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562b29604bf0 0x562b29607060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b296076e0 con 0x562b29604bf0 2024-09-18T02:04:24.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a30441640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562b29604bf0 0x562b29607060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a30441640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562b29604bf0 0x562b29607060 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a30441640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7a18037040 0x7f7a18036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b296076e0 con 0x7f7a18037040 2024-09-18T02:04:24.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a31443640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7a18037040 0x7f7a18036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a31443640 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7a18037040 0x7f7a18036410 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a200083f0 con 0x7f7a18037040 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.224+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29600280 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b295fb8c0 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a200083f0 con 0x562b295fb8c0 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b295fb8c0 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29600280 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29600280 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x7f7a18037040 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29604bf0 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b295fb8c0 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29600280 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b295fb8c0 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x7f7a18037040 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.228+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29604bf0 2024-09-18T02:04:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29604bf0 2024-09-18T02:04:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29600280 2024-09-18T02:04:24.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29604bf0 2024-09-18T02:04:24.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29604bf0 2024-09-18T02:04:24.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b295fb8c0 2024-09-18T02:04:24.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b295fb8c0 2024-09-18T02:04:24.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29600280 2024-09-18T02:04:24.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29604bf0 2024-09-18T02:04:24.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x7f7a18037040 2024-09-18T02:04:24.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b295fb8c0 2024-09-18T02:04:24.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29600280 2024-09-18T02:04:24.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.232+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29604bf0 2024-09-18T02:04:24.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29600280 2024-09-18T02:04:24.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x7f7a18037040 2024-09-18T02:04:24.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29604bf0 2024-09-18T02:04:24.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b29600280 2024-09-18T02:04:24.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x562b295fb8c0 2024-09-18T02:04:24.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562b295ff520 con 0x7f7a18037040 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b29603560 con 0x562b295fb8c0 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b29603560 con 0x562b295fb8c0 2024-09-18T02:04:24.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:24.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b29603560 con 0x562b29604bf0 2024-09-18T02:04:24.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:24.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 zone default found 2024-09-18T02:04:24.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 4 Realm: () 2024-09-18T02:04:24.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 zonegroup default 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b29603f20 con 0x562b29600280 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b29603ab0 con 0x562b29604bf0 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.236+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b29609b00 con 0x562b29604bf0 2024-09-18T02:04:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a33132980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a33132980 20 started sync module instance, tier type = 2024-09-18T02:04:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a33132980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b29608e80 con 0x7f7a18037040 2024-09-18T02:04:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94743377777568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b29608e80 con 0x7f7a18037040 2024-09-18T02:04:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960a580 con 0x562b295fb8c0 2024-09-18T02:04:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94743377777568] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94743377781216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b29608e80 con 0x562b295fb8c0 2024-09-18T02:04:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.240+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960afc0 con 0x562b29604bf0 2024-09-18T02:04:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.244+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94743377781216] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.244+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.244+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94743377775056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b29608df0 con 0x562b29604bf0 2024-09-18T02:04:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.244+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960bd00 con 0x7f7a18037040 2024-09-18T02:04:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.244+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.244+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94743377786896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960c5a0 con 0x7f7a18037040 2024-09-18T02:04:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.244+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960cfa0 con 0x562b295fb8c0 2024-09-18T02:04:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.244+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94743377775056] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.248+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94743377786896] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.248+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.248+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94743377785696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960c0a0 con 0x562b295fb8c0 2024-09-18T02:04:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.248+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960d840 con 0x562b29600280 2024-09-18T02:04:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.248+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94743377785696] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.248+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.248+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94743377793936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960c0a0 con 0x562b29600280 2024-09-18T02:04:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.248+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960e090 con 0x562b29600280 2024-09-18T02:04:24.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.252+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94743377793936] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.252+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.252+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94743377791664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960e8e0 con 0x562b29600280 2024-09-18T02:04:24.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.252+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960f2a0 con 0x562b29600280 2024-09-18T02:04:24.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94743377800688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960f6c0 con 0x562b29600280 2024-09-18T02:04:24.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 20 add_watcher() i=0 2024-09-18T02:04:24.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 20 add_watcher() i=1 2024-09-18T02:04:24.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 20 add_watcher() i=2 2024-09-18T02:04:24.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 20 add_watcher() i=3 2024-09-18T02:04:24.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 20 add_watcher() i=4 2024-09-18T02:04:24.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 20 add_watcher() i=5 2024-09-18T02:04:24.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94743377791664] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 20 add_watcher() i=6 2024-09-18T02:04:24.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94743377800688] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 20 add_watcher() i=7 2024-09-18T02:04:24.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:24.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b2960e460 con 0x562b295fb8c0 2024-09-18T02:04:24.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94743377801744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960e460 con 0x562b295fb8c0 2024-09-18T02:04:24.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94743377801744] v30'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f78e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:24.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:24.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:24.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.256+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961afb0 con 0x562b295fb8c0 2024-09-18T02:04:24.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.260+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'46 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.260+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961b680 con 0x562b29600280 2024-09-18T02:04:24.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.260+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.260+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961b680 con 0x562b29604bf0 2024-09-18T02:04:24.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.264+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.264+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961bc70 con 0x562b295fb8c0 2024-09-18T02:04:24.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.264+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'141 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.264+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961c120 con 0x7f7a18037040 2024-09-18T02:04:24.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.264+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.264+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b29618e90 con 0x562b29604bf0 2024-09-18T02:04:24.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.264+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.264+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b29618e90 con 0x562b295fb8c0 2024-09-18T02:04:24.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.268+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.268+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cc80 con 0x562b29600280 2024-09-18T02:04:24.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.268+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.268+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cc80 con 0x7f7a18037040 2024-09-18T02:04:24.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.272+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.272+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cc80 con 0x562b29604bf0 2024-09-18T02:04:24.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.272+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.272+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d130 con 0x7f7a18037040 2024-09-18T02:04:24.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.272+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.272+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d130 con 0x562b29600280 2024-09-18T02:04:24.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.276+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.276+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d130 con 0x7f7a18037040 2024-09-18T02:04:24.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.276+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.276+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d130 con 0x562b29600280 2024-09-18T02:04:24.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.280+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'45 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.280+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d130 con 0x562b295fb8c0 2024-09-18T02:04:24.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.280+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'142 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.280+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d130 con 0x562b29604bf0 2024-09-18T02:04:24.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.280+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.280+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d130 con 0x7f7a18037040 2024-09-18T02:04:24.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.284+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'46 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.284+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d130 con 0x562b29604bf0 2024-09-18T02:04:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.284+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.284+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d1c0 con 0x562b295fb8c0 2024-09-18T02:04:24.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.284+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.284+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d1c0 con 0x562b295fb8c0 2024-09-18T02:04:24.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.288+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'143 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.288+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d1c0 con 0x562b29604bf0 2024-09-18T02:04:24.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.288+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.288+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961d270 con 0x7f7a18037040 2024-09-18T02:04:24.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.288+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.288+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cd30 con 0x562b29604bf0 2024-09-18T02:04:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.292+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.292+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cd30 con 0x562b29604bf0 2024-09-18T02:04:24.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.292+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.292+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cde0 con 0x562b29604bf0 2024-09-18T02:04:24.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.292+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.292+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cde0 con 0x562b29604bf0 2024-09-18T02:04:24.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.296+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'38 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.296+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cde0 con 0x562b29600280 2024-09-18T02:04:24.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.296+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.296+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cde0 con 0x562b29604bf0 2024-09-18T02:04:24.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.296+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.296+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cde0 con 0x562b29600280 2024-09-18T02:04:24.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.300+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.300+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cde0 con 0x562b29604bf0 2024-09-18T02:04:24.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.300+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.300+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cde0 con 0x562b29600280 2024-09-18T02:04:24.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.304+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'46 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.304+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2961cde0 con 0x7f7a18037040 2024-09-18T02:04:24.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.304+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f78e67e4640 20 reqs_thread_entry: start 2024-09-18T02:04:24.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:24.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 20 Filter name: none 2024-09-18T02:04:24.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f78df7fe640 20 reqs_thread_entry: start 2024-09-18T02:04:24.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-18T02:04:24.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b29638990 con 0x562b29600280 2024-09-18T02:04:24.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 20 rados_obj.operate() r=0 bl.length=419 2024-09-18T02:04:24.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-18T02:04:24.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T02:04:24.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:24.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b2963ae60 con 0x562b295fb8c0 2024-09-18T02:04:24.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-18T02:04:24.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.308+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b29638e40 con 0x562b29600280 2024-09-18T02:04:24.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a33132980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T02:04:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94743377975712 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b2963b3c0 con 0x562b29604bf0 2024-09-18T02:04:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== watch-notify(notify (1) cookie 94743377775056 notify 128849018891 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562b296194e0 con 0x562b29604bf0 2024-09-18T02:04:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7907fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94743377775056 notifier 4571 bl.length()=170 2024-09-18T02:04:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(97 notify.2 [notify cookie 94743377975712 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7907fff640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f78f4003d70 con 0x562b29604bf0 2024-09-18T02:04:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== watch-notify(notify_complete (2) cookie 94743377975712 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562b29619230 con 0x562b29604bf0 2024-09-18T02:04:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a33132980 10 removing email index: 2024-09-18T02:04:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a33132980 10 removing user buckets index 2024-09-18T02:04:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2963b340 con 0x562b295fb8c0 2024-09-18T02:04:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v30'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a33132980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-18T02:04:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94743377980912 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b2963b340 con 0x562b295fb8c0 2024-09-18T02:04:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== watch-notify(notify (1) cookie 94743377785696 notify 128849018893 ret 0) ==== 217+0+0 (crc 0 0 0) 0x562b2961d750 con 0x562b295fb8c0 2024-09-18T02:04:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7907fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94743377785696 notifier 4571 bl.length()=175 2024-09-18T02:04:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(100 notify.4 [notify cookie 94743377980912 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7907fff640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f78f4003d70 con 0x562b295fb8c0 2024-09-18T02:04:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.312+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== watch-notify(notify_complete (2) cookie 94743377980912 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562b2961a950 con 0x562b295fb8c0 2024-09-18T02:04:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a33132980 10 removing user index: testx$tenanteduser 2024-09-18T02:04:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2963a9b0 con 0x562b29600280 2024-09-18T02:04:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a33132980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-18T02:04:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a33132980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-18T02:04:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94743377980912 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562b29639e50 con 0x7f7a18037040 2024-09-18T02:04:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== watch-notify(notify (1) cookie 94743377786896 notify 128849018893 ret 0) ==== 209+0+0 (crc 0 0 0) 0x562b2961a950 con 0x7f7a18037040 2024-09-18T02:04:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f79077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94743377786896 notifier 4571 bl.length()=167 2024-09-18T02:04:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(103 notify.3 [notify cookie 94743377980912 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f79077fe640 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f78580032d0 con 0x7f7a18037040 2024-09-18T02:04:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== watch-notify(notify_complete (2) cookie 94743377980912 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562b2961b850 con 0x7f7a18037040 2024-09-18T02:04:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f78e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.316+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94743377801744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2963adf0 con 0x562b295fb8c0 2024-09-18T02:04:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.320+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94743377801744] v30'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.320+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94743377777568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2963adf0 con 0x7f7a18037040 2024-09-18T02:04:24.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.320+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94743377777568] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.320+0000 7f7a33132980 20 remove_watcher() i=0 2024-09-18T02:04:24.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.320+0000 7f7a33132980 2 removed watcher, disabling cache 2024-09-18T02:04:24.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.320+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94743377781216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2963adf0 con 0x562b295fb8c0 2024-09-18T02:04:24.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.324+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94743377781216] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.324+0000 7f7a33132980 20 remove_watcher() i=1 2024-09-18T02:04:24.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.324+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94743377775056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b296093a0 con 0x562b29604bf0 2024-09-18T02:04:24.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.328+0000 7f7a30441640 1 -- 172.21.15.167:0/2141050885 <== osd.3 v2:172.21.15.167:6808/2476454287 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94743377775056] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a1800e6c0 con 0x562b29604bf0 2024-09-18T02:04:24.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.328+0000 7f7a33132980 20 remove_watcher() i=2 2024-09-18T02:04:24.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.328+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94743377786896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b296093a0 con 0x7f7a18037040 2024-09-18T02:04:24.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.328+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.2 v2:172.21.15.167:6816/2055439504 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94743377786896] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x7f7a18037040 2024-09-18T02:04:24.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.328+0000 7f7a33132980 20 remove_watcher() i=3 2024-09-18T02:04:24.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.328+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94743377785696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b296093a0 con 0x562b295fb8c0 2024-09-18T02:04:24.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.328+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 <== osd.1 v2:172.21.15.167:6800/15864359 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94743377785696] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a20026040 con 0x562b295fb8c0 2024-09-18T02:04:24.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.328+0000 7f7a33132980 20 remove_watcher() i=4 2024-09-18T02:04:24.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.328+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94743377793936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960b360 con 0x562b29600280 2024-09-18T02:04:24.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.332+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94743377793936] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.332+0000 7f7a33132980 20 remove_watcher() i=5 2024-09-18T02:04:24.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.332+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94743377791664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b296093a0 con 0x562b29600280 2024-09-18T02:04:24.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.332+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94743377791664] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.332+0000 7f7a33132980 20 remove_watcher() i=6 2024-09-18T02:04:24.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.332+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94743377800688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562b2960d390 con 0x562b29600280 2024-09-18T02:04:24.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a30c42640 1 -- 172.21.15.167:0/2141050885 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94743377800688] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a28110030 con 0x562b29600280 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 20 remove_watcher() i=7 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562b29600280 msgr2=0x562b29602670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562b29600280 0x562b29602670 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562b295fb8c0 msgr2=0x562b295fdd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562b295fb8c0 0x562b295fdd80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7a18037040 msgr2=0x7f7a18036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7a18037040 0x7f7a18036410 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562b29604bf0 msgr2=0x562b29607060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562b29604bf0 0x562b29607060 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78fc034650 msgr2=0x7f78fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f78fc034650 0x7f78fc036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x562b295cf5d0 tx=0x7f7a18010000 comp rx=0 tx=0).stop 2024-09-18T02:04:24.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a31443640 1 -- 172.21.15.167:0/2141050885 reap_dead start 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 msgr2=0x562b295f08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295f08e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7a280e1d80 tx=0x7f7a280b3f90 comp rx=0 tx=0).stop 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 shutdown_connections 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/2141050885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295e9640 0x562b295f08e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 >> 172.21.15.167:0/2141050885 conn(0x562b295e5a20 msgr2=0x562b295e3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 shutdown_connections 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/2141050885 wait complete. 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/433892767 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7908034650 msgr2=0x7f7908036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/433892767 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7908034650 0x7f7908036b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x562b29440420 tx=0x7f7a1800f000 comp rx=0 tx=0).stop 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/433892767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295dcca0 msgr2=0x562b295dd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/433892767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295dcca0 0x562b295dd0c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7a280e36a0 tx=0x7f7a280a9690 comp rx=0 tx=0).stop 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/433892767 shutdown_connections 2024-09-18T02:04:24.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/433892767 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7908034650 0x7f7908036b10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/433892767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b295dcca0 0x562b295dd0c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/433892767 >> 172.21.15.167:0/433892767 conn(0x562b295d1df0 msgr2=0x562b295d4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/433892767 shutdown_connections 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/433892767 wait complete. 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562b295c87a0 msgr2=0x562b295cab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562b295c87a0 0x562b295cab90 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562b294caff0 msgr2=0x562b295c60d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562b294caff0 0x562b295c60d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562b295cc670 msgr2=0x562b295cea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562b295cc670 0x562b295cea60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f79180346a0 msgr2=0x7f7918036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f79180346a0 0x7f7918036b60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001da0 tx=0x7f7a18001300 comp rx=0 tx=0).stop 2024-09-18T02:04:24.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 msgr2=0x562b294414e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 --2- 172.21.15.167:0/4256295300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b294ca6a0 0x562b294414e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7a28019680 tx=0x7f7a28019810 comp rx=0 tx=0).stop 2024-09-18T02:04:24.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a31443640 1 -- 172.21.15.167:0/4256295300 reap_dead start 2024-09-18T02:04:24.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 shutdown_connections 2024-09-18T02:04:24.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 >> 172.21.15.167:0/4256295300 conn(0x562b294c61c0 msgr2=0x562b295b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 shutdown_connections 2024-09-18T02:04:24.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.336+0000 7f7a33132980 1 -- 172.21.15.167:0/4256295300 wait complete. 2024-09-18T02:04:24.358 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-18T02:04:24.362 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-18T02:04:24.409 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:24.410 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-18T02:04:24.410 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-18T02:04:24.410 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-18T02:04:24.447 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:24.447 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:24.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.444+0000 7f68cf07f980 1 Processor -- start 2024-09-18T02:04:24.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.444+0000 7f68cf07f980 1 -- start start 2024-09-18T02:04:24.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.444+0000 7f68cf07f980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5604f7440ad0 0x5604f74d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.444+0000 7f68cf07f980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5604f7354ae0 con 0x5604f74d1cc0 2024-09-18T02:04:24.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.444+0000 7f68cf07f980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x5604f7378e30 con 0x5604f7440ad0 2024-09-18T02:04:24.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.444+0000 7f68ccb8f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5604f7440ad0 0x5604f74d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.444+0000 7f68cc38e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5604f74d1cc0 0x5604f74d40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55742/0 (socket says 172.21.15.167:55742) 2024-09-18T02:04:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.444+0000 7f68cc38e640 1 -- 172.21.15.167:0/2901554255 learned_addr learned my addr 172.21.15.167:0/2901554255 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.444+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2901554255 >> v1:172.21.15.81:6789/0 conn(0x5604f74d1cc0 legacy=0x5604f74d40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.444+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2901554255 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f7440eb0 con 0x5604f7440ad0 2024-09-18T02:04:24.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.448+0000 7f68ccb8f640 1 --2- 172.21.15.167:0/2901554255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f74d1780 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00a420 tx=0x7f68bc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23bf7bb351e17a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.448+0000 7f68cbb8d640 1 -- 172.21.15.167:0/2901554255 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc0af070 con 0x5604f7440ad0 2024-09-18T02:04:24.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.448+0000 7f68cbb8d640 1 -- 172.21.15.167:0/2901554255 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc0aa530 con 0x5604f7440ad0 2024-09-18T02:04:24.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.448+0000 7f68cbb8d640 1 -- 172.21.15.167:0/2901554255 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc0aa850 con 0x5604f7440ad0 2024-09-18T02:04:24.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.448+0000 7f68cf07f980 1 -- 172.21.15.167:0/2901554255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 msgr2=0x5604f74d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.448+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2901554255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f74d1780 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00a420 tx=0x7f68bc01afd0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.448+0000 7f68cf07f980 1 -- 172.21.15.167:0/2901554255 shutdown_connections 2024-09-18T02:04:24.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.448+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2901554255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f74d1780 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.448+0000 7f68cf07f980 1 -- 172.21.15.167:0/2901554255 >> 172.21.15.167:0/2901554255 conn(0x5604f74c7070 msgr2=0x5604f74c9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.448+0000 7f68cf07f980 1 -- 172.21.15.167:0/2901554255 shutdown_connections 2024-09-18T02:04:24.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.448+0000 7f68cf07f980 1 -- 172.21.15.167:0/2901554255 wait complete. 2024-09-18T02:04:24.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68cf07f980 1 Processor -- start 2024-09-18T02:04:24.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68cf07f980 1 -- start start 2024-09-18T02:04:24.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68cf07f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f75b9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68cf07f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604f737a200 con 0x5604f7440ad0 2024-09-18T02:04:24.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68ccb8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f75b9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68ccb8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f75b9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58072/0 (socket says 172.21.15.167:58072) 2024-09-18T02:04:24.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68ccb8f640 1 -- 172.21.15.167:0/867553456 learned_addr learned my addr 172.21.15.167:0/867553456 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68ccb8f640 1 -- 172.21.15.167:0/867553456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f75ba270 con 0x5604f7440ad0 2024-09-18T02:04:24.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68ccb8f640 1 --2- 172.21.15.167:0/867553456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f75b9ca0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0ad040 tx=0x7f68bc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e160926790d901bc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f67bae0d640 1 -- 172.21.15.167:0/867553456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc0af040 con 0x5604f7440ad0 2024-09-18T02:04:24.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f67bae0d640 1 -- 172.21.15.167:0/867553456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc0aab50 con 0x5604f7440ad0 2024-09-18T02:04:24.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f67bae0d640 1 -- 172.21.15.167:0/867553456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc0aae50 con 0x5604f7440ad0 2024-09-18T02:04:24.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68cf07f980 1 -- 172.21.15.167:0/867553456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 msgr2=0x5604f75b9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68cf07f980 1 --2- 172.21.15.167:0/867553456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f75b9ca0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0ad040 tx=0x7f68bc0033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68cf07f980 1 -- 172.21.15.167:0/867553456 shutdown_connections 2024-09-18T02:04:24.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68cf07f980 1 --2- 172.21.15.167:0/867553456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f75b9ca0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68cf07f980 1 -- 172.21.15.167:0/867553456 >> 172.21.15.167:0/867553456 conn(0x5604f74c7070 msgr2=0x5604f75b58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68cf07f980 1 -- 172.21.15.167:0/867553456 shutdown_connections 2024-09-18T02:04:24.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.464+0000 7f68cf07f980 1 -- 172.21.15.167:0/867553456 wait complete. 2024-09-18T02:04:24.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cf07f980 1 Processor -- start 2024-09-18T02:04:24.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cf07f980 1 -- start start 2024-09-18T02:04:24.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cf07f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f75c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cf07f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604f74d8260 con 0x5604f7440ad0 2024-09-18T02:04:24.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68ccb8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f75c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68ccb8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f75c0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58088/0 (socket says 172.21.15.167:58088) 2024-09-18T02:04:24.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2905668490 learned_addr learned my addr 172.21.15.167:0/2905668490 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2905668490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f75c1420 con 0x5604f7440ad0 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68ccb8f640 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f75c0ee0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f68bc018c00 tx=0x7f68bc017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f67b960a640 1 -- 172.21.15.167:0/2905668490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc0c5070 con 0x5604f7440ad0 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f67b960a640 1 -- 172.21.15.167:0/2905668490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc0b58b0 con 0x5604f7440ad0 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604f75c16b0 con 0x5604f7440ad0 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f67b960a640 1 -- 172.21.15.167:0/2905668490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc0b5b90 con 0x5604f7440ad0 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604f75c4390 con 0x5604f7440ad0 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f67b960a640 1 -- 172.21.15.167:0/2905668490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f68bc0c8070 con 0x5604f7440ad0 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f67b960a640 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67b4034650 0x7f67b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f67b960a640 1 -- 172.21.15.167:0/2905668490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f68bc0bb070 con 0x5604f7440ad0 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cc38e640 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67b4034650 0x7f67b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604f74d1cc0 0x5604f75c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f75c84c0 con 0x5604f74d1cc0 2024-09-18T02:04:24.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cd390640 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604f74d1cc0 0x5604f75c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cc38e640 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67b4034650 0x7f67b4036b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000f70 tx=0x7f68b40012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.468+0000 7f68cd390640 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604f74d1cc0 0x5604f75c7e70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cd390640 1 -- 172.21.15.167:0/2905668490 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68c40083f0 con 0x5604f74d1cc0 2024-09-18T02:04:24.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f75c5590 con 0x5604f74d1cc0 2024-09-18T02:04:24.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cd390640 1 -- 172.21.15.167:0/2905668490 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68c40083f0 con 0x5604f74d1cc0 2024-09-18T02:04:24.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5604f75ca820 0x5604f75ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f75cd2e0 con 0x5604f75ca820 2024-09-18T02:04:24.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68ccb8f640 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5604f75ca820 0x5604f75ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68ccb8f640 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5604f75ca820 0x5604f75ccc10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2905668490 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f75ca820 2024-09-18T02:04:24.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f75c96c0 con 0x5604f74d1cc0 2024-09-18T02:04:24.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cd390640 1 -- 172.21.15.167:0/2905668490 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68c40083f0 con 0x5604f74d1cc0 2024-09-18T02:04:24.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604f75ce740 0x5604f75d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f75d1230 con 0x5604f75ce740 2024-09-18T02:04:24.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cc38e640 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604f75ce740 0x5604f75d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cc38e640 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604f75ce740 0x5604f75d0b30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cc38e640 1 -- 172.21.15.167:0/2905668490 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f68b400e620 con 0x5604f75ce740 2024-09-18T02:04:24.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cf07f980 1 Processor -- start 2024-09-18T02:04:24.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.472+0000 7f68cf07f980 1 -- start start 2024-09-18T02:04:24.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68cf07f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75ded00 0x5604f75df120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68cf07f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604f73d3800 con 0x5604f75ded00 2024-09-18T02:04:24.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68ccb8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75ded00 0x5604f75df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68ccb8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75ded00 0x5604f75df120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58104/0 (socket says 172.21.15.167:58104) 2024-09-18T02:04:24.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2768468124 learned_addr learned my addr 172.21.15.167:0/2768468124 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2768468124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f75df660 con 0x5604f75ded00 2024-09-18T02:04:24.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68ccb8f640 1 --2- 172.21.15.167:0/2768468124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75ded00 0x5604f75df120 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0e3770 tx=0x7f68bc0d3f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f67b27fc640 1 -- 172.21.15.167:0/2768468124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc0af040 con 0x5604f75ded00 2024-09-18T02:04:24.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68cf07f980 1 -- 172.21.15.167:0/2768468124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604f75df8f0 con 0x5604f75ded00 2024-09-18T02:04:24.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f67b27fc640 1 -- 172.21.15.167:0/2768468124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc0af1e0 con 0x5604f75ded00 2024-09-18T02:04:24.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f67b27fc640 1 -- 172.21.15.167:0/2768468124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc0bf6f0 con 0x5604f75ded00 2024-09-18T02:04:24.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68cf07f980 1 -- 172.21.15.167:0/2768468124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604f75e2570 con 0x5604f75ded00 2024-09-18T02:04:24.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f67b27fc640 1 -- 172.21.15.167:0/2768468124 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f68bc0bf8b0 con 0x5604f75ded00 2024-09-18T02:04:24.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f67b27fc640 1 --2- 172.21.15.167:0/2768468124 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67a4034650 0x7f67a4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f67b27fc640 1 -- 172.21.15.167:0/2768468124 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f68bc0e0030 con 0x5604f75ded00 2024-09-18T02:04:24.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68cc38e640 1 --2- 172.21.15.167:0/2768468124 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67a4034650 0x7f67a4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68cf07f980 1 Processor -- start 2024-09-18T02:04:24.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68cf07f980 1 -- start start 2024-09-18T02:04:24.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68cc38e640 1 --2- 172.21.15.167:0/2768468124 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67a4034650 0x7f67a4036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f68b400bf60 tx=0x7f68b400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68cf07f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75ebaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.476+0000 7f68cf07f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604f75ba530 con 0x5604f75eb6f0 2024-09-18T02:04:24.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68ccb8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75ebaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68ccb8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75ebaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58116/0 (socket says 172.21.15.167:58116) 2024-09-18T02:04:24.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68ccb8f640 1 -- 172.21.15.167:0/3815770548 learned_addr learned my addr 172.21.15.167:0/3815770548 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68ccb8f640 1 -- 172.21.15.167:0/3815770548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f75ec0c0 con 0x5604f75eb6f0 2024-09-18T02:04:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68ccb8f640 1 --2- 172.21.15.167:0/3815770548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75ebaf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0ca5c0 tx=0x7f68bc0e7510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964b346d6d9395dc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f67a3fff640 1 -- 172.21.15.167:0/3815770548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc0bab40 con 0x5604f75eb6f0 2024-09-18T02:04:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f67a3fff640 1 -- 172.21.15.167:0/3815770548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc0bace0 con 0x5604f75eb6f0 2024-09-18T02:04:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f67a3fff640 1 -- 172.21.15.167:0/3815770548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc0cade0 con 0x5604f75eb6f0 2024-09-18T02:04:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 -- 172.21.15.167:0/3815770548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 msgr2=0x5604f75ebaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 --2- 172.21.15.167:0/3815770548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75ebaf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0ca5c0 tx=0x7f68bc0e7510 comp rx=0 tx=0).stop 2024-09-18T02:04:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 -- 172.21.15.167:0/3815770548 shutdown_connections 2024-09-18T02:04:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 --2- 172.21.15.167:0/3815770548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75ebaf0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 -- 172.21.15.167:0/3815770548 >> 172.21.15.167:0/3815770548 conn(0x5604f75e7a80 msgr2=0x5604f75e5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 -- 172.21.15.167:0/3815770548 shutdown_connections 2024-09-18T02:04:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 -- 172.21.15.167:0/3815770548 wait complete. 2024-09-18T02:04:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 Processor -- start 2024-09-18T02:04:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 -- start start 2024-09-18T02:04:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604f75ec610 con 0x5604f75eb6f0 2024-09-18T02:04:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68ccb8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68ccb8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58122/0 (socket says 172.21.15.167:58122) 2024-09-18T02:04:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 learned_addr learned my addr 172.21.15.167:0/2264781879 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f75f2e50 con 0x5604f75eb6f0 2024-09-18T02:04:24.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68ccb8f640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75f2910 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0e4010 tx=0x7f68bc0b2f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f67a27fc640 1 -- 172.21.15.167:0/2264781879 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc10b020 con 0x5604f75eb6f0 2024-09-18T02:04:24.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f67a27fc640 1 -- 172.21.15.167:0/2264781879 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc0a9580 con 0x5604f75eb6f0 2024-09-18T02:04:24.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.480+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604f75f2e50 con 0x5604f75eb6f0 2024-09-18T02:04:24.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f67a27fc640 1 -- 172.21.15.167:0/2264781879 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc103040 con 0x5604f75eb6f0 2024-09-18T02:04:24.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604f75f2e50 con 0x5604f75eb6f0 2024-09-18T02:04:24.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f67a27fc640 1 -- 172.21.15.167:0/2264781879 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f68bc10e020 con 0x5604f75eb6f0 2024-09-18T02:04:24.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f67a27fc640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67980345e0 0x7f6798036aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f67a27fc640 1 -- 172.21.15.167:0/2264781879 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f68bc111ab0 con 0x5604f75eb6f0 2024-09-18T02:04:24.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cc38e640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67980345e0 0x7f6798036aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604f75fda10 0x5604f75ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f7600620 con 0x5604f75fda10 2024-09-18T02:04:24.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cd390640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604f75fda10 0x5604f75ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cc38e640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67980345e0 0x7f6798036aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x5604f75c8dd0 tx=0x7f68b4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cd390640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604f75fda10 0x5604f75ffed0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68c40083f0 con 0x5604f75fda10 2024-09-18T02:04:24.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 20 realm 2024-09-18T02:04:24.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f7600a30 con 0x5604f75fda10 2024-09-18T02:04:24.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68c40083f0 con 0x5604f75fda10 2024-09-18T02:04:24.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:24.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f7601300 con 0x5604f75fda10 2024-09-18T02:04:24.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68c40083f0 con 0x5604f75fda10 2024-09-18T02:04:24.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f75fda10 2024-09-18T02:04:24.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68c40083f0 con 0x5604f75fda10 2024-09-18T02:04:24.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:24.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5604f7602400 0x5604f76047f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f7604e00 con 0x5604f7602400 2024-09-18T02:04:24.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.484+0000 7f68ccb8f640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5604f7602400 0x5604f76047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68ccb8f640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5604f7602400 0x5604f76047f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cf07f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:24.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cf07f980 20 searching for the correct realm 2024-09-18T02:04:24.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604f7606d50 0x5604f7609160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f7609830 con 0x5604f7606d50 2024-09-18T02:04:24.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cc38e640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604f7606d50 0x5604f7609160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cc38e640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604f7606d50 0x5604f7609160 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cc38e640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f68b4037040 0x7f68b4036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f7609830 con 0x7f68b4037040 2024-09-18T02:04:24.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cd390640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f68b4037040 0x7f68b4036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cd390640 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f68b4037040 0x7f68b4036410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c40083f0 con 0x7f68b4037040 2024-09-18T02:04:24.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7602400 2024-09-18T02:04:24.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f75fda10 2024-09-18T02:04:24.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c40083f0 con 0x5604f75fda10 2024-09-18T02:04:24.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f75fda10 2024-09-18T02:04:24.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.488+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7602400 2024-09-18T02:04:24.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7602400 2024-09-18T02:04:24.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x7f68b4037040 2024-09-18T02:04:24.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7606d50 2024-09-18T02:04:24.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f75fda10 2024-09-18T02:04:24.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7602400 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f75fda10 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x7f68b4037040 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7606d50 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7606d50 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.492+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7602400 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7606d50 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7606d50 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f75fda10 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f75fda10 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7602400 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7606d50 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x7f68b4037040 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f75fda10 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7602400 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7606d50 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7602400 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.496+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x7f68b4037040 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7606d50 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f7602400 2024-09-18T02:04:24.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x5604f75fda10 2024-09-18T02:04:24.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604f76016a0 con 0x7f68b4037040 2024-09-18T02:04:24.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:24.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f76056c0 con 0x5604f75fda10 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f76056c0 con 0x5604f75fda10 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f76056c0 con 0x5604f7606d50 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 zone default found 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 4 Realm: () 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 zonegroup default 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f76060e0 con 0x5604f7602400 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f760bb40 con 0x5604f7606d50 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f760bee0 con 0x5604f7606d50 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 started sync module instance, tier type = 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.500+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760af80 con 0x7f68b4037040 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.504+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.504+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94579330167984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760af80 con 0x7f68b4037040 2024-09-18T02:04:24.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.504+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760c730 con 0x5604f75fda10 2024-09-18T02:04:24.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.504+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94579330167984] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.504+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.504+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94579330171792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760af80 con 0x5604f75fda10 2024-09-18T02:04:24.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.504+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760d140 con 0x5604f7606d50 2024-09-18T02:04:24.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.508+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.508+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94579330174096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760d990 con 0x5604f7606d50 2024-09-18T02:04:24.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.508+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760e3b0 con 0x7f68b4037040 2024-09-18T02:04:24.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.508+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94579330171792] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.508+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.508+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94579330178720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760e7a0 con 0x7f68b4037040 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.508+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760f160 con 0x5604f75fda10 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.508+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94579330174096] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.508+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94579330178720] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.512+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.512+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94579330165456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760ecb0 con 0x5604f75fda10 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.512+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760f500 con 0x5604f7602400 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.512+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.512+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94579330182624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760fd50 con 0x5604f7602400 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.512+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f7610710 con 0x5604f7602400 2024-09-18T02:04:24.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.512+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94579330165456] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94579330187872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f7610b30 con 0x5604f7602400 2024-09-18T02:04:24.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f76114f0 con 0x5604f7602400 2024-09-18T02:04:24.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94579330182624] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94579330187872] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94579330185376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f7611040 con 0x5604f7602400 2024-09-18T02:04:24.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68cf07f980 20 add_watcher() i=0 2024-09-18T02:04:24.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68cf07f980 20 add_watcher() i=1 2024-09-18T02:04:24.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68cf07f980 20 add_watcher() i=2 2024-09-18T02:04:24.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68cf07f980 20 add_watcher() i=3 2024-09-18T02:04:24.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68cf07f980 20 add_watcher() i=4 2024-09-18T02:04:24.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68cf07f980 20 add_watcher() i=5 2024-09-18T02:04:24.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.516+0000 7f68cf07f980 20 add_watcher() i=6 2024-09-18T02:04:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.520+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94579330185376] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.520+0000 7f68cf07f980 20 add_watcher() i=7 2024-09-18T02:04:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.520+0000 7f68cf07f980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.520+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f7614520 con 0x5604f75fda10 2024-09-18T02:04:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.520+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.520+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94579330191424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f7611910 con 0x5604f75fda10 2024-09-18T02:04:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.520+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94579330191424] v30'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.520+0000 7f67837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.520+0000 7f68cf07f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.520+0000 7f68cf07f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.520+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761ccd0 con 0x5604f75fda10 2024-09-18T02:04:24.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.524+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'47 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.524+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761d3a0 con 0x5604f7602400 2024-09-18T02:04:24.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.524+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.524+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761d3a0 con 0x5604f7606d50 2024-09-18T02:04:24.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.524+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.524+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761d990 con 0x5604f75fda10 2024-09-18T02:04:24.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.528+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'146 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.528+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761dd70 con 0x7f68b4037040 2024-09-18T02:04:24.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.528+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.528+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761e1f0 con 0x5604f7606d50 2024-09-18T02:04:24.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.528+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'39 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.528+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761e760 con 0x5604f75fda10 2024-09-18T02:04:24.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.532+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.532+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761eb20 con 0x5604f7602400 2024-09-18T02:04:24.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.532+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.532+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761eb20 con 0x7f68b4037040 2024-09-18T02:04:24.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.536+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.536+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761eb20 con 0x5604f7606d50 2024-09-18T02:04:24.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.536+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.536+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761eb20 con 0x7f68b4037040 2024-09-18T02:04:24.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.536+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.536+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761eb20 con 0x5604f7602400 2024-09-18T02:04:24.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.540+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.540+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761ebb0 con 0x7f68b4037040 2024-09-18T02:04:24.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.540+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.540+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761ebb0 con 0x5604f7602400 2024-09-18T02:04:24.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.540+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'47 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.540+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761ebb0 con 0x5604f75fda10 2024-09-18T02:04:24.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.544+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'147 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.544+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761ebb0 con 0x5604f7606d50 2024-09-18T02:04:24.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.544+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.544+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761ec40 con 0x7f68b4037040 2024-09-18T02:04:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.544+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'49 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.544+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761ec40 con 0x5604f7606d50 2024-09-18T02:04:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.548+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.548+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761ec40 con 0x5604f75fda10 2024-09-18T02:04:24.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.548+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.548+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f350 con 0x5604f75fda10 2024-09-18T02:04:24.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.548+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'148 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.548+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f330 con 0x5604f7606d50 2024-09-18T02:04:24.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.552+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.552+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f330 con 0x7f68b4037040 2024-09-18T02:04:24.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.552+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.552+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f160 con 0x5604f7606d50 2024-09-18T02:04:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.552+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.552+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f160 con 0x5604f7606d50 2024-09-18T02:04:24.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.556+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.556+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f160 con 0x5604f7606d50 2024-09-18T02:04:24.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.556+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.556+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f160 con 0x5604f7606d50 2024-09-18T02:04:24.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.556+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'40 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.556+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f160 con 0x5604f7602400 2024-09-18T02:04:24.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.560+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.560+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f160 con 0x5604f7606d50 2024-09-18T02:04:24.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.560+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.560+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f160 con 0x5604f7602400 2024-09-18T02:04:24.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.564+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.564+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f160 con 0x5604f7606d50 2024-09-18T02:04:24.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.564+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.564+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f160 con 0x5604f7602400 2024-09-18T02:04:24.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'48 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f761f160 con 0x7f68b4037040 2024-09-18T02:04:24.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f67827e4640 20 reqs_thread_entry: start 2024-09-18T02:04:24.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 20 Filter name: none 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f677b7fe640 20 reqs_thread_entry: start 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f761b0b0 con 0x7f68b4037040 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 : miss 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:95 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f763bd60 con 0x5604f7606d50 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(95 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 20 get_obj_state: octx=0x7f68c4008c70 obj=myfoo:four state=0x5604f763cb18 s->prefetch_data=0 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:96 3.e 3:70f724c5:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604f763dbb0 con 0x7f68b4037040 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(96 c5231f36-c36e-44d5-8268-aaf52617db58.4235.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 10 manifest: total_size = 4 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 20 get_obj_state: setting s->obj_tag to c5231f36-c36e-44d5-8268-aaf52617db58.4235.14551730313965696151 2024-09-18T02:04:24.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 20 get_obj_state: octx=0x7f68c4008c70 obj=myfoo:four state=0x5604f763cb18 s->prefetch_data=0 2024-09-18T02:04:24.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 20 prepare_atomic_modification: state is not atomic. state=0x5604f763cb18 2024-09-18T02:04:24.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 20 bucket index object: :.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6 2024-09-18T02:04:24.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.568+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:97 4.16 4:680d0d24:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f7642570 con 0x5604f7606d50 2024-09-18T02:04:24.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.572+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(97 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6 [stat,call,call] v30'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.572+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:98 3.e 3:70f724c5:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f7642570 con 0x7f68b4037040 2024-09-18T02:04:24.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.572+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(98 c5231f36-c36e-44d5-8268-aaf52617db58.4235.1_four [call] v30'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.572+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:99 4.16 4:680d0d24:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f7643000 con 0x5604f7606d50 2024-09-18T02:04:24.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.576+0000 7f67837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:24.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.576+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94579330191424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f7643000 con 0x5604f75fda10 2024-09-18T02:04:24.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.576+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(99 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6 [stat,call,call] v30'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.576+0000 7f67a3fff640 20 handle_completion(): completion ok for obj=four 2024-09-18T02:04:24.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.576+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94579330191424] v30'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.576+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94579330167984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f75fb130 con 0x7f68b4037040 2024-09-18T02:04:24.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.576+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94579330167984] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.576+0000 7f68cf07f980 20 remove_watcher() i=0 2024-09-18T02:04:24.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.576+0000 7f68cf07f980 2 removed watcher, disabling cache 2024-09-18T02:04:24.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.576+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94579330171792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760b4b0 con 0x5604f75fda10 2024-09-18T02:04:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.580+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94579330171792] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.580+0000 7f68cf07f980 20 remove_watcher() i=1 2024-09-18T02:04:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.580+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94579330174096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760b4b0 con 0x5604f7606d50 2024-09-18T02:04:24.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.580+0000 7f68cc38e640 1 -- 172.21.15.167:0/2264781879 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94579330174096] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b400e620 con 0x5604f7606d50 2024-09-18T02:04:24.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.580+0000 7f68cf07f980 20 remove_watcher() i=2 2024-09-18T02:04:24.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.580+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94579330178720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760cc90 con 0x7f68b4037040 2024-09-18T02:04:24.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.580+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94579330178720] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x7f68b4037040 2024-09-18T02:04:24.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.580+0000 7f68cf07f980 20 remove_watcher() i=3 2024-09-18T02:04:24.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.584+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94579330165456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760b4b0 con 0x5604f75fda10 2024-09-18T02:04:24.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.584+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94579330165456] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c4026040 con 0x5604f75fda10 2024-09-18T02:04:24.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.584+0000 7f68cf07f980 20 remove_watcher() i=4 2024-09-18T02:04:24.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.584+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94579330182624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760cc90 con 0x5604f7602400 2024-09-18T02:04:24.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.584+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94579330182624] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.584+0000 7f68cf07f980 20 remove_watcher() i=5 2024-09-18T02:04:24.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.584+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94579330187872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760aad0 con 0x5604f7602400 2024-09-18T02:04:24.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.588+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94579330187872] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.588+0000 7f68cf07f980 20 remove_watcher() i=6 2024-09-18T02:04:24.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.588+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94579330185376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604f760b4b0 con 0x5604f7602400 2024-09-18T02:04:24.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68ccb8f640 1 -- 172.21.15.167:0/2264781879 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94579330185376] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc0c7030 con 0x5604f7602400 2024-09-18T02:04:24.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 20 remove_watcher() i=7 2024-09-18T02:04:24.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5604f7602400 msgr2=0x5604f76047f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5604f7602400 0x5604f76047f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604f75fda10 msgr2=0x5604f75ffed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604f75fda10 0x5604f75ffed0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f68b4037040 msgr2=0x7f68b4036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f68b4037040 0x7f68b4036410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604f7606d50 msgr2=0x5604f7609160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604f7606d50 0x5604f7609160 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67980345e0 msgr2=0x7f6798036aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67980345e0 0x7f6798036aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x5604f75c8dd0 tx=0x7f68b4010000 comp rx=0 tx=0).stop 2024-09-18T02:04:24.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 msgr2=0x5604f75f2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cd390640 1 -- 172.21.15.167:0/2264781879 reap_dead start 2024-09-18T02:04:24.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75f2910 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0e4010 tx=0x7f68bc0b2f20 comp rx=0 tx=0).stop 2024-09-18T02:04:24.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 shutdown_connections 2024-09-18T02:04:24.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2264781879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75eb6f0 0x5604f75f2910 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 >> 172.21.15.167:0/2264781879 conn(0x5604f75e7a80 msgr2=0x5604f75e5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 shutdown_connections 2024-09-18T02:04:24.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2264781879 wait complete. 2024-09-18T02:04:24.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2768468124 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67a4034650 msgr2=0x7f67a4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2768468124 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67a4034650 0x7f67a4036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f68b400bf60 tx=0x7f68b400f000 comp rx=0 tx=0).stop 2024-09-18T02:04:24.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2768468124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75ded00 msgr2=0x5604f75df120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2768468124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75ded00 0x5604f75df120 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0e3770 tx=0x7f68bc0d3f90 comp rx=0 tx=0).stop 2024-09-18T02:04:24.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2768468124 shutdown_connections 2024-09-18T02:04:24.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2768468124 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67a4034650 0x7f67a4036b10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2768468124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f75ded00 0x5604f75df120 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2768468124 >> 172.21.15.167:0/2768468124 conn(0x5604f75d3e50 msgr2=0x5604f75d68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2768468124 shutdown_connections 2024-09-18T02:04:24.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2768468124 wait complete. 2024-09-18T02:04:24.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5604f75ca820 msgr2=0x5604f75ccc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5604f75ca820 0x5604f75ccc10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604f74d1cc0 msgr2=0x5604f75c7e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604f74d1cc0 0x5604f75c7e70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604f75ce740 msgr2=0x5604f75d0b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604f75ce740 0x5604f75d0b30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67b4034650 msgr2=0x7f67b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f67b4034650 0x7f67b4036b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000f70 tx=0x7f68b40012c0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 msgr2=0x5604f75c0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 --2- 172.21.15.167:0/2905668490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604f7440ad0 0x5604f75c0ee0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f68bc018c00 tx=0x7f68bc017d70 comp rx=0 tx=0).stop 2024-09-18T02:04:24.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cd390640 1 -- 172.21.15.167:0/2905668490 reap_dead start 2024-09-18T02:04:24.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 shutdown_connections 2024-09-18T02:04:24.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 >> 172.21.15.167:0/2905668490 conn(0x5604f74c7070 msgr2=0x5604f75b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 shutdown_connections 2024-09-18T02:04:24.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.592+0000 7f68cf07f980 1 -- 172.21.15.167:0/2905668490 wait complete. 2024-09-18T02:04:24.604 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T02:04:24.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T02:04:24.604 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-18T02:04:24.681 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:24.682 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:24.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.680+0000 7fa3e09be980 1 Processor -- start 2024-09-18T02:04:24.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.680+0000 7fa3e09be980 1 -- start start 2024-09-18T02:04:24.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.680+0000 7fa3e09be980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x556554c9f7c0 0x556554c9e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.680+0000 7fa3e09be980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556554bb0ae0 con 0x556554c9f3b0 2024-09-18T02:04:24.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.680+0000 7fa3e09be980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x556554bd4e30 con 0x556554c9f7c0 2024-09-18T02:04:24.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.680+0000 7fa3ddccd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x556554c9f7c0 0x556554c9e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.680+0000 7fa3de4ce640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x556554c9f3b0 0x556554c9db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55754/0 (socket says 172.21.15.167:55754) 2024-09-18T02:04:24.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.680+0000 7fa3ddccd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x556554c9f7c0 0x556554c9e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58124/0 (socket says 172.21.15.167:58124) 2024-09-18T02:04:24.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.680+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3411428215 learned_addr learned my addr 172.21.15.167:0/3411428215 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:24.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.680+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3411428215 >> v1:172.21.15.81:6789/0 conn(0x556554c9f3b0 legacy=0x556554c9db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.680+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3411428215 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556554c9e8e0 con 0x556554c9f7c0 2024-09-18T02:04:24.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.684+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/3411428215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f7c0 0x556554c9e280 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400a480 tx=0x7fa3d401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce35ce33244b754 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.684+0000 7fa3dd4cc640 1 -- 172.21.15.167:0/3411428215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d40b0070 con 0x556554c9f7c0 2024-09-18T02:04:24.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.684+0000 7fa3dd4cc640 1 -- 172.21.15.167:0/3411428215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d40ab540 con 0x556554c9f7c0 2024-09-18T02:04:24.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.684+0000 7fa3dd4cc640 1 -- 172.21.15.167:0/3411428215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d40ab840 con 0x556554c9f7c0 2024-09-18T02:04:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.684+0000 7fa3e09be980 1 -- 172.21.15.167:0/3411428215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f7c0 msgr2=0x556554c9e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.684+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3411428215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f7c0 0x556554c9e280 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400a480 tx=0x7fa3d401b280 comp rx=0 tx=0).stop 2024-09-18T02:04:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.684+0000 7fa3e09be980 1 -- 172.21.15.167:0/3411428215 shutdown_connections 2024-09-18T02:04:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.684+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3411428215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f7c0 0x556554c9e280 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.684+0000 7fa3e09be980 1 -- 172.21.15.167:0/3411428215 >> 172.21.15.167:0/3411428215 conn(0x556554d241b0 msgr2=0x556554d265d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.684+0000 7fa3e09be980 1 -- 172.21.15.167:0/3411428215 shutdown_connections 2024-09-18T02:04:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.684+0000 7fa3e09be980 1 -- 172.21.15.167:0/3411428215 wait complete. 2024-09-18T02:04:24.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.696+0000 7fa3e09be980 1 Processor -- start 2024-09-18T02:04:24.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.696+0000 7fa3e09be980 1 -- start start 2024-09-18T02:04:24.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.696+0000 7fa3e09be980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 0x556554e15c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.696+0000 7fa3e09be980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556554bd6200 con 0x556554c9f3b0 2024-09-18T02:04:24.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3de4ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 0x556554e15c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3de4ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 0x556554e15c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58126/0 (socket says 172.21.15.167:58126) 2024-09-18T02:04:24.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3de4ce640 1 -- 172.21.15.167:0/539157615 learned_addr learned my addr 172.21.15.167:0/539157615 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3de4ce640 1 -- 172.21.15.167:0/539157615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556554e161e0 con 0x556554c9f3b0 2024-09-18T02:04:24.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3de4ce640 1 --2- 172.21.15.167:0/539157615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 0x556554e15c10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0001e20 tx=0x7fa3d000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d855dd02f8edda43 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa2cc608640 1 -- 172.21.15.167:0/539157615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d0012020 con 0x556554c9f3b0 2024-09-18T02:04:24.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa2cc608640 1 -- 172.21.15.167:0/539157615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d000e7c0 con 0x556554c9f3b0 2024-09-18T02:04:24.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa2cc608640 1 -- 172.21.15.167:0/539157615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d000eb00 con 0x556554c9f3b0 2024-09-18T02:04:24.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3e09be980 1 -- 172.21.15.167:0/539157615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 msgr2=0x556554e15c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3e09be980 1 --2- 172.21.15.167:0/539157615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 0x556554e15c10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0001e20 tx=0x7fa3d000b790 comp rx=0 tx=0).stop 2024-09-18T02:04:24.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3e09be980 1 -- 172.21.15.167:0/539157615 shutdown_connections 2024-09-18T02:04:24.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3e09be980 1 --2- 172.21.15.167:0/539157615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 0x556554e15c10 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3e09be980 1 -- 172.21.15.167:0/539157615 >> 172.21.15.167:0/539157615 conn(0x556554d241b0 msgr2=0x556554e11840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3e09be980 1 -- 172.21.15.167:0/539157615 shutdown_connections 2024-09-18T02:04:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3e09be980 1 -- 172.21.15.167:0/539157615 wait complete. 2024-09-18T02:04:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3e09be980 1 Processor -- start 2024-09-18T02:04:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3e09be980 1 -- start start 2024-09-18T02:04:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3e09be980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 0x556554e1cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3e09be980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556554d34200 con 0x556554c9f3b0 2024-09-18T02:04:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3de4ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 0x556554e1cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3de4ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 0x556554e1cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58128/0 (socket says 172.21.15.167:58128) 2024-09-18T02:04:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.700+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3522679270 learned_addr learned my addr 172.21.15.167:0/3522679270 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3522679270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556554e1d4a0 con 0x556554c9f3b0 2024-09-18T02:04:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3de4ce640 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 0x556554e1cf60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0001e20 tx=0x7fa3d0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa2cae05640 1 -- 172.21.15.167:0/3522679270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d0012030 con 0x556554c9f3b0 2024-09-18T02:04:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556554e1d730 con 0x556554c9f3b0 2024-09-18T02:04:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa2cae05640 1 -- 172.21.15.167:0/3522679270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d0001480 con 0x556554c9f3b0 2024-09-18T02:04:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa2cae05640 1 -- 172.21.15.167:0/3522679270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d001a910 con 0x556554c9f3b0 2024-09-18T02:04:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556554e20410 con 0x556554c9f3b0 2024-09-18T02:04:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa2cae05640 1 -- 172.21.15.167:0/3522679270 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa3d0015020 con 0x556554c9f3b0 2024-09-18T02:04:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa2cae05640 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2c4034650 0x7fa2c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa2cae05640 1 -- 172.21.15.167:0/3522679270 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa3d0020030 con 0x556554c9f3b0 2024-09-18T02:04:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2c4034650 0x7fa2c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556554c9f7c0 0x556554e23f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e245a0 con 0x556554c9f7c0 2024-09-18T02:04:24.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3deccf640 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556554c9f7c0 0x556554e23f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2c4034650 0x7fa2c4036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40ad000 tx=0x7fa3d40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3deccf640 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556554c9f7c0 0x556554e23f30 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3deccf640 1 -- 172.21.15.167:0/3522679270 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554c9f7c0 2024-09-18T02:04:24.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e21630 con 0x556554c9f7c0 2024-09-18T02:04:24.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3deccf640 1 -- 172.21.15.167:0/3522679270 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554c9f7c0 2024-09-18T02:04:24.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556554e268f0 0x556554e28ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e293d0 con 0x556554e268f0 2024-09-18T02:04:24.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.704+0000 7fa3de4ce640 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556554e268f0 0x556554e28ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3de4ce640 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556554e268f0 0x556554e28ce0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3522679270 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa3d0008030 con 0x556554e268f0 2024-09-18T02:04:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e25790 con 0x556554c9f7c0 2024-09-18T02:04:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3deccf640 1 -- 172.21.15.167:0/3522679270 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554c9f7c0 2024-09-18T02:04:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556554e2a830 0x556554e2cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e2d360 con 0x556554e2a830 2024-09-18T02:04:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556554e2a830 0x556554e2cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556554e2a830 0x556554e2cc20 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3522679270 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa3d40b3040 con 0x556554e2a830 2024-09-18T02:04:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3e09be980 1 Processor -- start 2024-09-18T02:04:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3e09be980 1 -- start start 2024-09-18T02:04:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3e09be980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e3ae30 0x556554e3b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3e09be980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556554c2f800 con 0x556554e3ae30 2024-09-18T02:04:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3de4ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e3ae30 0x556554e3b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3de4ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e3ae30 0x556554e3b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58142/0 (socket says 172.21.15.167:58142) 2024-09-18T02:04:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3de4ce640 1 -- 172.21.15.167:0/996506759 learned_addr learned my addr 172.21.15.167:0/996506759 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3de4ce640 1 -- 172.21.15.167:0/996506759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556554e3b790 con 0x556554e3ae30 2024-09-18T02:04:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.708+0000 7fa3de4ce640 1 --2- 172.21.15.167:0/996506759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e3ae30 0x556554e3b250 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0000fe0 tx=0x7fa3d001ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa2c3fff640 1 -- 172.21.15.167:0/996506759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d0041e80 con 0x556554e3ae30 2024-09-18T02:04:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3e09be980 1 -- 172.21.15.167:0/996506759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556554e3ba20 con 0x556554e3ae30 2024-09-18T02:04:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3e09be980 1 -- 172.21.15.167:0/996506759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556554e3ba20 con 0x556554e3ae30 2024-09-18T02:04:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa2c3fff640 1 -- 172.21.15.167:0/996506759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d0042020 con 0x556554e3ae30 2024-09-18T02:04:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa2c3fff640 1 -- 172.21.15.167:0/996506759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d0024550 con 0x556554e3ae30 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa2c3fff640 1 -- 172.21.15.167:0/996506759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa3d0009070 con 0x556554e3ae30 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa2c3fff640 1 --2- 172.21.15.167:0/996506759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2b8034650 0x7fa2b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa2c3fff640 1 -- 172.21.15.167:0/996506759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa3d0005050 con 0x556554e3ae30 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/996506759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2b8034650 0x7fa2b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3e09be980 1 Processor -- start 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3e09be980 1 -- start start 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/996506759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2b8034650 0x7fa2b8036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x556554e24a70 tx=0x7fa3d4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3e09be980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e47a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3e09be980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556554e16560 con 0x556554e47650 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3de4ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e47a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3de4ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e47a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58148/0 (socket says 172.21.15.167:58148) 2024-09-18T02:04:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3de4ce640 1 -- 172.21.15.167:0/793803373 learned_addr learned my addr 172.21.15.167:0/793803373 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3de4ce640 1 -- 172.21.15.167:0/793803373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556554e48020 con 0x556554e47650 2024-09-18T02:04:24.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3de4ce640 1 --2- 172.21.15.167:0/793803373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e47a50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0042230 tx=0x7fa3d00165b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405d0c8938510338 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa2c1ffb640 1 -- 172.21.15.167:0/793803373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d0064070 con 0x556554e47650 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa2c1ffb640 1 -- 172.21.15.167:0/793803373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d00489f0 con 0x556554e47650 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa2c1ffb640 1 -- 172.21.15.167:0/793803373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d0016930 con 0x556554e47650 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3e09be980 1 -- 172.21.15.167:0/793803373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 msgr2=0x556554e47a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.712+0000 7fa3e09be980 1 --2- 172.21.15.167:0/793803373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e47a50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0042230 tx=0x7fa3d00165b0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 -- 172.21.15.167:0/793803373 shutdown_connections 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 --2- 172.21.15.167:0/793803373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e47a50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 -- 172.21.15.167:0/793803373 >> 172.21.15.167:0/793803373 conn(0x556554e439d0 msgr2=0x556554e41ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 -- 172.21.15.167:0/793803373 shutdown_connections 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 -- 172.21.15.167:0/793803373 wait complete. 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 Processor -- start 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 -- start start 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e4e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556554e483e0 con 0x556554e47650 2024-09-18T02:04:24.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3de4ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e4e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3de4ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e4e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58154/0 (socket says 172.21.15.167:58154) 2024-09-18T02:04:24.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 learned_addr learned my addr 172.21.15.167:0/3944271690 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556554e4ecc0 con 0x556554e47650 2024-09-18T02:04:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3de4ce640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e4e780 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0042230 tx=0x7fa3d0042fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa2affff640 1 -- 172.21.15.167:0/3944271690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d006d070 con 0x556554e47650 2024-09-18T02:04:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa2affff640 1 -- 172.21.15.167:0/3944271690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d00300c0 con 0x556554e47650 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556554e4ecc0 con 0x556554e47650 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa2affff640 1 -- 172.21.15.167:0/3944271690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d0064040 con 0x556554e47650 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556554e4f130 con 0x556554e47650 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa2affff640 1 -- 172.21.15.167:0/3944271690 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa3d0070070 con 0x556554e47650 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa2affff640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2a8034650 0x7fa2a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa2affff640 1 -- 172.21.15.167:0/3944271690 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa3d005c070 con 0x556554e47650 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2a8034650 0x7fa2a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556554e59890 0x556554e5bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e5c4a0 con 0x556554e59890 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.716+0000 7fa3deccf640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556554e59890 0x556554e5bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2a8034650 0x7fa2a8036b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400a480 tx=0x7fa3d40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3deccf640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556554e59890 0x556554e5bd50 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 20 realm 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e5c8b0 con 0x556554e59890 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d150 con 0x556554e59890 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e59890 2024-09-18T02:04:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556554e5e250 0x556554e60640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e60bc0 con 0x556554e5e250 2024-09-18T02:04:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3de4ce640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556554e5e250 0x556554e60640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3de4ce640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556554e5e250 0x556554e60640 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 20 searching for the correct realm 2024-09-18T02:04:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556554e62b30 0x556554e64ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e656c0 con 0x556554e62b30 2024-09-18T02:04:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556554e62b30 0x556554e64ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556554e62b30 0x556554e64ff0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3ddccd640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa3d40cd040 0x7fa3d40ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e656c0 con 0x7fa3d40cd040 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3deccf640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa3d40cd040 0x7fa3d40ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.720+0000 7fa3deccf640 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa3d40cd040 0x7fa3d40ce430 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e5e250 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e59890 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e59890 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e5e250 2024-09-18T02:04:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e5e250 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x7fa3d40cd040 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e62b30 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e59890 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e5e250 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.724+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e59890 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x7fa3d40cd040 2024-09-18T02:04:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e62b30 2024-09-18T02:04:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e62b30 2024-09-18T02:04:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e5e250 2024-09-18T02:04:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e62b30 2024-09-18T02:04:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e62b30 2024-09-18T02:04:24.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e59890 2024-09-18T02:04:24.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e59890 2024-09-18T02:04:24.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e5e250 2024-09-18T02:04:24.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e62b30 2024-09-18T02:04:24.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x7fa3d40cd040 2024-09-18T02:04:24.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e59890 2024-09-18T02:04:24.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.728+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e5e250 2024-09-18T02:04:24.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e62b30 2024-09-18T02:04:24.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e5e250 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x7fa3d40cd040 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e62b30 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e5e250 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x556554e59890 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556554e5d4f0 con 0x7fa3d40cd040 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:24.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e61410 con 0x556554e59890 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e61410 con 0x556554e59890 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.732+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e61410 con 0x556554e62b30 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 20 zone default found 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 4 Realm: () 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 20 zonegroup default 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e61cb0 con 0x556554e5e250 2024-09-18T02:04:24.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e67520 con 0x556554e62b30 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e678c0 con 0x556554e62b30 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 20 started sync module instance, tier type = 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e669c0 con 0x7fa3d40cd040 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93893704445680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e669c0 con 0x7fa3d40cd040 2024-09-18T02:04:24.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e68280 con 0x556554e59890 2024-09-18T02:04:24.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.736+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93893704445680] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.740+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.740+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93893704449760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e669c0 con 0x556554e59890 2024-09-18T02:04:24.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.740+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e68c90 con 0x556554e62b30 2024-09-18T02:04:24.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.740+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93893704449760] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.740+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.740+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93893704443152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e66930 con 0x556554e62b30 2024-09-18T02:04:24.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.740+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e69990 con 0x7fa3d40cd040 2024-09-18T02:04:24.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.744+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.744+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93893704455696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e6a230 con 0x7fa3d40cd040 2024-09-18T02:04:24.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.744+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e6ac30 con 0x556554e59890 2024-09-18T02:04:24.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.744+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93893704455696] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.744+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93893704443152] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.744+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.744+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93893704454192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e69d10 con 0x556554e59890 2024-09-18T02:04:24.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.744+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e6b4d0 con 0x556554e5e250 2024-09-18T02:04:24.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.744+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93893704454192] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.748+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.748+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93893704462368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e69d10 con 0x556554e5e250 2024-09-18T02:04:24.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.748+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e6bd20 con 0x556554e5e250 2024-09-18T02:04:24.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.748+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93893704462368] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.748+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.748+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93893704464496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e6c140 con 0x556554e5e250 2024-09-18T02:04:24.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.748+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e6cb00 con 0x556554e5e250 2024-09-18T02:04:24.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93893704468048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e6cf20 con 0x556554e5e250 2024-09-18T02:04:24.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 20 add_watcher() i=0 2024-09-18T02:04:24.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 20 add_watcher() i=1 2024-09-18T02:04:24.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 20 add_watcher() i=2 2024-09-18T02:04:24.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 20 add_watcher() i=3 2024-09-18T02:04:24.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 20 add_watcher() i=4 2024-09-18T02:04:24.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 20 add_watcher() i=5 2024-09-18T02:04:24.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93893704464496] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 20 add_watcher() i=6 2024-09-18T02:04:24.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93893704468048] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 20 add_watcher() i=7 2024-09-18T02:04:24.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:24.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e6cf20 con 0x556554e59890 2024-09-18T02:04:24.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.752+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93893704469104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e6ce90 con 0x556554e59890 2024-09-18T02:04:24.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93893704469104] v30'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa294fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:24.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:24.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:24.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 5 note: GC not initialized 2024-09-18T02:04:24.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa20f7fe640 20 reqs_thread_entry: start 2024-09-18T02:04:24.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:24.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 Filter name: none 2024-09-18T02:04:24.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa20d7fa640 20 reqs_thread_entry: start 2024-09-18T02:04:24.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e936b0 con 0x7fa3d40cd040 2024-09-18T02:04:24.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:24.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:63 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e93f40 con 0x556554e62b30 2024-09-18T02:04:24.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(63 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:24.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T02:04:24.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e95550 con 0x7fa3d40cd040 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:65 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e95550 con 0x556554e62b30 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(65 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:66 4.24 4:2438aa61:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e94ec0 con 0x556554e5e250 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 4.29 4:9642b720:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e9a0b0 con 0x556554e62b30 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 4.f 4:f090116b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e94ec0 con 0x556554e59890 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 4.29 4:949287a7:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e9f100 con 0x556554e62b30 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:70 4.5 4:a2069307:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554ea1c00 con 0x556554e62b30 2024-09-18T02:04:24.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 4.2d 4:b5ed9a3b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554e9f100 con 0x556554e5e250 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:72 4.16 4:680d0d24:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554ea6b80 con 0x556554e62b30 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:73 4.9 4:9363ad15:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554ea95b0 con 0x556554e59890 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 4.24 4:24630749:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554ea95f0 con 0x556554e5e250 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 4.3 4:c118e1af:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554eae9e0 con 0x556554e59890 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 4.36 4:6d2a8929:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556554eaea20 con 0x556554e59890 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(67 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(70 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(69 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(72 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(68 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(75 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(73 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.756+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(76 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.760+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(66 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.760+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(71 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.760+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(74 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.1.8 [call out=124b] v0'0 uv12 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.760+0000 7fa294fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.760+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93893704469104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e83e10 con 0x556554e59890 2024-09-18T02:04:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.760+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93893704469104] v30'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.760+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93893704445680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e83e10 con 0x7fa3d40cd040 2024-09-18T02:04:24.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.760+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93893704445680] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.760+0000 7fa3e09be980 20 remove_watcher() i=0 2024-09-18T02:04:24.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.760+0000 7fa3e09be980 2 removed watcher, disabling cache 2024-09-18T02:04:24.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.760+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93893704449760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e83e10 con 0x556554e59890 2024-09-18T02:04:24.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.764+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93893704449760] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.764+0000 7fa3e09be980 20 remove_watcher() i=1 2024-09-18T02:04:24.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.764+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93893704443152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e83e10 con 0x556554e62b30 2024-09-18T02:04:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.764+0000 7fa3ddccd640 1 -- 172.21.15.167:0/3944271690 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93893704443152] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d40d8070 con 0x556554e62b30 2024-09-18T02:04:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.764+0000 7fa3e09be980 20 remove_watcher() i=2 2024-09-18T02:04:24.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.764+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93893704455696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e83e10 con 0x7fa3d40cd040 2024-09-18T02:04:24.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.768+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93893704455696] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x7fa3d40cd040 2024-09-18T02:04:24.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.768+0000 7fa3e09be980 20 remove_watcher() i=3 2024-09-18T02:04:24.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.768+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93893704454192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e83e10 con 0x556554e59890 2024-09-18T02:04:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.768+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93893704454192] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d800a4d0 con 0x556554e59890 2024-09-18T02:04:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.768+0000 7fa3e09be980 20 remove_watcher() i=4 2024-09-18T02:04:24.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.768+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93893704462368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e83e10 con 0x556554e5e250 2024-09-18T02:04:24.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.772+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93893704462368] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.772+0000 7fa3e09be980 20 remove_watcher() i=5 2024-09-18T02:04:24.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.772+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93893704464496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e83e10 con 0x556554e5e250 2024-09-18T02:04:24.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.772+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93893704464496] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.772+0000 7fa3e09be980 20 remove_watcher() i=6 2024-09-18T02:04:24.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.772+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93893704468048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556554e83e10 con 0x556554e5e250 2024-09-18T02:04:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3de4ce640 1 -- 172.21.15.167:0/3944271690 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93893704468048] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d006f030 con 0x556554e5e250 2024-09-18T02:04:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 20 remove_watcher() i=7 2024-09-18T02:04:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556554e5e250 msgr2=0x556554e60640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556554e5e250 0x556554e60640 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556554e59890 msgr2=0x556554e5bd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556554e59890 0x556554e5bd50 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa3d40cd040 msgr2=0x7fa3d40ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa3d40cd040 0x7fa3d40ce430 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556554e62b30 msgr2=0x556554e64ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556554e62b30 0x556554e64ff0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2a8034650 msgr2=0x7fa2a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2a8034650 0x7fa2a8036b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400a480 tx=0x7fa3d40a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 msgr2=0x556554e4e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3deccf640 1 -- 172.21.15.167:0/3944271690 reap_dead start 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e4e780 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0042230 tx=0x7fa3d0042fa0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 shutdown_connections 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3944271690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e47650 0x556554e4e780 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 >> 172.21.15.167:0/3944271690 conn(0x556554e439d0 msgr2=0x556554e41aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 shutdown_connections 2024-09-18T02:04:24.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3944271690 wait complete. 2024-09-18T02:04:24.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/996506759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2b8034650 msgr2=0x7fa2b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/996506759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2b8034650 0x7fa2b8036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x556554e24a70 tx=0x7fa3d4005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:24.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/996506759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e3ae30 msgr2=0x556554e3b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/996506759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e3ae30 0x556554e3b250 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0000fe0 tx=0x7fa3d001ae80 comp rx=0 tx=0).stop 2024-09-18T02:04:24.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/996506759 shutdown_connections 2024-09-18T02:04:24.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/996506759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2b8034650 0x7fa2b8036b10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/996506759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554e3ae30 0x556554e3b250 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/996506759 >> 172.21.15.167:0/996506759 conn(0x556554e2ff80 msgr2=0x556554e32a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/996506759 shutdown_connections 2024-09-18T02:04:24.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/996506759 wait complete. 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556554e268f0 msgr2=0x556554e28ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556554e268f0 0x556554e28ce0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556554c9f7c0 msgr2=0x556554e23f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556554c9f7c0 0x556554e23f30 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556554e2a830 msgr2=0x556554e2cc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556554e2a830 0x556554e2cc20 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2c4034650 msgr2=0x7fa2c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa2c4034650 0x7fa2c4036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40ad000 tx=0x7fa3d40a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 msgr2=0x556554e1cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 --2- 172.21.15.167:0/3522679270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556554c9f3b0 0x556554e1cf60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0001e20 tx=0x7fa3d0000ee0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3deccf640 1 -- 172.21.15.167:0/3522679270 reap_dead start 2024-09-18T02:04:24.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 shutdown_connections 2024-09-18T02:04:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 >> 172.21.15.167:0/3522679270 conn(0x556554d241b0 msgr2=0x556554e103c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 shutdown_connections 2024-09-18T02:04:24.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.776+0000 7fa3e09be980 1 -- 172.21.15.167:0/3522679270 wait complete. 2024-09-18T02:04:24.788 INFO:teuthology.orchestra.run.smithi167.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b6f58232-12d9-447d-8d4f-091dad0fc7cc","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","marker":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T02:04:24.068984Z","creation_time":"2024-09-18T02:04:20.260735Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-18T02:04:24.789 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b6f58232-12d9-447d-8d4f-091dad0fc7cc', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'marker': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T02:04:24.068984Z', 'creation_time': '2024-09-18T02:04:20.260735Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T02:04:24.789 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-18T02:04:24.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-18T02:04:24.789 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-18T02:04:24.855 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:24.855 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:24.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.852+0000 7fa5be054980 1 Processor -- start 2024-09-18T02:04:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.852+0000 7fa5be054980 1 -- start start 2024-09-18T02:04:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.852+0000 7fa5be054980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f635981c50 0x55f635984040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.852+0000 7fa5be054980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f635803ae0 con 0x55f63597d8d0 2024-09-18T02:04:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.852+0000 7fa5be054980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55f635827e30 con 0x55f635981c50 2024-09-18T02:04:24.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.852+0000 7fa5bb363640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f635981c50 0x55f635984040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.852+0000 7fa5bbb64640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55f63597d8d0 0x55f63597dcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55756/0 (socket says 172.21.15.167:55756) 2024-09-18T02:04:24.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.852+0000 7fa5bbb64640 1 -- 172.21.15.167:0/1997384602 learned_addr learned my addr 172.21.15.167:0/1997384602 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:24.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.852+0000 7fa5bb363640 1 -- 172.21.15.167:0/1997384602 >> v1:172.21.15.81:6789/0 conn(0x55f63597d8d0 legacy=0x55f63597dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.852+0000 7fa5bb363640 1 -- 172.21.15.167:0/1997384602 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f635985590 con 0x55f635981c50 2024-09-18T02:04:24.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.856+0000 7fa5bb363640 1 --2- 172.21.15.167:0/1997384602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635981c50 0x55f635984040 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000a480 tx=0x7fa5b001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44745f8bd6894da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.856+0000 7fa5bab62640 1 -- 172.21.15.167:0/1997384602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b00b0070 con 0x55f635981c50 2024-09-18T02:04:24.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.856+0000 7fa5bab62640 1 -- 172.21.15.167:0/1997384602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b00ab540 con 0x55f635981c50 2024-09-18T02:04:24.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.856+0000 7fa5bab62640 1 -- 172.21.15.167:0/1997384602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b00ab840 con 0x55f635981c50 2024-09-18T02:04:24.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.856+0000 7fa5be054980 1 -- 172.21.15.167:0/1997384602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635981c50 msgr2=0x55f635984040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.856+0000 7fa5be054980 1 --2- 172.21.15.167:0/1997384602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635981c50 0x55f635984040 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000a480 tx=0x7fa5b001b280 comp rx=0 tx=0).stop 2024-09-18T02:04:24.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.856+0000 7fa5be054980 1 -- 172.21.15.167:0/1997384602 shutdown_connections 2024-09-18T02:04:24.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.856+0000 7fa5be054980 1 --2- 172.21.15.167:0/1997384602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635981c50 0x55f635984040 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.856+0000 7fa5be054980 1 -- 172.21.15.167:0/1997384602 >> 172.21.15.167:0/1997384602 conn(0x55f6358f1220 msgr2=0x55f6358f1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.856+0000 7fa5be054980 1 -- 172.21.15.167:0/1997384602 shutdown_connections 2024-09-18T02:04:24.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.856+0000 7fa5be054980 1 -- 172.21.15.167:0/1997384602 wait complete. 2024-09-18T02:04:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 Processor -- start 2024-09-18T02:04:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 -- start start 2024-09-18T02:04:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 0x55f635a68c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f635829200 con 0x55f63597d8d0 2024-09-18T02:04:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5bbb64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 0x55f635a68c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5bbb64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 0x55f635a68c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58174/0 (socket says 172.21.15.167:58174) 2024-09-18T02:04:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5bbb64640 1 -- 172.21.15.167:0/2642258664 learned_addr learned my addr 172.21.15.167:0/2642258664 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5bbb64640 1 -- 172.21.15.167:0/2642258664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f635a691f0 con 0x55f63597d8d0 2024-09-18T02:04:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5bbb64640 1 --2- 172.21.15.167:0/2642258664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 0x55f635a68c20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac001d90 tx=0x7fa5ac001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f706c991e11fc9ba server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa4a9e0b640 1 -- 172.21.15.167:0/2642258664 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac013030 con 0x55f63597d8d0 2024-09-18T02:04:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa4a9e0b640 1 -- 172.21.15.167:0/2642258664 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac00e690 con 0x55f63597d8d0 2024-09-18T02:04:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa4a9e0b640 1 -- 172.21.15.167:0/2642258664 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac00ea10 con 0x55f63597d8d0 2024-09-18T02:04:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 -- 172.21.15.167:0/2642258664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 msgr2=0x55f635a68c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 --2- 172.21.15.167:0/2642258664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 0x55f635a68c20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac001d90 tx=0x7fa5ac001e80 comp rx=0 tx=0).stop 2024-09-18T02:04:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 -- 172.21.15.167:0/2642258664 shutdown_connections 2024-09-18T02:04:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 --2- 172.21.15.167:0/2642258664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 0x55f635a68c20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 -- 172.21.15.167:0/2642258664 >> 172.21.15.167:0/2642258664 conn(0x55f6358f1220 msgr2=0x55f635a64850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 -- 172.21.15.167:0/2642258664 shutdown_connections 2024-09-18T02:04:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 -- 172.21.15.167:0/2642258664 wait complete. 2024-09-18T02:04:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 Processor -- start 2024-09-18T02:04:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 -- start start 2024-09-18T02:04:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 0x55f635a6ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.872+0000 7fa5be054980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f635985090 con 0x55f63597d8d0 2024-09-18T02:04:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5bbb64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 0x55f635a6ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5bbb64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 0x55f635a6ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58184/0 (socket says 172.21.15.167:58184) 2024-09-18T02:04:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5bbb64640 1 -- 172.21.15.167:0/1718541425 learned_addr learned my addr 172.21.15.167:0/1718541425 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5bbb64640 1 -- 172.21.15.167:0/1718541425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f635a704d0 con 0x55f63597d8d0 2024-09-18T02:04:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5bbb64640 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 0x55f635a6ff90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x55f635a69e00 tx=0x7fa5ac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa4a3fff640 1 -- 172.21.15.167:0/1718541425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac027070 con 0x55f63597d8d0 2024-09-18T02:04:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f635a70760 con 0x55f63597d8d0 2024-09-18T02:04:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa4a3fff640 1 -- 172.21.15.167:0/1718541425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac019900 con 0x55f63597d8d0 2024-09-18T02:04:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa4a3fff640 1 -- 172.21.15.167:0/1718541425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac019c20 con 0x55f63597d8d0 2024-09-18T02:04:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f635a73440 con 0x55f63597d8d0 2024-09-18T02:04:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa4a3fff640 1 -- 172.21.15.167:0/1718541425 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa5ac02a070 con 0x55f63597d8d0 2024-09-18T02:04:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa4a3fff640 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa4a4034650 0x7fa4a4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa4a3fff640 1 -- 172.21.15.167:0/1718541425 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa5ac01f070 con 0x55f63597d8d0 2024-09-18T02:04:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5bb363640 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa4a4034650 0x7fa4a4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5be054980 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f635981c50 0x55f635a76f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635a775a0 con 0x55f635981c50 2024-09-18T02:04:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5bc365640 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f635981c50 0x55f635a76f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5bb363640 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa4a4034650 0x7fa4a4036b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00ad000 tx=0x7fa5b00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.876+0000 7fa5bc365640 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f635981c50 0x55f635a76f80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5bc365640 1 -- 172.21.15.167:0/1718541425 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635981c50 2024-09-18T02:04:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635a74660 con 0x55f635981c50 2024-09-18T02:04:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5bc365640 1 -- 172.21.15.167:0/1718541425 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635981c50 2024-09-18T02:04:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5be054980 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f635a798f0 0x55f635a7bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635a7c3b0 con 0x55f635a798f0 2024-09-18T02:04:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5bbb64640 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f635a798f0 0x55f635a7bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5bbb64640 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f635a798f0 0x55f635a7bce0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5bbb64640 1 -- 172.21.15.167:0/1718541425 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa5ac029030 con 0x55f635a798f0 2024-09-18T02:04:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635a78790 con 0x55f635981c50 2024-09-18T02:04:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5bc365640 1 -- 172.21.15.167:0/1718541425 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635981c50 2024-09-18T02:04:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5be054980 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f635a7d7f0 0x55f635a7fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635a80370 con 0x55f635a7d7f0 2024-09-18T02:04:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5bb363640 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f635a7d7f0 0x55f635a7fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5bb363640 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f635a7d7f0 0x55f635a7fbe0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5bb363640 1 -- 172.21.15.167:0/1718541425 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa5b00b3040 con 0x55f635a7d7f0 2024-09-18T02:04:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5be054980 1 Processor -- start 2024-09-18T02:04:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5be054980 1 -- start start 2024-09-18T02:04:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5be054980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a8de20 0x55f635a8e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.880+0000 7fa5be054980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f635882800 con 0x55f635a8de20 2024-09-18T02:04:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5bbb64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a8de20 0x55f635a8e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5bbb64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a8de20 0x55f635a8e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58186/0 (socket says 172.21.15.167:58186) 2024-09-18T02:04:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5bbb64640 1 -- 172.21.15.167:0/1832660994 learned_addr learned my addr 172.21.15.167:0/1832660994 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5bbb64640 1 -- 172.21.15.167:0/1832660994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f635a8e780 con 0x55f635a8de20 2024-09-18T02:04:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5bbb64640 1 --2- 172.21.15.167:0/1832660994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a8de20 0x55f635a8e240 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac048460 tx=0x7fa5ac00d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa4a17fa640 1 -- 172.21.15.167:0/1832660994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac048c10 con 0x55f635a8de20 2024-09-18T02:04:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5be054980 1 -- 172.21.15.167:0/1832660994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f635a8ea10 con 0x55f635a8de20 2024-09-18T02:04:24.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa4a17fa640 1 -- 172.21.15.167:0/1832660994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac048db0 con 0x55f635a8de20 2024-09-18T02:04:24.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa4a17fa640 1 -- 172.21.15.167:0/1832660994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac041530 con 0x55f635a8de20 2024-09-18T02:04:24.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5be054980 1 -- 172.21.15.167:0/1832660994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f635a91690 con 0x55f635a8de20 2024-09-18T02:04:24.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa4a17fa640 1 -- 172.21.15.167:0/1832660994 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa5ac036040 con 0x55f635a8de20 2024-09-18T02:04:24.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa4a17fa640 1 --2- 172.21.15.167:0/1832660994 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa494034650 0x7fa494036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa4a17fa640 1 -- 172.21.15.167:0/1832660994 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa5ac014070 con 0x55f635a8de20 2024-09-18T02:04:24.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5bb363640 1 --2- 172.21.15.167:0/1832660994 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa494034650 0x7fa494036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5be054980 1 Processor -- start 2024-09-18T02:04:24.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5be054980 1 -- start start 2024-09-18T02:04:24.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5bb363640 1 --2- 172.21.15.167:0/1832660994 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa494034650 0x7fa494036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa5b001b2c0 tx=0x7fa5b0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5be054980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635a9aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5be054980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f635a69570 con 0x55f635a9a7a0 2024-09-18T02:04:24.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5bbb64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635a9aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5bbb64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635a9aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58196/0 (socket says 172.21.15.167:58196) 2024-09-18T02:04:24.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.884+0000 7fa5bbb64640 1 -- 172.21.15.167:0/1194865499 learned_addr learned my addr 172.21.15.167:0/1194865499 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5bbb64640 1 -- 172.21.15.167:0/1194865499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f635a9b170 con 0x55f635a9a7a0 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5bbb64640 1 --2- 172.21.15.167:0/1194865499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635a9aba0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00c430 tx=0x7fa5ac021370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc8e96f2b8ce92 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa49affd640 1 -- 172.21.15.167:0/1194865499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac062070 con 0x55f635a9a7a0 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa49affd640 1 -- 172.21.15.167:0/1194865499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac02aaa0 con 0x55f635a9a7a0 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa49affd640 1 -- 172.21.15.167:0/1194865499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac02a580 con 0x55f635a9a7a0 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 -- 172.21.15.167:0/1194865499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 msgr2=0x55f635a9aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 --2- 172.21.15.167:0/1194865499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635a9aba0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00c430 tx=0x7fa5ac021370 comp rx=0 tx=0).stop 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 -- 172.21.15.167:0/1194865499 shutdown_connections 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 --2- 172.21.15.167:0/1194865499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635a9aba0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 -- 172.21.15.167:0/1194865499 >> 172.21.15.167:0/1194865499 conn(0x55f635a96b30 msgr2=0x55f635a94c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 -- 172.21.15.167:0/1194865499 shutdown_connections 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 -- 172.21.15.167:0/1194865499 wait complete. 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 Processor -- start 2024-09-18T02:04:24.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 -- start start 2024-09-18T02:04:24.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635aa1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f635a9b6c0 con 0x55f635a9a7a0 2024-09-18T02:04:24.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5bbb64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635aa1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5bbb64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635aa1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58210/0 (socket says 172.21.15.167:58210) 2024-09-18T02:04:24.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 learned_addr learned my addr 172.21.15.167:0/118903933 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:24.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f635aa1ec0 con 0x55f635a9a7a0 2024-09-18T02:04:24.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5bbb64640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635aa1980 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac02c810 tx=0x7fa5ac04ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa4997fa640 1 -- 172.21.15.167:0/118903933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac06d070 con 0x55f635a9a7a0 2024-09-18T02:04:24.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa4997fa640 1 -- 172.21.15.167:0/118903933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0416d0 con 0x55f635a9a7a0 2024-09-18T02:04:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f635aa1ec0 con 0x55f635a9a7a0 2024-09-18T02:04:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa4997fa640 1 -- 172.21.15.167:0/118903933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac062040 con 0x55f635a9a7a0 2024-09-18T02:04:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.888+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f635aa1ec0 con 0x55f635a9a7a0 2024-09-18T02:04:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa4997fa640 1 -- 172.21.15.167:0/118903933 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa5ac070070 con 0x55f635a9a7a0 2024-09-18T02:04:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa4997fa640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa484034600 0x7fa484036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa4997fa640 1 -- 172.21.15.167:0/118903933 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa5ac005050 con 0x55f635a9a7a0 2024-09-18T02:04:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5bb363640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa484034600 0x7fa484036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f635aaca60 0x55f635aaeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635aaf640 con 0x55f635aaca60 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5bc365640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f635aaca60 0x55f635aaeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5bb363640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa484034600 0x7fa484036ac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00abaa0 tx=0x7fa5b00b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5bc365640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f635aaca60 0x55f635aaeef0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 realm 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635aafa50 con 0x55f635aaca60 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab02f0 con 0x55f635aaca60 2024-09-18T02:04:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f635ab13f0 0x55f635ab37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab3d60 con 0x55f635ab13f0 2024-09-18T02:04:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5bbb64640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f635ab13f0 0x55f635ab37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5bbb64640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f635ab13f0 0x55f635ab37e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 20 searching for the correct realm 2024-09-18T02:04:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.892+0000 7fa5be054980 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f635ab5c90 0x55f635ab8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab87f0 con 0x55f635ab5c90 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bb363640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f635ab5c90 0x55f635ab8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bb363640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f635ab5c90 0x55f635ab8120 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bb363640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa5b00dc040 0x7fa5b00ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab87f0 con 0x7fa5b00dc040 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bc365640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa5b00dc040 0x7fa5b00ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bc365640 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa5b00dc040 0x7fa5b00ce430 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.896+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.900+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.904+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab45b0 con 0x55f635aaca60 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab45b0 con 0x55f635aaca60 2024-09-18T02:04:24.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab45b0 con 0x55f635ab5c90 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 zone default found 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 4 Realm: () 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 zonegroup default 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab4e50 con 0x55f635ab13f0 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635aba650 con 0x55f635ab5c90 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados->read ofs=0 len=0 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635aba9f0 con 0x55f635ab5c90 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 started sync module instance, tier type = 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab9af0 con 0x7fa5b00dc040 2024-09-18T02:04:24.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94515950753616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635aba130 con 0x7fa5b00dc040 2024-09-18T02:04:24.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.908+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abb3b0 con 0x55f635aaca60 2024-09-18T02:04:24.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.912+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94515950753616] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.912+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.912+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94515950754848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abb3b0 con 0x55f635aaca60 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.912+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abbd70 con 0x55f635ab5c90 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94515950762176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abc610 con 0x55f635ab5c90 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abd010 con 0x7fa5b00dc040 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94515950754848] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94515950759680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abd400 con 0x7fa5b00dc040 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abddc0 con 0x55f635aaca60 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94515950762176] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94515950759680] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94515950766880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abd910 con 0x55f635aaca60 2024-09-18T02:04:24.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.916+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abe160 con 0x55f635ab13f0 2024-09-18T02:04:24.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.920+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94515950766880] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.920+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.920+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94515950770448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abdd30 con 0x55f635ab13f0 2024-09-18T02:04:24.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.920+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abee60 con 0x55f635ab13f0 2024-09-18T02:04:24.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.920+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94515950770448] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.920+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.920+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94515950773776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abf0a0 con 0x55f635ab13f0 2024-09-18T02:04:24.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.920+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abfbc0 con 0x55f635ab13f0 2024-09-18T02:04:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94515950773776] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94515950778000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abfb80 con 0x55f635ab13f0 2024-09-18T02:04:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5be054980 20 add_watcher() i=0 2024-09-18T02:04:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5be054980 20 add_watcher() i=1 2024-09-18T02:04:24.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5be054980 20 add_watcher() i=2 2024-09-18T02:04:24.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5be054980 20 add_watcher() i=3 2024-09-18T02:04:24.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5be054980 20 add_watcher() i=4 2024-09-18T02:04:24.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5be054980 20 add_watcher() i=5 2024-09-18T02:04:24.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5be054980 20 add_watcher() i=6 2024-09-18T02:04:24.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94515950778000] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5be054980 20 add_watcher() i=7 2024-09-18T02:04:24.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5be054980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:24.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.924+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f635ac3010 con 0x55f635aaca60 2024-09-18T02:04:24.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94515950775024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635ac0530 con 0x55f635aaca60 2024-09-18T02:04:24.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94515950775024] v30'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:24.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5be054980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:24.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5be054980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:24.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5be054980 5 note: GC not initialized 2024-09-18T02:04:24.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa470fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:24.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5be054980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:24.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5be054980 20 Filter name: none 2024-09-18T02:04:24.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa3ea7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:24.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ae5cd0 con 0x55f635ab13f0 2024-09-18T02:04:24.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(62 [pgnls start_epoch 30 out=254b] v30'48 uv32 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635abdd30 con 0x55f635ab13f0 2024-09-18T02:04:24.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(63 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635abdd30 con 0x55f635ab5c90 2024-09-18T02:04:24.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 [pgnls start_epoch 30 out=295b] v30'35 uv27 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.928+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635abc610 con 0x55f635ab13f0 2024-09-18T02:04:24.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(65 [pgnls start_epoch 30 out=172b] v30'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635abc610 con 0x55f635aaca60 2024-09-18T02:04:24.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(66 [pgnls start_epoch 30 out=335b] v30'152 uv29 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(67 [pgnls start_epoch 30 out=213b] v30'22 uv22 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(68 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=295b] v30'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(70 [pgnls start_epoch 30 out=213b] v30'16 uv16 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(71 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(72 [pgnls start_epoch 30 out=336b] v30'33 uv25 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b00dc040 2024-09-18T02:04:24.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(73 [pgnls start_epoch 30 out=131b] v30'31 uv23 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(74 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(75 [pgnls start_epoch 30 out=90b] v30'29 uv21 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(76 [pgnls start_epoch 30 out=213b] v30'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(77 [pgnls start_epoch 30 out=254b] v30'16 uv16 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.932+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(78 [pgnls start_epoch 30 out=254b] v30'20 uv20 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fa5b400a4d0 con 0x55f635aaca60 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(79 [pgnls start_epoch 30 out=213b] v30'26 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(80 [pgnls start_epoch 30 out=172b] v30'40 uv24 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(81 [pgnls start_epoch 30 out=295b] v30'47 uv39 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fa5b404c130 con 0x55f635aaca60 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(82 [pgnls start_epoch 30 out=276b] v30'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fa5b404c130 con 0x7fa5b00dc040 2024-09-18T02:04:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(83 [pgnls start_epoch 30 out=172b] v30'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fa5b404c130 con 0x7fa5b00dc040 2024-09-18T02:04:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(84 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fa5b404c130 con 0x55f635aaca60 2024-09-18T02:04:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(85 [pgnls start_epoch 30 out=172b] v30'34 uv18 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(86 [pgnls start_epoch 30 out=213b] v30'49 uv25 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fa5b404c130 con 0x7fa5b00dc040 2024-09-18T02:04:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(87 [pgnls start_epoch 30 out=172b] v30'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(88 [pgnls start_epoch 30 out=172b] v30'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.936+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.940+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(89 [pgnls start_epoch 30 out=90b] v30'20 uv11 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.940+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab5c90 2024-09-18T02:04:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.940+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(90 [pgnls start_epoch 30 out=90b] v30'43 uv19 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.940+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635aaca60 2024-09-18T02:04:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.940+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(91 [pgnls start_epoch 30 out=131b] v30'12 uv12 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fa5b404c130 con 0x55f635aaca60 2024-09-18T02:04:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.940+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x7fa5b00dc040 2024-09-18T02:04:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.940+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(92 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fa5b404c130 con 0x7fa5b00dc040 2024-09-18T02:04:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.940+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab0690 con 0x55f635ab13f0 2024-09-18T02:04:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.940+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(93 [pgnls start_epoch 30 out=213b] v30'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.944 INFO:teuthology.orchestra.run.smithi167.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-18T02:04:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.940+0000 7fa471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.940+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94515950775024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635ae4120 con 0x55f635aaca60 2024-09-18T02:04:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.944+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94515950775024] v30'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5b404c130 con 0x55f635aaca60 2024-09-18T02:04:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.944+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94515950753616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635ae5c90 con 0x7fa5b00dc040 2024-09-18T02:04:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.944+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94515950753616] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b404c130 con 0x7fa5b00dc040 2024-09-18T02:04:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.944+0000 7fa5be054980 20 remove_watcher() i=0 2024-09-18T02:04:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.944+0000 7fa5be054980 2 removed watcher, disabling cache 2024-09-18T02:04:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.944+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94515950754848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab9750 con 0x55f635aaca60 2024-09-18T02:04:24.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.944+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94515950754848] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b404c130 con 0x55f635aaca60 2024-09-18T02:04:24.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.944+0000 7fa5be054980 20 remove_watcher() i=1 2024-09-18T02:04:24.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.944+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94515950762176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab9750 con 0x55f635ab5c90 2024-09-18T02:04:24.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.948+0000 7fa5bb363640 1 -- 172.21.15.167:0/118903933 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94515950762176] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00c9030 con 0x55f635ab5c90 2024-09-18T02:04:24.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.948+0000 7fa5be054980 20 remove_watcher() i=2 2024-09-18T02:04:24.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.948+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94515950759680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab9c20 con 0x7fa5b00dc040 2024-09-18T02:04:24.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.948+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94515950759680] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b404c130 con 0x7fa5b00dc040 2024-09-18T02:04:24.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.948+0000 7fa5be054980 20 remove_watcher() i=3 2024-09-18T02:04:24.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.948+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94515950766880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab9c20 con 0x55f635aaca60 2024-09-18T02:04:24.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.952+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94515950766880] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b404c130 con 0x55f635aaca60 2024-09-18T02:04:24.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.952+0000 7fa5be054980 20 remove_watcher() i=4 2024-09-18T02:04:24.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.952+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94515950770448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abcb20 con 0x55f635ab13f0 2024-09-18T02:04:24.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.952+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94515950770448] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.952+0000 7fa5be054980 20 remove_watcher() i=5 2024-09-18T02:04:24.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.952+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94515950773776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635ab9c20 con 0x55f635ab13f0 2024-09-18T02:04:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94515950773776] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 20 remove_watcher() i=6 2024-09-18T02:04:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94515950778000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f635abcb20 con 0x55f635ab13f0 2024-09-18T02:04:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5bbb64640 1 -- 172.21.15.167:0/118903933 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94515950778000] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac079070 con 0x55f635ab13f0 2024-09-18T02:04:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 20 remove_watcher() i=7 2024-09-18T02:04:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f635ab13f0 msgr2=0x55f635ab37e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f635ab13f0 0x55f635ab37e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f635aaca60 msgr2=0x55f635aaeef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f635aaca60 0x55f635aaeef0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa5b00dc040 msgr2=0x7fa5b00ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa5b00dc040 0x7fa5b00ce430 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f635ab5c90 msgr2=0x55f635ab8120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f635ab5c90 0x55f635ab8120 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa484034600 msgr2=0x7fa484036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa484034600 0x7fa484036ac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00abaa0 tx=0x7fa5b00b9040 comp rx=0 tx=0).stop 2024-09-18T02:04:24.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5bc365640 1 -- 172.21.15.167:0/118903933 reap_dead start 2024-09-18T02:04:24.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 msgr2=0x55f635aa1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635aa1980 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac02c810 tx=0x7fa5ac04ffa0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 shutdown_connections 2024-09-18T02:04:24.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/118903933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a9a7a0 0x55f635aa1980 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 >> 172.21.15.167:0/118903933 conn(0x55f635a96b30 msgr2=0x55f635a94c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 shutdown_connections 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/118903933 wait complete. 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1832660994 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa494034650 msgr2=0x7fa494036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/1832660994 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa494034650 0x7fa494036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa5b001b2c0 tx=0x7fa5b0005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1832660994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a8de20 msgr2=0x55f635a8e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/1832660994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a8de20 0x55f635a8e240 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac048460 tx=0x7fa5ac00d9e0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1832660994 shutdown_connections 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/1832660994 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa494034650 0x7fa494036b10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/1832660994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f635a8de20 0x55f635a8e240 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1832660994 >> 172.21.15.167:0/1832660994 conn(0x55f635a82f70 msgr2=0x55f635a859f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1832660994 shutdown_connections 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1832660994 wait complete. 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f635a798f0 msgr2=0x55f635a7bce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f635a798f0 0x55f635a7bce0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f635981c50 msgr2=0x55f635a76f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f635981c50 0x55f635a76f80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f635a7d7f0 msgr2=0x55f635a7fbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f635a7d7f0 0x55f635a7fbe0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa4a4034650 msgr2=0x7fa4a4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa4a4034650 0x7fa4a4036b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00ad000 tx=0x7fa5b00a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 msgr2=0x55f635a6ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 --2- 172.21.15.167:0/1718541425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f63597d8d0 0x55f635a6ff90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x55f635a69e00 tx=0x7fa5ac000bd0 comp rx=0 tx=0).stop 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5bc365640 1 -- 172.21.15.167:0/1718541425 reap_dead start 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 shutdown_connections 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 >> 172.21.15.167:0/1718541425 conn(0x55f6358f1220 msgr2=0x55f635a633d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 shutdown_connections 2024-09-18T02:04:24.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:24.956+0000 7fa5be054980 1 -- 172.21.15.167:0/1718541425 wait complete. 2024-09-18T02:04:24.970 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-18T02:04:24.970 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-18T02:04:24.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-18T02:04:24.971 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-18T02:04:25.046 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:25.046 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:25.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471fd99980 1 Processor -- start 2024-09-18T02:04:25.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471fd99980 1 -- start start 2024-09-18T02:04:25.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471fd99980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d9a6e008e0 0x55d9a6e00cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471fd99980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d9a6c86ae0 con 0x55d9a6e01230 2024-09-18T02:04:25.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471fd99980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55d9a6caae30 con 0x55d9a6e008e0 2024-09-18T02:04:25.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471d8a9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d9a6e008e0 0x55d9a6e00cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471d0a8640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55d9a6e01230 0x55d9a6e05c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55772/0 (socket says 172.21.15.167:55772) 2024-09-18T02:04:25.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471d0a8640 1 -- 172.21.15.167:0/1360032893 learned_addr learned my addr 172.21.15.167:0/1360032893 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:25.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471c8a7640 1 -- 172.21.15.167:0/1360032893 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4242490259 0 0) 0x55d9a6c86ae0 con 0x55d9a6e01230 2024-09-18T02:04:25.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471c8a7640 1 -- 172.21.15.167:0/1360032893 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4708001e20 con 0x55d9a6e01230 2024-09-18T02:04:25.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471d8a9640 1 -- 172.21.15.167:0/1360032893 >> v1:172.21.15.81:6789/0 conn(0x55d9a6e01230 legacy=0x55d9a6e05c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.044+0000 7f471d8a9640 1 -- 172.21.15.167:0/1360032893 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a6e084b0 con 0x55d9a6e008e0 2024-09-18T02:04:25.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.048+0000 7f471d8a9640 1 --2- 172.21.15.167:0/1360032893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6e00cc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f471000a480 tx=0x7f471001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57940b6b92a4b001 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.048+0000 7f471c8a7640 1 -- 172.21.15.167:0/1360032893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47100b0070 con 0x55d9a6e008e0 2024-09-18T02:04:25.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.048+0000 7f471c8a7640 1 -- 172.21.15.167:0/1360032893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47100ab540 con 0x55d9a6e008e0 2024-09-18T02:04:25.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.048+0000 7f471c8a7640 1 -- 172.21.15.167:0/1360032893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47100ab820 con 0x55d9a6e008e0 2024-09-18T02:04:25.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.048+0000 7f471fd99980 1 -- 172.21.15.167:0/1360032893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 msgr2=0x55d9a6e00cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.048+0000 7f471fd99980 1 --2- 172.21.15.167:0/1360032893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6e00cc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f471000a480 tx=0x7f471001b280 comp rx=0 tx=0).stop 2024-09-18T02:04:25.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.048+0000 7f471fd99980 1 -- 172.21.15.167:0/1360032893 shutdown_connections 2024-09-18T02:04:25.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.048+0000 7f471fd99980 1 --2- 172.21.15.167:0/1360032893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6e00cc0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.048+0000 7f471fd99980 1 -- 172.21.15.167:0/1360032893 >> 172.21.15.167:0/1360032893 conn(0x55d9a6d74230 msgr2=0x55d9a6d74640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.048+0000 7f471fd99980 1 -- 172.21.15.167:0/1360032893 shutdown_connections 2024-09-18T02:04:25.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.048+0000 7f471fd99980 1 -- 172.21.15.167:0/1360032893 wait complete. 2024-09-18T02:04:25.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.060+0000 7f471fd99980 1 Processor -- start 2024-09-18T02:04:25.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.060+0000 7f471fd99980 1 -- start start 2024-09-18T02:04:25.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.060+0000 7f471fd99980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6eeb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.060+0000 7f471fd99980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9a6cac200 con 0x55d9a6e008e0 2024-09-18T02:04:25.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.060+0000 7f471d8a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6eeb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.060+0000 7f471d8a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6eeb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58224/0 (socket says 172.21.15.167:58224) 2024-09-18T02:04:25.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.060+0000 7f471d8a9640 1 -- 172.21.15.167:0/1573318773 learned_addr learned my addr 172.21.15.167:0/1573318773 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:25.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471d8a9640 1 -- 172.21.15.167:0/1573318773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a6eebfa0 con 0x55d9a6e008e0 2024-09-18T02:04:25.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471d8a9640 1 --2- 172.21.15.167:0/1573318773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6eeb9d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4710017e90 tx=0x7f4710003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f223face67c402f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f460be07640 1 -- 172.21.15.167:0/1573318773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47100b0040 con 0x55d9a6e008e0 2024-09-18T02:04:25.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f460be07640 1 -- 172.21.15.167:0/1573318773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47100aca40 con 0x55d9a6e008e0 2024-09-18T02:04:25.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f460be07640 1 -- 172.21.15.167:0/1573318773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47100acd20 con 0x55d9a6e008e0 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 -- 172.21.15.167:0/1573318773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 msgr2=0x55d9a6eeb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 --2- 172.21.15.167:0/1573318773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6eeb9d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4710017e90 tx=0x7f4710003030 comp rx=0 tx=0).stop 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 -- 172.21.15.167:0/1573318773 shutdown_connections 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 --2- 172.21.15.167:0/1573318773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6eeb9d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 -- 172.21.15.167:0/1573318773 >> 172.21.15.167:0/1573318773 conn(0x55d9a6d74230 msgr2=0x55d9a6ee7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 -- 172.21.15.167:0/1573318773 shutdown_connections 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 -- 172.21.15.167:0/1573318773 wait complete. 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 Processor -- start 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 -- start start 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6ef2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9a6e07ef0 con 0x55d9a6e008e0 2024-09-18T02:04:25.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471d8a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6ef2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471d8a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6ef2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58232/0 (socket says 172.21.15.167:58232) 2024-09-18T02:04:25.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471d8a9640 1 -- 172.21.15.167:0/2864613674 learned_addr learned my addr 172.21.15.167:0/2864613674 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:25.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471d8a9640 1 -- 172.21.15.167:0/2864613674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a6ef3180 con 0x55d9a6e008e0 2024-09-18T02:04:25.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471d8a9640 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6ef2c40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f471001bb20 tx=0x7f4710018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f460a604640 1 -- 172.21.15.167:0/2864613674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47100c5030 con 0x55d9a6e008e0 2024-09-18T02:04:25.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9a6ef3410 con 0x55d9a6e008e0 2024-09-18T02:04:25.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f460a604640 1 -- 172.21.15.167:0/2864613674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47100b6c60 con 0x55d9a6e008e0 2024-09-18T02:04:25.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f460a604640 1 -- 172.21.15.167:0/2864613674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47100b0070 con 0x55d9a6e008e0 2024-09-18T02:04:25.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.064+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9a6ef60f0 con 0x55d9a6e008e0 2024-09-18T02:04:25.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f460a604640 1 -- 172.21.15.167:0/2864613674 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f47100c8070 con 0x55d9a6e008e0 2024-09-18T02:04:25.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f460a604640 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4604034650 0x7f4604036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f460a604640 1 -- 172.21.15.167:0/2864613674 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f47100c6070 con 0x55d9a6e008e0 2024-09-18T02:04:25.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471d0a8640 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4604034650 0x7f4604036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471fd99980 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d9a6e01230 0x55d9a6ef9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6efa310 con 0x55d9a6e01230 2024-09-18T02:04:25.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471e0aa640 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d9a6e01230 0x55d9a6ef9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471d0a8640 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4604034650 0x7f4604036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4714000f70 tx=0x7f47140010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471e0aa640 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d9a6e01230 0x55d9a6ef9d40 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471e0aa640 1 -- 172.21.15.167:0/2864613674 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6e01230 2024-09-18T02:04:25.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6ef72f0 con 0x55d9a6e01230 2024-09-18T02:04:25.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471e0aa640 1 -- 172.21.15.167:0/2864613674 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6e01230 2024-09-18T02:04:25.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471fd99980 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d9a6efc620 0x55d9a6efea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6eff100 con 0x55d9a6efc620 2024-09-18T02:04:25.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471d8a9640 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d9a6efc620 0x55d9a6efea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.068+0000 7f471d8a9640 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d9a6efc620 0x55d9a6efea10 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471d8a9640 1 -- 172.21.15.167:0/2864613674 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f47100b3040 con 0x55d9a6efc620 2024-09-18T02:04:25.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6efb4c0 con 0x55d9a6e01230 2024-09-18T02:04:25.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471e0aa640 1 -- 172.21.15.167:0/2864613674 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6e01230 2024-09-18T02:04:25.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471fd99980 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d9a6f00560 0x55d9a6f02950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f03090 con 0x55d9a6f00560 2024-09-18T02:04:25.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471d0a8640 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d9a6f00560 0x55d9a6f02950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471d0a8640 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d9a6f00560 0x55d9a6f02950 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471d0a8640 1 -- 172.21.15.167:0/2864613674 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f00560 2024-09-18T02:04:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471fd99980 1 Processor -- start 2024-09-18T02:04:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471fd99980 1 -- start start 2024-09-18T02:04:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471fd99980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f10b60 0x55d9a6f10f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471fd99980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9a6d05800 con 0x55d9a6f10b60 2024-09-18T02:04:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471d8a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f10b60 0x55d9a6f10f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471d8a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f10b60 0x55d9a6f10f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58234/0 (socket says 172.21.15.167:58234) 2024-09-18T02:04:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471d8a9640 1 -- 172.21.15.167:0/3330778616 learned_addr learned my addr 172.21.15.167:0/3330778616 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471d8a9640 1 -- 172.21.15.167:0/3330778616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a6f114c0 con 0x55d9a6f10b60 2024-09-18T02:04:25.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471d8a9640 1 --2- 172.21.15.167:0/3330778616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f10b60 0x55d9a6f10f80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f47100cafd0 tx=0x7f47100ca6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f46037fe640 1 -- 172.21.15.167:0/3330778616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47100aae50 con 0x55d9a6f10b60 2024-09-18T02:04:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471fd99980 1 -- 172.21.15.167:0/3330778616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9a6f116f0 con 0x55d9a6f10b60 2024-09-18T02:04:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f46037fe640 1 -- 172.21.15.167:0/3330778616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47100c9a60 con 0x55d9a6f10b60 2024-09-18T02:04:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f46037fe640 1 -- 172.21.15.167:0/3330778616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47100c9d40 con 0x55d9a6f10b60 2024-09-18T02:04:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.072+0000 7f471fd99980 1 -- 172.21.15.167:0/3330778616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9a6f14370 con 0x55d9a6f10b60 2024-09-18T02:04:25.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f46037fe640 1 -- 172.21.15.167:0/3330778616 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f47100eb060 con 0x55d9a6f10b60 2024-09-18T02:04:25.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f46037fe640 1 --2- 172.21.15.167:0/3330778616 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f45f8034650 0x7f45f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f46037fe640 1 -- 172.21.15.167:0/3330778616 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f47100de070 con 0x55d9a6f10b60 2024-09-18T02:04:25.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471d0a8640 1 --2- 172.21.15.167:0/3330778616 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f45f8034650 0x7f45f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 Processor -- start 2024-09-18T02:04:25.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 -- start start 2024-09-18T02:04:25.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471d0a8640 1 --2- 172.21.15.167:0/3330778616 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f45f8034650 0x7f45f8036b10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f471400c010 tx=0x7f471400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f1d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9a6eec260 con 0x55d9a6f1d370 2024-09-18T02:04:25.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471d8a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f1d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471d8a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f1d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58242/0 (socket says 172.21.15.167:58242) 2024-09-18T02:04:25.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471d8a9640 1 -- 172.21.15.167:0/29570002 learned_addr learned my addr 172.21.15.167:0/29570002 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:25.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471d8a9640 1 -- 172.21.15.167:0/29570002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a6f1dd40 con 0x55d9a6f1d370 2024-09-18T02:04:25.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471d8a9640 1 --2- 172.21.15.167:0/29570002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f1d770 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f47100d4fd0 tx=0x7f47100d44e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62591b2106a567aa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f46017fa640 1 -- 172.21.15.167:0/29570002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47100fc070 con 0x55d9a6f1d370 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f46017fa640 1 -- 172.21.15.167:0/29570002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47100d7c10 con 0x55d9a6f1d370 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f46017fa640 1 -- 172.21.15.167:0/29570002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47100c0a80 con 0x55d9a6f1d370 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 -- 172.21.15.167:0/29570002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 msgr2=0x55d9a6f1d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 --2- 172.21.15.167:0/29570002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f1d770 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f47100d4fd0 tx=0x7f47100d44e0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 -- 172.21.15.167:0/29570002 shutdown_connections 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 --2- 172.21.15.167:0/29570002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f1d770 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 -- 172.21.15.167:0/29570002 >> 172.21.15.167:0/29570002 conn(0x55d9a6f197e0 msgr2=0x55d9a6f178e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 -- 172.21.15.167:0/29570002 shutdown_connections 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 -- 172.21.15.167:0/29570002 wait complete. 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 Processor -- start 2024-09-18T02:04:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 -- start start 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f24520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.076+0000 7f471fd99980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9a6f1dd40 con 0x55d9a6f1d370 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471d8a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f24520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471d8a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f24520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58250/0 (socket says 172.21.15.167:58250) 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 learned_addr learned my addr 172.21.15.167:0/140979279 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a6f24a60 con 0x55d9a6f1d370 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471d8a9640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f24520 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f47100d4fd0 tx=0x7f47100a8f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f45ef7fe640 1 -- 172.21.15.167:0/140979279 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4710111070 con 0x55d9a6f1d370 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f45ef7fe640 1 -- 172.21.15.167:0/140979279 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47100d7dc0 con 0x55d9a6f1d370 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f45ef7fe640 1 -- 172.21.15.167:0/140979279 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47100fc040 con 0x55d9a6f1d370 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9a6f24a60 con 0x55d9a6f1d370 2024-09-18T02:04:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9a6f24a60 con 0x55d9a6f1d370 2024-09-18T02:04:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f45ef7fe640 1 -- 172.21.15.167:0/140979279 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4710114070 con 0x55d9a6f1d370 2024-09-18T02:04:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f45ef7fe640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f45e8034650 0x7f45e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f45ef7fe640 1 -- 172.21.15.167:0/140979279 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4710108030 con 0x55d9a6f1d370 2024-09-18T02:04:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471d0a8640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f45e8034650 0x7f45e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d9a6f2f4d0 0x55d9a6f31970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f320c0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471e0aa640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d9a6f2f4d0 0x55d9a6f31970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471d0a8640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f45e8034650 0x7f45e8036b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55d9a6efa7c0 tx=0x7f4714010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471e0aa640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d9a6f2f4d0 0x55d9a6f31970 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 20 realm 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f324d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.080+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f32d70 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471fd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471fd99980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471fd99980 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d9a6f33e70 0x55d9a6f36260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f36900 con 0x55d9a6f33e70 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471d8a9640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d9a6f33e70 0x55d9a6f36260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471d8a9640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d9a6f33e70 0x55d9a6f36260 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471fd99980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471fd99980 20 searching for the correct realm 2024-09-18T02:04:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471fd99980 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d9a6f387e0 0x55d9a6f3ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3b2d0 con 0x55d9a6f387e0 2024-09-18T02:04:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471d0a8640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d9a6f387e0 0x55d9a6f3ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471d0a8640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d9a6f387e0 0x55d9a6f3ac50 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471d0a8640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4714037040 0x7f4714036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3b2d0 con 0x7f4714037040 2024-09-18T02:04:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471e0aa640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4714037040 0x7f4714036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471e0aa640 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4714037040 0x7f4714036410 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.084+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f33e70 2024-09-18T02:04:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f33e70 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f33e70 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x7f4714037040 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f387e0 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f33e70 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.088+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x7f4714037040 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f387e0 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f387e0 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f33e70 2024-09-18T02:04:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f387e0 2024-09-18T02:04:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f387e0 2024-09-18T02:04:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f33e70 2024-09-18T02:04:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f387e0 2024-09-18T02:04:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x7f4714037040 2024-09-18T02:04:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.092+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f33e70 2024-09-18T02:04:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f387e0 2024-09-18T02:04:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f33e70 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x7f4714037040 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f387e0 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f33e70 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f33110 con 0x7f4714037040 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f37150 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f37150 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f37150 con 0x55d9a6f387e0 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.096+0000 7f471fd99980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 20 zone default found 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 4 Realm: () 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 20 zonegroup default 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f37a90 con 0x55d9a6f33e70 2024-09-18T02:04:25.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3d130 con 0x55d9a6f387e0 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3d600 con 0x55d9a6f387e0 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 20 started sync module instance, tier type = 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:25.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3c5d0 con 0x7f4714037040 2024-09-18T02:04:25.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94393297259248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3c5d0 con 0x7f4714037040 2024-09-18T02:04:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3e0c0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.100+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94393297259248] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.104+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.104+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94393297263568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3c5d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.104+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3ead0 con 0x55d9a6f387e0 2024-09-18T02:04:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.104+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94393297263568] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.104+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.104+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94393297256736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3c540 con 0x55d9a6f387e0 2024-09-18T02:04:25.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.104+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3f820 con 0x7f4714037040 2024-09-18T02:04:25.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.104+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.104+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94393297269888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f400c0 con 0x7f4714037040 2024-09-18T02:04:25.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.104+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f40a80 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.108+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94393297256736] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.108+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94393297269888] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.108+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.108+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94393297274320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f40070 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.108+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f409f0 con 0x55d9a6f33e70 2024-09-18T02:04:25.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.108+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94393297274320] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.108+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.108+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94393297271744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f40060 con 0x55d9a6f33e70 2024-09-18T02:04:25.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.108+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f41aa0 con 0x55d9a6f33e70 2024-09-18T02:04:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.112+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94393297271744] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.112+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.112+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94393297276528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f422f0 con 0x55d9a6f33e70 2024-09-18T02:04:25.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.112+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f42cb0 con 0x55d9a6f33e70 2024-09-18T02:04:25.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94393297283072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f430d0 con 0x55d9a6f33e70 2024-09-18T02:04:25.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 20 add_watcher() i=0 2024-09-18T02:04:25.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 20 add_watcher() i=1 2024-09-18T02:04:25.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 20 add_watcher() i=2 2024-09-18T02:04:25.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 20 add_watcher() i=3 2024-09-18T02:04:25.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 20 add_watcher() i=4 2024-09-18T02:04:25.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 20 add_watcher() i=5 2024-09-18T02:04:25.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94393297276528] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 20 add_watcher() i=6 2024-09-18T02:04:25.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94393297283072] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 20 add_watcher() i=7 2024-09-18T02:04:25.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:25.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f41e40 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94393297280576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f435f0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.116+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94393297280576] v30'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f45cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:25.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:25.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:25.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 5 note: GC not initialized 2024-09-18T02:04:25.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f45ce7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:25.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:25.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 20 Filter name: none 2024-09-18T02:04:25.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f453ffff640 20 reqs_thread_entry: start 2024-09-18T02:04:25.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:25.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f69750 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f6c1e0 con 0x7f4714037040 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 20 disabling bucket name=myfoo 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f6a1c0 con 0x7f4714037040 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 : miss 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:65 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f6ca30 con 0x55d9a6f387e0 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(65 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:25.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f744d0 con 0x55d9a6f387e0 2024-09-18T02:04:25.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(66 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1, ofs0, ns] 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.120+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94393297457392 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f6eae0 con 0x55d9a6f33e70 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== watch-notify(notify (1) cookie 94393297283072 notify 128849018897 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55d9a6f116f0 con 0x55d9a6f33e70 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f46017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94393297283072 notifier 4599 bl.length()=752 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f46017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f46017fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(67 notify.7 [notify cookie 94393297457392 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f46017fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f46017fa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f45e0003eb0 con 0x55d9a6f33e70 2024-09-18T02:04:25.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== watch-notify(notify_complete (2) cookie 94393297457392 notify 128849018897 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d9a6f114c0 con 0x55d9a6f33e70 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471fd99980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_sources= new_sources= 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471fd99980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential sources added=[] removed=[] 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471fd99980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_dests= new_dests= 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471fd99980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential dests added=[] removed=[] 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f6d5d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471fd99980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471fd99980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471fd99980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94393297436336 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f6d5d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94393297274320 notify 128849018894 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f4718044430 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f46017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94393297274320 notifier 4599 bl.length()=567 2024-09-18T02:04:25.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f46017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:25.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f46017fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:25.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f46017fa640 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f45e0003eb0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(70 notify.4 [notify cookie 94393297436336 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.124+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94393297436336 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4718044600 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.131 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:25.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.128+0000 7f45cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:25.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.128+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94393297280576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f67580 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.128+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94393297280576] v30'155 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.128+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94393297259248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f67580 con 0x7f4714037040 2024-09-18T02:04:25.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.128+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94393297259248] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.128+0000 7f471fd99980 20 remove_watcher() i=0 2024-09-18T02:04:25.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.128+0000 7f471fd99980 2 removed watcher, disabling cache 2024-09-18T02:04:25.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.128+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94393297263568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f67580 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.132+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94393297263568] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.132+0000 7f471fd99980 20 remove_watcher() i=1 2024-09-18T02:04:25.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.132+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94393297256736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f67580 con 0x55d9a6f387e0 2024-09-18T02:04:25.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.132+0000 7f471d0a8640 1 -- 172.21.15.167:0/140979279 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94393297256736] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471400e6c0 con 0x55d9a6f387e0 2024-09-18T02:04:25.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.132+0000 7f471fd99980 20 remove_watcher() i=2 2024-09-18T02:04:25.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.132+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94393297269888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3c120 con 0x7f4714037040 2024-09-18T02:04:25.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.132+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94393297269888] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x7f4714037040 2024-09-18T02:04:25.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.132+0000 7f471fd99980 20 remove_watcher() i=3 2024-09-18T02:04:25.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.132+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94393297274320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f67580 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.136+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94393297274320] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471800a4d0 con 0x55d9a6f2f4d0 2024-09-18T02:04:25.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.136+0000 7f471fd99980 20 remove_watcher() i=4 2024-09-18T02:04:25.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.136+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94393297271744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f3c120 con 0x55d9a6f33e70 2024-09-18T02:04:25.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.136+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94393297271744] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.136+0000 7f471fd99980 20 remove_watcher() i=5 2024-09-18T02:04:25.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.136+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94393297276528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f405d0 con 0x55d9a6f33e70 2024-09-18T02:04:25.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94393297276528] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 20 remove_watcher() i=6 2024-09-18T02:04:25.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94393297283072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9a6f67580 con 0x55d9a6f33e70 2024-09-18T02:04:25.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471d8a9640 1 -- 172.21.15.167:0/140979279 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94393297283072] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4710113030 con 0x55d9a6f33e70 2024-09-18T02:04:25.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 20 remove_watcher() i=7 2024-09-18T02:04:25.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d9a6f33e70 msgr2=0x55d9a6f36260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d9a6f33e70 0x55d9a6f36260 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d9a6f2f4d0 msgr2=0x55d9a6f31970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d9a6f2f4d0 0x55d9a6f31970 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4714037040 msgr2=0x7f4714036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4714037040 0x7f4714036410 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d9a6f387e0 msgr2=0x55d9a6f3ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d9a6f387e0 0x55d9a6f3ac50 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f45e8034650 msgr2=0x7f45e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f45e8034650 0x7f45e8036b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55d9a6efa7c0 tx=0x7f4714010000 comp rx=0 tx=0).stop 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471e0aa640 1 -- 172.21.15.167:0/140979279 reap_dead start 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 msgr2=0x55d9a6f24520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f24520 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f47100d4fd0 tx=0x7f47100a8f20 comp rx=0 tx=0).stop 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 shutdown_connections 2024-09-18T02:04:25.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 --2- 172.21.15.167:0/140979279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f1d370 0x55d9a6f24520 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 >> 172.21.15.167:0/140979279 conn(0x55d9a6f197e0 msgr2=0x55d9a6f178b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 shutdown_connections 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/140979279 wait complete. 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/3330778616 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f45f8034650 msgr2=0x7f45f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 --2- 172.21.15.167:0/3330778616 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f45f8034650 0x7f45f8036b10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f471400c010 tx=0x7f471400f000 comp rx=0 tx=0).stop 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 -- 172.21.15.167:0/3330778616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f10b60 msgr2=0x55d9a6f10f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.140+0000 7f471fd99980 1 --2- 172.21.15.167:0/3330778616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f10b60 0x55d9a6f10f80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f47100cafd0 tx=0x7f47100ca6e0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/3330778616 shutdown_connections 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 --2- 172.21.15.167:0/3330778616 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f45f8034650 0x7f45f8036b10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 --2- 172.21.15.167:0/3330778616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6f10b60 0x55d9a6f10f80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/3330778616 >> 172.21.15.167:0/3330778616 conn(0x55d9a6f05cb0 msgr2=0x55d9a6f08730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/3330778616 shutdown_connections 2024-09-18T02:04:25.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/3330778616 wait complete. 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d9a6efc620 msgr2=0x55d9a6efea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d9a6efc620 0x55d9a6efea10 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d9a6e01230 msgr2=0x55d9a6ef9d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d9a6e01230 0x55d9a6ef9d40 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d9a6f00560 msgr2=0x55d9a6f02950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d9a6f00560 0x55d9a6f02950 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4604034650 msgr2=0x7f4604036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4604034650 0x7f4604036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4714000f70 tx=0x7f47140010b0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 msgr2=0x55d9a6ef2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 --2- 172.21.15.167:0/2864613674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9a6e008e0 0x55d9a6ef2c40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f471001bb20 tx=0x7f4710018020 comp rx=0 tx=0).stop 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471e0aa640 1 -- 172.21.15.167:0/2864613674 reap_dead start 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 shutdown_connections 2024-09-18T02:04:25.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 >> 172.21.15.167:0/2864613674 conn(0x55d9a6d74230 msgr2=0x55d9a6ee6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 shutdown_connections 2024-09-18T02:04:25.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.144+0000 7f471fd99980 1 -- 172.21.15.167:0/2864613674 wait complete. 2024-09-18T02:04:25.155 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:25.157 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-18T02:04:25.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-18T02:04:25.157 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-18T02:04:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.224+0000 7f3216040980 1 Processor -- start 2024-09-18T02:04:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.224+0000 7f3216040980 1 -- start start 2024-09-18T02:04:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.224+0000 7f3216040980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x563c025d8c60 0x563c025db050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.224+0000 7f3216040980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563c0245aae0 con 0x563c025d48e0 2024-09-18T02:04:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.224+0000 7f3216040980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x563c0247ee30 con 0x563c025d8c60 2024-09-18T02:04:25.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.224+0000 7f321334f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x563c025d8c60 0x563c025db050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.224+0000 7f321334f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x563c025d8c60 0x563c025db050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58258/0 (socket says 172.21.15.167:58258) 2024-09-18T02:04:25.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.224+0000 7f321334f640 1 -- 172.21.15.167:0/2566209647 learned_addr learned my addr 172.21.15.167:0/2566209647 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:25.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.224+0000 7f3213b50640 1 --1- 172.21.15.167:0/2566209647 >> v1:172.21.15.81:6789/0 conn(0x563c025d48e0 0x563c025d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:55784/0 (socket says 172.21.15.167:55784) 2024-09-18T02:04:25.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.224+0000 7f321334f640 1 -- 172.21.15.167:0/2566209647 >> v1:172.21.15.81:6789/0 conn(0x563c025d48e0 legacy=0x563c025d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.224+0000 7f321334f640 1 -- 172.21.15.167:0/2566209647 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c025dc5a0 con 0x563c025d8c60 2024-09-18T02:04:25.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.228+0000 7f321334f640 1 --2- 172.21.15.167:0/2566209647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d8c60 0x563c025db050 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f320400a4e0 tx=0x7f320401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b5f78506460412 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.228+0000 7f3212b4e640 1 -- 172.21.15.167:0/2566209647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32040aa540 con 0x563c025d8c60 2024-09-18T02:04:25.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.228+0000 7f3212b4e640 1 -- 172.21.15.167:0/2566209647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32040aa6e0 con 0x563c025d8c60 2024-09-18T02:04:25.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.228+0000 7f3212b4e640 1 -- 172.21.15.167:0/2566209647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32040aaa40 con 0x563c025d8c60 2024-09-18T02:04:25.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.228+0000 7f3216040980 1 -- 172.21.15.167:0/2566209647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d8c60 msgr2=0x563c025db050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.228+0000 7f3216040980 1 --2- 172.21.15.167:0/2566209647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d8c60 0x563c025db050 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f320400a4e0 tx=0x7f320401b090 comp rx=0 tx=0).stop 2024-09-18T02:04:25.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.228+0000 7f3216040980 1 -- 172.21.15.167:0/2566209647 shutdown_connections 2024-09-18T02:04:25.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.228+0000 7f3216040980 1 --2- 172.21.15.167:0/2566209647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d8c60 0x563c025db050 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.228+0000 7f3216040980 1 -- 172.21.15.167:0/2566209647 >> 172.21.15.167:0/2566209647 conn(0x563c02548230 msgr2=0x563c02548640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.228+0000 7f3216040980 1 -- 172.21.15.167:0/2566209647 shutdown_connections 2024-09-18T02:04:25.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.228+0000 7f3216040980 1 -- 172.21.15.167:0/2566209647 wait complete. 2024-09-18T02:04:25.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.240+0000 7f3216040980 1 Processor -- start 2024-09-18T02:04:25.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.240+0000 7f3216040980 1 -- start start 2024-09-18T02:04:25.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.240+0000 7f3216040980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 0x563c026bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.240+0000 7f3216040980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c02480200 con 0x563c025d48e0 2024-09-18T02:04:25.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3213b50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 0x563c026bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3213b50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 0x563c026bfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58272/0 (socket says 172.21.15.167:58272) 2024-09-18T02:04:25.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3213b50640 1 -- 172.21.15.167:0/1830086059 learned_addr learned my addr 172.21.15.167:0/1830086059 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:25.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3213b50640 1 -- 172.21.15.167:0/1830086059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c026c0200 con 0x563c025d48e0 2024-09-18T02:04:25.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3213b50640 1 --2- 172.21.15.167:0/1830086059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 0x563c026bfc30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f320800b240 tx=0x7f320800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903809885d15fa6f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3101e0b640 1 -- 172.21.15.167:0/1830086059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f320800e700 con 0x563c025d48e0 2024-09-18T02:04:25.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3101e0b640 1 -- 172.21.15.167:0/1830086059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f320800e8a0 con 0x563c025d48e0 2024-09-18T02:04:25.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3101e0b640 1 -- 172.21.15.167:0/1830086059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f320800eb80 con 0x563c025d48e0 2024-09-18T02:04:25.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3216040980 1 -- 172.21.15.167:0/1830086059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 msgr2=0x563c026bfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3216040980 1 --2- 172.21.15.167:0/1830086059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 0x563c026bfc30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f320800b240 tx=0x7f320800b700 comp rx=0 tx=0).stop 2024-09-18T02:04:25.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3216040980 1 -- 172.21.15.167:0/1830086059 shutdown_connections 2024-09-18T02:04:25.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3216040980 1 --2- 172.21.15.167:0/1830086059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 0x563c026bfc30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3216040980 1 -- 172.21.15.167:0/1830086059 >> 172.21.15.167:0/1830086059 conn(0x563c02548230 msgr2=0x563c026bb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3216040980 1 -- 172.21.15.167:0/1830086059 shutdown_connections 2024-09-18T02:04:25.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3216040980 1 -- 172.21.15.167:0/1830086059 wait complete. 2024-09-18T02:04:25.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3216040980 1 Processor -- start 2024-09-18T02:04:25.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3216040980 1 -- start start 2024-09-18T02:04:25.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3216040980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 0x563c026c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3216040980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c025dc0a0 con 0x563c025d48e0 2024-09-18T02:04:25.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3213b50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 0x563c026c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3213b50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 0x563c026c6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58274/0 (socket says 172.21.15.167:58274) 2024-09-18T02:04:25.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3213b50640 1 -- 172.21.15.167:0/3697326160 learned_addr learned my addr 172.21.15.167:0/3697326160 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:25.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.244+0000 7f3213b50640 1 -- 172.21.15.167:0/3697326160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c026c74e0 con 0x563c025d48e0 2024-09-18T02:04:25.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3213b50640 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 0x563c026c6fa0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3208000fe0 tx=0x7f3208000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f30fbfff640 1 -- 172.21.15.167:0/3697326160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f320800f9c0 con 0x563c025d48e0 2024-09-18T02:04:25.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f30fbfff640 1 -- 172.21.15.167:0/3697326160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f320800fb80 con 0x563c025d48e0 2024-09-18T02:04:25.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c026c7770 con 0x563c025d48e0 2024-09-18T02:04:25.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f30fbfff640 1 -- 172.21.15.167:0/3697326160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f320801a480 con 0x563c025d48e0 2024-09-18T02:04:25.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c026ca450 con 0x563c025d48e0 2024-09-18T02:04:25.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f30fbfff640 1 -- 172.21.15.167:0/3697326160 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3208017070 con 0x563c025d48e0 2024-09-18T02:04:25.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f30fbfff640 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30fc0346a0 0x7f30fc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f30fbfff640 1 -- 172.21.15.167:0/3697326160 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3208015020 con 0x563c025d48e0 2024-09-18T02:04:25.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f321334f640 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30fc0346a0 0x7f30fc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3216040980 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563c025d8c60 0x563c026cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c026ce5c0 con 0x563c025d8c60 2024-09-18T02:04:25.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3214351640 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563c025d8c60 0x563c026cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f321334f640 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30fc0346a0 0x7f30fc036b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f32040ab000 tx=0x7f32040a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3214351640 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563c025d8c60 0x563c026cdf50 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3214351640 1 -- 172.21.15.167:0/3697326160 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f320c0083f0 con 0x563c025d8c60 2024-09-18T02:04:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c026cb670 con 0x563c025d8c60 2024-09-18T02:04:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3214351640 1 -- 172.21.15.167:0/3697326160 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f320c0083f0 con 0x563c025d8c60 2024-09-18T02:04:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3216040980 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563c026d08f0 0x563c026d2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c026d33b0 con 0x563c026d08f0 2024-09-18T02:04:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.248+0000 7f3213b50640 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563c026d08f0 0x563c026d2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3213b50640 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563c026d08f0 0x563c026d2ce0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3213b50640 1 -- 172.21.15.167:0/3697326160 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f320802e070 con 0x563c026d08f0 2024-09-18T02:04:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c026cf790 con 0x563c025d8c60 2024-09-18T02:04:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3214351640 1 -- 172.21.15.167:0/3697326160 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f320c0083f0 con 0x563c025d8c60 2024-09-18T02:04:25.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3216040980 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563c026d4810 0x563c026d6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c026d7300 con 0x563c026d4810 2024-09-18T02:04:25.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f321334f640 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563c026d4810 0x563c026d6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f321334f640 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563c026d4810 0x563c026d6c00 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f321334f640 1 -- 172.21.15.167:0/3697326160 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f32040bc040 con 0x563c026d4810 2024-09-18T02:04:25.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3216040980 1 Processor -- start 2024-09-18T02:04:25.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3216040980 1 -- start start 2024-09-18T02:04:25.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3216040980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026e4dd0 0x563c026e51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3216040980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c024d9800 con 0x563c026e4dd0 2024-09-18T02:04:25.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3213b50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026e4dd0 0x563c026e51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3213b50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026e4dd0 0x563c026e51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58290/0 (socket says 172.21.15.167:58290) 2024-09-18T02:04:25.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3213b50640 1 -- 172.21.15.167:0/642272992 learned_addr learned my addr 172.21.15.167:0/642272992 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:25.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.252+0000 7f3213b50640 1 -- 172.21.15.167:0/642272992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c026e5730 con 0x563c026e4dd0 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3213b50640 1 --2- 172.21.15.167:0/642272992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026e4dd0 0x563c026e51f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f320801cfd0 tx=0x7f3208017f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f30f97fa640 1 -- 172.21.15.167:0/642272992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f320801a8f0 con 0x563c026e4dd0 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3216040980 1 -- 172.21.15.167:0/642272992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c026e59c0 con 0x563c026e4dd0 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3216040980 1 -- 172.21.15.167:0/642272992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c026e59c0 con 0x563c026e4dd0 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f30f97fa640 1 -- 172.21.15.167:0/642272992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f320801aa90 con 0x563c026e4dd0 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f30f97fa640 1 -- 172.21.15.167:0/642272992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f320804a960 con 0x563c026e4dd0 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f30f97fa640 1 -- 172.21.15.167:0/642272992 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3208042430 con 0x563c026e4dd0 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f30f97fa640 1 --2- 172.21.15.167:0/642272992 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30ec0346a0 0x7f30ec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f30f97fa640 1 -- 172.21.15.167:0/642272992 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3208033b10 con 0x563c026e4dd0 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f321334f640 1 --2- 172.21.15.167:0/642272992 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30ec0346a0 0x7f30ec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3216040980 1 Processor -- start 2024-09-18T02:04:25.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3216040980 1 -- start start 2024-09-18T02:04:25.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f321334f640 1 --2- 172.21.15.167:0/642272992 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30ec0346a0 0x7f30ec036b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x563c026ceea0 tx=0x7f3204005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3216040980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 0x563c026f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3216040980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c026c0580 con 0x563c026f1610 2024-09-18T02:04:25.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3213b50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 0x563c026f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3213b50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 0x563c026f1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58302/0 (socket says 172.21.15.167:58302) 2024-09-18T02:04:25.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3213b50640 1 -- 172.21.15.167:0/599795176 learned_addr learned my addr 172.21.15.167:0/599795176 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3213b50640 1 -- 172.21.15.167:0/599795176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c026f1fe0 con 0x563c026f1610 2024-09-18T02:04:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f3213b50640 1 --2- 172.21.15.167:0/599795176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 0x563c026f1a10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f320800f700 tx=0x7f3208041f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1846d86946ac39 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f30f2ffd640 1 -- 172.21.15.167:0/599795176 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3208057070 con 0x563c026f1610 2024-09-18T02:04:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f30f2ffd640 1 -- 172.21.15.167:0/599795176 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3208047910 con 0x563c026f1610 2024-09-18T02:04:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.256+0000 7f30f2ffd640 1 -- 172.21.15.167:0/599795176 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f320804a1a0 con 0x563c026f1610 2024-09-18T02:04:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 -- 172.21.15.167:0/599795176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 msgr2=0x563c026f1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 --2- 172.21.15.167:0/599795176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 0x563c026f1a10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f320800f700 tx=0x7f3208041f20 comp rx=0 tx=0).stop 2024-09-18T02:04:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 -- 172.21.15.167:0/599795176 shutdown_connections 2024-09-18T02:04:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 --2- 172.21.15.167:0/599795176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 0x563c026f1a10 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 -- 172.21.15.167:0/599795176 >> 172.21.15.167:0/599795176 conn(0x563c026ed940 msgr2=0x563c026eba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 -- 172.21.15.167:0/599795176 shutdown_connections 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 -- 172.21.15.167:0/599795176 wait complete. 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 Processor -- start 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 -- start start 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 0x563c026f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c026f24d0 con 0x563c026f1610 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3213b50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 0x563c026f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3213b50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 0x563c026f86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58316/0 (socket says 172.21.15.167:58316) 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 learned_addr learned my addr 172.21.15.167:0/3160933798 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c026f8c10 con 0x563c026f1610 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3213b50640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 0x563c026f86d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3208016fd0 tx=0x7f3208039f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f30f17fa640 1 -- 172.21.15.167:0/3160933798 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32080472d0 con 0x563c026f1610 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c026f8c10 con 0x563c026f1610 2024-09-18T02:04:25.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c026f8c10 con 0x563c026f1610 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f30f17fa640 1 -- 172.21.15.167:0/3160933798 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3208047470 con 0x563c026f1610 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f30f17fa640 1 -- 172.21.15.167:0/3160933798 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f320800a9d0 con 0x563c026f1610 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f30f17fa640 1 -- 172.21.15.167:0/3160933798 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f320806a070 con 0x563c026f1610 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f30f17fa640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30dc034650 0x7f30dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f30f17fa640 1 -- 172.21.15.167:0/3160933798 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f320805b020 con 0x563c026f1610 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f321334f640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30dc034650 0x7f30dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563c027038b0 0x563c02705d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c027064c0 con 0x563c027038b0 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.260+0000 7f3214351640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563c027038b0 0x563c02705d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f321334f640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30dc034650 0x7f30dc036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f320400a190 tx=0x7f32040a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3214351640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563c027038b0 0x563c02705d70 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f320c0083f0 con 0x563c027038b0 2024-09-18T02:04:25.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 20 realm 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c027068d0 con 0x563c027038b0 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f320c0083f0 con 0x563c027038b0 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c027071a0 con 0x563c027038b0 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f320c0083f0 con 0x563c027038b0 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027038b0 2024-09-18T02:04:25.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f320c0083f0 con 0x563c027038b0 2024-09-18T02:04:25.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:25.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563c027082a0 0x563c0270a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c0270aca0 con 0x563c027082a0 2024-09-18T02:04:25.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3213b50640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563c027082a0 0x563c0270a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3213b50640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563c027082a0 0x563c0270a690 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:25.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 20 searching for the correct realm 2024-09-18T02:04:25.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563c0270cbf0 0x563c0270f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c0270f6d0 con 0x563c0270cbf0 2024-09-18T02:04:25.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f321334f640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563c0270cbf0 0x563c0270f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f321334f640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563c0270cbf0 0x563c0270f000 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f321334f640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f32040cd050 0x7f32040cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:25.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.264+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c0270f6d0 con 0x7f32040cd050 2024-09-18T02:04:25.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f32040cd050 0x7f32040cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:25.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f32040cd050 0x7f32040cd430 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:25.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c0083f0 con 0x7f32040cd050 2024-09-18T02:04:25.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027082a0 2024-09-18T02:04:25.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027038b0 2024-09-18T02:04:25.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c0083f0 con 0x563c027038b0 2024-09-18T02:04:25.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027038b0 2024-09-18T02:04:25.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027082a0 2024-09-18T02:04:25.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027082a0 2024-09-18T02:04:25.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x7f32040cd050 2024-09-18T02:04:25.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c0270cbf0 2024-09-18T02:04:25.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027038b0 2024-09-18T02:04:25.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.268+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027082a0 2024-09-18T02:04:25.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027038b0 2024-09-18T02:04:25.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x7f32040cd050 2024-09-18T02:04:25.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c0270cbf0 2024-09-18T02:04:25.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c0270cbf0 2024-09-18T02:04:25.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027082a0 2024-09-18T02:04:25.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c0270cbf0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c0270cbf0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027038b0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027038b0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.272+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027082a0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c0270cbf0 2024-09-18T02:04:25.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x7f32040cd050 2024-09-18T02:04:25.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027038b0 2024-09-18T02:04:25.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027082a0 2024-09-18T02:04:25.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c0270cbf0 2024-09-18T02:04:25.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027082a0 2024-09-18T02:04:25.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x7f32040cd050 2024-09-18T02:04:25.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c0270cbf0 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027082a0 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.276+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x563c027038b0 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c02707540 con 0x7f32040cd050 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:25.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c0270b560 con 0x563c027038b0 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c0270b560 con 0x563c027038b0 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c0270b560 con 0x563c0270cbf0 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 zone default found 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 4 Realm: () 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 zonegroup default 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c0270bf30 con 0x563c027082a0 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c0270bad0 con 0x563c0270cbf0 2024-09-18T02:04:25.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c02711a50 con 0x563c0270cbf0 2024-09-18T02:04:25.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:25.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 started sync module instance, tier type = 2024-09-18T02:04:25.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:25.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02710e70 con 0x7f32040cd050 2024-09-18T02:04:25.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94815738991504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02710e70 con 0x7f32040cd050 2024-09-18T02:04:25.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.280+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02712500 con 0x563c027038b0 2024-09-18T02:04:25.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.284+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94815738991504] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.284+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.284+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94815738995040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02710e70 con 0x563c027038b0 2024-09-18T02:04:25.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.284+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02712f40 con 0x563c0270cbf0 2024-09-18T02:04:25.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.284+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.284+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94815738997392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02713790 con 0x563c0270cbf0 2024-09-18T02:04:25.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.284+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02714190 con 0x7f32040cd050 2024-09-18T02:04:25.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.284+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94815738995040] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.288+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.288+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94815738988992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02714580 con 0x7f32040cd050 2024-09-18T02:04:25.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.288+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02714f40 con 0x563c027038b0 2024-09-18T02:04:25.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.288+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94815738997392] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.288+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94815738988992] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.288+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.288+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94815739002016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02714a90 con 0x563c027038b0 2024-09-18T02:04:25.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.288+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c027152e0 con 0x563c027082a0 2024-09-18T02:04:25.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.292+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94815739002016] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.292+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.292+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94815739005584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02714eb0 con 0x563c027082a0 2024-09-18T02:04:25.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.292+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02715fe0 con 0x563c027082a0 2024-09-18T02:04:25.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.292+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.292+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94815739005584] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.292+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94815739010112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c027166d0 con 0x563c027082a0 2024-09-18T02:04:25.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.292+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c027156c0 con 0x563c027082a0 2024-09-18T02:04:25.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94815739010112] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94815739008704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02716cc0 con 0x563c027082a0 2024-09-18T02:04:25.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3216040980 20 add_watcher() i=0 2024-09-18T02:04:25.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3216040980 20 add_watcher() i=1 2024-09-18T02:04:25.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3216040980 20 add_watcher() i=2 2024-09-18T02:04:25.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3216040980 20 add_watcher() i=3 2024-09-18T02:04:25.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3216040980 20 add_watcher() i=4 2024-09-18T02:04:25.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3216040980 20 add_watcher() i=5 2024-09-18T02:04:25.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3216040980 20 add_watcher() i=6 2024-09-18T02:04:25.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94815739008704] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3216040980 20 add_watcher() i=7 2024-09-18T02:04:25.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3216040980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:25.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c0271a0c0 con 0x563c027038b0 2024-09-18T02:04:25.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.296+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94815739011360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c027175b0 con 0x563c027038b0 2024-09-18T02:04:25.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94815739011360] v30'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f30c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:25.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:25.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:25.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 5 note: GC not initialized 2024-09-18T02:04:25.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f30c8fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:25.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:25.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 20 Filter name: none 2024-09-18T02:04:25.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f30427fc640 20 reqs_thread_entry: start 2024-09-18T02:04:25.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:25.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c0273d7b0 con 0x563c027038b0 2024-09-18T02:04:25.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:25.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:25.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:25.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:25.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c0273d290 con 0x7f32040cd050 2024-09-18T02:04:25.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 20 enabling bucket name=myfoo 2024-09-18T02:04:25.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:04:25.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c0273e220 con 0x7f32040cd050 2024-09-18T02:04:25.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-18T02:04:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 : miss 2024-09-18T02:04:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 20 rados->read ofs=0 len=0 2024-09-18T02:04:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:65 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c02740a60 con 0x563c0270cbf0 2024-09-18T02:04:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(65 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 2024-09-18T02:04:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.300+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 8.10 8:08d44b91:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02748850 con 0x563c0270cbf0 2024-09-18T02:04:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(66 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3216040980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3216040980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3216040980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3216040980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1, ofs0, ns] 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94815739187424 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c02743eb0 con 0x563c027082a0 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== watch-notify(notify (1) cookie 94815739008704 notify 128849018898 ret 0) ==== 794+0+0 (crc 0 0 0) 0x563c026e5730 con 0x563c027082a0 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f30f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94815739008704 notifier 4606 bl.length()=752 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f30f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 info.flags=0x17 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f30f2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1 to cache LRU end 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f30f2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(67 notify.7 [notify cookie 94815739187424 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f30f2ffd640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f30d8003eb0 con 0x563c027082a0 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== watch-notify(notify_complete (2) cookie 94815739187424 notify 128849018898 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563c026ca450 con 0x563c027082a0 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3216040980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_sources= new_sources= 2024-09-18T02:04:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3216040980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential sources added=[] removed=[] 2024-09-18T02:04:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3216040980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): orig_dests= new_dests= 2024-09-18T02:04:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3216040980 20 handle_bi_update(): bucket=:myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.1]): potential dests added=[] removed=[] 2024-09-18T02:04:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.304+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c027460e0 con 0x563c027038b0 2024-09-18T02:04:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3216040980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3216040980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3216040980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94815739209456 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c027460e0 con 0x563c027038b0 2024-09-18T02:04:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94815739002016 notify 128849018895 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f320c010040 con 0x563c027038b0 2024-09-18T02:04:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f30f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94815739002016 notifier 4606 bl.length()=567 2024-09-18T02:04:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f30f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f30f2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(70 notify.4 [notify cookie 94815739209456 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f30f2ffd640 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f30d8003eb0 con 0x563c027038b0 2024-09-18T02:04:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94815739209456 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f320c00ab50 con 0x563c027038b0 2024-09-18T02:04:25.324 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:25.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f30c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:25.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94815739011360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c0273b5e0 con 0x563c027038b0 2024-09-18T02:04:25.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94815739011360] v30'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94815738991504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c0273b5e0 con 0x7f32040cd050 2024-09-18T02:04:25.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94815738991504] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3216040980 20 remove_watcher() i=0 2024-09-18T02:04:25.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3216040980 2 removed watcher, disabling cache 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.308+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94815738995040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02711390 con 0x563c027038b0 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.312+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94815738995040] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.312+0000 7f3216040980 20 remove_watcher() i=1 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.312+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94815738997392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c0273b5e0 con 0x563c0270cbf0 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.312+0000 7f321334f640 1 -- 172.21.15.167:0/3160933798 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94815738997392] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32040ca070 con 0x563c0270cbf0 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.312+0000 7f3216040980 20 remove_watcher() i=2 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.312+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94815738988992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02712160 con 0x7f32040cd050 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.316+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94815738988992] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x7f32040cd050 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.316+0000 7f3216040980 20 remove_watcher() i=3 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.316+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94815739002016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02712a90 con 0x563c027038b0 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.316+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94815739002016] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c026040 con 0x563c027038b0 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.316+0000 7f3216040980 20 remove_watcher() i=4 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.316+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94815739005584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c0273b5e0 con 0x563c027082a0 2024-09-18T02:04:25.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.320+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94815739005584] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.320+0000 7f3216040980 20 remove_watcher() i=5 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.320+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94815739010112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02712160 con 0x563c027082a0 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.320+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94815739010112] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.320+0000 7f3216040980 20 remove_watcher() i=6 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.320+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94815739008704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c02712a90 con 0x563c027082a0 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3213b50640 1 -- 172.21.15.167:0/3160933798 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94815739008704] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3208073020 con 0x563c027082a0 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 20 remove_watcher() i=7 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563c027082a0 msgr2=0x563c0270a690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563c027082a0 0x563c0270a690 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563c027038b0 msgr2=0x563c02705d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563c027038b0 0x563c02705d70 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f32040cd050 msgr2=0x7f32040cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f32040cd050 0x7f32040cd430 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563c0270cbf0 msgr2=0x563c0270f000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563c0270cbf0 0x563c0270f000 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30dc034650 msgr2=0x7f30dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30dc034650 0x7f30dc036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f320400a190 tx=0x7f32040a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:25.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 msgr2=0x563c026f86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/3160933798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026f1610 0x563c026f86d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3208016fd0 tx=0x7f3208039f30 comp rx=0 tx=0).stop 2024-09-18T02:04:25.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3214351640 1 -- 172.21.15.167:0/3160933798 reap_dead start 2024-09-18T02:04:25.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 shutdown_connections 2024-09-18T02:04:25.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 >> 172.21.15.167:0/3160933798 conn(0x563c026ed940 msgr2=0x563c026eba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 shutdown_connections 2024-09-18T02:04:25.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3160933798 wait complete. 2024-09-18T02:04:25.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/642272992 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30ec0346a0 msgr2=0x7f30ec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/642272992 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30ec0346a0 0x7f30ec036b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x563c026ceea0 tx=0x7f3204005e50 comp rx=0 tx=0).stop 2024-09-18T02:04:25.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/642272992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026e4dd0 msgr2=0x563c026e51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/642272992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026e4dd0 0x563c026e51f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f320801cfd0 tx=0x7f3208017f50 comp rx=0 tx=0).stop 2024-09-18T02:04:25.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/642272992 shutdown_connections 2024-09-18T02:04:25.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/642272992 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30ec0346a0 0x7f30ec036b60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/642272992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c026e4dd0 0x563c026e51f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/642272992 >> 172.21.15.167:0/642272992 conn(0x563c026d9f20 msgr2=0x563c026dc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/642272992 shutdown_connections 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/642272992 wait complete. 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563c026d08f0 msgr2=0x563c026d2ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563c026d08f0 0x563c026d2ce0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563c025d8c60 msgr2=0x563c026cdf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563c025d8c60 0x563c026cdf50 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563c026d4810 msgr2=0x563c026d6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563c026d4810 0x563c026d6c00 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30fc0346a0 msgr2=0x7f30fc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f30fc0346a0 0x7f30fc036b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f32040ab000 tx=0x7f32040a5000 comp rx=0 tx=0).stop 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 msgr2=0x563c026c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 --2- 172.21.15.167:0/3697326160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c025d48e0 0x563c026c6fa0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3208000fe0 tx=0x7f3208000ee0 comp rx=0 tx=0).stop 2024-09-18T02:04:25.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3214351640 1 -- 172.21.15.167:0/3697326160 reap_dead start 2024-09-18T02:04:25.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 shutdown_connections 2024-09-18T02:04:25.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 >> 172.21.15.167:0/3697326160 conn(0x563c02548230 msgr2=0x563c026ba3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:25.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 shutdown_connections 2024-09-18T02:04:25.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:25.324+0000 7f3216040980 1 -- 172.21.15.167:0/3697326160 wait complete. 2024-09-18T02:04:25.337 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:25.345 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T02:04:25.705 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-18T02:04:25.723 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:40.724 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-18T02:04:40.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-18T02:04:40.725 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-18T02:04:40.763 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:40.763 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:40.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.759+0000 7f00c02d2980 1 Processor -- start 2024-09-18T02:04:40.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.759+0000 7f00c02d2980 1 -- start start 2024-09-18T02:04:40.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.759+0000 7f00c02d2980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d2b4673c60 0x55d2b4676050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.759+0000 7f00c02d2980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d2b44f5ae0 con 0x55d2b466f8e0 2024-09-18T02:04:40.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.759+0000 7f00c02d2980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55d2b4519e30 con 0x55d2b4673c60 2024-09-18T02:04:40.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.759+0000 7f00bd5e1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d2b4673c60 0x55d2b4676050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00bdde2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55d2b466f8e0 0x55d2b466fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:42592/0 (socket says 172.21.15.167:42592) 2024-09-18T02:04:40.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00bdde2640 1 -- 172.21.15.167:0/2579739040 learned_addr learned my addr 172.21.15.167:0/2579739040 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:40.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00bd5e1640 1 -- 172.21.15.167:0/2579739040 >> v1:172.21.15.81:6789/0 conn(0x55d2b466f8e0 legacy=0x55d2b466fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00bd5e1640 1 -- 172.21.15.167:0/2579739040 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b46775a0 con 0x55d2b4673c60 2024-09-18T02:04:40.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/2579739040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b4673c60 0x55d2b4676050 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f00b400a480 tx=0x7f00b401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9cc94b365536e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00bcde0640 1 -- 172.21.15.167:0/2579739040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40b0070 con 0x55d2b4673c60 2024-09-18T02:04:40.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00bcde0640 1 -- 172.21.15.167:0/2579739040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b40ab540 con 0x55d2b4673c60 2024-09-18T02:04:40.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00bcde0640 1 -- 172.21.15.167:0/2579739040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40ab840 con 0x55d2b4673c60 2024-09-18T02:04:40.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00c02d2980 1 -- 172.21.15.167:0/2579739040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b4673c60 msgr2=0x55d2b4676050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00c02d2980 1 --2- 172.21.15.167:0/2579739040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b4673c60 0x55d2b4676050 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f00b400a480 tx=0x7f00b401b280 comp rx=0 tx=0).stop 2024-09-18T02:04:40.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00c02d2980 1 -- 172.21.15.167:0/2579739040 shutdown_connections 2024-09-18T02:04:40.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.763+0000 7f00c02d2980 1 --2- 172.21.15.167:0/2579739040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b4673c60 0x55d2b4676050 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.767+0000 7f00c02d2980 1 -- 172.21.15.167:0/2579739040 >> 172.21.15.167:0/2579739040 conn(0x55d2b45e3230 msgr2=0x55d2b45e3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:40.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.767+0000 7f00c02d2980 1 -- 172.21.15.167:0/2579739040 shutdown_connections 2024-09-18T02:04:40.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.767+0000 7f00c02d2980 1 -- 172.21.15.167:0/2579739040 wait complete. 2024-09-18T02:04:40.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 Processor -- start 2024-09-18T02:04:40.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 -- start start 2024-09-18T02:04:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 0x55d2b475ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d2b451b200 con 0x55d2b466f8e0 2024-09-18T02:04:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00bdde2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 0x55d2b475ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00bdde2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 0x55d2b475ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33008/0 (socket says 172.21.15.167:33008) 2024-09-18T02:04:40.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00bdde2640 1 -- 172.21.15.167:0/3839827854 learned_addr learned my addr 172.21.15.167:0/3839827854 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:40.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00bdde2640 1 -- 172.21.15.167:0/3839827854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b475b210 con 0x55d2b466f8e0 2024-09-18T02:04:40.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00bdde2640 1 --2- 172.21.15.167:0/3839827854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 0x55d2b475ac40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f00b0001e20 tx=0x7f00b000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451b1439552e50f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7effabe07640 1 -- 172.21.15.167:0/3839827854 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0012020 con 0x55d2b466f8e0 2024-09-18T02:04:40.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7effabe07640 1 -- 172.21.15.167:0/3839827854 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b000e7c0 con 0x55d2b466f8e0 2024-09-18T02:04:40.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7effabe07640 1 -- 172.21.15.167:0/3839827854 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b000eb00 con 0x55d2b466f8e0 2024-09-18T02:04:40.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 -- 172.21.15.167:0/3839827854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 msgr2=0x55d2b475ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 --2- 172.21.15.167:0/3839827854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 0x55d2b475ac40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f00b0001e20 tx=0x7f00b000b790 comp rx=0 tx=0).stop 2024-09-18T02:04:40.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 -- 172.21.15.167:0/3839827854 shutdown_connections 2024-09-18T02:04:40.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 --2- 172.21.15.167:0/3839827854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 0x55d2b475ac40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 -- 172.21.15.167:0/3839827854 >> 172.21.15.167:0/3839827854 conn(0x55d2b45e3230 msgr2=0x55d2b4756870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:40.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 -- 172.21.15.167:0/3839827854 shutdown_connections 2024-09-18T02:04:40.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 -- 172.21.15.167:0/3839827854 wait complete. 2024-09-18T02:04:40.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 Processor -- start 2024-09-18T02:04:40.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 -- start start 2024-09-18T02:04:40.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 0x55d2b4761ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00c02d2980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d2b46770a0 con 0x55d2b466f8e0 2024-09-18T02:04:40.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.783+0000 7f00bdde2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 0x55d2b4761ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00bdde2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 0x55d2b4761ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33022/0 (socket says 172.21.15.167:33022) 2024-09-18T02:04:40.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00bdde2640 1 -- 172.21.15.167:0/990104163 learned_addr learned my addr 172.21.15.167:0/990104163 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:40.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00bdde2640 1 -- 172.21.15.167:0/990104163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b4762530 con 0x55d2b466f8e0 2024-09-18T02:04:40.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00bdde2640 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 0x55d2b4761ff0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f00b0001e20 tx=0x7f00b0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7effaa604640 1 -- 172.21.15.167:0/990104163 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0012030 con 0x55d2b466f8e0 2024-09-18T02:04:40.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2b47627c0 con 0x55d2b466f8e0 2024-09-18T02:04:40.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7effaa604640 1 -- 172.21.15.167:0/990104163 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b0001480 con 0x55d2b466f8e0 2024-09-18T02:04:40.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7effaa604640 1 -- 172.21.15.167:0/990104163 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b001a910 con 0x55d2b466f8e0 2024-09-18T02:04:40.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b47654a0 con 0x55d2b466f8e0 2024-09-18T02:04:40.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7effaa604640 1 -- 172.21.15.167:0/990104163 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00b0015020 con 0x55d2b466f8e0 2024-09-18T02:04:40.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7effaa604640 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effa4034650 0x7effa4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7effaa604640 1 -- 172.21.15.167:0/990104163 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f00b0020030 con 0x55d2b466f8e0 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effa4034650 0x7effa4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00c02d2980 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d2b4673c60 0x55d2b4768fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b4769620 con 0x55d2b4673c60 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00be5e3640 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d2b4673c60 0x55d2b4768fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effa4034650 0x7effa4036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00b40ad000 tx=0x7f00b40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00be5e3640 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d2b4673c60 0x55d2b4768fe0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00be5e3640 1 -- 172.21.15.167:0/990104163 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b4673c60 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.787+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47666a0 con 0x55d2b4673c60 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00be5e3640 1 -- 172.21.15.167:0/990104163 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b4673c60 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00c02d2980 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d2b476b950 0x55d2b476dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b476e410 con 0x55d2b476b950 2024-09-18T02:04:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00bdde2640 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d2b476b950 0x55d2b476dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00bdde2640 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d2b476b950 0x55d2b476dd40 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00bdde2640 1 -- 172.21.15.167:0/990104163 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b476b950 2024-09-18T02:04:40.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b476a7f0 con 0x55d2b4673c60 2024-09-18T02:04:40.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00be5e3640 1 -- 172.21.15.167:0/990104163 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b4673c60 2024-09-18T02:04:40.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00c02d2980 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d2b476f850 0x55d2b4771c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47723d0 con 0x55d2b476f850 2024-09-18T02:04:40.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d2b476f850 0x55d2b4771c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d2b476f850 0x55d2b4771c40 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00bd5e1640 1 -- 172.21.15.167:0/990104163 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f00b40b3040 con 0x55d2b476f850 2024-09-18T02:04:40.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00c02d2980 1 Processor -- start 2024-09-18T02:04:40.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.791+0000 7f00c02d2980 1 -- start start 2024-09-18T02:04:40.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00c02d2980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b477fe60 0x55d2b4780280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00c02d2980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d2b4574800 con 0x55d2b477fe60 2024-09-18T02:04:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00bdde2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b477fe60 0x55d2b4780280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00bdde2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b477fe60 0x55d2b4780280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33038/0 (socket says 172.21.15.167:33038) 2024-09-18T02:04:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00bdde2640 1 -- 172.21.15.167:0/2721698257 learned_addr learned my addr 172.21.15.167:0/2721698257 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00bdde2640 1 -- 172.21.15.167:0/2721698257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b47807c0 con 0x55d2b477fe60 2024-09-18T02:04:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00bdde2640 1 --2- 172.21.15.167:0/2721698257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b477fe60 0x55d2b4780280 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f00b000b2d0 tx=0x7f00b000db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7effa37fe640 1 -- 172.21.15.167:0/2721698257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0017c50 con 0x55d2b477fe60 2024-09-18T02:04:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7effa37fe640 1 -- 172.21.15.167:0/2721698257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b0017df0 con 0x55d2b477fe60 2024-09-18T02:04:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00c02d2980 1 -- 172.21.15.167:0/2721698257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2b47809f0 con 0x55d2b477fe60 2024-09-18T02:04:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7effa37fe640 1 -- 172.21.15.167:0/2721698257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00166c0 con 0x55d2b477fe60 2024-09-18T02:04:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00c02d2980 1 -- 172.21.15.167:0/2721698257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b47809f0 con 0x55d2b477fe60 2024-09-18T02:04:40.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7effa37fe640 1 -- 172.21.15.167:0/2721698257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00b0009070 con 0x55d2b477fe60 2024-09-18T02:04:40.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7effa37fe640 1 --2- 172.21.15.167:0/2721698257 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 0x7eff98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7effa37fe640 1 -- 172.21.15.167:0/2721698257 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f00b003b070 con 0x55d2b477fe60 2024-09-18T02:04:40.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/2721698257 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 0x7eff98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00c02d2980 1 Processor -- start 2024-09-18T02:04:40.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00c02d2980 1 -- start start 2024-09-18T02:04:40.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/2721698257 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 0x7eff98036b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00b400a480 tx=0x7f00b4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00c02d2980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b478c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.795+0000 7f00c02d2980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d2b475b590 con 0x55d2b478c3f0 2024-09-18T02:04:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00bdde2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b478c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00bdde2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b478c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33040/0 (socket says 172.21.15.167:33040) 2024-09-18T02:04:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00bdde2640 1 -- 172.21.15.167:0/137579649 learned_addr learned my addr 172.21.15.167:0/137579649 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00bdde2640 1 -- 172.21.15.167:0/137579649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b478cda0 con 0x55d2b478c3f0 2024-09-18T02:04:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00bdde2640 1 --2- 172.21.15.167:0/137579649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b478c7d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f00b001a6f0 tx=0x7f00b002d510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37df34035e5cbfc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7effa17fa640 1 -- 172.21.15.167:0/137579649 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0050480 con 0x55d2b478c3f0 2024-09-18T02:04:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7effa17fa640 1 -- 172.21.15.167:0/137579649 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b0061070 con 0x55d2b478c3f0 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7effa17fa640 1 -- 172.21.15.167:0/137579649 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b003fc80 con 0x55d2b478c3f0 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00c02d2980 1 -- 172.21.15.167:0/137579649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 msgr2=0x55d2b478c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00c02d2980 1 --2- 172.21.15.167:0/137579649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b478c7d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f00b001a6f0 tx=0x7f00b002d510 comp rx=0 tx=0).stop 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00c02d2980 1 -- 172.21.15.167:0/137579649 shutdown_connections 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00c02d2980 1 --2- 172.21.15.167:0/137579649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b478c7d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00c02d2980 1 -- 172.21.15.167:0/137579649 >> 172.21.15.167:0/137579649 conn(0x55d2b47887d0 msgr2=0x55d2b47868d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00c02d2980 1 -- 172.21.15.167:0/137579649 shutdown_connections 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00c02d2980 1 -- 172.21.15.167:0/137579649 wait complete. 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00c02d2980 1 Processor -- start 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00c02d2980 1 -- start start 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00c02d2980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b47935c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00c02d2980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d2b478d240 con 0x55d2b478c3f0 2024-09-18T02:04:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00bdde2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b47935c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00bdde2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b47935c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33050/0 (socket says 172.21.15.167:33050) 2024-09-18T02:04:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 learned_addr learned my addr 172.21.15.167:0/1071409534 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b4793b00 con 0x55d2b478c3f0 2024-09-18T02:04:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.799+0000 7f00bdde2640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b47935c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f00b0035cd0 tx=0x7f00b0013fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7eff8f7fe640 1 -- 172.21.15.167:0/1071409534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0050480 con 0x55d2b478c3f0 2024-09-18T02:04:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2b4793b00 con 0x55d2b478c3f0 2024-09-18T02:04:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7eff8f7fe640 1 -- 172.21.15.167:0/1071409534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b00485b0 con 0x55d2b478c3f0 2024-09-18T02:04:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7eff8f7fe640 1 -- 172.21.15.167:0/1071409534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b00415a0 con 0x55d2b478c3f0 2024-09-18T02:04:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b4793b00 con 0x55d2b478c3f0 2024-09-18T02:04:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7eff8f7fe640 1 -- 172.21.15.167:0/1071409534 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00b0041740 con 0x55d2b478c3f0 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 20 rados->read ofs=0 len=0 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7eff8f7fe640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff88034650 0x7eff88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7eff8f7fe640 1 -- 172.21.15.167:0/1071409534 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f00b0059040 con 0x55d2b478c3f0 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff88034650 0x7eff88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d2b479e5a0 0x55d2b47a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a11b0 con 0x55d2b479e5a0 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00be5e3640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d2b479e5a0 0x55d2b47a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff88034650 0x7eff88036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f00b40ae040 tx=0x7f00b40b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00be5e3640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d2b479e5a0 0x55d2b47a0a60 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 20 realm 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 20 rados->read ofs=0 len=0 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a15c0 con 0x55d2b479e5a0 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 20 rados->read ofs=0 len=0 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a1e60 con 0x55d2b479e5a0 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 20 rados->read ofs=0 len=0 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b479e5a0 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:40.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 20 rados->read ofs=0 len=0 2024-09-18T02:04:40.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d2b47a2f60 0x55d2b47a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.803+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a58d0 con 0x55d2b47a2f60 2024-09-18T02:04:40.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00bdde2640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d2b47a2f60 0x55d2b47a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00bdde2640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d2b47a2f60 0x55d2b47a5350 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00c02d2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:40.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00c02d2980 20 searching for the correct realm 2024-09-18T02:04:40.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00c02d2980 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d2b47a7800 0x55d2b47a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47aa390 con 0x55d2b47a7800 2024-09-18T02:04:40.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d2b47a7800 0x55d2b47a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d2b47a7800 0x55d2b47a9cc0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00bd5e1640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00b40dc040 0x7f00b40dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47aa390 con 0x7f00b40dc040 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00be5e3640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00b40dc040 0x7f00b40dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00be5e3640 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00b40dc040 0x7f00b40dd430 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x7f00b40dc040 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b479e5a0 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b479e5a0 2024-09-18T02:04:40.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.807+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b479e5a0 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a2f60 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x7f00b40dc040 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a7800 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b479e5a0 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x7f00b40dc040 2024-09-18T02:04:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b479e5a0 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x7f00b40dc040 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a7800 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a7800 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.811+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a2f60 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a7800 2024-09-18T02:04:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a7800 2024-09-18T02:04:40.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b479e5a0 2024-09-18T02:04:40.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b479e5a0 2024-09-18T02:04:40.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a2f60 2024-09-18T02:04:40.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a7800 2024-09-18T02:04:40.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x7f00b40dc040 2024-09-18T02:04:40.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b479e5a0 2024-09-18T02:04:40.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a2f60 2024-09-18T02:04:40.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a7800 2024-09-18T02:04:40.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.815+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a2f60 2024-09-18T02:04:40.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x7f00b40dc040 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a7800 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b47a2f60 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x55d2b479e5a0 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a2200 con 0x7f00b40dc040 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 rados->read ofs=0 len=0 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a6120 con 0x55d2b479e5a0 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 rados->read ofs=0 len=0 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a6120 con 0x55d2b479e5a0 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 rados->read ofs=0 len=0 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a6120 con 0x55d2b47a7800 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 zone default found 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 4 Realm: () 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 zonegroup default 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 20 rados->read ofs=0 len=0 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.819+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47a69c0 con 0x55d2b47a2f60 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 20 rados->read ofs=0 len=0 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ac1f0 con 0x55d2b47a7800 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 20 rados->read ofs=0 len=0 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ac590 con 0x55d2b47a7800 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 20 started sync module instance, tier type = 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ab690 con 0x7f00b40dc040 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94363459435408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ab690 con 0x7f00b40dc040 2024-09-18T02:04:40.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ad000 con 0x55d2b479e5a0 2024-09-18T02:04:40.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.823+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94363459435408] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.827+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.827+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94363459439344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ab690 con 0x55d2b479e5a0 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.827+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ada10 con 0x55d2b47a7800 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.827+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94363459439344] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.827+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.827+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94363459432928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ab600 con 0x55d2b47a7800 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.827+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ae7a0 con 0x7f00b40dc040 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.831+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.831+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94363459445424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47af040 con 0x7f00b40dc040 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.831+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47afa40 con 0x55d2b479e5a0 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.831+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94363459432928] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.831+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94363459445424] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.831+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.831+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94363459444224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47aeb10 con 0x55d2b479e5a0 2024-09-18T02:04:40.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.831+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b02e0 con 0x55d2b47a2f60 2024-09-18T02:04:40.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.835+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.835+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94363459452464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47aeb10 con 0x55d2b47a2f60 2024-09-18T02:04:40.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.835+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b1020 con 0x55d2b47a2f60 2024-09-18T02:04:40.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.835+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94363459444224] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.835+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94363459452464] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.835+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.835+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94363459454592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b13c0 con 0x55d2b47a2f60 2024-09-18T02:04:40.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.835+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b1c50 con 0x55d2b47a2f60 2024-09-18T02:04:40.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94363459454592] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94363459455648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b1e30 con 0x55d2b47a2f60 2024-09-18T02:04:40.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00c02d2980 20 add_watcher() i=0 2024-09-18T02:04:40.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00c02d2980 20 add_watcher() i=1 2024-09-18T02:04:40.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00c02d2980 20 add_watcher() i=2 2024-09-18T02:04:40.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00c02d2980 20 add_watcher() i=3 2024-09-18T02:04:40.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00c02d2980 20 add_watcher() i=4 2024-09-18T02:04:40.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00c02d2980 20 add_watcher() i=5 2024-09-18T02:04:40.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00c02d2980 20 add_watcher() i=6 2024-09-18T02:04:40.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94363459455648] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00c02d2980 20 add_watcher() i=7 2024-09-18T02:04:40.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00c02d2980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:40.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.839+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b5200 con 0x55d2b479e5a0 2024-09-18T02:04:40.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.843+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.843+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94363459460384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b25f0 con 0x55d2b479e5a0 2024-09-18T02:04:40.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.843+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94363459460384] v32'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.843+0000 7eff73fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:40.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.843+0000 7f00c02d2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:40.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.843+0000 7f00c02d2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:40.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.843+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bd6f0 con 0x55d2b479e5a0 2024-09-18T02:04:40.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.847+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'48 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.847+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bdd20 con 0x55d2b47a2f60 2024-09-18T02:04:40.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.847+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.847+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47be120 con 0x55d2b47a7800 2024-09-18T02:04:40.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.847+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.847+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47be530 con 0x55d2b479e5a0 2024-09-18T02:04:40.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.851+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'159 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.851+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bb6d0 con 0x7f00b40dc040 2024-09-18T02:04:40.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.851+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.851+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bb6d0 con 0x55d2b47a7800 2024-09-18T02:04:40.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.855+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'41 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.855+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bf260 con 0x55d2b479e5a0 2024-09-18T02:04:40.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.855+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.855+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bf710 con 0x55d2b47a2f60 2024-09-18T02:04:40.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.859+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.859+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bf710 con 0x7f00b40dc040 2024-09-18T02:04:40.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.859+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.859+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bf710 con 0x55d2b47a7800 2024-09-18T02:04:40.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.863+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.863+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bf710 con 0x7f00b40dc040 2024-09-18T02:04:40.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.863+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'51 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.863+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bf710 con 0x55d2b47a2f60 2024-09-18T02:04:40.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.867+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.867+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bf820 con 0x7f00b40dc040 2024-09-18T02:04:40.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.867+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.867+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bf820 con 0x55d2b47a2f60 2024-09-18T02:04:40.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.871+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'49 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.871+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bf820 con 0x55d2b479e5a0 2024-09-18T02:04:40.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.871+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'160 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.871+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bf820 con 0x55d2b47a7800 2024-09-18T02:04:40.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.875+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'45 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.875+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bff90 con 0x7f00b40dc040 2024-09-18T02:04:40.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.875+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'52 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.875+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bff40 con 0x55d2b47a7800 2024-09-18T02:04:40.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.875+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.875+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bff40 con 0x55d2b479e5a0 2024-09-18T02:04:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.879+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.879+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x55d2b479e5a0 2024-09-18T02:04:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.883+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'161 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.883+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x55d2b47a7800 2024-09-18T02:04:40.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.883+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'46 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.883+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x7f00b40dc040 2024-09-18T02:04:40.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.887+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.887+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x55d2b47a7800 2024-09-18T02:04:40.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.887+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.887+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x55d2b47a7800 2024-09-18T02:04:40.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.891+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.891+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x55d2b47a7800 2024-09-18T02:04:40.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.891+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.891+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x55d2b47a7800 2024-09-18T02:04:40.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.891+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'42 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.891+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x55d2b47a2f60 2024-09-18T02:04:40.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.895+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.895+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x55d2b47a7800 2024-09-18T02:04:40.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.899+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.899+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x55d2b47a2f60 2024-09-18T02:04:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.899+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.899+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x55d2b47a7800 2024-09-18T02:04:40.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.903+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'47 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.903+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bfeb0 con 0x55d2b47a2f60 2024-09-18T02:04:40.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.907+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'50 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.907+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47bb450 con 0x7f00b40dc040 2024-09-18T02:04:40.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.907+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.907+0000 7eff72fe5640 20 reqs_thread_entry: start 2024-09-18T02:04:40.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.907+0000 7f00c02d2980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:40.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.907+0000 7f00c02d2980 20 Filter name: none 2024-09-18T02:04:40.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.907+0000 7eff70fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:40.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.907+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba5e0 con 0x55d2b479e5a0 2024-09-18T02:04:40.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.911+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba5e0 con 0x55d2b479e5a0 2024-09-18T02:04:40.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba5e0 con 0x55d2b479e5a0 2024-09-18T02:04:40.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b800a4d0 con 0x7f00b40dc040 2024-09-18T02:04:40.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba5e0 con 0x55d2b47a7800 2024-09-18T02:04:40.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.915+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba5e0 con 0x55d2b479e5a0 2024-09-18T02:04:40.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f00b800a4d0 con 0x55d2b479e5a0 2024-09-18T02:04:40.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.919+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba5e0 con 0x7f00b40dc040 2024-09-18T02:04:40.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba5e0 con 0x7f00b40dc040 2024-09-18T02:04:40.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba5e0 con 0x55d2b47a7800 2024-09-18T02:04:40.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba5e0 con 0x7f00b40dc040 2024-09-18T02:04:40.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.923+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba5e0 con 0x7f00b40dc040 2024-09-18T02:04:40.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.927+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba5e0 con 0x55d2b479e5a0 2024-09-18T02:04:40.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv19 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 38 ==== osd_op_reply(141 gc.15 [call out=1702b] v0'0 uv44 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.931+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b479e5a0 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.935+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.939+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv14 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.943+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.947+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a7800 2024-09-18T02:04:40.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.951+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.951+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.951+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.951+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.951+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.951+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x55d2b47a2f60 2024-09-18T02:04:40.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.951+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.951+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.951+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.951+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.955+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.955+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ba130 con 0x7f00b40dc040 2024-09-18T02:04:40.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.955+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.955+0000 7eff73fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:40.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.955+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94363459460384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b9d40 con 0x55d2b479e5a0 2024-09-18T02:04:40.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.955+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94363459460384] v32'162 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.955+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94363459435408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b1d20 con 0x7f00b40dc040 2024-09-18T02:04:40.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.959+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94363459435408] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.959+0000 7f00c02d2980 20 remove_watcher() i=0 2024-09-18T02:04:40.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.959+0000 7f00c02d2980 2 removed watcher, disabling cache 2024-09-18T02:04:40.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.959+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94363459439344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b1d20 con 0x55d2b479e5a0 2024-09-18T02:04:40.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.959+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94363459439344] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.959+0000 7f00c02d2980 20 remove_watcher() i=1 2024-09-18T02:04:40.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.959+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94363459432928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47acaf0 con 0x55d2b47a7800 2024-09-18T02:04:40.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.963+0000 7f00bd5e1640 1 -- 172.21.15.167:0/1071409534 <== osd.3 v2:172.21.15.167:6808/2476454287 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94363459432928] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40c9030 con 0x55d2b47a7800 2024-09-18T02:04:40.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.963+0000 7f00c02d2980 20 remove_watcher() i=2 2024-09-18T02:04:40.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.963+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94363459445424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b1d20 con 0x7f00b40dc040 2024-09-18T02:04:40.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.963+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.2 v2:172.21.15.167:6816/2055439504 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94363459445424] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b804e020 con 0x7f00b40dc040 2024-09-18T02:04:40.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.963+0000 7f00c02d2980 20 remove_watcher() i=3 2024-09-18T02:04:40.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.963+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94363459444224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ab1e0 con 0x55d2b479e5a0 2024-09-18T02:04:40.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.967+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 <== osd.1 v2:172.21.15.167:6800/15864359 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94363459444224] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b804e020 con 0x55d2b479e5a0 2024-09-18T02:04:40.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.967+0000 7f00c02d2980 20 remove_watcher() i=4 2024-09-18T02:04:40.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.967+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94363459452464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47acaf0 con 0x55d2b47a2f60 2024-09-18T02:04:40.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.971+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94363459452464] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.971+0000 7f00c02d2980 20 remove_watcher() i=5 2024-09-18T02:04:40.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.971+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94363459454592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47b1d20 con 0x55d2b47a2f60 2024-09-18T02:04:40.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.971+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94363459454592] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.971+0000 7f00c02d2980 20 remove_watcher() i=6 2024-09-18T02:04:40.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.971+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94363459455648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2b47ade00 con 0x55d2b47a2f60 2024-09-18T02:04:40.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00bdde2640 1 -- 172.21.15.167:0/1071409534 <== osd.0 v2:172.21.15.81:6800/3087415523 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94363459455648] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b0043040 con 0x55d2b47a2f60 2024-09-18T02:04:40.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 20 remove_watcher() i=7 2024-09-18T02:04:40.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d2b47a2f60 msgr2=0x55d2b47a5350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d2b47a2f60 0x55d2b47a5350 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d2b479e5a0 msgr2=0x55d2b47a0a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d2b479e5a0 0x55d2b47a0a60 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00b40dc040 msgr2=0x7f00b40dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00b40dc040 0x7f00b40dd430 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d2b47a7800 msgr2=0x55d2b47a9cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d2b47a7800 0x55d2b47a9cc0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff88034650 msgr2=0x7eff88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff88034650 0x7eff88036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f00b40ae040 tx=0x7f00b40b9040 comp rx=0 tx=0).stop 2024-09-18T02:04:40.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 msgr2=0x55d2b47935c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00be5e3640 1 -- 172.21.15.167:0/1071409534 reap_dead start 2024-09-18T02:04:40.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b47935c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f00b0035cd0 tx=0x7f00b0013fb0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 shutdown_connections 2024-09-18T02:04:40.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/1071409534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b478c3f0 0x55d2b47935c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 >> 172.21.15.167:0/1071409534 conn(0x55d2b47887d0 msgr2=0x55d2b47868a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:40.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 shutdown_connections 2024-09-18T02:04:40.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/1071409534 wait complete. 2024-09-18T02:04:40.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/2721698257 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 msgr2=0x7eff98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/2721698257 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 0x7eff98036b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00b400a480 tx=0x7f00b4005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:40.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/2721698257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b477fe60 msgr2=0x55d2b4780280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/2721698257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b477fe60 0x55d2b4780280 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f00b000b2d0 tx=0x7f00b000db30 comp rx=0 tx=0).stop 2024-09-18T02:04:40.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/2721698257 shutdown_connections 2024-09-18T02:04:40.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/2721698257 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7eff98034650 0x7eff98036b10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/2721698257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b477fe60 0x55d2b4780280 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/2721698257 >> 172.21.15.167:0/2721698257 conn(0x55d2b4774fb0 msgr2=0x55d2b4777a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:40.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/2721698257 shutdown_connections 2024-09-18T02:04:40.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/2721698257 wait complete. 2024-09-18T02:04:40.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d2b476b950 msgr2=0x55d2b476dd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d2b476b950 0x55d2b476dd40 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d2b4673c60 msgr2=0x55d2b4768fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d2b4673c60 0x55d2b4768fe0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d2b476f850 msgr2=0x55d2b4771c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d2b476f850 0x55d2b4771c40 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effa4034650 msgr2=0x7effa4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effa4034650 0x7effa4036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00b40ad000 tx=0x7f00b40a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:40.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 msgr2=0x55d2b4761ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:40.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 --2- 172.21.15.167:0/990104163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2b466f8e0 0x55d2b4761ff0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f00b0001e20 tx=0x7f00b0000ee0 comp rx=0 tx=0).stop 2024-09-18T02:04:40.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00be5e3640 1 -- 172.21.15.167:0/990104163 reap_dead start 2024-09-18T02:04:40.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 shutdown_connections 2024-09-18T02:04:40.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 >> 172.21.15.167:0/990104163 conn(0x55d2b45e3230 msgr2=0x55d2b47553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:40.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 shutdown_connections 2024-09-18T02:04:40.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:40.975+0000 7f00c02d2980 1 -- 172.21.15.167:0/990104163 wait complete. 2024-09-18T02:04:40.993 INFO:teuthology.orchestra.run.smithi167.stdout:[{"tag":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.14118683553326031381\u0000","time":"2024-09-18T02:04:40.718863+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_7","key":"","instance":""}]}] 2024-09-18T02:04:40.993 DEBUG:tasks.util.rgw: json result: [{'tag': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.14118683553326031381\x00', 'time': '2024-09-18T02:04:40.718863+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_7', 'key': '', 'instance': ''}]}] 2024-09-18T02:04:40.993 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-18T02:04:40.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-18T02:04:40.994 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-18T02:04:41.073 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:41.073 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:41.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d3048a980 1 Processor -- start 2024-09-18T02:04:41.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d3048a980 1 -- start start 2024-09-18T02:04:41.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d3048a980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a7c5f8a8d0 0x55a7c5f8acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d3048a980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a7c5e10ae0 con 0x55a7c5f8b220 2024-09-18T02:04:41.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d3048a980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55a7c5e34e30 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d2df9a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a7c5f8a8d0 0x55a7c5f8acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d2d799640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55a7c5f8b220 0x55a7c5f8fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:42594/0 (socket says 172.21.15.167:42594) 2024-09-18T02:04:41.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d2d799640 1 -- 172.21.15.167:0/1467672231 learned_addr learned my addr 172.21.15.167:0/1467672231 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:41.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d2cf98640 1 -- 172.21.15.167:0/1467672231 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2335909650 0 0) 0x55a7c5e10ae0 con 0x55a7c5f8b220 2024-09-18T02:04:41.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d2cf98640 1 -- 172.21.15.167:0/1467672231 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d1c001e20 con 0x55a7c5f8b220 2024-09-18T02:04:41.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d2df9a640 1 -- 172.21.15.167:0/1467672231 >> v1:172.21.15.81:6789/0 conn(0x55a7c5f8b220 legacy=0x55a7c5f8fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.071+0000 7f5d2df9a640 1 -- 172.21.15.167:0/1467672231 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c5f924a0 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.075+0000 7f5d2df9a640 1 --2- 172.21.15.167:0/1467672231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c5f8acb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800a420 tx=0x7f5d2801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964cec34cf1d8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.075+0000 7f5d2cf98640 1 -- 172.21.15.167:0/1467672231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280af070 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.075+0000 7f5d2cf98640 1 -- 172.21.15.167:0/1467672231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d280aa530 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.075+0000 7f5d2cf98640 1 -- 172.21.15.167:0/1467672231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280aa850 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.075+0000 7f5d3048a980 1 -- 172.21.15.167:0/1467672231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 msgr2=0x55a7c5f8acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.075+0000 7f5d3048a980 1 --2- 172.21.15.167:0/1467672231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c5f8acb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800a420 tx=0x7f5d2801afd0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.075+0000 7f5d3048a980 1 -- 172.21.15.167:0/1467672231 shutdown_connections 2024-09-18T02:04:41.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.075+0000 7f5d3048a980 1 --2- 172.21.15.167:0/1467672231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c5f8acb0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.075+0000 7f5d3048a980 1 -- 172.21.15.167:0/1467672231 >> 172.21.15.167:0/1467672231 conn(0x55a7c5efe220 msgr2=0x55a7c5efe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.075+0000 7f5d3048a980 1 -- 172.21.15.167:0/1467672231 shutdown_connections 2024-09-18T02:04:41.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.075+0000 7f5d3048a980 1 -- 172.21.15.167:0/1467672231 wait complete. 2024-09-18T02:04:41.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.091+0000 7f5d3048a980 1 Processor -- start 2024-09-18T02:04:41.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.091+0000 7f5d3048a980 1 -- start start 2024-09-18T02:04:41.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.091+0000 7f5d3048a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c60759c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.091+0000 7f5d3048a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a7c5e36200 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.091+0000 7f5d2df9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c60759c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.091+0000 7f5d2df9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c60759c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33064/0 (socket says 172.21.15.167:33064) 2024-09-18T02:04:41.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.091+0000 7f5d2df9a640 1 -- 172.21.15.167:0/3634016893 learned_addr learned my addr 172.21.15.167:0/3634016893 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.091+0000 7f5d2df9a640 1 -- 172.21.15.167:0/3634016893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c6075f90 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.091+0000 7f5d2df9a640 1 --2- 172.21.15.167:0/3634016893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c60759c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5d28018c00 tx=0x7f5d280033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c513007ab0c02d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.091+0000 7f5c1be07640 1 -- 172.21.15.167:0/3634016893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280b9070 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.091+0000 7f5c1be07640 1 -- 172.21.15.167:0/3634016893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d280aa9a0 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5c1be07640 1 -- 172.21.15.167:0/3634016893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280af040 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 -- 172.21.15.167:0/3634016893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 msgr2=0x55a7c60759c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 --2- 172.21.15.167:0/3634016893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c60759c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5d28018c00 tx=0x7f5d280033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 -- 172.21.15.167:0/3634016893 shutdown_connections 2024-09-18T02:04:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 --2- 172.21.15.167:0/3634016893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c60759c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 -- 172.21.15.167:0/3634016893 >> 172.21.15.167:0/3634016893 conn(0x55a7c5efe220 msgr2=0x55a7c60715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 -- 172.21.15.167:0/3634016893 shutdown_connections 2024-09-18T02:04:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 -- 172.21.15.167:0/3634016893 wait complete. 2024-09-18T02:04:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 Processor -- start 2024-09-18T02:04:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 -- start start 2024-09-18T02:04:41.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c607cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a7c5f91ee0 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d2df9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c607cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d2df9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c607cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33076/0 (socket says 172.21.15.167:33076) 2024-09-18T02:04:41.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d2df9a640 1 -- 172.21.15.167:0/2068840125 learned_addr learned my addr 172.21.15.167:0/2068840125 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d2df9a640 1 -- 172.21.15.167:0/2068840125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c607d170 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d2df9a640 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c607cc30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d280aa500 tx=0x7f5d28017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5c1a604640 1 -- 172.21.15.167:0/2068840125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280b9070 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7c607d400 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5c1a604640 1 -- 172.21.15.167:0/2068840125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d280aad10 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5c1a604640 1 -- 172.21.15.167:0/2068840125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280af040 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.095+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7c60800e0 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5c1a604640 1 -- 172.21.15.167:0/2068840125 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d280b2070 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5c1a604640 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c14034650 0x7f5c14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5c1a604640 1 -- 172.21.15.167:0/2068840125 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5d280e4f40 con 0x55a7c5f8a8d0 2024-09-18T02:04:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d2d799640 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c14034650 0x7f5c14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d3048a980 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a7c5f8b220 0x55a7c6083bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c6084200 con 0x55a7c5f8b220 2024-09-18T02:04:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d2e79b640 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a7c5f8b220 0x55a7c6083bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d2d799640 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c14034650 0x7f5c14036b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5d18000f70 tx=0x7f5d180010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d2e79b640 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a7c5f8b220 0x55a7c6083bc0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d2e79b640 1 -- 172.21.15.167:0/2068840125 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c5f8b220 2024-09-18T02:04:41.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60812e0 con 0x55a7c5f8b220 2024-09-18T02:04:41.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d2e79b640 1 -- 172.21.15.167:0/2068840125 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c5f8b220 2024-09-18T02:04:41.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d3048a980 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a7c6086530 0x55a7c6088920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c6088ff0 con 0x55a7c6086530 2024-09-18T02:04:41.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d2df9a640 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a7c6086530 0x55a7c6088920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d2df9a640 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a7c6086530 0x55a7c6088920 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d2df9a640 1 -- 172.21.15.167:0/2068840125 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d280cc020 con 0x55a7c6086530 2024-09-18T02:04:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60853d0 con 0x55a7c5f8b220 2024-09-18T02:04:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.099+0000 7f5d2e79b640 1 -- 172.21.15.167:0/2068840125 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c5f8b220 2024-09-18T02:04:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d3048a980 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a7c608a430 0x55a7c608c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c608cfb0 con 0x55a7c608a430 2024-09-18T02:04:41.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d2d799640 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a7c608a430 0x55a7c608c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d2d799640 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a7c608a430 0x55a7c608c820 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d2d799640 1 -- 172.21.15.167:0/2068840125 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c608a430 2024-09-18T02:04:41.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d3048a980 1 Processor -- start 2024-09-18T02:04:41.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d3048a980 1 -- start start 2024-09-18T02:04:41.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d3048a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c609aa40 0x55a7c609ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d3048a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a7c5e8f800 con 0x55a7c609aa40 2024-09-18T02:04:41.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d2df9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c609aa40 0x55a7c609ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d2df9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c609aa40 0x55a7c609ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33082/0 (socket says 172.21.15.167:33082) 2024-09-18T02:04:41.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d2df9a640 1 -- 172.21.15.167:0/3670966911 learned_addr learned my addr 172.21.15.167:0/3670966911 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d2df9a640 1 -- 172.21.15.167:0/3670966911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c609b3a0 con 0x55a7c609aa40 2024-09-18T02:04:41.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d2df9a640 1 --2- 172.21.15.167:0/3670966911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c609aa40 0x55a7c609ae60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5d280ce930 tx=0x7f5d280abda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5c137fe640 1 -- 172.21.15.167:0/3670966911 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280c4390 con 0x55a7c609aa40 2024-09-18T02:04:41.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5c137fe640 1 -- 172.21.15.167:0/3670966911 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d280a98d0 con 0x55a7c609aa40 2024-09-18T02:04:41.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d3048a980 1 -- 172.21.15.167:0/3670966911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7c609b630 con 0x55a7c609aa40 2024-09-18T02:04:41.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5c137fe640 1 -- 172.21.15.167:0/3670966911 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280c4b50 con 0x55a7c609aa40 2024-09-18T02:04:41.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.103+0000 7f5d3048a980 1 -- 172.21.15.167:0/3670966911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7c609e2b0 con 0x55a7c609aa40 2024-09-18T02:04:41.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5c137fe640 1 -- 172.21.15.167:0/3670966911 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d280d8070 con 0x55a7c609aa40 2024-09-18T02:04:41.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5c137fe640 1 --2- 172.21.15.167:0/3670966911 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c080346a0 0x7f5c08036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5c137fe640 1 -- 172.21.15.167:0/3670966911 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5d280d5040 con 0x55a7c609aa40 2024-09-18T02:04:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d2d799640 1 --2- 172.21.15.167:0/3670966911 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c080346a0 0x7f5c08036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 Processor -- start 2024-09-18T02:04:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 -- start start 2024-09-18T02:04:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d2d799640 1 --2- 172.21.15.167:0/3670966911 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c080346a0 0x7f5c08036b60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55a7c608d3b0 tx=0x7f5d1800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 0x55a7c60a7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a7c6076250 con 0x55a7c60a7320 2024-09-18T02:04:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d2df9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 0x55a7c60a7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d2df9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 0x55a7c60a7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33084/0 (socket says 172.21.15.167:33084) 2024-09-18T02:04:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d2df9a640 1 -- 172.21.15.167:0/743487100 learned_addr learned my addr 172.21.15.167:0/743487100 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d2df9a640 1 -- 172.21.15.167:0/743487100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c60a7cf0 con 0x55a7c60a7320 2024-09-18T02:04:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d2df9a640 1 --2- 172.21.15.167:0/743487100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 0x55a7c60a7720 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5d280b0fc0 tx=0x7f5d280dbda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268c1fe358d30b74 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5c117fa640 1 -- 172.21.15.167:0/743487100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280c5c10 con 0x55a7c60a7320 2024-09-18T02:04:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5c117fa640 1 -- 172.21.15.167:0/743487100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d280c4cf0 con 0x55a7c60a7320 2024-09-18T02:04:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5c117fa640 1 -- 172.21.15.167:0/743487100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280bd920 con 0x55a7c60a7320 2024-09-18T02:04:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 -- 172.21.15.167:0/743487100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 msgr2=0x55a7c60a7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 --2- 172.21.15.167:0/743487100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 0x55a7c60a7720 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5d280b0fc0 tx=0x7f5d280dbda0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 -- 172.21.15.167:0/743487100 shutdown_connections 2024-09-18T02:04:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 --2- 172.21.15.167:0/743487100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 0x55a7c60a7720 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 -- 172.21.15.167:0/743487100 >> 172.21.15.167:0/743487100 conn(0x55a7c60a3750 msgr2=0x55a7c60a1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 -- 172.21.15.167:0/743487100 shutdown_connections 2024-09-18T02:04:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 -- 172.21.15.167:0/743487100 wait complete. 2024-09-18T02:04:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 Processor -- start 2024-09-18T02:04:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 -- start start 2024-09-18T02:04:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 0x55a7c60ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.107+0000 7f5d3048a980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a7c60a81c0 con 0x55a7c60a7320 2024-09-18T02:04:41.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d2df9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 0x55a7c60ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d2df9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 0x55a7c60ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33094/0 (socket says 172.21.15.167:33094) 2024-09-18T02:04:41.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 learned_addr learned my addr 172.21.15.167:0/656563445 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c60aea30 con 0x55a7c60a7320 2024-09-18T02:04:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d2df9a640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 0x55a7c60ae4f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5d280a9a80 tx=0x7f5d280bbf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5bff7fe640 1 -- 172.21.15.167:0/656563445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280bd920 con 0x55a7c60a7320 2024-09-18T02:04:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7c60aea30 con 0x55a7c60a7320 2024-09-18T02:04:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5bff7fe640 1 -- 172.21.15.167:0/656563445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d280e5ca0 con 0x55a7c60a7320 2024-09-18T02:04:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5bff7fe640 1 -- 172.21.15.167:0/656563445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280bdac0 con 0x55a7c60a7320 2024-09-18T02:04:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7c60aea30 con 0x55a7c60a7320 2024-09-18T02:04:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5bff7fe640 1 -- 172.21.15.167:0/656563445 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d280b6070 con 0x55a7c60a7320 2024-09-18T02:04:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5bff7fe640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5bf8034650 0x7f5bf8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5bff7fe640 1 -- 172.21.15.167:0/656563445 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5d28105070 con 0x55a7c60a7320 2024-09-18T02:04:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d2d799640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5bf8034650 0x7f5bf8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d3048a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d3048a980 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a7c60b9620 0x55a7c60bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bc230 con 0x55a7c60b9620 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.111+0000 7f5d2e79b640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a7c60b9620 0x55a7c60bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d2d799640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5bf8034650 0x7f5bf8036b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d18020010 tx=0x7f5d18010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d2e79b640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a7c60b9620 0x55a7c60bbae0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 20 realm 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bc640 con 0x55a7c60b9620 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bcf10 con 0x55a7c60b9620 2024-09-18T02:04:41.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60b9620 2024-09-18T02:04:41.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a7c60be010 0x55a7c60c0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c0a10 con 0x55a7c60be010 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d2df9a640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a7c60be010 0x55a7c60c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d2df9a640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a7c60be010 0x55a7c60c0400 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 20 searching for the correct realm 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a7c60c2960 0x55a7c60c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c5440 con 0x55a7c60c2960 2024-09-18T02:04:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d2d799640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a7c60c2960 0x55a7c60c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.115+0000 7f5d2d799640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a7c60c2960 0x55a7c60c4d70 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2d799640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5d18037040 0x7f5d18036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c5440 con 0x7f5d18037040 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5d18037040 0x7f5d18036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5d18037040 0x7f5d18036410 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x7f5d18037040 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60b9620 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60b9620 2024-09-18T02:04:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60b9620 2024-09-18T02:04:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60be010 2024-09-18T02:04:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x7f5d18037040 2024-09-18T02:04:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60c2960 2024-09-18T02:04:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.119+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60b9620 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x7f5d18037040 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60b9620 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x7f5d18037040 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60c2960 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60c2960 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60be010 2024-09-18T02:04:41.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60c2960 2024-09-18T02:04:41.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60c2960 2024-09-18T02:04:41.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60b9620 2024-09-18T02:04:41.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60b9620 2024-09-18T02:04:41.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.123+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60be010 2024-09-18T02:04:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60c2960 2024-09-18T02:04:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x7f5d18037040 2024-09-18T02:04:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60b9620 2024-09-18T02:04:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60be010 2024-09-18T02:04:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60c2960 2024-09-18T02:04:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60be010 2024-09-18T02:04:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x7f5d18037040 2024-09-18T02:04:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60c2960 2024-09-18T02:04:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.127+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60be010 2024-09-18T02:04:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x55a7c60b9620 2024-09-18T02:04:41.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60bd2b0 con 0x7f5d18037040 2024-09-18T02:04:41.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:41.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:41.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:41.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c12d0 con 0x55a7c60b9620 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c12d0 con 0x55a7c60b9620 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c12d0 con 0x55a7c60c2960 2024-09-18T02:04:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 zone default found 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 4 Realm: () 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 zonegroup default 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c1c70 con 0x55a7c60be010 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c7330 con 0x55a7c60c2960 2024-09-18T02:04:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c77e0 con 0x55a7c60c2960 2024-09-18T02:04:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 started sync module instance, tier type = 2024-09-18T02:04:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.131+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c6740 con 0x7f5d18037040 2024-09-18T02:04:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.135+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.135+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94179070602336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c6740 con 0x7f5d18037040 2024-09-18T02:04:41.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.135+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c82a0 con 0x55a7c60b9620 2024-09-18T02:04:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.135+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94179070602336] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.135+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.135+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94179070606768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c6740 con 0x55a7c60b9620 2024-09-18T02:04:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.135+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c8cb0 con 0x55a7c60c2960 2024-09-18T02:04:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.139+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.139+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94179070609408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c9550 con 0x55a7c60c2960 2024-09-18T02:04:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.139+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c9f90 con 0x7f5d18037040 2024-09-18T02:04:41.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.139+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94179070606768] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.139+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.139+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94179070614112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60ca380 con 0x7f5d18037040 2024-09-18T02:04:41.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.139+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60cad40 con 0x55a7c60b9620 2024-09-18T02:04:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.139+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94179070609408] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.143+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94179070614112] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.143+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.143+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94179070599824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60ca890 con 0x55a7c60b9620 2024-09-18T02:04:41.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.143+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60cb0e0 con 0x55a7c60be010 2024-09-18T02:04:41.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.143+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94179070599824] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.143+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.143+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94179070617744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60cacb0 con 0x55a7c60be010 2024-09-18T02:04:41.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.143+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60cbde0 con 0x55a7c60be010 2024-09-18T02:04:41.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.147+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.147+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94179070622480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60cc580 con 0x55a7c60be010 2024-09-18T02:04:41.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.147+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60cd0a0 con 0x55a7c60be010 2024-09-18T02:04:41.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.147+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94179070617744] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.147+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94179070622480] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94179070626672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60cbfd0 con 0x55a7c60be010 2024-09-18T02:04:41.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 20 add_watcher() i=0 2024-09-18T02:04:41.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 20 add_watcher() i=1 2024-09-18T02:04:41.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 20 add_watcher() i=2 2024-09-18T02:04:41.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 20 add_watcher() i=3 2024-09-18T02:04:41.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 20 add_watcher() i=4 2024-09-18T02:04:41.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 20 add_watcher() i=5 2024-09-18T02:04:41.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 20 add_watcher() i=6 2024-09-18T02:04:41.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94179070626672] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 20 add_watcher() i=7 2024-09-18T02:04:41.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:41.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60d0090 con 0x55a7c60b9620 2024-09-18T02:04:41.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.151+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94179070620800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60cd510 con 0x55a7c60b9620 2024-09-18T02:04:41.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.155+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94179070620800] v32'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.155+0000 7f5bdf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:41.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.155+0000 7f5d3048a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:41.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.155+0000 7f5d3048a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:41.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.155+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60d88f0 con 0x55a7c60b9620 2024-09-18T02:04:41.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.155+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'49 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.155+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60d8f40 con 0x55a7c60be010 2024-09-18T02:04:41.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.159+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.159+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60d8f40 con 0x55a7c60c2960 2024-09-18T02:04:41.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.159+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.159+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60d9570 con 0x55a7c60b9620 2024-09-18T02:04:41.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.159+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'164 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.159+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60d9a20 con 0x7f5d18037040 2024-09-18T02:04:41.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.163+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'53 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.163+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60d66f0 con 0x55a7c60c2960 2024-09-18T02:04:41.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.163+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'43 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.163+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60d66f0 con 0x55a7c60b9620 2024-09-18T02:04:41.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.167+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.167+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60d66f0 con 0x55a7c60be010 2024-09-18T02:04:41.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.167+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.167+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da770 con 0x7f5d18037040 2024-09-18T02:04:41.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.171+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.171+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da770 con 0x55a7c60c2960 2024-09-18T02:04:41.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.171+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.171+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da770 con 0x7f5d18037040 2024-09-18T02:04:41.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.171+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'54 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.171+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da770 con 0x55a7c60be010 2024-09-18T02:04:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.175+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.175+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da770 con 0x7f5d18037040 2024-09-18T02:04:41.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.175+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.175+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da770 con 0x55a7c60be010 2024-09-18T02:04:41.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.179+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'51 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.179+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da800 con 0x55a7c60b9620 2024-09-18T02:04:41.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.179+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'165 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.179+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da800 con 0x55a7c60c2960 2024-09-18T02:04:41.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.183+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'48 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.183+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da800 con 0x7f5d18037040 2024-09-18T02:04:41.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.183+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'55 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.183+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da800 con 0x55a7c60c2960 2024-09-18T02:04:41.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.187+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.187+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da800 con 0x55a7c60b9620 2024-09-18T02:04:41.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.187+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.187+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da800 con 0x55a7c60b9620 2024-09-18T02:04:41.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.191+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'166 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.191+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60da800 con 0x55a7c60c2960 2024-09-18T02:04:41.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.191+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'49 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.191+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60daea0 con 0x7f5d18037040 2024-09-18T02:04:41.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.195+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.195+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60daea0 con 0x55a7c60c2960 2024-09-18T02:04:41.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.195+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.195+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60daea0 con 0x55a7c60c2960 2024-09-18T02:04:41.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.195+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.195+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60daea0 con 0x55a7c60c2960 2024-09-18T02:04:41.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.199+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.199+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60daea0 con 0x55a7c60c2960 2024-09-18T02:04:41.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.199+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'44 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.199+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60daea0 con 0x55a7c60be010 2024-09-18T02:04:41.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.203+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.203+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60daea0 con 0x55a7c60c2960 2024-09-18T02:04:41.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.203+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.203+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60daea0 con 0x55a7c60be010 2024-09-18T02:04:41.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.207+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.207+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60daea0 con 0x55a7c60c2960 2024-09-18T02:04:41.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.207+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'50 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.207+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60daea0 con 0x55a7c60be010 2024-09-18T02:04:41.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.211+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'52 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.211+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60daea0 con 0x7f5d18037040 2024-09-18T02:04:41.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.211+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.215+0000 7f5bde7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:41.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.215+0000 7f5d3048a980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:41.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.215+0000 7f5d3048a980 20 Filter name: none 2024-09-18T02:04:41.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.215+0000 7f5b4ffff640 20 reqs_thread_entry: start 2024-09-18T02:04:41.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.215+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-18T02:04:41.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.215+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:94 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.215+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(94 gc.30 [call] v32'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.215+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:95 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.215+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(95 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.219+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.219+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:96 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60be010 2024-09-18T02:04:41.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.219+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(96 gc.30 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.219+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:97 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.219+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(97 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.219+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.219+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:98 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.219+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(98 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.219+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.219+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:99 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.223+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(99 gc.30 [call] v32'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.223+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-18T02:04:41.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.223+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:100 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.223+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(100 gc.31 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.223+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:101 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.223+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(101 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.223+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.223+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:102 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x7f5d18037040 2024-09-18T02:04:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.223+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(102 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.223+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:103 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.227+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 23 ==== osd_op_reply(103 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.227+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.227+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:104 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.227+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 24 ==== osd_op_reply(104 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.227+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.227+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:105 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.227+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 25 ==== osd_op_reply(105 gc.31 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x7f5d18037040 2024-09-18T02:04:41.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.227+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-18T02:04:41.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.227+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:106 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(106 gc.0 [call] v32'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:107 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(107 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:108 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60b9620 2024-09-18T02:04:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(108 gc.0 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:109 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(109 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:110 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(110 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.231+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:111 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.235+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(111 gc.0 [call] v32'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.235+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-18T02:04:41.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.235+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:112 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.235+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(112 gc.1 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.235+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:113 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.239+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(113 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.239+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.239+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:114 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60be010 2024-09-18T02:04:41.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.239+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== osd_op_reply(114 gc.1 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.239+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:115 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.239+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== osd_op_reply(115 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.239+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.239+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:116 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.239+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== osd_op_reply(116 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.239+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.239+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:117 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.243+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 33 ==== osd_op_reply(117 gc.1 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.243+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-18T02:04:41.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.243+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:118 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.243+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(118 gc.2 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.243+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:119 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.243+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(119 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.243+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.243+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:120 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60c2960 2024-09-18T02:04:41.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.243+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(120 gc.2 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.243+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:121 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.247+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== osd_op_reply(121 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.247+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.247+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:122 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.247+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 31 ==== osd_op_reply(122 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.247+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.247+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:123 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.247+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 32 ==== osd_op_reply(123 gc.2 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.247+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-18T02:04:41.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.247+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:124 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(124 gc.3 [call] v32'167 uv167 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:125 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 35 ==== osd_op_reply(125 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:126 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60b9620 2024-09-18T02:04:41.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 36 ==== osd_op_reply(126 gc.3 [call out=24b] v0'0 uv167 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d200083f0 con 0x55a7c60b9620 2024-09-18T02:04:41.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:127 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 37 ==== osd_op_reply(127 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:128 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 38 ==== osd_op_reply(128 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.251+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:129 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 39 ==== osd_op_reply(129 gc.3 [call] v32'168 uv168 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-18T02:04:41.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:130 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 26 ==== osd_op_reply(130 gc.4 [call] v32'56 uv56 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:131 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 27 ==== osd_op_reply(131 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:132 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x7f5d18037040 2024-09-18T02:04:41.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 28 ==== osd_op_reply(132 gc.4 [call out=24b] v0'0 uv56 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:133 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 29 ==== osd_op_reply(133 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:134 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 30 ==== osd_op_reply(134 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.255+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:135 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.259+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 31 ==== osd_op_reply(135 gc.4 [call] v32'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.259+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-18T02:04:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.259+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:136 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.259+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 33 ==== osd_op_reply(136 gc.5 [call] v32'45 uv45 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.259+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:137 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.259+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 34 ==== osd_op_reply(137 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.259+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.259+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:138 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60c2960 2024-09-18T02:04:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.259+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 35 ==== osd_op_reply(138 gc.5 [call out=24b] v0'0 uv45 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.259+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:139 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.263+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 36 ==== osd_op_reply(139 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.263+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.263+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:140 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.263+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 37 ==== osd_op_reply(140 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.263+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.263+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:141 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.263+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 38 ==== osd_op_reply(141 gc.5 [call] v32'46 uv46 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.263+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-18T02:04:41.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.263+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:142 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 40 ==== osd_op_reply(142 gc.6 [call] v32'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:143 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 41 ==== osd_op_reply(143 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:144 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60b9620 2024-09-18T02:04:41.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 42 ==== osd_op_reply(144 gc.6 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:145 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 43 ==== osd_op_reply(145 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:146 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 44 ==== osd_op_reply(146 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.267+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:147 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.271+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 45 ==== osd_op_reply(147 gc.6 [call] v32'29 uv29 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.271+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-18T02:04:41.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.271+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:148 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.271+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 34 ==== osd_op_reply(148 gc.7 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.271+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:149 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.271+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 35 ==== osd_op_reply(149 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.271+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.271+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:150 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60be010 2024-09-18T02:04:41.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.275+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 36 ==== osd_op_reply(150 gc.7 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.275+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:151 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.275+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 37 ==== osd_op_reply(151 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.275+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.275+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:152 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.275+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 38 ==== osd_op_reply(152 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.275+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.275+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:153 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.279+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 39 ==== osd_op_reply(153 gc.7 [call] v32'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.279+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-18T02:04:41.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.279+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:154 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.279+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 32 ==== osd_op_reply(154 gc.8 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.279+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:155 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.279+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 33 ==== osd_op_reply(155 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.279+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.279+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:156 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x7f5d18037040 2024-09-18T02:04:41.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.283+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 34 ==== osd_op_reply(156 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.283+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:157 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.283+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 35 ==== osd_op_reply(157 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.283+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.283+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:158 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.283+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 36 ==== osd_op_reply(158 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.283+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.283+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:159 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.283+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 37 ==== osd_op_reply(159 gc.8 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.283+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-18T02:04:41.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.283+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:160 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 39 ==== osd_op_reply(160 gc.9 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:161 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 40 ==== osd_op_reply(161 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:162 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60c2960 2024-09-18T02:04:41.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 41 ==== osd_op_reply(162 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:163 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 42 ==== osd_op_reply(163 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:164 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 43 ==== osd_op_reply(164 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.287+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:165 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.291+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 44 ==== osd_op_reply(165 gc.9 [call] v32'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.291+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-18T02:04:41.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.291+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:166 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.291+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 38 ==== osd_op_reply(166 gc.10 [call] v32'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.291+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:167 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.291+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 39 ==== osd_op_reply(167 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.291+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.291+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:168 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x7f5d18037040 2024-09-18T02:04:41.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.291+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 40 ==== osd_op_reply(168 gc.10 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.291+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:169 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.295+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 41 ==== osd_op_reply(169 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.295+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.295+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:170 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.295+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 42 ==== osd_op_reply(170 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.295+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.295+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:171 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.295+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 43 ==== osd_op_reply(171 gc.10 [call] v32'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.295+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-18T02:04:41.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.295+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:172 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.299+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 40 ==== osd_op_reply(172 gc.11 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.299+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:173 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.299+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 41 ==== osd_op_reply(173 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.299+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.299+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:174 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60be010 2024-09-18T02:04:41.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.299+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 42 ==== osd_op_reply(174 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.299+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:175 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.303+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 43 ==== osd_op_reply(175 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.303+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.303+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:176 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.303+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 44 ==== osd_op_reply(176 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.303+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.303+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:177 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.307+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 45 ==== osd_op_reply(177 gc.11 [call] v32'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.307+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-18T02:04:41.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.307+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:178 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.307+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 44 ==== osd_op_reply(178 gc.12 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.307+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:179 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.307+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 45 ==== osd_op_reply(179 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.307+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.307+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:180 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x7f5d18037040 2024-09-18T02:04:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.311+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 46 ==== osd_op_reply(180 gc.12 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.311+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:181 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.311+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 47 ==== osd_op_reply(181 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.311+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.311+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:182 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.311+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 48 ==== osd_op_reply(182 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.311+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.311+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:183 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.311+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 49 ==== osd_op_reply(183 gc.12 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.311+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-18T02:04:41.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.311+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:184 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.315+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 46 ==== osd_op_reply(184 gc.13 [call] v32'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.315+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:185 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.315+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 47 ==== osd_op_reply(185 gc.13 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.315+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.315+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:186 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60be010 2024-09-18T02:04:41.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.315+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 48 ==== osd_op_reply(186 gc.13 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.319+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:187 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.319+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 49 ==== osd_op_reply(187 gc.13 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.319+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.319+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:188 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.319+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 50 ==== osd_op_reply(188 gc.13 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.319+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.319+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:189 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 51 ==== osd_op_reply(189 gc.13 [call] v32'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-18T02:04:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:190 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 46 ==== osd_op_reply(190 gc.14 [call] v32'169 uv169 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:191 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 47 ==== osd_op_reply(191 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:192 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60b9620 2024-09-18T02:04:41.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 48 ==== osd_op_reply(192 gc.14 [call out=24b] v0'0 uv169 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:193 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 49 ==== osd_op_reply(193 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.323+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:194 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.327+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 50 ==== osd_op_reply(194 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.327+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.327+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:195 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.327+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 51 ==== osd_op_reply(195 gc.14 [call] v32'170 uv170 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.327+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-18T02:04:41.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.327+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:196 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 45 ==== osd_op_reply(196 gc.15 [call] v32'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:197 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 46 ==== osd_op_reply(197 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:198 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60c2960 2024-09-18T02:04:41.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 47 ==== osd_op_reply(198 gc.15 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:199 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 48 ==== osd_op_reply(199 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:200 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 49 ==== osd_op_reply(200 gc.15 [call out=1702b] v0'0 uv51 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-18T02:04:41.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 20 garbage collection: RGWGC::process iterating over entry tag='c5231f36-c36e-44d5-8268-aaf52617db58.4235.14118683553326031381', time=2024-09-18T02:04:40.718863+0000, chain.objs.size()=7 2024-09-18T02:04:41.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_1 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:201 3.6 3:60ab0f3d:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7700 con 0x55a7c60b9620 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_2 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:202 3.0 3:0091f0c2:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60fa3b0 con 0x55a7c60be010 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_3 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:203 3.10 3:09cf3713:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60fcce0 con 0x55a7c60b9620 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_4 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:204 3.3f 3:fd8fdedf:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60ff5d0 con 0x7f5d18037040 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_5 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:205 3.19 3:982d70c5:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c6101f00 con 0x55a7c60b9620 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_6 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:206 3.3c 3:3ee8d58b:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c6104770 con 0x7f5d18037040 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_7 2024-09-18T02:04:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.331+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:207 3.36 3:6e691e93:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x7f5d18037040 2024-09-18T02:04:41.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.339+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 50 ==== osd_op_reply(204 c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_4 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.339+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 51 ==== osd_op_reply(207 c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_7 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.339+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 52 ==== osd_op_reply(203 c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_3 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.339+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 53 ==== osd_op_reply(201 c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_1 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.339+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 54 ==== osd_op_reply(205 c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_5 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.343+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 52 ==== osd_op_reply(206 c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_6 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.343+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 52 ==== osd_op_reply(202 c5231f36-c36e-44d5-8268-aaf52617db58.4235.1__shadow_.UijWyPFkYryLvqkbBDdE8tKs71GUKWV_2 [call] v32'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.343+0000 7f5d3048a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-18T02:04:41.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.343+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:208 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x55a7c60c2960 2024-09-18T02:04:41.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.343+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 50 ==== osd_op_reply(208 gc.15 [call] v32'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.347+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:209 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x55a7c60c2960 2024-09-18T02:04:41.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.347+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 51 ==== osd_op_reply(209 gc.15 [call] v32'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.347+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-18T02:04:41.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.347+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:210 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x7f5d18037040 2024-09-18T02:04:41.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 53 ==== osd_op_reply(210 gc.16 [call] v32'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:211 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x7f5d18037040 2024-09-18T02:04:41.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 54 ==== osd_op_reply(211 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:212 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x7f5d18037040 2024-09-18T02:04:41.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 55 ==== osd_op_reply(212 gc.16 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:213 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x7f5d18037040 2024-09-18T02:04:41.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 56 ==== osd_op_reply(213 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:214 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x7f5d18037040 2024-09-18T02:04:41.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 57 ==== osd_op_reply(214 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:215 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x7f5d18037040 2024-09-18T02:04:41.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 58 ==== osd_op_reply(215 gc.16 [call] v32'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-18T02:04:41.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.351+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:216 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x55a7c60c2960 2024-09-18T02:04:41.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 52 ==== osd_op_reply(216 gc.17 [call] v32'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:217 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x55a7c60c2960 2024-09-18T02:04:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 53 ==== osd_op_reply(217 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:218 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x55a7c60c2960 2024-09-18T02:04:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 54 ==== osd_op_reply(218 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:219 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x55a7c60c2960 2024-09-18T02:04:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 55 ==== osd_op_reply(219 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:220 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x55a7c60c2960 2024-09-18T02:04:41.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 56 ==== osd_op_reply(220 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.355+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:221 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x55a7c60c2960 2024-09-18T02:04:41.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.359+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 57 ==== osd_op_reply(221 gc.17 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.359+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-18T02:04:41.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.359+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:222 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x55a7c60b9620 2024-09-18T02:04:41.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.359+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 55 ==== osd_op_reply(222 gc.18 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.359+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:223 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c61072b0 con 0x55a7c60b9620 2024-09-18T02:04:41.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.359+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 56 ==== osd_op_reply(223 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.359+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.359+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:224 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60b9620 2024-09-18T02:04:41.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.363+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 57 ==== osd_op_reply(224 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.363+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:225 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.363+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 58 ==== osd_op_reply(225 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.363+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.363+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:226 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.363+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 59 ==== osd_op_reply(226 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.363+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.363+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:227 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.363+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 60 ==== osd_op_reply(227 gc.18 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.363+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-18T02:04:41.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.363+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:228 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 61 ==== osd_op_reply(228 gc.19 [call] v32'171 uv171 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:229 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 62 ==== osd_op_reply(229 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:230 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60b9620 2024-09-18T02:04:41.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 63 ==== osd_op_reply(230 gc.19 [call out=24b] v0'0 uv171 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:231 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 64 ==== osd_op_reply(231 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:232 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 65 ==== osd_op_reply(232 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.367+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:233 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60b9620 2024-09-18T02:04:41.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.371+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 66 ==== osd_op_reply(233 gc.19 [call] v32'172 uv172 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.371+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-18T02:04:41.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.371+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:234 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.371+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 58 ==== osd_op_reply(234 gc.20 [call] v32'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.371+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:235 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.371+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 59 ==== osd_op_reply(235 gc.20 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.371+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.371+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:236 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60c2960 2024-09-18T02:04:41.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.375+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 60 ==== osd_op_reply(236 gc.20 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.375+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:237 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.375+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 61 ==== osd_op_reply(237 gc.20 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.375+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.375+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:238 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.375+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 62 ==== osd_op_reply(238 gc.20 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.375+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.375+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:239 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.375+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 63 ==== osd_op_reply(239 gc.20 [call] v32'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.375+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-18T02:04:41.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.375+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:240 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 59 ==== osd_op_reply(240 gc.21 [call] v32'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:241 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 60 ==== osd_op_reply(241 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:242 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x7f5d18037040 2024-09-18T02:04:41.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 61 ==== osd_op_reply(242 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:243 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 62 ==== osd_op_reply(243 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:244 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 63 ==== osd_op_reply(244 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.379+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:245 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x7f5d18037040 2024-09-18T02:04:41.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.383+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 64 ==== osd_op_reply(245 gc.21 [call] v32'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.383+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-18T02:04:41.386 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.383+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:246 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.383+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 64 ==== osd_op_reply(246 gc.22 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.383+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:247 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.383+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 65 ==== osd_op_reply(247 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.383+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.383+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:248 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60c2960 2024-09-18T02:04:41.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.387+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 66 ==== osd_op_reply(248 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.387+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:249 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.387+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 67 ==== osd_op_reply(249 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.387+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.387+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:250 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.387+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 68 ==== osd_op_reply(250 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.387+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.387+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:251 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.387+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 69 ==== osd_op_reply(251 gc.22 [call] v32'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.387+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-18T02:04:41.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.387+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:252 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 70 ==== osd_op_reply(252 gc.23 [call] v32'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:253 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 71 ==== osd_op_reply(253 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:254 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60c2960 2024-09-18T02:04:41.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 72 ==== osd_op_reply(254 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:255 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 73 ==== osd_op_reply(255 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:256 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 74 ==== osd_op_reply(256 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.391+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:257 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.395+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 75 ==== osd_op_reply(257 gc.23 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.395+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-18T02:04:41.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.395+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:258 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.395+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 76 ==== osd_op_reply(258 gc.24 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.395+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:259 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.399+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 77 ==== osd_op_reply(259 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.399+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.399+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:260 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60c2960 2024-09-18T02:04:41.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.399+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 78 ==== osd_op_reply(260 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.399+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:261 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.399+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 79 ==== osd_op_reply(261 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.399+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.399+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:262 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.399+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 80 ==== osd_op_reply(262 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.399+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.404 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.399+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:263 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 81 ==== osd_op_reply(263 gc.24 [call] v32'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-18T02:04:41.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:264 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 82 ==== osd_op_reply(264 gc.25 [call] v32'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:265 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 83 ==== osd_op_reply(265 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:266 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f6120 con 0x55a7c60c2960 2024-09-18T02:04:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 84 ==== osd_op_reply(266 gc.25 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:267 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 85 ==== osd_op_reply(267 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.403+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:268 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.407+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 86 ==== osd_op_reply(268 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.407+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.407+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:269 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60c2960 2024-09-18T02:04:41.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.407+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 87 ==== osd_op_reply(269 gc.25 [call] v32'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.407+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-18T02:04:41.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.407+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:270 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.411+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 53 ==== osd_op_reply(270 gc.26 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.411+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:271 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.411+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 54 ==== osd_op_reply(271 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.411+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.411+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:272 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f65d0 con 0x55a7c60be010 2024-09-18T02:04:41.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.411+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 55 ==== osd_op_reply(272 gc.26 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.411+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:273 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.411+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 56 ==== osd_op_reply(273 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.411+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.411+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:274 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7130 con 0x55a7c60be010 2024-09-18T02:04:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.415+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 57 ==== osd_op_reply(274 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.415+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.415+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:275 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60be010 2024-09-18T02:04:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.415+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 58 ==== osd_op_reply(275 gc.26 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.415+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-18T02:04:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.415+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:276 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 88 ==== osd_op_reply(276 gc.27 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:277 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 89 ==== osd_op_reply(277 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:278 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 90 ==== osd_op_reply(278 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:279 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 91 ==== osd_op_reply(279 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:280 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 92 ==== osd_op_reply(280 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.419+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:281 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.423+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 93 ==== osd_op_reply(281 gc.27 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.423+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-18T02:04:41.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.423+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:282 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60be010 2024-09-18T02:04:41.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.427+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 59 ==== osd_op_reply(282 gc.28 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.427+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:283 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60be010 2024-09-18T02:04:41.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.427+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 60 ==== osd_op_reply(283 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.427+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.427+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:284 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60be010 2024-09-18T02:04:41.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.427+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 61 ==== osd_op_reply(284 gc.28 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.427+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:285 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60be010 2024-09-18T02:04:41.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.427+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 62 ==== osd_op_reply(285 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.427+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.427+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:286 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60be010 2024-09-18T02:04:41.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.431+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 63 ==== osd_op_reply(286 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.431+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.431+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:287 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60be010 2024-09-18T02:04:41.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.431+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 64 ==== osd_op_reply(287 gc.28 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.431+0000 7f5d3048a980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-18T02:04:41.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.431+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:288 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.435+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 94 ==== osd_op_reply(288 gc.29 [call] v32'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.435+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:289 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.435+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 95 ==== osd_op_reply(289 gc.29 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.435+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.435+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:290 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.439+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 96 ==== osd_op_reply(290 gc.29 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.439+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:291 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.439+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 97 ==== osd_op_reply(291 gc.29 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.439+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:04:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.439+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:292 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.439+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 98 ==== osd_op_reply(292 gc.29 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.439+0000 7f5d3048a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:04:41.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.439+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:293 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60f7be0 con 0x55a7c60c2960 2024-09-18T02:04:41.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.443+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 99 ==== osd_op_reply(293 gc.29 [call] v32'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.443+0000 7f5bdf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:41.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.443+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94179070620800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60d24e0 con 0x55a7c60b9620 2024-09-18T02:04:41.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.447+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 67 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94179070620800] v32'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.447+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94179070602336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60cb480 con 0x7f5d18037040 2024-09-18T02:04:41.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.447+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 65 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94179070602336] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.447+0000 7f5d3048a980 20 remove_watcher() i=0 2024-09-18T02:04:41.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.447+0000 7f5d3048a980 2 removed watcher, disabling cache 2024-09-18T02:04:41.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.447+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94179070606768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c6c60 con 0x55a7c60b9620 2024-09-18T02:04:41.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.451+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 68 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94179070606768] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.451+0000 7f5d3048a980 20 remove_watcher() i=1 2024-09-18T02:04:41.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.451+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94179070609408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c6c60 con 0x55a7c60c2960 2024-09-18T02:04:41.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.455+0000 7f5d2d799640 1 -- 172.21.15.167:0/656563445 <== osd.3 v2:172.21.15.167:6808/2476454287 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94179070609408] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d1800e6c0 con 0x55a7c60c2960 2024-09-18T02:04:41.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.455+0000 7f5d3048a980 20 remove_watcher() i=2 2024-09-18T02:04:41.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.455+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94179070614112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c6c60 con 0x7f5d18037040 2024-09-18T02:04:41.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.455+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.2 v2:172.21.15.167:6816/2055439504 66 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94179070614112] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x7f5d18037040 2024-09-18T02:04:41.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.455+0000 7f5d3048a980 20 remove_watcher() i=3 2024-09-18T02:04:41.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.455+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94179070599824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c9a60 con 0x55a7c60b9620 2024-09-18T02:04:41.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.459+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 <== osd.1 v2:172.21.15.167:6800/15864359 69 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94179070599824] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d20040040 con 0x55a7c60b9620 2024-09-18T02:04:41.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.459+0000 7f5d3048a980 20 remove_watcher() i=4 2024-09-18T02:04:41.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.459+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94179070617744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60c6290 con 0x55a7c60be010 2024-09-18T02:04:41.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.463+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 65 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94179070617744] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.463+0000 7f5d3048a980 20 remove_watcher() i=5 2024-09-18T02:04:41.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.463+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94179070622480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60ca890 con 0x55a7c60be010 2024-09-18T02:04:41.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.463+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 66 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94179070622480] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.463+0000 7f5d3048a980 20 remove_watcher() i=6 2024-09-18T02:04:41.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.463+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94179070626672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7c60cbb10 con 0x55a7c60be010 2024-09-18T02:04:41.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d2df9a640 1 -- 172.21.15.167:0/656563445 <== osd.0 v2:172.21.15.81:6800/3087415523 67 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94179070626672] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d280e1070 con 0x55a7c60be010 2024-09-18T02:04:41.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 20 remove_watcher() i=7 2024-09-18T02:04:41.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a7c60be010 msgr2=0x55a7c60c0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a7c60be010 0x55a7c60c0400 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a7c60b9620 msgr2=0x55a7c60bbae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a7c60b9620 0x55a7c60bbae0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5d18037040 msgr2=0x7f5d18036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5d18037040 0x7f5d18036410 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a7c60c2960 msgr2=0x55a7c60c4d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a7c60c2960 0x55a7c60c4d70 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5bf8034650 msgr2=0x7f5bf8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5bf8034650 0x7f5bf8036b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d18020010 tx=0x7f5d18010000 comp rx=0 tx=0).stop 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 msgr2=0x55a7c60ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/656563445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c60a7320 0x55a7c60ae4f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5d280a9a80 tx=0x7f5d280bbf90 comp rx=0 tx=0).stop 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d2e79b640 1 -- 172.21.15.167:0/656563445 reap_dead start 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 shutdown_connections 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 >> 172.21.15.167:0/656563445 conn(0x55a7c60a3750 msgr2=0x55a7c60a1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 shutdown_connections 2024-09-18T02:04:41.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/656563445 wait complete. 2024-09-18T02:04:41.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/3670966911 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c080346a0 msgr2=0x7f5c08036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/3670966911 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c080346a0 0x7f5c08036b60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55a7c608d3b0 tx=0x7f5d1800f000 comp rx=0 tx=0).stop 2024-09-18T02:04:41.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/3670966911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c609aa40 msgr2=0x55a7c609ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/3670966911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c609aa40 0x55a7c609ae60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5d280ce930 tx=0x7f5d280abda0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/3670966911 shutdown_connections 2024-09-18T02:04:41.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/3670966911 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c080346a0 0x7f5c08036b60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/3670966911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c609aa40 0x55a7c609ae60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/3670966911 >> 172.21.15.167:0/3670966911 conn(0x55a7c608fb90 msgr2=0x55a7c6092610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/3670966911 shutdown_connections 2024-09-18T02:04:41.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/3670966911 wait complete. 2024-09-18T02:04:41.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a7c6086530 msgr2=0x55a7c6088920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a7c6086530 0x55a7c6088920 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a7c5f8b220 msgr2=0x55a7c6083bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a7c5f8b220 0x55a7c6083bc0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a7c608a430 msgr2=0x55a7c608c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.467+0000 7f5d3048a980 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a7c608a430 0x55a7c608c820 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.471+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c14034650 msgr2=0x7f5c14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.471+0000 7f5d3048a980 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5c14034650 0x7f5c14036b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5d18000f70 tx=0x7f5d180010b0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.471+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 msgr2=0x55a7c607cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.471+0000 7f5d3048a980 1 --2- 172.21.15.167:0/2068840125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7c5f8a8d0 0x55a7c607cc30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d280aa500 tx=0x7f5d28017d70 comp rx=0 tx=0).stop 2024-09-18T02:04:41.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.471+0000 7f5d2e79b640 1 -- 172.21.15.167:0/2068840125 reap_dead start 2024-09-18T02:04:41.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.471+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 shutdown_connections 2024-09-18T02:04:41.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.471+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 >> 172.21.15.167:0/2068840125 conn(0x55a7c5efe220 msgr2=0x55a7c6070170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.471+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 shutdown_connections 2024-09-18T02:04:41.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.471+0000 7f5d3048a980 1 -- 172.21.15.167:0/2068840125 wait complete. 2024-09-18T02:04:41.489 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-18T02:04:41.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-18T02:04:41.490 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-18T02:04:41.570 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:41.570 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:41.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.567+0000 7fb5fddd3980 1 Processor -- start 2024-09-18T02:04:41.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.567+0000 7fb5fddd3980 1 -- start start 2024-09-18T02:04:41.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.567+0000 7fb5fddd3980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564794a93690 0x564794a93a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.567+0000 7fb5fddd3980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56479491bae0 con 0x564794a93fe0 2024-09-18T02:04:41.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.567+0000 7fb5fddd3980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x56479493fe30 con 0x564794a93690 2024-09-18T02:04:41.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.567+0000 7fb5fb8e3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564794a93690 0x564794a93a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.567+0000 7fb5fb8e3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564794a93690 0x564794a93a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33104/0 (socket says 172.21.15.167:33104) 2024-09-18T02:04:41.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.567+0000 7fb5f30e2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x564794a93fe0 0x564794a98a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:42596/0 (socket says 172.21.15.167:42596) 2024-09-18T02:04:41.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.567+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/2343615552 learned_addr learned my addr 172.21.15.167:0/2343615552 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/2343615552 >> v1:172.21.15.81:6789/0 conn(0x564794a93fe0 legacy=0x564794a98a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/2343615552 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564794a9b260 con 0x564794a93690 2024-09-18T02:04:41.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fb8e3640 1 --2- 172.21.15.167:0/2343615552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794a93a70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00a5c0 tx=0x7fb5ec01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bfe343aec3e815 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fb0e2640 1 -- 172.21.15.167:0/2343615552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0a6070 con 0x564794a93690 2024-09-18T02:04:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fb0e2640 1 -- 172.21.15.167:0/2343615552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ec0af070 con 0x564794a93690 2024-09-18T02:04:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fb0e2640 1 -- 172.21.15.167:0/2343615552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0aa5c0 con 0x564794a93690 2024-09-18T02:04:41.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fddd3980 1 -- 172.21.15.167:0/2343615552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 msgr2=0x564794a93a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/2343615552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794a93a70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00a5c0 tx=0x7fb5ec01b340 comp rx=0 tx=0).stop 2024-09-18T02:04:41.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fddd3980 1 -- 172.21.15.167:0/2343615552 shutdown_connections 2024-09-18T02:04:41.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/2343615552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794a93a70 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fddd3980 1 -- 172.21.15.167:0/2343615552 >> 172.21.15.167:0/2343615552 conn(0x564794a8f1b0 msgr2=0x564794a915d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fddd3980 1 -- 172.21.15.167:0/2343615552 shutdown_connections 2024-09-18T02:04:41.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.571+0000 7fb5fddd3980 1 -- 172.21.15.167:0/2343615552 wait complete. 2024-09-18T02:04:41.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.587+0000 7fb5fddd3980 1 Processor -- start 2024-09-18T02:04:41.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.587+0000 7fb5fddd3980 1 -- start start 2024-09-18T02:04:41.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.587+0000 7fb5fddd3980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794a0a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.587+0000 7fb5fddd3980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564794941200 con 0x564794a93690 2024-09-18T02:04:41.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.587+0000 7fb5fb8e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794a0a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.587+0000 7fb5fb8e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794a0a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33114/0 (socket says 172.21.15.167:33114) 2024-09-18T02:04:41.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.587+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/435910797 learned_addr learned my addr 172.21.15.167:0/435910797 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/435910797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564794a0a940 con 0x564794a93690 2024-09-18T02:04:41.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fb8e3640 1 --2- 172.21.15.167:0/435910797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794a0a370 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0199f0 tx=0x7fb5ec003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc0fd25cf55fdfc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb4e9e0b640 1 -- 172.21.15.167:0/435910797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0aaa00 con 0x564794a93690 2024-09-18T02:04:41.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb4e9e0b640 1 -- 172.21.15.167:0/435910797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ec0aaba0 con 0x564794a93690 2024-09-18T02:04:41.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb4e9e0b640 1 -- 172.21.15.167:0/435910797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0bd3f0 con 0x564794a93690 2024-09-18T02:04:41.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fddd3980 1 -- 172.21.15.167:0/435910797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 msgr2=0x564794a0a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/435910797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794a0a370 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0199f0 tx=0x7fb5ec003030 comp rx=0 tx=0).stop 2024-09-18T02:04:41.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fddd3980 1 -- 172.21.15.167:0/435910797 shutdown_connections 2024-09-18T02:04:41.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/435910797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794a0a370 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fddd3980 1 -- 172.21.15.167:0/435910797 >> 172.21.15.167:0/435910797 conn(0x564794a8f1b0 msgr2=0x564794b7a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fddd3980 1 -- 172.21.15.167:0/435910797 shutdown_connections 2024-09-18T02:04:41.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fddd3980 1 -- 172.21.15.167:0/435910797 wait complete. 2024-09-18T02:04:41.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fddd3980 1 Processor -- start 2024-09-18T02:04:41.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fddd3980 1 -- start start 2024-09-18T02:04:41.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fddd3980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794b87e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fddd3980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564794a9aca0 con 0x564794a93690 2024-09-18T02:04:41.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fb8e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794b87e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fb8e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794b87e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33124/0 (socket says 172.21.15.167:33124) 2024-09-18T02:04:41.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/1512404197 learned_addr learned my addr 172.21.15.167:0/1512404197 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/1512404197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564794b88370 con 0x564794a93690 2024-09-18T02:04:41.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.591+0000 7fb5fb8e3640 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794b87e30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0199f0 tx=0x7fb5ec0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb4e3fff640 1 -- 172.21.15.167:0/1512404197 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0bd7c0 con 0x564794a93690 2024-09-18T02:04:41.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb4e3fff640 1 -- 172.21.15.167:0/1512404197 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ec0bd960 con 0x564794a93690 2024-09-18T02:04:41.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564794b88600 con 0x564794a93690 2024-09-18T02:04:41.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb4e3fff640 1 -- 172.21.15.167:0/1512404197 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0bdc40 con 0x564794a93690 2024-09-18T02:04:41.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564794b8b2e0 con 0x564794a93690 2024-09-18T02:04:41.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb4e3fff640 1 -- 172.21.15.167:0/1512404197 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb5ec0ce020 con 0x564794a93690 2024-09-18T02:04:41.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb4e3fff640 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4e4034650 0x7fb4e4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb4e3fff640 1 -- 172.21.15.167:0/1512404197 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb5ec0cc020 con 0x564794a93690 2024-09-18T02:04:41.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5f30e2640 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4e4034650 0x7fb4e4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564794a93fe0 0x564794b8ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794b8f470 con 0x564794a93fe0 2024-09-18T02:04:41.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fc0e4640 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564794a93fe0 0x564794b8ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5f30e2640 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4e4034650 0x7fb4e4036b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4000f70 tx=0x7fb5e4001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fc0e4640 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564794a93fe0 0x564794b8ee00 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/1512404197 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794a93fe0 2024-09-18T02:04:41.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794b8c500 con 0x564794a93fe0 2024-09-18T02:04:41.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/1512404197 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794a93fe0 2024-09-18T02:04:41.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564794b917a0 0x564794b93b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794b94260 con 0x564794b917a0 2024-09-18T02:04:41.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.595+0000 7fb5fb8e3640 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564794b917a0 0x564794b93b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fb8e3640 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564794b917a0 0x564794b93b90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/1512404197 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794b917a0 2024-09-18T02:04:41.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794b90640 con 0x564794a93fe0 2024-09-18T02:04:41.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/1512404197 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794a93fe0 2024-09-18T02:04:41.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564794b956c0 0x564794b97ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794b981b0 con 0x564794b956c0 2024-09-18T02:04:41.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5f30e2640 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564794b956c0 0x564794b97ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5f30e2640 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564794b956c0 0x564794b97ab0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5f30e2640 1 -- 172.21.15.167:0/1512404197 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb5e400f6a0 con 0x564794b956c0 2024-09-18T02:04:41.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fddd3980 1 Processor -- start 2024-09-18T02:04:41.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fddd3980 1 -- start start 2024-09-18T02:04:41.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fddd3980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794ba5c80 0x564794ba60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fddd3980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56479499a800 con 0x564794ba5c80 2024-09-18T02:04:41.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fb8e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794ba5c80 0x564794ba60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fb8e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794ba5c80 0x564794ba60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33138/0 (socket says 172.21.15.167:33138) 2024-09-18T02:04:41.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/4262392111 learned_addr learned my addr 172.21.15.167:0/4262392111 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/4262392111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564794ba65e0 con 0x564794ba5c80 2024-09-18T02:04:41.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.599+0000 7fb5fb8e3640 1 --2- 172.21.15.167:0/4262392111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794ba5c80 0x564794ba60a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec01b380 tx=0x7fb5ec0bcce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb4e17fa640 1 -- 172.21.15.167:0/4262392111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0e34e0 con 0x564794ba5c80 2024-09-18T02:04:41.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb4e17fa640 1 -- 172.21.15.167:0/4262392111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ec0e3680 con 0x564794ba5c80 2024-09-18T02:04:41.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5fddd3980 1 -- 172.21.15.167:0/4262392111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564794ba6870 con 0x564794ba5c80 2024-09-18T02:04:41.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb4e17fa640 1 -- 172.21.15.167:0/4262392111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0c65d0 con 0x564794ba5c80 2024-09-18T02:04:41.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5fddd3980 1 -- 172.21.15.167:0/4262392111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564794ba94f0 con 0x564794ba5c80 2024-09-18T02:04:41.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb4e17fa640 1 -- 172.21.15.167:0/4262392111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb5ec0c6770 con 0x564794ba5c80 2024-09-18T02:04:41.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb4e17fa640 1 --2- 172.21.15.167:0/4262392111 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4d4034650 0x7fb4d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb4e17fa640 1 -- 172.21.15.167:0/4262392111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb5ec0eeba0 con 0x564794ba5c80 2024-09-18T02:04:41.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5f30e2640 1 --2- 172.21.15.167:0/4262392111 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4d4034650 0x7fb4d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5fddd3980 1 Processor -- start 2024-09-18T02:04:41.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5fddd3980 1 -- start start 2024-09-18T02:04:41.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5f30e2640 1 --2- 172.21.15.167:0/4262392111 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4d4034650 0x7fb4d4036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x564794b8fd50 tx=0x7fb5e400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5fddd3980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5fddd3980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564794a08aa0 con 0x564794bb25d0 2024-09-18T02:04:41.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5fb8e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5fb8e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33148/0 (socket says 172.21.15.167:33148) 2024-09-18T02:04:41.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/663315302 learned_addr learned my addr 172.21.15.167:0/663315302 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/663315302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564794bb2f80 con 0x564794bb25d0 2024-09-18T02:04:41.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb5fb8e3640 1 --2- 172.21.15.167:0/663315302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb29b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0c7fd0 tx=0x7fb5ec0bc3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796c48d082918290 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb4daffd640 1 -- 172.21.15.167:0/663315302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0db440 con 0x564794bb25d0 2024-09-18T02:04:41.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb4daffd640 1 -- 172.21.15.167:0/663315302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ec0e5b90 con 0x564794bb25d0 2024-09-18T02:04:41.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.603+0000 7fb4daffd640 1 -- 172.21.15.167:0/663315302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0c5940 con 0x564794bb25d0 2024-09-18T02:04:41.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 -- 172.21.15.167:0/663315302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 msgr2=0x564794bb29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/663315302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb29b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0c7fd0 tx=0x7fb5ec0bc3a0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 -- 172.21.15.167:0/663315302 shutdown_connections 2024-09-18T02:04:41.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/663315302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb29b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 -- 172.21.15.167:0/663315302 >> 172.21.15.167:0/663315302 conn(0x564794bae9b0 msgr2=0x564794bacab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 -- 172.21.15.167:0/663315302 shutdown_connections 2024-09-18T02:04:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 -- 172.21.15.167:0/663315302 wait complete. 2024-09-18T02:04:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 Processor -- start 2024-09-18T02:04:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 -- start start 2024-09-18T02:04:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564794bb3420 con 0x564794bb25d0 2024-09-18T02:04:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fb8e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fb8e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33156/0 (socket says 172.21.15.167:33156) 2024-09-18T02:04:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 learned_addr learned my addr 172.21.15.167:0/396970063 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564794bb9d00 con 0x564794bb25d0 2024-09-18T02:04:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fb8e3640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb97c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0cf000 tx=0x7fb5ec0e1f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb4d97fa640 1 -- 172.21.15.167:0/396970063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0dbb30 con 0x564794bb25d0 2024-09-18T02:04:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564794bb9d00 con 0x564794bb25d0 2024-09-18T02:04:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb4d97fa640 1 -- 172.21.15.167:0/396970063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ec0bc580 con 0x564794bb25d0 2024-09-18T02:04:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564794bb9d00 con 0x564794bb25d0 2024-09-18T02:04:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb4d97fa640 1 -- 172.21.15.167:0/396970063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0bc860 con 0x564794bb25d0 2024-09-18T02:04:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.607+0000 7fb4d97fa640 1 -- 172.21.15.167:0/396970063 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb5ec0c1af0 con 0x564794bb25d0 2024-09-18T02:04:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb4d97fa640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4c40345b0 0x7fb4c4036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb4d97fa640 1 -- 172.21.15.167:0/396970063 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb5ec106190 con 0x564794bb25d0 2024-09-18T02:04:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5f30e2640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4c40345b0 0x7fb4c4036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564794bc46a0 0x564794bc6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bc72b0 con 0x564794bc46a0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fc0e4640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564794bc46a0 0x564794bc6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5f30e2640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4c40345b0 0x7fb4c4036a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c010 tx=0x7fb5e4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fc0e4640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564794bc46a0 0x564794bc6b60 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 realm 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bc76c0 con 0x564794bc46a0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bc7f60 con 0x564794bc46a0 2024-09-18T02:04:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc46a0 2024-09-18T02:04:41.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:41.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564794bc9060 0x564794bcb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bcb9d0 con 0x564794bc9060 2024-09-18T02:04:41.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fb8e3640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564794bc9060 0x564794bcb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fb8e3640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564794bc9060 0x564794bcb450 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 20 searching for the correct realm 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564794bcd900 0x564794bcfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.611+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bd0490 con 0x564794bcd900 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5f30e2640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564794bcd900 0x564794bcfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5f30e2640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564794bcd900 0x564794bcfdc0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5f30e2640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb5e401fbe0 0x7fb5e403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bd0490 con 0x7fb5e401fbe0 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb5e401fbe0 0x7fb5e403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb5e401fbe0 0x7fb5e403a3c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x7fb5e401fbe0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc46a0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc46a0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc46a0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc9060 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x7fb5e401fbe0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.615+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bcd900 2024-09-18T02:04:41.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc46a0 2024-09-18T02:04:41.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x7fb5e401fbe0 2024-09-18T02:04:41.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc46a0 2024-09-18T02:04:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x7fb5e401fbe0 2024-09-18T02:04:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bcd900 2024-09-18T02:04:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bcd900 2024-09-18T02:04:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc9060 2024-09-18T02:04:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bcd900 2024-09-18T02:04:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bcd900 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc46a0 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc46a0 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.619+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc9060 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bcd900 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x7fb5e401fbe0 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc46a0 2024-09-18T02:04:41.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc9060 2024-09-18T02:04:41.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bcd900 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc9060 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x7fb5e401fbe0 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bcd900 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.623+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc9060 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x564794bc46a0 2024-09-18T02:04:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564794bc8300 con 0x7fb5e401fbe0 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bcc220 con 0x564794bc46a0 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bcc220 con 0x564794bc46a0 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bcc220 con 0x564794bcd900 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 zone default found 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 4 Realm: () 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 zonegroup default 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bccac0 con 0x564794bc9060 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bd22f0 con 0x564794bcd900 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bd2690 con 0x564794bcd900 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 started sync module instance, tier type = 2024-09-18T02:04:41.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:41.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.627+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd1790 con 0x7fb5e401fbe0 2024-09-18T02:04:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.631+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.631+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94865438088416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd1790 con 0x7fb5e401fbe0 2024-09-18T02:04:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.631+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd30c0 con 0x564794bc46a0 2024-09-18T02:04:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.631+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94865438088416] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.631+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.631+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94865438092240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd1790 con 0x564794bc46a0 2024-09-18T02:04:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.631+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd3b00 con 0x564794bcd900 2024-09-18T02:04:41.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.635+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.635+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94865438092240] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.635+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94865438094928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd3ef0 con 0x564794bcd900 2024-09-18T02:04:41.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.635+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd48b0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.635+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.635+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94865438098736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd5150 con 0x7fb5e401fbe0 2024-09-18T02:04:41.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.635+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd5b10 con 0x564794bc46a0 2024-09-18T02:04:41.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.635+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94865438094928] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.639+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94865438098736] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.639+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.639+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94865438103136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd50c0 con 0x564794bc46a0 2024-09-18T02:04:41.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.639+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd5a80 con 0x564794bc9060 2024-09-18T02:04:41.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.639+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94865438103136] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.639+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.639+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94865438100800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd63b0 con 0x564794bc9060 2024-09-18T02:04:41.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.639+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd6c00 con 0x564794bc9060 2024-09-18T02:04:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.643+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94865438100800] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.643+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.643+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94865438107472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd7020 con 0x564794bc9060 2024-09-18T02:04:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.643+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd7a20 con 0x564794bc9060 2024-09-18T02:04:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.643+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94865438107472] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94865438111024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd7c00 con 0x564794bc9060 2024-09-18T02:04:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 20 add_watcher() i=0 2024-09-18T02:04:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 20 add_watcher() i=1 2024-09-18T02:04:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 20 add_watcher() i=2 2024-09-18T02:04:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 20 add_watcher() i=3 2024-09-18T02:04:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 20 add_watcher() i=4 2024-09-18T02:04:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 20 add_watcher() i=5 2024-09-18T02:04:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 20 add_watcher() i=6 2024-09-18T02:04:41.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94865438111024] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 20 add_watcher() i=7 2024-09-18T02:04:41.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:41.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdafd0 con 0x564794bc46a0 2024-09-18T02:04:41.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94865438112496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd83c0 con 0x564794bc46a0 2024-09-18T02:04:41.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.647+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94865438112496] v32'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.651+0000 7fb4b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:41.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.651+0000 7fb5fddd3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:41.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.651+0000 7fb5fddd3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:41.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.651+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be34c0 con 0x564794bc46a0 2024-09-18T02:04:41.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.651+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'52 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.651+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be3af0 con 0x564794bc9060 2024-09-18T02:04:41.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.655+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.655+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be3af0 con 0x564794bcd900 2024-09-18T02:04:41.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.655+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.655+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be4570 con 0x564794bc46a0 2024-09-18T02:04:41.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.655+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'175 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.655+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be14a0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.659+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'62 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.659+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be14a0 con 0x564794bcd900 2024-09-18T02:04:41.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.659+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'49 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.659+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be50d0 con 0x564794bc46a0 2024-09-18T02:04:41.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.659+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.659+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5580 con 0x564794bc9060 2024-09-18T02:04:41.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.663+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.663+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5580 con 0x7fb5e401fbe0 2024-09-18T02:04:41.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.667+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.667+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5580 con 0x564794bcd900 2024-09-18T02:04:41.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.667+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.667+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5750 con 0x7fb5e401fbe0 2024-09-18T02:04:41.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.667+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'63 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.667+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5750 con 0x564794bc9060 2024-09-18T02:04:41.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.671+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.671+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5840 con 0x7fb5e401fbe0 2024-09-18T02:04:41.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.671+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.671+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bc9060 2024-09-18T02:04:41.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.675+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'57 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.675+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bc46a0 2024-09-18T02:04:41.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.675+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'176 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.675+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bcd900 2024-09-18T02:04:41.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.679+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.679+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.679+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'64 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.679+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bcd900 2024-09-18T02:04:41.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.683+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.683+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bc46a0 2024-09-18T02:04:41.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.683+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.683+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bc46a0 2024-09-18T02:04:41.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.683+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'177 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.683+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bcd900 2024-09-18T02:04:41.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.687+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'59 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.687+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.687+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.691+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bcd900 2024-09-18T02:04:41.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.691+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'31 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.691+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bcd900 2024-09-18T02:04:41.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.691+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.691+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bcd900 2024-09-18T02:04:41.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.695+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.695+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bcd900 2024-09-18T02:04:41.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.695+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'50 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.695+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be5ce0 con 0x564794bc9060 2024-09-18T02:04:41.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.699+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.699+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be60e0 con 0x564794bcd900 2024-09-18T02:04:41.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.699+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'36 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.699+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be60e0 con 0x564794bc9060 2024-09-18T02:04:41.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.703+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.703+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be60e0 con 0x564794bcd900 2024-09-18T02:04:41.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.707+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'60 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.707+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be60e0 con 0x564794bc9060 2024-09-18T02:04:41.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.707+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'58 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.707+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be60e0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb4b17e2640 20 reqs_thread_entry: start 2024-09-18T02:04:41.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb5fddd3980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:41.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb5fddd3980 20 Filter name: none 2024-09-18T02:04:41.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb4aa7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:41.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc46a0 2024-09-18T02:04:41.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc46a0 2024-09-18T02:04:41.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc46a0 2024-09-18T02:04:41.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.711+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.715+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.715+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.715+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.715+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.715+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.715+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.715+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.715+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.715+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.715+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc46a0 2024-09-18T02:04:41.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc46a0 2024-09-18T02:04:41.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv168 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc46a0 2024-09-18T02:04:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x7fb5e401fbe0 2024-09-18T02:04:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x7fb5e401fbe0 2024-09-18T02:04:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x7fb5e401fbe0 2024-09-18T02:04:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv46 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv46 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv46 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc46a0 2024-09-18T02:04:41.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.719+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc46a0 2024-09-18T02:04:41.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc46a0 2024-09-18T02:04:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc9060 2024-09-18T02:04:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc9060 2024-09-18T02:04:41.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.723+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x7fb5e401fbe0 2024-09-18T02:04:41.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x7fb5e401fbe0 2024-09-18T02:04:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc9060 2024-09-18T02:04:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.727+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc9060 2024-09-18T02:04:41.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x7fb5e401fbe0 2024-09-18T02:04:41.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc9060 2024-09-18T02:04:41.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.731+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc9060 2024-09-18T02:04:41.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc46a0 2024-09-18T02:04:41.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc46a0 2024-09-18T02:04:41.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv170 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc46a0 2024-09-18T02:04:41.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.735+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x7fb5e401fbe0 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc46a0 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc46a0 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc46a0 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.739+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc46a0 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc46a0 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv172 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc46a0 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x7fb5e401fbe0 2024-09-18T02:04:41.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x7fb5e401fbe0 2024-09-18T02:04:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.743+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4037040 con 0x564794bcd900 2024-09-18T02:04:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.747+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc9060 2024-09-18T02:04:41.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.751+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc9060 2024-09-18T02:04:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.755+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.755+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.755+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.755+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.755+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.755+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bcd900 2024-09-18T02:04:41.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.755+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.755+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.755+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.755+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bcd900 2024-09-18T02:04:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc9060 2024-09-18T02:04:41.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x564794bc9060 2024-09-18T02:04:41.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x7fb5e401fbe0 2024-09-18T02:04:41.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.759+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564794bdff00 con 0x7fb5e401fbe0 2024-09-18T02:04:41.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.763+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.763+0000 7fb4b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:41.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.763+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94865438112496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794be03b0 con 0x564794bc46a0 2024-09-18T02:04:41.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.763+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94865438112496] v32'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.763+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94865438088416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd7af0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.767+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94865438088416] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.767+0000 7fb5fddd3980 20 remove_watcher() i=0 2024-09-18T02:04:41.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.767+0000 7fb5fddd3980 2 removed watcher, disabling cache 2024-09-18T02:04:41.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.767+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94865438092240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd7af0 con 0x564794bc46a0 2024-09-18T02:04:41.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.767+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94865438092240] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.767+0000 7fb5fddd3980 20 remove_watcher() i=1 2024-09-18T02:04:41.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.767+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94865438094928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd2bd0 con 0x564794bcd900 2024-09-18T02:04:41.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.771+0000 7fb5f30e2640 1 -- 172.21.15.167:0/396970063 <== osd.3 v2:172.21.15.167:6808/2476454287 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94865438094928] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e4056040 con 0x564794bcd900 2024-09-18T02:04:41.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.771+0000 7fb5fddd3980 20 remove_watcher() i=2 2024-09-18T02:04:41.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.771+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94865438098736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd7af0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.771+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.2 v2:172.21.15.167:6816/2055439504 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94865438098736] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x7fb5e401fbe0 2024-09-18T02:04:41.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.771+0000 7fb5fddd3980 20 remove_watcher() i=3 2024-09-18T02:04:41.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.771+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94865438103136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd3650 con 0x564794bc46a0 2024-09-18T02:04:41.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.775+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 <== osd.1 v2:172.21.15.167:6800/15864359 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94865438103136] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f400a4d0 con 0x564794bc46a0 2024-09-18T02:04:41.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.775+0000 7fb5fddd3980 20 remove_watcher() i=4 2024-09-18T02:04:41.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.775+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94865438100800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd2bd0 con 0x564794bc9060 2024-09-18T02:04:41.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.779+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94865438100800] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.779+0000 7fb5fddd3980 20 remove_watcher() i=5 2024-09-18T02:04:41.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.779+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94865438107472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd4530 con 0x564794bc9060 2024-09-18T02:04:41.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.779+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94865438107472] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.779+0000 7fb5fddd3980 20 remove_watcher() i=6 2024-09-18T02:04:41.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.779+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94865438111024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564794bd7af0 con 0x564794bc9060 2024-09-18T02:04:41.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fb8e3640 1 -- 172.21.15.167:0/396970063 <== osd.0 v2:172.21.15.81:6800/3087415523 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94865438111024] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0e5050 con 0x564794bc9060 2024-09-18T02:04:41.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 20 remove_watcher() i=7 2024-09-18T02:04:41.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564794bc9060 msgr2=0x564794bcb450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564794bc9060 0x564794bcb450 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564794bc46a0 msgr2=0x564794bc6b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564794bc46a0 0x564794bc6b60 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb5e401fbe0 msgr2=0x7fb5e403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb5e401fbe0 0x7fb5e403a3c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564794bcd900 msgr2=0x564794bcfdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564794bcd900 0x564794bcfdc0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4c40345b0 msgr2=0x7fb4c4036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4c40345b0 0x7fb4c4036a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c010 tx=0x7fb5e4010000 comp rx=0 tx=0).stop 2024-09-18T02:04:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 msgr2=0x564794bb97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/396970063 reap_dead start 2024-09-18T02:04:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb97c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0cf000 tx=0x7fb5ec0e1f20 comp rx=0 tx=0).stop 2024-09-18T02:04:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 shutdown_connections 2024-09-18T02:04:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/396970063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794bb25d0 0x564794bb97c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 >> 172.21.15.167:0/396970063 conn(0x564794bae9b0 msgr2=0x564794baca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 shutdown_connections 2024-09-18T02:04:41.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/396970063 wait complete. 2024-09-18T02:04:41.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/4262392111 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4d4034650 msgr2=0x7fb4d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/4262392111 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4d4034650 0x7fb4d4036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x564794b8fd50 tx=0x7fb5e400f000 comp rx=0 tx=0).stop 2024-09-18T02:04:41.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/4262392111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794ba5c80 msgr2=0x564794ba60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/4262392111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794ba5c80 0x564794ba60a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec01b380 tx=0x7fb5ec0bcce0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/4262392111 shutdown_connections 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/4262392111 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4d4034650 0x7fb4d4036b10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/4262392111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794ba5c80 0x564794ba60a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/4262392111 >> 172.21.15.167:0/4262392111 conn(0x564794b9add0 msgr2=0x564794b9d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.783+0000 7fb5fddd3980 1 -- 172.21.15.167:0/4262392111 shutdown_connections 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 -- 172.21.15.167:0/4262392111 wait complete. 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564794b917a0 msgr2=0x564794b93b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564794b917a0 0x564794b93b90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564794a93fe0 msgr2=0x564794b8ee00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564794a93fe0 0x564794b8ee00 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564794b956c0 msgr2=0x564794b97ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564794b956c0 0x564794b97ab0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4e4034650 msgr2=0x7fb4e4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb4e4034650 0x7fb4e4036b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4000f70 tx=0x7fb5e4001380 comp rx=0 tx=0).stop 2024-09-18T02:04:41.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 msgr2=0x564794b87e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 --2- 172.21.15.167:0/1512404197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564794a93690 0x564794b87e30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0199f0 tx=0x7fb5ec0180e0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fc0e4640 1 -- 172.21.15.167:0/1512404197 reap_dead start 2024-09-18T02:04:41.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 shutdown_connections 2024-09-18T02:04:41.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 >> 172.21.15.167:0/1512404197 conn(0x564794a8f1b0 msgr2=0x564794a08fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 shutdown_connections 2024-09-18T02:04:41.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.787+0000 7fb5fddd3980 1 -- 172.21.15.167:0/1512404197 wait complete. 2024-09-18T02:04:41.805 INFO:teuthology.orchestra.run.smithi167.stdout:[] 2024-09-18T02:04:41.806 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T02:04:41.806 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-18T02:04:41.806 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-18T02:04:41.806 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-18T02:04:41.888 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:41.888 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:41.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.883+0000 7fc6ed057980 1 Processor -- start 2024-09-18T02:04:41.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.883+0000 7fc6ed057980 1 -- start start 2024-09-18T02:04:41.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.883+0000 7fc6ed057980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564cff75ec60 0x564cff761050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.883+0000 7fc6ed057980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564cff5e0ae0 con 0x564cff75a8e0 2024-09-18T02:04:41.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.883+0000 7fc6ed057980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x564cff604e30 con 0x564cff75ec60 2024-09-18T02:04:41.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.887+0000 7fc6ea366640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564cff75ec60 0x564cff761050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.887+0000 7fc6ea366640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564cff75ec60 0x564cff761050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33170/0 (socket says 172.21.15.167:33170) 2024-09-18T02:04:41.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.887+0000 7fc6ea366640 1 -- 172.21.15.167:0/1626920929 learned_addr learned my addr 172.21.15.167:0/1626920929 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.887+0000 7fc6eab67640 1 --1- 172.21.15.167:0/1626920929 >> v1:172.21.15.81:6789/0 conn(0x564cff75a8e0 0x564cff75acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:42606/0 (socket says 172.21.15.167:42606) 2024-09-18T02:04:41.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.887+0000 7fc6ea366640 1 -- 172.21.15.167:0/1626920929 >> v1:172.21.15.81:6789/0 conn(0x564cff75a8e0 legacy=0x564cff75acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.887+0000 7fc6ea366640 1 -- 172.21.15.167:0/1626920929 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cff7625a0 con 0x564cff75ec60 2024-09-18T02:04:41.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.887+0000 7fc6ea366640 1 --2- 172.21.15.167:0/1626920929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75ec60 0x564cff761050 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000a5c0 tx=0x7fc6e001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fcdace9511a19e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.887+0000 7fc6e9b65640 1 -- 172.21.15.167:0/1626920929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e00a6070 con 0x564cff75ec60 2024-09-18T02:04:41.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.887+0000 7fc6e9b65640 1 -- 172.21.15.167:0/1626920929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e00af070 con 0x564cff75ec60 2024-09-18T02:04:41.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.887+0000 7fc6e9b65640 1 -- 172.21.15.167:0/1626920929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e00aa5c0 con 0x564cff75ec60 2024-09-18T02:04:41.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.891+0000 7fc6ed057980 1 -- 172.21.15.167:0/1626920929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75ec60 msgr2=0x564cff761050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.891+0000 7fc6ed057980 1 --2- 172.21.15.167:0/1626920929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75ec60 0x564cff761050 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000a5c0 tx=0x7fc6e001b340 comp rx=0 tx=0).stop 2024-09-18T02:04:41.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.891+0000 7fc6ed057980 1 -- 172.21.15.167:0/1626920929 shutdown_connections 2024-09-18T02:04:41.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.891+0000 7fc6ed057980 1 --2- 172.21.15.167:0/1626920929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75ec60 0x564cff761050 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.891+0000 7fc6ed057980 1 -- 172.21.15.167:0/1626920929 >> 172.21.15.167:0/1626920929 conn(0x564cff6ce230 msgr2=0x564cff6ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.891+0000 7fc6ed057980 1 -- 172.21.15.167:0/1626920929 shutdown_connections 2024-09-18T02:04:41.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.891+0000 7fc6ed057980 1 -- 172.21.15.167:0/1626920929 wait complete. 2024-09-18T02:04:41.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 Processor -- start 2024-09-18T02:04:41.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 -- start start 2024-09-18T02:04:41.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 0x564cff845c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564cff606200 con 0x564cff75a8e0 2024-09-18T02:04:41.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6eab67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 0x564cff845c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6eab67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 0x564cff845c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33172/0 (socket says 172.21.15.167:33172) 2024-09-18T02:04:41.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6eab67640 1 -- 172.21.15.167:0/2500558454 learned_addr learned my addr 172.21.15.167:0/2500558454 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6eab67640 1 -- 172.21.15.167:0/2500558454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cff846200 con 0x564cff75a8e0 2024-09-18T02:04:41.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6eab67640 1 --2- 172.21.15.167:0/2500558454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 0x564cff845c30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc001e50 tx=0x7fc6dc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdff9c9fb90cfced server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc5d8e09640 1 -- 172.21.15.167:0/2500558454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc00e5d0 con 0x564cff75a8e0 2024-09-18T02:04:41.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc5d8e09640 1 -- 172.21.15.167:0/2500558454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc00e770 con 0x564cff75a8e0 2024-09-18T02:04:41.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc5d8e09640 1 -- 172.21.15.167:0/2500558454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc00eab0 con 0x564cff75a8e0 2024-09-18T02:04:41.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 -- 172.21.15.167:0/2500558454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 msgr2=0x564cff845c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 --2- 172.21.15.167:0/2500558454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 0x564cff845c30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc001e50 tx=0x7fc6dc001e80 comp rx=0 tx=0).stop 2024-09-18T02:04:41.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 -- 172.21.15.167:0/2500558454 shutdown_connections 2024-09-18T02:04:41.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 --2- 172.21.15.167:0/2500558454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 0x564cff845c30 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 -- 172.21.15.167:0/2500558454 >> 172.21.15.167:0/2500558454 conn(0x564cff6ce230 msgr2=0x564cff841860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 -- 172.21.15.167:0/2500558454 shutdown_connections 2024-09-18T02:04:41.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 -- 172.21.15.167:0/2500558454 wait complete. 2024-09-18T02:04:41.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 Processor -- start 2024-09-18T02:04:41.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 -- start start 2024-09-18T02:04:41.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 0x564cff84cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.907+0000 7fc6ed057980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564cff7620a0 con 0x564cff75a8e0 2024-09-18T02:04:41.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6eab67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 0x564cff84cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6eab67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 0x564cff84cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33178/0 (socket says 172.21.15.167:33178) 2024-09-18T02:04:41.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6eab67640 1 -- 172.21.15.167:0/1650453381 learned_addr learned my addr 172.21.15.167:0/1650453381 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6eab67640 1 -- 172.21.15.167:0/1650453381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cff84d4e0 con 0x564cff75a8e0 2024-09-18T02:04:41.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6eab67640 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 0x564cff84cfa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x564cff846e10 tx=0x7fc6dc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc5d7606640 1 -- 172.21.15.167:0/1650453381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc001260 con 0x564cff75a8e0 2024-09-18T02:04:41.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cff84d770 con 0x564cff75a8e0 2024-09-18T02:04:41.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc5d7606640 1 -- 172.21.15.167:0/1650453381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc00fa40 con 0x564cff75a8e0 2024-09-18T02:04:41.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc5d7606640 1 -- 172.21.15.167:0/1650453381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc00fd80 con 0x564cff75a8e0 2024-09-18T02:04:41.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cff850450 con 0x564cff75a8e0 2024-09-18T02:04:41.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc5d7606640 1 -- 172.21.15.167:0/1650453381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc6dc017070 con 0x564cff75a8e0 2024-09-18T02:04:41.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc5d7606640 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5d0034650 0x7fc5d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc5d7606640 1 -- 172.21.15.167:0/1650453381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc6dc015020 con 0x564cff75a8e0 2024-09-18T02:04:41.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6ea366640 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5d0034650 0x7fc5d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6ed057980 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564cff75ec60 0x564cff853f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff854600 con 0x564cff75ec60 2024-09-18T02:04:41.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6eb368640 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564cff75ec60 0x564cff853f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6ea366640 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5d0034650 0x7fc5d0036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00ae000 tx=0x7fc6e00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6eb368640 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564cff75ec60 0x564cff853f90 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.911+0000 7fc6eb368640 1 -- 172.21.15.167:0/1650453381 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff75ec60 2024-09-18T02:04:41.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff851650 con 0x564cff75ec60 2024-09-18T02:04:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6eb368640 1 -- 172.21.15.167:0/1650453381 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff75ec60 2024-09-18T02:04:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6ed057980 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564cff856930 0x564cff858d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff8593f0 con 0x564cff856930 2024-09-18T02:04:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6eab67640 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564cff856930 0x564cff858d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6eab67640 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564cff856930 0x564cff858d20 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6eab67640 1 -- 172.21.15.167:0/1650453381 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc6dc02e070 con 0x564cff856930 2024-09-18T02:04:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff8557d0 con 0x564cff75ec60 2024-09-18T02:04:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6eb368640 1 -- 172.21.15.167:0/1650453381 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff75ec60 2024-09-18T02:04:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6ed057980 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564cff85a830 0x564cff85cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff85d3b0 con 0x564cff85a830 2024-09-18T02:04:41.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6ea366640 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564cff85a830 0x564cff85cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6ea366640 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564cff85a830 0x564cff85cc20 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6ea366640 1 -- 172.21.15.167:0/1650453381 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff85a830 2024-09-18T02:04:41.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6ed057980 1 Processor -- start 2024-09-18T02:04:41.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.915+0000 7fc6ed057980 1 -- start start 2024-09-18T02:04:41.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6ed057980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff86ae40 0x564cff86b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6ed057980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564cff65f800 con 0x564cff86ae40 2024-09-18T02:04:41.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6eab67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff86ae40 0x564cff86b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6eab67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff86ae40 0x564cff86b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33182/0 (socket says 172.21.15.167:33182) 2024-09-18T02:04:41.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6eab67640 1 -- 172.21.15.167:0/2447943284 learned_addr learned my addr 172.21.15.167:0/2447943284 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6eab67640 1 -- 172.21.15.167:0/2447943284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cff86b7a0 con 0x564cff86ae40 2024-09-18T02:04:41.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6eab67640 1 --2- 172.21.15.167:0/2447943284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff86ae40 0x564cff86b260 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc048f40 tx=0x7fc6dc017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc5d4e01640 1 -- 172.21.15.167:0/2447943284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc03f020 con 0x564cff86ae40 2024-09-18T02:04:41.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc5d4e01640 1 -- 172.21.15.167:0/2447943284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc042850 con 0x564cff86ae40 2024-09-18T02:04:41.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6ed057980 1 -- 172.21.15.167:0/2447943284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cff86ba30 con 0x564cff86ae40 2024-09-18T02:04:41.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc5d4e01640 1 -- 172.21.15.167:0/2447943284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc019860 con 0x564cff86ae40 2024-09-18T02:04:41.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6ed057980 1 -- 172.21.15.167:0/2447943284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cff86ba30 con 0x564cff86ae40 2024-09-18T02:04:41.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc5d4e01640 1 -- 172.21.15.167:0/2447943284 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc6dc03a070 con 0x564cff86ae40 2024-09-18T02:04:41.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc5d4e01640 1 --2- 172.21.15.167:0/2447943284 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5c4034650 0x7fc5c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc5d4e01640 1 -- 172.21.15.167:0/2447943284 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc6dc04f950 con 0x564cff86ae40 2024-09-18T02:04:41.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6ea366640 1 --2- 172.21.15.167:0/2447943284 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5c4034650 0x7fc5c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6ed057980 1 Processor -- start 2024-09-18T02:04:41.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6ed057980 1 -- start start 2024-09-18T02:04:41.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6ea366640 1 --2- 172.21.15.167:0/2447943284 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5c4034650 0x7fc5c4036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0000c10 tx=0x7fc6e0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6ed057980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 0x564cff8779b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6ed057980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564cff846580 con 0x564cff8775b0 2024-09-18T02:04:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.919+0000 7fc6eab67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 0x564cff8779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6eab67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 0x564cff8779b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33196/0 (socket says 172.21.15.167:33196) 2024-09-18T02:04:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6eab67640 1 -- 172.21.15.167:0/667388703 learned_addr learned my addr 172.21.15.167:0/667388703 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6eab67640 1 -- 172.21.15.167:0/667388703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cff877f80 con 0x564cff8775b0 2024-09-18T02:04:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6eab67640 1 --2- 172.21.15.167:0/667388703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 0x564cff8779b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc019fd0 tx=0x7fc6dc042410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dae210d8f41d346 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc5ce7fc640 1 -- 172.21.15.167:0/667388703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc03be30 con 0x564cff8775b0 2024-09-18T02:04:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc5ce7fc640 1 -- 172.21.15.167:0/667388703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc05f070 con 0x564cff8775b0 2024-09-18T02:04:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc5ce7fc640 1 -- 172.21.15.167:0/667388703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc04a1e0 con 0x564cff8775b0 2024-09-18T02:04:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 -- 172.21.15.167:0/667388703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 msgr2=0x564cff8779b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 --2- 172.21.15.167:0/667388703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 0x564cff8779b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc019fd0 tx=0x7fc6dc042410 comp rx=0 tx=0).stop 2024-09-18T02:04:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 -- 172.21.15.167:0/667388703 shutdown_connections 2024-09-18T02:04:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 --2- 172.21.15.167:0/667388703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 0x564cff8779b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 -- 172.21.15.167:0/667388703 >> 172.21.15.167:0/667388703 conn(0x564cff873990 msgr2=0x564cff871a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 -- 172.21.15.167:0/667388703 shutdown_connections 2024-09-18T02:04:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 -- 172.21.15.167:0/667388703 wait complete. 2024-09-18T02:04:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 Processor -- start 2024-09-18T02:04:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 -- start start 2024-09-18T02:04:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 0x564cff87e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564cff878400 con 0x564cff8775b0 2024-09-18T02:04:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6eab67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 0x564cff87e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6eab67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 0x564cff87e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33202/0 (socket says 172.21.15.167:33202) 2024-09-18T02:04:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 learned_addr learned my addr 172.21.15.167:0/95849624 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cff87ed80 con 0x564cff8775b0 2024-09-18T02:04:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6eab67640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 0x564cff87e840 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc03bdc0 tx=0x7fc6dc048010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc5ccff9640 1 -- 172.21.15.167:0/95849624 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc047e70 con 0x564cff8775b0 2024-09-18T02:04:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cff87ed80 con 0x564cff8775b0 2024-09-18T02:04:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc5ccff9640 1 -- 172.21.15.167:0/95849624 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc06a070 con 0x564cff8775b0 2024-09-18T02:04:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc5ccff9640 1 -- 172.21.15.167:0/95849624 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc031620 con 0x564cff8775b0 2024-09-18T02:04:41.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.923+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cff87ed80 con 0x564cff8775b0 2024-09-18T02:04:41.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc5ccff9640 1 -- 172.21.15.167:0/95849624 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc6dc058040 con 0x564cff8775b0 2024-09-18T02:04:41.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc5ccff9640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5b4034650 0x7fc5b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc5ccff9640 1 -- 172.21.15.167:0/95849624 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc6dc055040 con 0x564cff8775b0 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ea366640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5b4034650 0x7fc5b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564cff889860 0x564cff88bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff88c470 con 0x564cff889860 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6eb368640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564cff889860 0x564cff88bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ea366640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5b4034650 0x7fc5b4036b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00aa910 tx=0x7fc6e00c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6eb368640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564cff889860 0x564cff88bd20 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 20 realm 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff88c880 con 0x564cff889860 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d150 con 0x564cff889860 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff889860 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564cff88e250 0x564cff890640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff890c10 con 0x564cff88e250 2024-09-18T02:04:41.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.927+0000 7fc6eab67640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564cff88e250 0x564cff890640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eab67640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564cff88e250 0x564cff890640 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6ed057980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6ed057980 20 searching for the correct realm 2024-09-18T02:04:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6ed057980 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564cff892b60 0x564cff894f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff895660 con 0x564cff892b60 2024-09-18T02:04:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6ea366640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564cff892b60 0x564cff894f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6ea366640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564cff892b60 0x564cff894f90 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6ea366640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc6e00e0040 0x7fc6e00e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff895660 con 0x7fc6e00e0040 2024-09-18T02:04:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eb368640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc6e00e0040 0x7fc6e00e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eb368640 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc6e00e0040 0x7fc6e00e0420 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x7fc6e00e0040 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff889860 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff889860 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.931+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff889860 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff88e250 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x7fc6e00e0040 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff892b60 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff889860 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x7fc6e00e0040 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff889860 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x7fc6e00e0040 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff892b60 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff892b60 2024-09-18T02:04:41.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff88e250 2024-09-18T02:04:41.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.935+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff892b60 2024-09-18T02:04:41.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff892b60 2024-09-18T02:04:41.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff889860 2024-09-18T02:04:41.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff889860 2024-09-18T02:04:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff88e250 2024-09-18T02:04:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff892b60 2024-09-18T02:04:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x7fc6e00e0040 2024-09-18T02:04:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff889860 2024-09-18T02:04:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff88e250 2024-09-18T02:04:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff892b60 2024-09-18T02:04:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.939+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff88e250 2024-09-18T02:04:41.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x7fc6e00e0040 2024-09-18T02:04:41.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff892b60 2024-09-18T02:04:41.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff88e250 2024-09-18T02:04:41.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x564cff889860 2024-09-18T02:04:41.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564cff88d4f0 con 0x7fc6e00e0040 2024-09-18T02:04:41.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:41.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:41.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:41.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:41.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:41.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:41.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff8914d0 con 0x564cff889860 2024-09-18T02:04:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff8914d0 con 0x564cff889860 2024-09-18T02:04:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff8914d0 con 0x564cff892b60 2024-09-18T02:04:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 zone default found 2024-09-18T02:04:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 4 Realm: () 2024-09-18T02:04:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:41.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:41.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:41.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 zonegroup default 2024-09-18T02:04:41.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff891e60 con 0x564cff88e250 2024-09-18T02:04:41.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff897550 con 0x564cff892b60 2024-09-18T02:04:41.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.943+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:41.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff8979e0 con 0x564cff892b60 2024-09-18T02:04:41.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6ed057980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:41.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6ed057980 20 started sync module instance, tier type = 2024-09-18T02:04:41.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6ed057980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:41.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff896960 con 0x7fc6e00e0040 2024-09-18T02:04:41.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94888704700000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff896960 con 0x7fc6e00e0040 2024-09-18T02:04:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8984a0 con 0x564cff889860 2024-09-18T02:04:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94888704700000] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.947+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94888704704432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff896960 con 0x564cff889860 2024-09-18T02:04:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.951+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff898eb0 con 0x564cff892b60 2024-09-18T02:04:41.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.951+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94888704704432] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.951+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.951+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94888704697520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8968d0 con 0x564cff892b60 2024-09-18T02:04:41.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.951+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff899bf0 con 0x7fc6e00e0040 2024-09-18T02:04:41.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.951+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.951+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94888704710400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89a490 con 0x7fc6e00e0040 2024-09-18T02:04:41.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.955+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89ae90 con 0x564cff889860 2024-09-18T02:04:41.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.955+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94888704697520] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.955+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94888704710400] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.955+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.955+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94888704709200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff899f90 con 0x564cff889860 2024-09-18T02:04:41.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.955+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89b730 con 0x564cff88e250 2024-09-18T02:04:41.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.955+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94888704709200] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.959+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.959+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94888704717440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff899f90 con 0x564cff88e250 2024-09-18T02:04:41.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.959+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89bf80 con 0x564cff88e250 2024-09-18T02:04:41.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.959+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.959+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94888704721696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89cbf0 con 0x564cff88e250 2024-09-18T02:04:41.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.959+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89d5f0 con 0x564cff88e250 2024-09-18T02:04:41.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.959+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94888704717440] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94888704721696] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94888704715168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89c740 con 0x564cff88e250 2024-09-18T02:04:41.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 20 add_watcher() i=0 2024-09-18T02:04:41.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 20 add_watcher() i=1 2024-09-18T02:04:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 20 add_watcher() i=2 2024-09-18T02:04:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 20 add_watcher() i=3 2024-09-18T02:04:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 20 add_watcher() i=4 2024-09-18T02:04:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 20 add_watcher() i=5 2024-09-18T02:04:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 20 add_watcher() i=6 2024-09-18T02:04:41.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94888704715168] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 20 add_watcher() i=7 2024-09-18T02:04:41.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:41.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a06f0 con 0x564cff889860 2024-09-18T02:04:41.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.963+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94888704725248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89db70 con 0x564cff889860 2024-09-18T02:04:41.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.967+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94888704725248] v32'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.967+0000 7fc5a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:41.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.967+0000 7fc6ed057980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:41.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.967+0000 7fc6ed057980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:41.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.967+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a8e80 con 0x564cff889860 2024-09-18T02:04:41.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.967+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'53 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.967+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a9550 con 0x564cff88e250 2024-09-18T02:04:41.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.971+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.971+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a9550 con 0x564cff892b60 2024-09-18T02:04:41.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.971+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.971+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a9b40 con 0x564cff889860 2024-09-18T02:04:41.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.975+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'180 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.975+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a9f20 con 0x7fc6e00e0040 2024-09-18T02:04:41.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.975+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'65 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.975+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8aa490 con 0x564cff892b60 2024-09-18T02:04:41.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.975+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'51 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.975+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8aa8b0 con 0x564cff889860 2024-09-18T02:04:41.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.979+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.979+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8aad60 con 0x564cff88e250 2024-09-18T02:04:41.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.979+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.979+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8aad60 con 0x7fc6e00e0040 2024-09-18T02:04:41.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.983+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.983+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8aad60 con 0x564cff892b60 2024-09-18T02:04:41.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.983+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.983+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6d50 con 0x7fc6e00e0040 2024-09-18T02:04:41.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.983+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'66 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.983+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6d50 con 0x564cff88e250 2024-09-18T02:04:41.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.987+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.987+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6d50 con 0x7fc6e00e0040 2024-09-18T02:04:41.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.987+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.987+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6640 con 0x564cff88e250 2024-09-18T02:04:41.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.991+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'59 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:41.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.991+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6c70 con 0x564cff889860 2024-09-18T02:04:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.991+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'181 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.991+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff892b60 2024-09-18T02:04:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.995+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.995+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x7fc6e00e0040 2024-09-18T02:04:41.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.995+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'67 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:41.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.995+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff892b60 2024-09-18T02:04:42.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.995+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:42.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.995+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff889860 2024-09-18T02:04:42.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.999+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:42.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.999+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff889860 2024-09-18T02:04:42.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.999+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'182 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:42.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:41.999+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff892b60 2024-09-18T02:04:42.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.003+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'62 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:42.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.003+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6bb0 con 0x7fc6e00e0040 2024-09-18T02:04:42.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.003+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:42.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.003+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6bb0 con 0x564cff892b60 2024-09-18T02:04:42.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.003+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'32 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:42.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.003+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6b80 con 0x564cff892b60 2024-09-18T02:04:42.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.007+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'41 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:42.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.007+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff892b60 2024-09-18T02:04:42.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.007+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:42.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.007+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff892b60 2024-09-18T02:04:42.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.007+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'52 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:42.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.007+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff88e250 2024-09-18T02:04:42.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.011+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:42.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.011+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff892b60 2024-09-18T02:04:42.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.011+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'37 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:42.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.011+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff88e250 2024-09-18T02:04:42.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.015+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:42.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.015+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff892b60 2024-09-18T02:04:42.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.019+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'63 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:42.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.019+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x564cff88e250 2024-09-18T02:04:42.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.019+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'60 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:42.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.019+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6af0 con 0x7fc6e00e0040 2024-09-18T02:04:42.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:42.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc51bfff640 20 reqs_thread_entry: start 2024-09-18T02:04:42.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6ed057980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:42.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6ed057980 20 Filter name: none 2024-09-18T02:04:42.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc519ffb640 20 reqs_thread_entry: start 2024-09-18T02:04:42.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6ed057980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:42.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6ed057980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a6b20 con 0x564cff889860 2024-09-18T02:04:42.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:42.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6ed057980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:42.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6ed057980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6ed057980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6ed057980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.023+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564cff8c8fe0 con 0x7fc6e00e0040 2024-09-18T02:04:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.027+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-18T02:04:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.027+0000 7fc5a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:42.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.027+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94888704725248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8a2ab0 con 0x564cff889860 2024-09-18T02:04:42.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.027+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94888704725248] v32'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:42.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.027+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94888704700000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89d100 con 0x7fc6e00e0040 2024-09-18T02:04:42.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.031+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94888704700000] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:42.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.031+0000 7fc6ed057980 20 remove_watcher() i=0 2024-09-18T02:04:42.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.031+0000 7fc6ed057980 2 removed watcher, disabling cache 2024-09-18T02:04:42.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.031+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94888704704432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89d100 con 0x564cff889860 2024-09-18T02:04:42.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.031+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94888704704432] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:42.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.031+0000 7fc6ed057980 20 remove_watcher() i=1 2024-09-18T02:04:42.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.031+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94888704697520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff897fb0 con 0x564cff892b60 2024-09-18T02:04:42.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.035+0000 7fc6ea366640 1 -- 172.21.15.167:0/95849624 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94888704697520] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e00aaae0 con 0x564cff892b60 2024-09-18T02:04:42.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.035+0000 7fc6ed057980 20 remove_watcher() i=2 2024-09-18T02:04:42.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.035+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94888704710400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89d100 con 0x7fc6e00e0040 2024-09-18T02:04:42.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.035+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94888704710400] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x7fc6e00e0040 2024-09-18T02:04:42.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.035+0000 7fc6ed057980 20 remove_watcher() i=3 2024-09-18T02:04:42.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.035+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94888704709200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8964b0 con 0x564cff889860 2024-09-18T02:04:42.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.039+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94888704709200] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e400a4d0 con 0x564cff889860 2024-09-18T02:04:42.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.039+0000 7fc6ed057980 20 remove_watcher() i=4 2024-09-18T02:04:42.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.039+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94888704717440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff897fb0 con 0x564cff88e250 2024-09-18T02:04:42.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.039+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94888704717440] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:42.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.039+0000 7fc6ed057980 20 remove_watcher() i=5 2024-09-18T02:04:42.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.039+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94888704721696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff89d100 con 0x564cff88e250 2024-09-18T02:04:42.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94888704721696] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:42.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 20 remove_watcher() i=6 2024-09-18T02:04:42.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94888704715168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564cff8964b0 con 0x564cff88e250 2024-09-18T02:04:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6eab67640 1 -- 172.21.15.167:0/95849624 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94888704715168] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc041020 con 0x564cff88e250 2024-09-18T02:04:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 20 remove_watcher() i=7 2024-09-18T02:04:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564cff88e250 msgr2=0x564cff890640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564cff88e250 0x564cff890640 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564cff889860 msgr2=0x564cff88bd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564cff889860 0x564cff88bd20 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc6e00e0040 msgr2=0x7fc6e00e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc6e00e0040 0x7fc6e00e0420 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564cff892b60 msgr2=0x564cff894f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564cff892b60 0x564cff894f90 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5b4034650 msgr2=0x7fc5b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5b4034650 0x7fc5b4036b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00aa910 tx=0x7fc6e00c1040 comp rx=0 tx=0).stop 2024-09-18T02:04:42.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 msgr2=0x564cff87e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 --2- 172.21.15.167:0/95849624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff8775b0 0x564cff87e840 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc03bdc0 tx=0x7fc6dc048010 comp rx=0 tx=0).stop 2024-09-18T02:04:42.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 reap_dead start 2024-09-18T02:04:42.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6eb368640 1 -- 172.21.15.167:0/95849624 reap_dead start 2024-09-18T02:04:42.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 shutdown_connections 2024-09-18T02:04:42.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 >> 172.21.15.167:0/95849624 conn(0x564cff873990 msgr2=0x564cff871a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 shutdown_connections 2024-09-18T02:04:42.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.043+0000 7fc6ed057980 1 -- 172.21.15.167:0/95849624 wait complete. 2024-09-18T02:04:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/2447943284 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5c4034650 msgr2=0x7fc5c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 --2- 172.21.15.167:0/2447943284 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5c4034650 0x7fc5c4036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0000c10 tx=0x7fc6e0005ad0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/2447943284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff86ae40 msgr2=0x564cff86b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 --2- 172.21.15.167:0/2447943284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff86ae40 0x564cff86b260 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc048f40 tx=0x7fc6dc017d50 comp rx=0 tx=0).stop 2024-09-18T02:04:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/2447943284 shutdown_connections 2024-09-18T02:04:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 --2- 172.21.15.167:0/2447943284 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5c4034650 0x7fc5c4036b10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 --2- 172.21.15.167:0/2447943284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff86ae40 0x564cff86b260 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/2447943284 >> 172.21.15.167:0/2447943284 conn(0x564cff85ff90 msgr2=0x564cff862a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/2447943284 shutdown_connections 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/2447943284 wait complete. 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564cff856930 msgr2=0x564cff858d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564cff856930 0x564cff858d20 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564cff75ec60 msgr2=0x564cff853f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564cff75ec60 0x564cff853f90 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564cff85a830 msgr2=0x564cff85cc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564cff85a830 0x564cff85cc20 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5d0034650 msgr2=0x7fc5d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc5d0034650 0x7fc5d0036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00ae000 tx=0x7fc6e00a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 msgr2=0x564cff84cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 --2- 172.21.15.167:0/1650453381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564cff75a8e0 0x564cff84cfa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x564cff846e10 tx=0x7fc6dc000bd0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6eb368640 1 -- 172.21.15.167:0/1650453381 reap_dead start 2024-09-18T02:04:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 shutdown_connections 2024-09-18T02:04:42.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 >> 172.21.15.167:0/1650453381 conn(0x564cff6ce230 msgr2=0x564cff8403e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 shutdown_connections 2024-09-18T02:04:42.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.047+0000 7fc6ed057980 1 -- 172.21.15.167:0/1650453381 wait complete. 2024-09-18T02:04:42.062 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T02:04:42.077 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-18T02:04:42.083 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:42.145 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:42.168 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:42.213 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-18T02:04:42.224 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:42.224 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T02:04:42.224 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T02:04:42.225 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-18T02:04:42.263 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:42.263 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:42.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.259+0000 7f89f1aed980 1 Processor -- start 2024-09-18T02:04:42.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.259+0000 7f89f1aed980 1 -- start start 2024-09-18T02:04:42.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.259+0000 7f89f1aed980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a4b2468e00 0x55a4b246b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.259+0000 7f89f1aed980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a4b22eeae0 con 0x55a4b246b760 2024-09-18T02:04:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.259+0000 7f89f1aed980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55a4b2312e30 con 0x55a4b2468e00 2024-09-18T02:04:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.259+0000 7f89ef5fd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a4b2468e00 0x55a4b246b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.259+0000 7f89ef5fd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a4b2468e00 0x55a4b246b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33206/0 (socket says 172.21.15.167:33206) 2024-09-18T02:04:42.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.259+0000 7f89eedfc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55a4b246b760 0x55a4b246db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:42610/0 (socket says 172.21.15.167:42610) 2024-09-18T02:04:42.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.259+0000 7f89ef5fd640 1 -- 172.21.15.167:0/1793565676 learned_addr learned my addr 172.21.15.167:0/1793565676 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.263+0000 7f89ef5fd640 1 -- 172.21.15.167:0/1793565676 >> v1:172.21.15.81:6789/0 conn(0x55a4b246b760 legacy=0x55a4b246db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.263+0000 7f89ef5fd640 1 -- 172.21.15.167:0/1793565676 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b2470400 con 0x55a4b2468e00 2024-09-18T02:04:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.263+0000 7f89ef5fd640 1 --2- 172.21.15.167:0/1793565676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b246b1f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f89e000a4e0 tx=0x7f89e001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b61df843fad725 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.263+0000 7f89ee5fb640 1 -- 172.21.15.167:0/1793565676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00aa540 con 0x55a4b2468e00 2024-09-18T02:04:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.263+0000 7f89ee5fb640 1 -- 172.21.15.167:0/1793565676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e00aa6e0 con 0x55a4b2468e00 2024-09-18T02:04:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.263+0000 7f89ee5fb640 1 -- 172.21.15.167:0/1793565676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00aaa40 con 0x55a4b2468e00 2024-09-18T02:04:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.267+0000 7f89f1aed980 1 -- 172.21.15.167:0/1793565676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 msgr2=0x55a4b246b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.267+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1793565676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b246b1f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f89e000a4e0 tx=0x7f89e001b090 comp rx=0 tx=0).stop 2024-09-18T02:04:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.267+0000 7f89f1aed980 1 -- 172.21.15.167:0/1793565676 shutdown_connections 2024-09-18T02:04:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.267+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1793565676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b246b1f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.267+0000 7f89f1aed980 1 -- 172.21.15.167:0/1793565676 >> 172.21.15.167:0/1793565676 conn(0x55a4b23dc290 msgr2=0x55a4b23dc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.267+0000 7f89f1aed980 1 -- 172.21.15.167:0/1793565676 shutdown_connections 2024-09-18T02:04:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.267+0000 7f89f1aed980 1 -- 172.21.15.167:0/1793565676 wait complete. 2024-09-18T02:04:42.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 Processor -- start 2024-09-18T02:04:42.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 -- start start 2024-09-18T02:04:42.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b2553d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a4b2314200 con 0x55a4b2468e00 2024-09-18T02:04:42.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89ef5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b2553d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89ef5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b2553d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33222/0 (socket says 172.21.15.167:33222) 2024-09-18T02:04:42.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2582768531 learned_addr learned my addr 172.21.15.167:0/2582768531 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2582768531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b25542f0 con 0x55a4b2468e00 2024-09-18T02:04:42.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89ef5fd640 1 --2- 172.21.15.167:0/2582768531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b2553d20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f89e0017ca0 tx=0x7f89e00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e701090a4e06462 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f88dd60a640 1 -- 172.21.15.167:0/2582768531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00b9070 con 0x55a4b2468e00 2024-09-18T02:04:42.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f88dd60a640 1 -- 172.21.15.167:0/2582768531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e00aaa80 con 0x55a4b2468e00 2024-09-18T02:04:42.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f88dd60a640 1 -- 172.21.15.167:0/2582768531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00aad60 con 0x55a4b2468e00 2024-09-18T02:04:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 -- 172.21.15.167:0/2582768531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 msgr2=0x55a4b2553d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2582768531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b2553d20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f89e0017ca0 tx=0x7f89e00033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 -- 172.21.15.167:0/2582768531 shutdown_connections 2024-09-18T02:04:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2582768531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b2553d20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 -- 172.21.15.167:0/2582768531 >> 172.21.15.167:0/2582768531 conn(0x55a4b23dc290 msgr2=0x55a4b254f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 -- 172.21.15.167:0/2582768531 shutdown_connections 2024-09-18T02:04:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 -- 172.21.15.167:0/2582768531 wait complete. 2024-09-18T02:04:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 Processor -- start 2024-09-18T02:04:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 -- start start 2024-09-18T02:04:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b255aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.283+0000 7f89f1aed980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a4b246fe40 con 0x55a4b2468e00 2024-09-18T02:04:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89ef5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b255aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89ef5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b255aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33226/0 (socket says 172.21.15.167:33226) 2024-09-18T02:04:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89ef5fd640 1 -- 172.21.15.167:0/1095725660 learned_addr learned my addr 172.21.15.167:0/1095725660 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89ef5fd640 1 -- 172.21.15.167:0/1095725660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b255b410 con 0x55a4b2468e00 2024-09-18T02:04:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89ef5fd640 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b255aed0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f89e0018cc0 tx=0x7f89e0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f88dbe07640 1 -- 172.21.15.167:0/1095725660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00cc070 con 0x55a4b2468e00 2024-09-18T02:04:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4b255b6a0 con 0x55a4b2468e00 2024-09-18T02:04:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f88dbe07640 1 -- 172.21.15.167:0/1095725660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e00c7410 con 0x55a4b2468e00 2024-09-18T02:04:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4b255e380 con 0x55a4b2468e00 2024-09-18T02:04:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f88dbe07640 1 -- 172.21.15.167:0/1095725660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00b9070 con 0x55a4b2468e00 2024-09-18T02:04:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f88dbe07640 1 -- 172.21.15.167:0/1095725660 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89e00b3040 con 0x55a4b2468e00 2024-09-18T02:04:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f88dbe07640 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88d4034650 0x7f88d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f88dbe07640 1 -- 172.21.15.167:0/1095725660 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f89e00c4070 con 0x55a4b2468e00 2024-09-18T02:04:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89eedfc640 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88d4034650 0x7f88d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a4b246b760 0x55a4b2561fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b2562550 con 0x55a4b246b760 2024-09-18T02:04:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89efdfe640 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a4b246b760 0x55a4b2561fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89eedfc640 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88d4034650 0x7f88d4036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f89e4000f70 tx=0x7f89e4001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.287+0000 7f89efdfe640 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a4b246b760 0x55a4b2561fd0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89efdfe640 1 -- 172.21.15.167:0/1095725660 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89e80083f0 con 0x55a4b246b760 2024-09-18T02:04:42.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b255f5a0 con 0x55a4b246b760 2024-09-18T02:04:42.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89efdfe640 1 -- 172.21.15.167:0/1095725660 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89e80083f0 con 0x55a4b246b760 2024-09-18T02:04:42.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a4b25648b0 0x55a4b2566ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b2567390 con 0x55a4b25648b0 2024-09-18T02:04:42.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89ef5fd640 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a4b25648b0 0x55a4b2566ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89ef5fd640 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a4b25648b0 0x55a4b2566ca0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89ef5fd640 1 -- 172.21.15.167:0/1095725660 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89e00ce310 con 0x55a4b25648b0 2024-09-18T02:04:42.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b2563750 con 0x55a4b246b760 2024-09-18T02:04:42.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89efdfe640 1 -- 172.21.15.167:0/1095725660 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89e80083f0 con 0x55a4b246b760 2024-09-18T02:04:42.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a4b25687f0 0x55a4b256abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b256b320 con 0x55a4b25687f0 2024-09-18T02:04:42.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89eedfc640 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a4b25687f0 0x55a4b256abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89eedfc640 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a4b25687f0 0x55a4b256abe0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89eedfc640 1 -- 172.21.15.167:0/1095725660 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f89e400f6a0 con 0x55a4b25687f0 2024-09-18T02:04:42.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89f1aed980 1 Processor -- start 2024-09-18T02:04:42.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.291+0000 7f89f1aed980 1 -- start start 2024-09-18T02:04:42.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89f1aed980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2578df0 0x55a4b2579210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89f1aed980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a4b236d800 con 0x55a4b2578df0 2024-09-18T02:04:42.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89ef5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2578df0 0x55a4b2579210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89ef5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2578df0 0x55a4b2579210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33240/0 (socket says 172.21.15.167:33240) 2024-09-18T02:04:42.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89ef5fd640 1 -- 172.21.15.167:0/3400838485 learned_addr learned my addr 172.21.15.167:0/3400838485 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89ef5fd640 1 -- 172.21.15.167:0/3400838485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b2579750 con 0x55a4b2578df0 2024-09-18T02:04:42.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89ef5fd640 1 --2- 172.21.15.167:0/3400838485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2578df0 0x55a4b2579210 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f89e0000f90 tx=0x7f89e00ce610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f88d9602640 1 -- 172.21.15.167:0/3400838485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00e9070 con 0x55a4b2578df0 2024-09-18T02:04:42.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f88d9602640 1 -- 172.21.15.167:0/3400838485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e00e0070 con 0x55a4b2578df0 2024-09-18T02:04:42.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89f1aed980 1 -- 172.21.15.167:0/3400838485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4b25799e0 con 0x55a4b2578df0 2024-09-18T02:04:42.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f88d9602640 1 -- 172.21.15.167:0/3400838485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00ac2e0 con 0x55a4b2578df0 2024-09-18T02:04:42.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89f1aed980 1 -- 172.21.15.167:0/3400838485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4b257c660 con 0x55a4b2578df0 2024-09-18T02:04:42.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f88d9602640 1 -- 172.21.15.167:0/3400838485 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89e00ec070 con 0x55a4b2578df0 2024-09-18T02:04:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f88d9602640 1 --2- 172.21.15.167:0/3400838485 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88c8034650 0x7f88c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f88d9602640 1 -- 172.21.15.167:0/3400838485 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f89e00efbf0 con 0x55a4b2578df0 2024-09-18T02:04:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89eedfc640 1 --2- 172.21.15.167:0/3400838485 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88c8034650 0x7f88c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89f1aed980 1 Processor -- start 2024-09-18T02:04:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89f1aed980 1 -- start start 2024-09-18T02:04:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89f1aed980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b2585b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89f1aed980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a4b25545b0 con 0x55a4b25857b0 2024-09-18T02:04:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89eedfc640 1 --2- 172.21.15.167:0/3400838485 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88c8034650 0x7f88c8036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55a4b2562a30 tx=0x7f89e400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89ef5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b2585b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89ef5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b2585b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33256/0 (socket says 172.21.15.167:33256) 2024-09-18T02:04:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.295+0000 7f89ef5fd640 1 -- 172.21.15.167:0/1841711703 learned_addr learned my addr 172.21.15.167:0/1841711703 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89ef5fd640 1 -- 172.21.15.167:0/1841711703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b2586160 con 0x55a4b25857b0 2024-09-18T02:04:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89ef5fd640 1 --2- 172.21.15.167:0/1841711703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b2585b90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f89e00cfa40 tx=0x7f89e00e1740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b148964b63e7191 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f88d2ffd640 1 -- 172.21.15.167:0/1841711703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00ace60 con 0x55a4b25857b0 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f88d2ffd640 1 -- 172.21.15.167:0/1841711703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e0101070 con 0x55a4b25857b0 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f88d2ffd640 1 -- 172.21.15.167:0/1841711703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00ac5b0 con 0x55a4b25857b0 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 -- 172.21.15.167:0/1841711703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 msgr2=0x55a4b2585b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1841711703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b2585b90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f89e00cfa40 tx=0x7f89e00e1740 comp rx=0 tx=0).stop 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 -- 172.21.15.167:0/1841711703 shutdown_connections 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1841711703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b2585b90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 -- 172.21.15.167:0/1841711703 >> 172.21.15.167:0/1841711703 conn(0x55a4b2581b90 msgr2=0x55a4b257fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 -- 172.21.15.167:0/1841711703 shutdown_connections 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 -- 172.21.15.167:0/1841711703 wait complete. 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 Processor -- start 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 -- start start 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b258c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a4b2586600 con 0x55a4b25857b0 2024-09-18T02:04:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89ef5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b258c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89ef5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b258c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33264/0 (socket says 172.21.15.167:33264) 2024-09-18T02:04:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 learned_addr learned my addr 172.21.15.167:0/2629524370 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b258ceb0 con 0x55a4b25857b0 2024-09-18T02:04:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89ef5fd640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b258c970 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f89e00cfa40 tx=0x7f89e00e9ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f88d17fa640 1 -- 172.21.15.167:0/2629524370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00cec80 con 0x55a4b25857b0 2024-09-18T02:04:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f88d17fa640 1 -- 172.21.15.167:0/2629524370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e00cee20 con 0x55a4b25857b0 2024-09-18T02:04:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f88d17fa640 1 -- 172.21.15.167:0/2629524370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e00a96c0 con 0x55a4b25857b0 2024-09-18T02:04:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.299+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4b258ceb0 con 0x55a4b25857b0 2024-09-18T02:04:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4b258ceb0 con 0x55a4b25857b0 2024-09-18T02:04:42.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f88d17fa640 1 -- 172.21.15.167:0/2629524370 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89e00a9860 con 0x55a4b25857b0 2024-09-18T02:04:42.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f88d17fa640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88b80346a0 0x7f88b8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f88d17fa640 1 -- 172.21.15.167:0/2629524370 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f89e00f9070 con 0x55a4b25857b0 2024-09-18T02:04:42.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89eedfc640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88b80346a0 0x7f88b8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a4b2597a30 0x55a4b2599ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259a640 con 0x55a4b2597a30 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89efdfe640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a4b2597a30 0x55a4b2599ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89eedfc640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88b80346a0 0x7f88b8036b60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f89e400ffd0 tx=0x7f89e4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89efdfe640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a4b2597a30 0x55a4b2599ef0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89e80083f0 con 0x55a4b2597a30 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 20 realm 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259aa50 con 0x55a4b2597a30 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89e80083f0 con 0x55a4b2597a30 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b320 con 0x55a4b2597a30 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89e80083f0 con 0x55a4b2597a30 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b2597a30 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89e80083f0 con 0x55a4b2597a30 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a4b259c420 0x55a4b259e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.303+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259ede0 con 0x55a4b259c420 2024-09-18T02:04:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89ef5fd640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a4b259c420 0x55a4b259e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89ef5fd640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a4b259c420 0x55a4b259e810 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89f1aed980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89f1aed980 20 searching for the correct realm 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a4b25a0d30 0x55a4b25a3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a3830 con 0x55a4b25a0d30 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89eedfc640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a4b25a0d30 0x55a4b25a3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89eedfc640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a4b25a0d30 0x55a4b25a3160 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89eedfc640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f89e401fbe0 0x7f89e403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a3830 con 0x7f89e401fbe0 2024-09-18T02:04:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89efdfe640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f89e401fbe0 0x7f89e403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89efdfe640 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f89e401fbe0 0x7f89e403a3c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e80083f0 con 0x7f89e401fbe0 2024-09-18T02:04:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x7f89e401fbe0 2024-09-18T02:04:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e80083f0 con 0x7f89e401fbe0 2024-09-18T02:04:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.307+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b2597a30 2024-09-18T02:04:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b2597a30 2024-09-18T02:04:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b2597a30 2024-09-18T02:04:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b259c420 2024-09-18T02:04:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x7f89e401fbe0 2024-09-18T02:04:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b25a0d30 2024-09-18T02:04:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b2597a30 2024-09-18T02:04:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x7f89e401fbe0 2024-09-18T02:04:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b2597a30 2024-09-18T02:04:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x7f89e401fbe0 2024-09-18T02:04:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b25a0d30 2024-09-18T02:04:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b25a0d30 2024-09-18T02:04:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.311+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b259c420 2024-09-18T02:04:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b25a0d30 2024-09-18T02:04:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b25a0d30 2024-09-18T02:04:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b2597a30 2024-09-18T02:04:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b2597a30 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b259c420 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b25a0d30 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x7f89e401fbe0 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b2597a30 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.315+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b259c420 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b25a0d30 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b259c420 2024-09-18T02:04:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x7f89e401fbe0 2024-09-18T02:04:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b25a0d30 2024-09-18T02:04:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b259c420 2024-09-18T02:04:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x55a4b2597a30 2024-09-18T02:04:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259b6c0 con 0x7f89e401fbe0 2024-09-18T02:04:42.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:42.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:42.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:42.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:42.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259f6a0 con 0x55a4b2597a30 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259f6a0 con 0x55a4b2597a30 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.319+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259f6a0 con 0x55a4b25a0d30 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 20 zone default found 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 4 Realm: () 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 20 zonegroup default 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a0070 con 0x55a4b259c420 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b259fbd0 con 0x55a4b25a0d30 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a5be0 con 0x55a4b25a0d30 2024-09-18T02:04:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 20 started sync module instance, tier type = 2024-09-18T02:04:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a4fd0 con 0x7f89e401fbe0 2024-09-18T02:04:42.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94165855261936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a4fd0 con 0x7f89e401fbe0 2024-09-18T02:04:42.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.323+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a66a0 con 0x55a4b2597a30 2024-09-18T02:04:42.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.327+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94165855261936] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.327+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.327+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94165855265168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a4fd0 con 0x55a4b2597a30 2024-09-18T02:04:42.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.327+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a70b0 con 0x55a4b25a0d30 2024-09-18T02:04:42.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.327+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94165855265168] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.327+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.327+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94165855259424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a4f40 con 0x55a4b25a0d30 2024-09-18T02:04:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.327+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a7e40 con 0x7f89e401fbe0 2024-09-18T02:04:42.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.331+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.331+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94165855271248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a86e0 con 0x7f89e401fbe0 2024-09-18T02:04:42.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.331+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a90e0 con 0x55a4b2597a30 2024-09-18T02:04:42.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.331+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94165855259424] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.331+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94165855271248] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.331+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.331+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94165855270048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a81b0 con 0x55a4b2597a30 2024-09-18T02:04:42.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.331+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a9980 con 0x55a4b259c420 2024-09-18T02:04:42.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.335+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94165855270048] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.335+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.335+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94165855278288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25a81b0 con 0x55a4b259c420 2024-09-18T02:04:42.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.335+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25aa1d0 con 0x55a4b259c420 2024-09-18T02:04:42.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.335+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94165855278288] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.335+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.335+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94165855280416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25aa5f0 con 0x55a4b259c420 2024-09-18T02:04:42.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.335+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25aafb0 con 0x55a4b259c420 2024-09-18T02:04:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94165855283968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25ab3d0 con 0x55a4b259c420 2024-09-18T02:04:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89f1aed980 20 add_watcher() i=0 2024-09-18T02:04:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89f1aed980 20 add_watcher() i=1 2024-09-18T02:04:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89f1aed980 20 add_watcher() i=2 2024-09-18T02:04:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89f1aed980 20 add_watcher() i=3 2024-09-18T02:04:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89f1aed980 20 add_watcher() i=4 2024-09-18T02:04:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89f1aed980 20 add_watcher() i=5 2024-09-18T02:04:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94165855280416] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89f1aed980 20 add_watcher() i=6 2024-09-18T02:04:42.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94165855283968] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89f1aed980 20 add_watcher() i=7 2024-09-18T02:04:42.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89f1aed980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:42.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.339+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25ab3d0 con 0x55a4b2597a30 2024-09-18T02:04:42.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94165855285024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25ab340 con 0x55a4b2597a30 2024-09-18T02:04:42.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94165855285024] v32'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f88a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:42.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:42.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:42.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 5 note: GC not initialized 2024-09-18T02:04:42.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f88a4fe1640 20 reqs_thread_entry: start 2024-09-18T02:04:42.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:42.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 20 Filter name: none 2024-09-18T02:04:42.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f881e7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:42.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:04:42.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25d20b0 con 0x7f89e401fbe0 2024-09-18T02:04:42.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 : miss 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:63 8.1c 8:3ecfd7e4:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25d3ae0 con 0x55a4b25a0d30 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(63 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 info.flags=0x17 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 to cache LRU end 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 2024-09-18T02:04:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 20 get_obj_state: octx=0x55a4b2585b90 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55a4b25d6308 s->prefetch_data=0 2024-09-18T02:04:42.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.343+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:64 3.24 3:24e94933:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25d74c0 con 0x55a4b259c420 2024-09-18T02:04:42.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.347+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(64 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.347+0000 7f89f1aed980 10 manifest: total_size = 5 2024-09-18T02:04:42.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.347+0000 7f89f1aed980 20 get_obj_state: setting s->obj_tag to _M4xY-_Vo5sidofEP83r6zbLyNTyNmDw 2024-09-18T02:04:42.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.347+0000 7f88a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.347+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94165855285024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25cf920 con 0x55a4b2597a30 2024-09-18T02:04:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.347+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94165855285024] v32'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.347+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94165855261936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25d74c0 con 0x7f89e401fbe0 2024-09-18T02:04:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.351+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94165855261936] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.351+0000 7f89f1aed980 20 remove_watcher() i=0 2024-09-18T02:04:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.351+0000 7f89f1aed980 2 removed watcher, disabling cache 2024-09-18T02:04:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.351+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94165855265168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25d74c0 con 0x55a4b2597a30 2024-09-18T02:04:42.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.351+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94165855265168] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.351+0000 7f89f1aed980 20 remove_watcher() i=1 2024-09-18T02:04:42.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.351+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94165855259424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25d74c0 con 0x55a4b25a0d30 2024-09-18T02:04:42.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.355+0000 7f89eedfc640 1 -- 172.21.15.167:0/2629524370 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94165855259424] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4037040 con 0x55a4b25a0d30 2024-09-18T02:04:42.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.355+0000 7f89f1aed980 20 remove_watcher() i=2 2024-09-18T02:04:42.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.355+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94165855271248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25d74c0 con 0x7f89e401fbe0 2024-09-18T02:04:42.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.355+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94165855271248] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x7f89e401fbe0 2024-09-18T02:04:42.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.355+0000 7f89f1aed980 20 remove_watcher() i=3 2024-09-18T02:04:42.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.355+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94165855270048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25d74c0 con 0x55a4b2597a30 2024-09-18T02:04:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.355+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94165855270048] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e8026040 con 0x55a4b2597a30 2024-09-18T02:04:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.355+0000 7f89f1aed980 20 remove_watcher() i=4 2024-09-18T02:04:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.355+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94165855278288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25d74c0 con 0x55a4b259c420 2024-09-18T02:04:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.359+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94165855278288] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.359+0000 7f89f1aed980 20 remove_watcher() i=5 2024-09-18T02:04:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.359+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94165855280416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25d74c0 con 0x55a4b259c420 2024-09-18T02:04:42.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.359+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94165855280416] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.359+0000 7f89f1aed980 20 remove_watcher() i=6 2024-09-18T02:04:42.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.359+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94165855283968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4b25d74c0 con 0x55a4b259c420 2024-09-18T02:04:42.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89ef5fd640 1 -- 172.21.15.167:0/2629524370 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94165855283968] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e0115020 con 0x55a4b259c420 2024-09-18T02:04:42.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 20 remove_watcher() i=7 2024-09-18T02:04:42.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a4b259c420 msgr2=0x55a4b259e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a4b259c420 0x55a4b259e810 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a4b2597a30 msgr2=0x55a4b2599ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a4b2597a30 0x55a4b2599ef0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f89e401fbe0 msgr2=0x7f89e403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f89e401fbe0 0x7f89e403a3c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a4b25a0d30 msgr2=0x55a4b25a3160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a4b25a0d30 0x55a4b25a3160 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88b80346a0 msgr2=0x7f88b8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88b80346a0 0x7f88b8036b60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f89e400ffd0 tx=0x7f89e4010000 comp rx=0 tx=0).stop 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89efdfe640 1 -- 172.21.15.167:0/2629524370 reap_dead start 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 msgr2=0x55a4b258c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b258c970 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f89e00cfa40 tx=0x7f89e00e9ed0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 shutdown_connections 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/2629524370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b25857b0 0x55a4b258c970 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 >> 172.21.15.167:0/2629524370 conn(0x55a4b2581b90 msgr2=0x55a4b257fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 shutdown_connections 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/2629524370 wait complete. 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/3400838485 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88c8034650 msgr2=0x7f88c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/3400838485 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88c8034650 0x7f88c8036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55a4b2562a30 tx=0x7f89e400f000 comp rx=0 tx=0).stop 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/3400838485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2578df0 msgr2=0x55a4b2579210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/3400838485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2578df0 0x55a4b2579210 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f89e0000f90 tx=0x7f89e00ce610 comp rx=0 tx=0).stop 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/3400838485 shutdown_connections 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/3400838485 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88c8034650 0x7f88c8036b10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/3400838485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2578df0 0x55a4b2579210 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/3400838485 >> 172.21.15.167:0/3400838485 conn(0x55a4b256df40 msgr2=0x55a4b25709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/3400838485 shutdown_connections 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/3400838485 wait complete. 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a4b25648b0 msgr2=0x55a4b2566ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a4b25648b0 0x55a4b2566ca0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a4b246b760 msgr2=0x55a4b2561fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a4b246b760 0x55a4b2561fd0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a4b25687f0 msgr2=0x55a4b256abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a4b25687f0 0x55a4b256abe0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88d4034650 msgr2=0x7f88d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f88d4034650 0x7f88d4036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f89e4000f70 tx=0x7f89e4001380 comp rx=0 tx=0).stop 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 msgr2=0x55a4b255aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89f1aed980 1 --2- 172.21.15.167:0/1095725660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4b2468e00 0x55a4b255aed0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f89e0018cc0 tx=0x7f89e0017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.363+0000 7f89efdfe640 1 -- 172.21.15.167:0/1095725660 reap_dead start 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.367+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 shutdown_connections 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.367+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 >> 172.21.15.167:0/1095725660 conn(0x55a4b23dc290 msgr2=0x55a4b254e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.367+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 shutdown_connections 2024-09-18T02:04:42.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.367+0000 7f89f1aed980 1 -- 172.21.15.167:0/1095725660 wait complete. 2024-09-18T02:04:42.381 INFO:teuthology.orchestra.run.smithi167.stdout:fooFoofooFooFULL_CONTROL 2024-09-18T02:04:42.382 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-18T02:04:42.384 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-18T02:04:42.391 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:42.391 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T02:04:42.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T02:04:42.392 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-18T02:04:42.462 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:42.462 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:42.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.459+0000 7f4befb34980 1 Processor -- start 2024-09-18T02:04:42.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.459+0000 7f4befb34980 1 -- start start 2024-09-18T02:04:42.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.459+0000 7f4befb34980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ae53f99fb0 0x55ae53f98a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.459+0000 7f4befb34980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ae53eabae0 con 0x55ae53f99ba0 2024-09-18T02:04:42.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.459+0000 7f4befb34980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55ae53ecfe30 con 0x55ae53f99fb0 2024-09-18T02:04:42.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.459+0000 7f4bece43640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ae53f99fb0 0x55ae53f98a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.459+0000 7f4bece43640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ae53f99fb0 0x55ae53f98a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33276/0 (socket says 172.21.15.167:33276) 2024-09-18T02:04:42.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.459+0000 7f4bece43640 1 -- 172.21.15.167:0/549091516 learned_addr learned my addr 172.21.15.167:0/549091516 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.459+0000 7f4bece43640 1 -- 172.21.15.167:0/549091516 >> v1:172.21.15.81:6789/0 conn(0x55ae53f99ba0 legacy=0x55ae53f98360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.459+0000 7f4bece43640 1 -- 172.21.15.167:0/549091516 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae53f990d0 con 0x55ae53f99fb0 2024-09-18T02:04:42.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.463+0000 7f4bece43640 1 --2- 172.21.15.167:0/549091516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99fb0 0x55ae53f98a70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800a4e0 tx=0x7f4bd801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c380beace4ccbc63 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.463+0000 7f4be7fff640 1 -- 172.21.15.167:0/549091516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd80aa540 con 0x55ae53f99fb0 2024-09-18T02:04:42.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.463+0000 7f4be7fff640 1 -- 172.21.15.167:0/549091516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd80aa6e0 con 0x55ae53f99fb0 2024-09-18T02:04:42.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.463+0000 7f4be7fff640 1 -- 172.21.15.167:0/549091516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd80aaa40 con 0x55ae53f99fb0 2024-09-18T02:04:42.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.463+0000 7f4befb34980 1 -- 172.21.15.167:0/549091516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99fb0 msgr2=0x55ae53f98a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.463+0000 7f4befb34980 1 --2- 172.21.15.167:0/549091516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99fb0 0x55ae53f98a70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800a4e0 tx=0x7f4bd801b090 comp rx=0 tx=0).stop 2024-09-18T02:04:42.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.463+0000 7f4befb34980 1 -- 172.21.15.167:0/549091516 shutdown_connections 2024-09-18T02:04:42.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.463+0000 7f4befb34980 1 --2- 172.21.15.167:0/549091516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99fb0 0x55ae53f98a70 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.463+0000 7f4befb34980 1 -- 172.21.15.167:0/549091516 >> 172.21.15.167:0/549091516 conn(0x55ae5401f180 msgr2=0x55ae540215a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.463+0000 7f4befb34980 1 -- 172.21.15.167:0/549091516 shutdown_connections 2024-09-18T02:04:42.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.463+0000 7f4befb34980 1 -- 172.21.15.167:0/549091516 wait complete. 2024-09-18T02:04:42.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.479+0000 7f4befb34980 1 Processor -- start 2024-09-18T02:04:42.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.479+0000 7f4befb34980 1 -- start start 2024-09-18T02:04:42.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.479+0000 7f4befb34980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 0x55ae54110c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.479+0000 7f4befb34980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ae53ed1200 con 0x55ae53f99ba0 2024-09-18T02:04:42.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.479+0000 7f4bed644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 0x55ae54110c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.479+0000 7f4bed644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 0x55ae54110c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33284/0 (socket says 172.21.15.167:33284) 2024-09-18T02:04:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.479+0000 7f4bed644640 1 -- 172.21.15.167:0/2755790042 learned_addr learned my addr 172.21.15.167:0/2755790042 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.479+0000 7f4bed644640 1 -- 172.21.15.167:0/2755790042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae54111200 con 0x55ae53f99ba0 2024-09-18T02:04:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.479+0000 7f4bed644640 1 --2- 172.21.15.167:0/2755790042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 0x55ae54110c30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4be0001ea0 tx=0x7f4be000b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587b0a6889e5dd10 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.479+0000 7f4ada614640 1 -- 172.21.15.167:0/2755790042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be000a040 con 0x55ae53f99ba0 2024-09-18T02:04:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.479+0000 7f4ada614640 1 -- 172.21.15.167:0/2755790042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4be000f620 con 0x55ae53f99ba0 2024-09-18T02:04:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4ada614640 1 -- 172.21.15.167:0/2755790042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be000f890 con 0x55ae53f99ba0 2024-09-18T02:04:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 -- 172.21.15.167:0/2755790042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 msgr2=0x55ae54110c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 --2- 172.21.15.167:0/2755790042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 0x55ae54110c30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4be0001ea0 tx=0x7f4be000b680 comp rx=0 tx=0).stop 2024-09-18T02:04:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 -- 172.21.15.167:0/2755790042 shutdown_connections 2024-09-18T02:04:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 --2- 172.21.15.167:0/2755790042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 0x55ae54110c30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 -- 172.21.15.167:0/2755790042 >> 172.21.15.167:0/2755790042 conn(0x55ae5401f180 msgr2=0x55ae5410c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 -- 172.21.15.167:0/2755790042 shutdown_connections 2024-09-18T02:04:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 -- 172.21.15.167:0/2755790042 wait complete. 2024-09-18T02:04:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 Processor -- start 2024-09-18T02:04:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 -- start start 2024-09-18T02:04:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 0x55ae54117fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ae5402f1d0 con 0x55ae53f99ba0 2024-09-18T02:04:42.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4bed644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 0x55ae54117fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4bed644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 0x55ae54117fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33288/0 (socket says 172.21.15.167:33288) 2024-09-18T02:04:42.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4bed644640 1 -- 172.21.15.167:0/85963748 learned_addr learned my addr 172.21.15.167:0/85963748 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4bed644640 1 -- 172.21.15.167:0/85963748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae54118520 con 0x55ae53f99ba0 2024-09-18T02:04:42.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4bed644640 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 0x55ae54117fe0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4be0001fd0 tx=0x7f4be0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4ad8e11640 1 -- 172.21.15.167:0/85963748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be0001520 con 0x55ae53f99ba0 2024-09-18T02:04:42.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4ad8e11640 1 -- 172.21.15.167:0/85963748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4be001ca10 con 0x55ae53f99ba0 2024-09-18T02:04:42.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae541187b0 con 0x55ae53f99ba0 2024-09-18T02:04:42.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4ad8e11640 1 -- 172.21.15.167:0/85963748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be001cd50 con 0x55ae53f99ba0 2024-09-18T02:04:42.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.483+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae5411b490 con 0x55ae53f99ba0 2024-09-18T02:04:42.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4ad8e11640 1 -- 172.21.15.167:0/85963748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4be0017050 con 0x55ae53f99ba0 2024-09-18T02:04:42.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4ad8e11640 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ad4034650 0x7f4ad4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4ad8e11640 1 -- 172.21.15.167:0/85963748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4be0015020 con 0x55ae53f99ba0 2024-09-18T02:04:42.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4bece43640 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ad4034650 0x7f4ad4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4befb34980 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ae53f99fb0 0x55ae5411f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae5411f660 con 0x55ae53f99fb0 2024-09-18T02:04:42.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4bede45640 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ae53f99fb0 0x55ae5411f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4bece43640 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ad4034650 0x7f4ad4036b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80ab000 tx=0x7f4bd80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4bede45640 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ae53f99fb0 0x55ae5411f0e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4bede45640 1 -- 172.21.15.167:0/85963748 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4be80083f0 con 0x55ae53f99fb0 2024-09-18T02:04:42.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae5411c6b0 con 0x55ae53f99fb0 2024-09-18T02:04:42.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4bede45640 1 -- 172.21.15.167:0/85963748 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4be80083f0 con 0x55ae53f99fb0 2024-09-18T02:04:42.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4befb34980 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ae541219c0 0x55ae54123db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae54124480 con 0x55ae541219c0 2024-09-18T02:04:42.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4bed644640 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ae541219c0 0x55ae54123db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.487+0000 7f4bed644640 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ae541219c0 0x55ae54123db0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4bed644640 1 -- 172.21.15.167:0/85963748 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4be002e070 con 0x55ae541219c0 2024-09-18T02:04:42.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae54120860 con 0x55ae53f99fb0 2024-09-18T02:04:42.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4bede45640 1 -- 172.21.15.167:0/85963748 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4be80083f0 con 0x55ae53f99fb0 2024-09-18T02:04:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4befb34980 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ae541258e0 0x55ae54127cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae541283d0 con 0x55ae541258e0 2024-09-18T02:04:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4bece43640 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ae541258e0 0x55ae54127cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4bece43640 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ae541258e0 0x55ae54127cd0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4bece43640 1 -- 172.21.15.167:0/85963748 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4bd80bc040 con 0x55ae541258e0 2024-09-18T02:04:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4befb34980 1 Processor -- start 2024-09-18T02:04:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4befb34980 1 -- start start 2024-09-18T02:04:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4befb34980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54135ea0 0x55ae541362c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4befb34980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ae53f2a800 con 0x55ae54135ea0 2024-09-18T02:04:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4bed644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54135ea0 0x55ae541362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4bed644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54135ea0 0x55ae541362c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33302/0 (socket says 172.21.15.167:33302) 2024-09-18T02:04:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4bed644640 1 -- 172.21.15.167:0/3191105260 learned_addr learned my addr 172.21.15.167:0/3191105260 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4bed644640 1 -- 172.21.15.167:0/3191105260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae54136800 con 0x55ae54135ea0 2024-09-18T02:04:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4bed644640 1 --2- 172.21.15.167:0/3191105260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54135ea0 0x55ae541362c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4be0048860 tx=0x7f4be0018d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4ad1ffb640 1 -- 172.21.15.167:0/3191105260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be0048950 con 0x55ae54135ea0 2024-09-18T02:04:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4ad1ffb640 1 -- 172.21.15.167:0/3191105260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4be0048af0 con 0x55ae54135ea0 2024-09-18T02:04:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4befb34980 1 -- 172.21.15.167:0/3191105260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae54136a90 con 0x55ae54135ea0 2024-09-18T02:04:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4ad1ffb640 1 -- 172.21.15.167:0/3191105260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be0048df0 con 0x55ae54135ea0 2024-09-18T02:04:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.491+0000 7f4befb34980 1 -- 172.21.15.167:0/3191105260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae54139710 con 0x55ae54135ea0 2024-09-18T02:04:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4ad1ffb640 1 -- 172.21.15.167:0/3191105260 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4be0013130 con 0x55ae54135ea0 2024-09-18T02:04:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4ad1ffb640 1 --2- 172.21.15.167:0/3191105260 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ac4034600 0x7f4ac4036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4ad1ffb640 1 -- 172.21.15.167:0/3191105260 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4be0041870 con 0x55ae54135ea0 2024-09-18T02:04:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4bece43640 1 --2- 172.21.15.167:0/3191105260 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ac4034600 0x7f4ac4036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4befb34980 1 Processor -- start 2024-09-18T02:04:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4befb34980 1 -- start start 2024-09-18T02:04:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4bece43640 1 --2- 172.21.15.167:0/3191105260 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ac4034600 0x7f4ac4036ac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55ae5411ff70 tx=0x7f4bd8005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4befb34980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54142c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4befb34980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ae54111580 con 0x55ae54142880 2024-09-18T02:04:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4bed644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4bed644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33306/0 (socket says 172.21.15.167:33306) 2024-09-18T02:04:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4bed644640 1 -- 172.21.15.167:0/3499012435 learned_addr learned my addr 172.21.15.167:0/3499012435 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4bed644640 1 -- 172.21.15.167:0/3499012435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae54143250 con 0x55ae54142880 2024-09-18T02:04:42.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4bed644640 1 --2- 172.21.15.167:0/3499012435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54142c80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4be0020fb0 tx=0x7f4be00305c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d6bda1531cdda6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4acb7fe640 1 -- 172.21.15.167:0/3499012435 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be005d070 con 0x55ae54142880 2024-09-18T02:04:42.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4acb7fe640 1 -- 172.21.15.167:0/3499012435 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4be00420f0 con 0x55ae54142880 2024-09-18T02:04:42.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4acb7fe640 1 -- 172.21.15.167:0/3499012435 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be0041d00 con 0x55ae54142880 2024-09-18T02:04:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4befb34980 1 -- 172.21.15.167:0/3499012435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 msgr2=0x55ae54142c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4befb34980 1 --2- 172.21.15.167:0/3499012435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54142c80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4be0020fb0 tx=0x7f4be00305c0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4befb34980 1 -- 172.21.15.167:0/3499012435 shutdown_connections 2024-09-18T02:04:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4befb34980 1 --2- 172.21.15.167:0/3499012435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54142c80 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4befb34980 1 -- 172.21.15.167:0/3499012435 >> 172.21.15.167:0/3499012435 conn(0x55ae5413ebb0 msgr2=0x55ae5413ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4befb34980 1 -- 172.21.15.167:0/3499012435 shutdown_connections 2024-09-18T02:04:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.495+0000 7f4befb34980 1 -- 172.21.15.167:0/3499012435 wait complete. 2024-09-18T02:04:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4befb34980 1 Processor -- start 2024-09-18T02:04:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4befb34980 1 -- start start 2024-09-18T02:04:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4befb34980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4befb34980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ae541435c0 con 0x55ae54142880 2024-09-18T02:04:42.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4bed644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4bed644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33308/0 (socket says 172.21.15.167:33308) 2024-09-18T02:04:42.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 learned_addr learned my addr 172.21.15.167:0/3820310757 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae54149d60 con 0x55ae54142880 2024-09-18T02:04:42.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4bed644640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54149820 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4be0030960 tx=0x7f4be0020f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4ac9ffb640 1 -- 172.21.15.167:0/3820310757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be005d040 con 0x55ae54142880 2024-09-18T02:04:42.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae54149d60 con 0x55ae54142880 2024-09-18T02:04:42.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae54149d60 con 0x55ae54142880 2024-09-18T02:04:42.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4ac9ffb640 1 -- 172.21.15.167:0/3820310757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4be00474e0 con 0x55ae54142880 2024-09-18T02:04:42.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4ac9ffb640 1 -- 172.21.15.167:0/3820310757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be00477c0 con 0x55ae54142880 2024-09-18T02:04:42.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4ac9ffb640 1 -- 172.21.15.167:0/3820310757 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4be0056070 con 0x55ae54142880 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4ac9ffb640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4abc034600 0x7f4abc036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4ac9ffb640 1 -- 172.21.15.167:0/3820310757 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4be0053070 con 0x55ae54142880 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4bece43640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4abc034600 0x7f4abc036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4befb34980 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ae54154730 0x55ae54156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae54157340 con 0x55ae54154730 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.499+0000 7f4bede45640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ae54154730 0x55ae54156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4bece43640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4abc034600 0x7f4abc036ac0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4bd801b0d0 tx=0x7f4bd80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4bede45640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ae54154730 0x55ae54156bf0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4be80083f0 con 0x55ae54154730 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 20 realm 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae54157750 con 0x55ae54154730 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4be80083f0 con 0x55ae54154730 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae54158020 con 0x55ae54154730 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4be80083f0 con 0x55ae54154730 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54154730 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4be80083f0 con 0x55ae54154730 2024-09-18T02:04:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:42.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ae54159120 0x55ae5415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae5415bb20 con 0x55ae54159120 2024-09-18T02:04:42.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4bed644640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ae54159120 0x55ae5415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4bed644640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ae54159120 0x55ae5415b510 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 20 searching for the correct realm 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ae5415da70 0x55ae5415fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae54160550 con 0x55ae5415da70 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4bece43640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ae5415da70 0x55ae5415fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.503+0000 7f4bece43640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ae5415da70 0x55ae5415fe80 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bece43640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4bd80cd050 0x7f4bd80cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae54160550 con 0x7f4bd80cd050 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4bd80cd050 0x7f4bd80cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4bd80cd050 0x7f4bd80cd430 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be80083f0 con 0x7f4bd80cd050 2024-09-18T02:04:42.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x7f4bd80cd050 2024-09-18T02:04:42.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be80083f0 con 0x7f4bd80cd050 2024-09-18T02:04:42.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54154730 2024-09-18T02:04:42.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54154730 2024-09-18T02:04:42.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54154730 2024-09-18T02:04:42.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54159120 2024-09-18T02:04:42.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x7f4bd80cd050 2024-09-18T02:04:42.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae5415da70 2024-09-18T02:04:42.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54154730 2024-09-18T02:04:42.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.507+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x7f4bd80cd050 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54154730 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x7f4bd80cd050 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae5415da70 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae5415da70 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54159120 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae5415da70 2024-09-18T02:04:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae5415da70 2024-09-18T02:04:42.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54154730 2024-09-18T02:04:42.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54154730 2024-09-18T02:04:42.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54159120 2024-09-18T02:04:42.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.511+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae5415da70 2024-09-18T02:04:42.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x7f4bd80cd050 2024-09-18T02:04:42.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54154730 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54159120 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae5415da70 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54159120 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x7f4bd80cd050 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae5415da70 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54159120 2024-09-18T02:04:42.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.515+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x55ae54154730 2024-09-18T02:04:42.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae541583c0 con 0x7f4bd80cd050 2024-09-18T02:04:42.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae5415c3e0 con 0x55ae54154730 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae5415c3e0 con 0x55ae54154730 2024-09-18T02:04:42.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae5415c3e0 con 0x55ae5415da70 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 zone default found 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 4 Realm: () 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 zonegroup default 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae5415cda0 con 0x55ae54159120 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae5415c940 con 0x55ae5415da70 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae54162900 con 0x55ae5415da70 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 started sync module instance, tier type = 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:42.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.519+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54161cf0 con 0x7f4bd80cd050 2024-09-18T02:04:42.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.523+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.523+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94207223407168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54161cf0 con 0x7f4bd80cd050 2024-09-18T02:04:42.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.523+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54163360 con 0x55ae54154730 2024-09-18T02:04:42.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.523+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94207223407168] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.523+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.523+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94207223410624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54161cf0 con 0x55ae54154730 2024-09-18T02:04:42.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.523+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54163d70 con 0x55ae5415da70 2024-09-18T02:04:42.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.527+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94207223410624] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.527+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.527+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94207223404608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54161c60 con 0x55ae5415da70 2024-09-18T02:04:42.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.527+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54164a70 con 0x7f4bd80cd050 2024-09-18T02:04:42.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.527+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.527+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94207223416560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54165310 con 0x7f4bd80cd050 2024-09-18T02:04:42.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.527+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54165cd0 con 0x55ae54154730 2024-09-18T02:04:42.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.527+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94207223416560] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.531+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94207223404608] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.531+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.531+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94207223420960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54165280 con 0x55ae54154730 2024-09-18T02:04:42.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.531+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54165c40 con 0x55ae54159120 2024-09-18T02:04:42.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.531+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94207223420960] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.531+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.531+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94207223418624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54166570 con 0x55ae54159120 2024-09-18T02:04:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.531+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54166dc0 con 0x55ae54159120 2024-09-18T02:04:42.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94207223418624] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94207223423648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54166cb0 con 0x55ae54159120 2024-09-18T02:04:42.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae541677d0 con 0x55ae54159120 2024-09-18T02:04:42.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94207223427744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54167c40 con 0x55ae54159120 2024-09-18T02:04:42.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4befb34980 20 add_watcher() i=0 2024-09-18T02:04:42.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4befb34980 20 add_watcher() i=1 2024-09-18T02:04:42.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4befb34980 20 add_watcher() i=2 2024-09-18T02:04:42.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4befb34980 20 add_watcher() i=3 2024-09-18T02:04:42.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4befb34980 20 add_watcher() i=4 2024-09-18T02:04:42.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.535+0000 7f4befb34980 20 add_watcher() i=5 2024-09-18T02:04:42.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.539+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94207223423648] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.539+0000 7f4befb34980 20 add_watcher() i=6 2024-09-18T02:04:42.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.539+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94207223427744] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.539+0000 7f4befb34980 20 add_watcher() i=7 2024-09-18T02:04:42.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.539+0000 7f4befb34980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:42.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.539+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae54166740 con 0x55ae54154730 2024-09-18T02:04:42.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.539+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.539+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94207223424768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54168150 con 0x55ae54154730 2024-09-18T02:04:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94207223424768] v32'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4aa27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 5 note: GC not initialized 2024-09-18T02:04:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4aa17e2640 20 reqs_thread_entry: start 2024-09-18T02:04:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 20 Filter name: none 2024-09-18T02:04:42.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4a12ffd640 20 reqs_thread_entry: start 2024-09-18T02:04:42.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:04:42.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae5418e8a0 con 0x7f4bd80cd050 2024-09-18T02:04:42.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:42.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T02:04:42.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 : miss 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:63 8.1c 8:3ecfd7e4:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae54190320 con 0x55ae5415da70 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(63 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 info.flags=0x17 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 to cache LRU end 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 20 get_obj_state: octx=0x55ae54142c60 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55ae54192b78 s->prefetch_data=0 2024-09-18T02:04:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:64 3.24 3:24e94933:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae54193d30 con 0x55ae54159120 2024-09-18T02:04:42.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(64 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 10 manifest: total_size = 5 2024-09-18T02:04:42.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4befb34980 20 get_obj_state: setting s->obj_tag to _HTqmrNpMvUBqr2ylzJ7w2ImhSMw4vph 2024-09-18T02:04:42.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.543+0000 7f4aa27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:42.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.547+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94207223424768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae5418c110 con 0x55ae54154730 2024-09-18T02:04:42.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.547+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94207223424768] v32'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.547+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94207223407168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54193d30 con 0x7f4bd80cd050 2024-09-18T02:04:42.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.547+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94207223407168] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.547+0000 7f4befb34980 20 remove_watcher() i=0 2024-09-18T02:04:42.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.547+0000 7f4befb34980 2 removed watcher, disabling cache 2024-09-18T02:04:42.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.547+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94207223410624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54193d30 con 0x55ae54154730 2024-09-18T02:04:42.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.551+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94207223410624] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.551+0000 7f4befb34980 20 remove_watcher() i=1 2024-09-18T02:04:42.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.551+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94207223404608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54193d30 con 0x55ae5415da70 2024-09-18T02:04:42.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.551+0000 7f4bece43640 1 -- 172.21.15.167:0/3820310757 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94207223404608] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd80ca070 con 0x55ae5415da70 2024-09-18T02:04:42.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.551+0000 7f4befb34980 20 remove_watcher() i=2 2024-09-18T02:04:42.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.551+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94207223416560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54193d30 con 0x7f4bd80cd050 2024-09-18T02:04:42.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.551+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94207223416560] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x7f4bd80cd050 2024-09-18T02:04:42.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.551+0000 7f4befb34980 20 remove_watcher() i=3 2024-09-18T02:04:42.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.555+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94207223420960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54193d30 con 0x55ae54154730 2024-09-18T02:04:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.555+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94207223420960] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8026040 con 0x55ae54154730 2024-09-18T02:04:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.555+0000 7f4befb34980 20 remove_watcher() i=4 2024-09-18T02:04:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.555+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94207223418624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54193d30 con 0x55ae54159120 2024-09-18T02:04:42.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.559+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94207223418624] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.559+0000 7f4befb34980 20 remove_watcher() i=5 2024-09-18T02:04:42.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.559+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94207223423648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54193d30 con 0x55ae54159120 2024-09-18T02:04:42.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.559+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94207223423648] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.559+0000 7f4befb34980 20 remove_watcher() i=6 2024-09-18T02:04:42.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.559+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94207223427744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae54193d30 con 0x55ae54159120 2024-09-18T02:04:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4bed644640 1 -- 172.21.15.167:0/3820310757 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94207223427744] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be002e070 con 0x55ae54159120 2024-09-18T02:04:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 20 remove_watcher() i=7 2024-09-18T02:04:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ae54159120 msgr2=0x55ae5415b510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ae54159120 0x55ae5415b510 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ae54154730 msgr2=0x55ae54156bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ae54154730 0x55ae54156bf0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4bd80cd050 msgr2=0x7f4bd80cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4bd80cd050 0x7f4bd80cd430 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ae5415da70 msgr2=0x55ae5415fe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ae5415da70 0x55ae5415fe80 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4abc034600 msgr2=0x7f4abc036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4abc034600 0x7f4abc036ac0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4bd801b0d0 tx=0x7f4bd80a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4bede45640 1 -- 172.21.15.167:0/3820310757 reap_dead start 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 msgr2=0x55ae54149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54149820 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4be0030960 tx=0x7f4be0020f10 comp rx=0 tx=0).stop 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 shutdown_connections 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/3820310757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54142880 0x55ae54149820 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 >> 172.21.15.167:0/3820310757 conn(0x55ae5413ebb0 msgr2=0x55ae5413cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 shutdown_connections 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3820310757 wait complete. 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3191105260 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ac4034600 msgr2=0x7f4ac4036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/3191105260 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ac4034600 0x7f4ac4036ac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55ae5411ff70 tx=0x7f4bd8005e50 comp rx=0 tx=0).stop 2024-09-18T02:04:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3191105260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54135ea0 msgr2=0x55ae541362c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/3191105260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54135ea0 0x55ae541362c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4be0048860 tx=0x7f4be0018d50 comp rx=0 tx=0).stop 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3191105260 shutdown_connections 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/3191105260 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ac4034600 0x7f4ac4036ac0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/3191105260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae54135ea0 0x55ae541362c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3191105260 >> 172.21.15.167:0/3191105260 conn(0x55ae5412aff0 msgr2=0x55ae5412da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3191105260 shutdown_connections 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/3191105260 wait complete. 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ae541219c0 msgr2=0x55ae54123db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ae541219c0 0x55ae54123db0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ae53f99fb0 msgr2=0x55ae5411f0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ae53f99fb0 0x55ae5411f0e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ae541258e0 msgr2=0x55ae54127cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ae541258e0 0x55ae54127cd0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ad4034650 msgr2=0x7f4ad4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4ad4034650 0x7f4ad4036b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80ab000 tx=0x7f4bd80a5000 comp rx=0 tx=0).stop 2024-09-18T02:04:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 msgr2=0x55ae54117fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 --2- 172.21.15.167:0/85963748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae53f99ba0 0x55ae54117fe0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4be0001fd0 tx=0x7f4be0000bd0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4bede45640 1 -- 172.21.15.167:0/85963748 reap_dead start 2024-09-18T02:04:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 shutdown_connections 2024-09-18T02:04:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 >> 172.21.15.167:0/85963748 conn(0x55ae5401f180 msgr2=0x55ae5410b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 shutdown_connections 2024-09-18T02:04:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.563+0000 7f4befb34980 1 -- 172.21.15.167:0/85963748 wait complete. 2024-09-18T02:04:42.579 INFO:teuthology.orchestra.run.smithi167.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-18T02:04:42.579 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-18T02:04:42.582 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-18T02:04:42.602 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:42.705 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-18T02:04:42.705 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-18T02:04:42.705 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T02:04:42.706 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-18T02:04:42.706 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-18T02:04:42.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-18T02:04:42.706 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-18T02:04:42.747 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:42.747 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:42.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.743+0000 7ffa9e53c980 1 Processor -- start 2024-09-18T02:04:42.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.743+0000 7ffa9e53c980 1 -- start start 2024-09-18T02:04:42.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.743+0000 7ffa9e53c980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55841c474900 0x55841c476cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.743+0000 7ffa9e53c980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55841c2f9ae0 con 0x55841c470580 2024-09-18T02:04:42.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.743+0000 7ffa9e53c980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55841c31de30 con 0x55841c474900 2024-09-18T02:04:42.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.743+0000 7ffa9b84b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55841c474900 0x55841c476cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.743+0000 7ffa9c04c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55841c470580 0x55841c470960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:42638/0 (socket says 172.21.15.167:42638) 2024-09-18T02:04:42.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.743+0000 7ffa9c04c640 1 -- 172.21.15.167:0/2666336344 learned_addr learned my addr 172.21.15.167:0/2666336344 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:42.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9b84b640 1 -- 172.21.15.167:0/2666336344 >> v1:172.21.15.81:6789/0 conn(0x55841c470580 legacy=0x55841c470960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9b84b640 1 -- 172.21.15.167:0/2666336344 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841c478240 con 0x55841c474900 2024-09-18T02:04:42.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/2666336344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c474900 0x55841c476cf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000a480 tx=0x7ffa9001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1f10bdd08f843a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9b04a640 1 -- 172.21.15.167:0/2666336344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900b0070 con 0x55841c474900 2024-09-18T02:04:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9b04a640 1 -- 172.21.15.167:0/2666336344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa900ab540 con 0x55841c474900 2024-09-18T02:04:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9b04a640 1 -- 172.21.15.167:0/2666336344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900ab840 con 0x55841c474900 2024-09-18T02:04:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9e53c980 1 -- 172.21.15.167:0/2666336344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c474900 msgr2=0x55841c476cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/2666336344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c474900 0x55841c476cf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000a480 tx=0x7ffa9001b280 comp rx=0 tx=0).stop 2024-09-18T02:04:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9e53c980 1 -- 172.21.15.167:0/2666336344 shutdown_connections 2024-09-18T02:04:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/2666336344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c474900 0x55841c476cf0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9e53c980 1 -- 172.21.15.167:0/2666336344 >> 172.21.15.167:0/2666336344 conn(0x55841c46c0a0 msgr2=0x55841c46e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9e53c980 1 -- 172.21.15.167:0/2666336344 shutdown_connections 2024-09-18T02:04:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.747+0000 7ffa9e53c980 1 -- 172.21.15.167:0/2666336344 wait complete. 2024-09-18T02:04:42.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.763+0000 7ffa9e53c980 1 Processor -- start 2024-09-18T02:04:42.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.763+0000 7ffa9e53c980 1 -- start start 2024-09-18T02:04:42.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 0x55841c3e5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55841c31f200 con 0x55841c470580 2024-09-18T02:04:42.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9c04c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 0x55841c3e5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9c04c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 0x55841c3e5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33326/0 (socket says 172.21.15.167:33326) 2024-09-18T02:04:42.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4245120782 learned_addr learned my addr 172.21.15.167:0/4245120782 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4245120782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841c3e61e0 con 0x55841c470580 2024-09-18T02:04:42.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9c04c640 1 --2- 172.21.15.167:0/4245120782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 0x55841c3e5c10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ffa940017b0 tx=0x7ffa94001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd7e151ccb5d2ac server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ff98a60c640 1 -- 172.21.15.167:0/4245120782 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa94016070 con 0x55841c470580 2024-09-18T02:04:42.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ff98a60c640 1 -- 172.21.15.167:0/4245120782 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa94004530 con 0x55841c470580 2024-09-18T02:04:42.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ff98a60c640 1 -- 172.21.15.167:0/4245120782 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa94004870 con 0x55841c470580 2024-09-18T02:04:42.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4245120782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 msgr2=0x55841c3e5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4245120782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 0x55841c3e5c10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ffa940017b0 tx=0x7ffa94001c70 comp rx=0 tx=0).stop 2024-09-18T02:04:42.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4245120782 shutdown_connections 2024-09-18T02:04:42.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4245120782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 0x55841c3e5c10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4245120782 >> 172.21.15.167:0/4245120782 conn(0x55841c46c0a0 msgr2=0x55841c5575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4245120782 shutdown_connections 2024-09-18T02:04:42.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4245120782 wait complete. 2024-09-18T02:04:42.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 Processor -- start 2024-09-18T02:04:42.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 -- start start 2024-09-18T02:04:42.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 0x55841c563db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9e53c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55841c477d40 con 0x55841c470580 2024-09-18T02:04:42.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9c04c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 0x55841c563db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9c04c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 0x55841c563db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33342/0 (socket says 172.21.15.167:33342) 2024-09-18T02:04:42.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.767+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4189105280 learned_addr learned my addr 172.21.15.167:0/4189105280 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4189105280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841c5642f0 con 0x55841c470580 2024-09-18T02:04:42.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ffa9c04c640 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 0x55841c563db0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000f90 tx=0x7ffa94001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ff988e09640 1 -- 172.21.15.167:0/4189105280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa94020070 con 0x55841c470580 2024-09-18T02:04:42.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ff988e09640 1 -- 172.21.15.167:0/4189105280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa94011400 con 0x55841c470580 2024-09-18T02:04:42.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ff988e09640 1 -- 172.21.15.167:0/4189105280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa94016040 con 0x55841c470580 2024-09-18T02:04:42.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55841c564580 con 0x55841c470580 2024-09-18T02:04:42.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55841c567260 con 0x55841c470580 2024-09-18T02:04:42.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ff988e09640 1 -- 172.21.15.167:0/4189105280 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa94023070 con 0x55841c470580 2024-09-18T02:04:42.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ff988e09640 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff9840346a0 0x7ff984036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ff988e09640 1 -- 172.21.15.167:0/4189105280 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ffa94049050 con 0x55841c470580 2024-09-18T02:04:42.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff9840346a0 0x7ff984036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55841c474900 0x55841c56aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c56b3f0 con 0x55841c474900 2024-09-18T02:04:42.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.771+0000 7ffa9c84d640 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55841c474900 0x55841c56aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff9840346a0 0x7ff984036b60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffa900ad000 tx=0x7ffa900a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9c84d640 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55841c474900 0x55841c56aeb0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4189105280 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa8c0083f0 con 0x55841c474900 2024-09-18T02:04:42.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c568430 con 0x55841c474900 2024-09-18T02:04:42.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4189105280 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa8c0083f0 con 0x55841c474900 2024-09-18T02:04:42.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55841c56d660 0x55841c56fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c570120 con 0x55841c56d660 2024-09-18T02:04:42.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9c04c640 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55841c56d660 0x55841c56fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9c04c640 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55841c56d660 0x55841c56fa50 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4189105280 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c56d660 2024-09-18T02:04:42.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c56c530 con 0x55841c474900 2024-09-18T02:04:42.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4189105280 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa8c0083f0 con 0x55841c474900 2024-09-18T02:04:42.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55841c571580 0x55841c573970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c574060 con 0x55841c571580 2024-09-18T02:04:42.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55841c571580 0x55841c573970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.775+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55841c571580 0x55841c573970 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4189105280 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa900b3040 con 0x55841c571580 2024-09-18T02:04:42.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9e53c980 1 Processor -- start 2024-09-18T02:04:42.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9e53c980 1 -- start start 2024-09-18T02:04:42.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9e53c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c55d1e0 0x55841c55b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9e53c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55841c378800 con 0x55841c55d1e0 2024-09-18T02:04:42.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9c04c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c55d1e0 0x55841c55b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9c04c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c55d1e0 0x55841c55b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33348/0 (socket says 172.21.15.167:33348) 2024-09-18T02:04:42.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9c04c640 1 -- 172.21.15.167:0/1628806883 learned_addr learned my addr 172.21.15.167:0/1628806883 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9c04c640 1 -- 172.21.15.167:0/1628806883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841c55d600 con 0x55841c55d1e0 2024-09-18T02:04:42.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9c04c640 1 --2- 172.21.15.167:0/1628806883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c55d1e0 0x55841c55b860 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ffa94024520 tx=0x7ffa94023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ff981ffb640 1 -- 172.21.15.167:0/1628806883 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa94011a20 con 0x55841c55d1e0 2024-09-18T02:04:42.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1628806883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55841c55be00 con 0x55841c55d1e0 2024-09-18T02:04:42.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ff981ffb640 1 -- 172.21.15.167:0/1628806883 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa94011bc0 con 0x55841c55d1e0 2024-09-18T02:04:42.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ff981ffb640 1 -- 172.21.15.167:0/1628806883 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa94026aa0 con 0x55841c55d1e0 2024-09-18T02:04:42.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1628806883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55841c55c2d0 con 0x55841c55d1e0 2024-09-18T02:04:42.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ff981ffb640 1 -- 172.21.15.167:0/1628806883 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa94026c40 con 0x55841c55d1e0 2024-09-18T02:04:42.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.779+0000 7ff981ffb640 1 --2- 172.21.15.167:0/1628806883 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff974034650 0x7ff974036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ff981ffb640 1 -- 172.21.15.167:0/1628806883 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ffa94036070 con 0x55841c55d1e0 2024-09-18T02:04:42.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/1628806883 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff974034650 0x7ff974036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 Processor -- start 2024-09-18T02:04:42.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 -- start start 2024-09-18T02:04:42.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/1628806883 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff974034650 0x7ff974036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55841c5687f0 tx=0x7ffa90005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 0x55841c590a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55841c3e6560 con 0x55841c590660 2024-09-18T02:04:42.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9c04c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 0x55841c590a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9c04c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 0x55841c590a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33362/0 (socket says 172.21.15.167:33362) 2024-09-18T02:04:42.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9c04c640 1 -- 172.21.15.167:0/1717629588 learned_addr learned my addr 172.21.15.167:0/1717629588 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9c04c640 1 -- 172.21.15.167:0/1717629588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841c591030 con 0x55841c590660 2024-09-18T02:04:42.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9c04c640 1 --2- 172.21.15.167:0/1717629588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 0x55841c590a60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400d010 tx=0x7ffa9402e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23837d170d059560 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ff97b7fe640 1 -- 172.21.15.167:0/1717629588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa94059020 con 0x55841c590660 2024-09-18T02:04:42.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ff97b7fe640 1 -- 172.21.15.167:0/1717629588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9404bcf0 con 0x55841c590660 2024-09-18T02:04:42.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ff97b7fe640 1 -- 172.21.15.167:0/1717629588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa940493b0 con 0x55841c590660 2024-09-18T02:04:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1717629588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 msgr2=0x55841c590a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/1717629588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 0x55841c590a60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400d010 tx=0x7ffa9402e680 comp rx=0 tx=0).stop 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1717629588 shutdown_connections 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/1717629588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 0x55841c590a60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1717629588 >> 172.21.15.167:0/1717629588 conn(0x55841c58c990 msgr2=0x55841c58aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1717629588 shutdown_connections 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1717629588 wait complete. 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 Processor -- start 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 -- start start 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 0x55841c597780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9e53c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55841c591520 con 0x55841c590660 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9c04c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 0x55841c597780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9c04c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 0x55841c597780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33368/0 (socket says 172.21.15.167:33368) 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.783+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 learned_addr learned my addr 172.21.15.167:0/4167844072 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841c597cc0 con 0x55841c590660 2024-09-18T02:04:42.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9c04c640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 0x55841c597780 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400d010 tx=0x7ffa94032570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ff979ffb640 1 -- 172.21.15.167:0/4167844072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa9406e070 con 0x55841c590660 2024-09-18T02:04:42.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55841c597cc0 con 0x55841c590660 2024-09-18T02:04:42.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ff979ffb640 1 -- 172.21.15.167:0/4167844072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9402f660 con 0x55841c590660 2024-09-18T02:04:42.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55841c597cc0 con 0x55841c590660 2024-09-18T02:04:42.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ff979ffb640 1 -- 172.21.15.167:0/4167844072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa9402f940 con 0x55841c590660 2024-09-18T02:04:42.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ff979ffb640 1 -- 172.21.15.167:0/4167844072 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa9405c020 con 0x55841c590660 2024-09-18T02:04:42.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ff979ffb640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff96c034650 0x7ff96c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ff979ffb640 1 -- 172.21.15.167:0/4167844072 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ffa94065030 con 0x55841c590660 2024-09-18T02:04:42.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff96c034650 0x7ff96c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55841c5a28c0 0x55841c5a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a54d0 con 0x55841c5a28c0 2024-09-18T02:04:42.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9c84d640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55841c5a28c0 0x55841c5a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff96c034650 0x7ff96c036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa90000c10 tx=0x7ffa900b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9c84d640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55841c5a28c0 0x55841c5a4d80 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa8c0083f0 con 0x55841c5a28c0 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9e53c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9e53c980 20 realm 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.787+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a58e0 con 0x55841c5a28c0 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa8c0083f0 con 0x55841c5a28c0 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a61b0 con 0x55841c5a28c0 2024-09-18T02:04:42.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa8c0083f0 con 0x55841c5a28c0 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a28c0 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa8c0083f0 con 0x55841c5a28c0 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55841c5a72b0 0x55841c5a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a9cb0 con 0x55841c5a72b0 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9c04c640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55841c5a72b0 0x55841c5a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9c04c640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55841c5a72b0 0x55841c5a96a0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:42.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 20 searching for the correct realm 2024-09-18T02:04:42.798 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55841c5abc00 0x55841c5ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.798 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ae6e0 con 0x55841c5abc00 2024-09-18T02:04:42.798 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55841c5abc00 0x55841c5ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55841c5abc00 0x55841c5ae010 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9b84b640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ffa900dc040 0x7ffa900dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:42.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ae6e0 con 0x7ffa900dc040 2024-09-18T02:04:42.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9c84d640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ffa900dc040 0x7ffa900dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:42.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.791+0000 7ffa9c84d640 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ffa900dc040 0x7ffa900dd430 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:42.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c0083f0 con 0x7ffa900dc040 2024-09-18T02:04:42.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x7ffa900dc040 2024-09-18T02:04:42.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c0083f0 con 0x7ffa900dc040 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a28c0 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a28c0 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a28c0 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a72b0 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x7ffa900dc040 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5abc00 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a28c0 2024-09-18T02:04:42.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x7ffa900dc040 2024-09-18T02:04:42.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a28c0 2024-09-18T02:04:42.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x7ffa900dc040 2024-09-18T02:04:42.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.795+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5abc00 2024-09-18T02:04:42.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5abc00 2024-09-18T02:04:42.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a72b0 2024-09-18T02:04:42.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5abc00 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5abc00 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a28c0 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a28c0 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a72b0 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5abc00 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.799+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x7ffa900dc040 2024-09-18T02:04:42.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a28c0 2024-09-18T02:04:42.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a72b0 2024-09-18T02:04:42.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5abc00 2024-09-18T02:04:42.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a72b0 2024-09-18T02:04:42.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x7ffa900dc040 2024-09-18T02:04:42.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5abc00 2024-09-18T02:04:42.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a72b0 2024-09-18T02:04:42.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.803+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x55841c5a28c0 2024-09-18T02:04:42.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55841c5a6550 con 0x7ffa900dc040 2024-09-18T02:04:42.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:42.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:42.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:42.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:42.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:42.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:42.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.811 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5aa570 con 0x55841c5a28c0 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5aa570 con 0x55841c5a28c0 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5aa570 con 0x55841c5abc00 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 zone default found 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 4 Realm: () 2024-09-18T02:04:42.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:42.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:42.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:42.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 zonegroup default 2024-09-18T02:04:42.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5aaef0 con 0x55841c5a72b0 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b05a0 con 0x55841c5abc00 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b09e0 con 0x55841c5abc00 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 started sync module instance, tier type = 2024-09-18T02:04:42.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:42.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.807+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5af9e0 con 0x7ffa900dc040 2024-09-18T02:04:42.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.811+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.811+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94025899769600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5af9e0 con 0x7ffa900dc040 2024-09-18T02:04:42.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.811+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b14e0 con 0x55841c5a28c0 2024-09-18T02:04:42.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.811+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94025899769600] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.811+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.811+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94025899773872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5af9e0 con 0x55841c5a28c0 2024-09-18T02:04:42.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.811+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b1ef0 con 0x55841c5abc00 2024-09-18T02:04:42.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94025899776576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b2740 con 0x55841c5abc00 2024-09-18T02:04:42.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b3140 con 0x7ffa900dc040 2024-09-18T02:04:42.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94025899773872] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94025899767088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b3530 con 0x7ffa900dc040 2024-09-18T02:04:42.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b3ef0 con 0x55841c5a28c0 2024-09-18T02:04:42.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94025899776576] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94025899767088] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94025899781200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b3a40 con 0x55841c5a28c0 2024-09-18T02:04:42.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.815+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b4290 con 0x55841c5a72b0 2024-09-18T02:04:42.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.819+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94025899781200] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.819+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.819+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94025899784768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b3e60 con 0x55841c5a72b0 2024-09-18T02:04:42.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.819+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b4f90 con 0x55841c5a72b0 2024-09-18T02:04:42.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94025899784768] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94025899789328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b5740 con 0x55841c5a72b0 2024-09-18T02:04:42.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b4630 con 0x55841c5a72b0 2024-09-18T02:04:42.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94025899789328] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94025899787824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b5190 con 0x55841c5a72b0 2024-09-18T02:04:42.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9e53c980 20 add_watcher() i=0 2024-09-18T02:04:42.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9e53c980 20 add_watcher() i=1 2024-09-18T02:04:42.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9e53c980 20 add_watcher() i=2 2024-09-18T02:04:42.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9e53c980 20 add_watcher() i=3 2024-09-18T02:04:42.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9e53c980 20 add_watcher() i=4 2024-09-18T02:04:42.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9e53c980 20 add_watcher() i=5 2024-09-18T02:04:42.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.823+0000 7ffa9e53c980 20 add_watcher() i=6 2024-09-18T02:04:42.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.827+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94025899787824] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.827+0000 7ffa9e53c980 20 add_watcher() i=7 2024-09-18T02:04:42.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.827+0000 7ffa9e53c980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:42.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.827+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b9250 con 0x55841c5a28c0 2024-09-18T02:04:42.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.827+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.827+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94025899793712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b66d0 con 0x55841c5a28c0 2024-09-18T02:04:42.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.827+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94025899793712] v32'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.827+0000 7ff9527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:42.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.827+0000 7ffa9e53c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:42.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.827+0000 7ffa9e53c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:42.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.827+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c1a50 con 0x55841c5a28c0 2024-09-18T02:04:42.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.831+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'54 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.834 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.831+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c20a0 con 0x55841c5a72b0 2024-09-18T02:04:42.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.831+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.831+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c20a0 con 0x55841c5abc00 2024-09-18T02:04:42.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.835+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.835+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c26d0 con 0x55841c5a28c0 2024-09-18T02:04:42.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.835+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'189 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.835+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c2b80 con 0x7ffa900dc040 2024-09-18T02:04:42.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.835+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'68 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.835+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5bf8b0 con 0x55841c5abc00 2024-09-18T02:04:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.839+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'53 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.839+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5bf8b0 con 0x55841c5a28c0 2024-09-18T02:04:42.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.839+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.839+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5bf8b0 con 0x55841c5a72b0 2024-09-18T02:04:42.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.843+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.843+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c36e0 con 0x7ffa900dc040 2024-09-18T02:04:42.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.843+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.843+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c36e0 con 0x55841c5abc00 2024-09-18T02:04:42.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.847+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.847+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x7ffa900dc040 2024-09-18T02:04:42.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.847+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'69 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.847+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5a72b0 2024-09-18T02:04:42.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.851+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.851+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x7ffa900dc040 2024-09-18T02:04:42.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.851+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.851+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5a72b0 2024-09-18T02:04:42.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.855+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'61 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.855+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5a28c0 2024-09-18T02:04:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.855+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'190 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.855+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5abc00 2024-09-18T02:04:42.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.859+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'64 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.859+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x7ffa900dc040 2024-09-18T02:04:42.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.859+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'70 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.859+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5abc00 2024-09-18T02:04:42.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.859+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.863+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5a28c0 2024-09-18T02:04:42.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.863+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.863+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5a28c0 2024-09-18T02:04:42.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.863+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'191 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.863+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5abc00 2024-09-18T02:04:42.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.867+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'65 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.867+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x7ffa900dc040 2024-09-18T02:04:42.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.867+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.867+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5abc00 2024-09-18T02:04:42.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.871+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'33 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.871+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5abc00 2024-09-18T02:04:42.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.871+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'42 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.871+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5abc00 2024-09-18T02:04:42.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.871+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.871+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5abc00 2024-09-18T02:04:42.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.875+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'54 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.875+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5a72b0 2024-09-18T02:04:42.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.875+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.875+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5abc00 2024-09-18T02:04:42.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.879+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'38 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.879+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5a72b0 2024-09-18T02:04:42.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.879+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.879+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5abc00 2024-09-18T02:04:42.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.883+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'66 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.883+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x55841c5a72b0 2024-09-18T02:04:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.887+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'62 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.887+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5c3b90 con 0x7ffa900dc040 2024-09-18T02:04:42.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.887+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.887+0000 7ff9517e2640 20 reqs_thread_entry: start 2024-09-18T02:04:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.887+0000 7ffa9e53c980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.887+0000 7ffa9e53c980 20 Filter name: none 2024-09-18T02:04:42.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.887+0000 7ff8c2ffd640 20 reqs_thread_entry: start 2024-09-18T02:04:42.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.887+0000 7ffa9e53c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:04:42.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.887+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.887+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5df230 con 0x7ffa900dc040 2024-09-18T02:04:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:04:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T02:04:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:04:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 : miss 2024-09-18T02:04:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:95 8.1c 8:3ecfd7e4:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e09b0 con 0x55841c5abc00 2024-09-18T02:04:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(95 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:04:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 info.flags=0x17 2024-09-18T02:04:42.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 to cache LRU end 2024-09-18T02:04:42.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:42.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:04:42.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 2024-09-18T02:04:42.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:96 4.1a 4:5a104f11:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65df20 con 0x7ffa900dc040 2024-09-18T02:04:42.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(96 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:97 4.3f 4:fc6bc1bf:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65df60 con 0x7ffa900dc040 2024-09-18T02:04:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(97 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:98 4.3d 4:be44c729:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65df60 con 0x55841c5abc00 2024-09-18T02:04:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(98 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2 [call out=425b] v0'0 uv7 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-18T02:04:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:99 4.24 4:2552714c:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65df90 con 0x55841c5a72b0 2024-09-18T02:04:42.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(99 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.3 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.891+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:100 4.16 4:6a82c613:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65e580 con 0x7ffa900dc040 2024-09-18T02:04:42.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 23 ==== osd_op_reply(100 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:101 4.1a 4:5a662b41:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65e580 con 0x7ffa900dc040 2024-09-18T02:04:42.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 24 ==== osd_op_reply(101 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.5 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:102 4.8 4:11490601:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65e580 con 0x55841c5abc00 2024-09-18T02:04:42.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(102 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-18T02:04:42.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:103 4.25 4:a55a8335:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65ea50 con 0x55841c5abc00 2024-09-18T02:04:42.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== osd_op_reply(103 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:104 4.b 4:d223104f:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65ea50 con 0x7ffa900dc040 2024-09-18T02:04:42.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 25 ==== osd_op_reply(104 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8 [call out=425b] v0'0 uv4 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-18T02:04:42.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:105 4.b 4:d105c325:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65ea50 con 0x7ffa900dc040 2024-09-18T02:04:42.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 26 ==== osd_op_reply(105 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:106 4.c 4:30e425b0:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65ea50 con 0x55841c5a28c0 2024-09-18T02:04:42.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(106 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10 [call out=698b] v0'0 uv11 ondisk = 0) ==== 195+0+698 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-18T02:04:42.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-18T02:04:42.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 20 get_obj_state: octx=0x55841c5910f0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55841c5e1258 s->prefetch_data=0 2024-09-18T02:04:42.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:107 3.32 3:4d6391bf:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c65ba80 con 0x55841c5abc00 2024-09-18T02:04:42.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 31 ==== osd_op_reply(107 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 10 manifest: total_size = 6 2024-09-18T02:04:42.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 20 get_obj_state: setting s->obj_tag to c5231f36-c36e-44d5-8268-aaf52617db58.4235.6457457222570362547 2024-09-18T02:04:42.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 20 get_obj_state: octx=0x55841c5910f0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55841c5e1258 s->prefetch_data=0 2024-09-18T02:04:42.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.895+0000 7ffa9e53c980 20 prepare_atomic_modification: state is not atomic. state=0x55841c5e1258 2024-09-18T02:04:42.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.899+0000 7ffa9e53c980 20 bucket index object: :.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2 2024-09-18T02:04:42.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.899+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:108 4.3d 4:be44c729:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e60c0 con 0x55841c5abc00 2024-09-18T02:04:42.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.899+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 32 ==== osd_op_reply(108 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2 [stat,call,call] v32'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.899+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:109 3.32 3:4d6391bf:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e40a0 con 0x55841c5abc00 2024-09-18T02:04:42.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.899+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 33 ==== osd_op_reply(109 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_9c8454ddf7aa50116496bac348d7550d [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.899+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:110 4.3d 4:be44c729:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e6090 con 0x55841c5abc00 2024-09-18T02:04:42.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.899+0000 7ffa9e53c980 20 get_obj_state: octx=0x55841c5910f0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55841c5e1258 s->prefetch_data=0 2024-09-18T02:04:42.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.899+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:111 3.12 3:48f4abba:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e7090 con 0x7ffa900dc040 2024-09-18T02:04:42.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 27 ==== osd_op_reply(111 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9e53c980 10 manifest: total_size = 3 2024-09-18T02:04:42.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9e53c980 20 get_obj_state: setting s->obj_tag to c5231f36-c36e-44d5-8268-aaf52617db58.4235.1368732044163168848 2024-09-18T02:04:42.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9e53c980 20 get_obj_state: octx=0x55841c5910f0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55841c5e1258 s->prefetch_data=0 2024-09-18T02:04:42.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9e53c980 20 prepare_atomic_modification: state is not atomic. state=0x55841c5e1258 2024-09-18T02:04:42.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9e53c980 20 bucket index object: :.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6 2024-09-18T02:04:42.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:112 4.8 4:11490601:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e7090 con 0x55841c5abc00 2024-09-18T02:04:42.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 34 ==== osd_op_reply(110 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2 [stat,call,call] v32'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ff97b7fe640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-18T02:04:42.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 35 ==== osd_op_reply(112 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:113 3.12 3:48f4abba:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e6be0 con 0x7ffa900dc040 2024-09-18T02:04:42.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 28 ==== osd_op_reply(113 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:114 4.8 4:11490601:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e7040 con 0x55841c5abc00 2024-09-18T02:04:42.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9e53c980 20 get_obj_state: octx=0x55841c5910f0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55841c5e1258 s->prefetch_data=0 2024-09-18T02:04:42.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.903+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:115 3.4 3:209000c8:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e7040 con 0x55841c5a72b0 2024-09-18T02:04:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.907+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(115 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.907+0000 7ffa9e53c980 10 manifest: total_size = 4 2024-09-18T02:04:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.907+0000 7ffa9e53c980 20 get_obj_state: setting s->obj_tag to c5231f36-c36e-44d5-8268-aaf52617db58.4235.7821092926033175131 2024-09-18T02:04:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.907+0000 7ffa9e53c980 20 get_obj_state: octx=0x55841c5910f0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55841c5e1258 s->prefetch_data=0 2024-09-18T02:04:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.907+0000 7ffa9e53c980 20 prepare_atomic_modification: state is not atomic. state=0x55841c5e1258 2024-09-18T02:04:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.907+0000 7ffa9e53c980 20 bucket index object: :.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8 2024-09-18T02:04:42.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.907+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:116 4.b 4:d223104f:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e7040 con 0x7ffa900dc040 2024-09-18T02:04:42.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.907+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 36 ==== osd_op_reply(114 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.907+0000 7ff97affd640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-18T02:04:42.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.907+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 29 ==== osd_op_reply(116 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.907+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:117 3.4 3:209000c8:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e7040 con 0x55841c5a72b0 2024-09-18T02:04:42.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.911+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(117 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.911+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:118 4.b 4:d223104f:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e7040 con 0x7ffa900dc040 2024-09-18T02:04:42.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.911+0000 7ffa9e53c980 20 get_obj_state: octx=0x55841c5910f0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55841c5e1258 s->prefetch_data=0 2024-09-18T02:04:42.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.911+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:119 3.36 3:6efa7c53:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e7040 con 0x7ffa900dc040 2024-09-18T02:04:42.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.911+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 30 ==== osd_op_reply(119 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.911+0000 7ffa9e53c980 10 manifest: total_size = 5 2024-09-18T02:04:42.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.911+0000 7ffa9e53c980 20 get_obj_state: setting s->obj_tag to c5231f36-c36e-44d5-8268-aaf52617db58.4235.15622145781567812589 2024-09-18T02:04:42.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.911+0000 7ffa9e53c980 20 get_obj_state: octx=0x55841c5910f0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55841c5e1258 s->prefetch_data=0 2024-09-18T02:04:42.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.911+0000 7ffa9e53c980 20 prepare_atomic_modification: state is not atomic. state=0x55841c5e1258 2024-09-18T02:04:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.911+0000 7ffa9e53c980 20 bucket index object: :.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10 2024-09-18T02:04:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.911+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:120 4.c 4:30e425b0:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ec660 con 0x55841c5a28c0 2024-09-18T02:04:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(120 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10 [stat,call,call] v32'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:121 3.36 3:6efa7c53:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ea640 con 0x7ffa900dc040 2024-09-18T02:04:42.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 31 ==== osd_op_reply(118 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ff97b7fe640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-18T02:04:42.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 32 ==== osd_op_reply(121 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:122 4.c 4:30e425b0:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e8620 con 0x55841c5a28c0 2024-09-18T02:04:42.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9e53c980 20 get_obj_state: octx=0x55841c5910f0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55841c5e1258 s->prefetch_data=0 2024-09-18T02:04:42.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:123 3.24 3:24e94933:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e9280 con 0x55841c5a72b0 2024-09-18T02:04:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(123 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9e53c980 10 manifest: total_size = 5 2024-09-18T02:04:42.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9e53c980 20 get_obj_state: setting s->obj_tag to _HTqmrNpMvUBqr2ylzJ7w2ImhSMw4vph 2024-09-18T02:04:42.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9e53c980 20 get_obj_state: octx=0x55841c5910f0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55841c5e1258 s->prefetch_data=0 2024-09-18T02:04:42.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9e53c980 20 prepare_atomic_modification: state is not atomic. state=0x55841c5e1258 2024-09-18T02:04:42.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9e53c980 20 bucket index object: :.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10 2024-09-18T02:04:42.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.915+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:124 4.c 4:30e425b0:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e8620 con 0x55841c5a28c0 2024-09-18T02:04:42.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(122 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10 [stat,call,call] v32'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ff97affd640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-18T02:04:42.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(124 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10 [stat,call,call] v32'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:125 3.24 3:24e94933:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e8620 con 0x55841c5a72b0 2024-09-18T02:04:42.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(125 c5231f36-c36e-44d5-8268-aaf52617db58.4235.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:126 4.c 4:30e425b0:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e85f0 con 0x55841c5a28c0 2024-09-18T02:04:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 20 list_objects_ordered: starting attempt 1 2024-09-18T02:04:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T02:04:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:127 4.1a 4:5a104f11:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e85f0 con 0x7ffa900dc040 2024-09-18T02:04:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:128 4.3f 4:fc6bc1bf:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e1520 con 0x7ffa900dc040 2024-09-18T02:04:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:129 4.3d 4:be44c729:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef870 con 0x55841c5abc00 2024-09-18T02:04:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:130 4.24 4:2552714c:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5e1520 con 0x55841c5a72b0 2024-09-18T02:04:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:131 4.16 4:6a82c613:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef870 con 0x7ffa900dc040 2024-09-18T02:04:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:132 4.1a 4:5a662b41:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5f6e20 con 0x7ffa900dc040 2024-09-18T02:04:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:133 4.8 4:11490601:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5f9c70 con 0x55841c5abc00 2024-09-18T02:04:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:134 4.25 4:a55a8335:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5fc630 con 0x55841c5abc00 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:135 4.b 4:d223104f:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ff040 con 0x7ffa900dc040 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:136 4.b 4:d105c325:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c601ea0 con 0x7ffa900dc040 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:137 4.c 4:30e425b0:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c604cd0 con 0x55841c5a28c0 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 37 ==== osd_op_reply(129 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 33 ==== osd_op_reply(128 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(130 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.3 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.919+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 38 ==== osd_op_reply(133 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 39 ==== osd_op_reply(134 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 34 ==== osd_op_reply(127 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 35 ==== osd_op_reply(131 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 36 ==== osd_op_reply(132 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.5 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 37 ==== osd_op_reply(135 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 38 ==== osd_op_reply(136 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(126 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10 [stat,call,call] v32'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ff97affd640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(137 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.5])"; uploads.size()=0; is_truncated=0 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:138 4.1a 4:5a104f11:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c604cd0 con 0x7ffa900dc040 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:139 4.3f 4:fc6bc1bf:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5fc630 con 0x7ffa900dc040 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:140 4.3d 4:be44c729:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ff040 con 0x55841c5abc00 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:141 4.24 4:2552714c:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5feaf0 con 0x55841c5a72b0 2024-09-18T02:04:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:142 4.16 4:6a82c613:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c604cd0 con 0x7ffa900dc040 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:143 4.1a 4:5a662b41:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5fc630 con 0x7ffa900dc040 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:144 4.8 4:11490601:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c604cd0 con 0x55841c5abc00 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:145 4.25 4:a55a8335:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5fc630 con 0x55841c5abc00 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:146 4.b 4:d223104f:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5feaf0 con 0x7ffa900dc040 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:147 4.b 4:d105c325:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c604cd0 con 0x7ffa900dc040 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:148 4.c 4:30e425b0:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ff040 con 0x55841c5a28c0 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 40 ==== osd_op_reply(144 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 39 ==== osd_op_reply(139 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 40 ==== osd_op_reply(138 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 41 ==== osd_op_reply(142 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 42 ==== osd_op_reply(143 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.5 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 43 ==== osd_op_reply(146 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(141 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.3 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(148 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 44 ==== osd_op_reply(147 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 41 ==== osd_op_reply(140 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 42 ==== osd_op_reply(145 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.923+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x7ffa900dc040 2024-09-18T02:04:42.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.927+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 45 ==== osd_op_reply(149 foo.buckets [call] v32'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.927+0000 7ffa9e53c980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.927+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x7ffa900dc040 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.927+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 46 ==== osd_op_reply(150 myfoo [call,call,delete] v32'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.927+0000 7ffa9e53c980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.927+0000 7ffa9e53c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.927+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94025900093504 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x55841c5a72b0 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.927+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== watch-notify(notify (1) cookie 94025899789328 notify 137438953497 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55841c5bf400 con 0x55841c5a72b0 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.927+0000 7ff97b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94025899789328 notifier 4655 bl.length()=149 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.927+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== osd_op_reply(151 notify.6 [notify cookie 94025900093504 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.927+0000 7ff97b7fe640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff960003d70 con 0x55841c5a72b0 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.931+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.931+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== watch-notify(notify_complete (2) cookie 94025900093504 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55841c55d600 con 0x55841c5a72b0 2024-09-18T02:04:42.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.931+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:153 8.1c 8:3ecfd7e4:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x55841c5abc00 2024-09-18T02:04:42.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.931+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 43 ==== osd_op_reply(153 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 [call,call,delete] v32'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.931+0000 7ffa9e53c980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 from cache 2024-09-18T02:04:42.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.931+0000 7ffa9e53c980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.5, ofs0, ns] 2024-09-18T02:04:42.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.931+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:154 7.9 7:93e5b521:::notify.7:head [notify cookie 94025900093504 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x55841c5a72b0 2024-09-18T02:04:42.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.931+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 33 ==== watch-notify(notify (1) cookie 94025899787824 notify 137438953498 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55841c55d600 con 0x55841c5a72b0 2024-09-18T02:04:42.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.931+0000 7ff97b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94025899787824 notifier 4655 bl.length()=206 2024-09-18T02:04:42.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.931+0000 7ff97b7fe640 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:155 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff960003d70 con 0x55841c5a72b0 2024-09-18T02:04:42.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.931+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 34 ==== osd_op_reply(154 notify.7 [notify cookie 94025900093504 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 35 ==== osd_op_reply(155 notify.7 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 36 ==== watch-notify(notify_complete (2) cookie 94025900093504 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55841c567260 con 0x55841c5a72b0 2024-09-18T02:04:42.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:156 4.1a 4:5a104f11:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x7ffa900dc040 2024-09-18T02:04:42.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:157 4.3f 4:fc6bc1bf:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c604cd0 con 0x7ffa900dc040 2024-09-18T02:04:42.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:158 4.3d 4:be44c729:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ff040 con 0x55841c5abc00 2024-09-18T02:04:42.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:159 4.24 4:2552714c:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x55841c5a72b0 2024-09-18T02:04:42.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:160 4.16 4:6a82c613:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c604cd0 con 0x7ffa900dc040 2024-09-18T02:04:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:161 4.1a 4:5a662b41:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ff040 con 0x7ffa900dc040 2024-09-18T02:04:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:162 4.8 4:11490601:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x55841c5abc00 2024-09-18T02:04:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:163 4.25 4:a55a8335:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c603df0 con 0x55841c5abc00 2024-09-18T02:04:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:164 4.b 4:d223104f:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c604cd0 con 0x7ffa900dc040 2024-09-18T02:04:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:165 4.b 4:d105c325:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ff040 con 0x7ffa900dc040 2024-09-18T02:04:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:166 4.c 4:30e425b0:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x55841c5a28c0 2024-09-18T02:04:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 44 ==== osd_op_reply(158 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.2 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 45 ==== osd_op_reply(162 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.6 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 47 ==== osd_op_reply(157 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.1 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 46 ==== osd_op_reply(163 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.7 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 48 ==== osd_op_reply(160 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.4 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.935+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 49 ==== osd_op_reply(156 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.0 [delete] v32'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 35 ==== osd_op_reply(166 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.10 [delete] v32'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 37 ==== osd_op_reply(159 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.3 [delete] v32'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 50 ==== osd_op_reply(161 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.5 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 51 ==== osd_op_reply(164 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.8 [delete] v32'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 52 ==== osd_op_reply(165 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.5.9 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9e53c980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 : miss 2024-09-18T02:04:42.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9e53c980 20 rados->read ofs=0 len=0 2024-09-18T02:04:42.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:167 6.6 6:63a02f8e:::pubsub..bucket.myfoo%2fc5231f36-c36e-44d5-8268-aaf52617db58.4235.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x55841c5abc00 2024-09-18T02:04:42.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 47 ==== osd_op_reply(167 pubsub..bucket.myfoo/c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9e53c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:42.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9e53c980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 info.flags=0x0 2024-09-18T02:04:42.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9e53c980 10 adding default.rgw.log++pubsub..bucket.myfoo/c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 to cache LRU end 2024-09-18T02:04:42.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.939+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:168 6.6 6:63a02f8e:::pubsub..bucket.myfoo%2fc5231f36-c36e-44d5-8268-aaf52617db58.4235.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x55841c5abc00 2024-09-18T02:04:42.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.943+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 48 ==== osd_op_reply(168 pubsub..bucket.myfoo/c5231f36-c36e-44d5-8268-aaf52617db58.4235.5 [delete] v32'13 uv12 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.943+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x7ffa900dc040 2024-09-18T02:04:42.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.943+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 53 ==== osd_op_reply(169 foo.buckets [call] v32'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.947+0000 7ff9527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:42.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.947+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94025899793712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x55841c5a28c0 2024-09-18T02:04:42.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.947+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 36 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94025899793712] v32'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.947+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94025899769600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5ef8c0 con 0x7ffa900dc040 2024-09-18T02:04:42.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.947+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 54 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94025899769600] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.947+0000 7ffa9e53c980 20 remove_watcher() i=0 2024-09-18T02:04:42.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.947+0000 7ffa9e53c980 2 removed watcher, disabling cache 2024-09-18T02:04:42.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.947+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94025899773872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b5d30 con 0x55841c5a28c0 2024-09-18T02:04:42.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.951+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 37 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94025899773872] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.951+0000 7ffa9e53c980 20 remove_watcher() i=1 2024-09-18T02:04:42.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.951+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94025899776576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5aff00 con 0x55841c5abc00 2024-09-18T02:04:42.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.951+0000 7ffa9b84b640 1 -- 172.21.15.167:0/4167844072 <== osd.3 v2:172.21.15.167:6808/2476454287 49 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94025899776576] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa900c9030 con 0x55841c5abc00 2024-09-18T02:04:42.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.951+0000 7ffa9e53c980 20 remove_watcher() i=2 2024-09-18T02:04:42.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.951+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94025899767088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b5d30 con 0x7ffa900dc040 2024-09-18T02:04:42.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.955+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.2 v2:172.21.15.167:6816/2055439504 55 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94025899767088] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x7ffa900dc040 2024-09-18T02:04:42.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.955+0000 7ffa9e53c980 20 remove_watcher() i=3 2024-09-18T02:04:42.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.955+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94025899781200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5aff00 con 0x55841c5a28c0 2024-09-18T02:04:42.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.955+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 <== osd.1 v2:172.21.15.167:6800/15864359 38 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94025899781200] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8c027040 con 0x55841c5a28c0 2024-09-18T02:04:42.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.955+0000 7ffa9e53c980 20 remove_watcher() i=4 2024-09-18T02:04:42.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.955+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94025899784768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b5d30 con 0x55841c5a72b0 2024-09-18T02:04:42.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.959+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 38 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94025899784768] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.959+0000 7ffa9e53c980 20 remove_watcher() i=5 2024-09-18T02:04:42.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.959+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94025899789328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5b2c50 con 0x55841c5a72b0 2024-09-18T02:04:42.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.959+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 39 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94025899789328] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.959+0000 7ffa9e53c980 20 remove_watcher() i=6 2024-09-18T02:04:42.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.959+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94025899787824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55841c5aff00 con 0x55841c5a72b0 2024-09-18T02:04:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9c04c640 1 -- 172.21.15.167:0/4167844072 <== osd.0 v2:172.21.15.81:6800/3087415523 40 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94025899787824] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa9402c070 con 0x55841c5a72b0 2024-09-18T02:04:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 20 remove_watcher() i=7 2024-09-18T02:04:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55841c5a72b0 msgr2=0x55841c5a96a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55841c5a72b0 0x55841c5a96a0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55841c5a28c0 msgr2=0x55841c5a4d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55841c5a28c0 0x55841c5a4d80 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ffa900dc040 msgr2=0x7ffa900dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ffa900dc040 0x7ffa900dd430 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55841c5abc00 msgr2=0x55841c5ae010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55841c5abc00 0x55841c5ae010 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff96c034650 msgr2=0x7ff96c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff96c034650 0x7ff96c036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa90000c10 tx=0x7ffa900b9040 comp rx=0 tx=0).stop 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 msgr2=0x55841c597780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4167844072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c590660 0x55841c597780 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400d010 tx=0x7ffa94032570 comp rx=0 tx=0).stop 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4167844072 reap_dead start 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 shutdown_connections 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 >> 172.21.15.167:0/4167844072 conn(0x55841c58c990 msgr2=0x55841c58aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 shutdown_connections 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4167844072 wait complete. 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1628806883 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff974034650 msgr2=0x7ff974036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/1628806883 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff974034650 0x7ff974036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55841c5687f0 tx=0x7ffa90005a10 comp rx=0 tx=0).stop 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1628806883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c55d1e0 msgr2=0x55841c55b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.963+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/1628806883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c55d1e0 0x55841c55b860 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ffa94024520 tx=0x7ffa94023ac0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1628806883 shutdown_connections 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/1628806883 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff974034650 0x7ff974036b10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/1628806883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c55d1e0 0x55841c55b860 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1628806883 >> 172.21.15.167:0/1628806883 conn(0x55841c576c30 msgr2=0x55841c5796b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1628806883 shutdown_connections 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/1628806883 wait complete. 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55841c56d660 msgr2=0x55841c56fa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55841c56d660 0x55841c56fa50 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55841c474900 msgr2=0x55841c56aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55841c474900 0x55841c56aeb0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55841c571580 msgr2=0x55841c573970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55841c571580 0x55841c573970 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff9840346a0 msgr2=0x7ff984036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7ff9840346a0 0x7ff984036b60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffa900ad000 tx=0x7ffa900a5040 comp rx=0 tx=0).stop 2024-09-18T02:04:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 msgr2=0x55841c563db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 --2- 172.21.15.167:0/4189105280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841c470580 0x55841c563db0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000f90 tx=0x7ffa94001260 comp rx=0 tx=0).stop 2024-09-18T02:04:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9c84d640 1 -- 172.21.15.167:0/4189105280 reap_dead start 2024-09-18T02:04:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 shutdown_connections 2024-09-18T02:04:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 >> 172.21.15.167:0/4189105280 conn(0x55841c46c0a0 msgr2=0x55841c556130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 shutdown_connections 2024-09-18T02:04:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:42.967+0000 7ffa9e53c980 1 -- 172.21.15.167:0/4189105280 wait complete. 2024-09-18T02:04:42.982 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T02:04:42.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T02:04:42.983 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-18T02:04:43.060 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:43.060 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:43.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.059+0000 7fe2f1455980 1 Processor -- start 2024-09-18T02:04:43.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.059+0000 7fe2f1455980 1 -- start start 2024-09-18T02:04:43.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.059+0000 7fe2f1455980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a8393eec70 0x55a8393f1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.059+0000 7fe2f1455980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a839270ae0 con 0x55a8393ea8f0 2024-09-18T02:04:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.059+0000 7fe2f1455980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55a839294e30 con 0x55a8393eec70 2024-09-18T02:04:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.059+0000 7fe2ee764640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a8393eec70 0x55a8393f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.059+0000 7fe2ee764640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a8393eec70 0x55a8393f1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33376/0 (socket says 172.21.15.167:33376) 2024-09-18T02:04:43.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.059+0000 7fe2eef65640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55a8393ea8f0 0x55a8393eacd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:42652/0 (socket says 172.21.15.167:42652) 2024-09-18T02:04:43.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.059+0000 7fe2ee764640 1 -- 172.21.15.167:0/6627731 learned_addr learned my addr 172.21.15.167:0/6627731 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.059+0000 7fe2ee764640 1 -- 172.21.15.167:0/6627731 >> v1:172.21.15.81:6789/0 conn(0x55a8393ea8f0 legacy=0x55a8393eacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.059+0000 7fe2ee764640 1 -- 172.21.15.167:0/6627731 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8393f25b0 con 0x55a8393eec70 2024-09-18T02:04:43.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.063+0000 7fe2ee764640 1 --2- 172.21.15.167:0/6627731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393eec70 0x55a8393f1060 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800a4e0 tx=0x7fe2d801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce48a9cacff7c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.063+0000 7fe2edf63640 1 -- 172.21.15.167:0/6627731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80aa540 con 0x55a8393eec70 2024-09-18T02:04:43.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.063+0000 7fe2edf63640 1 -- 172.21.15.167:0/6627731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d80aa6e0 con 0x55a8393eec70 2024-09-18T02:04:43.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.063+0000 7fe2edf63640 1 -- 172.21.15.167:0/6627731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80aaa40 con 0x55a8393eec70 2024-09-18T02:04:43.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.063+0000 7fe2f1455980 1 -- 172.21.15.167:0/6627731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393eec70 msgr2=0x55a8393f1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.063+0000 7fe2f1455980 1 --2- 172.21.15.167:0/6627731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393eec70 0x55a8393f1060 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800a4e0 tx=0x7fe2d801b090 comp rx=0 tx=0).stop 2024-09-18T02:04:43.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.063+0000 7fe2f1455980 1 -- 172.21.15.167:0/6627731 shutdown_connections 2024-09-18T02:04:43.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.063+0000 7fe2f1455980 1 --2- 172.21.15.167:0/6627731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393eec70 0x55a8393f1060 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.063+0000 7fe2f1455980 1 -- 172.21.15.167:0/6627731 >> 172.21.15.167:0/6627731 conn(0x55a83935e240 msgr2=0x55a83935e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.063+0000 7fe2f1455980 1 -- 172.21.15.167:0/6627731 shutdown_connections 2024-09-18T02:04:43.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.063+0000 7fe2f1455980 1 -- 172.21.15.167:0/6627731 wait complete. 2024-09-18T02:04:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 Processor -- start 2024-09-18T02:04:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 -- start start 2024-09-18T02:04:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 0x55a8394d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a839296200 con 0x55a8393ea8f0 2024-09-18T02:04:43.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2eef65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 0x55a8394d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2eef65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 0x55a8394d5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33390/0 (socket says 172.21.15.167:33390) 2024-09-18T02:04:43.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2eef65640 1 -- 172.21.15.167:0/36999245 learned_addr learned my addr 172.21.15.167:0/36999245 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2eef65640 1 -- 172.21.15.167:0/36999245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8394d6380 con 0x55a8393ea8f0 2024-09-18T02:04:43.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2eef65640 1 --2- 172.21.15.167:0/36999245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 0x55a8394d5db0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8001e50 tx=0x7fe2e8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb93445514b0b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe1dce09640 1 -- 172.21.15.167:0/36999245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e800e5d0 con 0x55a8393ea8f0 2024-09-18T02:04:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe1dce09640 1 -- 172.21.15.167:0/36999245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e800e770 con 0x55a8393ea8f0 2024-09-18T02:04:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe1dce09640 1 -- 172.21.15.167:0/36999245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e800eab0 con 0x55a8393ea8f0 2024-09-18T02:04:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 -- 172.21.15.167:0/36999245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 msgr2=0x55a8394d5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 --2- 172.21.15.167:0/36999245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 0x55a8394d5db0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8001e50 tx=0x7fe2e8001e80 comp rx=0 tx=0).stop 2024-09-18T02:04:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 -- 172.21.15.167:0/36999245 shutdown_connections 2024-09-18T02:04:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 --2- 172.21.15.167:0/36999245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 0x55a8394d5db0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 -- 172.21.15.167:0/36999245 >> 172.21.15.167:0/36999245 conn(0x55a83935e240 msgr2=0x55a8394d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 -- 172.21.15.167:0/36999245 shutdown_connections 2024-09-18T02:04:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 -- 172.21.15.167:0/36999245 wait complete. 2024-09-18T02:04:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 Processor -- start 2024-09-18T02:04:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.079+0000 7fe2f1455980 1 -- start start 2024-09-18T02:04:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2f1455980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 0x55a8394dd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2f1455980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a8393f20b0 con 0x55a8393ea8f0 2024-09-18T02:04:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2eef65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 0x55a8394dd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2eef65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 0x55a8394dd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33400/0 (socket says 172.21.15.167:33400) 2024-09-18T02:04:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2eef65640 1 -- 172.21.15.167:0/3471039634 learned_addr learned my addr 172.21.15.167:0/3471039634 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2eef65640 1 -- 172.21.15.167:0/3471039634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8394dd660 con 0x55a8393ea8f0 2024-09-18T02:04:43.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2eef65640 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 0x55a8394dd120 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x55a8394d6f90 tx=0x7fe2e8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe1db606640 1 -- 172.21.15.167:0/3471039634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e8001260 con 0x55a8393ea8f0 2024-09-18T02:04:43.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe1db606640 1 -- 172.21.15.167:0/3471039634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e800fa40 con 0x55a8393ea8f0 2024-09-18T02:04:43.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8394dd8f0 con 0x55a8393ea8f0 2024-09-18T02:04:43.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe1db606640 1 -- 172.21.15.167:0/3471039634 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e800fd80 con 0x55a8393ea8f0 2024-09-18T02:04:43.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8394e05d0 con 0x55a8393ea8f0 2024-09-18T02:04:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe1db606640 1 -- 172.21.15.167:0/3471039634 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2e8017070 con 0x55a8393ea8f0 2024-09-18T02:04:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe1db606640 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1d40346a0 0x7fe1d4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe1db606640 1 -- 172.21.15.167:0/3471039634 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe2e8015020 con 0x55a8393ea8f0 2024-09-18T02:04:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2ee764640 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1d40346a0 0x7fe1d4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a8394e20a0 0x55a8394e44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8394e4b60 con 0x55a8394e20a0 2024-09-18T02:04:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2ef766640 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a8394e20a0 0x55a8394e44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2ee764640 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1d40346a0 0x7fe1d4036b60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80ab000 tx=0x7fe2d80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.083+0000 7fe2ef766640 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a8394e20a0 0x55a8394e44f0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2ef766640 1 -- 172.21.15.167:0/3471039634 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2e00083f0 con 0x55a8394e20a0 2024-09-18T02:04:43.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8394e17f0 con 0x55a8394e20a0 2024-09-18T02:04:43.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2ef766640 1 -- 172.21.15.167:0/3471039634 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2e00083f0 con 0x55a8394e20a0 2024-09-18T02:04:43.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a8394e6e90 0x55a8394e9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8394e9970 con 0x55a8394e6e90 2024-09-18T02:04:43.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2eef65640 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a8394e6e90 0x55a8394e9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2eef65640 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a8394e6e90 0x55a8394e9280 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2eef65640 1 -- 172.21.15.167:0/3471039634 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2e802e070 con 0x55a8394e6e90 2024-09-18T02:04:43.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8394e5d30 con 0x55a8394e20a0 2024-09-18T02:04:43.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2ef766640 1 -- 172.21.15.167:0/3471039634 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2e00083f0 con 0x55a8394e20a0 2024-09-18T02:04:43.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a8394eadd0 0x55a8394ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8394ed930 con 0x55a8394eadd0 2024-09-18T02:04:43.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2ee764640 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a8394eadd0 0x55a8394ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2ee764640 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a8394eadd0 0x55a8394ed1c0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2ee764640 1 -- 172.21.15.167:0/3471039634 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe2d80bc040 con 0x55a8394eadd0 2024-09-18T02:04:43.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.087+0000 7fe2f1455980 1 Processor -- start 2024-09-18T02:04:43.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2f1455980 1 -- start start 2024-09-18T02:04:43.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2f1455980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8394fb3a0 0x55a8394fb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2f1455980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a8392ef800 con 0x55a8394fb3a0 2024-09-18T02:04:43.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2eef65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8394fb3a0 0x55a8394fb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2eef65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8394fb3a0 0x55a8394fb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33408/0 (socket says 172.21.15.167:33408) 2024-09-18T02:04:43.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2eef65640 1 -- 172.21.15.167:0/1575145432 learned_addr learned my addr 172.21.15.167:0/1575145432 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2eef65640 1 -- 172.21.15.167:0/1575145432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8394fbd00 con 0x55a8394fb3a0 2024-09-18T02:04:43.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2eef65640 1 --2- 172.21.15.167:0/1575145432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8394fb3a0 0x55a8394fb7c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8024000 tx=0x7fe2e8017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe1d8e01640 1 -- 172.21.15.167:0/1575145432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e803f020 con 0x55a8394fb3a0 2024-09-18T02:04:43.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe1d8e01640 1 -- 172.21.15.167:0/1575145432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e8042850 con 0x55a8394fb3a0 2024-09-18T02:04:43.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2f1455980 1 -- 172.21.15.167:0/1575145432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8394fbf90 con 0x55a8394fb3a0 2024-09-18T02:04:43.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe1d8e01640 1 -- 172.21.15.167:0/1575145432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e8019860 con 0x55a8394fb3a0 2024-09-18T02:04:43.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2f1455980 1 -- 172.21.15.167:0/1575145432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8394fbf90 con 0x55a8394fb3a0 2024-09-18T02:04:43.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe1d8e01640 1 -- 172.21.15.167:0/1575145432 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2e803a070 con 0x55a8394fb3a0 2024-09-18T02:04:43.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe1d8e01640 1 --2- 172.21.15.167:0/1575145432 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1c8034650 0x7fe1c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe1d8e01640 1 -- 172.21.15.167:0/1575145432 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe2e804f970 con 0x55a8394fb3a0 2024-09-18T02:04:43.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2ee764640 1 --2- 172.21.15.167:0/1575145432 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1c8034650 0x7fe1c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2f1455980 1 Processor -- start 2024-09-18T02:04:43.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2f1455980 1 -- start start 2024-09-18T02:04:43.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2f1455980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 0x55a839507f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2f1455980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a8394d6700 con 0x55a839507b90 2024-09-18T02:04:43.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.091+0000 7fe2ee764640 1 --2- 172.21.15.167:0/1575145432 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1c8034650 0x7fe1c8036b10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80aa6b0 tx=0x7fe2d8005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2eef65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 0x55a839507f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2eef65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 0x55a839507f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33412/0 (socket says 172.21.15.167:33412) 2024-09-18T02:04:43.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2eef65640 1 -- 172.21.15.167:0/2826764878 learned_addr learned my addr 172.21.15.167:0/2826764878 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2eef65640 1 -- 172.21.15.167:0/2826764878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a839508540 con 0x55a839507b90 2024-09-18T02:04:43.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2eef65640 1 --2- 172.21.15.167:0/2826764878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 0x55a839507f70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe2e804afd0 tx=0x7fe2e803bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fea03a659991e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe1d27fc640 1 -- 172.21.15.167:0/2826764878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e803de50 con 0x55a839507b90 2024-09-18T02:04:43.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe1d27fc640 1 -- 172.21.15.167:0/2826764878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e805f070 con 0x55a839507b90 2024-09-18T02:04:43.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe1d27fc640 1 -- 172.21.15.167:0/2826764878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e804a1e0 con 0x55a839507b90 2024-09-18T02:04:43.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2f1455980 1 -- 172.21.15.167:0/2826764878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 msgr2=0x55a839507f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2f1455980 1 --2- 172.21.15.167:0/2826764878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 0x55a839507f70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe2e804afd0 tx=0x7fe2e803bc50 comp rx=0 tx=0).stop 2024-09-18T02:04:43.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2f1455980 1 -- 172.21.15.167:0/2826764878 shutdown_connections 2024-09-18T02:04:43.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2f1455980 1 --2- 172.21.15.167:0/2826764878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 0x55a839507f70 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2f1455980 1 -- 172.21.15.167:0/2826764878 >> 172.21.15.167:0/2826764878 conn(0x55a839503ec0 msgr2=0x55a839501fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2f1455980 1 -- 172.21.15.167:0/2826764878 shutdown_connections 2024-09-18T02:04:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2f1455980 1 -- 172.21.15.167:0/2826764878 wait complete. 2024-09-18T02:04:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2f1455980 1 Processor -- start 2024-09-18T02:04:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2f1455980 1 -- start start 2024-09-18T02:04:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2f1455980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 0x55a83950ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2f1455980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a839508a50 con 0x55a839507b90 2024-09-18T02:04:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2eef65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 0x55a83950ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2eef65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 0x55a83950ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33426/0 (socket says 172.21.15.167:33426) 2024-09-18T02:04:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 learned_addr learned my addr 172.21.15.167:0/3983025049 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a83950f1a0 con 0x55a839507b90 2024-09-18T02:04:43.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.095+0000 7fe2eef65640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 0x55a83950ec60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8047fe0 tx=0x7fe2e8047f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe1d0ff9640 1 -- 172.21.15.167:0/3983025049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e803de50 con 0x55a839507b90 2024-09-18T02:04:43.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a83950f1a0 con 0x55a839507b90 2024-09-18T02:04:43.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a83950f1a0 con 0x55a839507b90 2024-09-18T02:04:43.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe1d0ff9640 1 -- 172.21.15.167:0/3983025049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e806a070 con 0x55a839507b90 2024-09-18T02:04:43.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe1d0ff9640 1 -- 172.21.15.167:0/3983025049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e8041be0 con 0x55a839507b90 2024-09-18T02:04:43.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe1d0ff9640 1 -- 172.21.15.167:0/3983025049 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2e8058040 con 0x55a839507b90 2024-09-18T02:04:43.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe1d0ff9640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1b8034650 0x7fe1b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe1d0ff9640 1 -- 172.21.15.167:0/3983025049 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe2e8055040 con 0x55a839507b90 2024-09-18T02:04:43.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2ee764640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1b8034650 0x7fe1b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a839519d80 0x55a83951c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a83951c990 con 0x55a839519d80 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2ef766640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a839519d80 0x55a83951c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2ee764640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1b8034650 0x7fe1b8036b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800a190 tx=0x7fe2d80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2ef766640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a839519d80 0x55a83951c240 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2e00083f0 con 0x55a839519d80 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 20 realm 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a83951cda0 con 0x55a839519d80 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2e00083f0 con 0x55a839519d80 2024-09-18T02:04:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a83951d670 con 0x55a839519d80 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2e00083f0 con 0x55a839519d80 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839519d80 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2e00083f0 con 0x55a839519d80 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a83951e770 0x55a839520b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.099+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a839521130 con 0x55a83951e770 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2eef65640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a83951e770 0x55a839520b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2eef65640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a83951e770 0x55a839520b60 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2f1455980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2f1455980 20 searching for the correct realm 2024-09-18T02:04:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a839523080 0x55a8395254b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a839525b80 con 0x55a839523080 2024-09-18T02:04:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ee764640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a839523080 0x55a8395254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ee764640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a839523080 0x55a8395254b0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ee764640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fe2d80dc040 0x7fe2d80cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a839525b80 con 0x7fe2d80dc040 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ef766640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fe2d80dc040 0x7fe2d80cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ef766640 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fe2d80dc040 0x7fe2d80cd430 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e00083f0 con 0x7fe2d80dc040 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x7fe2d80dc040 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e00083f0 con 0x7fe2d80dc040 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839519d80 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.103+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839519d80 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839519d80 2024-09-18T02:04:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a83951e770 2024-09-18T02:04:43.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x7fe2d80dc040 2024-09-18T02:04:43.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839523080 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839519d80 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x7fe2d80dc040 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839519d80 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x7fe2d80dc040 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839523080 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839523080 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.107+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a83951e770 2024-09-18T02:04:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839523080 2024-09-18T02:04:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839523080 2024-09-18T02:04:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839519d80 2024-09-18T02:04:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839519d80 2024-09-18T02:04:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a83951e770 2024-09-18T02:04:43.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839523080 2024-09-18T02:04:43.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x7fe2d80dc040 2024-09-18T02:04:43.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839519d80 2024-09-18T02:04:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a83951e770 2024-09-18T02:04:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.111+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839523080 2024-09-18T02:04:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a83951e770 2024-09-18T02:04:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x7fe2d80dc040 2024-09-18T02:04:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839523080 2024-09-18T02:04:43.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a83951e770 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x55a839519d80 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a83951da10 con 0x7fe2d80dc040 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8395219f0 con 0x55a839519d80 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8395219f0 con 0x55a839519d80 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.115+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8395219f0 con 0x55a839523080 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:43.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 20 zone default found 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 4 Realm: () 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 20 zonegroup default 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a839522370 con 0x55a83951e770 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a839527a70 con 0x55a839523080 2024-09-18T02:04:43.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a839527eb0 con 0x55a839523080 2024-09-18T02:04:43.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 20 started sync module instance, tier type = 2024-09-18T02:04:43.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:43.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839526e80 con 0x7fe2d80dc040 2024-09-18T02:04:43.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94181004571600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839526e80 con 0x7fe2d80dc040 2024-09-18T02:04:43.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.119+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839528980 con 0x55a839519d80 2024-09-18T02:04:43.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.123+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94181004571600] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.123+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.123+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94181004575888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839526e80 con 0x55a839519d80 2024-09-18T02:04:43.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.123+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839529390 con 0x55a839523080 2024-09-18T02:04:43.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.123+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.123+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94181004578528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839529be0 con 0x55a839523080 2024-09-18T02:04:43.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.123+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952a5e0 con 0x7fe2d80dc040 2024-09-18T02:04:43.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.123+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94181004575888] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.127+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.127+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94181004569040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952aa00 con 0x7fe2d80dc040 2024-09-18T02:04:43.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.127+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952b2d0 con 0x55a839519d80 2024-09-18T02:04:43.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.127+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94181004578528] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.127+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94181004569040] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.127+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.127+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94181004583152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952a9b0 con 0x55a839519d80 2024-09-18T02:04:43.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.127+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952bb70 con 0x55a83951e770 2024-09-18T02:04:43.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.131+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94181004583152] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.131+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.131+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94181004588736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952a9b0 con 0x55a83951e770 2024-09-18T02:04:43.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.131+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952c3c0 con 0x55a83951e770 2024-09-18T02:04:43.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.131+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.131+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94181004591344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952cb60 con 0x55a83951e770 2024-09-18T02:04:43.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.131+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952d660 con 0x55a83951e770 2024-09-18T02:04:43.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.131+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94181004588736] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94181004591344] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94181004595536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952c5b0 con 0x55a83951e770 2024-09-18T02:04:43.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2f1455980 20 add_watcher() i=0 2024-09-18T02:04:43.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2f1455980 20 add_watcher() i=1 2024-09-18T02:04:43.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2f1455980 20 add_watcher() i=2 2024-09-18T02:04:43.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2f1455980 20 add_watcher() i=3 2024-09-18T02:04:43.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2f1455980 20 add_watcher() i=4 2024-09-18T02:04:43.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2f1455980 20 add_watcher() i=5 2024-09-18T02:04:43.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2f1455980 20 add_watcher() i=6 2024-09-18T02:04:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94181004595536] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2f1455980 20 add_watcher() i=7 2024-09-18T02:04:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2f1455980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.135+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a839530650 con 0x55a839519d80 2024-09-18T02:04:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94181004580656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952dad0 con 0x55a839519d80 2024-09-18T02:04:43.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94181004580656] v32'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe1a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:43.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:43.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 5 note: GC not initialized 2024-09-18T02:04:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe11ffff640 20 reqs_thread_entry: start 2024-09-18T02:04:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 20 Filter name: none 2024-09-18T02:04:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe11dffb640 20 reqs_thread_entry: start 2024-09-18T02:04:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a839553c60 con 0x55a839519d80 2024-09-18T02:04:43.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:43.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:43.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:43.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:43.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.139+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839559e00 con 0x55a839519d80 2024-09-18T02:04:43.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2f1455980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:43.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2f1455980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:43.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2f1455980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:43.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94181004777616 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8395556e0 con 0x55a839519d80 2024-09-18T02:04:43.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== watch-notify(notify (1) cookie 94181004583152 notify 137438953488 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7fe2e0010040 con 0x55a839519d80 2024-09-18T02:04:43.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe1d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94181004583152 notifier 4662 bl.length()=579 2024-09-18T02:04:43.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe1d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:43.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe1d27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:43.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(64 notify.4 [notify cookie 94181004777616 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe1d27fc640 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe1b4003eb0 con 0x55a839519d80 2024-09-18T02:04:43.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== watch-notify(notify_complete (2) cookie 94181004777616 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe2e002b440 con 0x55a839519d80 2024-09-18T02:04:43.147 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:43.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe1a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:43.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94181004580656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839551a90 con 0x55a839519d80 2024-09-18T02:04:43.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94181004580656] v32'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.143+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94181004571600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839551a90 con 0x7fe2d80dc040 2024-09-18T02:04:43.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.147+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94181004571600] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.147+0000 7fe2f1455980 20 remove_watcher() i=0 2024-09-18T02:04:43.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.147+0000 7fe2f1455980 2 removed watcher, disabling cache 2024-09-18T02:04:43.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.147+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94181004575888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a8395273d0 con 0x55a839519d80 2024-09-18T02:04:43.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.147+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94181004575888] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.147+0000 7fe2f1455980 20 remove_watcher() i=1 2024-09-18T02:04:43.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.147+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94181004578528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839551a90 con 0x55a839523080 2024-09-18T02:04:43.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.151+0000 7fe2ee764640 1 -- 172.21.15.167:0/3983025049 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94181004578528] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d80ca070 con 0x55a839523080 2024-09-18T02:04:43.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.151+0000 7fe2f1455980 20 remove_watcher() i=2 2024-09-18T02:04:43.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.151+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94181004569040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839528490 con 0x7fe2d80dc040 2024-09-18T02:04:43.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.151+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94181004569040] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x7fe2d80dc040 2024-09-18T02:04:43.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.151+0000 7fe2f1455980 20 remove_watcher() i=3 2024-09-18T02:04:43.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.151+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94181004583152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a8395273d0 con 0x55a839519d80 2024-09-18T02:04:43.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.155+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94181004583152] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e0026040 con 0x55a839519d80 2024-09-18T02:04:43.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.155+0000 7fe2f1455980 20 remove_watcher() i=4 2024-09-18T02:04:43.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.155+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94181004588736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a839528490 con 0x55a83951e770 2024-09-18T02:04:43.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.155+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94181004588736] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.155+0000 7fe2f1455980 20 remove_watcher() i=5 2024-09-18T02:04:43.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.155+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94181004591344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a83952a0f0 con 0x55a83951e770 2024-09-18T02:04:43.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94181004591344] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 20 remove_watcher() i=6 2024-09-18T02:04:43.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94181004595536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a8395273d0 con 0x55a83951e770 2024-09-18T02:04:43.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2eef65640 1 -- 172.21.15.167:0/3983025049 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94181004595536] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2e8041020 con 0x55a83951e770 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 20 remove_watcher() i=7 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a83951e770 msgr2=0x55a839520b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a83951e770 0x55a839520b60 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a839519d80 msgr2=0x55a83951c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a839519d80 0x55a83951c240 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fe2d80dc040 msgr2=0x7fe2d80cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fe2d80dc040 0x7fe2d80cd430 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a839523080 msgr2=0x55a8395254b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a839523080 0x55a8395254b0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1b8034650 msgr2=0x7fe1b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1b8034650 0x7fe1b8036b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800a190 tx=0x7fe2d80a6000 comp rx=0 tx=0).stop 2024-09-18T02:04:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 msgr2=0x55a83950ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3983025049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a839507b90 0x55a83950ec60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8047fe0 tx=0x7fe2e8047f70 comp rx=0 tx=0).stop 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 reap_dead start 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2ef766640 1 -- 172.21.15.167:0/3983025049 reap_dead start 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 shutdown_connections 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 >> 172.21.15.167:0/3983025049 conn(0x55a839503ec0 msgr2=0x55a839501f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 shutdown_connections 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/3983025049 wait complete. 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/1575145432 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1c8034650 msgr2=0x7fe1c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 --2- 172.21.15.167:0/1575145432 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1c8034650 0x7fe1c8036b10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80aa6b0 tx=0x7fe2d8005e50 comp rx=0 tx=0).stop 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/1575145432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8394fb3a0 msgr2=0x55a8394fb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 --2- 172.21.15.167:0/1575145432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8394fb3a0 0x55a8394fb7c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8024000 tx=0x7fe2e8017d50 comp rx=0 tx=0).stop 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/1575145432 shutdown_connections 2024-09-18T02:04:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 --2- 172.21.15.167:0/1575145432 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1c8034650 0x7fe1c8036b10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 --2- 172.21.15.167:0/1575145432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8394fb3a0 0x55a8394fb7c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/1575145432 >> 172.21.15.167:0/1575145432 conn(0x55a8394f04f0 msgr2=0x55a8394f2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/1575145432 shutdown_connections 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.159+0000 7fe2f1455980 1 -- 172.21.15.167:0/1575145432 wait complete. 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a8394e6e90 msgr2=0x55a8394e9280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a8394e6e90 0x55a8394e9280 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a8394e20a0 msgr2=0x55a8394e44f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a8394e20a0 0x55a8394e44f0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a8394eadd0 msgr2=0x55a8394ed1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a8394eadd0 0x55a8394ed1c0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1d40346a0 msgr2=0x7fe1d4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe1d40346a0 0x7fe1d4036b60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80ab000 tx=0x7fe2d80a5000 comp rx=0 tx=0).stop 2024-09-18T02:04:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 msgr2=0x55a8394dd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 --2- 172.21.15.167:0/3471039634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8393ea8f0 0x55a8394dd120 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x55a8394d6f90 tx=0x7fe2e8000bd0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2ef766640 1 -- 172.21.15.167:0/3471039634 reap_dead start 2024-09-18T02:04:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 shutdown_connections 2024-09-18T02:04:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 >> 172.21.15.167:0/3471039634 conn(0x55a83935e240 msgr2=0x55a8394d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 shutdown_connections 2024-09-18T02:04:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.163+0000 7fe2f1455980 1 -- 172.21.15.167:0/3471039634 wait complete. 2024-09-18T02:04:43.176 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:43.177 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T02:04:43.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T02:04:43.177 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-18T02:04:43.255 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:43.255 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.251+0000 7efdb6e4f980 1 Processor -- start 2024-09-18T02:04:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.251+0000 7efdb6e4f980 1 -- start start 2024-09-18T02:04:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.251+0000 7efdb6e4f980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f914c396a0 0x55f914c39a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.251+0000 7efdb6e4f980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f914ac1ae0 con 0x55f914c39ff0 2024-09-18T02:04:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.251+0000 7efdb6e4f980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55f914ae5e30 con 0x55f914c396a0 2024-09-18T02:04:43.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.251+0000 7efdb495f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f914c396a0 0x55f914c39a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.251+0000 7efdb495f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f914c396a0 0x55f914c39a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33440/0 (socket says 172.21.15.167:33440) 2024-09-18T02:04:43.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.251+0000 7efdb495f640 1 -- 172.21.15.167:0/222772693 learned_addr learned my addr 172.21.15.167:0/222772693 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.251+0000 7efdb415e640 1 --1- 172.21.15.167:0/222772693 >> v1:172.21.15.81:6789/0 conn(0x55f914c39ff0 0x55f914c3ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:42656/0 (socket says 172.21.15.167:42656) 2024-09-18T02:04:43.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb495f640 1 -- 172.21.15.167:0/222772693 >> v1:172.21.15.81:6789/0 conn(0x55f914c39ff0 legacy=0x55f914c3ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb495f640 1 -- 172.21.15.167:0/222772693 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f914c41270 con 0x55f914c396a0 2024-09-18T02:04:43.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb495f640 1 --2- 172.21.15.167:0/222772693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914c39a80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7efdac00a4e0 tx=0x7efdac01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26d9a3f89a2593 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb395d640 1 -- 172.21.15.167:0/222772693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac0aa540 con 0x55f914c396a0 2024-09-18T02:04:43.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb395d640 1 -- 172.21.15.167:0/222772693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdac0aa6e0 con 0x55f914c396a0 2024-09-18T02:04:43.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb395d640 1 -- 172.21.15.167:0/222772693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac0aaa40 con 0x55f914c396a0 2024-09-18T02:04:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb6e4f980 1 -- 172.21.15.167:0/222772693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 msgr2=0x55f914c39a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/222772693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914c39a80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7efdac00a4e0 tx=0x7efdac01b090 comp rx=0 tx=0).stop 2024-09-18T02:04:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb6e4f980 1 -- 172.21.15.167:0/222772693 shutdown_connections 2024-09-18T02:04:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/222772693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914c39a80 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb6e4f980 1 -- 172.21.15.167:0/222772693 >> 172.21.15.167:0/222772693 conn(0x55f914c351c0 msgr2=0x55f914c375e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb6e4f980 1 -- 172.21.15.167:0/222772693 shutdown_connections 2024-09-18T02:04:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.255+0000 7efdb6e4f980 1 -- 172.21.15.167:0/222772693 wait complete. 2024-09-18T02:04:43.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.271+0000 7efdb6e4f980 1 Processor -- start 2024-09-18T02:04:43.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.271+0000 7efdb6e4f980 1 -- start start 2024-09-18T02:04:43.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.271+0000 7efdb6e4f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914bb0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.271+0000 7efdb6e4f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f914ae7200 con 0x55f914c396a0 2024-09-18T02:04:43.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb495f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914bb0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb495f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914bb0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33450/0 (socket says 172.21.15.167:33450) 2024-09-18T02:04:43.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb495f640 1 -- 172.21.15.167:0/1390820012 learned_addr learned my addr 172.21.15.167:0/1390820012 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb495f640 1 -- 172.21.15.167:0/1390820012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f914bb0950 con 0x55f914c396a0 2024-09-18T02:04:43.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb495f640 1 --2- 172.21.15.167:0/1390820012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914bb0380 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7efdac017ca0 tx=0x7efdac0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea45f1eb832261c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efca2e0d640 1 -- 172.21.15.167:0/1390820012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac0b9030 con 0x55f914c396a0 2024-09-18T02:04:43.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efca2e0d640 1 -- 172.21.15.167:0/1390820012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdac0aaac0 con 0x55f914c396a0 2024-09-18T02:04:43.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efca2e0d640 1 -- 172.21.15.167:0/1390820012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac0aada0 con 0x55f914c396a0 2024-09-18T02:04:43.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1390820012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 msgr2=0x55f914bb0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/1390820012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914bb0380 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7efdac017ca0 tx=0x7efdac0033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1390820012 shutdown_connections 2024-09-18T02:04:43.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/1390820012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914bb0380 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1390820012 >> 172.21.15.167:0/1390820012 conn(0x55f914c351c0 msgr2=0x55f914d20610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1390820012 shutdown_connections 2024-09-18T02:04:43.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1390820012 wait complete. 2024-09-18T02:04:43.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb6e4f980 1 Processor -- start 2024-09-18T02:04:43.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb6e4f980 1 -- start start 2024-09-18T02:04:43.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb6e4f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914d2ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb6e4f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f914c40cb0 con 0x55f914c396a0 2024-09-18T02:04:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb495f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914d2ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb495f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914d2ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33454/0 (socket says 172.21.15.167:33454) 2024-09-18T02:04:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb495f640 1 -- 172.21.15.167:0/3755794382 learned_addr learned my addr 172.21.15.167:0/3755794382 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb495f640 1 -- 172.21.15.167:0/3755794382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f914d2e330 con 0x55f914c396a0 2024-09-18T02:04:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.275+0000 7efdb495f640 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914d2ddf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efdac005cc0 tx=0x7efdac017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efca160a640 1 -- 172.21.15.167:0/3755794382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac0b9030 con 0x55f914c396a0 2024-09-18T02:04:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f914d2e5c0 con 0x55f914c396a0 2024-09-18T02:04:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efca160a640 1 -- 172.21.15.167:0/3755794382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdac0c3070 con 0x55f914c396a0 2024-09-18T02:04:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efca160a640 1 -- 172.21.15.167:0/3755794382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac0bf750 con 0x55f914c396a0 2024-09-18T02:04:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f914d312a0 con 0x55f914c396a0 2024-09-18T02:04:43.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efca160a640 1 -- 172.21.15.167:0/3755794382 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdac0c5030 con 0x55f914c396a0 2024-09-18T02:04:43.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efca160a640 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc9c034650 0x7efc9c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efca160a640 1 -- 172.21.15.167:0/3755794382 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7efdac0ba070 con 0x55f914c396a0 2024-09-18T02:04:43.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb415e640 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc9c034650 0x7efc9c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f914c39ff0 0x55f914d34ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d35430 con 0x55f914c39ff0 2024-09-18T02:04:43.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb5160640 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f914c39ff0 0x55f914d34ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb415e640 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc9c034650 0x7efc9c036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efda8001e50 tx=0x7efda80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb5160640 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f914c39ff0 0x55f914d34ef0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb5160640 1 -- 172.21.15.167:0/3755794382 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914c39ff0 2024-09-18T02:04:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d324a0 con 0x55f914c39ff0 2024-09-18T02:04:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb5160640 1 -- 172.21.15.167:0/3755794382 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efda40083f0 con 0x55f914c39ff0 2024-09-18T02:04:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f914d37700 0x55f914d39af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d3a1c0 con 0x55f914d37700 2024-09-18T02:04:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.279+0000 7efdb495f640 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f914d37700 0x55f914d39af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb495f640 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f914d37700 0x55f914d39af0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb495f640 1 -- 172.21.15.167:0/3755794382 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efdac0ce070 con 0x55f914d37700 2024-09-18T02:04:43.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d365a0 con 0x55f914c39ff0 2024-09-18T02:04:43.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb5160640 1 -- 172.21.15.167:0/3755794382 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efda40083f0 con 0x55f914c39ff0 2024-09-18T02:04:43.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f914d3b600 0x55f914d3d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d3e180 con 0x55f914d3b600 2024-09-18T02:04:43.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb415e640 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f914d3b600 0x55f914d3d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb415e640 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f914d3b600 0x55f914d3d9f0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb415e640 1 -- 172.21.15.167:0/3755794382 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efda800f700 con 0x55f914d3b600 2024-09-18T02:04:43.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb6e4f980 1 Processor -- start 2024-09-18T02:04:43.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb6e4f980 1 -- start start 2024-09-18T02:04:43.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb6e4f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d4bc10 0x55f914d4c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb6e4f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f914b40800 con 0x55f914d4bc10 2024-09-18T02:04:43.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb495f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d4bc10 0x55f914d4c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb495f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d4bc10 0x55f914d4c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33460/0 (socket says 172.21.15.167:33460) 2024-09-18T02:04:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb495f640 1 -- 172.21.15.167:0/1262685312 learned_addr learned my addr 172.21.15.167:0/1262685312 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.283+0000 7efdb495f640 1 -- 172.21.15.167:0/1262685312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f914d4c570 con 0x55f914d4bc10 2024-09-18T02:04:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb495f640 1 --2- 172.21.15.167:0/1262685312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d4bc10 0x55f914d4c030 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efdac0e35a0 tx=0x7efdac0bf9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efc9a7fc640 1 -- 172.21.15.167:0/1262685312 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac0e3a20 con 0x55f914d4bc10 2024-09-18T02:04:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efc9a7fc640 1 -- 172.21.15.167:0/1262685312 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdac0e3bc0 con 0x55f914d4bc10 2024-09-18T02:04:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1262685312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f914d4c800 con 0x55f914d4bc10 2024-09-18T02:04:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efc9a7fc640 1 -- 172.21.15.167:0/1262685312 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac0b43a0 con 0x55f914d4bc10 2024-09-18T02:04:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1262685312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f914d4f480 con 0x55f914d4bc10 2024-09-18T02:04:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efc9a7fc640 1 -- 172.21.15.167:0/1262685312 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdac0b3040 con 0x55f914d4bc10 2024-09-18T02:04:43.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efc9a7fc640 1 --2- 172.21.15.167:0/1262685312 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc8c034650 0x7efc8c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efc9a7fc640 1 -- 172.21.15.167:0/1262685312 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7efdac0eac20 con 0x55f914d4bc10 2024-09-18T02:04:43.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb415e640 1 --2- 172.21.15.167:0/1262685312 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc8c034650 0x7efc8c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb6e4f980 1 Processor -- start 2024-09-18T02:04:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb6e4f980 1 -- start start 2024-09-18T02:04:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb415e640 1 --2- 172.21.15.167:0/1262685312 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc8c034650 0x7efc8c036b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55f914d3e580 tx=0x7efda800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb6e4f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d58920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb6e4f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f914baeab0 con 0x55f914d58540 2024-09-18T02:04:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb495f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d58920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb495f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d58920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33474/0 (socket says 172.21.15.167:33474) 2024-09-18T02:04:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb495f640 1 -- 172.21.15.167:0/3683919723 learned_addr learned my addr 172.21.15.167:0/3683919723 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb495f640 1 -- 172.21.15.167:0/3683919723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f914d58ef0 con 0x55f914d58540 2024-09-18T02:04:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efdb495f640 1 --2- 172.21.15.167:0/3683919723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d58920 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efdac0e4010 tx=0x7efdac0a9f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be11c182073bb5e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.287+0000 7efc8bfff640 1 -- 172.21.15.167:0/3683919723 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac101070 con 0x55f914d58540 2024-09-18T02:04:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efc8bfff640 1 -- 172.21.15.167:0/3683919723 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdac0090d0 con 0x55f914d58540 2024-09-18T02:04:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efc8bfff640 1 -- 172.21.15.167:0/3683919723 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac0ee070 con 0x55f914d58540 2024-09-18T02:04:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3683919723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 msgr2=0x55f914d58920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/3683919723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d58920 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efdac0e4010 tx=0x7efdac0a9f80 comp rx=0 tx=0).stop 2024-09-18T02:04:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3683919723 shutdown_connections 2024-09-18T02:04:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/3683919723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d58920 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3683919723 >> 172.21.15.167:0/3683919723 conn(0x55f914d54920 msgr2=0x55f914d52a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3683919723 shutdown_connections 2024-09-18T02:04:43.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3683919723 wait complete. 2024-09-18T02:04:43.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 Processor -- start 2024-09-18T02:04:43.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 -- start start 2024-09-18T02:04:43.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d5f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f914d59390 con 0x55f914d58540 2024-09-18T02:04:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb495f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d5f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb495f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d5f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33484/0 (socket says 172.21.15.167:33484) 2024-09-18T02:04:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 learned_addr learned my addr 172.21.15.167:0/2303416659 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f914d5fcb0 con 0x55f914d58540 2024-09-18T02:04:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb495f640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d5f770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efdac0e0f70 tx=0x7efdac0ac1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efc8a7fc640 1 -- 172.21.15.167:0/2303416659 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac101050 con 0x55f914d58540 2024-09-18T02:04:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f914d5fcb0 con 0x55f914d58540 2024-09-18T02:04:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efc8a7fc640 1 -- 172.21.15.167:0/2303416659 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdac102040 con 0x55f914d58540 2024-09-18T02:04:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f914d5fcb0 con 0x55f914d58540 2024-09-18T02:04:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efc8a7fc640 1 -- 172.21.15.167:0/2303416659 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac0a9980 con 0x55f914d58540 2024-09-18T02:04:43.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.291+0000 7efc8a7fc640 1 -- 172.21.15.167:0/2303416659 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdac10f020 con 0x55f914d58540 2024-09-18T02:04:43.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efc8a7fc640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc800346a0 0x7efc80036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efc8a7fc640 1 -- 172.21.15.167:0/2303416659 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7efdac10d020 con 0x55f914d58540 2024-09-18T02:04:43.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb415e640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc800346a0 0x7efc80036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f914d6a650 0x55f914d6cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6d260 con 0x55f914d6a650 2024-09-18T02:04:43.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb5160640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f914d6a650 0x55f914d6cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb415e640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc800346a0 0x7efc80036b60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efda800baa0 tx=0x7efda8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb5160640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f914d6a650 0x55f914d6cb10 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 20 realm 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6d670 con 0x55f914d6a650 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6df40 con 0x55f914d6a650 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6a650 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:43.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f914d6f040 0x55f914d71430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d71a40 con 0x55f914d6f040 2024-09-18T02:04:43.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb495f640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f914d6f040 0x55f914d71430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.295+0000 7efdb495f640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f914d6f040 0x55f914d71430 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb6e4f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:43.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb6e4f980 20 searching for the correct realm 2024-09-18T02:04:43.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f914d73990 0x55f914d75da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d76470 con 0x55f914d73990 2024-09-18T02:04:43.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb415e640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f914d73990 0x55f914d75da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb415e640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f914d73990 0x55f914d75da0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb415e640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efda803a3c0 0x7efda803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d76470 con 0x7efda803a3c0 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efda803a3c0 0x7efda803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efda803a3c0 0x7efda803a800 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x7efda803a3c0 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6a650 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6a650 2024-09-18T02:04:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6a650 2024-09-18T02:04:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6f040 2024-09-18T02:04:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x7efda803a3c0 2024-09-18T02:04:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.299+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d73990 2024-09-18T02:04:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6a650 2024-09-18T02:04:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x7efda803a3c0 2024-09-18T02:04:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6a650 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x7efda803a3c0 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d73990 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d73990 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6f040 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d73990 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d73990 2024-09-18T02:04:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6a650 2024-09-18T02:04:43.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6a650 2024-09-18T02:04:43.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.303+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6f040 2024-09-18T02:04:43.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d73990 2024-09-18T02:04:43.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x7efda803a3c0 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6a650 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6f040 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d73990 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6f040 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x7efda803a3c0 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d73990 2024-09-18T02:04:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.307+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6f040 2024-09-18T02:04:43.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x55f914d6a650 2024-09-18T02:04:43.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f914d6e2e0 con 0x7efda803a3c0 2024-09-18T02:04:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d72300 con 0x55f914d6a650 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d72300 con 0x55f914d6a650 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d72300 con 0x55f914d73990 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 zone default found 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 4 Realm: () 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 zonegroup default 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d72ca0 con 0x55f914d6f040 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d78360 con 0x55f914d73990 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d787c0 con 0x55f914d73990 2024-09-18T02:04:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 started sync module instance, tier type = 2024-09-18T02:04:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.311+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d77770 con 0x7efda803a3c0 2024-09-18T02:04:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.315+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.315+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94528284884080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d77770 con 0x7efda803a3c0 2024-09-18T02:04:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.315+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d79260 con 0x55f914d6a650 2024-09-18T02:04:43.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.315+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94528284884080] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.315+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.315+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94528284888432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d77770 con 0x55f914d6a650 2024-09-18T02:04:43.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.315+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d79c70 con 0x55f914d73990 2024-09-18T02:04:43.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.319+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.319+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94528284891072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7a4c0 con 0x55f914d73990 2024-09-18T02:04:43.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.319+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7aee0 con 0x7efda803a3c0 2024-09-18T02:04:43.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.319+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94528284888432] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.319+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.319+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94528284895696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7b2d0 con 0x7efda803a3c0 2024-09-18T02:04:43.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.319+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7bc90 con 0x55f914d6a650 2024-09-18T02:04:43.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.319+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94528284891072] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.319+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94528284895696] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.323+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.323+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94528284881600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7b7e0 con 0x55f914d6a650 2024-09-18T02:04:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.323+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7c030 con 0x55f914d6f040 2024-09-18T02:04:43.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.323+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94528284881600] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.323+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.323+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94528284899296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7bc00 con 0x55f914d6f040 2024-09-18T02:04:43.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.323+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7cd30 con 0x55f914d6f040 2024-09-18T02:04:43.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94528284899296] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94528284902352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7cca0 con 0x55f914d6f040 2024-09-18T02:04:43.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7d6e0 con 0x55f914d6f040 2024-09-18T02:04:43.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94528284902352] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94528284905904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7d8c0 con 0x55f914d6f040 2024-09-18T02:04:43.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb6e4f980 20 add_watcher() i=0 2024-09-18T02:04:43.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb6e4f980 20 add_watcher() i=1 2024-09-18T02:04:43.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb6e4f980 20 add_watcher() i=2 2024-09-18T02:04:43.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb6e4f980 20 add_watcher() i=3 2024-09-18T02:04:43.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb6e4f980 20 add_watcher() i=4 2024-09-18T02:04:43.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb6e4f980 20 add_watcher() i=5 2024-09-18T02:04:43.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.327+0000 7efdb6e4f980 20 add_watcher() i=6 2024-09-18T02:04:43.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94528284905904] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb6e4f980 20 add_watcher() i=7 2024-09-18T02:04:43.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb6e4f980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:43.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914d80c90 con 0x55f914d6a650 2024-09-18T02:04:43.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94528284907440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7e080 con 0x55f914d6a650 2024-09-18T02:04:43.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94528284907440] v32'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efc6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:43.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb6e4f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:43.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb6e4f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:43.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb6e4f980 5 note: GC not initialized 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efc69fe3640 20 reqs_thread_entry: start 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb6e4f980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efdb6e4f980 20 Filter name: none 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.331+0000 7efbdb7fe640 20 reqs_thread_entry: start 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914da41e0 con 0x55f914d6a650 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 20 rados_obj.operate() r=0 bl.length=403 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914daa3f0 con 0x55f914d6a650 2024-09-18T02:04:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:04:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94528285089376 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f914da8f40 con 0x55f914d6a650 2024-09-18T02:04:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== watch-notify(notify (1) cookie 94528284881600 notify 137438953489 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7efda4010040 con 0x55f914d6a650 2024-09-18T02:04:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efc8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94528284881600 notifier 4669 bl.length()=567 2024-09-18T02:04:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efc8bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T02:04:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(64 notify.4 [notify cookie 94528285089376 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efc8bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efc8bfff640 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efc78003eb0 con 0x55f914d6a650 2024-09-18T02:04:43.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.335+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== watch-notify(notify_complete (2) cookie 94528285089376 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efda400a8c0 con 0x55f914d6a650 2024-09-18T02:04:43.342 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T02:04:16.734302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:04:16.734280Z","tags":[],"group_ids":[]} 2024-09-18T02:04:43.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.339+0000 7efc6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:43.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.339+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94528284907440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914da2010 con 0x55f914d6a650 2024-09-18T02:04:43.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.339+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94528284907440] v32'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.339+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94528284884080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914da2010 con 0x7efda803a3c0 2024-09-18T02:04:43.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.339+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94528284884080] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.339+0000 7efdb6e4f980 20 remove_watcher() i=0 2024-09-18T02:04:43.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.339+0000 7efdb6e4f980 2 removed watcher, disabling cache 2024-09-18T02:04:43.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.339+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94528284888432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d77c70 con 0x55f914d6a650 2024-09-18T02:04:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.343+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94528284888432] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.343+0000 7efdb6e4f980 20 remove_watcher() i=1 2024-09-18T02:04:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.343+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94528284891072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914da2010 con 0x55f914d73990 2024-09-18T02:04:43.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.343+0000 7efdb415e640 1 -- 172.21.15.167:0/2303416659 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94528284891072] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda8037040 con 0x55f914d73990 2024-09-18T02:04:43.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.343+0000 7efdb6e4f980 20 remove_watcher() i=2 2024-09-18T02:04:43.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.343+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94528284895696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d78d70 con 0x7efda803a3c0 2024-09-18T02:04:43.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.347+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94528284895696] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x7efda803a3c0 2024-09-18T02:04:43.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.347+0000 7efdb6e4f980 20 remove_watcher() i=3 2024-09-18T02:04:43.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.347+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94528284881600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d77c70 con 0x55f914d6a650 2024-09-18T02:04:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.347+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94528284881600] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda40083f0 con 0x55f914d6a650 2024-09-18T02:04:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.347+0000 7efdb6e4f980 20 remove_watcher() i=4 2024-09-18T02:04:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.347+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94528284899296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d7a9d0 con 0x55f914d6f040 2024-09-18T02:04:43.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.351+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94528284899296] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.351+0000 7efdb6e4f980 20 remove_watcher() i=5 2024-09-18T02:04:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.351+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94528284902352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d78d70 con 0x55f914d6f040 2024-09-18T02:04:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.351+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94528284902352] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.351+0000 7efdb6e4f980 20 remove_watcher() i=6 2024-09-18T02:04:43.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.351+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94528284905904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f914d77c70 con 0x55f914d6f040 2024-09-18T02:04:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb495f640 1 -- 172.21.15.167:0/2303416659 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94528284905904] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdac104070 con 0x55f914d6f040 2024-09-18T02:04:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 20 remove_watcher() i=7 2024-09-18T02:04:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f914d6f040 msgr2=0x55f914d71430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f914d6f040 0x55f914d71430 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f914d6a650 msgr2=0x55f914d6cb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f914d6a650 0x55f914d6cb10 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efda803a3c0 msgr2=0x7efda803a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efda803a3c0 0x7efda803a800 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f914d73990 msgr2=0x55f914d75da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f914d73990 0x55f914d75da0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc800346a0 msgr2=0x7efc80036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc800346a0 0x7efc80036b60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efda800baa0 tx=0x7efda8010000 comp rx=0 tx=0).stop 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 msgr2=0x55f914d5f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb5160640 1 -- 172.21.15.167:0/2303416659 reap_dead start 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d5f770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efdac0e0f70 tx=0x7efdac0ac1d0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 shutdown_connections 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/2303416659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d58540 0x55f914d5f770 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 >> 172.21.15.167:0/2303416659 conn(0x55f914d54920 msgr2=0x55f914d529f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 shutdown_connections 2024-09-18T02:04:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/2303416659 wait complete. 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1262685312 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc8c034650 msgr2=0x7efc8c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/1262685312 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc8c034650 0x7efc8c036b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55f914d3e580 tx=0x7efda800f000 comp rx=0 tx=0).stop 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1262685312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d4bc10 msgr2=0x55f914d4c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/1262685312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d4bc10 0x55f914d4c030 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efdac0e35a0 tx=0x7efdac0bf9c0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1262685312 shutdown_connections 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/1262685312 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc8c034650 0x7efc8c036b10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/1262685312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914d4bc10 0x55f914d4c030 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1262685312 >> 172.21.15.167:0/1262685312 conn(0x55f914d40d60 msgr2=0x55f914d437e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1262685312 shutdown_connections 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/1262685312 wait complete. 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f914d37700 msgr2=0x55f914d39af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f914d37700 0x55f914d39af0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f914c39ff0 msgr2=0x55f914d34ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f914c39ff0 0x55f914d34ef0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f914d3b600 msgr2=0x55f914d3d9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f914d3b600 0x55f914d3d9f0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc9c034650 msgr2=0x7efc9c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efc9c034650 0x7efc9c036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efda8001e50 tx=0x7efda80013b0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 msgr2=0x55f914d2ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 --2- 172.21.15.167:0/3755794382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f914c396a0 0x55f914d2ddf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efdac005cc0 tx=0x7efdac017e30 comp rx=0 tx=0).stop 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb5160640 1 -- 172.21.15.167:0/3755794382 reap_dead start 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 shutdown_connections 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 >> 172.21.15.167:0/3755794382 conn(0x55f914c351c0 msgr2=0x55f914baefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 shutdown_connections 2024-09-18T02:04:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.355+0000 7efdb6e4f980 1 -- 172.21.15.167:0/3755794382 wait complete. 2024-09-18T02:04:43.371 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T02:04:16.734302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:04:16.734280Z', 'tags': [], 'group_ids': []} 2024-09-18T02:04:43.393 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:43.393 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-18T02:04:43.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-18T02:04:43.393 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-18T02:04:43.444 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:04:43.445 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:04:43.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.443+0000 7f57bfd80980 1 Processor -- start 2024-09-18T02:04:43.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.443+0000 7f57bfd80980 1 -- start start 2024-09-18T02:04:43.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.443+0000 7f57bfd80980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5585573263b0 0x558557324b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.443+0000 7f57bfd80980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558557237ae0 con 0x5585573267c0 2024-09-18T02:04:43.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.443+0000 7f57bfd80980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55855725be30 con 0x5585573263b0 2024-09-18T02:04:43.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.443+0000 7f57bd890640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5585573263b0 0x558557324b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.443+0000 7f57bd08f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5585573267c0 0x5585573250b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:42672/0 (socket says 172.21.15.167:42672) 2024-09-18T02:04:43.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.443+0000 7f57bd890640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5585573263b0 0x558557324b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33496/0 (socket says 172.21.15.167:33496) 2024-09-18T02:04:43.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.443+0000 7f57bd08f640 1 -- 172.21.15.167:0/4005695000 learned_addr learned my addr 172.21.15.167:0/4005695000 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:04:43.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.443+0000 7f57bd890640 1 -- 172.21.15.167:0/4005695000 >> v1:172.21.15.81:6789/0 conn(0x5585573267c0 legacy=0x5585573250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.443+0000 7f57bd890640 1 -- 172.21.15.167:0/4005695000 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585573258e0 con 0x5585573263b0 2024-09-18T02:04:43.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.447+0000 7f57bd890640 1 --2- 172.21.15.167:0/4005695000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x558557324b70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f57b000a420 tx=0x7f57b001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b5f0fd08ec8ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.447+0000 7f57bc88e640 1 -- 172.21.15.167:0/4005695000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00af070 con 0x5585573263b0 2024-09-18T02:04:43.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.447+0000 7f57bc88e640 1 -- 172.21.15.167:0/4005695000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b00aa530 con 0x5585573263b0 2024-09-18T02:04:43.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.447+0000 7f57bc88e640 1 -- 172.21.15.167:0/4005695000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00aa850 con 0x5585573263b0 2024-09-18T02:04:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.447+0000 7f57bfd80980 1 -- 172.21.15.167:0/4005695000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 msgr2=0x558557324b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.447+0000 7f57bfd80980 1 --2- 172.21.15.167:0/4005695000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x558557324b70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f57b000a420 tx=0x7f57b001afd0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.447+0000 7f57bfd80980 1 -- 172.21.15.167:0/4005695000 shutdown_connections 2024-09-18T02:04:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.447+0000 7f57bfd80980 1 --2- 172.21.15.167:0/4005695000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x558557324b70 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.447+0000 7f57bfd80980 1 -- 172.21.15.167:0/4005695000 >> 172.21.15.167:0/4005695000 conn(0x5585573ab1b0 msgr2=0x5585573ad5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.447+0000 7f57bfd80980 1 -- 172.21.15.167:0/4005695000 shutdown_connections 2024-09-18T02:04:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.447+0000 7f57bfd80980 1 -- 172.21.15.167:0/4005695000 wait complete. 2024-09-18T02:04:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f57bfd80980 1 Processor -- start 2024-09-18T02:04:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f57bfd80980 1 -- start start 2024-09-18T02:04:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f57bfd80980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x55855749cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f57bfd80980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55855725d200 con 0x5585573263b0 2024-09-18T02:04:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f57bd890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x55855749cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f57bd890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x55855749cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33504/0 (socket says 172.21.15.167:33504) 2024-09-18T02:04:43.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f57bd890640 1 -- 172.21.15.167:0/1003814332 learned_addr learned my addr 172.21.15.167:0/1003814332 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f57bd890640 1 -- 172.21.15.167:0/1003814332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55855749d1f0 con 0x5585573263b0 2024-09-18T02:04:43.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f57bd890640 1 --2- 172.21.15.167:0/1003814332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x55855749cc20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f57b00ad040 tx=0x7f57b00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe940062d2fe9ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f56abe07640 1 -- 172.21.15.167:0/1003814332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00af040 con 0x5585573263b0 2024-09-18T02:04:43.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f56abe07640 1 -- 172.21.15.167:0/1003814332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b00aab50 con 0x5585573263b0 2024-09-18T02:04:43.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.463+0000 7f56abe07640 1 -- 172.21.15.167:0/1003814332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00aae50 con 0x5585573263b0 2024-09-18T02:04:43.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 -- 172.21.15.167:0/1003814332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 msgr2=0x55855749cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 --2- 172.21.15.167:0/1003814332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x55855749cc20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f57b00ad040 tx=0x7f57b00033b0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 -- 172.21.15.167:0/1003814332 shutdown_connections 2024-09-18T02:04:43.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 --2- 172.21.15.167:0/1003814332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x55855749cc20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 -- 172.21.15.167:0/1003814332 >> 172.21.15.167:0/1003814332 conn(0x5585573ab1b0 msgr2=0x558557498850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 -- 172.21.15.167:0/1003814332 shutdown_connections 2024-09-18T02:04:43.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 -- 172.21.15.167:0/1003814332 wait complete. 2024-09-18T02:04:43.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 Processor -- start 2024-09-18T02:04:43.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 -- start start 2024-09-18T02:04:43.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x5585574a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585573bb200 con 0x5585573263b0 2024-09-18T02:04:43.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bd890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x5585574a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bd890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x5585574a3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33518/0 (socket says 172.21.15.167:33518) 2024-09-18T02:04:43.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bd890640 1 -- 172.21.15.167:0/2150951444 learned_addr learned my addr 172.21.15.167:0/2150951444 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bd890640 1 -- 172.21.15.167:0/2150951444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585574a4440 con 0x5585573263b0 2024-09-18T02:04:43.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bd890640 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x5585574a3f00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f57b0018c00 tx=0x7f57b0017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f56aa604640 1 -- 172.21.15.167:0/2150951444 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00c5070 con 0x5585573263b0 2024-09-18T02:04:43.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f56aa604640 1 -- 172.21.15.167:0/2150951444 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b00b58f0 con 0x5585573263b0 2024-09-18T02:04:43.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f56aa604640 1 -- 172.21.15.167:0/2150951444 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00b5bf0 con 0x5585573263b0 2024-09-18T02:04:43.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585574a46d0 con 0x5585573263b0 2024-09-18T02:04:43.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.467+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585574a73b0 con 0x5585573263b0 2024-09-18T02:04:43.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f56aa604640 1 -- 172.21.15.167:0/2150951444 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f57b00c8070 con 0x5585573263b0 2024-09-18T02:04:43.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f56aa604640 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f56a4034650 0x7f56a4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f56aa604640 1 -- 172.21.15.167:0/2150951444 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f57b00bb070 con 0x5585573263b0 2024-09-18T02:04:43.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57bd08f640 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f56a4034650 0x7f56a4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585573267c0 0x5585574ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574ab540 con 0x5585573267c0 2024-09-18T02:04:43.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57be091640 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585573267c0 0x5585574ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57bd08f640 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f56a4034650 0x7f56a4036b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f57a8001da0 tx=0x7f57a8001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57be091640 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585573267c0 0x5585574ab000 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57be091640 1 -- 172.21.15.167:0/2150951444 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57b80083f0 con 0x5585573267c0 2024-09-18T02:04:43.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574a85d0 con 0x5585573267c0 2024-09-18T02:04:43.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57be091640 1 -- 172.21.15.167:0/2150951444 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f57b80083f0 con 0x5585573267c0 2024-09-18T02:04:43.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585574ad800 0x5585574afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574b02c0 con 0x5585574ad800 2024-09-18T02:04:43.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57bd890640 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585574ad800 0x5585574afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57bd890640 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585574ad800 0x5585574afbf0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.471+0000 7f57bd890640 1 -- 172.21.15.167:0/2150951444 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f57b00d1070 con 0x5585574ad800 2024-09-18T02:04:43.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574ac670 con 0x5585573267c0 2024-09-18T02:04:43.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57be091640 1 -- 172.21.15.167:0/2150951444 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f57b80083f0 con 0x5585573267c0 2024-09-18T02:04:43.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585574b1700 0x5585574b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574b4260 con 0x5585574b1700 2024-09-18T02:04:43.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bd08f640 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585574b1700 0x5585574b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bd08f640 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585574b1700 0x5585574b3af0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bd08f640 1 -- 172.21.15.167:0/2150951444 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574b1700 2024-09-18T02:04:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bfd80980 1 Processor -- start 2024-09-18T02:04:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bfd80980 1 -- start start 2024-09-18T02:04:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bfd80980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574c1cd0 0x5585574c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bfd80980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585572b6800 con 0x5585574c1cd0 2024-09-18T02:04:43.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bd890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574c1cd0 0x5585574c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bd890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574c1cd0 0x5585574c20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33522/0 (socket says 172.21.15.167:33522) 2024-09-18T02:04:43.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bd890640 1 -- 172.21.15.167:0/3441720520 learned_addr learned my addr 172.21.15.167:0/3441720520 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bd890640 1 -- 172.21.15.167:0/3441720520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585574c2630 con 0x5585574c1cd0 2024-09-18T02:04:43.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bd890640 1 --2- 172.21.15.167:0/3441720520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574c1cd0 0x5585574c20f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f57b0019680 tx=0x7f57b00b5f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f56a37fe640 1 -- 172.21.15.167:0/3441720520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00bf590 con 0x5585574c1cd0 2024-09-18T02:04:43.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f56a37fe640 1 -- 172.21.15.167:0/3441720520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b00bf730 con 0x5585574c1cd0 2024-09-18T02:04:43.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bfd80980 1 -- 172.21.15.167:0/3441720520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585574c28c0 con 0x5585574c1cd0 2024-09-18T02:04:43.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f56a37fe640 1 -- 172.21.15.167:0/3441720520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00bf900 con 0x5585574c1cd0 2024-09-18T02:04:43.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.475+0000 7f57bfd80980 1 -- 172.21.15.167:0/3441720520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585574c28c0 con 0x5585574c1cd0 2024-09-18T02:04:43.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f56a37fe640 1 -- 172.21.15.167:0/3441720520 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f57b00de070 con 0x5585574c1cd0 2024-09-18T02:04:43.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f56a37fe640 1 --2- 172.21.15.167:0/3441720520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5698034650 0x7f5698036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f56a37fe640 1 -- 172.21.15.167:0/3441720520 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f57b00b8070 con 0x5585574c1cd0 2024-09-18T02:04:43.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bd08f640 1 --2- 172.21.15.167:0/3441720520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5698034650 0x7f5698036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bfd80980 1 Processor -- start 2024-09-18T02:04:43.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bfd80980 1 -- start start 2024-09-18T02:04:43.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bfd80980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bd08f640 1 --2- 172.21.15.167:0/3441720520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5698034650 0x7f5698036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5585574b4640 tx=0x7f57a800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bfd80980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55855749d510 con 0x5585574ce410 2024-09-18T02:04:43.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bd890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bd890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33530/0 (socket says 172.21.15.167:33530) 2024-09-18T02:04:43.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bd890640 1 -- 172.21.15.167:0/2904672283 learned_addr learned my addr 172.21.15.167:0/2904672283 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bd890640 1 -- 172.21.15.167:0/2904672283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585574cedc0 con 0x5585574ce410 2024-09-18T02:04:43.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bd890640 1 --2- 172.21.15.167:0/2904672283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574ce7f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f57b00c1790 tx=0x7f57b00ec4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e4e3f20cd17d9e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f56a17fa640 1 -- 172.21.15.167:0/2904672283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00c03e0 con 0x5585574ce410 2024-09-18T02:04:43.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f56a17fa640 1 -- 172.21.15.167:0/2904672283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b00dfc50 con 0x5585574ce410 2024-09-18T02:04:43.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f56a17fa640 1 -- 172.21.15.167:0/2904672283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00c0580 con 0x5585574ce410 2024-09-18T02:04:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bfd80980 1 -- 172.21.15.167:0/2904672283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 msgr2=0x5585574ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2904672283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574ce7f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f57b00c1790 tx=0x7f57b00ec4e0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bfd80980 1 -- 172.21.15.167:0/2904672283 shutdown_connections 2024-09-18T02:04:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2904672283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574ce7f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bfd80980 1 -- 172.21.15.167:0/2904672283 >> 172.21.15.167:0/2904672283 conn(0x5585574ca7f0 msgr2=0x5585574c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bfd80980 1 -- 172.21.15.167:0/2904672283 shutdown_connections 2024-09-18T02:04:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.479+0000 7f57bfd80980 1 -- 172.21.15.167:0/2904672283 wait complete. 2024-09-18T02:04:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bfd80980 1 Processor -- start 2024-09-18T02:04:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bfd80980 1 -- start start 2024-09-18T02:04:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bfd80980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574d5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bfd80980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585574cf260 con 0x5585574ce410 2024-09-18T02:04:43.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bd890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bd890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574d5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:33532/0 (socket says 172.21.15.167:33532) 2024-09-18T02:04:43.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 learned_addr learned my addr 172.21.15.167:0/2148303500 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:04:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585574d5b50 con 0x5585574ce410 2024-09-18T02:04:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bd890640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574d5610 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f57b00eed30 tx=0x7f57b00d8ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f568f7fe640 1 -- 172.21.15.167:0/2148303500 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00ca8b0 con 0x5585574ce410 2024-09-18T02:04:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585574d5b50 con 0x5585574ce410 2024-09-18T02:04:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f568f7fe640 1 -- 172.21.15.167:0/2148303500 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b00caa50 con 0x5585574ce410 2024-09-18T02:04:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f568f7fe640 1 -- 172.21.15.167:0/2148303500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b00cad70 con 0x5585574ce410 2024-09-18T02:04:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585574d5fc0 con 0x5585574ce410 2024-09-18T02:04:43.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f568f7fe640 1 -- 172.21.15.167:0/2148303500 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f57b00eb840 con 0x5585574ce410 2024-09-18T02:04:43.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f568f7fe640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5688034650 0x7f5688036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f568f7fe640 1 -- 172.21.15.167:0/2148303500 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f57b0107070 con 0x5585574ce410 2024-09-18T02:04:43.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bd08f640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5688034650 0x7f5688036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585574e05a0 0x5585574e2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.483+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574e31b0 con 0x5585574e05a0 2024-09-18T02:04:43.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57be091640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585574e05a0 0x5585574e2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bd08f640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5688034650 0x7f5688036b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f57a800bb60 tx=0x7f57a8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57be091640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585574e05a0 0x5585574e2a60 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57b80083f0 con 0x5585574e05a0 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 20 realm 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574e35c0 con 0x5585574e05a0 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57b80083f0 con 0x5585574e05a0 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574e3e90 con 0x5585574e05a0 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57b80083f0 con 0x5585574e05a0 2024-09-18T02:04:43.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e05a0 2024-09-18T02:04:43.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f57b80083f0 con 0x5585574e05a0 2024-09-18T02:04:43.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:43.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585574e4f90 0x5585574e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574e7940 con 0x5585574e4f90 2024-09-18T02:04:43.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bd890640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585574e4f90 0x5585574e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bd890640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585574e4f90 0x5585574e7380 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 20 searching for the correct realm 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585574e9890 0x5585574ebca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574ec370 con 0x5585574e9890 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.487+0000 7f57bd08f640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585574e9890 0x5585574ebca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57bd08f640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585574e9890 0x5585574ebca0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57bd08f640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f57a8037040 0x7f57a8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574ec370 con 0x7f57a8037040 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f57a8037040 0x7f57a8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f57a8037040 0x7f57a8036410 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:04:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b80083f0 con 0x7f57a8037040 2024-09-18T02:04:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x7f57a8037040 2024-09-18T02:04:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b80083f0 con 0x7f57a8037040 2024-09-18T02:04:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e05a0 2024-09-18T02:04:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e05a0 2024-09-18T02:04:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e05a0 2024-09-18T02:04:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e4f90 2024-09-18T02:04:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x7f57a8037040 2024-09-18T02:04:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e9890 2024-09-18T02:04:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.491+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e05a0 2024-09-18T02:04:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x7f57a8037040 2024-09-18T02:04:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e05a0 2024-09-18T02:04:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x7f57a8037040 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e9890 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e9890 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e4f90 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e9890 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e9890 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e05a0 2024-09-18T02:04:43.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e05a0 2024-09-18T02:04:43.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.495+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e4f90 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e9890 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x7f57a8037040 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e05a0 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e4f90 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e9890 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e4f90 2024-09-18T02:04:43.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x7f57a8037040 2024-09-18T02:04:43.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e9890 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e4f90 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.499+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x5585574e05a0 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585574e4230 con 0x7f57a8037040 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:04:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574e8200 con 0x5585574e05a0 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574e8200 con 0x5585574e05a0 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574e8200 con 0x5585574e9890 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 zone default found 2024-09-18T02:04:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 4 Realm: () 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 zonegroup default 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574e8c60 con 0x5585574e4f90 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574ee680 con 0x5585574e9890 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574eea20 con 0x5585574e9890 2024-09-18T02:04:43.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:04:43.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 started sync module instance, tier type = 2024-09-18T02:04:43.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:04:43.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.503+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574edac0 con 0x7f57a8037040 2024-09-18T02:04:43.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.507+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.507+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94031183797984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574edac0 con 0x7f57a8037040 2024-09-18T02:04:43.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.507+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574ef2f0 con 0x5585574e05a0 2024-09-18T02:04:43.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.507+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94031183797984] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.507+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.507+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94031183801792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574edac0 con 0x5585574e05a0 2024-09-18T02:04:43.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.507+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574efd00 con 0x5585574e9890 2024-09-18T02:04:43.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.511+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94031183801792] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.511+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.511+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94031183795728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574eda30 con 0x5585574e9890 2024-09-18T02:04:43.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.511+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f0a50 con 0x7f57a8037040 2024-09-18T02:04:43.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.511+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.511+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94031183808176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f1160 con 0x7f57a8037040 2024-09-18T02:04:43.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.511+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f1c80 con 0x5585574e05a0 2024-09-18T02:04:43.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.515+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94031183795728] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.515+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94031183808176] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.515+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.515+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94031183812432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f1c40 con 0x5585574e05a0 2024-09-18T02:04:43.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.515+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f2070 con 0x5585574e4f90 2024-09-18T02:04:43.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.515+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94031183812432] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.519+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.519+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94031183806704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f2460 con 0x5585574e4f90 2024-09-18T02:04:43.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.519+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f2e20 con 0x5585574e4f90 2024-09-18T02:04:43.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.519+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.519+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94031183817344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f3570 con 0x5585574e4f90 2024-09-18T02:04:43.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.519+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f4090 con 0x5585574e4f90 2024-09-18T02:04:43.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.519+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94031183806704] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94031183817344] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94031183821664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f2fc0 con 0x5585574e4f90 2024-09-18T02:04:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 20 add_watcher() i=0 2024-09-18T02:04:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 20 add_watcher() i=1 2024-09-18T02:04:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 20 add_watcher() i=2 2024-09-18T02:04:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 20 add_watcher() i=3 2024-09-18T02:04:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 20 add_watcher() i=4 2024-09-18T02:04:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 20 add_watcher() i=5 2024-09-18T02:04:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 20 add_watcher() i=6 2024-09-18T02:04:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94031183821664] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 20 add_watcher() i=7 2024-09-18T02:04:43.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 2 all 8 watchers are set, enabling cache 2024-09-18T02:04:43.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574f7080 con 0x5585574e05a0 2024-09-18T02:04:43.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.523+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94031183809456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f4500 con 0x5585574e05a0 2024-09-18T02:04:43.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.527+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94031183809456] v32'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.527+0000 7f566f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:43.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.527+0000 7f57bfd80980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:04:43.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.527+0000 7f57bfd80980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:04:43.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.527+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574ff8a0 con 0x5585574e05a0 2024-09-18T02:04:43.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.527+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'55 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.527+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574ffef0 con 0x5585574e4f90 2024-09-18T02:04:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.531+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.531+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574ffef0 con 0x5585574e9890 2024-09-18T02:04:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.531+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.531+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557500500 con 0x5585574e05a0 2024-09-18T02:04:43.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.531+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'198 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.531+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585575009b0 con 0x7f57a8037040 2024-09-18T02:04:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.535+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'71 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.535+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574fd6f0 con 0x5585574e9890 2024-09-18T02:04:43.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.535+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'55 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.535+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574fd6f0 con 0x5585574e05a0 2024-09-18T02:04:43.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.539+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.539+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574fd6f0 con 0x5585574e4f90 2024-09-18T02:04:43.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.539+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.543 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.539+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574fd6f0 con 0x7f57a8037040 2024-09-18T02:04:43.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.543+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.543+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574fd6f0 con 0x5585574e9890 2024-09-18T02:04:43.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.543+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.543+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501720 con 0x7f57a8037040 2024-09-18T02:04:43.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.543+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'72 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.543+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501720 con 0x5585574e4f90 2024-09-18T02:04:43.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.547+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.547+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501720 con 0x7f57a8037040 2024-09-18T02:04:43.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.547+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.547+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574fd6f0 con 0x5585574e4f90 2024-09-18T02:04:43.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.551+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'63 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.551+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574fd6f0 con 0x5585574e05a0 2024-09-18T02:04:43.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.551+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'199 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.551+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574fd6f0 con 0x5585574e9890 2024-09-18T02:04:43.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.555+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'67 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.555+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b40 con 0x7f57a8037040 2024-09-18T02:04:43.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.555+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'73 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.555+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e9890 2024-09-18T02:04:43.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.555+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.555+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e05a0 2024-09-18T02:04:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.559+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.559+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e05a0 2024-09-18T02:04:43.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.559+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'200 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.559+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e9890 2024-09-18T02:04:43.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.563+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'68 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.563+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x7f57a8037040 2024-09-18T02:04:43.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.563+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.563+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e9890 2024-09-18T02:04:43.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.563+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'34 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.563+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e9890 2024-09-18T02:04:43.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.567+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'43 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.567+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e9890 2024-09-18T02:04:43.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.567+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.567+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e9890 2024-09-18T02:04:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.567+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'56 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.567+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e4f90 2024-09-18T02:04:43.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.571+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.571+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e9890 2024-09-18T02:04:43.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.571+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.571+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e4f90 2024-09-18T02:04:43.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.575+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.575+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e9890 2024-09-18T02:04:43.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.575+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'69 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.575+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x5585574e4f90 2024-09-18T02:04:43.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.579+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'64 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.579+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558557501b00 con 0x7f57a8037040 2024-09-18T02:04:43.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.579+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f566e7fc640 20 reqs_thread_entry: start 2024-09-18T02:04:43.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57bfd80980 20 init_complete bucket index max shards: 11 2024-09-18T02:04:43.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57bfd80980 20 Filter name: none 2024-09-18T02:04:43.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f55dffff640 20 reqs_thread_entry: start 2024-09-18T02:04:43.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57bfd80980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:04:43.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57bfd80980 20 rados->read ofs=0 len=0 2024-09-18T02:04:43.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574fcbe0 con 0x5585574e05a0 2024-09-18T02:04:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57bfd80980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:04:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57bfd80980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:04:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57bfd80980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:04:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57bfd80980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:04:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585574fc650 con 0x7f57a8037040 2024-09-18T02:04:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-18T02:04:43.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f566f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:04:43.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.583+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94031183809456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f94e0 con 0x5585574e05a0 2024-09-18T02:04:43.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.587+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94031183809456] v32'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.587+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94031183797984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f0bb0 con 0x7f57a8037040 2024-09-18T02:04:43.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.587+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94031183797984] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.587+0000 7f57bfd80980 20 remove_watcher() i=0 2024-09-18T02:04:43.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.587+0000 7f57bfd80980 2 removed watcher, disabling cache 2024-09-18T02:04:43.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.587+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94031183801792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574edee0 con 0x5585574e05a0 2024-09-18T02:04:43.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.591+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94031183801792] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.591+0000 7f57bfd80980 20 remove_watcher() i=1 2024-09-18T02:04:43.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.591+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94031183795728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574edee0 con 0x5585574e9890 2024-09-18T02:04:43.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.591+0000 7f57bd08f640 1 -- 172.21.15.167:0/2148303500 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94031183795728] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57a800e6c0 con 0x5585574e9890 2024-09-18T02:04:43.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.591+0000 7f57bfd80980 20 remove_watcher() i=2 2024-09-18T02:04:43.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.591+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94031183808176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574ed610 con 0x7f57a8037040 2024-09-18T02:04:43.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.591+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94031183808176] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x7f57a8037040 2024-09-18T02:04:43.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.591+0000 7f57bfd80980 20 remove_watcher() i=3 2024-09-18T02:04:43.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.591+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94031183812432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574ed610 con 0x5585574e05a0 2024-09-18T02:04:43.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.595+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94031183812432] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b8026040 con 0x5585574e05a0 2024-09-18T02:04:43.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.595+0000 7f57bfd80980 20 remove_watcher() i=4 2024-09-18T02:04:43.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.595+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94031183806704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574ed610 con 0x5585574e4f90 2024-09-18T02:04:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.599+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94031183806704] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.599+0000 7f57bfd80980 20 remove_watcher() i=5 2024-09-18T02:04:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.599+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94031183817344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574f00f0 con 0x5585574e4f90 2024-09-18T02:04:43.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.599+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94031183817344] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.599+0000 7f57bfd80980 20 remove_watcher() i=6 2024-09-18T02:04:43.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.599+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94031183821664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585574ed610 con 0x5585574e4f90 2024-09-18T02:04:43.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bd890640 1 -- 172.21.15.167:0/2148303500 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94031183821664] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57b0113020 con 0x5585574e4f90 2024-09-18T02:04:43.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 20 remove_watcher() i=7 2024-09-18T02:04:43.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585574e4f90 msgr2=0x5585574e7380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585574e4f90 0x5585574e7380 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585574e05a0 msgr2=0x5585574e2a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585574e05a0 0x5585574e2a60 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f57a8037040 msgr2=0x7f57a8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f57a8037040 0x7f57a8036410 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585574e9890 msgr2=0x5585574ebca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585574e9890 0x5585574ebca0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5688034650 msgr2=0x7f5688036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5688034650 0x7f5688036b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f57a800bb60 tx=0x7f57a8010000 comp rx=0 tx=0).stop 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 msgr2=0x5585574d5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574d5610 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f57b00eed30 tx=0x7f57b00d8ec0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57be091640 1 -- 172.21.15.167:0/2148303500 reap_dead start 2024-09-18T02:04:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 shutdown_connections 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2148303500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574ce410 0x5585574d5610 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 >> 172.21.15.167:0/2148303500 conn(0x5585574ca7f0 msgr2=0x5585574c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 shutdown_connections 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2148303500 wait complete. 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/3441720520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5698034650 msgr2=0x7f5698036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/3441720520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5698034650 0x7f5698036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5585574b4640 tx=0x7f57a800f000 comp rx=0 tx=0).stop 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/3441720520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574c1cd0 msgr2=0x5585574c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/3441720520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574c1cd0 0x5585574c20f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f57b0019680 tx=0x7f57b00b5f40 comp rx=0 tx=0).stop 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/3441720520 shutdown_connections 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/3441720520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5698034650 0x7f5698036b10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/3441720520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585574c1cd0 0x5585574c20f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/3441720520 >> 172.21.15.167:0/3441720520 conn(0x5585574b6e20 msgr2=0x5585574b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/3441720520 shutdown_connections 2024-09-18T02:04:43.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/3441720520 wait complete. 2024-09-18T02:04:43.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585574ad800 msgr2=0x5585574afbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5585574ad800 0x5585574afbf0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585573267c0 msgr2=0x5585574ab000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5585573267c0 0x5585574ab000 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585574b1700 msgr2=0x5585574b3af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5585574b1700 0x5585574b3af0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f56a4034650 msgr2=0x7f56a4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f56a4034650 0x7f56a4036b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f57a8001da0 tx=0x7f57a8001300 comp rx=0 tx=0).stop 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 msgr2=0x5585574a3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 --2- 172.21.15.167:0/2150951444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585573263b0 0x5585574a3f00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f57b0018c00 tx=0x7f57b0017d70 comp rx=0 tx=0).stop 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57be091640 1 -- 172.21.15.167:0/2150951444 reap_dead start 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 shutdown_connections 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 >> 172.21.15.167:0/2150951444 conn(0x5585573ab1b0 msgr2=0x5585574973d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:04:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 shutdown_connections 2024-09-18T02:04:43.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:04:43.603+0000 7f57bfd80980 1 -- 172.21.15.167:0/2150951444 wait complete. 2024-09-18T02:04:43.619 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T02:04:43.641 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:04:43.646 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-18T02:05:18.647 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-18T02:05:18.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-18T02:05:18.648 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-18T02:05:18.688 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:18.688 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:18.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.687+0000 7f2a63dfd980 1 Processor -- start 2024-09-18T02:05:18.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.687+0000 7f2a63dfd980 1 -- start start 2024-09-18T02:05:18.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.687+0000 7f2a63dfd980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558bb9276c60 0x558bb9279050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.687+0000 7f2a63dfd980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558bb90f8ae0 con 0x558bb92728e0 2024-09-18T02:05:18.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.687+0000 7f2a63dfd980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x558bb911ce30 con 0x558bb9276c60 2024-09-18T02:05:18.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.687+0000 7f2a6110c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558bb9276c60 0x558bb9279050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.687+0000 7f2a6110c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558bb9276c60 0x558bb9279050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50754/0 (socket says 172.21.15.167:50754) 2024-09-18T02:05:18.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.687+0000 7f2a6110c640 1 -- 172.21.15.167:0/3640357692 learned_addr learned my addr 172.21.15.167:0/3640357692 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:18.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.687+0000 7f2a6190d640 1 --1- 172.21.15.167:0/3640357692 >> v1:172.21.15.81:6789/0 conn(0x558bb92728e0 0x558bb9272cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33648/0 (socket says 172.21.15.167:33648) 2024-09-18T02:05:18.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.687+0000 7f2a6110c640 1 -- 172.21.15.167:0/3640357692 >> v1:172.21.15.81:6789/0 conn(0x558bb92728e0 legacy=0x558bb9272cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.687+0000 7f2a6110c640 1 -- 172.21.15.167:0/3640357692 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb927a5a0 con 0x558bb9276c60 2024-09-18T02:05:18.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.691+0000 7f2a6110c640 1 --2- 172.21.15.167:0/3640357692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb9276c60 0x558bb9279050 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800a5c0 tx=0x7f2a5801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8086aa5813f07d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.691+0000 7f2a6090b640 1 -- 172.21.15.167:0/3640357692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a580a6070 con 0x558bb9276c60 2024-09-18T02:05:18.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.691+0000 7f2a6090b640 1 -- 172.21.15.167:0/3640357692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a580af070 con 0x558bb9276c60 2024-09-18T02:05:18.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.691+0000 7f2a6090b640 1 -- 172.21.15.167:0/3640357692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a580aa5c0 con 0x558bb9276c60 2024-09-18T02:05:18.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.691+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3640357692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb9276c60 msgr2=0x558bb9279050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.691+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3640357692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb9276c60 0x558bb9279050 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800a5c0 tx=0x7f2a5801b340 comp rx=0 tx=0).stop 2024-09-18T02:05:18.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.691+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3640357692 shutdown_connections 2024-09-18T02:05:18.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.691+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3640357692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb9276c60 0x558bb9279050 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.691+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3640357692 >> 172.21.15.167:0/3640357692 conn(0x558bb91e6230 msgr2=0x558bb91e6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:18.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.691+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3640357692 shutdown_connections 2024-09-18T02:05:18.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.691+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3640357692 wait complete. 2024-09-18T02:05:18.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 Processor -- start 2024-09-18T02:05:18.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 -- start start 2024-09-18T02:05:18.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 0x558bb935dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558bb911e200 con 0x558bb92728e0 2024-09-18T02:05:18.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a6190d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 0x558bb935dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a6190d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 0x558bb935dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50760/0 (socket says 172.21.15.167:50760) 2024-09-18T02:05:18.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a6190d640 1 -- 172.21.15.167:0/3081097235 learned_addr learned my addr 172.21.15.167:0/3081097235 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:18.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a6190d640 1 -- 172.21.15.167:0/3081097235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb935e250 con 0x558bb92728e0 2024-09-18T02:05:18.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a6190d640 1 --2- 172.21.15.167:0/3081097235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 0x558bb935dc80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2a54001e50 tx=0x7f2a54001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c80a68432665f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f294fe07640 1 -- 172.21.15.167:0/3081097235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a5400e5d0 con 0x558bb92728e0 2024-09-18T02:05:18.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f294fe07640 1 -- 172.21.15.167:0/3081097235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5400e770 con 0x558bb92728e0 2024-09-18T02:05:18.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f294fe07640 1 -- 172.21.15.167:0/3081097235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a5400eab0 con 0x558bb92728e0 2024-09-18T02:05:18.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3081097235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 msgr2=0x558bb935dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3081097235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 0x558bb935dc80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2a54001e50 tx=0x7f2a54001e80 comp rx=0 tx=0).stop 2024-09-18T02:05:18.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3081097235 shutdown_connections 2024-09-18T02:05:18.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3081097235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 0x558bb935dc80 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3081097235 >> 172.21.15.167:0/3081097235 conn(0x558bb91e6230 msgr2=0x558bb93598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:18.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3081097235 shutdown_connections 2024-09-18T02:05:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3081097235 wait complete. 2024-09-18T02:05:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.707+0000 7f2a63dfd980 1 Processor -- start 2024-09-18T02:05:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a63dfd980 1 -- start start 2024-09-18T02:05:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a63dfd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 0x558bb9364ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a63dfd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558bb927a0a0 con 0x558bb92728e0 2024-09-18T02:05:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a6190d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 0x558bb9364ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a6190d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 0x558bb9364ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50776/0 (socket says 172.21.15.167:50776) 2024-09-18T02:05:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a6190d640 1 -- 172.21.15.167:0/1930882317 learned_addr learned my addr 172.21.15.167:0/1930882317 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a6190d640 1 -- 172.21.15.167:0/1930882317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb9365530 con 0x558bb92728e0 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a6190d640 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 0x558bb9364ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x558bb935ee60 tx=0x7f2a54000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f294e604640 1 -- 172.21.15.167:0/1930882317 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a54001260 con 0x558bb92728e0 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bb93657c0 con 0x558bb92728e0 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f294e604640 1 -- 172.21.15.167:0/1930882317 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5400fa40 con 0x558bb92728e0 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f294e604640 1 -- 172.21.15.167:0/1930882317 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a5400fd80 con 0x558bb92728e0 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bb93684a0 con 0x558bb92728e0 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f294e604640 1 -- 172.21.15.167:0/1930882317 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2a54017070 con 0x558bb92728e0 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f294e604640 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2948034650 0x7f2948036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f294e604640 1 -- 172.21.15.167:0/1930882317 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2a54015020 con 0x558bb92728e0 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a6110c640 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2948034650 0x7f2948036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558bb9276c60 0x558bb936bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb936c650 con 0x558bb9276c60 2024-09-18T02:05:18.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a6210e640 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558bb9276c60 0x558bb936bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a6110c640 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2948034650 0x7f2948036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2a580ae000 tx=0x7f2a580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.711+0000 7f2a6210e640 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558bb9276c60 0x558bb936bfe0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a6210e640 1 -- 172.21.15.167:0/1930882317 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb9276c60 2024-09-18T02:05:18.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93696a0 con 0x558bb9276c60 2024-09-18T02:05:18.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a6210e640 1 -- 172.21.15.167:0/1930882317 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb9276c60 2024-09-18T02:05:18.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558bb936e980 0x558bb9370d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb9371460 con 0x558bb936e980 2024-09-18T02:05:18.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a6190d640 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558bb936e980 0x558bb9370d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a6190d640 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558bb936e980 0x558bb9370d70 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a6190d640 1 -- 172.21.15.167:0/1930882317 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2a5402e070 con 0x558bb936e980 2024-09-18T02:05:18.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb936d820 con 0x558bb9276c60 2024-09-18T02:05:18.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a6210e640 1 -- 172.21.15.167:0/1930882317 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb9276c60 2024-09-18T02:05:18.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558bb93728c0 0x558bb9374cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93753f0 con 0x558bb93728c0 2024-09-18T02:05:18.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a6110c640 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558bb93728c0 0x558bb9374cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a6110c640 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558bb93728c0 0x558bb9374cb0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a6110c640 1 -- 172.21.15.167:0/1930882317 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93728c0 2024-09-18T02:05:18.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.715+0000 7f2a63dfd980 1 Processor -- start 2024-09-18T02:05:18.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a63dfd980 1 -- start start 2024-09-18T02:05:18.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a63dfd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb9382ec0 0x558bb93832e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a63dfd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558bb9177800 con 0x558bb9382ec0 2024-09-18T02:05:18.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a6190d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb9382ec0 0x558bb93832e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a6190d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb9382ec0 0x558bb93832e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50780/0 (socket says 172.21.15.167:50780) 2024-09-18T02:05:18.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a6190d640 1 -- 172.21.15.167:0/2031130279 learned_addr learned my addr 172.21.15.167:0/2031130279 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:18.722 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a6190d640 1 -- 172.21.15.167:0/2031130279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb9383820 con 0x558bb9382ec0 2024-09-18T02:05:18.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a6190d640 1 --2- 172.21.15.167:0/2031130279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb9382ec0 0x558bb93832e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2a54048f40 tx=0x7f2a54017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f29477fe640 1 -- 172.21.15.167:0/2031130279 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a5403f020 con 0x558bb9382ec0 2024-09-18T02:05:18.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f29477fe640 1 -- 172.21.15.167:0/2031130279 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a54042850 con 0x558bb9382ec0 2024-09-18T02:05:18.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a63dfd980 1 -- 172.21.15.167:0/2031130279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bb9383ab0 con 0x558bb9382ec0 2024-09-18T02:05:18.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f29477fe640 1 -- 172.21.15.167:0/2031130279 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a54019860 con 0x558bb9382ec0 2024-09-18T02:05:18.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a63dfd980 1 -- 172.21.15.167:0/2031130279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bb9383ab0 con 0x558bb9382ec0 2024-09-18T02:05:18.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f29477fe640 1 -- 172.21.15.167:0/2031130279 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2a5403a070 con 0x558bb9382ec0 2024-09-18T02:05:18.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f29477fe640 1 --2- 172.21.15.167:0/2031130279 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f293c034650 0x7f293c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f29477fe640 1 -- 172.21.15.167:0/2031130279 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2a5404f950 con 0x558bb9382ec0 2024-09-18T02:05:18.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a6110c640 1 --2- 172.21.15.167:0/2031130279 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f293c034650 0x7f293c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a63dfd980 1 Processor -- start 2024-09-18T02:05:18.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a63dfd980 1 -- start start 2024-09-18T02:05:18.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a63dfd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb938fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a63dfd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558bb935e5d0 con 0x558bb938f630 2024-09-18T02:05:18.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a6110c640 1 --2- 172.21.15.167:0/2031130279 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f293c034650 0x7f293c036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x558bb936cb20 tx=0x7f2a58005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a6190d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb938fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a6190d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb938fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50792/0 (socket says 172.21.15.167:50792) 2024-09-18T02:05:18.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.719+0000 7f2a6190d640 1 -- 172.21.15.167:0/1325140788 learned_addr learned my addr 172.21.15.167:0/1325140788 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:18.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a6190d640 1 -- 172.21.15.167:0/1325140788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb9390000 con 0x558bb938f630 2024-09-18T02:05:18.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a6190d640 1 --2- 172.21.15.167:0/1325140788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb938fa30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2a54019fd0 tx=0x7f2a54042410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b747fd9b5198aaa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f29457fa640 1 -- 172.21.15.167:0/1325140788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a5403be30 con 0x558bb938f630 2024-09-18T02:05:18.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f29457fa640 1 -- 172.21.15.167:0/1325140788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5405f070 con 0x558bb938f630 2024-09-18T02:05:18.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f29457fa640 1 -- 172.21.15.167:0/1325140788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a5404a1e0 con 0x558bb938f630 2024-09-18T02:05:18.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1325140788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 msgr2=0x558bb938fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/1325140788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb938fa30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2a54019fd0 tx=0x7f2a54042410 comp rx=0 tx=0).stop 2024-09-18T02:05:18.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1325140788 shutdown_connections 2024-09-18T02:05:18.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/1325140788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb938fa30 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1325140788 >> 172.21.15.167:0/1325140788 conn(0x558bb938ba10 msgr2=0x558bb9389b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:18.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1325140788 shutdown_connections 2024-09-18T02:05:18.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1325140788 wait complete. 2024-09-18T02:05:18.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 Processor -- start 2024-09-18T02:05:18.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 -- start start 2024-09-18T02:05:18.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb93968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558bb9390480 con 0x558bb938f630 2024-09-18T02:05:18.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a6190d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb93968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a6190d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb93968c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50798/0 (socket says 172.21.15.167:50798) 2024-09-18T02:05:18.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 learned_addr learned my addr 172.21.15.167:0/3348591827 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:18.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb9396e00 con 0x558bb938f630 2024-09-18T02:05:18.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a6190d640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb93968c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2a54047d00 tx=0x7f2a54048010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f29337fe640 1 -- 172.21.15.167:0/3348591827 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a54047e70 con 0x558bb938f630 2024-09-18T02:05:18.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f29337fe640 1 -- 172.21.15.167:0/3348591827 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5406a070 con 0x558bb938f630 2024-09-18T02:05:18.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bb9396e00 con 0x558bb938f630 2024-09-18T02:05:18.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f29337fe640 1 -- 172.21.15.167:0/3348591827 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a5404fba0 con 0x558bb938f630 2024-09-18T02:05:18.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.723+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bb9396e00 con 0x558bb938f630 2024-09-18T02:05:18.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f29337fe640 1 -- 172.21.15.167:0/3348591827 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2a54058040 con 0x558bb938f630 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f29337fe640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f292c034650 0x7f292c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f29337fe640 1 -- 172.21.15.167:0/3348591827 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2a54055040 con 0x558bb938f630 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a6110c640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f292c034650 0x7f292c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558bb93a18c0 0x558bb93a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a44d0 con 0x558bb93a18c0 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a6210e640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558bb93a18c0 0x558bb93a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a6110c640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f292c034650 0x7f292c036b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2a58000c10 tx=0x7f2a580c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a6210e640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558bb93a18c0 0x558bb93a3d80 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 20 realm 2024-09-18T02:05:18.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a48e0 con 0x558bb93a18c0 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5180 con 0x558bb93a18c0 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a18c0 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558bb93a6280 0x558bb93a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a8bf0 con 0x558bb93a6280 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.727+0000 7f2a6190d640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558bb93a6280 0x558bb93a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6190d640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558bb93a6280 0x558bb93a8670 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a63dfd980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a63dfd980 20 searching for the correct realm 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558bb93aab60 0x558bb93ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93ad6f0 con 0x558bb93aab60 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6110c640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558bb93aab60 0x558bb93ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6110c640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558bb93aab60 0x558bb93ad020 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6110c640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2a580e0040 0x7f2a580e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93ad6f0 con 0x7f2a580e0040 2024-09-18T02:05:18.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6210e640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2a580e0040 0x7f2a580e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6210e640 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2a580e0040 0x7f2a580e0420 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x7f2a580e0040 2024-09-18T02:05:18.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a18c0 2024-09-18T02:05:18.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a18c0 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.731+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a18c0 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a6280 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x7f2a580e0040 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93aab60 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a18c0 2024-09-18T02:05:18.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x7f2a580e0040 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a18c0 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x7f2a580e0040 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93aab60 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93aab60 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.735+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a6280 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.743 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93aab60 2024-09-18T02:05:18.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93aab60 2024-09-18T02:05:18.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a18c0 2024-09-18T02:05:18.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a18c0 2024-09-18T02:05:18.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a6280 2024-09-18T02:05:18.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93aab60 2024-09-18T02:05:18.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x7f2a580e0040 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a18c0 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a6280 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.739+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93aab60 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a6280 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x7f2a580e0040 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93aab60 2024-09-18T02:05:18.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a6280 2024-09-18T02:05:18.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x558bb93a18c0 2024-09-18T02:05:18.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a5520 con 0x7f2a580e0040 2024-09-18T02:05:18.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:18.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:18.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:18.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:18.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:18.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:18.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a9440 con 0x558bb93a18c0 2024-09-18T02:05:18.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a9440 con 0x558bb93a18c0 2024-09-18T02:05:18.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:18.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.743+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a9440 con 0x558bb93aab60 2024-09-18T02:05:18.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 20 zone default found 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 4 Realm: () 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 20 zonegroup default 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93a9ce0 con 0x558bb93a6280 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93af550 con 0x558bb93aab60 2024-09-18T02:05:18.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93af8f0 con 0x558bb93aab60 2024-09-18T02:05:18.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 20 started sync module instance, tier type = 2024-09-18T02:05:18.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:18.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93ae9f0 con 0x7f2a580e0040 2024-09-18T02:05:18.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94058596462400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93ae9f0 con 0x7f2a580e0040 2024-09-18T02:05:18.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.747+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b02b0 con 0x558bb93a18c0 2024-09-18T02:05:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.751+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94058596462400] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.751+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.751+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94058596466448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93ae9f0 con 0x558bb93a18c0 2024-09-18T02:05:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.751+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b0cc0 con 0x558bb93aab60 2024-09-18T02:05:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.751+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94058596466448] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.755+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.755+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94058596459840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93ae960 con 0x558bb93aab60 2024-09-18T02:05:18.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.755+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b19c0 con 0x7f2a580e0040 2024-09-18T02:05:18.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.755+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.755+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94058596472352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b2260 con 0x7f2a580e0040 2024-09-18T02:05:18.758 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.755+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b2c20 con 0x558bb93a18c0 2024-09-18T02:05:18.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.755+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94058596459840] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.755+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94058596472352] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.755+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.755+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94058596476784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b2b90 con 0x558bb93a18c0 2024-09-18T02:05:18.760 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.755+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b21b0 con 0x558bb93a6280 2024-09-18T02:05:18.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.759+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.759+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94058596478992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b38e0 con 0x558bb93a6280 2024-09-18T02:05:18.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.759+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b41d0 con 0x558bb93a6280 2024-09-18T02:05:18.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.759+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94058596476784] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.759+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94058596478992] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94058596482176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b4570 con 0x558bb93a6280 2024-09-18T02:05:18.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b4e00 con 0x558bb93a6280 2024-09-18T02:05:18.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94058596484464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b4990 con 0x558bb93a6280 2024-09-18T02:05:18.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a63dfd980 20 add_watcher() i=0 2024-09-18T02:05:18.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a63dfd980 20 add_watcher() i=1 2024-09-18T02:05:18.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a63dfd980 20 add_watcher() i=2 2024-09-18T02:05:18.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a63dfd980 20 add_watcher() i=3 2024-09-18T02:05:18.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a63dfd980 20 add_watcher() i=4 2024-09-18T02:05:18.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a63dfd980 20 add_watcher() i=5 2024-09-18T02:05:18.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94058596482176] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.763+0000 7f2a63dfd980 20 add_watcher() i=6 2024-09-18T02:05:18.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94058596484464] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a63dfd980 20 add_watcher() i=7 2024-09-18T02:05:18.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a63dfd980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:18.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b1d00 con 0x558bb93a18c0 2024-09-18T02:05:18.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94058596474112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b5790 con 0x558bb93a18c0 2024-09-18T02:05:18.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94058596474112] v32'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f29137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:18.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a63dfd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:18.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a63dfd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:18.771 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a63dfd980 5 note: GC not initialized 2024-09-18T02:05:18.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f29127fc640 20 reqs_thread_entry: start 2024-09-18T02:05:18.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a63dfd980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:18.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a63dfd980 20 Filter name: none 2024-09-18T02:05:18.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2883fff640 20 reqs_thread_entry: start 2024-09-18T02:05:18.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dbed0 con 0x558bb93a18c0 2024-09-18T02:05:18.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dbed0 con 0x7f2a580e0040 2024-09-18T02:05:18.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.767+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.773 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dbe90 con 0x558bb93a18c0 2024-09-18T02:05:18.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dbe90 con 0x558bb93aab60 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dbe90 con 0x558bb93aab60 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dbe90 con 0x558bb93aab60 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dbe90 con 0x558bb93a18c0 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dbe90 con 0x558bb93a18c0 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dbe90 con 0x558bb93aab60 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.775 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dbe90 con 0x558bb93aab60 2024-09-18T02:05:18.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dbe90 con 0x558bb93a6280 2024-09-18T02:05:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dda30 con 0x558bb93a18c0 2024-09-18T02:05:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.771+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dda30 con 0x7f2a580e0040 2024-09-18T02:05:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dda30 con 0x558bb93aab60 2024-09-18T02:05:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dda30 con 0x558bb93a6280 2024-09-18T02:05:18.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dda30 con 0x558bb93a6280 2024-09-18T02:05:18.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93aab60 2024-09-18T02:05:18.778 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93a6280 2024-09-18T02:05:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93a18c0 2024-09-18T02:05:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93aab60 2024-09-18T02:05:18.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.775+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93a6280 2024-09-18T02:05:18.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x7f2a580e0040 2024-09-18T02:05:18.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93a6280 2024-09-18T02:05:18.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93a18c0 2024-09-18T02:05:18.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93a18c0 2024-09-18T02:05:18.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.783 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93aab60 2024-09-18T02:05:18.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93a18c0 2024-09-18T02:05:18.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93a18c0 2024-09-18T02:05:18.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93aab60 2024-09-18T02:05:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93aab60 2024-09-18T02:05:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93aab60 2024-09-18T02:05:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.779+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb93dd9e0 con 0x558bb93a6280 2024-09-18T02:05:18.785 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.783+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.783+0000 7f29137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:18.786 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.783+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94058596474112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93d9ae0 con 0x558bb93a18c0 2024-09-18T02:05:18.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.783+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94058596474112] v32'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.787 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.783+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94058596462400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93d9300 con 0x7f2a580e0040 2024-09-18T02:05:18.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.787+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94058596462400] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.787+0000 7f2a63dfd980 20 remove_watcher() i=0 2024-09-18T02:05:18.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.787+0000 7f2a63dfd980 2 removed watcher, disabling cache 2024-09-18T02:05:18.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.787+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94058596466448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93d9300 con 0x558bb93a18c0 2024-09-18T02:05:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.787+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94058596466448] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.787+0000 7f2a63dfd980 20 remove_watcher() i=1 2024-09-18T02:05:18.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.787+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94058596459840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93d9300 con 0x558bb93aab60 2024-09-18T02:05:18.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.791+0000 7f2a6110c640 1 -- 172.21.15.167:0/3348591827 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94058596459840] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a580aaae0 con 0x558bb93aab60 2024-09-18T02:05:18.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.791+0000 7f2a63dfd980 20 remove_watcher() i=2 2024-09-18T02:05:18.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.791+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94058596472352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93ae540 con 0x7f2a580e0040 2024-09-18T02:05:18.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.791+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94058596472352] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x7f2a580e0040 2024-09-18T02:05:18.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.791+0000 7f2a63dfd980 20 remove_watcher() i=3 2024-09-18T02:05:18.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.791+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94058596476784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93d9300 con 0x558bb93a18c0 2024-09-18T02:05:18.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.795+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94058596476784] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5c00a4d0 con 0x558bb93a18c0 2024-09-18T02:05:18.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.795+0000 7f2a63dfd980 20 remove_watcher() i=4 2024-09-18T02:05:18.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.795+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94058596478992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b1620 con 0x558bb93a6280 2024-09-18T02:05:18.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.795+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94058596478992] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.795+0000 7f2a63dfd980 20 remove_watcher() i=5 2024-09-18T02:05:18.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.795+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94058596482176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93ae540 con 0x558bb93a6280 2024-09-18T02:05:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94058596482176] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 20 remove_watcher() i=6 2024-09-18T02:05:18.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94058596484464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb93b2770 con 0x558bb93a6280 2024-09-18T02:05:18.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a6190d640 1 -- 172.21.15.167:0/3348591827 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94058596484464] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a54041020 con 0x558bb93a6280 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 20 remove_watcher() i=7 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558bb93a6280 msgr2=0x558bb93a8670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558bb93a6280 0x558bb93a8670 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558bb93a18c0 msgr2=0x558bb93a3d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558bb93a18c0 0x558bb93a3d80 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2a580e0040 msgr2=0x7f2a580e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2a580e0040 0x7f2a580e0420 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558bb93aab60 msgr2=0x558bb93ad020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558bb93aab60 0x558bb93ad020 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f292c034650 msgr2=0x7f292c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f292c034650 0x7f292c036b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2a58000c10 tx=0x7f2a580c1040 comp rx=0 tx=0).stop 2024-09-18T02:05:18.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a6210e640 1 -- 172.21.15.167:0/3348591827 reap_dead start 2024-09-18T02:05:18.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 msgr2=0x558bb93968c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.799+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb93968c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2a54047d00 tx=0x7f2a54048010 comp rx=0 tx=0).stop 2024-09-18T02:05:18.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 shutdown_connections 2024-09-18T02:05:18.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/3348591827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb938f630 0x558bb93968c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 >> 172.21.15.167:0/3348591827 conn(0x558bb938ba10 msgr2=0x558bb9389ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:18.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 shutdown_connections 2024-09-18T02:05:18.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/3348591827 wait complete. 2024-09-18T02:05:18.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/2031130279 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f293c034650 msgr2=0x7f293c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/2031130279 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f293c034650 0x7f293c036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x558bb936cb20 tx=0x7f2a58005ad0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/2031130279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb9382ec0 msgr2=0x558bb93832e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/2031130279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb9382ec0 0x558bb93832e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2a54048f40 tx=0x7f2a54017d50 comp rx=0 tx=0).stop 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/2031130279 shutdown_connections 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/2031130279 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f293c034650 0x7f293c036b10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/2031130279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb9382ec0 0x558bb93832e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/2031130279 >> 172.21.15.167:0/2031130279 conn(0x558bb9378010 msgr2=0x558bb937aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/2031130279 shutdown_connections 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/2031130279 wait complete. 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558bb936e980 msgr2=0x558bb9370d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558bb936e980 0x558bb9370d70 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558bb9276c60 msgr2=0x558bb936bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558bb9276c60 0x558bb936bfe0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558bb93728c0 msgr2=0x558bb9374cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558bb93728c0 0x558bb9374cb0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2948034650 msgr2=0x7f2948036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2948034650 0x7f2948036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2a580ae000 tx=0x7f2a580a6000 comp rx=0 tx=0).stop 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 msgr2=0x558bb9364ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 --2- 172.21.15.167:0/1930882317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558bb92728e0 0x558bb9364ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x558bb935ee60 tx=0x7f2a54000bd0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a6210e640 1 -- 172.21.15.167:0/1930882317 reap_dead start 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 shutdown_connections 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 >> 172.21.15.167:0/1930882317 conn(0x558bb91e6230 msgr2=0x558bb9358430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 shutdown_connections 2024-09-18T02:05:18.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.803+0000 7f2a63dfd980 1 -- 172.21.15.167:0/1930882317 wait complete. 2024-09-18T02:05:18.817 INFO:teuthology.orchestra.run.smithi167.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-18T02:05:18.817 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-18T02:05:18.818 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-18T02:05:18.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-18T02:05:18.818 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-18T02:05:18.890 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:18.891 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:18.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.887+0000 7f0741340980 1 Processor -- start 2024-09-18T02:05:18.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.887+0000 7f0741340980 1 -- start start 2024-09-18T02:05:18.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.887+0000 7f0741340980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55edea9098d0 0x55edea909cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.887+0000 7f0741340980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55edea78fae0 con 0x55edea90a220 2024-09-18T02:05:18.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.887+0000 7f0741340980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55edea7b3e30 con 0x55edea9098d0 2024-09-18T02:05:18.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.887+0000 7f073ee50640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55edea9098d0 0x55edea909cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.887+0000 7f073e64f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55edea90a220 0x55edea90ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33664/0 (socket says 172.21.15.167:33664) 2024-09-18T02:05:18.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.887+0000 7f073e64f640 1 -- 172.21.15.167:0/3795826609 learned_addr learned my addr 172.21.15.167:0/3795826609 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:05:18.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.891+0000 7f073de4e640 1 -- 172.21.15.167:0/3795826609 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835055806 0 0) 0x55edea78fae0 con 0x55edea90a220 2024-09-18T02:05:18.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.891+0000 7f073de4e640 1 -- 172.21.15.167:0/3795826609 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f072c001e20 con 0x55edea90a220 2024-09-18T02:05:18.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.891+0000 7f073ee50640 1 -- 172.21.15.167:0/3795826609 >> v1:172.21.15.81:6789/0 conn(0x55edea90a220 legacy=0x55edea90ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.891+0000 7f073ee50640 1 -- 172.21.15.167:0/3795826609 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edea9114a0 con 0x55edea9098d0 2024-09-18T02:05:18.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.895+0000 7f073ee50640 1 --2- 172.21.15.167:0/3795826609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea909cb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f072800a480 tx=0x7f072801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31734c424b8518c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.895+0000 7f073de4e640 1 -- 172.21.15.167:0/3795826609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280b0070 con 0x55edea9098d0 2024-09-18T02:05:18.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.895+0000 7f073de4e640 1 -- 172.21.15.167:0/3795826609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07280ab540 con 0x55edea9098d0 2024-09-18T02:05:18.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.895+0000 7f073de4e640 1 -- 172.21.15.167:0/3795826609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280ab840 con 0x55edea9098d0 2024-09-18T02:05:18.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.895+0000 7f0741340980 1 -- 172.21.15.167:0/3795826609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 msgr2=0x55edea909cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.895+0000 7f0741340980 1 --2- 172.21.15.167:0/3795826609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea909cb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f072800a480 tx=0x7f072801b280 comp rx=0 tx=0).stop 2024-09-18T02:05:18.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.895+0000 7f0741340980 1 -- 172.21.15.167:0/3795826609 shutdown_connections 2024-09-18T02:05:18.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.895+0000 7f0741340980 1 --2- 172.21.15.167:0/3795826609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea909cb0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.895+0000 7f0741340980 1 -- 172.21.15.167:0/3795826609 >> 172.21.15.167:0/3795826609 conn(0x55edea87d220 msgr2=0x55edea87d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:18.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.895+0000 7f0741340980 1 -- 172.21.15.167:0/3795826609 shutdown_connections 2024-09-18T02:05:18.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.895+0000 7f0741340980 1 -- 172.21.15.167:0/3795826609 wait complete. 2024-09-18T02:05:18.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f0741340980 1 Processor -- start 2024-09-18T02:05:18.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f0741340980 1 -- start start 2024-09-18T02:05:18.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f0741340980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea9f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f0741340980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55edea7b5200 con 0x55edea9098d0 2024-09-18T02:05:18.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f073ee50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea9f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f073ee50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea9f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50826/0 (socket says 172.21.15.167:50826) 2024-09-18T02:05:18.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f073ee50640 1 -- 172.21.15.167:0/3263420340 learned_addr learned my addr 172.21.15.167:0/3263420340 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:18.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f073ee50640 1 -- 172.21.15.167:0/3263420340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edea9f4f90 con 0x55edea9098d0 2024-09-18T02:05:18.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f073ee50640 1 --2- 172.21.15.167:0/3263420340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea9f49c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f07280ae040 tx=0x7f0728003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fa36f8b277d00e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f062ce09640 1 -- 172.21.15.167:0/3263420340 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280b0040 con 0x55edea9098d0 2024-09-18T02:05:18.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f062ce09640 1 -- 172.21.15.167:0/3263420340 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07280ab9d0 con 0x55edea9098d0 2024-09-18T02:05:18.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.911+0000 7f062ce09640 1 -- 172.21.15.167:0/3263420340 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280abcb0 con 0x55edea9098d0 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 -- 172.21.15.167:0/3263420340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 msgr2=0x55edea9f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 --2- 172.21.15.167:0/3263420340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea9f49c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f07280ae040 tx=0x7f0728003030 comp rx=0 tx=0).stop 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 -- 172.21.15.167:0/3263420340 shutdown_connections 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 --2- 172.21.15.167:0/3263420340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea9f49c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 -- 172.21.15.167:0/3263420340 >> 172.21.15.167:0/3263420340 conn(0x55edea87d220 msgr2=0x55edea9f05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 -- 172.21.15.167:0/3263420340 shutdown_connections 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 -- 172.21.15.167:0/3263420340 wait complete. 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 Processor -- start 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 -- start start 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea9fbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55edea910ee0 con 0x55edea9098d0 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f073ee50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea9fbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f073ee50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea9fbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50832/0 (socket says 172.21.15.167:50832) 2024-09-18T02:05:18.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f073ee50640 1 -- 172.21.15.167:0/802814711 learned_addr learned my addr 172.21.15.167:0/802814711 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:18.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f073ee50640 1 -- 172.21.15.167:0/802814711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edea9fc170 con 0x55edea9098d0 2024-09-18T02:05:18.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f073ee50640 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea9fbc30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f07280ab510 tx=0x7f0728018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f062b606640 1 -- 172.21.15.167:0/802814711 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280c3030 con 0x55edea9098d0 2024-09-18T02:05:18.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edea9fc400 con 0x55edea9098d0 2024-09-18T02:05:18.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f062b606640 1 -- 172.21.15.167:0/802814711 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07280b6870 con 0x55edea9098d0 2024-09-18T02:05:18.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f062b606640 1 -- 172.21.15.167:0/802814711 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280b0070 con 0x55edea9098d0 2024-09-18T02:05:18.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edea9ff0e0 con 0x55edea9098d0 2024-09-18T02:05:18.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f062b606640 1 -- 172.21.15.167:0/802814711 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07280c6070 con 0x55edea9098d0 2024-09-18T02:05:18.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.915+0000 7f062b606640 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0624034650 0x7f0624036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f062b606640 1 -- 172.21.15.167:0/802814711 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f07280c4070 con 0x55edea9098d0 2024-09-18T02:05:18.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f073e64f640 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0624034650 0x7f0624036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f0741340980 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55edea90a220 0x55edeaa02d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa03270 con 0x55edea90a220 2024-09-18T02:05:18.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f073f651640 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55edea90a220 0x55edeaa02d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f073e64f640 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0624034650 0x7f0624036b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f07300012f0 tx=0x7f0730001430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f073f651640 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55edea90a220 0x55edeaa02d30 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f073f651640 1 -- 172.21.15.167:0/802814711 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07380083f0 con 0x55edea90a220 2024-09-18T02:05:18.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa002e0 con 0x55edea90a220 2024-09-18T02:05:18.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f073f651640 1 -- 172.21.15.167:0/802814711 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07380083f0 con 0x55edea90a220 2024-09-18T02:05:18.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f0741340980 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55edeaa055a0 0x55edeaa07990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa08080 con 0x55edeaa055a0 2024-09-18T02:05:18.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f073ee50640 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55edeaa055a0 0x55edeaa07990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f073ee50640 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55edeaa055a0 0x55edeaa07990 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f073ee50640 1 -- 172.21.15.167:0/802814711 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f07280b3040 con 0x55edeaa055a0 2024-09-18T02:05:18.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa04440 con 0x55edea90a220 2024-09-18T02:05:18.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f073f651640 1 -- 172.21.15.167:0/802814711 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07380083f0 con 0x55edea90a220 2024-09-18T02:05:18.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f0741340980 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55edeaa094e0 0x55edeaa0b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa0bfc0 con 0x55edeaa094e0 2024-09-18T02:05:18.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.919+0000 7f073e64f640 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55edeaa094e0 0x55edeaa0b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f073e64f640 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55edeaa094e0 0x55edeaa0b8d0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f073e64f640 1 -- 172.21.15.167:0/802814711 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f073000f070 con 0x55edeaa094e0 2024-09-18T02:05:18.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f0741340980 1 Processor -- start 2024-09-18T02:05:18.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f0741340980 1 -- start start 2024-09-18T02:05:18.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f0741340980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa19a90 0x55edeaa19eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f0741340980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55edea80e800 con 0x55edeaa19a90 2024-09-18T02:05:18.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f073ee50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa19a90 0x55edeaa19eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f073ee50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa19a90 0x55edeaa19eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50842/0 (socket says 172.21.15.167:50842) 2024-09-18T02:05:18.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f073ee50640 1 -- 172.21.15.167:0/589651116 learned_addr learned my addr 172.21.15.167:0/589651116 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:18.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f073ee50640 1 -- 172.21.15.167:0/589651116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edeaa1a3f0 con 0x55edeaa19a90 2024-09-18T02:05:18.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f073ee50640 1 --2- 172.21.15.167:0/589651116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa19a90 0x55edeaa19eb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f07280e2830 tx=0x7f07280b7be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f0628e01640 1 -- 172.21.15.167:0/589651116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280e12a0 con 0x55edeaa19a90 2024-09-18T02:05:18.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f0741340980 1 -- 172.21.15.167:0/589651116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edeaa1a680 con 0x55edeaa19a90 2024-09-18T02:05:18.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f0628e01640 1 -- 172.21.15.167:0/589651116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07280b58d0 con 0x55edeaa19a90 2024-09-18T02:05:18.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f0628e01640 1 -- 172.21.15.167:0/589651116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280e1440 con 0x55edeaa19a90 2024-09-18T02:05:18.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f0741340980 1 -- 172.21.15.167:0/589651116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edeaa1a680 con 0x55edeaa19a90 2024-09-18T02:05:18.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.923+0000 7f0628e01640 1 -- 172.21.15.167:0/589651116 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07280c73b0 con 0x55edeaa19a90 2024-09-18T02:05:18.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0628e01640 1 --2- 172.21.15.167:0/589651116 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0618034650 0x7f0618036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0628e01640 1 -- 172.21.15.167:0/589651116 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f07280bc070 con 0x55edeaa19a90 2024-09-18T02:05:18.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f073e64f640 1 --2- 172.21.15.167:0/589651116 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0618034650 0x7f0618036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 Processor -- start 2024-09-18T02:05:18.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 -- start start 2024-09-18T02:05:18.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa26670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55edea9f5250 con 0x55edeaa26290 2024-09-18T02:05:18.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f073e64f640 1 --2- 172.21.15.167:0/589651116 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0618034650 0x7f0618036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0730006300 tx=0x7f073000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f073ee50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa26670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f073ee50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa26670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50846/0 (socket says 172.21.15.167:50846) 2024-09-18T02:05:18.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f073ee50640 1 -- 172.21.15.167:0/4244781192 learned_addr learned my addr 172.21.15.167:0/4244781192 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:18.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f073ee50640 1 -- 172.21.15.167:0/4244781192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edeaa26c40 con 0x55edeaa26290 2024-09-18T02:05:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f073ee50640 1 --2- 172.21.15.167:0/4244781192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa26670 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f07280c4fc0 tx=0x7f07280e5ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a6b577b30df66b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f06227fc640 1 -- 172.21.15.167:0/4244781192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280f5070 con 0x55edeaa26290 2024-09-18T02:05:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f06227fc640 1 -- 172.21.15.167:0/4244781192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07280c7c80 con 0x55edeaa26290 2024-09-18T02:05:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f06227fc640 1 -- 172.21.15.167:0/4244781192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280e9040 con 0x55edeaa26290 2024-09-18T02:05:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 -- 172.21.15.167:0/4244781192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 msgr2=0x55edeaa26670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 --2- 172.21.15.167:0/4244781192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa26670 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f07280c4fc0 tx=0x7f07280e5ec0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 -- 172.21.15.167:0/4244781192 shutdown_connections 2024-09-18T02:05:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 --2- 172.21.15.167:0/4244781192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa26670 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 -- 172.21.15.167:0/4244781192 >> 172.21.15.167:0/4244781192 conn(0x55edeaa22670 msgr2=0x55edeaa20770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 -- 172.21.15.167:0/4244781192 shutdown_connections 2024-09-18T02:05:18.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 -- 172.21.15.167:0/4244781192 wait complete. 2024-09-18T02:05:18.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 Processor -- start 2024-09-18T02:05:18.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 -- start start 2024-09-18T02:05:18.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa2d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f0741340980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55edeaa26c40 con 0x55edeaa26290 2024-09-18T02:05:18.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f073ee50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa2d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f073ee50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa2d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50854/0 (socket says 172.21.15.167:50854) 2024-09-18T02:05:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.927+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 learned_addr learned my addr 172.21.15.167:0/2445752050 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edeaa2d890 con 0x55edeaa26290 2024-09-18T02:05:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f073ee50640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa2d350 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f07280c0760 tx=0x7f07280c06f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0620ff9640 1 -- 172.21.15.167:0/2445752050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280e9040 con 0x55edeaa26290 2024-09-18T02:05:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0620ff9640 1 -- 172.21.15.167:0/2445752050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0728006bc0 con 0x55edeaa26290 2024-09-18T02:05:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edeaa2d890 con 0x55edeaa26290 2024-09-18T02:05:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0620ff9640 1 -- 172.21.15.167:0/2445752050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07280c0040 con 0x55edeaa26290 2024-09-18T02:05:18.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edeaa2d890 con 0x55edeaa26290 2024-09-18T02:05:18.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0741340980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0620ff9640 1 -- 172.21.15.167:0/2445752050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07280f8070 con 0x55edeaa26290 2024-09-18T02:05:18.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0620ff9640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f06080346a0 0x7f0608036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0620ff9640 1 -- 172.21.15.167:0/2445752050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f07280a8070 con 0x55edeaa26290 2024-09-18T02:05:18.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f073e64f640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f06080346a0 0x7f0608036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0741340980 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55edeaa381a0 0x55edeaa3a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3adb0 con 0x55edeaa381a0 2024-09-18T02:05:18.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f073f651640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55edeaa381a0 0x55edeaa3a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f073e64f640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f06080346a0 0x7f0608036b60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55edeaa08450 tx=0x7f0730010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f073f651640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55edeaa381a0 0x55edeaa3a660 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07380083f0 con 0x55edeaa381a0 2024-09-18T02:05:18.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.931+0000 7f0741340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 20 realm 2024-09-18T02:05:18.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3b210 con 0x55edeaa381a0 2024-09-18T02:05:18.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07380083f0 con 0x55edeaa381a0 2024-09-18T02:05:18.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3bab0 con 0x55edeaa381a0 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07380083f0 con 0x55edeaa381a0 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa381a0 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07380083f0 con 0x55edeaa381a0 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55edeaa3cbb0 0x55edeaa3efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3f520 con 0x55edeaa3cbb0 2024-09-18T02:05:18.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f073ee50640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55edeaa3cbb0 0x55edeaa3efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f073ee50640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55edeaa3cbb0 0x55edeaa3efa0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 20 searching for the correct realm 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55edeaa41450 0x55edeaa438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa43fb0 con 0x55edeaa41450 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f073e64f640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55edeaa41450 0x55edeaa438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f073e64f640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55edeaa41450 0x55edeaa438e0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f073000f070 con 0x55edeaa41450 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f073e64f640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0730024070 0x7f0730031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.935+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa43fb0 con 0x7f0730024070 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0730024070 0x7f0730031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0730024070 0x7f0730031460 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07380083f0 con 0x7f0730024070 2024-09-18T02:05:18.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x7f0730024070 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07380083f0 con 0x7f0730024070 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa381a0 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa381a0 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa381a0 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa3cbb0 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x7f0730024070 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa41450 2024-09-18T02:05:18.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f073000f070 con 0x55edeaa41450 2024-09-18T02:05:18.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa381a0 2024-09-18T02:05:18.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x7f0730024070 2024-09-18T02:05:18.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.939+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa381a0 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x7f0730024070 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa41450 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa41450 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa3cbb0 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa41450 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa41450 2024-09-18T02:05:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa381a0 2024-09-18T02:05:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa381a0 2024-09-18T02:05:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa3cbb0 2024-09-18T02:05:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.943+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa41450 2024-09-18T02:05:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x7f0730024070 2024-09-18T02:05:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa381a0 2024-09-18T02:05:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa3cbb0 2024-09-18T02:05:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa41450 2024-09-18T02:05:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa3cbb0 2024-09-18T02:05:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x7f0730024070 2024-09-18T02:05:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa41450 2024-09-18T02:05:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.947+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa3cbb0 2024-09-18T02:05:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x55edeaa381a0 2024-09-18T02:05:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3be50 con 0x7f0730024070 2024-09-18T02:05:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3fd70 con 0x55edeaa381a0 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3fd70 con 0x55edeaa381a0 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa3fd70 con 0x55edeaa41450 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 zone default found 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 4 Realm: () 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 zonegroup default 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa40610 con 0x55edeaa3cbb0 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa45e10 con 0x55edeaa41450 2024-09-18T02:05:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados->read ofs=0 len=0 2024-09-18T02:05:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa461b0 con 0x55edeaa41450 2024-09-18T02:05:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 started sync module instance, tier type = 2024-09-18T02:05:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:18.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.951+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa452b0 con 0x7f0730024070 2024-09-18T02:05:18.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.955+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.955+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94480332249040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa452b0 con 0x7f0730024070 2024-09-18T02:05:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.955+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa46bd0 con 0x55edeaa381a0 2024-09-18T02:05:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.955+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94480332249040] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.955+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.955+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94480332252864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa452b0 con 0x55edeaa381a0 2024-09-18T02:05:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.955+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa475e0 con 0x55edeaa41450 2024-09-18T02:05:18.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.959+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.959+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94480332255536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa47e80 con 0x55edeaa41450 2024-09-18T02:05:18.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.959+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa48880 con 0x7f0730024070 2024-09-18T02:05:18.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.959+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94480332252864] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.959+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.959+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94480332246528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa48c70 con 0x7f0730024070 2024-09-18T02:05:18.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.959+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa49540 con 0x55edeaa381a0 2024-09-18T02:05:18.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.959+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94480332255536] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.963+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94480332246528] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.963+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.963+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94480332260240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa48c20 con 0x55edeaa381a0 2024-09-18T02:05:18.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.963+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa49de0 con 0x55edeaa3cbb0 2024-09-18T02:05:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.963+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94480332260240] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.963+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.963+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94480332265776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa48c20 con 0x55edeaa3cbb0 2024-09-18T02:05:18.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.963+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa4a630 con 0x55edeaa3cbb0 2024-09-18T02:05:18.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.967+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94480332265776] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.967+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.967+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94480332257744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa4ae80 con 0x55edeaa3cbb0 2024-09-18T02:05:18.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.967+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa4b840 con 0x55edeaa3cbb0 2024-09-18T02:05:18.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94480332257744] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94480332270304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa4b840 con 0x55edeaa3cbb0 2024-09-18T02:05:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 20 add_watcher() i=0 2024-09-18T02:05:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 20 add_watcher() i=1 2024-09-18T02:05:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 20 add_watcher() i=2 2024-09-18T02:05:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 20 add_watcher() i=3 2024-09-18T02:05:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 20 add_watcher() i=4 2024-09-18T02:05:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 20 add_watcher() i=5 2024-09-18T02:05:18.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 20 add_watcher() i=6 2024-09-18T02:05:18.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94480332270304] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 20 add_watcher() i=7 2024-09-18T02:05:18.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:18.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa4eb30 con 0x55edeaa381a0 2024-09-18T02:05:18.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.971+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94480332272896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa4bdd0 con 0x55edeaa381a0 2024-09-18T02:05:18.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94480332272896] v32'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f05f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:18.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 5 note: GC not initialized 2024-09-18T02:05:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f056ffff640 20 reqs_thread_entry: start 2024-09-18T02:05:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 20 Filter name: none 2024-09-18T02:05:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f056dffb640 20 reqs_thread_entry: start 2024-09-18T02:05:18.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa727a0 con 0x55edeaa381a0 2024-09-18T02:05:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa727a0 con 0x7f0730024070 2024-09-18T02:05:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa72760 con 0x55edeaa381a0 2024-09-18T02:05:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa72760 con 0x55edeaa41450 2024-09-18T02:05:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa72c70 con 0x55edeaa41450 2024-09-18T02:05:18.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa72c70 con 0x55edeaa41450 2024-09-18T02:05:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa72c70 con 0x55edeaa381a0 2024-09-18T02:05:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa72c70 con 0x55edeaa381a0 2024-09-18T02:05:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa72bf0 con 0x55edeaa41450 2024-09-18T02:05:18.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.975+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa72bf0 con 0x55edeaa41450 2024-09-18T02:05:18.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa72ba0 con 0x55edeaa3cbb0 2024-09-18T02:05:18.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa746f0 con 0x55edeaa381a0 2024-09-18T02:05:18.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa746f0 con 0x7f0730024070 2024-09-18T02:05:18.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa746f0 con 0x55edeaa41450 2024-09-18T02:05:18.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa746f0 con 0x55edeaa3cbb0 2024-09-18T02:05:18.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa746f0 con 0x55edeaa3cbb0 2024-09-18T02:05:18.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.979+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74670 con 0x55edeaa41450 2024-09-18T02:05:18.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74670 con 0x55edeaa3cbb0 2024-09-18T02:05:18.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74670 con 0x55edeaa381a0 2024-09-18T02:05:18.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74670 con 0x55edeaa41450 2024-09-18T02:05:18.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74670 con 0x55edeaa3cbb0 2024-09-18T02:05:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74650 con 0x7f0730024070 2024-09-18T02:05:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74650 con 0x55edeaa3cbb0 2024-09-18T02:05:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74650 con 0x55edeaa381a0 2024-09-18T02:05:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.983+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74650 con 0x55edeaa381a0 2024-09-18T02:05:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74650 con 0x55edeaa41450 2024-09-18T02:05:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74650 con 0x55edeaa381a0 2024-09-18T02:05:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74650 con 0x55edeaa381a0 2024-09-18T02:05:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74650 con 0x55edeaa41450 2024-09-18T02:05:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74650 con 0x55edeaa41450 2024-09-18T02:05:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74650 con 0x55edeaa41450 2024-09-18T02:05:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa74650 con 0x55edeaa3cbb0 2024-09-18T02:05:18.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.987+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:18.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.991+0000 7f05f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:18.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.991+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94480332272896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa70590 con 0x55edeaa381a0 2024-09-18T02:05:18.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.991+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94480332272896] v32'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.991+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94480332249040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa72ba0 con 0x7f0730024070 2024-09-18T02:05:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.991+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94480332249040] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.991+0000 7f0741340980 20 remove_watcher() i=0 2024-09-18T02:05:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.991+0000 7f0741340980 2 removed watcher, disabling cache 2024-09-18T02:05:18.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.991+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94480332252864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa6fc00 con 0x55edeaa381a0 2024-09-18T02:05:18.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.995+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94480332252864] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:18.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.995+0000 7f0741340980 20 remove_watcher() i=1 2024-09-18T02:05:18.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.995+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94480332255536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa6fc00 con 0x55edeaa41450 2024-09-18T02:05:19.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.995+0000 7f073e64f640 1 -- 172.21.15.167:0/2445752050 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94480332255536] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0730040040 con 0x55edeaa41450 2024-09-18T02:05:19.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.995+0000 7f0741340980 20 remove_watcher() i=2 2024-09-18T02:05:19.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.995+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94480332246528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa6fc00 con 0x7f0730024070 2024-09-18T02:05:19.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.999+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94480332246528] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x7f0730024070 2024-09-18T02:05:19.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.999+0000 7f0741340980 20 remove_watcher() i=3 2024-09-18T02:05:19.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.999+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94480332260240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa6fc00 con 0x55edeaa381a0 2024-09-18T02:05:19.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.999+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94480332260240] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0738026040 con 0x55edeaa381a0 2024-09-18T02:05:19.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.999+0000 7f0741340980 20 remove_watcher() i=4 2024-09-18T02:05:19.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:18.999+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94480332265776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa6fc00 con 0x55edeaa3cbb0 2024-09-18T02:05:19.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.003+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94480332265776] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:19.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.003+0000 7f0741340980 20 remove_watcher() i=5 2024-09-18T02:05:19.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.003+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94480332257744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa6fc00 con 0x55edeaa3cbb0 2024-09-18T02:05:19.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.003+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94480332257744] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:19.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.003+0000 7f0741340980 20 remove_watcher() i=6 2024-09-18T02:05:19.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.003+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94480332270304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edeaa6fc00 con 0x55edeaa3cbb0 2024-09-18T02:05:19.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f073ee50640 1 -- 172.21.15.167:0/2445752050 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94480332270304] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07280f7030 con 0x55edeaa3cbb0 2024-09-18T02:05:19.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 20 remove_watcher() i=7 2024-09-18T02:05:19.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55edeaa3cbb0 msgr2=0x55edeaa3efa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55edeaa3cbb0 0x55edeaa3efa0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55edeaa381a0 msgr2=0x55edeaa3a660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55edeaa381a0 0x55edeaa3a660 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0730024070 msgr2=0x7f0730031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f0730024070 0x7f0730031460 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55edeaa41450 msgr2=0x55edeaa438e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55edeaa41450 0x55edeaa438e0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f06080346a0 msgr2=0x7f0608036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f06080346a0 0x7f0608036b60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55edeaa08450 tx=0x7f0730010000 comp rx=0 tx=0).stop 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 msgr2=0x55edeaa2d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa2d350 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f07280c0760 tx=0x7f07280c06f0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f073f651640 1 -- 172.21.15.167:0/2445752050 reap_dead start 2024-09-18T02:05:19.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 shutdown_connections 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/2445752050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa26290 0x55edeaa2d350 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 >> 172.21.15.167:0/2445752050 conn(0x55edeaa22670 msgr2=0x55edeaa20740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 shutdown_connections 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/2445752050 wait complete. 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/589651116 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0618034650 msgr2=0x7f0618036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/589651116 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0618034650 0x7f0618036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0730006300 tx=0x7f073000f000 comp rx=0 tx=0).stop 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/589651116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa19a90 msgr2=0x55edeaa19eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/589651116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa19a90 0x55edeaa19eb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f07280e2830 tx=0x7f07280b7be0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/589651116 shutdown_connections 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/589651116 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0618034650 0x7f0618036b10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/589651116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edeaa19a90 0x55edeaa19eb0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/589651116 >> 172.21.15.167:0/589651116 conn(0x55edeaa0ebe0 msgr2=0x55edeaa11660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/589651116 shutdown_connections 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/589651116 wait complete. 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55edeaa055a0 msgr2=0x55edeaa07990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55edeaa055a0 0x55edeaa07990 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55edea90a220 msgr2=0x55edeaa02d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55edea90a220 0x55edeaa02d30 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55edeaa094e0 msgr2=0x55edeaa0b8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55edeaa094e0 0x55edeaa0b8d0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0624034650 msgr2=0x7f0624036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0624034650 0x7f0624036b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f07300012f0 tx=0x7f0730001430 comp rx=0 tx=0).stop 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 msgr2=0x55edea9fbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 --2- 172.21.15.167:0/802814711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edea9098d0 0x55edea9fbc30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f07280ab510 tx=0x7f0728018020 comp rx=0 tx=0).stop 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f073f651640 1 -- 172.21.15.167:0/802814711 reap_dead start 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 shutdown_connections 2024-09-18T02:05:19.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 >> 172.21.15.167:0/802814711 conn(0x55edea87d220 msgr2=0x55edea9ef170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 shutdown_connections 2024-09-18T02:05:19.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.007+0000 7f0741340980 1 -- 172.21.15.167:0/802814711 wait complete. 2024-09-18T02:05:19.023 INFO:teuthology.orchestra.run.smithi167.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-18T02:05:19.023 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-18T02:05:19.024 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-18T02:05:19.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-18T02:05:19.024 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-18T02:05:19.097 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:19.098 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:19.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.095+0000 7f3441da0980 1 Processor -- start 2024-09-18T02:05:19.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.095+0000 7f3441da0980 1 -- start start 2024-09-18T02:05:19.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.095+0000 7f3441da0980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a5e9a948e0 0x55a5e9a94cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.095+0000 7f3441da0980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a5e991aae0 con 0x55a5e9a95230 2024-09-18T02:05:19.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.095+0000 7f3441da0980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55a5e993ee30 con 0x55a5e9a948e0 2024-09-18T02:05:19.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.095+0000 7f343f8b0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55a5e9a948e0 0x55a5e9a94cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.095+0000 7f343f0af640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55a5e9a95230 0x55a5e9a99c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33668/0 (socket says 172.21.15.167:33668) 2024-09-18T02:05:19.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.095+0000 7f343f0af640 1 -- 172.21.15.167:0/1546544637 learned_addr learned my addr 172.21.15.167:0/1546544637 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:05:19.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.095+0000 7f343f8b0640 1 -- 172.21.15.167:0/1546544637 >> v1:172.21.15.81:6789/0 conn(0x55a5e9a95230 legacy=0x55a5e9a99c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.095+0000 7f343f8b0640 1 -- 172.21.15.167:0/1546544637 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5e9a9c4b0 con 0x55a5e9a948e0 2024-09-18T02:05:19.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.099+0000 7f343f8b0640 1 --2- 172.21.15.167:0/1546544637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9a94cc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f343000a480 tx=0x7f343001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952698325d0c3aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.099+0000 7f343e8ae640 1 -- 172.21.15.167:0/1546544637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300b0070 con 0x55a5e9a948e0 2024-09-18T02:05:19.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.099+0000 7f343e8ae640 1 -- 172.21.15.167:0/1546544637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34300ab540 con 0x55a5e9a948e0 2024-09-18T02:05:19.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.099+0000 7f343e8ae640 1 -- 172.21.15.167:0/1546544637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300ab840 con 0x55a5e9a948e0 2024-09-18T02:05:19.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.099+0000 7f3441da0980 1 -- 172.21.15.167:0/1546544637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 msgr2=0x55a5e9a94cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.099+0000 7f3441da0980 1 --2- 172.21.15.167:0/1546544637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9a94cc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f343000a480 tx=0x7f343001b280 comp rx=0 tx=0).stop 2024-09-18T02:05:19.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.099+0000 7f3441da0980 1 -- 172.21.15.167:0/1546544637 shutdown_connections 2024-09-18T02:05:19.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.099+0000 7f3441da0980 1 --2- 172.21.15.167:0/1546544637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9a94cc0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.099+0000 7f3441da0980 1 -- 172.21.15.167:0/1546544637 >> 172.21.15.167:0/1546544637 conn(0x55a5e9a08230 msgr2=0x55a5e9a08640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.099+0000 7f3441da0980 1 -- 172.21.15.167:0/1546544637 shutdown_connections 2024-09-18T02:05:19.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.099+0000 7f3441da0980 1 -- 172.21.15.167:0/1546544637 wait complete. 2024-09-18T02:05:19.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.115+0000 7f3441da0980 1 Processor -- start 2024-09-18T02:05:19.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.115+0000 7f3441da0980 1 -- start start 2024-09-18T02:05:19.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.115+0000 7f3441da0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9b7fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.115+0000 7f3441da0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a5e9940200 con 0x55a5e9a948e0 2024-09-18T02:05:19.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.115+0000 7f343f8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9b7fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.115+0000 7f343f8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9b7fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50862/0 (socket says 172.21.15.167:50862) 2024-09-18T02:05:19.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.115+0000 7f343f8b0640 1 -- 172.21.15.167:0/897062255 learned_addr learned my addr 172.21.15.167:0/897062255 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f343f8b0640 1 -- 172.21.15.167:0/897062255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5e9b80220 con 0x55a5e9a948e0 2024-09-18T02:05:19.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f343f8b0640 1 --2- 172.21.15.167:0/897062255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9b7fc50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f34300ae040 tx=0x7f3430003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb15434135c0472 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f332de0b640 1 -- 172.21.15.167:0/897062255 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300b0040 con 0x55a5e9a948e0 2024-09-18T02:05:19.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f332de0b640 1 -- 172.21.15.167:0/897062255 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34300ab9d0 con 0x55a5e9a948e0 2024-09-18T02:05:19.121 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f332de0b640 1 -- 172.21.15.167:0/897062255 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300abcf0 con 0x55a5e9a948e0 2024-09-18T02:05:19.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 -- 172.21.15.167:0/897062255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 msgr2=0x55a5e9b7fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 --2- 172.21.15.167:0/897062255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9b7fc50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f34300ae040 tx=0x7f3430003030 comp rx=0 tx=0).stop 2024-09-18T02:05:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 -- 172.21.15.167:0/897062255 shutdown_connections 2024-09-18T02:05:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 --2- 172.21.15.167:0/897062255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9b7fc50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 -- 172.21.15.167:0/897062255 >> 172.21.15.167:0/897062255 conn(0x55a5e9a08230 msgr2=0x55a5e9b7b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 -- 172.21.15.167:0/897062255 shutdown_connections 2024-09-18T02:05:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 -- 172.21.15.167:0/897062255 wait complete. 2024-09-18T02:05:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 Processor -- start 2024-09-18T02:05:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 -- start start 2024-09-18T02:05:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9b86f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a5e9a9bef0 con 0x55a5e9a948e0 2024-09-18T02:05:19.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f343f8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9b86f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f343f8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9b86f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50864/0 (socket says 172.21.15.167:50864) 2024-09-18T02:05:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f343f8b0640 1 -- 172.21.15.167:0/3551315670 learned_addr learned my addr 172.21.15.167:0/3551315670 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f343f8b0640 1 -- 172.21.15.167:0/3551315670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5e9b87460 con 0x55a5e9a948e0 2024-09-18T02:05:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f343f8b0640 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9b86f20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f343001b2c0 tx=0x7f3430018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3327fff640 1 -- 172.21.15.167:0/3551315670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300c5070 con 0x55a5e9a948e0 2024-09-18T02:05:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3327fff640 1 -- 172.21.15.167:0/3551315670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34300b6830 con 0x55a5e9a948e0 2024-09-18T02:05:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5e9b876f0 con 0x55a5e9a948e0 2024-09-18T02:05:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3327fff640 1 -- 172.21.15.167:0/3551315670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300b0050 con 0x55a5e9a948e0 2024-09-18T02:05:19.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.119+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5e9b8a3d0 con 0x55a5e9a948e0 2024-09-18T02:05:19.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f3327fff640 1 -- 172.21.15.167:0/3551315670 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f34300b6b30 con 0x55a5e9a948e0 2024-09-18T02:05:19.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f3327fff640 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f33280346a0 0x7f3328036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f3327fff640 1 -- 172.21.15.167:0/3551315670 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f34300bc070 con 0x55a5e9a948e0 2024-09-18T02:05:19.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f343f0af640 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f33280346a0 0x7f3328036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f3441da0980 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a5e9a95230 0x55a5e9b8deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9b8e520 con 0x55a5e9a95230 2024-09-18T02:05:19.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f34400b1640 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a5e9a95230 0x55a5e9b8deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f343f0af640 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f33280346a0 0x7f3328036b60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3434001da0 tx=0x7f3434001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f34400b1640 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a5e9a95230 0x55a5e9b8deb0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f34400b1640 1 -- 172.21.15.167:0/3551315670 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9a95230 2024-09-18T02:05:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9b8b5d0 con 0x55a5e9a95230 2024-09-18T02:05:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f34400b1640 1 -- 172.21.15.167:0/3551315670 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9a95230 2024-09-18T02:05:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f3441da0980 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a5e9b908a0 0x55a5e9b92c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9b93360 con 0x55a5e9b908a0 2024-09-18T02:05:19.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f343f8b0640 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a5e9b908a0 0x55a5e9b92c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.123+0000 7f343f8b0640 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a5e9b908a0 0x55a5e9b92c90 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f343f8b0640 1 -- 172.21.15.167:0/3551315670 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34300b3040 con 0x55a5e9b908a0 2024-09-18T02:05:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9b8f740 con 0x55a5e9a95230 2024-09-18T02:05:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f34400b1640 1 -- 172.21.15.167:0/3551315670 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9a95230 2024-09-18T02:05:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f3441da0980 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a5e9b947c0 0x55a5e9b96bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9b972b0 con 0x55a5e9b947c0 2024-09-18T02:05:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f343f0af640 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a5e9b947c0 0x55a5e9b96bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f343f0af640 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a5e9b947c0 0x55a5e9b96bb0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f343f0af640 1 -- 172.21.15.167:0/3551315670 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9b947c0 2024-09-18T02:05:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f3441da0980 1 Processor -- start 2024-09-18T02:05:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f3441da0980 1 -- start start 2024-09-18T02:05:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f3441da0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9ba4d80 0x55a5e9ba51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f3441da0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a5e9999800 con 0x55a5e9ba4d80 2024-09-18T02:05:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f343f8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9ba4d80 0x55a5e9ba51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f343f8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9ba4d80 0x55a5e9ba51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50866/0 (socket says 172.21.15.167:50866) 2024-09-18T02:05:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f343f8b0640 1 -- 172.21.15.167:0/2151301275 learned_addr learned my addr 172.21.15.167:0/2151301275 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f343f8b0640 1 -- 172.21.15.167:0/2151301275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5e9ba56e0 con 0x55a5e9ba4d80 2024-09-18T02:05:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.127+0000 7f343f8b0640 1 --2- 172.21.15.167:0/2151301275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9ba4d80 0x55a5e9ba51a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f34300e25d0 tx=0x7f34300b5db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f33257fa640 1 -- 172.21.15.167:0/2151301275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300b6e20 con 0x55a5e9ba4d80 2024-09-18T02:05:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f33257fa640 1 -- 172.21.15.167:0/2151301275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34300e1120 con 0x55a5e9ba4d80 2024-09-18T02:05:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f33257fa640 1 -- 172.21.15.167:0/2151301275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300aa830 con 0x55a5e9ba4d80 2024-09-18T02:05:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f3441da0980 1 -- 172.21.15.167:0/2151301275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5e9ba5970 con 0x55a5e9ba4d80 2024-09-18T02:05:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f3441da0980 1 -- 172.21.15.167:0/2151301275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5e9ba85f0 con 0x55a5e9ba4d80 2024-09-18T02:05:19.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f33257fa640 1 -- 172.21.15.167:0/2151301275 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f34300aa9d0 con 0x55a5e9ba4d80 2024-09-18T02:05:19.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f33257fa640 1 --2- 172.21.15.167:0/2151301275 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3318034650 0x7f3318036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f33257fa640 1 -- 172.21.15.167:0/2151301275 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f34300a8070 con 0x55a5e9ba4d80 2024-09-18T02:05:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f343f0af640 1 --2- 172.21.15.167:0/2151301275 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3318034650 0x7f3318036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f3441da0980 1 Processor -- start 2024-09-18T02:05:19.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f3441da0980 1 -- start start 2024-09-18T02:05:19.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f343f0af640 1 --2- 172.21.15.167:0/2151301275 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3318034650 0x7f3318036b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55a5e9b8ee50 tx=0x7f343400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f3441da0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f3441da0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a5e9b804e0 con 0x55a5e9bb1640 2024-09-18T02:05:19.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f343f8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f343f8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50872/0 (socket says 172.21.15.167:50872) 2024-09-18T02:05:19.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f343f8b0640 1 -- 172.21.15.167:0/1601429090 learned_addr learned my addr 172.21.15.167:0/1601429090 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f343f8b0640 1 -- 172.21.15.167:0/1601429090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5e9bb2010 con 0x55a5e9bb1640 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.131+0000 7f343f8b0640 1 --2- 172.21.15.167:0/1601429090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb1a40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f34300defd0 tx=0x7f34300d4f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83c162760b9a69 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f331effd640 1 -- 172.21.15.167:0/1601429090 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300fb020 con 0x55a5e9bb1640 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f331effd640 1 -- 172.21.15.167:0/1601429090 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34300c85f0 con 0x55a5e9bb1640 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f331effd640 1 -- 172.21.15.167:0/1601429090 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300dab30 con 0x55a5e9bb1640 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 -- 172.21.15.167:0/1601429090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 msgr2=0x55a5e9bb1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 --2- 172.21.15.167:0/1601429090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb1a40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f34300defd0 tx=0x7f34300d4f20 comp rx=0 tx=0).stop 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 -- 172.21.15.167:0/1601429090 shutdown_connections 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 --2- 172.21.15.167:0/1601429090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb1a40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 -- 172.21.15.167:0/1601429090 >> 172.21.15.167:0/1601429090 conn(0x55a5e9badab0 msgr2=0x55a5e9babbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 -- 172.21.15.167:0/1601429090 shutdown_connections 2024-09-18T02:05:19.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 -- 172.21.15.167:0/1601429090 wait complete. 2024-09-18T02:05:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 Processor -- start 2024-09-18T02:05:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 -- start start 2024-09-18T02:05:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a5e9bb2520 con 0x55a5e9bb1640 2024-09-18T02:05:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f343f8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f343f8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50878/0 (socket says 172.21.15.167:50878) 2024-09-18T02:05:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 learned_addr learned my addr 172.21.15.167:0/2550929334 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5e9bb8d60 con 0x55a5e9bb1640 2024-09-18T02:05:19.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f343f8b0640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb8820 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f34300e8cd0 tx=0x7f34300a4100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f331d7fa640 1 -- 172.21.15.167:0/2550929334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f343010f070 con 0x55a5e9bb1640 2024-09-18T02:05:19.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5e9bb8d60 con 0x55a5e9bb1640 2024-09-18T02:05:19.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f331d7fa640 1 -- 172.21.15.167:0/2550929334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34300bfb00 con 0x55a5e9bb1640 2024-09-18T02:05:19.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f331d7fa640 1 -- 172.21.15.167:0/2550929334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300eda70 con 0x55a5e9bb1640 2024-09-18T02:05:19.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.135+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5e9bb8d60 con 0x55a5e9bb1640 2024-09-18T02:05:19.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f331d7fa640 1 -- 172.21.15.167:0/2550929334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3430112070 con 0x55a5e9bb1640 2024-09-18T02:05:19.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f331d7fa640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3308034650 0x7f3308036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f331d7fa640 1 -- 172.21.15.167:0/2550929334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3430115bf0 con 0x55a5e9bb1640 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f343f0af640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3308034650 0x7f3308036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a5e9bc37d0 0x55a5e9bc5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc63c0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f34400b1640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a5e9bc37d0 0x55a5e9bc5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f343f0af640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3308034650 0x7f3308036b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55a5e9b976b0 tx=0x7f3434010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f34400b1640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a5e9bc37d0 0x55a5e9bc5c70 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 20 realm 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc67d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7070 con 0x55a5e9bc37d0 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc37d0 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a5e9bc8170 0x55a5e9bca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bcaae0 con 0x55a5e9bc8170 2024-09-18T02:05:19.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f343f8b0640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a5e9bc8170 0x55a5e9bca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.139+0000 7f343f8b0640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a5e9bc8170 0x55a5e9bca560 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f3441da0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f3441da0980 20 searching for the correct realm 2024-09-18T02:05:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f3441da0980 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a5e9bcca10 0x55a5e9bceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bcf5a0 con 0x55a5e9bcca10 2024-09-18T02:05:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f343f0af640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a5e9bcca10 0x55a5e9bceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f343f0af640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a5e9bcca10 0x55a5e9bceed0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f343f0af640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3434037040 0x7f3434036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bcf5a0 con 0x7f3434037040 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3434037040 0x7f3434036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3434037040 0x7f3434036410 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x7f3434037040 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc37d0 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc37d0 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc37d0 2024-09-18T02:05:19.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.143+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc8170 2024-09-18T02:05:19.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x7f3434037040 2024-09-18T02:05:19.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bcca10 2024-09-18T02:05:19.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc37d0 2024-09-18T02:05:19.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x7f3434037040 2024-09-18T02:05:19.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc37d0 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x7f3434037040 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bcca10 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bcca10 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc8170 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bcca10 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bcca10 2024-09-18T02:05:19.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.147+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc37d0 2024-09-18T02:05:19.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc37d0 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc8170 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bcca10 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x7f3434037040 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc37d0 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc8170 2024-09-18T02:05:19.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bcca10 2024-09-18T02:05:19.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc8170 2024-09-18T02:05:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.151+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x7f3434037040 2024-09-18T02:05:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bcca10 2024-09-18T02:05:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc8170 2024-09-18T02:05:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x55a5e9bc37d0 2024-09-18T02:05:19.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bc7410 con 0x7f3434037040 2024-09-18T02:05:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:19.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bcb330 con 0x55a5e9bc37d0 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bcb330 con 0x55a5e9bc37d0 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bcb330 con 0x55a5e9bcca10 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 zone default found 2024-09-18T02:05:19.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 4 Realm: () 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 zonegroup default 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bcbbd0 con 0x55a5e9bc8170 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.155+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd1400 con 0x55a5e9bcca10 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f3441da0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd17a0 con 0x55a5e9bcca10 2024-09-18T02:05:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f3441da0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f3441da0980 20 started sync module instance, tier type = 2024-09-18T02:05:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f3441da0980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:19.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd08a0 con 0x7f3434037040 2024-09-18T02:05:19.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94171079445952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd08a0 con 0x7f3434037040 2024-09-18T02:05:19.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd2210 con 0x55a5e9bc37d0 2024-09-18T02:05:19.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.159+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94171079445952] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.163+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.163+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94171079449856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd08a0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.163+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd2c20 con 0x55a5e9bcca10 2024-09-18T02:05:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.163+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94171079449856] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.163+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.163+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94171079443440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd0810 con 0x55a5e9bcca10 2024-09-18T02:05:19.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.163+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd3960 con 0x7f3434037040 2024-09-18T02:05:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.163+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.167+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94171079455856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd4200 con 0x7f3434037040 2024-09-18T02:05:19.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.167+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd4c20 con 0x55a5e9bc37d0 2024-09-18T02:05:19.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.167+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94171079443440] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.167+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94171079455856] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.167+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.167+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94171079460624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd3cd0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.167+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd54c0 con 0x55a5e9bc8170 2024-09-18T02:05:19.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.171+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94171079460624] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.171+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.171+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94171079462928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd3cd0 con 0x55a5e9bc8170 2024-09-18T02:05:19.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.171+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd5d10 con 0x55a5e9bc8170 2024-09-18T02:05:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.171+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.171+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94171079465536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd6510 con 0x55a5e9bc8170 2024-09-18T02:05:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.171+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd6510 con 0x55a5e9bc8170 2024-09-18T02:05:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.171+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94171079462928] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94171079465536] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94171079469824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd5f60 con 0x55a5e9bc8170 2024-09-18T02:05:19.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f3441da0980 20 add_watcher() i=0 2024-09-18T02:05:19.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f3441da0980 20 add_watcher() i=1 2024-09-18T02:05:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f3441da0980 20 add_watcher() i=2 2024-09-18T02:05:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f3441da0980 20 add_watcher() i=3 2024-09-18T02:05:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f3441da0980 20 add_watcher() i=4 2024-09-18T02:05:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f3441da0980 20 add_watcher() i=5 2024-09-18T02:05:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f3441da0980 20 add_watcher() i=6 2024-09-18T02:05:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94171079469824] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f3441da0980 20 add_watcher() i=7 2024-09-18T02:05:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f3441da0980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.175+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bda000 con 0x55a5e9bc37d0 2024-09-18T02:05:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94171079454656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd74f0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94171079454656] v32'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f32f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f3441da0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f3441da0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f3441da0980 5 note: GC not initialized 2024-09-18T02:05:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f32f4fe1640 20 reqs_thread_entry: start 2024-09-18T02:05:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f3441da0980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f3441da0980 20 Filter name: none 2024-09-18T02:05:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f326e7fc640 20 reqs_thread_entry: start 2024-09-18T02:05:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f3441da0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bfd120 con 0x55a5e9bc37d0 2024-09-18T02:05:19.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f3441da0980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:05:19.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.179+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bfe670 con 0x55a5e9bc8170 2024-09-18T02:05:19.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.183+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.183+0000 7f32f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:19.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.183+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94171079454656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bdc4a0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.183+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94171079454656] v32'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.183+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94171079445952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd2fc0 con 0x7f3434037040 2024-09-18T02:05:19.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.187+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94171079445952] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.187+0000 7f3441da0980 20 remove_watcher() i=0 2024-09-18T02:05:19.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.187+0000 7f3441da0980 2 removed watcher, disabling cache 2024-09-18T02:05:19.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.187+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94171079449856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd0dc0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.187+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94171079449856] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.187+0000 7f3441da0980 20 remove_watcher() i=1 2024-09-18T02:05:19.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.187+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94171079443440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd0dc0 con 0x55a5e9bcca10 2024-09-18T02:05:19.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.191+0000 7f343f0af640 1 -- 172.21.15.167:0/2550929334 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94171079443440] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343400e6c0 con 0x55a5e9bcca10 2024-09-18T02:05:19.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.191+0000 7f3441da0980 20 remove_watcher() i=2 2024-09-18T02:05:19.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.191+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94171079455856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd03f0 con 0x7f3434037040 2024-09-18T02:05:19.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.191+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94171079455856] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x7f3434037040 2024-09-18T02:05:19.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.191+0000 7f3441da0980 20 remove_watcher() i=3 2024-09-18T02:05:19.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.191+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94171079460624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd0dc0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.191+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94171079460624] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343800a4d0 con 0x55a5e9bc37d0 2024-09-18T02:05:19.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.191+0000 7f3441da0980 20 remove_watcher() i=4 2024-09-18T02:05:19.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.191+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94171079462928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd03f0 con 0x55a5e9bc8170 2024-09-18T02:05:19.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.195+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94171079462928] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.195+0000 7f3441da0980 20 remove_watcher() i=5 2024-09-18T02:05:19.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.195+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94171079465536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd4710 con 0x55a5e9bc8170 2024-09-18T02:05:19.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94171079465536] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 20 remove_watcher() i=6 2024-09-18T02:05:19.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94171079469824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5e9bd0dc0 con 0x55a5e9bc8170 2024-09-18T02:05:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f343f8b0640 1 -- 172.21.15.167:0/2550929334 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94171079469824] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430111030 con 0x55a5e9bc8170 2024-09-18T02:05:19.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 20 remove_watcher() i=7 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a5e9bc8170 msgr2=0x55a5e9bca560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a5e9bc8170 0x55a5e9bca560 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a5e9bc37d0 msgr2=0x55a5e9bc5c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a5e9bc37d0 0x55a5e9bc5c70 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3434037040 msgr2=0x7f3434036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3434037040 0x7f3434036410 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a5e9bcca10 msgr2=0x55a5e9bceed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a5e9bcca10 0x55a5e9bceed0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3308034650 msgr2=0x7f3308036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3308034650 0x7f3308036b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55a5e9b976b0 tx=0x7f3434010000 comp rx=0 tx=0).stop 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f34400b1640 1 -- 172.21.15.167:0/2550929334 reap_dead start 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 msgr2=0x55a5e9bb8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb8820 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f34300e8cd0 tx=0x7f34300a4100 comp rx=0 tx=0).stop 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 shutdown_connections 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 --2- 172.21.15.167:0/2550929334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9bb1640 0x55a5e9bb8820 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 >> 172.21.15.167:0/2550929334 conn(0x55a5e9badab0 msgr2=0x55a5e9babb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 shutdown_connections 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2550929334 wait complete. 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2151301275 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3318034650 msgr2=0x7f3318036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 --2- 172.21.15.167:0/2151301275 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3318034650 0x7f3318036b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55a5e9b8ee50 tx=0x7f343400f000 comp rx=0 tx=0).stop 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2151301275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9ba4d80 msgr2=0x55a5e9ba51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 --2- 172.21.15.167:0/2151301275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9ba4d80 0x55a5e9ba51a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f34300e25d0 tx=0x7f34300b5db0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2151301275 shutdown_connections 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 --2- 172.21.15.167:0/2151301275 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3318034650 0x7f3318036b10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 --2- 172.21.15.167:0/2151301275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9ba4d80 0x55a5e9ba51a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2151301275 >> 172.21.15.167:0/2151301275 conn(0x55a5e9b99ed0 msgr2=0x55a5e9b9c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2151301275 shutdown_connections 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.199+0000 7f3441da0980 1 -- 172.21.15.167:0/2151301275 wait complete. 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a5e9b908a0 msgr2=0x55a5e9b92c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55a5e9b908a0 0x55a5e9b92c90 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a5e9a95230 msgr2=0x55a5e9b8deb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55a5e9a95230 0x55a5e9b8deb0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a5e9b947c0 msgr2=0x55a5e9b96bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55a5e9b947c0 0x55a5e9b96bb0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f33280346a0 msgr2=0x7f3328036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f33280346a0 0x7f3328036b60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3434001da0 tx=0x7f3434001300 comp rx=0 tx=0).stop 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 msgr2=0x55a5e9b86f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 --2- 172.21.15.167:0/3551315670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5e9a948e0 0x55a5e9b86f20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f343001b2c0 tx=0x7f3430018020 comp rx=0 tx=0).stop 2024-09-18T02:05:19.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f34400b1640 1 -- 172.21.15.167:0/3551315670 reap_dead start 2024-09-18T02:05:19.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 shutdown_connections 2024-09-18T02:05:19.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 >> 172.21.15.167:0/3551315670 conn(0x55a5e9a08230 msgr2=0x55a5e9b7a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 shutdown_connections 2024-09-18T02:05:19.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.203+0000 7f3441da0980 1 -- 172.21.15.167:0/3551315670 wait complete. 2024-09-18T02:05:19.215 INFO:teuthology.orchestra.run.smithi167.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-18T02:05:19.216 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-18T02:05:19.216 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-18T02:05:19.216 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-18T02:05:19.216 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-18T02:05:19.290 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:19.291 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:19.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.287+0000 7face2905980 1 Processor -- start 2024-09-18T02:05:19.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.287+0000 7face2905980 1 -- start start 2024-09-18T02:05:19.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.287+0000 7face2905980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558fcc89bad0 0x558fcc92c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.287+0000 7face2905980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558fcc7afae0 con 0x558fcc92ccc0 2024-09-18T02:05:19.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.287+0000 7face2905980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x558fcc7d3e30 con 0x558fcc89bad0 2024-09-18T02:05:19.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.287+0000 7face0415640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558fcc89bad0 0x558fcc92c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.287+0000 7face0415640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x558fcc89bad0 0x558fcc92c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50894/0 (socket says 172.21.15.167:50894) 2024-09-18T02:05:19.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.287+0000 7face0415640 1 -- 172.21.15.167:0/2577753736 learned_addr learned my addr 172.21.15.167:0/2577753736 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.287+0000 7facdfc14640 1 --1- 172.21.15.167:0/2577753736 >> v1:172.21.15.81:6789/0 conn(0x558fcc92ccc0 0x558fcc92f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33682/0 (socket says 172.21.15.167:33682) 2024-09-18T02:05:19.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.291+0000 7face0415640 1 -- 172.21.15.167:0/2577753736 >> v1:172.21.15.81:6789/0 conn(0x558fcc92ccc0 legacy=0x558fcc92f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.291+0000 7face0415640 1 -- 172.21.15.167:0/2577753736 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fcc89beb0 con 0x558fcc89bad0 2024-09-18T02:05:19.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.291+0000 7face0415640 1 --2- 172.21.15.167:0/2577753736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcc92c780 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7facd000a5c0 tx=0x7facd001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d50e0419c235b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.291+0000 7facdf413640 1 -- 172.21.15.167:0/2577753736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd00a6070 con 0x558fcc89bad0 2024-09-18T02:05:19.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.291+0000 7facdf413640 1 -- 172.21.15.167:0/2577753736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd00af070 con 0x558fcc89bad0 2024-09-18T02:05:19.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.291+0000 7facdf413640 1 -- 172.21.15.167:0/2577753736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd00aa5c0 con 0x558fcc89bad0 2024-09-18T02:05:19.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.291+0000 7face2905980 1 -- 172.21.15.167:0/2577753736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 msgr2=0x558fcc92c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.291+0000 7face2905980 1 --2- 172.21.15.167:0/2577753736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcc92c780 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7facd000a5c0 tx=0x7facd001b340 comp rx=0 tx=0).stop 2024-09-18T02:05:19.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.295+0000 7face2905980 1 -- 172.21.15.167:0/2577753736 shutdown_connections 2024-09-18T02:05:19.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.295+0000 7face2905980 1 --2- 172.21.15.167:0/2577753736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcc92c780 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.295+0000 7face2905980 1 -- 172.21.15.167:0/2577753736 >> 172.21.15.167:0/2577753736 conn(0x558fcc922070 msgr2=0x558fcc924490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.295+0000 7face2905980 1 -- 172.21.15.167:0/2577753736 shutdown_connections 2024-09-18T02:05:19.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.295+0000 7face2905980 1 -- 172.21.15.167:0/2577753736 wait complete. 2024-09-18T02:05:19.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.307+0000 7face2905980 1 Processor -- start 2024-09-18T02:05:19.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.307+0000 7face2905980 1 -- start start 2024-09-18T02:05:19.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.307+0000 7face2905980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcca14c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.307+0000 7face2905980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558fcc7d5200 con 0x558fcc89bad0 2024-09-18T02:05:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face0415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcca14c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face0415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcca14c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50908/0 (socket says 172.21.15.167:50908) 2024-09-18T02:05:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face0415640 1 -- 172.21.15.167:0/1494860553 learned_addr learned my addr 172.21.15.167:0/1494860553 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face0415640 1 -- 172.21.15.167:0/1494860553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fcca151e0 con 0x558fcc89bad0 2024-09-18T02:05:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face0415640 1 --2- 172.21.15.167:0/1494860553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcca14c10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7facd0018f70 tx=0x7facd0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe10424cc2a46800 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7fabce60c640 1 -- 172.21.15.167:0/1494860553 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd00aaa00 con 0x558fcc89bad0 2024-09-18T02:05:19.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7fabce60c640 1 -- 172.21.15.167:0/1494860553 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd00aaba0 con 0x558fcc89bad0 2024-09-18T02:05:19.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7fabce60c640 1 -- 172.21.15.167:0/1494860553 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd00bd3f0 con 0x558fcc89bad0 2024-09-18T02:05:19.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face2905980 1 -- 172.21.15.167:0/1494860553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 msgr2=0x558fcca14c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face2905980 1 --2- 172.21.15.167:0/1494860553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcca14c10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7facd0018f70 tx=0x7facd0003030 comp rx=0 tx=0).stop 2024-09-18T02:05:19.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face2905980 1 -- 172.21.15.167:0/1494860553 shutdown_connections 2024-09-18T02:05:19.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face2905980 1 --2- 172.21.15.167:0/1494860553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcca14c10 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face2905980 1 -- 172.21.15.167:0/1494860553 >> 172.21.15.167:0/1494860553 conn(0x558fcc922070 msgr2=0x558fcca10840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face2905980 1 -- 172.21.15.167:0/1494860553 shutdown_connections 2024-09-18T02:05:19.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face2905980 1 -- 172.21.15.167:0/1494860553 wait complete. 2024-09-18T02:05:19.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face2905980 1 Processor -- start 2024-09-18T02:05:19.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face2905980 1 -- start start 2024-09-18T02:05:19.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face2905980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcca1be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face2905980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558fcc933260 con 0x558fcc89bad0 2024-09-18T02:05:19.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face0415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcca1be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face0415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcca1be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50910/0 (socket says 172.21.15.167:50910) 2024-09-18T02:05:19.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face0415640 1 -- 172.21.15.167:0/2738041437 learned_addr learned my addr 172.21.15.167:0/2738041437 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.311+0000 7face0415640 1 -- 172.21.15.167:0/2738041437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fcca1c3b0 con 0x558fcc89bad0 2024-09-18T02:05:19.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face0415640 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcca1be70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7facd001b170 tx=0x7facd00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7fabcce09640 1 -- 172.21.15.167:0/2738041437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd00bd790 con 0x558fcc89bad0 2024-09-18T02:05:19.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558fcca1c640 con 0x558fcc89bad0 2024-09-18T02:05:19.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7fabcce09640 1 -- 172.21.15.167:0/2738041437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd00bd930 con 0x558fcc89bad0 2024-09-18T02:05:19.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7fabcce09640 1 -- 172.21.15.167:0/2738041437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd00bdc10 con 0x558fcc89bad0 2024-09-18T02:05:19.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fcca1f320 con 0x558fcc89bad0 2024-09-18T02:05:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7fabcce09640 1 -- 172.21.15.167:0/2738041437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7facd00ce030 con 0x558fcc89bad0 2024-09-18T02:05:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7fabcce09640 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabc8034650 0x7fabc8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7fabcce09640 1 -- 172.21.15.167:0/2738041437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7facd00cc020 con 0x558fcc89bad0 2024-09-18T02:05:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7facdfc14640 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabc8034650 0x7fabc8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face2905980 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558fcc92ccc0 0x558fcca22e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca23440 con 0x558fcc92ccc0 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face0c16640 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558fcc92ccc0 0x558fcca22e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7facdfc14640 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabc8034650 0x7fabc8036b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7facc8001e50 tx=0x7facc80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face0c16640 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558fcc92ccc0 0x558fcca22e00 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face0c16640 1 -- 172.21.15.167:0/2738041437 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcc92ccc0 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca20520 con 0x558fcc92ccc0 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face0c16640 1 -- 172.21.15.167:0/2738041437 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcc92ccc0 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face2905980 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558fcca25770 0x558fcca27b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca28230 con 0x558fcca25770 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.315+0000 7face0415640 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558fcca25770 0x558fcca27b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face0415640 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558fcca25770 0x558fcca27b60 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face0415640 1 -- 172.21.15.167:0/2738041437 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7facd00c6d20 con 0x558fcca25770 2024-09-18T02:05:19.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca24610 con 0x558fcc92ccc0 2024-09-18T02:05:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face0c16640 1 -- 172.21.15.167:0/2738041437 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcc92ccc0 2024-09-18T02:05:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face2905980 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558fcca29670 0x558fcca2ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca2c1f0 con 0x558fcca29670 2024-09-18T02:05:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7facdfc14640 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558fcca29670 0x558fcca2ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7facdfc14640 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558fcca29670 0x558fcca2ba60 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7facdfc14640 1 -- 172.21.15.167:0/2738041437 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7facc800f700 con 0x558fcca29670 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face2905980 1 Processor -- start 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face2905980 1 -- start start 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face2905980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca39c80 0x558fcca3a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face2905980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558fcc82e800 con 0x558fcca39c80 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face0415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca39c80 0x558fcca3a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face0415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca39c80 0x558fcca3a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50916/0 (socket says 172.21.15.167:50916) 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face0415640 1 -- 172.21.15.167:0/4125146024 learned_addr learned my addr 172.21.15.167:0/4125146024 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face0415640 1 -- 172.21.15.167:0/4125146024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fcca3a5e0 con 0x558fcca39c80 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.319+0000 7face0415640 1 --2- 172.21.15.167:0/4125146024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca39c80 0x558fcca3a0a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7facd00e36c0 tx=0x7facd00cfe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7fabc5ffb640 1 -- 172.21.15.167:0/4125146024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd00bc9a0 con 0x558fcca39c80 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7fabc5ffb640 1 -- 172.21.15.167:0/4125146024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd00bcb40 con 0x558fcca39c80 2024-09-18T02:05:19.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7face2905980 1 -- 172.21.15.167:0/4125146024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558fcca3a870 con 0x558fcca39c80 2024-09-18T02:05:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7fabc5ffb640 1 -- 172.21.15.167:0/4125146024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd00bce20 con 0x558fcca39c80 2024-09-18T02:05:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7face2905980 1 -- 172.21.15.167:0/4125146024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fcca3d4f0 con 0x558fcca39c80 2024-09-18T02:05:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7fabc5ffb640 1 -- 172.21.15.167:0/4125146024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7facd00e3a00 con 0x558fcca39c80 2024-09-18T02:05:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7fabc5ffb640 1 --2- 172.21.15.167:0/4125146024 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabb80346a0 0x7fabb8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7fabc5ffb640 1 -- 172.21.15.167:0/4125146024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7facd00f2ba0 con 0x558fcca39c80 2024-09-18T02:05:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7facdfc14640 1 --2- 172.21.15.167:0/4125146024 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabb80346a0 0x7fabb8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7face2905980 1 Processor -- start 2024-09-18T02:05:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7face2905980 1 -- start start 2024-09-18T02:05:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7facdfc14640 1 --2- 172.21.15.167:0/4125146024 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabb80346a0 0x7fabb8036b60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x558fcca2c5f0 tx=0x7facc800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7face2905980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca46a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7face2905980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558fcca154a0 con 0x558fcca46650 2024-09-18T02:05:19.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7face0415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca46a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7face0415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca46a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50930/0 (socket says 172.21.15.167:50930) 2024-09-18T02:05:19.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7face0415640 1 -- 172.21.15.167:0/2472690944 learned_addr learned my addr 172.21.15.167:0/2472690944 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7face0415640 1 -- 172.21.15.167:0/2472690944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fcca47020 con 0x558fcca46650 2024-09-18T02:05:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7face0415640 1 --2- 172.21.15.167:0/2472690944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca46a50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7facd00ae000 tx=0x7facd00c6a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93de551403d03700 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7fabbf7fe640 1 -- 172.21.15.167:0/2472690944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd0104070 con 0x558fcca46650 2024-09-18T02:05:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7fabbf7fe640 1 -- 172.21.15.167:0/2472690944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd00c5d90 con 0x558fcca46650 2024-09-18T02:05:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.323+0000 7fabbf7fe640 1 -- 172.21.15.167:0/2472690944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd00e3cf0 con 0x558fcca46650 2024-09-18T02:05:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 -- 172.21.15.167:0/2472690944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 msgr2=0x558fcca46a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 --2- 172.21.15.167:0/2472690944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca46a50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7facd00ae000 tx=0x7facd00c6a60 comp rx=0 tx=0).stop 2024-09-18T02:05:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 -- 172.21.15.167:0/2472690944 shutdown_connections 2024-09-18T02:05:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 --2- 172.21.15.167:0/2472690944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca46a50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 -- 172.21.15.167:0/2472690944 >> 172.21.15.167:0/2472690944 conn(0x558fcca429e0 msgr2=0x558fcca40ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 -- 172.21.15.167:0/2472690944 shutdown_connections 2024-09-18T02:05:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 -- 172.21.15.167:0/2472690944 wait complete. 2024-09-18T02:05:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 Processor -- start 2024-09-18T02:05:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 -- start start 2024-09-18T02:05:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca4d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558fcca47570 con 0x558fcca46650 2024-09-18T02:05:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face0415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca4d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face0415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca4d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50944/0 (socket says 172.21.15.167:50944) 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 learned_addr learned my addr 172.21.15.167:0/1876487621 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fcca4dd30 con 0x558fcca46650 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face0415640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca4d7f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7facd00f3000 tx=0x7facd00d8f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7fabbdffb640 1 -- 172.21.15.167:0/1876487621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd010d070 con 0x558fcca46650 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558fcca4dd30 con 0x558fcca46650 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7fabbdffb640 1 -- 172.21.15.167:0/1876487621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd00e8e30 con 0x558fcca46650 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7fabbdffb640 1 -- 172.21.15.167:0/1876487621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd0104040 con 0x558fcca46650 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fcca4dd30 con 0x558fcca46650 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7fabbdffb640 1 -- 172.21.15.167:0/1876487621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7facd0110070 con 0x558fcca46650 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.327+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7fabbdffb640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabb0034600 0x7fabb0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7fabbdffb640 1 -- 172.21.15.167:0/1876487621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7facd00fc070 con 0x558fcca46650 2024-09-18T02:05:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7facdfc14640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabb0034600 0x7fabb0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558fcca58770 0x558fcca5ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5b360 con 0x558fcca58770 2024-09-18T02:05:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face0c16640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558fcca58770 0x558fcca5ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7facdfc14640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabb0034600 0x7fabb0036ac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7facc800baa0 tx=0x7facc8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face0c16640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558fcca58770 0x558fcca5ac10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 20 realm 2024-09-18T02:05:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5b770 con 0x558fcca58770 2024-09-18T02:05:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c010 con 0x558fcca58770 2024-09-18T02:05:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca58770 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558fcca5d110 0x558fcca5f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5fa80 con 0x558fcca5d110 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face0415640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558fcca5d110 0x558fcca5f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.331+0000 7face0415640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558fcca5d110 0x558fcca5f500 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face2905980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:19.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face2905980 20 searching for the correct realm 2024-09-18T02:05:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face2905980 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558fcca619b0 0x558fcca63e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca64540 con 0x558fcca619b0 2024-09-18T02:05:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7facdfc14640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558fcca619b0 0x558fcca63e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7facdfc14640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558fcca619b0 0x558fcca63e70 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7facdfc14640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7facc803a3c0 0x7facc803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca64540 con 0x7facc803a3c0 2024-09-18T02:05:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7facc803a3c0 0x7facc803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7facc803a3c0 0x7facc803a800 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x7facc803a3c0 2024-09-18T02:05:19.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca58770 2024-09-18T02:05:19.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca58770 2024-09-18T02:05:19.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca58770 2024-09-18T02:05:19.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca5d110 2024-09-18T02:05:19.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x7facc803a3c0 2024-09-18T02:05:19.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.335+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca619b0 2024-09-18T02:05:19.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca58770 2024-09-18T02:05:19.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x7facc803a3c0 2024-09-18T02:05:19.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca58770 2024-09-18T02:05:19.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x7facc803a3c0 2024-09-18T02:05:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca619b0 2024-09-18T02:05:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca619b0 2024-09-18T02:05:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca5d110 2024-09-18T02:05:19.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca619b0 2024-09-18T02:05:19.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca619b0 2024-09-18T02:05:19.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca58770 2024-09-18T02:05:19.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca58770 2024-09-18T02:05:19.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.339+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca5d110 2024-09-18T02:05:19.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca619b0 2024-09-18T02:05:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x7facc803a3c0 2024-09-18T02:05:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca58770 2024-09-18T02:05:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca5d110 2024-09-18T02:05:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca619b0 2024-09-18T02:05:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca5d110 2024-09-18T02:05:19.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x7facc803a3c0 2024-09-18T02:05:19.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca619b0 2024-09-18T02:05:19.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.343+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca5d110 2024-09-18T02:05:19.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x558fcca58770 2024-09-18T02:05:19.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558fcca5c3b0 con 0x7facc803a3c0 2024-09-18T02:05:19.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:19.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:19.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:19.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:19.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:19.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca602d0 con 0x558fcca58770 2024-09-18T02:05:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca602d0 con 0x558fcca58770 2024-09-18T02:05:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca602d0 con 0x558fcca619b0 2024-09-18T02:05:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 zone default found 2024-09-18T02:05:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 4 Realm: () 2024-09-18T02:05:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 zonegroup default 2024-09-18T02:05:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca60b70 con 0x558fcca5d110 2024-09-18T02:05:19.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca663a0 con 0x558fcca619b0 2024-09-18T02:05:19.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca66740 con 0x558fcca619b0 2024-09-18T02:05:19.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 started sync module instance, tier type = 2024-09-18T02:05:19.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:19.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.347+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca65840 con 0x7facc803a3c0 2024-09-18T02:05:19.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.351+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.351+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94076102139280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca65840 con 0x7facc803a3c0 2024-09-18T02:05:19.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.351+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca67100 con 0x558fcca58770 2024-09-18T02:05:19.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.351+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94076102139280] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.351+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.351+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94076102143328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca65840 con 0x558fcca58770 2024-09-18T02:05:19.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.351+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca67b10 con 0x558fcca619b0 2024-09-18T02:05:19.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.355+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.355+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94076102143328] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.355+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94076102136720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca657b0 con 0x558fcca619b0 2024-09-18T02:05:19.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.355+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca68810 con 0x7facc803a3c0 2024-09-18T02:05:19.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.355+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.355+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94076102149232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca68f20 con 0x7facc803a3c0 2024-09-18T02:05:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.355+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca69a20 con 0x558fcca58770 2024-09-18T02:05:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.359+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94076102136720] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.359+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94076102149232] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.359+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.359+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94076102153488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca699e0 con 0x558fcca58770 2024-09-18T02:05:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.359+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca69e40 con 0x558fcca5d110 2024-09-18T02:05:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.359+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94076102153488] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.359+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.359+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94076102150512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca6a1e0 con 0x558fcca5d110 2024-09-18T02:05:19.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.359+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca6aad0 con 0x558fcca5d110 2024-09-18T02:05:19.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94076102159984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca6b740 con 0x558fcca5d110 2024-09-18T02:05:19.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca6c1b0 con 0x558fcca5d110 2024-09-18T02:05:19.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94076102150512] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94076102163584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca6c430 con 0x558fcca5d110 2024-09-18T02:05:19.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face2905980 20 add_watcher() i=0 2024-09-18T02:05:19.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face2905980 20 add_watcher() i=1 2024-09-18T02:05:19.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face2905980 20 add_watcher() i=2 2024-09-18T02:05:19.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face2905980 20 add_watcher() i=3 2024-09-18T02:05:19.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face2905980 20 add_watcher() i=4 2024-09-18T02:05:19.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.363+0000 7face2905980 20 add_watcher() i=5 2024-09-18T02:05:19.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94076102159984] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face2905980 20 add_watcher() i=6 2024-09-18T02:05:19.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94076102163584] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face2905980 20 add_watcher() i=7 2024-09-18T02:05:19.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face2905980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:19.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca6b290 con 0x558fcca58770 2024-09-18T02:05:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94076102161040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca6c9b0 con 0x558fcca58770 2024-09-18T02:05:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94076102161040] v32'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7fab967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face2905980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face2905980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.367+0000 7face2905980 5 note: GC not initialized 2024-09-18T02:05:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7fab957e2640 20 reqs_thread_entry: start 2024-09-18T02:05:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7face2905980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7face2905980 20 Filter name: none 2024-09-18T02:05:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7fab06ffd640 20 reqs_thread_entry: start 2024-09-18T02:05:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7face2905980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca925f0 con 0x558fcca58770 2024-09-18T02:05:19.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7face2905980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:05:19.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558fcca93b40 con 0x558fcca5d110 2024-09-18T02:05:19.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7fab967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:19.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.371+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94076102161040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca90d50 con 0x558fcca58770 2024-09-18T02:05:19.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.375+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94076102161040] v32'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.375+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94076102139280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca6b290 con 0x7facc803a3c0 2024-09-18T02:05:19.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.375+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94076102139280] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.375+0000 7face2905980 20 remove_watcher() i=0 2024-09-18T02:05:19.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.375+0000 7face2905980 2 removed watcher, disabling cache 2024-09-18T02:05:19.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.375+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94076102143328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca65d90 con 0x558fcca58770 2024-09-18T02:05:19.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.375+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94076102143328] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.375+0000 7face2905980 20 remove_watcher() i=1 2024-09-18T02:05:19.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.375+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94076102136720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca6b290 con 0x558fcca619b0 2024-09-18T02:05:19.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.379+0000 7facdfc14640 1 -- 172.21.15.167:0/1876487621 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94076102136720] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc8037040 con 0x558fcca619b0 2024-09-18T02:05:19.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.379+0000 7face2905980 20 remove_watcher() i=2 2024-09-18T02:05:19.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.379+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94076102149232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca65390 con 0x7facc803a3c0 2024-09-18T02:05:19.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.379+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94076102149232] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x7facc803a3c0 2024-09-18T02:05:19.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.379+0000 7face2905980 20 remove_watcher() i=3 2024-09-18T02:05:19.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.379+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94076102153488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca65390 con 0x558fcca58770 2024-09-18T02:05:19.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.383+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94076102153488] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd800a4d0 con 0x558fcca58770 2024-09-18T02:05:19.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.383+0000 7face2905980 20 remove_watcher() i=4 2024-09-18T02:05:19.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.383+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94076102150512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca65390 con 0x558fcca5d110 2024-09-18T02:05:19.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.383+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94076102150512] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.383+0000 7face2905980 20 remove_watcher() i=5 2024-09-18T02:05:19.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.383+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94076102159984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca65390 con 0x558fcca5d110 2024-09-18T02:05:19.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.387+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94076102159984] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.387+0000 7face2905980 20 remove_watcher() i=6 2024-09-18T02:05:19.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.387+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94076102163584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558fcca65390 con 0x558fcca5d110 2024-09-18T02:05:19.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.387+0000 7face0415640 1 -- 172.21.15.167:0/1876487621 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94076102163584] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facd0119070 con 0x558fcca5d110 2024-09-18T02:05:19.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.387+0000 7face2905980 20 remove_watcher() i=7 2024-09-18T02:05:19.394 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558fcca5d110 msgr2=0x558fcca5f500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558fcca5d110 0x558fcca5f500 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558fcca58770 msgr2=0x558fcca5ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558fcca58770 0x558fcca5ac10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7facc803a3c0 msgr2=0x7facc803a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7facc803a3c0 0x7facc803a800 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558fcca619b0 msgr2=0x558fcca63e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558fcca619b0 0x558fcca63e70 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabb0034600 msgr2=0x7fabb0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabb0034600 0x7fabb0036ac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7facc800baa0 tx=0x7facc8010000 comp rx=0 tx=0).stop 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 msgr2=0x558fcca4d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face0c16640 1 -- 172.21.15.167:0/1876487621 reap_dead start 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca4d7f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7facd00f3000 tx=0x7facd00d8f20 comp rx=0 tx=0).stop 2024-09-18T02:05:19.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 shutdown_connections 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/1876487621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca46650 0x558fcca4d7f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 >> 172.21.15.167:0/1876487621 conn(0x558fcca429e0 msgr2=0x558fcca40ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 shutdown_connections 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/1876487621 wait complete. 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/4125146024 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabb80346a0 msgr2=0x7fabb8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/4125146024 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabb80346a0 0x7fabb8036b60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x558fcca2c5f0 tx=0x7facc800f000 comp rx=0 tx=0).stop 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/4125146024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca39c80 msgr2=0x558fcca3a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/4125146024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca39c80 0x558fcca3a0a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7facd00e36c0 tx=0x7facd00cfe00 comp rx=0 tx=0).stop 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/4125146024 shutdown_connections 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/4125146024 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabb80346a0 0x7fabb8036b60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/4125146024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcca39c80 0x558fcca3a0a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/4125146024 >> 172.21.15.167:0/4125146024 conn(0x558fcca2edd0 msgr2=0x558fcca31850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/4125146024 shutdown_connections 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/4125146024 wait complete. 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558fcca25770 msgr2=0x558fcca27b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x558fcca25770 0x558fcca27b60 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558fcc92ccc0 msgr2=0x558fcca22e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x558fcc92ccc0 0x558fcca22e00 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558fcca29670 msgr2=0x558fcca2ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x558fcca29670 0x558fcca2ba60 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabc8034650 msgr2=0x7fabc8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fabc8034650 0x7fabc8036b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7facc8001e50 tx=0x7facc80013b0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 msgr2=0x558fcca1be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 --2- 172.21.15.167:0/2738041437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558fcc89bad0 0x558fcca1be70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7facd001b170 tx=0x7facd00180e0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face0c16640 1 -- 172.21.15.167:0/2738041437 reap_dead start 2024-09-18T02:05:19.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 shutdown_connections 2024-09-18T02:05:19.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 >> 172.21.15.167:0/2738041437 conn(0x558fcc922070 msgr2=0x558fcca0f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 shutdown_connections 2024-09-18T02:05:19.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.391+0000 7face2905980 1 -- 172.21.15.167:0/2738041437 wait complete. 2024-09-18T02:05:19.405 INFO:teuthology.orchestra.run.smithi167.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-18T02:05:19.406 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-18T02:05:19.406 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-18T02:05:19.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-18T02:05:19.406 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-18T02:05:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:19.491 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.487+0000 7efc161c0980 1 Processor -- start 2024-09-18T02:05:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.487+0000 7efc161c0980 1 -- start start 2024-09-18T02:05:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.487+0000 7efc161c0980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x556c63e3c2a0 0x556c63ecc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.487+0000 7efc161c0980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556c63d4fae0 con 0x556c63ecccf0 2024-09-18T02:05:19.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.487+0000 7efc161c0980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x556c63d73e30 con 0x556c63e3c2a0 2024-09-18T02:05:19.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.487+0000 7efc13cd0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x556c63e3c2a0 0x556c63ecc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.487+0000 7efc134cf640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x556c63ecccf0 0x556c63ecf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33690/0 (socket says 172.21.15.167:33690) 2024-09-18T02:05:19.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.487+0000 7efc134cf640 1 -- 172.21.15.167:0/3892551408 learned_addr learned my addr 172.21.15.167:0/3892551408 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:05:19.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc13cd0640 1 -- 172.21.15.167:0/3892551408 >> v1:172.21.15.81:6789/0 conn(0x556c63ecccf0 legacy=0x556c63ecf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc13cd0640 1 -- 172.21.15.167:0/3892551408 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c63e3c680 con 0x556c63e3c2a0 2024-09-18T02:05:19.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc13cd0640 1 --2- 172.21.15.167:0/3892551408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63ecc7b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efc0400a480 tx=0x7efc0401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b0c972e830cc90 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc12cce640 1 -- 172.21.15.167:0/3892551408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc040b0070 con 0x556c63e3c2a0 2024-09-18T02:05:19.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc12cce640 1 -- 172.21.15.167:0/3892551408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc040ab540 con 0x556c63e3c2a0 2024-09-18T02:05:19.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc12cce640 1 -- 172.21.15.167:0/3892551408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc040ab840 con 0x556c63e3c2a0 2024-09-18T02:05:19.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc161c0980 1 -- 172.21.15.167:0/3892551408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 msgr2=0x556c63ecc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc161c0980 1 --2- 172.21.15.167:0/3892551408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63ecc7b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efc0400a480 tx=0x7efc0401b280 comp rx=0 tx=0).stop 2024-09-18T02:05:19.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc161c0980 1 -- 172.21.15.167:0/3892551408 shutdown_connections 2024-09-18T02:05:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc161c0980 1 --2- 172.21.15.167:0/3892551408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63ecc7b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc161c0980 1 -- 172.21.15.167:0/3892551408 >> 172.21.15.167:0/3892551408 conn(0x556c63ec20a0 msgr2=0x556c63ec44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc161c0980 1 -- 172.21.15.167:0/3892551408 shutdown_connections 2024-09-18T02:05:19.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.491+0000 7efc161c0980 1 -- 172.21.15.167:0/3892551408 wait complete. 2024-09-18T02:05:19.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.507+0000 7efc161c0980 1 Processor -- start 2024-09-18T02:05:19.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.507+0000 7efc161c0980 1 -- start start 2024-09-18T02:05:19.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.507+0000 7efc161c0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63fb4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.507+0000 7efc161c0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556c63d75200 con 0x556c63e3c2a0 2024-09-18T02:05:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.507+0000 7efc13cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63fb4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.507+0000 7efc13cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63fb4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50960/0 (socket says 172.21.15.167:50960) 2024-09-18T02:05:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.507+0000 7efc13cd0640 1 -- 172.21.15.167:0/1520763472 learned_addr learned my addr 172.21.15.167:0/1520763472 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc13cd0640 1 -- 172.21.15.167:0/1520763472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c63fb52a0 con 0x556c63e3c2a0 2024-09-18T02:05:19.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc13cd0640 1 --2- 172.21.15.167:0/1520763472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63fb4cd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efc04018eb0 tx=0x7efc04003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b39b4fa6674689 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efb01e0b640 1 -- 172.21.15.167:0/1520763472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc040b0070 con 0x556c63e3c2a0 2024-09-18T02:05:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efb01e0b640 1 -- 172.21.15.167:0/1520763472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc040b1040 con 0x556c63e3c2a0 2024-09-18T02:05:19.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efb01e0b640 1 -- 172.21.15.167:0/1520763472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc040ab6f0 con 0x556c63e3c2a0 2024-09-18T02:05:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc161c0980 1 -- 172.21.15.167:0/1520763472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 msgr2=0x556c63fb4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc161c0980 1 --2- 172.21.15.167:0/1520763472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63fb4cd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efc04018eb0 tx=0x7efc04003030 comp rx=0 tx=0).stop 2024-09-18T02:05:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc161c0980 1 -- 172.21.15.167:0/1520763472 shutdown_connections 2024-09-18T02:05:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc161c0980 1 --2- 172.21.15.167:0/1520763472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63fb4cd0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc161c0980 1 -- 172.21.15.167:0/1520763472 >> 172.21.15.167:0/1520763472 conn(0x556c63ec20a0 msgr2=0x556c63fb0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc161c0980 1 -- 172.21.15.167:0/1520763472 shutdown_connections 2024-09-18T02:05:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc161c0980 1 -- 172.21.15.167:0/1520763472 wait complete. 2024-09-18T02:05:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc161c0980 1 Processor -- start 2024-09-18T02:05:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc161c0980 1 -- start start 2024-09-18T02:05:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc161c0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63fbbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc161c0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556c63ed3230 con 0x556c63e3c2a0 2024-09-18T02:05:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc13cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63fbbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc13cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63fbbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50968/0 (socket says 172.21.15.167:50968) 2024-09-18T02:05:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc13cd0640 1 -- 172.21.15.167:0/3574535670 learned_addr learned my addr 172.21.15.167:0/3574535670 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc13cd0640 1 -- 172.21.15.167:0/3574535670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c63fbc3e0 con 0x556c63e3c2a0 2024-09-18T02:05:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.511+0000 7efc13cd0640 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63fbbea0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efc040b9040 tx=0x7efc04018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efafbfff640 1 -- 172.21.15.167:0/3574535670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc040b75b0 con 0x556c63e3c2a0 2024-09-18T02:05:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efafbfff640 1 -- 172.21.15.167:0/3574535670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc040b7750 con 0x556c63e3c2a0 2024-09-18T02:05:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c63fbc670 con 0x556c63e3c2a0 2024-09-18T02:05:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efafbfff640 1 -- 172.21.15.167:0/3574535670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc040b7a50 con 0x556c63e3c2a0 2024-09-18T02:05:19.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c63fbf350 con 0x556c63e3c2a0 2024-09-18T02:05:19.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efafbfff640 1 -- 172.21.15.167:0/3574535670 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efc040c23f0 con 0x556c63e3c2a0 2024-09-18T02:05:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efafbfff640 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efafc034650 0x7efafc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efafbfff640 1 -- 172.21.15.167:0/3574535670 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7efc040bc070 con 0x556c63e3c2a0 2024-09-18T02:05:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc134cf640 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efafc034650 0x7efafc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc161c0980 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556c63ecccf0 0x556c63fc2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c63fc34a0 con 0x556c63ecccf0 2024-09-18T02:05:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc144d1640 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556c63ecccf0 0x556c63fc2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc134cf640 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efafc034650 0x7efafc036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efc08000f70 tx=0x7efc080012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc144d1640 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556c63ecccf0 0x556c63fc2e30 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc144d1640 1 -- 172.21.15.167:0/3574535670 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ecccf0 2024-09-18T02:05:19.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c63fc0550 con 0x556c63ecccf0 2024-09-18T02:05:19.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc144d1640 1 -- 172.21.15.167:0/3574535670 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ecccf0 2024-09-18T02:05:19.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc161c0980 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556c63fc5820 0x556c63fc7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c63fc82e0 con 0x556c63fc5820 2024-09-18T02:05:19.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.515+0000 7efc13cd0640 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556c63fc5820 0x556c63fc7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc13cd0640 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556c63fc5820 0x556c63fc7c10 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc13cd0640 1 -- 172.21.15.167:0/3574535670 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efc040b5c70 con 0x556c63fc5820 2024-09-18T02:05:19.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c63fc46c0 con 0x556c63ecccf0 2024-09-18T02:05:19.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc144d1640 1 -- 172.21.15.167:0/3574535670 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ecccf0 2024-09-18T02:05:19.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc161c0980 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556c63fc9740 0x556c63fcbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c63fcc230 con 0x556c63fc9740 2024-09-18T02:05:19.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc134cf640 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556c63fc9740 0x556c63fcbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc134cf640 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556c63fc9740 0x556c63fcbb30 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc134cf640 1 -- 172.21.15.167:0/3574535670 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efc0800e620 con 0x556c63fc9740 2024-09-18T02:05:19.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc161c0980 1 Processor -- start 2024-09-18T02:05:19.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc161c0980 1 -- start start 2024-09-18T02:05:19.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc161c0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fd9d00 0x556c63fda120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc161c0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556c63dce800 con 0x556c63fd9d00 2024-09-18T02:05:19.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc13cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fd9d00 0x556c63fda120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc13cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fd9d00 0x556c63fda120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50980/0 (socket says 172.21.15.167:50980) 2024-09-18T02:05:19.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc13cd0640 1 -- 172.21.15.167:0/2923096771 learned_addr learned my addr 172.21.15.167:0/2923096771 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc13cd0640 1 -- 172.21.15.167:0/2923096771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c63fda660 con 0x556c63fd9d00 2024-09-18T02:05:19.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.519+0000 7efc13cd0640 1 --2- 172.21.15.167:0/2923096771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fd9d00 0x556c63fda120 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7efc040b6b20 tx=0x7efc040076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efaf97fa640 1 -- 172.21.15.167:0/2923096771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc040e2070 con 0x556c63fd9d00 2024-09-18T02:05:19.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efaf97fa640 1 -- 172.21.15.167:0/2923096771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc040c1a60 con 0x556c63fd9d00 2024-09-18T02:05:19.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc161c0980 1 -- 172.21.15.167:0/2923096771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c63fda8f0 con 0x556c63fd9d00 2024-09-18T02:05:19.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efaf97fa640 1 -- 172.21.15.167:0/2923096771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc040c1d40 con 0x556c63fd9d00 2024-09-18T02:05:19.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc161c0980 1 -- 172.21.15.167:0/2923096771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c63fdd570 con 0x556c63fd9d00 2024-09-18T02:05:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efaf97fa640 1 -- 172.21.15.167:0/2923096771 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efc040c26e0 con 0x556c63fd9d00 2024-09-18T02:05:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efaf97fa640 1 --2- 172.21.15.167:0/2923096771 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efaec0346a0 0x7efaec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efaf97fa640 1 -- 172.21.15.167:0/2923096771 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7efc040a8070 con 0x556c63fd9d00 2024-09-18T02:05:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc134cf640 1 --2- 172.21.15.167:0/2923096771 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efaec0346a0 0x7efaec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc161c0980 1 Processor -- start 2024-09-18T02:05:19.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc161c0980 1 -- start start 2024-09-18T02:05:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc134cf640 1 --2- 172.21.15.167:0/2923096771 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efaec0346a0 0x7efaec036b60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efc0800bf60 tx=0x7efc0800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc161c0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fe6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc161c0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556c63fb5560 con 0x556c63fe6650 2024-09-18T02:05:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc13cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fe6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc13cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fe6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50990/0 (socket says 172.21.15.167:50990) 2024-09-18T02:05:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc13cd0640 1 -- 172.21.15.167:0/2463287695 learned_addr learned my addr 172.21.15.167:0/2463287695 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc13cd0640 1 -- 172.21.15.167:0/2463287695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c63fe7020 con 0x556c63fe6650 2024-09-18T02:05:19.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efc13cd0640 1 --2- 172.21.15.167:0/2463287695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fe6a50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7efc040eefd0 tx=0x7efc040d5fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4140b06176f5e891 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efaf2ffd640 1 -- 172.21.15.167:0/2463287695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc040fb070 con 0x556c63fe6650 2024-09-18T02:05:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efaf2ffd640 1 -- 172.21.15.167:0/2463287695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc040bec50 con 0x556c63fe6650 2024-09-18T02:05:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.523+0000 7efaf2ffd640 1 -- 172.21.15.167:0/2463287695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc04007a40 con 0x556c63fe6650 2024-09-18T02:05:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 -- 172.21.15.167:0/2463287695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 msgr2=0x556c63fe6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 --2- 172.21.15.167:0/2463287695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fe6a50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7efc040eefd0 tx=0x7efc040d5fa0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 -- 172.21.15.167:0/2463287695 shutdown_connections 2024-09-18T02:05:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 --2- 172.21.15.167:0/2463287695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fe6a50 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.530 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 -- 172.21.15.167:0/2463287695 >> 172.21.15.167:0/2463287695 conn(0x556c63fe2a30 msgr2=0x556c63fe0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 -- 172.21.15.167:0/2463287695 shutdown_connections 2024-09-18T02:05:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 -- 172.21.15.167:0/2463287695 wait complete. 2024-09-18T02:05:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 Processor -- start 2024-09-18T02:05:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 -- start start 2024-09-18T02:05:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556c63fe74a0 con 0x556c63fe6650 2024-09-18T02:05:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc13cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc13cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fed7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50998/0 (socket says 172.21.15.167:50998) 2024-09-18T02:05:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 learned_addr learned my addr 172.21.15.167:0/274614198 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c63fedd30 con 0x556c63fe6650 2024-09-18T02:05:19.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc13cd0640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fed7f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efc040dde80 tx=0x7efc040bde90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efaf17fa640 1 -- 172.21.15.167:0/274614198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc040fb050 con 0x556c63fe6650 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efaf17fa640 1 -- 172.21.15.167:0/274614198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc040fc040 con 0x556c63fe6650 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c63fedd30 con 0x556c63fe6650 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efaf17fa640 1 -- 172.21.15.167:0/274614198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc040dd5d0 con 0x556c63fe6650 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c63fedd30 con 0x556c63fe6650 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efaf17fa640 1 -- 172.21.15.167:0/274614198 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efc04109020 con 0x556c63fe6650 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efaf17fa640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efadc034650 0x7efadc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.527+0000 7efaf17fa640 1 -- 172.21.15.167:0/274614198 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7efc04107020 con 0x556c63fe6650 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc134cf640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efadc034650 0x7efadc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556c63ff88f0 0x556c63ffad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffb4e0 con 0x556c63ff88f0 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc144d1640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556c63ff88f0 0x556c63ffad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc134cf640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efadc034650 0x7efadc036b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x556c63fc3dd0 tx=0x7efc08010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc144d1640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556c63ff88f0 0x556c63ffad90 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 20 realm 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffb8f0 con 0x556c63ff88f0 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc190 con 0x556c63ff88f0 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ff88f0 2024-09-18T02:05:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556c63ffd290 0x556c63fff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c63fffc00 con 0x556c63ffd290 2024-09-18T02:05:19.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc13cd0640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556c63ffd290 0x556c63fff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc13cd0640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556c63ffd290 0x556c63fff680 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 20 searching for the correct realm 2024-09-18T02:05:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556c64001b30 0x556c64003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c640046c0 con 0x556c64001b30 2024-09-18T02:05:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.531+0000 7efc134cf640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556c64001b30 0x556c64003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc134cf640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556c64001b30 0x556c64003ff0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc134cf640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efc08037040 0x7efc08036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c640046c0 con 0x7efc08037040 2024-09-18T02:05:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efc08037040 0x7efc08036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efc08037040 0x7efc08036410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x7efc08037040 2024-09-18T02:05:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ff88f0 2024-09-18T02:05:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ff88f0 2024-09-18T02:05:19.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ff88f0 2024-09-18T02:05:19.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ffd290 2024-09-18T02:05:19.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x7efc08037040 2024-09-18T02:05:19.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.535+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c64001b30 2024-09-18T02:05:19.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ff88f0 2024-09-18T02:05:19.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x7efc08037040 2024-09-18T02:05:19.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ff88f0 2024-09-18T02:05:19.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x7efc08037040 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c64001b30 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c64001b30 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ffd290 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c64001b30 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c64001b30 2024-09-18T02:05:19.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ff88f0 2024-09-18T02:05:19.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.539+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ff88f0 2024-09-18T02:05:19.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ffd290 2024-09-18T02:05:19.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c64001b30 2024-09-18T02:05:19.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x7efc08037040 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ff88f0 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ffd290 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c64001b30 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ffd290 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x7efc08037040 2024-09-18T02:05:19.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c64001b30 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.543+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ffd290 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x556c63ff88f0 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c63ffc530 con 0x7efc08037040 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:19.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c64000450 con 0x556c63ff88f0 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c64000450 con 0x556c63ff88f0 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c64000450 con 0x556c64001b30 2024-09-18T02:05:19.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 zone default found 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 4 Realm: () 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 zonegroup default 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c64000cf0 con 0x556c63ffd290 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c64006520 con 0x556c64001b30 2024-09-18T02:05:19.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c640068f0 con 0x556c64001b30 2024-09-18T02:05:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 started sync module instance, tier type = 2024-09-18T02:05:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:19.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.547+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c640059c0 con 0x7efc08037040 2024-09-18T02:05:19.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.551+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.551+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93924022574784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c640059c0 con 0x7efc08037040 2024-09-18T02:05:19.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.551+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c640073b0 con 0x556c63ff88f0 2024-09-18T02:05:19.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.551+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93924022574784] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.551+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.551+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93924022578880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c640059c0 con 0x556c63ff88f0 2024-09-18T02:05:19.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.551+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c64007df0 con 0x556c64001b30 2024-09-18T02:05:19.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.555+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93924022578880] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.555+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.555+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93924022572304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c64005930 con 0x556c64001b30 2024-09-18T02:05:19.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.555+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c64008bc0 con 0x7efc08037040 2024-09-18T02:05:19.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.555+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.555+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93924022584976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c64009460 con 0x7efc08037040 2024-09-18T02:05:19.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.555+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c64009e60 con 0x556c63ff88f0 2024-09-18T02:05:19.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.555+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93924022572304] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.559+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93924022584976] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.559+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.559+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93924022583776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c64008f60 con 0x556c63ff88f0 2024-09-18T02:05:19.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.559+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c6400a700 con 0x556c63ffd290 2024-09-18T02:05:19.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.559+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93924022583776] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.559+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.559+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93924022592080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c64008f60 con 0x556c63ffd290 2024-09-18T02:05:19.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.559+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c6400af50 con 0x556c63ffd290 2024-09-18T02:05:19.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93924022592080] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93924022589808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c6400b7a0 con 0x556c63ffd290 2024-09-18T02:05:19.566 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c6400c160 con 0x556c63ffd290 2024-09-18T02:05:19.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93924022598832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c6400c580 con 0x556c63ffd290 2024-09-18T02:05:19.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc161c0980 20 add_watcher() i=0 2024-09-18T02:05:19.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc161c0980 20 add_watcher() i=1 2024-09-18T02:05:19.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc161c0980 20 add_watcher() i=2 2024-09-18T02:05:19.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc161c0980 20 add_watcher() i=3 2024-09-18T02:05:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc161c0980 20 add_watcher() i=4 2024-09-18T02:05:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc161c0980 20 add_watcher() i=5 2024-09-18T02:05:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93924022589808] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.563+0000 7efc161c0980 20 add_watcher() i=6 2024-09-18T02:05:19.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93924022598832] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc161c0980 20 add_watcher() i=7 2024-09-18T02:05:19.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc161c0980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:19.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c6400c580 con 0x556c63ff88f0 2024-09-18T02:05:19.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93924022599888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c6400c4f0 con 0x556c63ff88f0 2024-09-18T02:05:19.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93924022599888] v32'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efaca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc161c0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc161c0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc161c0980 5 note: GC not initialized 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efac97e2640 20 reqs_thread_entry: start 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc161c0980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc161c0980 20 Filter name: none 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efac27fc640 20 reqs_thread_entry: start 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc161c0980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.567+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c64032700 con 0x556c63ff88f0 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.571+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.571+0000 7efc161c0980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:05:19.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.571+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c64033c50 con 0x556c63ffd290 2024-09-18T02:05:19.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.571+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.571+0000 7efaca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:19.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.571+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93924022599888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c64031310 con 0x556c63ff88f0 2024-09-18T02:05:19.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.571+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93924022599888] v32'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.571+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93924022574784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c6400c0d0 con 0x7efc08037040 2024-09-18T02:05:19.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.575+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93924022574784] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.575+0000 7efc161c0980 20 remove_watcher() i=0 2024-09-18T02:05:19.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.575+0000 7efc161c0980 2 removed watcher, disabling cache 2024-09-18T02:05:19.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.575+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93924022578880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c6400c0d0 con 0x556c63ff88f0 2024-09-18T02:05:19.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.575+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93924022578880] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.575+0000 7efc161c0980 20 remove_watcher() i=1 2024-09-18T02:05:19.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.575+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93924022572304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c6400c0d0 con 0x556c64001b30 2024-09-18T02:05:19.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.579+0000 7efc134cf640 1 -- 172.21.15.167:0/274614198 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93924022572304] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0800e620 con 0x556c64001b30 2024-09-18T02:05:19.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.579+0000 7efc161c0980 20 remove_watcher() i=2 2024-09-18T02:05:19.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.579+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93924022584976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c64005510 con 0x7efc08037040 2024-09-18T02:05:19.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.579+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93924022584976] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x7efc08037040 2024-09-18T02:05:19.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.579+0000 7efc161c0980 20 remove_watcher() i=3 2024-09-18T02:05:19.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.579+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93924022583776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c6400c0d0 con 0x556c63ff88f0 2024-09-18T02:05:19.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.583+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93924022583776] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc0c00a4d0 con 0x556c63ff88f0 2024-09-18T02:05:19.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.583+0000 7efc161c0980 20 remove_watcher() i=4 2024-09-18T02:05:19.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.583+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93924022592080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c64008690 con 0x556c63ffd290 2024-09-18T02:05:19.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.583+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93924022592080] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.583+0000 7efc161c0980 20 remove_watcher() i=5 2024-09-18T02:05:19.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.583+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93924022589808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c64005510 con 0x556c63ffd290 2024-09-18T02:05:19.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93924022589808] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 20 remove_watcher() i=6 2024-09-18T02:05:19.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93924022598832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c6400c0d0 con 0x556c63ffd290 2024-09-18T02:05:19.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc13cd0640 1 -- 172.21.15.167:0/274614198 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93924022598832] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc040fe070 con 0x556c63ffd290 2024-09-18T02:05:19.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 20 remove_watcher() i=7 2024-09-18T02:05:19.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556c63ffd290 msgr2=0x556c63fff680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556c63ffd290 0x556c63fff680 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556c63ff88f0 msgr2=0x556c63ffad90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556c63ff88f0 0x556c63ffad90 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efc08037040 msgr2=0x7efc08036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7efc08037040 0x7efc08036410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556c64001b30 msgr2=0x556c64003ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556c64001b30 0x556c64003ff0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efadc034650 msgr2=0x7efadc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efadc034650 0x7efadc036b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x556c63fc3dd0 tx=0x7efc08010000 comp rx=0 tx=0).stop 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 msgr2=0x556c63fed7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc144d1640 1 -- 172.21.15.167:0/274614198 reap_dead start 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fed7f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efc040dde80 tx=0x7efc040bde90 comp rx=0 tx=0).stop 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 shutdown_connections 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 --2- 172.21.15.167:0/274614198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fe6650 0x556c63fed7f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 >> 172.21.15.167:0/274614198 conn(0x556c63fe2a30 msgr2=0x556c63fe0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 shutdown_connections 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/274614198 wait complete. 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/2923096771 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efaec0346a0 msgr2=0x7efaec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 --2- 172.21.15.167:0/2923096771 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efaec0346a0 0x7efaec036b60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efc0800bf60 tx=0x7efc0800f000 comp rx=0 tx=0).stop 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/2923096771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fd9d00 msgr2=0x556c63fda120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 --2- 172.21.15.167:0/2923096771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fd9d00 0x556c63fda120 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7efc040b6b20 tx=0x7efc040076e0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/2923096771 shutdown_connections 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 --2- 172.21.15.167:0/2923096771 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efaec0346a0 0x7efaec036b60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 --2- 172.21.15.167:0/2923096771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63fd9d00 0x556c63fda120 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/2923096771 >> 172.21.15.167:0/2923096771 conn(0x556c63fcee50 msgr2=0x556c63fd18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/2923096771 shutdown_connections 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.587+0000 7efc161c0980 1 -- 172.21.15.167:0/2923096771 wait complete. 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556c63fc5820 msgr2=0x556c63fc7c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x556c63fc5820 0x556c63fc7c10 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556c63ecccf0 msgr2=0x556c63fc2e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x556c63ecccf0 0x556c63fc2e30 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556c63fc9740 msgr2=0x556c63fcbb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x556c63fc9740 0x556c63fcbb30 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efafc034650 msgr2=0x7efafc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7efafc034650 0x7efafc036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efc08000f70 tx=0x7efc080012c0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 msgr2=0x556c63fbbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 --2- 172.21.15.167:0/3574535670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63e3c2a0 0x556c63fbbea0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efc040b9040 tx=0x7efc04018020 comp rx=0 tx=0).stop 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc144d1640 1 -- 172.21.15.167:0/3574535670 reap_dead start 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 shutdown_connections 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 >> 172.21.15.167:0/3574535670 conn(0x556c63ec20a0 msgr2=0x556c63faf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 shutdown_connections 2024-09-18T02:05:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.591+0000 7efc161c0980 1 -- 172.21.15.167:0/3574535670 wait complete. 2024-09-18T02:05:19.603 INFO:teuthology.orchestra.run.smithi167.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-18T02:05:19.604 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-18T02:05:19.604 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-18T02:05:19.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-18T02:05:19.605 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-18T02:05:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:19.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.679+0000 7fa22612f980 1 Processor -- start 2024-09-18T02:05:19.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.679+0000 7fa22612f980 1 -- start start 2024-09-18T02:05:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.679+0000 7fa22612f980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x561be873f2a0 0x561be87cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.679+0000 7fa22612f980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561be8652ae0 con 0x561be87cfcf0 2024-09-18T02:05:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.679+0000 7fa22612f980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x561be8676e30 con 0x561be873f2a0 2024-09-18T02:05:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.679+0000 7fa223c3f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x561be873f2a0 0x561be87cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.679+0000 7fa22343e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x561be87cfcf0 0x561be87d20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33706/0 (socket says 172.21.15.167:33706) 2024-09-18T02:05:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.679+0000 7fa22343e640 1 -- 172.21.15.167:0/1603850835 learned_addr learned my addr 172.21.15.167:0/1603850835 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:05:19.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa223c3f640 1 -- 172.21.15.167:0/1603850835 >> v1:172.21.15.81:6789/0 conn(0x561be87cfcf0 legacy=0x561be87d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa223c3f640 1 -- 172.21.15.167:0/1603850835 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be873f680 con 0x561be873f2a0 2024-09-18T02:05:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa223c3f640 1 --2- 172.21.15.167:0/1603850835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be87cf7b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa21400a480 tx=0x7fa21401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb988c2b69d62867 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa222c3d640 1 -- 172.21.15.167:0/1603850835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140b0070 con 0x561be873f2a0 2024-09-18T02:05:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa222c3d640 1 -- 172.21.15.167:0/1603850835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2140ab540 con 0x561be873f2a0 2024-09-18T02:05:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa222c3d640 1 -- 172.21.15.167:0/1603850835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140ab840 con 0x561be873f2a0 2024-09-18T02:05:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa22612f980 1 -- 172.21.15.167:0/1603850835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 msgr2=0x561be87cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa22612f980 1 --2- 172.21.15.167:0/1603850835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be87cf7b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa21400a480 tx=0x7fa21401b280 comp rx=0 tx=0).stop 2024-09-18T02:05:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa22612f980 1 -- 172.21.15.167:0/1603850835 shutdown_connections 2024-09-18T02:05:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa22612f980 1 --2- 172.21.15.167:0/1603850835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be87cf7b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa22612f980 1 -- 172.21.15.167:0/1603850835 >> 172.21.15.167:0/1603850835 conn(0x561be87c50a0 msgr2=0x561be87c74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa22612f980 1 -- 172.21.15.167:0/1603850835 shutdown_connections 2024-09-18T02:05:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.683+0000 7fa22612f980 1 -- 172.21.15.167:0/1603850835 wait complete. 2024-09-18T02:05:19.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.699+0000 7fa22612f980 1 Processor -- start 2024-09-18T02:05:19.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.699+0000 7fa22612f980 1 -- start start 2024-09-18T02:05:19.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.699+0000 7fa22612f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be88b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.699+0000 7fa22612f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561be8678200 con 0x561be873f2a0 2024-09-18T02:05:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.699+0000 7fa223c3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be88b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.699+0000 7fa223c3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be88b7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51014/0 (socket says 172.21.15.167:51014) 2024-09-18T02:05:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.699+0000 7fa223c3f640 1 -- 172.21.15.167:0/3481692768 learned_addr learned my addr 172.21.15.167:0/3481692768 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa223c3f640 1 -- 172.21.15.167:0/3481692768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be88b8230 con 0x561be873f2a0 2024-09-18T02:05:19.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa223c3f640 1 --2- 172.21.15.167:0/3481692768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be88b7c60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa214018eb0 tx=0x7fa214003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4618afb6e6f88b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa111e0b640 1 -- 172.21.15.167:0/3481692768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140b0070 con 0x561be873f2a0 2024-09-18T02:05:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa111e0b640 1 -- 172.21.15.167:0/3481692768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2140b1040 con 0x561be873f2a0 2024-09-18T02:05:19.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa111e0b640 1 -- 172.21.15.167:0/3481692768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140ab6f0 con 0x561be873f2a0 2024-09-18T02:05:19.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 -- 172.21.15.167:0/3481692768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 msgr2=0x561be88b7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 --2- 172.21.15.167:0/3481692768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be88b7c60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa214018eb0 tx=0x7fa214003030 comp rx=0 tx=0).stop 2024-09-18T02:05:19.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 -- 172.21.15.167:0/3481692768 shutdown_connections 2024-09-18T02:05:19.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 --2- 172.21.15.167:0/3481692768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be88b7c60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 -- 172.21.15.167:0/3481692768 >> 172.21.15.167:0/3481692768 conn(0x561be87c50a0 msgr2=0x561be88b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 -- 172.21.15.167:0/3481692768 shutdown_connections 2024-09-18T02:05:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 -- 172.21.15.167:0/3481692768 wait complete. 2024-09-18T02:05:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 Processor -- start 2024-09-18T02:05:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 -- start start 2024-09-18T02:05:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be88bee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561be87d6230 con 0x561be873f2a0 2024-09-18T02:05:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa223c3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be88bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa223c3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be88bee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51016/0 (socket says 172.21.15.167:51016) 2024-09-18T02:05:19.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa223c3f640 1 -- 172.21.15.167:0/3037996252 learned_addr learned my addr 172.21.15.167:0/3037996252 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa223c3f640 1 -- 172.21.15.167:0/3037996252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be88bf390 con 0x561be873f2a0 2024-09-18T02:05:19.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa223c3f640 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be88bee50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa2140b9040 tx=0x7fa214018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa10bfff640 1 -- 172.21.15.167:0/3037996252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140b75b0 con 0x561be873f2a0 2024-09-18T02:05:19.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa10bfff640 1 -- 172.21.15.167:0/3037996252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2140b7750 con 0x561be873f2a0 2024-09-18T02:05:19.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be88bf620 con 0x561be873f2a0 2024-09-18T02:05:19.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa10bfff640 1 -- 172.21.15.167:0/3037996252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140b7a50 con 0x561be873f2a0 2024-09-18T02:05:19.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.703+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be88c2300 con 0x561be873f2a0 2024-09-18T02:05:19.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa10bfff640 1 -- 172.21.15.167:0/3037996252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa2140c23f0 con 0x561be873f2a0 2024-09-18T02:05:19.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa10bfff640 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa10c034650 0x7fa10c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa10bfff640 1 -- 172.21.15.167:0/3037996252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa2140bc070 con 0x561be873f2a0 2024-09-18T02:05:19.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa22343e640 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa10c034650 0x7fa10c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa22612f980 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561be87cfcf0 0x561be88c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be88c6420 con 0x561be87cfcf0 2024-09-18T02:05:19.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa224440640 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561be87cfcf0 0x561be88c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa22343e640 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa10c034650 0x7fa10c036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa218001da0 tx=0x7fa218001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa224440640 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561be87cfcf0 0x561be88c5de0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa224440640 1 -- 172.21.15.167:0/3037996252 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be87cfcf0 2024-09-18T02:05:19.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be88c3500 con 0x561be87cfcf0 2024-09-18T02:05:19.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa224440640 1 -- 172.21.15.167:0/3037996252 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be87cfcf0 2024-09-18T02:05:19.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa22612f980 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561be88c8750 0x561be88cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be88cb210 con 0x561be88c8750 2024-09-18T02:05:19.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.707+0000 7fa223c3f640 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561be88c8750 0x561be88cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa223c3f640 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561be88c8750 0x561be88cab40 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa223c3f640 1 -- 172.21.15.167:0/3037996252 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be88c8750 2024-09-18T02:05:19.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be88c75f0 con 0x561be87cfcf0 2024-09-18T02:05:19.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa224440640 1 -- 172.21.15.167:0/3037996252 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be87cfcf0 2024-09-18T02:05:19.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa22612f980 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561be88cc650 0x561be88cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be88cf1d0 con 0x561be88cc650 2024-09-18T02:05:19.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa22343e640 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561be88cc650 0x561be88cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa22343e640 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561be88cc650 0x561be88cea40 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa22343e640 1 -- 172.21.15.167:0/3037996252 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be88cc650 2024-09-18T02:05:19.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa22612f980 1 Processor -- start 2024-09-18T02:05:19.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa22612f980 1 -- start start 2024-09-18T02:05:19.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa22612f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88dcc60 0x561be88dd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa22612f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561be86d1800 con 0x561be88dcc60 2024-09-18T02:05:19.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa223c3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88dcc60 0x561be88dd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa223c3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88dcc60 0x561be88dd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51028/0 (socket says 172.21.15.167:51028) 2024-09-18T02:05:19.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa223c3f640 1 -- 172.21.15.167:0/518163862 learned_addr learned my addr 172.21.15.167:0/518163862 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa223c3f640 1 -- 172.21.15.167:0/518163862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be88dd5c0 con 0x561be88dcc60 2024-09-18T02:05:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.711+0000 7fa223c3f640 1 --2- 172.21.15.167:0/518163862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88dcc60 0x561be88dd080 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa21400a480 tx=0x7fa2140c1870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa1097fa640 1 -- 172.21.15.167:0/518163862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa214007600 con 0x561be88dcc60 2024-09-18T02:05:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa1097fa640 1 -- 172.21.15.167:0/518163862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2140e2120 con 0x561be88dcc60 2024-09-18T02:05:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa22612f980 1 -- 172.21.15.167:0/518163862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be88dd850 con 0x561be88dcc60 2024-09-18T02:05:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa1097fa640 1 -- 172.21.15.167:0/518163862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140b5810 con 0x561be88dcc60 2024-09-18T02:05:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa22612f980 1 -- 172.21.15.167:0/518163862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be88e04d0 con 0x561be88dcc60 2024-09-18T02:05:19.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa1097fa640 1 -- 172.21.15.167:0/518163862 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa2140c1a60 con 0x561be88dcc60 2024-09-18T02:05:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa1097fa640 1 --2- 172.21.15.167:0/518163862 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0fc0347f0 0x7fa0fc036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa1097fa640 1 -- 172.21.15.167:0/518163862 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa2140dc050 con 0x561be88dcc60 2024-09-18T02:05:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa22343e640 1 --2- 172.21.15.167:0/518163862 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0fc0347f0 0x7fa0fc036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa22612f980 1 Processor -- start 2024-09-18T02:05:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa22612f980 1 -- start start 2024-09-18T02:05:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa22343e640 1 --2- 172.21.15.167:0/518163862 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0fc0347f0 0x7fa0fc036cb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x561be88cf5d0 tx=0x7fa21800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa22612f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 0x561be88e9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa22612f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561be88b84f0 con 0x561be88e9510 2024-09-18T02:05:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa223c3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 0x561be88e9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa223c3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 0x561be88e9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51030/0 (socket says 172.21.15.167:51030) 2024-09-18T02:05:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa223c3f640 1 -- 172.21.15.167:0/2878228349 learned_addr learned my addr 172.21.15.167:0/2878228349 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa223c3f640 1 -- 172.21.15.167:0/2878228349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be88e9ee0 con 0x561be88e9510 2024-09-18T02:05:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa223c3f640 1 --2- 172.21.15.167:0/2878228349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 0x561be88e9910 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa2140eafd0 tx=0x7fa2140ca7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c208db849ee79952 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa102ffd640 1 -- 172.21.15.167:0/2878228349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140d6500 con 0x561be88e9510 2024-09-18T02:05:19.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa102ffd640 1 -- 172.21.15.167:0/2878228349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa214007f90 con 0x561be88e9510 2024-09-18T02:05:19.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.715+0000 7fa102ffd640 1 -- 172.21.15.167:0/2878228349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140b59b0 con 0x561be88e9510 2024-09-18T02:05:19.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 -- 172.21.15.167:0/2878228349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 msgr2=0x561be88e9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 --2- 172.21.15.167:0/2878228349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 0x561be88e9910 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa2140eafd0 tx=0x7fa2140ca7c0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 -- 172.21.15.167:0/2878228349 shutdown_connections 2024-09-18T02:05:19.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 --2- 172.21.15.167:0/2878228349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 0x561be88e9910 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 -- 172.21.15.167:0/2878228349 >> 172.21.15.167:0/2878228349 conn(0x561be88e5980 msgr2=0x561be88e3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 -- 172.21.15.167:0/2878228349 shutdown_connections 2024-09-18T02:05:19.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 -- 172.21.15.167:0/2878228349 wait complete. 2024-09-18T02:05:19.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 Processor -- start 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 -- start start 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 0x561be88f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561be88ea3f0 con 0x561be88e9510 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa223c3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 0x561be88f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa223c3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 0x561be88f06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51038/0 (socket says 172.21.15.167:51038) 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 learned_addr learned my addr 172.21.15.167:0/854128146 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be88f0c30 con 0x561be88e9510 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa223c3f640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 0x561be88f06f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa2140ccfd0 tx=0x7fa2140d2f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa1017fa640 1 -- 172.21.15.167:0/854128146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140c26e0 con 0x561be88e9510 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa1017fa640 1 -- 172.21.15.167:0/854128146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2140ca440 con 0x561be88e9510 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be88f0c30 con 0x561be88e9510 2024-09-18T02:05:19.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa1017fa640 1 -- 172.21.15.167:0/854128146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140c2880 con 0x561be88e9510 2024-09-18T02:05:19.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be88f1100 con 0x561be88e9510 2024-09-18T02:05:19.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa1017fa640 1 -- 172.21.15.167:0/854128146 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa2140be370 con 0x561be88e9510 2024-09-18T02:05:19.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.719+0000 7fa1017fa640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0ec0345b0 0x7fa0ec036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa1017fa640 1 -- 172.21.15.167:0/854128146 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa2140a8070 con 0x561be88e9510 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22343e640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0ec0345b0 0x7fa0ec036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561be88fb830 0x561be88fdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be88fe420 con 0x561be88fb830 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa224440640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561be88fb830 0x561be88fdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22343e640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0ec0345b0 0x7fa0ec036a70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa21800bb60 tx=0x7fa218010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa224440640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561be88fb830 0x561be88fdcd0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 20 realm 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be88fe830 con 0x561be88fb830 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff0d0 con 0x561be88fb830 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be88fb830 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:19.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561be89001d0 0x561be89025c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8902b40 con 0x561be89001d0 2024-09-18T02:05:19.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa223c3f640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561be89001d0 0x561be89025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa223c3f640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561be89001d0 0x561be89025c0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 20 searching for the correct realm 2024-09-18T02:05:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561be8904a70 0x561be8906f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8907600 con 0x561be8904a70 2024-09-18T02:05:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.723+0000 7fa22343e640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561be8904a70 0x561be8906f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa22343e640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561be8904a70 0x561be8906f30 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa22343e640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa218037040 0x7fa218036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8907600 con 0x7fa218037040 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa218037040 0x7fa218036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa218037040 0x7fa218036410 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x7fa218037040 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be88fb830 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be88fb830 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be88fb830 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be89001d0 2024-09-18T02:05:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x7fa218037040 2024-09-18T02:05:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.727+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be8904a70 2024-09-18T02:05:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be88fb830 2024-09-18T02:05:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x7fa218037040 2024-09-18T02:05:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be88fb830 2024-09-18T02:05:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x7fa218037040 2024-09-18T02:05:19.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be8904a70 2024-09-18T02:05:19.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be8904a70 2024-09-18T02:05:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be89001d0 2024-09-18T02:05:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be8904a70 2024-09-18T02:05:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be8904a70 2024-09-18T02:05:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be88fb830 2024-09-18T02:05:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be88fb830 2024-09-18T02:05:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.731+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be89001d0 2024-09-18T02:05:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be8904a70 2024-09-18T02:05:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x7fa218037040 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be88fb830 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be89001d0 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be8904a70 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be89001d0 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x7fa218037040 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be8904a70 2024-09-18T02:05:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.735+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be89001d0 2024-09-18T02:05:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x561be88fb830 2024-09-18T02:05:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be88ff470 con 0x7fa218037040 2024-09-18T02:05:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8903390 con 0x561be88fb830 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8903390 con 0x561be88fb830 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8903390 con 0x561be8904a70 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 zone default found 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 4 Realm: () 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 zonegroup default 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8903c30 con 0x561be89001d0 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8909460 con 0x561be8904a70 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.739+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8909800 con 0x561be8904a70 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa22612f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa22612f980 20 started sync module instance, tier type = 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa22612f980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8908900 con 0x7fa218037040 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94677865893376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8908900 con 0x7fa218037040 2024-09-18T02:05:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890a210 con 0x561be88fb830 2024-09-18T02:05:19.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94677865893376] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94677865897584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8908900 con 0x561be88fb830 2024-09-18T02:05:19.752 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.743+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890ac20 con 0x561be8904a70 2024-09-18T02:05:19.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.747+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94677865897584] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.747+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.747+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94677865890896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8908870 con 0x561be8904a70 2024-09-18T02:05:19.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.747+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890b970 con 0x7fa218037040 2024-09-18T02:05:19.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.747+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.747+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94677865903568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890c240 con 0x7fa218037040 2024-09-18T02:05:19.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.747+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890cc00 con 0x561be88fb830 2024-09-18T02:05:19.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.751+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94677865890896] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.751+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94677865903568] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.751+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.751+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94677865908048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890cb70 con 0x561be88fb830 2024-09-18T02:05:19.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.751+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890c180 con 0x561be89001d0 2024-09-18T02:05:19.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.751+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94677865908048] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.755+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.755+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94677865905360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890d4a0 con 0x561be89001d0 2024-09-18T02:05:19.757 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.755+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890dcf0 con 0x561be89001d0 2024-09-18T02:05:19.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.755+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94677865905360] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.755+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.755+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94677865910256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890e540 con 0x561be89001d0 2024-09-18T02:05:19.759 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.755+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890ef00 con 0x561be89001d0 2024-09-18T02:05:19.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94677865910256] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94677865917008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890f320 con 0x561be89001d0 2024-09-18T02:05:19.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 20 add_watcher() i=0 2024-09-18T02:05:19.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 20 add_watcher() i=1 2024-09-18T02:05:19.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 20 add_watcher() i=2 2024-09-18T02:05:19.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 20 add_watcher() i=3 2024-09-18T02:05:19.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 20 add_watcher() i=4 2024-09-18T02:05:19.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 20 add_watcher() i=5 2024-09-18T02:05:19.762 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 20 add_watcher() i=6 2024-09-18T02:05:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94677865917008] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 20 add_watcher() i=7 2024-09-18T02:05:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be89125a0 con 0x561be88fb830 2024-09-18T02:05:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.759+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94677865918432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890f8b0 con 0x561be88fb830 2024-09-18T02:05:19.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94677865918432] v32'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa0d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:19.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa22612f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:19.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa22612f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:19.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa22612f980 5 note: GC not initialized 2024-09-18T02:05:19.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa0d8fe1640 20 reqs_thread_entry: start 2024-09-18T02:05:19.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa22612f980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:19.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa22612f980 20 Filter name: none 2024-09-18T02:05:19.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa0527fc640 20 reqs_thread_entry: start 2024-09-18T02:05:19.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa22612f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be89357d0 con 0x561be88fb830 2024-09-18T02:05:19.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa22612f980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:05:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8936d20 con 0x561be89001d0 2024-09-18T02:05:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.763+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.767+0000 7fa0d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.767+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94677865918432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8933f30 con 0x561be88fb830 2024-09-18T02:05:19.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.767+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94677865918432] v32'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.767+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94677865893376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890efe0 con 0x7fa218037040 2024-09-18T02:05:19.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.767+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94677865893376] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.767+0000 7fa22612f980 20 remove_watcher() i=0 2024-09-18T02:05:19.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.767+0000 7fa22612f980 2 removed watcher, disabling cache 2024-09-18T02:05:19.772 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.767+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94677865897584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890efe0 con 0x561be88fb830 2024-09-18T02:05:19.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.771+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94677865897584] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.771+0000 7fa22612f980 20 remove_watcher() i=1 2024-09-18T02:05:19.774 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.771+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94677865890896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8909e70 con 0x561be8904a70 2024-09-18T02:05:19.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.771+0000 7fa22343e640 1 -- 172.21.15.167:0/854128146 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94677865890896] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21800e6c0 con 0x561be8904a70 2024-09-18T02:05:19.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.771+0000 7fa22612f980 20 remove_watcher() i=2 2024-09-18T02:05:19.776 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.771+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94677865903568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890efe0 con 0x7fa218037040 2024-09-18T02:05:19.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.775+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94677865903568] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x7fa218037040 2024-09-18T02:05:19.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.775+0000 7fa22612f980 20 remove_watcher() i=3 2024-09-18T02:05:19.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.775+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94677865908048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8908450 con 0x561be88fb830 2024-09-18T02:05:19.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.775+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94677865908048] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x561be88fb830 2024-09-18T02:05:19.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.775+0000 7fa22612f980 20 remove_watcher() i=4 2024-09-18T02:05:19.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.775+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94677865905360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8909e70 con 0x561be89001d0 2024-09-18T02:05:19.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.779+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94677865905360] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.779+0000 7fa22612f980 20 remove_watcher() i=5 2024-09-18T02:05:19.782 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.779+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94677865910256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890b5d0 con 0x561be89001d0 2024-09-18T02:05:19.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.779+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94677865910256] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.779+0000 7fa22612f980 20 remove_watcher() i=6 2024-09-18T02:05:19.784 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.779+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94677865917008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be890efe0 con 0x561be89001d0 2024-09-18T02:05:19.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa223c3f640 1 -- 172.21.15.167:0/854128146 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94677865917008] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2140b5c70 con 0x561be89001d0 2024-09-18T02:05:19.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 20 remove_watcher() i=7 2024-09-18T02:05:19.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561be89001d0 msgr2=0x561be89025c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561be89001d0 0x561be89025c0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561be88fb830 msgr2=0x561be88fdcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561be88fb830 0x561be88fdcd0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa218037040 msgr2=0x7fa218036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa218037040 0x7fa218036410 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.788 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561be8904a70 msgr2=0x561be8906f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561be8904a70 0x561be8906f30 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0ec0345b0 msgr2=0x7fa0ec036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0ec0345b0 0x7fa0ec036a70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa21800bb60 tx=0x7fa218010000 comp rx=0 tx=0).stop 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 msgr2=0x561be88f06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/854128146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88e9510 0x561be88f06f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa2140ccfd0 tx=0x7fa2140d2f60 comp rx=0 tx=0).stop 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa224440640 1 -- 172.21.15.167:0/854128146 reap_dead start 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 shutdown_connections 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 >> 172.21.15.167:0/854128146 conn(0x561be88e5980 msgr2=0x561be88e3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 shutdown_connections 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/854128146 wait complete. 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/518163862 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0fc0347f0 msgr2=0x7fa0fc036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/518163862 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0fc0347f0 0x7fa0fc036cb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x561be88cf5d0 tx=0x7fa21800f000 comp rx=0 tx=0).stop 2024-09-18T02:05:19.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/518163862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88dcc60 msgr2=0x561be88dd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/518163862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88dcc60 0x561be88dd080 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa21400a480 tx=0x7fa2140c1870 comp rx=0 tx=0).stop 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/518163862 shutdown_connections 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/518163862 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa0fc0347f0 0x7fa0fc036cb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/518163862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be88dcc60 0x561be88dd080 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/518163862 >> 172.21.15.167:0/518163862 conn(0x561be88d1db0 msgr2=0x561be88d4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/518163862 shutdown_connections 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/518163862 wait complete. 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561be88c8750 msgr2=0x561be88cab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561be88c8750 0x561be88cab40 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561be87cfcf0 msgr2=0x561be88c5de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561be87cfcf0 0x561be88c5de0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561be88cc650 msgr2=0x561be88cea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561be88cc650 0x561be88cea40 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa10c034650 msgr2=0x7fa10c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa10c034650 0x7fa10c036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa218001da0 tx=0x7fa218001300 comp rx=0 tx=0).stop 2024-09-18T02:05:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 msgr2=0x561be88bee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 --2- 172.21.15.167:0/3037996252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561be873f2a0 0x561be88bee50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa2140b9040 tx=0x7fa214018020 comp rx=0 tx=0).stop 2024-09-18T02:05:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa224440640 1 -- 172.21.15.167:0/3037996252 reap_dead start 2024-09-18T02:05:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 shutdown_connections 2024-09-18T02:05:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 >> 172.21.15.167:0/3037996252 conn(0x561be87c50a0 msgr2=0x561be88b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 shutdown_connections 2024-09-18T02:05:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.783+0000 7fa22612f980 1 -- 172.21.15.167:0/3037996252 wait complete. 2024-09-18T02:05:19.798 INFO:teuthology.orchestra.run.smithi167.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-18T02:05:19.799 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-18T02:05:19.799 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-18T02:05:19.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-18T02:05:19.799 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-18T02:05:19.879 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:19.879 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:19.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.875+0000 7ff1169a2980 1 Processor -- start 2024-09-18T02:05:19.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.875+0000 7ff1169a2980 1 -- start start 2024-09-18T02:05:19.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.875+0000 7ff1169a2980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x555b4c794ed0 0x555b4c7972c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.875+0000 7ff1169a2980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555b4c616ae0 con 0x555b4c7032a0 2024-09-18T02:05:19.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.875+0000 7ff1169a2980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x555b4c63ae30 con 0x555b4c794ed0 2024-09-18T02:05:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.875+0000 7ff113cb1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x555b4c794ed0 0x555b4c7972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.875+0000 7ff1144b2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x555b4c7032a0 0x555b4c7937b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33714/0 (socket says 172.21.15.167:33714) 2024-09-18T02:05:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff1144b2640 1 -- 172.21.15.167:0/2446531619 learned_addr learned my addr 172.21.15.167:0/2446531619 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:05:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff113cb1640 1 -- 172.21.15.167:0/2446531619 >> v1:172.21.15.81:6789/0 conn(0x555b4c7032a0 legacy=0x555b4c7937b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff113cb1640 1 -- 172.21.15.167:0/2446531619 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4c703680 con 0x555b4c794ed0 2024-09-18T02:05:19.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff113cb1640 1 --2- 172.21.15.167:0/2446531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c794ed0 0x555b4c7972c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00a480 tx=0x7ff0fc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3154ff1e411f1038 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff1134b0640 1 -- 172.21.15.167:0/2446531619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0b0070 con 0x555b4c794ed0 2024-09-18T02:05:19.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff1134b0640 1 -- 172.21.15.167:0/2446531619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0ab540 con 0x555b4c794ed0 2024-09-18T02:05:19.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff1134b0640 1 -- 172.21.15.167:0/2446531619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0ab840 con 0x555b4c794ed0 2024-09-18T02:05:19.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff1169a2980 1 -- 172.21.15.167:0/2446531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c794ed0 msgr2=0x555b4c7972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff1169a2980 1 --2- 172.21.15.167:0/2446531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c794ed0 0x555b4c7972c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00a480 tx=0x7ff0fc01b280 comp rx=0 tx=0).stop 2024-09-18T02:05:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff1169a2980 1 -- 172.21.15.167:0/2446531619 shutdown_connections 2024-09-18T02:05:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff1169a2980 1 --2- 172.21.15.167:0/2446531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c794ed0 0x555b4c7972c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff1169a2980 1 -- 172.21.15.167:0/2446531619 >> 172.21.15.167:0/2446531619 conn(0x555b4c7890a0 msgr2=0x555b4c78b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff1169a2980 1 -- 172.21.15.167:0/2446531619 shutdown_connections 2024-09-18T02:05:19.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.879+0000 7ff1169a2980 1 -- 172.21.15.167:0/2446531619 wait complete. 2024-09-18T02:05:19.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.895+0000 7ff1169a2980 1 Processor -- start 2024-09-18T02:05:19.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.895+0000 7ff1169a2980 1 -- start start 2024-09-18T02:05:19.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.895+0000 7ff1169a2980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 0x555b4c87bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.895+0000 7ff1169a2980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555b4c63c200 con 0x555b4c7032a0 2024-09-18T02:05:19.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.895+0000 7ff1144b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 0x555b4c87bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.895+0000 7ff1144b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 0x555b4c87bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51066/0 (socket says 172.21.15.167:51066) 2024-09-18T02:05:19.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.895+0000 7ff1144b2640 1 -- 172.21.15.167:0/4090190069 learned_addr learned my addr 172.21.15.167:0/4090190069 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1144b2640 1 -- 172.21.15.167:0/4090190069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4c87c300 con 0x555b4c7032a0 2024-09-18T02:05:19.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1144b2640 1 --2- 172.21.15.167:0/4090190069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 0x555b4c87bd30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff1040017b0 tx=0x7ff104001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c84323be424c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff00260c640 1 -- 172.21.15.167:0/4090190069 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff104016070 con 0x555b4c7032a0 2024-09-18T02:05:19.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff00260c640 1 -- 172.21.15.167:0/4090190069 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff104004530 con 0x555b4c7032a0 2024-09-18T02:05:19.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff00260c640 1 -- 172.21.15.167:0/4090190069 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff104004870 con 0x555b4c7032a0 2024-09-18T02:05:19.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 -- 172.21.15.167:0/4090190069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 msgr2=0x555b4c87bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 --2- 172.21.15.167:0/4090190069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 0x555b4c87bd30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff1040017b0 tx=0x7ff104001c70 comp rx=0 tx=0).stop 2024-09-18T02:05:19.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 -- 172.21.15.167:0/4090190069 shutdown_connections 2024-09-18T02:05:19.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 --2- 172.21.15.167:0/4090190069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 0x555b4c87bd30 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 -- 172.21.15.167:0/4090190069 >> 172.21.15.167:0/4090190069 conn(0x555b4c7890a0 msgr2=0x555b4c877960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 -- 172.21.15.167:0/4090190069 shutdown_connections 2024-09-18T02:05:19.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 -- 172.21.15.167:0/4090190069 wait complete. 2024-09-18T02:05:19.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 Processor -- start 2024-09-18T02:05:19.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 -- start start 2024-09-18T02:05:19.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 0x555b4c883040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555b4c79a230 con 0x555b4c7032a0 2024-09-18T02:05:19.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1144b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 0x555b4c883040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1144b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 0x555b4c883040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51072/0 (socket says 172.21.15.167:51072) 2024-09-18T02:05:19.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1144b2640 1 -- 172.21.15.167:0/3562362322 learned_addr learned my addr 172.21.15.167:0/3562362322 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1144b2640 1 -- 172.21.15.167:0/3562362322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4c883580 con 0x555b4c7032a0 2024-09-18T02:05:19.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1144b2640 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 0x555b4c883040 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff104000f90 tx=0x7ff104001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff000e09640 1 -- 172.21.15.167:0/3562362322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff104020070 con 0x555b4c7032a0 2024-09-18T02:05:19.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff000e09640 1 -- 172.21.15.167:0/3562362322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff104011400 con 0x555b4c7032a0 2024-09-18T02:05:19.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4c883810 con 0x555b4c7032a0 2024-09-18T02:05:19.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff000e09640 1 -- 172.21.15.167:0/3562362322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff104016040 con 0x555b4c7032a0 2024-09-18T02:05:19.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.899+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4c8864f0 con 0x555b4c7032a0 2024-09-18T02:05:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff000e09640 1 -- 172.21.15.167:0/3562362322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff104023070 con 0x555b4c7032a0 2024-09-18T02:05:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff000e09640 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7feffc034650 0x7feffc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff000e09640 1 -- 172.21.15.167:0/3562362322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff104049180 con 0x555b4c7032a0 2024-09-18T02:05:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff113cb1640 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7feffc034650 0x7feffc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x555b4c794ed0 0x555b4c88a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c88a680 con 0x555b4c794ed0 2024-09-18T02:05:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff114cb3640 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x555b4c794ed0 0x555b4c88a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff113cb1640 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7feffc034650 0x7feffc036b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0ad000 tx=0x7ff0fc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff114cb3640 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x555b4c794ed0 0x555b4c88a140 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff114cb3640 1 -- 172.21.15.167:0/3562362322 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10c0083f0 con 0x555b4c794ed0 2024-09-18T02:05:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8876f0 con 0x555b4c794ed0 2024-09-18T02:05:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff114cb3640 1 -- 172.21.15.167:0/3562362322 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff10c0083f0 con 0x555b4c794ed0 2024-09-18T02:05:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x555b4c88c950 0x555b4c88ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c88f410 con 0x555b4c88c950 2024-09-18T02:05:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff1144b2640 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x555b4c88c950 0x555b4c88ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.903+0000 7ff1144b2640 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x555b4c88c950 0x555b4c88ed40 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1144b2640 1 -- 172.21.15.167:0/3562362322 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff10402c070 con 0x555b4c88c950 2024-09-18T02:05:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c88b7c0 con 0x555b4c794ed0 2024-09-18T02:05:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff114cb3640 1 -- 172.21.15.167:0/3562362322 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff10c0083f0 con 0x555b4c794ed0 2024-09-18T02:05:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555b4c890870 0x555b4c892c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c893350 con 0x555b4c890870 2024-09-18T02:05:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff113cb1640 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555b4c890870 0x555b4c892c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff113cb1640 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555b4c890870 0x555b4c892c60 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff113cb1640 1 -- 172.21.15.167:0/3562362322 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0fc0ab8a0 con 0x555b4c890870 2024-09-18T02:05:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1169a2980 1 Processor -- start 2024-09-18T02:05:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1169a2980 1 -- start start 2024-09-18T02:05:19.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1169a2980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8a0e00 0x555b4c8a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1169a2980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555b4c695800 con 0x555b4c8a0e00 2024-09-18T02:05:19.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1144b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8a0e00 0x555b4c8a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1144b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8a0e00 0x555b4c8a1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51076/0 (socket says 172.21.15.167:51076) 2024-09-18T02:05:19.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1144b2640 1 -- 172.21.15.167:0/3819510475 learned_addr learned my addr 172.21.15.167:0/3819510475 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1144b2640 1 -- 172.21.15.167:0/3819510475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4c8a1760 con 0x555b4c8a0e00 2024-09-18T02:05:19.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1144b2640 1 --2- 172.21.15.167:0/3819510475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8a0e00 0x555b4c8a1220 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff1040475c0 tx=0x7ff104023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7feff9ffb640 1 -- 172.21.15.167:0/3819510475 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff10402a040 con 0x555b4c8a0e00 2024-09-18T02:05:19.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1169a2980 1 -- 172.21.15.167:0/3819510475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4c8a19f0 con 0x555b4c8a0e00 2024-09-18T02:05:19.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7feff9ffb640 1 -- 172.21.15.167:0/3819510475 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff104023db0 con 0x555b4c8a0e00 2024-09-18T02:05:19.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7feff9ffb640 1 -- 172.21.15.167:0/3819510475 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff10402a420 con 0x555b4c8a0e00 2024-09-18T02:05:19.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.907+0000 7ff1169a2980 1 -- 172.21.15.167:0/3819510475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4c8a4670 con 0x555b4c8a0e00 2024-09-18T02:05:19.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7feff9ffb640 1 -- 172.21.15.167:0/3819510475 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff104011850 con 0x555b4c8a0e00 2024-09-18T02:05:19.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7feff9ffb640 1 --2- 172.21.15.167:0/3819510475 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fefec034650 0x7fefec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7feff9ffb640 1 -- 172.21.15.167:0/3819510475 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff104036070 con 0x555b4c8a0e00 2024-09-18T02:05:19.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff113cb1640 1 --2- 172.21.15.167:0/3819510475 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fefec034650 0x7fefec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1169a2980 1 Processor -- start 2024-09-18T02:05:19.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1169a2980 1 -- start start 2024-09-18T02:05:19.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff113cb1640 1 --2- 172.21.15.167:0/3819510475 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fefec034650 0x7fefec036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x555b4c88af00 tx=0x7ff0fc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1169a2980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 0x555b4c8adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1169a2980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555b4c87c680 con 0x555b4c8ad800 2024-09-18T02:05:19.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1144b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 0x555b4c8adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1144b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 0x555b4c8adbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51082/0 (socket says 172.21.15.167:51082) 2024-09-18T02:05:19.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1144b2640 1 -- 172.21.15.167:0/48137015 learned_addr learned my addr 172.21.15.167:0/48137015 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1144b2640 1 -- 172.21.15.167:0/48137015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4c8ae1b0 con 0x555b4c8ad800 2024-09-18T02:05:19.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1144b2640 1 --2- 172.21.15.167:0/48137015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 0x555b4c8adbe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff10403dfd0 tx=0x7ff10402f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e559a4182ae57454 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7feff37fe640 1 -- 172.21.15.167:0/48137015 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff104011b40 con 0x555b4c8ad800 2024-09-18T02:05:19.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7feff37fe640 1 -- 172.21.15.167:0/48137015 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff104058070 con 0x555b4c8ad800 2024-09-18T02:05:19.916 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7feff37fe640 1 -- 172.21.15.167:0/48137015 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff104040bf0 con 0x555b4c8ad800 2024-09-18T02:05:19.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1169a2980 1 -- 172.21.15.167:0/48137015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 msgr2=0x555b4c8adbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1169a2980 1 --2- 172.21.15.167:0/48137015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 0x555b4c8adbe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff10403dfd0 tx=0x7ff10402f440 comp rx=0 tx=0).stop 2024-09-18T02:05:19.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1169a2980 1 -- 172.21.15.167:0/48137015 shutdown_connections 2024-09-18T02:05:19.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1169a2980 1 --2- 172.21.15.167:0/48137015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 0x555b4c8adbe0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1169a2980 1 -- 172.21.15.167:0/48137015 >> 172.21.15.167:0/48137015 conn(0x555b4c8a9b30 msgr2=0x555b4c8a7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1169a2980 1 -- 172.21.15.167:0/48137015 shutdown_connections 2024-09-18T02:05:19.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.911+0000 7ff1169a2980 1 -- 172.21.15.167:0/48137015 wait complete. 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1169a2980 1 Processor -- start 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1169a2980 1 -- start start 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1169a2980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 0x555b4c8b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1169a2980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555b4c8ae540 con 0x555b4c8ad800 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1144b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 0x555b4c8b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1144b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 0x555b4c8b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51090/0 (socket says 172.21.15.167:51090) 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 learned_addr learned my addr 172.21.15.167:0/2469837345 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4c8b4e00 con 0x555b4c8ad800 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1144b2640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 0x555b4c8b48c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff104026ae0 tx=0x7ff10402fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7feff1ffb640 1 -- 172.21.15.167:0/2469837345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1040409c0 con 0x555b4c8ad800 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4c8b4e00 con 0x555b4c8ad800 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7feff1ffb640 1 -- 172.21.15.167:0/2469837345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff104040bf0 con 0x555b4c8ad800 2024-09-18T02:05:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7feff1ffb640 1 -- 172.21.15.167:0/2469837345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff104025850 con 0x555b4c8ad800 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4c8b52d0 con 0x555b4c8ad800 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7feff1ffb640 1 -- 172.21.15.167:0/2469837345 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1040259f0 con 0x555b4c8ad800 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7feff1ffb640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fefe4034650 0x7fefe4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7feff1ffb640 1 -- 172.21.15.167:0/2469837345 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff104072ba0 con 0x555b4c8ad800 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff113cb1640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fefe4034650 0x7fefe4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1169a2980 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x555b4c8bf950 0x555b4c8c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c2540 con 0x555b4c8bf950 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff114cb3640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x555b4c8bf950 0x555b4c8c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff114cb3640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x555b4c8bf950 0x555b4c8c1df0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.915+0000 7ff113cb1640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fefe4034650 0x7fefe4036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc01b2c0 tx=0x7ff0fc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10c0083f0 con 0x555b4c8bf950 2024-09-18T02:05:19.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 20 realm 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c2950 con 0x555b4c8bf950 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10c0083f0 con 0x555b4c8bf950 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c31f0 con 0x555b4c8bf950 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10c0083f0 con 0x555b4c8bf950 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x555b4c8bf950 2024-09-18T02:05:19.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff10c0083f0 con 0x555b4c8bf950 2024-09-18T02:05:19.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:19.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x555b4c8c42f0 0x555b4c8c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c6c60 con 0x555b4c8c42f0 2024-09-18T02:05:19.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1144b2640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x555b4c8c42f0 0x555b4c8c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1144b2640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x555b4c8c42f0 0x555b4c8c66e0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:19.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 20 searching for the correct realm 2024-09-18T02:05:19.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555b4c8c8bb0 0x555b4c8cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cb740 con 0x555b4c8c8bb0 2024-09-18T02:05:19.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff113cb1640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555b4c8c8bb0 0x555b4c8cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff113cb1640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555b4c8c8bb0 0x555b4c8cb070 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff113cb1640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff0fc0cf040 0x7ff0fc0dc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:19.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cb740 con 0x7ff0fc0cf040 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.919+0000 7ff114cb3640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff0fc0cf040 0x7ff0fc0dc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff0fc0cf040 0x7ff0fc0dc410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c0083f0 con 0x7ff0fc0cf040 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x7ff0fc0cf040 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c0083f0 con 0x7ff0fc0cf040 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x555b4c8bf950 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x555b4c8bf950 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x555b4c8bf950 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x555b4c8c42f0 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x7ff0fc0cf040 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x555b4c8c8bb0 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x555b4c8bf950 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x7ff0fc0cf040 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x555b4c8bf950 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x7ff0fc0cf040 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.923+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c3590 con 0x555b4c8c8bb0 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8c8bb0 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8c42f0 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8c8bb0 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8c8bb0 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8bf950 2024-09-18T02:05:19.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8bf950 2024-09-18T02:05:19.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8c42f0 2024-09-18T02:05:19.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8c8bb0 2024-09-18T02:05:19.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x7ff0fc0cf040 2024-09-18T02:05:19.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8bf950 2024-09-18T02:05:19.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.927+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8c42f0 2024-09-18T02:05:19.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8c8bb0 2024-09-18T02:05:19.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8c42f0 2024-09-18T02:05:19.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x7ff0fc0cf040 2024-09-18T02:05:19.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8c8bb0 2024-09-18T02:05:19.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8c42f0 2024-09-18T02:05:19.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x555b4c8bf950 2024-09-18T02:05:19.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0fc0e9080 con 0x7ff0fc0cf040 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c74b0 con 0x555b4c8bf950 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c74b0 con 0x555b4c8bf950 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.931+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c74b0 con 0x555b4c8c8bb0 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 20 zone default found 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 4 Realm: () 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:19.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 20 zonegroup default 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8c7d50 con 0x555b4c8c42f0 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cd5a0 con 0x555b4c8c8bb0 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cd940 con 0x555b4c8c8bb0 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:19.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 20 started sync module instance, tier type = 2024-09-18T02:05:19.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:19.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cca40 con 0x7ff0fc0cf040 2024-09-18T02:05:19.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93850614681456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cca40 con 0x7ff0fc0cf040 2024-09-18T02:05:19.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8ce300 con 0x555b4c8bf950 2024-09-18T02:05:19.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.935+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93850614681456] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.939+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.939+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93850614685536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cca40 con 0x555b4c8bf950 2024-09-18T02:05:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.939+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8ced10 con 0x555b4c8c8bb0 2024-09-18T02:05:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.939+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93850614685536] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.939+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.939+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93850614678928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cc9b0 con 0x555b4c8c8bb0 2024-09-18T02:05:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.939+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cfa10 con 0x7ff0fc0cf040 2024-09-18T02:05:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.943+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.943+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93850614691440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d02b0 con 0x7ff0fc0cf040 2024-09-18T02:05:19.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.943+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d0c70 con 0x555b4c8bf950 2024-09-18T02:05:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.943+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93850614678928] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.943+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93850614691440] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.943+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.943+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93850614693296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d01d0 con 0x555b4c8bf950 2024-09-18T02:05:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.943+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d1120 con 0x555b4c8c42f0 2024-09-18T02:05:19.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.947+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.947+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93850614697072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d1970 con 0x555b4c8c42f0 2024-09-18T02:05:19.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.947+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d2330 con 0x555b4c8c42f0 2024-09-18T02:05:19.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.947+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93850614693296] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.947+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.947+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93850614697072] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.947+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93850614695872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d2b80 con 0x555b4c8c42f0 2024-09-18T02:05:19.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.947+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d14c0 con 0x555b4c8c42f0 2024-09-18T02:05:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93850614705952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d37f0 con 0x555b4c8c42f0 2024-09-18T02:05:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 20 add_watcher() i=0 2024-09-18T02:05:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 20 add_watcher() i=1 2024-09-18T02:05:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 20 add_watcher() i=2 2024-09-18T02:05:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 20 add_watcher() i=3 2024-09-18T02:05:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 20 add_watcher() i=4 2024-09-18T02:05:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 20 add_watcher() i=5 2024-09-18T02:05:19.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93850614695872] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 20 add_watcher() i=6 2024-09-18T02:05:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93850614705952] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 20 add_watcher() i=7 2024-09-18T02:05:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d6820 con 0x555b4c8bf950 2024-09-18T02:05:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.951+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93850614707008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d3c10 con 0x555b4c8bf950 2024-09-18T02:05:19.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93850614707008] v32'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7fefca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:19.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff1169a2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:19.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff1169a2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff1169a2980 5 note: GC not initialized 2024-09-18T02:05:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7fefc97e2640 20 reqs_thread_entry: start 2024-09-18T02:05:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff1169a2980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff1169a2980 20 Filter name: none 2024-09-18T02:05:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7fef3affd640 20 reqs_thread_entry: start 2024-09-18T02:05:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff1169a2980 20 rados->read ofs=0 len=0 2024-09-18T02:05:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8f9800 con 0x555b4c8bf950 2024-09-18T02:05:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff1169a2980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:05:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8fad50 con 0x555b4c8c42f0 2024-09-18T02:05:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7fefca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.955+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93850614707008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8f8410 con 0x555b4c8bf950 2024-09-18T02:05:19.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.959+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93850614707008] v32'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.959+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93850614681456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d3340 con 0x7ff0fc0cf040 2024-09-18T02:05:19.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.959+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93850614681456] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.959+0000 7ff1169a2980 20 remove_watcher() i=0 2024-09-18T02:05:19.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.959+0000 7ff1169a2980 2 removed watcher, disabling cache 2024-09-18T02:05:19.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.959+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93850614685536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d3340 con 0x555b4c8bf950 2024-09-18T02:05:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.963+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93850614685536] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.963+0000 7ff1169a2980 20 remove_watcher() i=1 2024-09-18T02:05:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.963+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93850614678928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cdf60 con 0x555b4c8c8bb0 2024-09-18T02:05:19.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.963+0000 7ff113cb1640 1 -- 172.21.15.167:0/2469837345 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93850614678928] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0fc0da070 con 0x555b4c8c8bb0 2024-09-18T02:05:19.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.963+0000 7ff1169a2980 20 remove_watcher() i=2 2024-09-18T02:05:19.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.963+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93850614691440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d3340 con 0x7ff0fc0cf040 2024-09-18T02:05:19.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.963+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93850614691440] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x7ff0fc0cf040 2024-09-18T02:05:19.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.963+0000 7ff1169a2980 20 remove_watcher() i=3 2024-09-18T02:05:19.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.963+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93850614693296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cc590 con 0x555b4c8bf950 2024-09-18T02:05:19.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.967+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93850614693296] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10c026040 con 0x555b4c8bf950 2024-09-18T02:05:19.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.967+0000 7ff1169a2980 20 remove_watcher() i=4 2024-09-18T02:05:19.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.967+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93850614697072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cdf60 con 0x555b4c8c42f0 2024-09-18T02:05:19.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.971+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93850614697072] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.971+0000 7ff1169a2980 20 remove_watcher() i=5 2024-09-18T02:05:19.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.971+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93850614695872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8cf670 con 0x555b4c8c42f0 2024-09-18T02:05:19.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.971+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93850614695872] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.971+0000 7ff1169a2980 20 remove_watcher() i=6 2024-09-18T02:05:19.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.971+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93850614705952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4c8d3340 con 0x555b4c8c42f0 2024-09-18T02:05:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1144b2640 1 -- 172.21.15.167:0/2469837345 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93850614705952] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10407a040 con 0x555b4c8c42f0 2024-09-18T02:05:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 20 remove_watcher() i=7 2024-09-18T02:05:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x555b4c8c42f0 msgr2=0x555b4c8c66e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x555b4c8c42f0 0x555b4c8c66e0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x555b4c8bf950 msgr2=0x555b4c8c1df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x555b4c8bf950 0x555b4c8c1df0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff0fc0cf040 msgr2=0x7ff0fc0dc410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff0fc0cf040 0x7ff0fc0dc410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555b4c8c8bb0 msgr2=0x555b4c8cb070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555b4c8c8bb0 0x555b4c8cb070 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fefe4034650 msgr2=0x7fefe4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fefe4034650 0x7fefe4036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc01b2c0 tx=0x7ff0fc0a6000 comp rx=0 tx=0).stop 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 msgr2=0x555b4c8b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/2469837345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8ad800 0x555b4c8b48c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff104026ae0 tx=0x7ff10402fed0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 reap_dead start 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff114cb3640 1 -- 172.21.15.167:0/2469837345 reap_dead start 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 shutdown_connections 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 >> 172.21.15.167:0/2469837345 conn(0x555b4c8a9b30 msgr2=0x555b4c8a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 shutdown_connections 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/2469837345 wait complete. 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3819510475 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fefec034650 msgr2=0x7fefec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3819510475 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fefec034650 0x7fefec036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x555b4c88af00 tx=0x7ff0fc005a10 comp rx=0 tx=0).stop 2024-09-18T02:05:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3819510475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8a0e00 msgr2=0x555b4c8a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3819510475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8a0e00 0x555b4c8a1220 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff1040475c0 tx=0x7ff104023ac0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3819510475 shutdown_connections 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3819510475 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fefec034650 0x7fefec036b10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3819510475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c8a0e00 0x555b4c8a1220 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3819510475 >> 172.21.15.167:0/3819510475 conn(0x555b4c895f50 msgr2=0x555b4c8989d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3819510475 shutdown_connections 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3819510475 wait complete. 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x555b4c88c950 msgr2=0x555b4c88ed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x555b4c88c950 0x555b4c88ed40 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x555b4c794ed0 msgr2=0x555b4c88a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x555b4c794ed0 0x555b4c88a140 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555b4c890870 msgr2=0x555b4c892c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x555b4c890870 0x555b4c892c60 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:19.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7feffc034650 msgr2=0x7feffc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7feffc034650 0x7feffc036b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0ad000 tx=0x7ff0fc0a5040 comp rx=0 tx=0).stop 2024-09-18T02:05:19.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 msgr2=0x555b4c883040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:19.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 --2- 172.21.15.167:0/3562362322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b4c7032a0 0x555b4c883040 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff104000f90 tx=0x7ff104001260 comp rx=0 tx=0).stop 2024-09-18T02:05:19.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff114cb3640 1 -- 172.21.15.167:0/3562362322 reap_dead start 2024-09-18T02:05:19.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 shutdown_connections 2024-09-18T02:05:19.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 >> 172.21.15.167:0/3562362322 conn(0x555b4c7890a0 msgr2=0x555b4c8764e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:19.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 shutdown_connections 2024-09-18T02:05:19.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:19.975+0000 7ff1169a2980 1 -- 172.21.15.167:0/3562362322 wait complete. 2024-09-18T02:05:19.987 INFO:teuthology.orchestra.run.smithi167.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T02:00:00.000000Z","epoch":1726624800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-18T02:05:19.987 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-18T02:05:19.988 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-18T02:05:19.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-18T02:05:19.988 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-18T02:05:20.070 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:20.070 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:20.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.067+0000 7ff071244980 1 Processor -- start 2024-09-18T02:05:20.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.067+0000 7ff071244980 1 -- start start 2024-09-18T02:05:20.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.067+0000 7ff071244980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d01a651f00 0x55d01a6542f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.067+0000 7ff071244980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d01a4d3ae0 con 0x55d01a5c02d0 2024-09-18T02:05:20.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.067+0000 7ff071244980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55d01a4f7e30 con 0x55d01a651f00 2024-09-18T02:05:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.067+0000 7ff06e553640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d01a651f00 0x55d01a6542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.067+0000 7ff06ed54640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55d01a5c02d0 0x55d01a6507e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33722/0 (socket says 172.21.15.167:33722) 2024-09-18T02:05:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.067+0000 7ff06ed54640 1 -- 172.21.15.167:0/2455793567 learned_addr learned my addr 172.21.15.167:0/2455793567 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:05:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.067+0000 7ff06e553640 1 -- 172.21.15.167:0/2455793567 >> v1:172.21.15.81:6789/0 conn(0x55d01a5c02d0 legacy=0x55d01a6507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.067+0000 7ff06e553640 1 -- 172.21.15.167:0/2455793567 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01a5c06b0 con 0x55d01a651f00 2024-09-18T02:05:20.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.071+0000 7ff06e553640 1 --2- 172.21.15.167:0/2455793567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a651f00 0x55d01a6542f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff06400a480 tx=0x7ff06401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a376885ee812547 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.071+0000 7ff06dd52640 1 -- 172.21.15.167:0/2455793567 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0640b0070 con 0x55d01a651f00 2024-09-18T02:05:20.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.071+0000 7ff06dd52640 1 -- 172.21.15.167:0/2455793567 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0640ab540 con 0x55d01a651f00 2024-09-18T02:05:20.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.071+0000 7ff06dd52640 1 -- 172.21.15.167:0/2455793567 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0640ab840 con 0x55d01a651f00 2024-09-18T02:05:20.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.071+0000 7ff071244980 1 -- 172.21.15.167:0/2455793567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a651f00 msgr2=0x55d01a6542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.071+0000 7ff071244980 1 --2- 172.21.15.167:0/2455793567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a651f00 0x55d01a6542f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff06400a480 tx=0x7ff06401b280 comp rx=0 tx=0).stop 2024-09-18T02:05:20.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.071+0000 7ff071244980 1 -- 172.21.15.167:0/2455793567 shutdown_connections 2024-09-18T02:05:20.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.071+0000 7ff071244980 1 --2- 172.21.15.167:0/2455793567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a651f00 0x55d01a6542f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.071+0000 7ff071244980 1 -- 172.21.15.167:0/2455793567 >> 172.21.15.167:0/2455793567 conn(0x55d01a6460d0 msgr2=0x55d01a6484f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.071+0000 7ff071244980 1 -- 172.21.15.167:0/2455793567 shutdown_connections 2024-09-18T02:05:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.071+0000 7ff071244980 1 -- 172.21.15.167:0/2455793567 wait complete. 2024-09-18T02:05:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 Processor -- start 2024-09-18T02:05:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 -- start start 2024-09-18T02:05:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 0x55d01a738dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d01a4f9200 con 0x55d01a5c02d0 2024-09-18T02:05:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff06ed54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 0x55d01a738dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff06ed54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 0x55d01a738dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51120/0 (socket says 172.21.15.167:51120) 2024-09-18T02:05:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff06ed54640 1 -- 172.21.15.167:0/1142904995 learned_addr learned my addr 172.21.15.167:0/1142904995 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:20.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff06ed54640 1 -- 172.21.15.167:0/1142904995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01a7393a0 con 0x55d01a5c02d0 2024-09-18T02:05:20.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff06ed54640 1 --2- 172.21.15.167:0/1142904995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 0x55d01a738dd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff060001e20 tx=0x7ff06000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4138da46f2227560 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7fef5ce09640 1 -- 172.21.15.167:0/1142904995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff060012020 con 0x55d01a5c02d0 2024-09-18T02:05:20.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7fef5ce09640 1 -- 172.21.15.167:0/1142904995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06000e7c0 con 0x55d01a5c02d0 2024-09-18T02:05:20.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7fef5ce09640 1 -- 172.21.15.167:0/1142904995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff06000eb00 con 0x55d01a5c02d0 2024-09-18T02:05:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 -- 172.21.15.167:0/1142904995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 msgr2=0x55d01a738dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 --2- 172.21.15.167:0/1142904995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 0x55d01a738dd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff060001e20 tx=0x7ff06000b790 comp rx=0 tx=0).stop 2024-09-18T02:05:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 -- 172.21.15.167:0/1142904995 shutdown_connections 2024-09-18T02:05:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 --2- 172.21.15.167:0/1142904995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 0x55d01a738dd0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 -- 172.21.15.167:0/1142904995 >> 172.21.15.167:0/1142904995 conn(0x55d01a6460d0 msgr2=0x55d01a734a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 -- 172.21.15.167:0/1142904995 shutdown_connections 2024-09-18T02:05:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 -- 172.21.15.167:0/1142904995 wait complete. 2024-09-18T02:05:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 Processor -- start 2024-09-18T02:05:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 -- start start 2024-09-18T02:05:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 0x55d01a7400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff071244980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d01a657260 con 0x55d01a5c02d0 2024-09-18T02:05:20.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff06ed54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 0x55d01a7400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff06ed54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 0x55d01a7400e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51124/0 (socket says 172.21.15.167:51124) 2024-09-18T02:05:20.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff06ed54640 1 -- 172.21.15.167:0/3069257980 learned_addr learned my addr 172.21.15.167:0/3069257980 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:20.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.087+0000 7ff06ed54640 1 -- 172.21.15.167:0/3069257980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01a740620 con 0x55d01a5c02d0 2024-09-18T02:05:20.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff06ed54640 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 0x55d01a7400e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff060001e20 tx=0x7ff060000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7fef5b606640 1 -- 172.21.15.167:0/3069257980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff060012030 con 0x55d01a5c02d0 2024-09-18T02:05:20.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d01a7408b0 con 0x55d01a5c02d0 2024-09-18T02:05:20.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7fef5b606640 1 -- 172.21.15.167:0/3069257980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff060001480 con 0x55d01a5c02d0 2024-09-18T02:05:20.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7fef5b606640 1 -- 172.21.15.167:0/3069257980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff06001a920 con 0x55d01a5c02d0 2024-09-18T02:05:20.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d01a743590 con 0x55d01a5c02d0 2024-09-18T02:05:20.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7fef5b606640 1 -- 172.21.15.167:0/3069257980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff060015020 con 0x55d01a5c02d0 2024-09-18T02:05:20.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7fef5b606640 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef54034650 0x7fef54036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7fef5b606640 1 -- 172.21.15.167:0/3069257980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff060020030 con 0x55d01a5c02d0 2024-09-18T02:05:20.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff06e553640 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef54034650 0x7fef54036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff071244980 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d01a651f00 0x55d01a747070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a747690 con 0x55d01a651f00 2024-09-18T02:05:20.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff06f555640 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d01a651f00 0x55d01a747070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff06e553640 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef54034650 0x7fef54036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0640ad000 tx=0x7ff0640a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff06f555640 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d01a651f00 0x55d01a747070 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff06f555640 1 -- 172.21.15.167:0/3069257980 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a651f00 2024-09-18T02:05:20.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7447b0 con 0x55d01a651f00 2024-09-18T02:05:20.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff06f555640 1 -- 172.21.15.167:0/3069257980 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a651f00 2024-09-18T02:05:20.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff071244980 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d01a7499e0 0x55d01a74bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a74c4c0 con 0x55d01a7499e0 2024-09-18T02:05:20.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.091+0000 7ff06ed54640 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d01a7499e0 0x55d01a74bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff06ed54640 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d01a7499e0 0x55d01a74bdd0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff06ed54640 1 -- 172.21.15.167:0/3069257980 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff060008030 con 0x55d01a7499e0 2024-09-18T02:05:20.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a748880 con 0x55d01a651f00 2024-09-18T02:05:20.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff06f555640 1 -- 172.21.15.167:0/3069257980 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a651f00 2024-09-18T02:05:20.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff071244980 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d01a74d920 0x55d01a74fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a750450 con 0x55d01a74d920 2024-09-18T02:05:20.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff06e553640 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d01a74d920 0x55d01a74fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff06e553640 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d01a74d920 0x55d01a74fd10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff06e553640 1 -- 172.21.15.167:0/3069257980 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0640ab8a0 con 0x55d01a74d920 2024-09-18T02:05:20.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff071244980 1 Processor -- start 2024-09-18T02:05:20.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff071244980 1 -- start start 2024-09-18T02:05:20.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff071244980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a75df20 0x55d01a75e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff071244980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d01a552800 con 0x55d01a75df20 2024-09-18T02:05:20.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff06ed54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a75df20 0x55d01a75e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff06ed54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a75df20 0x55d01a75e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51130/0 (socket says 172.21.15.167:51130) 2024-09-18T02:05:20.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff06ed54640 1 -- 172.21.15.167:0/3362783968 learned_addr learned my addr 172.21.15.167:0/3362783968 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:20.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff06ed54640 1 -- 172.21.15.167:0/3362783968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01a75e880 con 0x55d01a75df20 2024-09-18T02:05:20.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7ff06ed54640 1 --2- 172.21.15.167:0/3362783968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a75df20 0x55d01a75e340 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff06002ded0 tx=0x7ff06000db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.095+0000 7fef58e01640 1 -- 172.21.15.167:0/3362783968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff06003d020 con 0x55d01a75df20 2024-09-18T02:05:20.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 -- 172.21.15.167:0/3362783968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d01a75eb10 con 0x55d01a75df20 2024-09-18T02:05:20.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7fef58e01640 1 -- 172.21.15.167:0/3362783968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06000d510 con 0x55d01a75df20 2024-09-18T02:05:20.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7fef58e01640 1 -- 172.21.15.167:0/3362783968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff060047220 con 0x55d01a75df20 2024-09-18T02:05:20.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 -- 172.21.15.167:0/3362783968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d01a761790 con 0x55d01a75df20 2024-09-18T02:05:20.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7fef58e01640 1 -- 172.21.15.167:0/3362783968 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff060040020 con 0x55d01a75df20 2024-09-18T02:05:20.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7fef58e01640 1 --2- 172.21.15.167:0/3362783968 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef48034600 0x7fef48036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7fef58e01640 1 -- 172.21.15.167:0/3362783968 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff060005050 con 0x55d01a75df20 2024-09-18T02:05:20.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff06e553640 1 --2- 172.21.15.167:0/3362783968 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef48034600 0x7fef48036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 Processor -- start 2024-09-18T02:05:20.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 -- start start 2024-09-18T02:05:20.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff06e553640 1 --2- 172.21.15.167:0/3362783968 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef48034600 0x7fef48036ac0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55d01a747b60 tx=0x7ff064005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 0x55d01a76aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d01a739720 con 0x55d01a76a650 2024-09-18T02:05:20.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff06ed54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 0x55d01a76aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff06ed54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 0x55d01a76aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51136/0 (socket says 172.21.15.167:51136) 2024-09-18T02:05:20.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff06ed54640 1 -- 172.21.15.167:0/2407364962 learned_addr learned my addr 172.21.15.167:0/2407364962 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:20.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff06ed54640 1 -- 172.21.15.167:0/2407364962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01a76b000 con 0x55d01a76a650 2024-09-18T02:05:20.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff06ed54640 1 --2- 172.21.15.167:0/2407364962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 0x55d01a76aa30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff060039a20 tx=0x7ff060039920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c3f84eaab9bc51 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7fef527fc640 1 -- 172.21.15.167:0/2407364962 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff060063070 con 0x55d01a76a650 2024-09-18T02:05:20.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7fef527fc640 1 -- 172.21.15.167:0/2407364962 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff060017e30 con 0x55d01a76a650 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7fef527fc640 1 -- 172.21.15.167:0/2407364962 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0600191a0 con 0x55d01a76a650 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 -- 172.21.15.167:0/2407364962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 msgr2=0x55d01a76aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 --2- 172.21.15.167:0/2407364962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 0x55d01a76aa30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff060039a20 tx=0x7ff060039920 comp rx=0 tx=0).stop 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 -- 172.21.15.167:0/2407364962 shutdown_connections 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 --2- 172.21.15.167:0/2407364962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 0x55d01a76aa30 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 -- 172.21.15.167:0/2407364962 >> 172.21.15.167:0/2407364962 conn(0x55d01a766a30 msgr2=0x55d01a764b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 -- 172.21.15.167:0/2407364962 shutdown_connections 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.099+0000 7ff071244980 1 -- 172.21.15.167:0/2407364962 wait complete. 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff071244980 1 Processor -- start 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff071244980 1 -- start start 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff071244980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 0x55d01a771790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff071244980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d01a76b4a0 con 0x55d01a76a650 2024-09-18T02:05:20.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff06ed54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 0x55d01a771790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff06ed54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 0x55d01a771790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51138/0 (socket says 172.21.15.167:51138) 2024-09-18T02:05:20.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 learned_addr learned my addr 172.21.15.167:0/3143500882 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:20.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01a771cd0 con 0x55d01a76a650 2024-09-18T02:05:20.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff06ed54640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 0x55d01a771790 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff06002dc80 tx=0x7ff06002af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7fef50ff9640 1 -- 172.21.15.167:0/3143500882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff06006e020 con 0x55d01a76a650 2024-09-18T02:05:20.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d01a771cd0 con 0x55d01a76a650 2024-09-18T02:05:20.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7fef50ff9640 1 -- 172.21.15.167:0/3143500882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff060030e20 con 0x55d01a76a650 2024-09-18T02:05:20.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d01a771cd0 con 0x55d01a76a650 2024-09-18T02:05:20.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7fef50ff9640 1 -- 172.21.15.167:0/3143500882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff060063040 con 0x55d01a76a650 2024-09-18T02:05:20.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7fef50ff9640 1 -- 172.21.15.167:0/3143500882 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff060071020 con 0x55d01a76a650 2024-09-18T02:05:20.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7fef50ff9640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef38034650 0x7fef38036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7fef50ff9640 1 -- 172.21.15.167:0/3143500882 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff06005b070 con 0x55d01a76a650 2024-09-18T02:05:20.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff06e553640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef38034650 0x7fef38036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff071244980 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d01a77c920 0x55d01a77ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a77f530 con 0x55d01a77c920 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff06f555640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d01a77c920 0x55d01a77ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff06e553640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef38034650 0x7fef38036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff06401b2c0 tx=0x7ff0640a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff06f555640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d01a77c920 0x55d01a77ede0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.103+0000 7ff071244980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 20 realm 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a77f940 con 0x55d01a77c920 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a780210 con 0x55d01a77c920 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x55d01a77c920 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d01a781310 0x55d01a783700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a783d10 con 0x55d01a781310 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06ed54640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d01a781310 0x55d01a783700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06ed54640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d01a781310 0x55d01a783700 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 20 searching for the correct realm 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d01a785c60 0x55d01a788070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a788740 con 0x55d01a785c60 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06e553640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d01a785c60 0x55d01a788070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06e553640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d01a785c60 0x55d01a788070 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06e553640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff0640cf040 0x7ff0640dc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a788740 con 0x7ff0640cf040 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06f555640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff0640cf040 0x7ff0640dc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06f555640 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff0640cf040 0x7ff0640dc410 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.116 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x7ff0640cf040 2024-09-18T02:05:20.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.107+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x55d01a77c920 2024-09-18T02:05:20.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x55d01a77c920 2024-09-18T02:05:20.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x55d01a77c920 2024-09-18T02:05:20.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x55d01a781310 2024-09-18T02:05:20.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x7ff0640cf040 2024-09-18T02:05:20.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x55d01a785c60 2024-09-18T02:05:20.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x55d01a77c920 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x7ff0640cf040 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x55d01a77c920 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x7ff0640cf040 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7805b0 con 0x55d01a785c60 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a785c60 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a781310 2024-09-18T02:05:20.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.111+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a785c60 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a785c60 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a77c920 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a77c920 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a781310 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a785c60 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x7ff0640cf040 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a77c920 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a781310 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a785c60 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a781310 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.115+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x7ff0640cf040 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a785c60 2024-09-18T02:05:20.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a781310 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x55d01a77c920 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0640e9080 con 0x7ff0640cf040 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:20.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7845d0 con 0x55d01a77c920 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7845d0 con 0x55d01a77c920 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7845d0 con 0x55d01a785c60 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 zone default found 2024-09-18T02:05:20.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 4 Realm: () 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 zonegroup default 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a784f90 con 0x55d01a781310 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a784b30 con 0x55d01a785c60 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78aad0 con 0x55d01a785c60 2024-09-18T02:05:20.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 started sync module instance, tier type = 2024-09-18T02:05:20.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:20.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.119+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a789ee0 con 0x7ff0640cf040 2024-09-18T02:05:20.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.123+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.123+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94352285672448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a789ee0 con 0x7ff0640cf040 2024-09-18T02:05:20.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.123+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78b530 con 0x55d01a77c920 2024-09-18T02:05:20.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.123+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94352285672448] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.123+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.123+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94352285675920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a789ee0 con 0x55d01a77c920 2024-09-18T02:05:20.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.123+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78bf70 con 0x55d01a785c60 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.127+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94352285675920] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.127+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.127+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94352285669936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a789e50 con 0x55d01a785c60 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.127+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78cc70 con 0x7ff0640cf040 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.127+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.127+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94352285681904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78d510 con 0x7ff0640cf040 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.127+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78ded0 con 0x55d01a77c920 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.127+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94352285669936] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.127+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94352285681904] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.131+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.131+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94352285680400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78da20 con 0x55d01a77c920 2024-09-18T02:05:20.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.131+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78e770 con 0x55d01a781310 2024-09-18T02:05:20.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.131+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94352285680400] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.131+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.131+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94352285688512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78da20 con 0x55d01a781310 2024-09-18T02:05:20.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.131+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78efc0 con 0x55d01a781310 2024-09-18T02:05:20.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94352285690640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78f440 con 0x55d01a781310 2024-09-18T02:05:20.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78ff50 con 0x55d01a781310 2024-09-18T02:05:20.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94352285688512] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94352285690640] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94352285691696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78d010 con 0x55d01a781310 2024-09-18T02:05:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff071244980 20 add_watcher() i=0 2024-09-18T02:05:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff071244980 20 add_watcher() i=1 2024-09-18T02:05:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff071244980 20 add_watcher() i=2 2024-09-18T02:05:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff071244980 20 add_watcher() i=3 2024-09-18T02:05:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff071244980 20 add_watcher() i=4 2024-09-18T02:05:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff071244980 20 add_watcher() i=5 2024-09-18T02:05:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.135+0000 7ff071244980 20 add_watcher() i=6 2024-09-18T02:05:20.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94352285691696] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 20 add_watcher() i=7 2024-09-18T02:05:20.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:20.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a792f40 con 0x55d01a77c920 2024-09-18T02:05:20.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94352285694464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7903c0 con 0x55d01a77c920 2024-09-18T02:05:20.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94352285694464] v32'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7fef257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 5 note: GC not initialized 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7fee9ffff640 20 reqs_thread_entry: start 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 20 Filter name: none 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7fee9dffb640 20 reqs_thread_entry: start 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7b6560 con 0x55d01a781310 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-18T02:05:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T02:05:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-18T02:05:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7b4d00 con 0x55d01a77c920 2024-09-18T02:05:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-18T02:05:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.139+0000 7ff071244980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T02:05:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7ff071244980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-18T02:05:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7ff071244980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-18T02:05:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7b55f0 con 0x55d01a781310 2024-09-18T02:05:20.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7ff071244980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-18T02:05:20.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7ff071244980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T02:05:20.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7ff071244980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-18T02:05:20.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94352285847872 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7b9b50 con 0x55d01a781310 2024-09-18T02:05:20.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== watch-notify(notify (1) cookie 94352285691696 notify 137438953503 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55d01a7b5fb0 con 0x55d01a781310 2024-09-18T02:05:20.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7fef527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94352285691696 notifier 4732 bl.length()=556 2024-09-18T02:05:20.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7fef527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-18T02:05:20.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7fef527fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T02:05:20.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(65 notify.7 [notify cookie 94352285847872 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.143+0000 7fef527fc640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fef34003eb0 con 0x55d01a781310 2024-09-18T02:05:20.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== watch-notify(notify_complete (2) cookie 94352285847872 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff060033070 con 0x55d01a781310 2024-09-18T02:05:20.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7b55f0 con 0x55d01a77c920 2024-09-18T02:05:20.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7ff071244980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T02:05:20.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7ff071244980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T02:05:20.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7ff071244980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-18T02:05:20.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94352285847872 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7b55c0 con 0x55d01a781310 2024-09-18T02:05:20.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== watch-notify(notify (1) cookie 94352285688512 notify 137438953504 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7ff060033070 con 0x55d01a781310 2024-09-18T02:05:20.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7fef51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94352285688512 notifier 4732 bl.length()=177 2024-09-18T02:05:20.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7fef51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T02:05:20.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7fef51ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T02:05:20.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7fef51ffb640 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7feea4003410 con 0x55d01a781310 2024-09-18T02:05:20.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(68 notify.5 [notify cookie 94352285847872 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.147+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.151+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== watch-notify(notify_complete (2) cookie 94352285847872 notify 137438953504 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d01a743590 con 0x55d01a781310 2024-09-18T02:05:20.153 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-18T02:05:20.144904Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:05:20.144878Z","tags":[],"group_ids":[]} 2024-09-18T02:05:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.151+0000 7fef257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.151+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94352285694464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7b4300 con 0x55d01a77c920 2024-09-18T02:05:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.151+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94352285694464] v32'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.151+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94352285672448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7b4300 con 0x7ff0640cf040 2024-09-18T02:05:20.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.151+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94352285672448] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.151+0000 7ff071244980 20 remove_watcher() i=0 2024-09-18T02:05:20.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.151+0000 7ff071244980 2 removed watcher, disabling cache 2024-09-18T02:05:20.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.151+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94352285675920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78a400 con 0x55d01a77c920 2024-09-18T02:05:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.155+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94352285675920] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.155+0000 7ff071244980 20 remove_watcher() i=1 2024-09-18T02:05:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.155+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94352285669936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7b4300 con 0x55d01a785c60 2024-09-18T02:05:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.155+0000 7ff06e553640 1 -- 172.21.15.167:0/3143500882 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94352285669936] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0640da070 con 0x55d01a785c60 2024-09-18T02:05:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.155+0000 7ff071244980 20 remove_watcher() i=2 2024-09-18T02:05:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.155+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94352285681904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78a400 con 0x7ff0640cf040 2024-09-18T02:05:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.155+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94352285681904] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x7ff0640cf040 2024-09-18T02:05:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.155+0000 7ff071244980 20 remove_watcher() i=3 2024-09-18T02:05:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.155+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94352285680400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a789a30 con 0x55d01a77c920 2024-09-18T02:05:20.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.159+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94352285680400] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06800a4d0 con 0x55d01a77c920 2024-09-18T02:05:20.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.159+0000 7ff071244980 20 remove_watcher() i=4 2024-09-18T02:05:20.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.159+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94352285688512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a7b4300 con 0x55d01a781310 2024-09-18T02:05:20.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.163+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94352285688512] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.163+0000 7ff071244980 20 remove_watcher() i=5 2024-09-18T02:05:20.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.163+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94352285690640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78c8f0 con 0x55d01a781310 2024-09-18T02:05:20.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.163+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94352285690640] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.163+0000 7ff071244980 20 remove_watcher() i=6 2024-09-18T02:05:20.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.163+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94352285691696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d01a78a400 con 0x55d01a781310 2024-09-18T02:05:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff06ed54640 1 -- 172.21.15.167:0/3143500882 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94352285691696] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff060066040 con 0x55d01a781310 2024-09-18T02:05:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 20 remove_watcher() i=7 2024-09-18T02:05:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d01a781310 msgr2=0x55d01a783700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d01a781310 0x55d01a783700 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d01a77c920 msgr2=0x55d01a77ede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d01a77c920 0x55d01a77ede0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff0640cf040 msgr2=0x7ff0640dc410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7ff0640cf040 0x7ff0640dc410 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d01a785c60 msgr2=0x55d01a788070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d01a785c60 0x55d01a788070 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef38034650 msgr2=0x7fef38036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef38034650 0x7fef38036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff06401b2c0 tx=0x7ff0640a6000 comp rx=0 tx=0).stop 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 msgr2=0x55d01a771790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3143500882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a76a650 0x55d01a771790 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff06002dc80 tx=0x7ff06002af60 comp rx=0 tx=0).stop 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 reap_dead start 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff06f555640 1 -- 172.21.15.167:0/3143500882 reap_dead start 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 shutdown_connections 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 >> 172.21.15.167:0/3143500882 conn(0x55d01a766a30 msgr2=0x55d01a764b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 shutdown_connections 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3143500882 wait complete. 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3362783968 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef48034600 msgr2=0x7fef48036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3362783968 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef48034600 0x7fef48036ac0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55d01a747b60 tx=0x7ff064005a10 comp rx=0 tx=0).stop 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3362783968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a75df20 msgr2=0x55d01a75e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3362783968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a75df20 0x55d01a75e340 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff06002ded0 tx=0x7ff06000db30 comp rx=0 tx=0).stop 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3362783968 shutdown_connections 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3362783968 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef48034600 0x7fef48036ac0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3362783968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a75df20 0x55d01a75e340 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3362783968 >> 172.21.15.167:0/3362783968 conn(0x55d01a753070 msgr2=0x55d01a755af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3362783968 shutdown_connections 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3362783968 wait complete. 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d01a7499e0 msgr2=0x55d01a74bdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d01a7499e0 0x55d01a74bdd0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d01a651f00 msgr2=0x55d01a747070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d01a651f00 0x55d01a747070 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d01a74d920 msgr2=0x55d01a74fd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d01a74d920 0x55d01a74fd10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef54034650 msgr2=0x7fef54036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fef54034650 0x7fef54036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0640ad000 tx=0x7ff0640a5040 comp rx=0 tx=0).stop 2024-09-18T02:05:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 msgr2=0x55d01a7400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 --2- 172.21.15.167:0/3069257980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d01a5c02d0 0x55d01a7400e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff060001e20 tx=0x7ff060000ee0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff06f555640 1 -- 172.21.15.167:0/3069257980 reap_dead start 2024-09-18T02:05:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 shutdown_connections 2024-09-18T02:05:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 >> 172.21.15.167:0/3069257980 conn(0x55d01a6460d0 msgr2=0x55d01a733580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 shutdown_connections 2024-09-18T02:05:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.167+0000 7ff071244980 1 -- 172.21.15.167:0/3069257980 wait complete. 2024-09-18T02:05:20.179 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-18T02:05:20.144904Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:05:20.144878Z', 'tags': [], 'group_ids': []} 2024-09-18T02:05:20.195 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:05:20.199 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-18T02:05:20.199 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-18T02:05:20.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-18T02:05:20.199 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-18T02:05:20.251 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:20.251 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:20.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.247+0000 7f987b1f9980 1 Processor -- start 2024-09-18T02:05:20.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.247+0000 7f987b1f9980 1 -- start start 2024-09-18T02:05:20.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.247+0000 7f987b1f9980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5592c3f52ea0 0x5592c3f55290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.247+0000 7f987b1f9980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5592c3dd4ae0 con 0x5592c3ec0ad0 2024-09-18T02:05:20.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.247+0000 7f987b1f9980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x5592c3df8e30 con 0x5592c3f52ea0 2024-09-18T02:05:20.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.247+0000 7f9878508640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5592c3f52ea0 0x5592c3f55290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.247+0000 7f9878d09640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5592c3ec0ad0 0x5592c3f51780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33728/0 (socket says 172.21.15.167:33728) 2024-09-18T02:05:20.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.247+0000 7f9878508640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5592c3f52ea0 0x5592c3f55290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51148/0 (socket says 172.21.15.167:51148) 2024-09-18T02:05:20.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.247+0000 7f9878d09640 1 -- 172.21.15.167:0/2294392775 learned_addr learned my addr 172.21.15.167:0/2294392775 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:05:20.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f9878508640 1 -- 172.21.15.167:0/2294392775 >> v1:172.21.15.81:6789/0 conn(0x5592c3ec0ad0 legacy=0x5592c3f51780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f9878508640 1 -- 172.21.15.167:0/2294392775 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c3ec0eb0 con 0x5592c3f52ea0 2024-09-18T02:05:20.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f9878508640 1 --2- 172.21.15.167:0/2294392775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3f52ea0 0x5592c3f55290 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f986000a420 tx=0x7f986001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fe41b08b20819 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f9877d07640 1 -- 172.21.15.167:0/2294392775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98600af070 con 0x5592c3f52ea0 2024-09-18T02:05:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f9877d07640 1 -- 172.21.15.167:0/2294392775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98600aa530 con 0x5592c3f52ea0 2024-09-18T02:05:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f9877d07640 1 -- 172.21.15.167:0/2294392775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98600aa850 con 0x5592c3f52ea0 2024-09-18T02:05:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f987b1f9980 1 -- 172.21.15.167:0/2294392775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3f52ea0 msgr2=0x5592c3f55290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f987b1f9980 1 --2- 172.21.15.167:0/2294392775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3f52ea0 0x5592c3f55290 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f986000a420 tx=0x7f986001afd0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f987b1f9980 1 -- 172.21.15.167:0/2294392775 shutdown_connections 2024-09-18T02:05:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f987b1f9980 1 --2- 172.21.15.167:0/2294392775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3f52ea0 0x5592c3f55290 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f987b1f9980 1 -- 172.21.15.167:0/2294392775 >> 172.21.15.167:0/2294392775 conn(0x5592c3f47070 msgr2=0x5592c3f49490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f987b1f9980 1 -- 172.21.15.167:0/2294392775 shutdown_connections 2024-09-18T02:05:20.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.251+0000 7f987b1f9980 1 -- 172.21.15.167:0/2294392775 wait complete. 2024-09-18T02:05:20.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 Processor -- start 2024-09-18T02:05:20.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 -- start start 2024-09-18T02:05:20.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3ec0ad0 0x5592c4039c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.269 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5592c3dfa200 con 0x5592c3ec0ad0 2024-09-18T02:05:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f9878d09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3ec0ad0 0x5592c4039c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f9878d09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3ec0ad0 0x5592c4039c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51160/0 (socket says 172.21.15.167:51160) 2024-09-18T02:05:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f9878d09640 1 -- 172.21.15.167:0/2756686538 learned_addr learned my addr 172.21.15.167:0/2756686538 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f9878d09640 1 -- 172.21.15.167:0/2756686538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c403a230 con 0x5592c3ec0ad0 2024-09-18T02:05:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f9878d09640 1 --2- 172.21.15.167:0/2756686538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3ec0ad0 0x5592c4039c60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9868001d90 tx=0x7f9868001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7565abcd764f9291 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f9766e0d640 1 -- 172.21.15.167:0/2756686538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9868013030 con 0x5592c3ec0ad0 2024-09-18T02:05:20.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f9766e0d640 1 -- 172.21.15.167:0/2756686538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986800e690 con 0x5592c3ec0ad0 2024-09-18T02:05:20.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f9766e0d640 1 -- 172.21.15.167:0/2756686538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f986800ea10 con 0x5592c3ec0ad0 2024-09-18T02:05:20.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 -- 172.21.15.167:0/2756686538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3ec0ad0 msgr2=0x5592c4039c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 --2- 172.21.15.167:0/2756686538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3ec0ad0 0x5592c4039c60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9868001d90 tx=0x7f9868001e80 comp rx=0 tx=0).stop 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 -- 172.21.15.167:0/2756686538 shutdown_connections 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 --2- 172.21.15.167:0/2756686538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3ec0ad0 0x5592c4039c60 secure :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9868001d90 tx=0x7f9868001e80 comp rx=0 tx=0).stop 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 -- 172.21.15.167:0/2756686538 >> 172.21.15.167:0/2756686538 conn(0x5592c3f47070 msgr2=0x5592c4035890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 -- 172.21.15.167:0/2756686538 shutdown_connections 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 -- 172.21.15.167:0/2756686538 wait complete. 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 Processor -- start 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 -- start start 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3f52ea0 0x5592c4041260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f987b1f9980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5592c3f58260 con 0x5592c3f52ea0 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f9878d09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3f52ea0 0x5592c4041260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f9878d09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3f52ea0 0x5592c4041260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51176/0 (socket says 172.21.15.167:51176) 2024-09-18T02:05:20.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.267+0000 7f9878d09640 1 -- 172.21.15.167:0/3011031654 learned_addr learned my addr 172.21.15.167:0/3011031654 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:20.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f9878d09640 1 -- 172.21.15.167:0/3011031654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c40417a0 con 0x5592c3f52ea0 2024-09-18T02:05:20.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f9878d09640 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3f52ea0 0x5592c4041260 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9868004000 tx=0x7f9868000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f976560a640 1 -- 172.21.15.167:0/3011031654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9868027070 con 0x5592c3f52ea0 2024-09-18T02:05:20.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592c4041a30 con 0x5592c3f52ea0 2024-09-18T02:05:20.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f976560a640 1 -- 172.21.15.167:0/3011031654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98680198b0 con 0x5592c3f52ea0 2024-09-18T02:05:20.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f976560a640 1 -- 172.21.15.167:0/3011031654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9868019bd0 con 0x5592c3f52ea0 2024-09-18T02:05:20.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592c4044710 con 0x5592c3f52ea0 2024-09-18T02:05:20.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f976560a640 1 -- 172.21.15.167:0/3011031654 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f986802a070 con 0x5592c3f52ea0 2024-09-18T02:05:20.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f976560a640 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9760034650 0x7f9760036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f976560a640 1 -- 172.21.15.167:0/3011031654 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f986801f070 con 0x5592c3f52ea0 2024-09-18T02:05:20.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f9878508640 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9760034650 0x7f9760036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f987b1f9980 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5592c40461e0 0x5592c40485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4048bf0 con 0x5592c40461e0 2024-09-18T02:05:20.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f987950a640 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5592c40461e0 0x5592c40485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f9878508640 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9760034650 0x7f9760036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f98600ac000 tx=0x7f98600a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f987950a640 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5592c40461e0 0x5592c40485d0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f987950a640 1 -- 172.21.15.167:0/3011031654 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98700083f0 con 0x5592c40461e0 2024-09-18T02:05:20.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4045930 con 0x5592c40461e0 2024-09-18T02:05:20.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f987950a640 1 -- 172.21.15.167:0/3011031654 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98700083f0 con 0x5592c40461e0 2024-09-18T02:05:20.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f987b1f9980 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5592c404af20 0x5592c404d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.271+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c404da00 con 0x5592c404af20 2024-09-18T02:05:20.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f9878d09640 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5592c404af20 0x5592c404d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f9878d09640 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5592c404af20 0x5592c404d310 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f9878d09640 1 -- 172.21.15.167:0/3011031654 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9868029030 con 0x5592c404af20 2024-09-18T02:05:20.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4049dc0 con 0x5592c40461e0 2024-09-18T02:05:20.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f987950a640 1 -- 172.21.15.167:0/3011031654 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98700083f0 con 0x5592c40461e0 2024-09-18T02:05:20.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f987b1f9980 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5592c404ee60 0x5592c4051250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4051990 con 0x5592c404ee60 2024-09-18T02:05:20.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f9878508640 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5592c404ee60 0x5592c4051250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f9878508640 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5592c404ee60 0x5592c4051250 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f9878508640 1 -- 172.21.15.167:0/3011031654 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98600b2040 con 0x5592c404ee60 2024-09-18T02:05:20.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f987b1f9980 1 Processor -- start 2024-09-18T02:05:20.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f987b1f9980 1 -- start start 2024-09-18T02:05:20.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f987b1f9980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c405f460 0x5592c405f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f987b1f9980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5592c3e53800 con 0x5592c405f460 2024-09-18T02:05:20.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f9878d09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c405f460 0x5592c405f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f9878d09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c405f460 0x5592c405f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51182/0 (socket says 172.21.15.167:51182) 2024-09-18T02:05:20.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.275+0000 7f9878d09640 1 -- 172.21.15.167:0/1999534099 learned_addr learned my addr 172.21.15.167:0/1999534099 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:20.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f9878d09640 1 -- 172.21.15.167:0/1999534099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c405fdc0 con 0x5592c405f460 2024-09-18T02:05:20.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f9878d09640 1 --2- 172.21.15.167:0/1999534099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c405f460 0x5592c405f880 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f98680482f0 tx=0x7f986800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f975e7fc640 1 -- 172.21.15.167:0/1999534099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f986802a6b0 con 0x5592c405f460 2024-09-18T02:05:20.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f975e7fc640 1 -- 172.21.15.167:0/1999534099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986802a850 con 0x5592c405f460 2024-09-18T02:05:20.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f987b1f9980 1 -- 172.21.15.167:0/1999534099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592c4060050 con 0x5592c405f460 2024-09-18T02:05:20.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f975e7fc640 1 -- 172.21.15.167:0/1999534099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f986802ab70 con 0x5592c405f460 2024-09-18T02:05:20.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f987b1f9980 1 -- 172.21.15.167:0/1999534099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592c4062cd0 con 0x5592c405f460 2024-09-18T02:05:20.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f975e7fc640 1 -- 172.21.15.167:0/1999534099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9868036040 con 0x5592c405f460 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f975e7fc640 1 --2- 172.21.15.167:0/1999534099 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9750034650 0x7f9750036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f975e7fc640 1 -- 172.21.15.167:0/1999534099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9868014070 con 0x5592c405f460 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f9878508640 1 --2- 172.21.15.167:0/1999534099 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9750034650 0x7f9750036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f987b1f9980 1 Processor -- start 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f987b1f9980 1 -- start start 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f9878508640 1 --2- 172.21.15.167:0/1999534099 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9750034650 0x7f9750036b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5592c40490a0 tx=0x7f9860005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f987b1f9980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c406c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f987b1f9980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5592c403a5b0 con 0x5592c406bd40 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f9878d09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c406c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f9878d09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c406c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51190/0 (socket says 172.21.15.167:51190) 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f9878d09640 1 -- 172.21.15.167:0/3347491599 learned_addr learned my addr 172.21.15.167:0/3347491599 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:20.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f9878d09640 1 -- 172.21.15.167:0/3347491599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c406c710 con 0x5592c406bd40 2024-09-18T02:05:20.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.279+0000 7f9878d09640 1 --2- 172.21.15.167:0/3347491599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c406c140 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f986801cf90 tx=0x7f98680224d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0794a5cf42ace9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f974ffff640 1 -- 172.21.15.167:0/3347491599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98680390c0 con 0x5592c406bd40 2024-09-18T02:05:20.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f974ffff640 1 -- 172.21.15.167:0/3347491599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9868038860 con 0x5592c406bd40 2024-09-18T02:05:20.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f974ffff640 1 -- 172.21.15.167:0/3347491599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9868048bc0 con 0x5592c406bd40 2024-09-18T02:05:20.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 -- 172.21.15.167:0/3347491599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 msgr2=0x5592c406c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 --2- 172.21.15.167:0/3347491599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c406c140 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f986801cf90 tx=0x7f98680224d0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 -- 172.21.15.167:0/3347491599 shutdown_connections 2024-09-18T02:05:20.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 --2- 172.21.15.167:0/3347491599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c406c140 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 -- 172.21.15.167:0/3347491599 >> 172.21.15.167:0/3347491599 conn(0x5592c40681b0 msgr2=0x5592c40662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 -- 172.21.15.167:0/3347491599 shutdown_connections 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 -- 172.21.15.167:0/3347491599 wait complete. 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 Processor -- start 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 -- start start 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c4072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5592c406cc20 con 0x5592c406bd40 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f9878d09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c4072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f9878d09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c4072f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51206/0 (socket says 172.21.15.167:51206) 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 learned_addr learned my addr 172.21.15.167:0/349437234 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c4073460 con 0x5592c406bd40 2024-09-18T02:05:20.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f9878d09640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c4072f20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f986800dfd0 tx=0x7f9868026fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f974e7fc640 1 -- 172.21.15.167:0/349437234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9868021d60 con 0x5592c406bd40 2024-09-18T02:05:20.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592c4073460 con 0x5592c406bd40 2024-09-18T02:05:20.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f974e7fc640 1 -- 172.21.15.167:0/349437234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986806a030 con 0x5592c406bd40 2024-09-18T02:05:20.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f974e7fc640 1 -- 172.21.15.167:0/349437234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98680214e0 con 0x5592c406bd40 2024-09-18T02:05:20.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592c4073460 con 0x5592c406bd40 2024-09-18T02:05:20.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f974e7fc640 1 -- 172.21.15.167:0/349437234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9868061040 con 0x5592c406bd40 2024-09-18T02:05:20.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.283+0000 7f974e7fc640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f97440345b0 0x7f9744036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f974e7fc640 1 -- 172.21.15.167:0/349437234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9868054040 con 0x5592c406bd40 2024-09-18T02:05:20.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f9878508640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f97440345b0 0x7f9744036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5592c407e0b0 0x5592c4080550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4080ca0 con 0x5592c407e0b0 2024-09-18T02:05:20.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987950a640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5592c407e0b0 0x5592c4080550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f9878508640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f97440345b0 0x7f9744036a70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9860017be0 tx=0x7f98600b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987950a640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5592c407e0b0 0x5592c4080550 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98700083f0 con 0x5592c407e0b0 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 20 realm 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40810b0 con 0x5592c407e0b0 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98700083f0 con 0x5592c407e0b0 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081950 con 0x5592c407e0b0 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98700083f0 con 0x5592c407e0b0 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c407e0b0 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98700083f0 con 0x5592c407e0b0 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5592c4082a50 0x5592c4084e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4085490 con 0x5592c4082a50 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f9878d09640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5592c4082a50 0x5592c4084e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f9878d09640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5592c4082a50 0x5592c4084e40 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 20 searching for the correct realm 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5592c4087370 0x5592c4089810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4089e90 con 0x5592c4087370 2024-09-18T02:05:20.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f9878508640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5592c4087370 0x5592c4089810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.287+0000 7f9878508640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5592c4087370 0x5592c4089810 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f9878508640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f98600db040 0x7f98600cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:20.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4089e90 con 0x7f98600db040 2024-09-18T02:05:20.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f98600db040 0x7f98600cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:20.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f98600db040 0x7f98600cd430 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:20.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98700083f0 con 0x7f98600db040 2024-09-18T02:05:20.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x7f98600db040 2024-09-18T02:05:20.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98700083f0 con 0x7f98600db040 2024-09-18T02:05:20.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c407e0b0 2024-09-18T02:05:20.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c407e0b0 2024-09-18T02:05:20.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c407e0b0 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4082a50 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x7f98600db040 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4087370 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c407e0b0 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x7f98600db040 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c407e0b0 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.291+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x7f98600db040 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4087370 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4087370 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4082a50 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4087370 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4087370 2024-09-18T02:05:20.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c407e0b0 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c407e0b0 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4082a50 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4087370 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x7f98600db040 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c407e0b0 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.295+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4082a50 2024-09-18T02:05:20.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4087370 2024-09-18T02:05:20.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4082a50 2024-09-18T02:05:20.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x7f98600db040 2024-09-18T02:05:20.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4087370 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c4082a50 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x5592c407e0b0 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592c4081cf0 con 0x7f98600db040 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:20.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4085ce0 con 0x5592c407e0b0 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4085ce0 con 0x5592c407e0b0 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4085ce0 con 0x5592c4087370 2024-09-18T02:05:20.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 zone default found 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 4 Realm: () 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 zonegroup default 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.299+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4086740 con 0x5592c4082a50 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c408c1a0 con 0x5592c4087370 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c408c540 con 0x5592c4087370 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 20 started sync module instance, tier type = 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408b5e0 con 0x7f98600db040 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94088842492368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408b5e0 con 0x7f98600db040 2024-09-18T02:05:20.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408cd90 con 0x5592c407e0b0 2024-09-18T02:05:20.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.303+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94088842492368] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.307+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.307+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94088842496496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408b5e0 con 0x5592c407e0b0 2024-09-18T02:05:20.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.307+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408d7a0 con 0x5592c4087370 2024-09-18T02:05:20.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.307+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.307+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94088842498800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408e040 con 0x5592c4087370 2024-09-18T02:05:20.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.307+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408ea80 con 0x7f98600db040 2024-09-18T02:05:20.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.307+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94088842496496] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.307+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.307+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94088842503504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408ee70 con 0x7f98600db040 2024-09-18T02:05:20.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.307+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408f830 con 0x5592c407e0b0 2024-09-18T02:05:20.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.311+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94088842498800] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.311+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94088842503504] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.311+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.311+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94088842490160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408f380 con 0x5592c407e0b0 2024-09-18T02:05:20.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.311+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408fbd0 con 0x5592c4082a50 2024-09-18T02:05:20.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.311+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94088842490160] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.311+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.311+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94088842507136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408f7a0 con 0x5592c4082a50 2024-09-18T02:05:20.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.311+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40908d0 con 0x5592c4082a50 2024-09-18T02:05:20.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.315+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94088842507136] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.315+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.315+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94088842510464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c4090ab0 con 0x5592c4082a50 2024-09-18T02:05:20.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.315+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40915b0 con 0x5592c4082a50 2024-09-18T02:05:20.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94088842510464] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94088842514592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c4091570 con 0x5592c4082a50 2024-09-18T02:05:20.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 20 add_watcher() i=0 2024-09-18T02:05:20.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 20 add_watcher() i=1 2024-09-18T02:05:20.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 20 add_watcher() i=2 2024-09-18T02:05:20.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 20 add_watcher() i=3 2024-09-18T02:05:20.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 20 add_watcher() i=4 2024-09-18T02:05:20.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 20 add_watcher() i=5 2024-09-18T02:05:20.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 20 add_watcher() i=6 2024-09-18T02:05:20.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94088842514592] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 20 add_watcher() i=7 2024-09-18T02:05:20.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:20.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c4094a00 con 0x5592c407e0b0 2024-09-18T02:05:20.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94088842511680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c4091f20 con 0x5592c407e0b0 2024-09-18T02:05:20.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94088842511680] v32'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.319+0000 7f972efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:20.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:20.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:20.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 5 note: GC not initialized 2024-09-18T02:05:20.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f972dfe3640 20 reqs_thread_entry: start 2024-09-18T02:05:20.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:20.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 20 Filter name: none 2024-09-18T02:05:20.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f969f7fe640 20 reqs_thread_entry: start 2024-09-18T02:05:20.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-18T02:05:20.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40b80a0 con 0x5592c4082a50 2024-09-18T02:05:20.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T02:05:20.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-18T02:05:20.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T02:05:20.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:05:20.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bc260 con 0x7f98600db040 2024-09-18T02:05:20.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v32'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T02:05:20.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T02:05:20.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-18T02:05:20.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94088842686512 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bce90 con 0x5592c4082a50 2024-09-18T02:05:20.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== watch-notify(notify (1) cookie 94088842507136 notify 137438953505 ret 0) ==== 424+0+0 (crc 0 0 0) 0x5592c4060050 con 0x5592c4082a50 2024-09-18T02:05:20.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f974ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94088842507136 notifier 4739 bl.length()=382 2024-09-18T02:05:20.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f974ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T02:05:20.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f974ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T02:05:20.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f974ffff640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f973c003eb0 con 0x5592c4082a50 2024-09-18T02:05:20.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.323+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(64 notify.5 [notify cookie 94088842686512 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== watch-notify(notify_complete (2) cookie 94088842686512 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5592c405fdc0 con 0x5592c4082a50 2024-09-18T02:05:20.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bcd70 con 0x5592c407e0b0 2024-09-18T02:05:20.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987b1f9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 : miss 2024-09-18T02:05:20.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987b1f9980 20 rados->read ofs=0 len=0 2024-09-18T02:05:20.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 8.d 8:b052010b:root::.bucket.meta.myfoo6%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40ba7a0 con 0x7f98600db040 2024-09-18T02:05:20.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(67 .bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987b1f9980 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T02:05:20.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987b1f9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 info.flags=0x17 2024-09-18T02:05:20.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987b1f9980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 to cache LRU end 2024-09-18T02:05:20.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987b1f9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:05:20.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987b1f9980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:05:20.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987b1f9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 2024-09-18T02:05:20.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.327+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 8.d 8:b052010b:root::.bucket.meta.myfoo6%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40c3f90 con 0x7f98600db040 2024-09-18T02:05:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(68 .bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 info.flags=0x17 2024-09-18T02:05:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 to cache LRU end 2024-09-18T02:05:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T02:05:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9, ofs0, ns] 2024-09-18T02:05:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify cookie 94088842683760 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40c2c40 con 0x5592c4087370 2024-09-18T02:05:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== watch-notify(notify (1) cookie 94088842498800 notify 137438953485 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7f98600e5080 con 0x5592c4087370 2024-09-18T02:05:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f974f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94088842498800 notifier 4739 bl.length()=748 2024-09-18T02:05:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(69 notify.2 [notify cookie 94088842683760 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f974f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 info.flags=0x17 2024-09-18T02:05:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f974f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 to cache LRU end 2024-09-18T02:05:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f974f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T02:05:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f974f7fe640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f96ac003540 con 0x5592c4087370 2024-09-18T02:05:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(70 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== watch-notify(notify_complete (2) cookie 94088842683760 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5592c3ec0eb0 con 0x5592c4087370 2024-09-18T02:05:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 20 handle_bi_update(): bucket=:myfoo6[c5231f36-c36e-44d5-8268-aaf52617db58.4235.9]): orig_sources= new_sources= 2024-09-18T02:05:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 20 handle_bi_update(): bucket=:myfoo6[c5231f36-c36e-44d5-8268-aaf52617db58.4235.9]): potential sources added=[] removed=[] 2024-09-18T02:05:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 20 handle_bi_update(): bucket=:myfoo6[c5231f36-c36e-44d5-8268-aaf52617db58.4235.9]): orig_dests= new_dests= 2024-09-18T02:05:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 20 handle_bi_update(): bucket=:myfoo6[c5231f36-c36e-44d5-8268-aaf52617db58.4235.9]): potential dests added=[] removed=[] 2024-09-18T02:05:20.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40ba570 con 0x5592c407e0b0 2024-09-18T02:05:20.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(71 bud.buckets [call] v32'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40ba570 con 0x5592c407e0b0 2024-09-18T02:05:20.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(72 bud.buckets [call] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.331+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40ba570 con 0x5592c407e0b0 2024-09-18T02:05:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v32'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-18T02:05:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-18T02:05:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-18T02:05:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94088842683760 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bd2c0 con 0x7f98600db040 2024-09-18T02:05:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== watch-notify(notify (1) cookie 94088842503504 notify 137438953487 ret 0) ==== 358+0+0 (crc 0 0 0) 0x5592c40c1300 con 0x7f98600db040 2024-09-18T02:05:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f974f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94088842503504 notifier 4739 bl.length()=316 2024-09-18T02:05:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f974f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-18T02:05:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f974f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-18T02:05:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f974f7fe640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f96ac003570 con 0x7f98600db040 2024-09-18T02:05:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(74 notify.3 [notify cookie 94088842683760 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== watch-notify(notify_complete (2) cookie 94088842683760 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5592c40bab90 con 0x7f98600db040 2024-09-18T02:05:20.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 : hit (requested=0x17, cached=0x17) 2024-09-18T02:05:20.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 2024-09-18T02:05:20.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:76 8.d 8:b052010b:root::.bucket.meta.myfoo6%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bb840 con 0x7f98600db040 2024-09-18T02:05:20.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(76 .bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 info.flags=0x17 2024-09-18T02:05:20.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 to cache LRU end 2024-09-18T02:05:20.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T02:05:20.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9, ofs0, ns] 2024-09-18T02:05:20.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.335+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 94088842717072 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40c3060 con 0x5592c4087370 2024-09-18T02:05:20.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== watch-notify(notify (1) cookie 94088842498800 notify 137438953486 ret 0) ==== 790+0+0 (crc 0 0 0) 0x5592c3ec0eb0 con 0x5592c4087370 2024-09-18T02:05:20.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f974ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94088842498800 notifier 4739 bl.length()=748 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f974ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 info.flags=0x17 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f974ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 to cache LRU end 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f974ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(77 notify.2 [notify cookie 94088842717072 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f974ffff640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f973c003eb0 con 0x5592c4087370 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== watch-notify(notify_complete (2) cookie 94088842717072 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f98600cda40 con 0x5592c4087370 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 20 handle_bi_update(): bucket=:myfoo6[c5231f36-c36e-44d5-8268-aaf52617db58.4235.9]): orig_sources= new_sources= 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 20 handle_bi_update(): bucket=:myfoo6[c5231f36-c36e-44d5-8268-aaf52617db58.4235.9]): potential sources added=[] removed=[] 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 20 handle_bi_update(): bucket=:myfoo6[c5231f36-c36e-44d5-8268-aaf52617db58.4235.9]): orig_dests= new_dests= 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 20 handle_bi_update(): bucket=:myfoo6[c5231f36-c36e-44d5-8268-aaf52617db58.4235.9]): potential dests added=[] removed=[] 2024-09-18T02:05:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:79 4.1b 4:da6a630d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bb310 con 0x7f98600db040 2024-09-18T02:05:20.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(79 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870026040 con 0x7f98600db040 2024-09-18T02:05:20.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:80 4.6 4:60a440ab:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bae60 con 0x5592c4087370 2024-09-18T02:05:20.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(80 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 4.3c 4:3ea78ab1:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bae60 con 0x5592c407e0b0 2024-09-18T02:05:20.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(81 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:82 4.9 4:903a05e5:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bae60 con 0x5592c407e0b0 2024-09-18T02:05:20.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(82 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:83 4.12 4:4b91de11:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bae60 con 0x5592c407e0b0 2024-09-18T02:05:20.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(83 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:84 4.9 4:905ebafe:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bae60 con 0x5592c407e0b0 2024-09-18T02:05:20.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(84 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.5 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870026040 con 0x5592c407e0b0 2024-09-18T02:05:20.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 4.0 4:0265753b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bae60 con 0x5592c4087370 2024-09-18T02:05:20.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(85 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:86 4.24 4:253bf9bb:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bae60 con 0x5592c4082a50 2024-09-18T02:05:20.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.339+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(86 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.7 [call out=85b] v0'0 uv17 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:87 4.18 4:1bbb3569:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bae60 con 0x7f98600db040 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(87 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f987004f040 con 0x7f98600db040 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:88 4.3e 4:7ce3cfa2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bae60 con 0x7f98600db040 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 23 ==== osd_op_reply(88 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9 [call out=378b] v0'0 uv5 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7f987004f040 con 0x7f98600db040 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 10 cls_bucket_list_unordered: got thirteen 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:89 4.35 4:ac3b89ba:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bae60 con 0x5592c407e0b0 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(89 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f987004f040 con 0x5592c407e0b0 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 get_obj_state: octx=0x5592c406ca30 obj=myfoo6:thirteen state=0x5592c40b8f68 s->prefetch_data=0 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:90 3.d 3:b3a6972e:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bae60 con 0x5592c4087370 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(90 c5231f36-c36e-44d5-8268-aaf52617db58.4235.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 10 manifest: total_size = 8 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 get_obj_state: setting s->obj_tag to c5231f36-c36e-44d5-8268-aaf52617db58.4235.11550855705563659234 2024-09-18T02:05:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 Read xattr rgw_rados: user.rgw.acl 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 Read xattr rgw_rados: user.rgw.etag 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 get_obj_state: octx=0x5592c406ca30 obj=myfoo6:thirteen state=0x5592c40b8f68 s->prefetch_data=0 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 : hit (requested=0x17, cached=0x17) 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 20 bucket index object: :.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:91 4.3e 4:7ce3cfa2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40c0cd0 con 0x7f98600db040 2024-09-18T02:05:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 24 ==== osd_op_reply(91 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f987004f040 con 0x7f98600db040 2024-09-18T02:05:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:92 3.d 3:b3a6972e:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40c58f0 con 0x5592c4087370 2024-09-18T02:05:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(92 c5231f36-c36e-44d5-8268-aaf52617db58.4235.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v32'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 4.3e 4:7ce3cfa2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40c7180 con 0x7f98600db040 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:1 objects processed in :myfoo6[c5231f36-c36e-44d5-8268-aaf52617db58.4235.9]). Next marker thirteen 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.343+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bc8c0 con 0x7f98600db040 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 25 ==== osd_op_reply(93 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f987004f040 con 0x7f98600db040 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f974f7fe640 20 handle_completion(): completion ok for obj=thirteen 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 26 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v32'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f987004f040 con 0x7f98600db040 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987b1f9980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987b1f9980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987b1f9980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94088842688384 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bc8c0 con 0x5592c4082a50 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== watch-notify(notify (1) cookie 94088842507136 notify 137438953506 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5592c405fdc0 con 0x5592c4082a50 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f974ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94088842507136 notifier 4739 bl.length()=556 2024-09-18T02:05:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f974ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T02:05:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f974ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T02:05:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(95 notify.5 [notify cookie 94088842688384 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f974ffff640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f973c003eb0 con 0x5592c4082a50 2024-09-18T02:05:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== watch-notify(notify_complete (2) cookie 94088842688384 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5592c4044710 con 0x5592c4082a50 2024-09-18T02:05:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bc820 con 0x5592c407e0b0 2024-09-18T02:05:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f987004f040 con 0x5592c407e0b0 2024-09-18T02:05:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987b1f9980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T02:05:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987b1f9980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987b1f9980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.347+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94088842692640 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40b8d80 con 0x5592c4082a50 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== watch-notify(notify (1) cookie 94088842507136 notify 137438953507 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5592c4044710 con 0x5592c4082a50 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f974ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94088842507136 notifier 4739 bl.length()=177 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f974ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f974ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f974ffff640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f973c003eb0 con 0x5592c4082a50 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(98 notify.5 [notify cookie 94088842692640 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== watch-notify(notify_complete (2) cookie 94088842692640 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5592c4041a30 con 0x5592c4082a50 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f987b1f9980 10 removing user index: bar 2024-09-18T02:05:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40bc820 con 0x5592c4082a50 2024-09-18T02:05:20.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(100 bar [delete] v32'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f987b1f9980 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-18T02:05:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f987b1f9980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-18T02:05:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94088842692640 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592c40b8d80 con 0x5592c4082a50 2024-09-18T02:05:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== watch-notify(notify (1) cookie 94088842514592 notify 137438953508 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5592c4041a30 con 0x5592c4082a50 2024-09-18T02:05:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f974f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 94088842514592 notifier 4739 bl.length()=152 2024-09-18T02:05:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f974f7fe640 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f96ac003570 con 0x5592c4082a50 2024-09-18T02:05:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.351+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== osd_op_reply(101 notify.7 [notify cookie 94088842692640 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.355+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.355+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 33 ==== watch-notify(notify_complete (2) cookie 94088842692640 notify 137438953508 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5592c40417a0 con 0x5592c4082a50 2024-09-18T02:05:20.358 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-18T02:05:20.144904Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:05:20.144878Z","tags":[],"group_ids":[]} 2024-09-18T02:05:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.355+0000 7f972efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.355+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94088842511680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40b5ed0 con 0x5592c407e0b0 2024-09-18T02:05:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.355+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94088842511680] v32'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f987004f040 con 0x5592c407e0b0 2024-09-18T02:05:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.355+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94088842492368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40b5ed0 con 0x7f98600db040 2024-09-18T02:05:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.355+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 27 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94088842492368] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f987004f040 con 0x7f98600db040 2024-09-18T02:05:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.355+0000 7f987b1f9980 20 remove_watcher() i=0 2024-09-18T02:05:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.355+0000 7f987b1f9980 2 removed watcher, disabling cache 2024-09-18T02:05:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.355+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94088842496496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40b5ed0 con 0x5592c407e0b0 2024-09-18T02:05:20.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.359+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94088842496496] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f987004f040 con 0x5592c407e0b0 2024-09-18T02:05:20.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.359+0000 7f987b1f9980 20 remove_watcher() i=1 2024-09-18T02:05:20.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.359+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94088842498800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40b5ed0 con 0x5592c4087370 2024-09-18T02:05:20.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.363+0000 7f9878508640 1 -- 172.21.15.167:0/349437234 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94088842498800] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98600c8030 con 0x5592c4087370 2024-09-18T02:05:20.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.363+0000 7f987b1f9980 20 remove_watcher() i=2 2024-09-18T02:05:20.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.363+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94088842503504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40b5ed0 con 0x7f98600db040 2024-09-18T02:05:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.363+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.2 v2:172.21.15.167:6816/2055439504 28 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94088842503504] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f987004f040 con 0x7f98600db040 2024-09-18T02:05:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.363+0000 7f987b1f9980 20 remove_watcher() i=3 2024-09-18T02:05:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.363+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94088842490160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408e550 con 0x5592c407e0b0 2024-09-18T02:05:20.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.363+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94088842490160] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f987004f040 con 0x5592c407e0b0 2024-09-18T02:05:20.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.363+0000 7f987b1f9980 20 remove_watcher() i=4 2024-09-18T02:05:20.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.363+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94088842507136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c40b5ed0 con 0x5592c4082a50 2024-09-18T02:05:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.367+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 34 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94088842507136] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.367+0000 7f987b1f9980 20 remove_watcher() i=5 2024-09-18T02:05:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.367+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94088842510464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408b130 con 0x5592c4082a50 2024-09-18T02:05:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.367+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 35 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94088842510464] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.367+0000 7f987b1f9980 20 remove_watcher() i=6 2024-09-18T02:05:20.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.367+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94088842514592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592c408f380 con 0x5592c4082a50 2024-09-18T02:05:20.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f9878d09640 1 -- 172.21.15.167:0/349437234 <== osd.0 v2:172.21.15.81:6800/3087415523 36 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94088842514592] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868076070 con 0x5592c4082a50 2024-09-18T02:05:20.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 20 remove_watcher() i=7 2024-09-18T02:05:20.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5592c4082a50 msgr2=0x5592c4084e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5592c4082a50 0x5592c4084e40 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5592c407e0b0 msgr2=0x5592c4080550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5592c407e0b0 0x5592c4080550 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f98600db040 msgr2=0x7f98600cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f98600db040 0x7f98600cd430 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5592c4087370 msgr2=0x5592c4089810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5592c4087370 0x5592c4089810 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f97440345b0 msgr2=0x7f9744036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f97440345b0 0x7f9744036a70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9860017be0 tx=0x7f98600b8040 comp rx=0 tx=0).stop 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987950a640 1 -- 172.21.15.167:0/349437234 reap_dead start 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 msgr2=0x5592c4072f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c4072f20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f986800dfd0 tx=0x7f9868026fa0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 shutdown_connections 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/349437234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c406bd40 0x5592c4072f20 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 >> 172.21.15.167:0/349437234 conn(0x5592c40681b0 msgr2=0x5592c4066280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 shutdown_connections 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/349437234 wait complete. 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/1999534099 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9750034650 msgr2=0x7f9750036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/1999534099 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9750034650 0x7f9750036b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5592c40490a0 tx=0x7f9860005d90 comp rx=0 tx=0).stop 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/1999534099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c405f460 msgr2=0x5592c405f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/1999534099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c405f460 0x5592c405f880 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f98680482f0 tx=0x7f986800d7b0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/1999534099 shutdown_connections 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/1999534099 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9750034650 0x7f9750036b10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/1999534099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c405f460 0x5592c405f880 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/1999534099 >> 172.21.15.167:0/1999534099 conn(0x5592c40545b0 msgr2=0x5592c4057030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/1999534099 shutdown_connections 2024-09-18T02:05:20.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/1999534099 wait complete. 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5592c404af20 msgr2=0x5592c404d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5592c404af20 0x5592c404d310 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5592c40461e0 msgr2=0x5592c40485d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5592c40461e0 0x5592c40485d0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5592c404ee60 msgr2=0x5592c4051250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5592c404ee60 0x5592c4051250 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9760034650 msgr2=0x7f9760036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f9760034650 0x7f9760036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f98600ac000 tx=0x7f98600a5000 comp rx=0 tx=0).stop 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3f52ea0 msgr2=0x5592c4041260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 --2- 172.21.15.167:0/3011031654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592c3f52ea0 0x5592c4041260 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9868004000 tx=0x7f9868000bd0 comp rx=0 tx=0).stop 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987950a640 1 -- 172.21.15.167:0/3011031654 reap_dead start 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 shutdown_connections 2024-09-18T02:05:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 >> 172.21.15.167:0/3011031654 conn(0x5592c3f47070 msgr2=0x5592c4034410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 shutdown_connections 2024-09-18T02:05:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:20.371+0000 7f987b1f9980 1 -- 172.21.15.167:0/3011031654 wait complete. 2024-09-18T02:05:20.385 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-18T02:05:20.144904Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:05:20.144878Z', 'tags': [], 'group_ids': []} 2024-09-18T02:05:25.395 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:05:25.395 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-18T02:05:25.395 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-18T02:05:25.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-18T02:05:25.396 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-18T02:05:25.444 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:25.444 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:25.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.443+0000 7f3c76584980 1 Processor -- start 2024-09-18T02:05:25.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.443+0000 7f3c76584980 1 -- start start 2024-09-18T02:05:25.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.443+0000 7f3c76584980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5639510b03f0 0x5639510aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.443+0000 7f3c76584980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563950fc1ae0 con 0x5639510b0800 2024-09-18T02:05:25.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.443+0000 7f3c76584980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x563950fe5e30 con 0x5639510b03f0 2024-09-18T02:05:25.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.443+0000 7f3c74094640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5639510b03f0 0x5639510aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.443+0000 7f3c6b893640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5639510b0800 0x5639510af0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33734/0 (socket says 172.21.15.167:33734) 2024-09-18T02:05:25.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.443+0000 7f3c6b893640 1 -- 172.21.15.167:0/64630655 learned_addr learned my addr 172.21.15.167:0/64630655 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:05:25.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.443+0000 7f3c74094640 1 -- 172.21.15.167:0/64630655 >> v1:172.21.15.81:6789/0 conn(0x5639510b0800 legacy=0x5639510af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.443+0000 7f3c74094640 1 -- 172.21.15.167:0/64630655 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639510af920 con 0x5639510b03f0 2024-09-18T02:05:25.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.447+0000 7f3c74094640 1 --2- 172.21.15.167:0/64630655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x5639510aebb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400a480 tx=0x7f3c6401b0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75505ea509ab8b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.447+0000 7f3c73893640 1 -- 172.21.15.167:0/64630655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c640af070 con 0x5639510b03f0 2024-09-18T02:05:25.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.447+0000 7f3c73893640 1 -- 172.21.15.167:0/64630655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c640aa530 con 0x5639510b03f0 2024-09-18T02:05:25.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.447+0000 7f3c73893640 1 -- 172.21.15.167:0/64630655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c640a3e60 con 0x5639510b03f0 2024-09-18T02:05:25.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.447+0000 7f3c76584980 1 -- 172.21.15.167:0/64630655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 msgr2=0x5639510aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.447+0000 7f3c76584980 1 --2- 172.21.15.167:0/64630655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x5639510aebb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400a480 tx=0x7f3c6401b0a0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.447+0000 7f3c76584980 1 -- 172.21.15.167:0/64630655 shutdown_connections 2024-09-18T02:05:25.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.447+0000 7f3c76584980 1 --2- 172.21.15.167:0/64630655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x5639510aebb0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.447+0000 7f3c76584980 1 -- 172.21.15.167:0/64630655 >> 172.21.15.167:0/64630655 conn(0x5639511351f0 msgr2=0x563951137610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.447+0000 7f3c76584980 1 -- 172.21.15.167:0/64630655 shutdown_connections 2024-09-18T02:05:25.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.447+0000 7f3c76584980 1 -- 172.21.15.167:0/64630655 wait complete. 2024-09-18T02:05:25.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.463+0000 7f3c76584980 1 Processor -- start 2024-09-18T02:05:25.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.463+0000 7f3c76584980 1 -- start start 2024-09-18T02:05:25.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.463+0000 7f3c76584980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x56395122b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.463+0000 7f3c76584980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563950fe7200 con 0x5639510b03f0 2024-09-18T02:05:25.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.463+0000 7f3c74094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x56395122b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.463+0000 7f3c74094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x56395122b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51220/0 (socket says 172.21.15.167:51220) 2024-09-18T02:05:25.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.463+0000 7f3c74094640 1 -- 172.21.15.167:0/154794597 learned_addr learned my addr 172.21.15.167:0/154794597 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.463+0000 7f3c74094640 1 -- 172.21.15.167:0/154794597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395122ba60 con 0x5639510b03f0 2024-09-18T02:05:25.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.463+0000 7f3c74094640 1 --2- 172.21.15.167:0/154794597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x56395122b490 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3c640ad040 tx=0x7f3c64003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0172d3cc307a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3b6260c640 1 -- 172.21.15.167:0/154794597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c640af040 con 0x5639510b03f0 2024-09-18T02:05:25.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3b6260c640 1 -- 172.21.15.167:0/154794597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c640aa9d0 con 0x5639510b03f0 2024-09-18T02:05:25.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3b6260c640 1 -- 172.21.15.167:0/154794597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c640aacb0 con 0x5639510b03f0 2024-09-18T02:05:25.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 -- 172.21.15.167:0/154794597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 msgr2=0x56395122b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 --2- 172.21.15.167:0/154794597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x56395122b490 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3c640ad040 tx=0x7f3c64003030 comp rx=0 tx=0).stop 2024-09-18T02:05:25.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 -- 172.21.15.167:0/154794597 shutdown_connections 2024-09-18T02:05:25.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 --2- 172.21.15.167:0/154794597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x56395122b490 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 -- 172.21.15.167:0/154794597 >> 172.21.15.167:0/154794597 conn(0x5639511351f0 msgr2=0x5639512270c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 -- 172.21.15.167:0/154794597 shutdown_connections 2024-09-18T02:05:25.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 -- 172.21.15.167:0/154794597 wait complete. 2024-09-18T02:05:25.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 Processor -- start 2024-09-18T02:05:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 -- start start 2024-09-18T02:05:25.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x563951232740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563951149a30 con 0x5639510b03f0 2024-09-18T02:05:25.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c74094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x563951232740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c74094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x563951232740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51222/0 (socket says 172.21.15.167:51222) 2024-09-18T02:05:25.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c74094640 1 -- 172.21.15.167:0/1684018255 learned_addr learned my addr 172.21.15.167:0/1684018255 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c74094640 1 -- 172.21.15.167:0/1684018255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563951232c80 con 0x5639510b03f0 2024-09-18T02:05:25.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c74094640 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x563951232740 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3c640a4010 tx=0x7f3c64017e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3b60e09640 1 -- 172.21.15.167:0/1684018255 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c640c2030 con 0x5639510b03f0 2024-09-18T02:05:25.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3b60e09640 1 -- 172.21.15.167:0/1684018255 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c640b5870 con 0x5639510b03f0 2024-09-18T02:05:25.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563951232f10 con 0x5639510b03f0 2024-09-18T02:05:25.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3b60e09640 1 -- 172.21.15.167:0/1684018255 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c640af070 con 0x5639510b03f0 2024-09-18T02:05:25.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.467+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563951235bf0 con 0x5639510b03f0 2024-09-18T02:05:25.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3b60e09640 1 -- 172.21.15.167:0/1684018255 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3c640c5070 con 0x5639510b03f0 2024-09-18T02:05:25.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3b60e09640 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b5c0346a0 0x7f3b5c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3b60e09640 1 -- 172.21.15.167:0/1684018255 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3c640c3070 con 0x5639510b03f0 2024-09-18T02:05:25.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c6b893640 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b5c0346a0 0x7f3b5c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c76584980 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5639510b0800 0x563951239840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951239d80 con 0x5639510b0800 2024-09-18T02:05:25.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c74895640 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5639510b0800 0x563951239840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c6b893640 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b5c0346a0 0x7f3b5c036b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c000f70 tx=0x7f3c5c0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c74895640 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5639510b0800 0x563951239840 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c74895640 1 -- 172.21.15.167:0/1684018255 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x5639510b0800 2024-09-18T02:05:25.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951236e10 con 0x5639510b0800 2024-09-18T02:05:25.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c74895640 1 -- 172.21.15.167:0/1684018255 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x5639510b0800 2024-09-18T02:05:25.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c76584980 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56395123c0c0 0x56395123e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56395123eb80 con 0x56395123c0c0 2024-09-18T02:05:25.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c74094640 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56395123c0c0 0x56395123e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.471+0000 7f3c74094640 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56395123c0c0 0x56395123e4b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c74094640 1 -- 172.21.15.167:0/1684018255 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c640b2040 con 0x56395123c0c0 2024-09-18T02:05:25.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56395123af30 con 0x5639510b0800 2024-09-18T02:05:25.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c74895640 1 -- 172.21.15.167:0/1684018255 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x5639510b0800 2024-09-18T02:05:25.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c76584980 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56395123ffe0 0x5639512423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951242ac0 con 0x56395123ffe0 2024-09-18T02:05:25.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c6b893640 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56395123ffe0 0x5639512423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c6b893640 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56395123ffe0 0x5639512423d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c6b893640 1 -- 172.21.15.167:0/1684018255 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3c5c00e620 con 0x56395123ffe0 2024-09-18T02:05:25.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c76584980 1 Processor -- start 2024-09-18T02:05:25.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c76584980 1 -- start start 2024-09-18T02:05:25.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c76584980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563951250570 0x563951250990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c76584980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563951040800 con 0x563951250570 2024-09-18T02:05:25.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c74094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563951250570 0x563951250990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c74094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563951250570 0x563951250990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51236/0 (socket says 172.21.15.167:51236) 2024-09-18T02:05:25.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c74094640 1 -- 172.21.15.167:0/3903079007 learned_addr learned my addr 172.21.15.167:0/3903079007 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.475+0000 7f3c74094640 1 -- 172.21.15.167:0/3903079007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563951250ed0 con 0x563951250570 2024-09-18T02:05:25.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c74094640 1 --2- 172.21.15.167:0/3903079007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563951250570 0x563951250990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3c64000bf0 tx=0x7f3c640b5e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3b59ffb640 1 -- 172.21.15.167:0/3903079007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c64001010 con 0x563951250570 2024-09-18T02:05:25.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3b59ffb640 1 -- 172.21.15.167:0/3903079007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c640011b0 con 0x563951250570 2024-09-18T02:05:25.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3b59ffb640 1 -- 172.21.15.167:0/3903079007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c640dbcd0 con 0x563951250570 2024-09-18T02:05:25.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c76584980 1 -- 172.21.15.167:0/3903079007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563951251160 con 0x563951250570 2024-09-18T02:05:25.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c76584980 1 -- 172.21.15.167:0/3903079007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563951253de0 con 0x563951250570 2024-09-18T02:05:25.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3b59ffb640 1 -- 172.21.15.167:0/3903079007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3c640dbe70 con 0x563951250570 2024-09-18T02:05:25.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3b59ffb640 1 --2- 172.21.15.167:0/3903079007 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b4c034650 0x7f3b4c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3b59ffb640 1 -- 172.21.15.167:0/3903079007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3c640bb070 con 0x563951250570 2024-09-18T02:05:25.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c6b893640 1 --2- 172.21.15.167:0/3903079007 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b4c034650 0x7f3b4c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c76584980 1 Processor -- start 2024-09-18T02:05:25.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c76584980 1 -- start start 2024-09-18T02:05:25.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c6b893640 1 --2- 172.21.15.167:0/3903079007 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b4c034650 0x7f3b4c036b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00bf60 tx=0x7f3c5c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c76584980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 0x56395125d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c76584980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56395122bd80 con 0x56395125ce70 2024-09-18T02:05:25.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c74094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 0x56395125d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c74094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 0x56395125d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51248/0 (socket says 172.21.15.167:51248) 2024-09-18T02:05:25.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c74094640 1 -- 172.21.15.167:0/1271445125 learned_addr learned my addr 172.21.15.167:0/1271445125 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c74094640 1 -- 172.21.15.167:0/1271445125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395125d820 con 0x56395125ce70 2024-09-18T02:05:25.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.479+0000 7f3c74094640 1 --2- 172.21.15.167:0/1271445125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 0x56395125d250 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3c64001e40 tx=0x7f3c64001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19d5199583f703 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3b4b7fe640 1 -- 172.21.15.167:0/1271445125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c640dfae0 con 0x56395125ce70 2024-09-18T02:05:25.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3b4b7fe640 1 -- 172.21.15.167:0/1271445125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c640f7070 con 0x56395125ce70 2024-09-18T02:05:25.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3b4b7fe640 1 -- 172.21.15.167:0/1271445125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c640df3f0 con 0x56395125ce70 2024-09-18T02:05:25.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 -- 172.21.15.167:0/1271445125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 msgr2=0x56395125d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 --2- 172.21.15.167:0/1271445125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 0x56395125d250 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3c64001e40 tx=0x7f3c64001e70 comp rx=0 tx=0).stop 2024-09-18T02:05:25.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 -- 172.21.15.167:0/1271445125 shutdown_connections 2024-09-18T02:05:25.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 --2- 172.21.15.167:0/1271445125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 0x56395125d250 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 -- 172.21.15.167:0/1271445125 >> 172.21.15.167:0/1271445125 conn(0x563951259250 msgr2=0x563951257350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 -- 172.21.15.167:0/1271445125 shutdown_connections 2024-09-18T02:05:25.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 -- 172.21.15.167:0/1271445125 wait complete. 2024-09-18T02:05:25.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 Processor -- start 2024-09-18T02:05:25.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 -- start start 2024-09-18T02:05:25.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 0x563951264030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56395125dcc0 con 0x56395125ce70 2024-09-18T02:05:25.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c74094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 0x563951264030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c74094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 0x563951264030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51250/0 (socket says 172.21.15.167:51250) 2024-09-18T02:05:25.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 learned_addr learned my addr 172.21.15.167:0/3373303292 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563951264570 con 0x56395125ce70 2024-09-18T02:05:25.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c74094640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 0x563951264030 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3c640c69d0 tx=0x7f3c64006b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3b49ffb640 1 -- 172.21.15.167:0/3373303292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c64109070 con 0x56395125ce70 2024-09-18T02:05:25.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563951264570 con 0x56395125ce70 2024-09-18T02:05:25.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3b49ffb640 1 -- 172.21.15.167:0/3373303292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c640c6ce0 con 0x56395125ce70 2024-09-18T02:05:25.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563951264570 con 0x56395125ce70 2024-09-18T02:05:25.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.483+0000 7f3b49ffb640 1 -- 172.21.15.167:0/3373303292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c640a4370 con 0x56395125ce70 2024-09-18T02:05:25.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3b49ffb640 1 -- 172.21.15.167:0/3373303292 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3c640c90b0 con 0x56395125ce70 2024-09-18T02:05:25.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3b49ffb640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b3c034650 0x7f3b3c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3b49ffb640 1 -- 172.21.15.167:0/3373303292 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3c640fdc20 con 0x56395125ce70 2024-09-18T02:05:25.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c6b893640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b3c034650 0x7f3b3c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56395126f160 0x563951271620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951271d70 con 0x56395126f160 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c74895640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56395126f160 0x563951271620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c6b893640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b3c034650 0x7f3b3c036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x56395123a670 tx=0x7f3c5c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c74895640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56395126f160 0x563951271620 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 20 realm 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951272180 con 0x56395126f160 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951272a50 con 0x56395126f160 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x56395126f160 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563951273b50 0x563951275f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951276550 con 0x563951273b50 2024-09-18T02:05:25.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c74094640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563951273b50 0x563951275f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.487+0000 7f3c74094640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563951273b50 0x563951275f40 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c76584980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:25.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c76584980 20 searching for the correct realm 2024-09-18T02:05:25.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c76584980 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5639512784a0 0x56395127a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56395127af80 con 0x5639512784a0 2024-09-18T02:05:25.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c6b893640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5639512784a0 0x56395127a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c6b893640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5639512784a0 0x56395127a8b0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c6b893640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3c5c037040 0x7f3c5c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56395127af80 con 0x7f3c5c037040 2024-09-18T02:05:25.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3c5c037040 0x7f3c5c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3c5c037040 0x7f3c5c036410 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x7f3c5c037040 2024-09-18T02:05:25.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x56395126f160 2024-09-18T02:05:25.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x56395126f160 2024-09-18T02:05:25.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x56395126f160 2024-09-18T02:05:25.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.491+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x563951273b50 2024-09-18T02:05:25.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x7f3c5c037040 2024-09-18T02:05:25.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x5639512784a0 2024-09-18T02:05:25.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x56395126f160 2024-09-18T02:05:25.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x7f3c5c037040 2024-09-18T02:05:25.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x56395126f160 2024-09-18T02:05:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x7f3c5c037040 2024-09-18T02:05:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x5639512784a0 2024-09-18T02:05:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x5639512784a0 2024-09-18T02:05:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x563951273b50 2024-09-18T02:05:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x5639512784a0 2024-09-18T02:05:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.495+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x5639512784a0 2024-09-18T02:05:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x56395126f160 2024-09-18T02:05:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x56395126f160 2024-09-18T02:05:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x563951273b50 2024-09-18T02:05:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x5639512784a0 2024-09-18T02:05:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x7f3c5c037040 2024-09-18T02:05:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x56395126f160 2024-09-18T02:05:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x563951273b50 2024-09-18T02:05:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x5639512784a0 2024-09-18T02:05:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.499+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x563951273b50 2024-09-18T02:05:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x7f3c5c037040 2024-09-18T02:05:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x5639512784a0 2024-09-18T02:05:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x563951273b50 2024-09-18T02:05:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x56395126f160 2024-09-18T02:05:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563951272df0 con 0x7f3c5c037040 2024-09-18T02:05:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951276e10 con 0x56395126f160 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951276e10 con 0x56395126f160 2024-09-18T02:05:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951276e10 con 0x5639512784a0 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 zone default found 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 4 Realm: () 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 zonegroup default 2024-09-18T02:05:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.503+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951277830 con 0x563951273b50 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56395127d290 con 0x5639512784a0 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56395127d630 con 0x5639512784a0 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 20 started sync module instance, tier type = 2024-09-18T02:05:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127c6d0 con 0x7f3c5c037040 2024-09-18T02:05:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94804174686912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127c6d0 con 0x7f3c5c037040 2024-09-18T02:05:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127de80 con 0x56395126f160 2024-09-18T02:05:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.507+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94804174686912] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.511+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.511+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94804174685008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127de80 con 0x56395126f160 2024-09-18T02:05:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.511+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127e840 con 0x5639512784a0 2024-09-18T02:05:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.511+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94804174685008] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.511+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.511+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94804174690768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127ddf0 con 0x5639512784a0 2024-09-18T02:05:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.511+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127f580 con 0x7f3c5c037040 2024-09-18T02:05:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.515+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.515+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94804174696592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127fe20 con 0x7f3c5c037040 2024-09-18T02:05:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.515+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563951280820 con 0x56395126f160 2024-09-18T02:05:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.515+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94804174690768] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.515+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94804174696592] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.515+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.515+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94804174695392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127f920 con 0x56395126f160 2024-09-18T02:05:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.515+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639512810c0 con 0x563951273b50 2024-09-18T02:05:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.519+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.519+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94804174703632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127f920 con 0x563951273b50 2024-09-18T02:05:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.519+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563951281e40 con 0x563951273b50 2024-09-18T02:05:25.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.519+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94804174695392] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.519+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.519+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94804174703632] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.519+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94804174701360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563951281950 con 0x563951273b50 2024-09-18T02:05:25.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.519+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639512826a0 con 0x563951273b50 2024-09-18T02:05:25.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94804174701360] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94804174709136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563951282660 con 0x563951273b50 2024-09-18T02:05:25.526 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c76584980 20 add_watcher() i=0 2024-09-18T02:05:25.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c76584980 20 add_watcher() i=1 2024-09-18T02:05:25.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c76584980 20 add_watcher() i=2 2024-09-18T02:05:25.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c76584980 20 add_watcher() i=3 2024-09-18T02:05:25.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c76584980 20 add_watcher() i=4 2024-09-18T02:05:25.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c76584980 20 add_watcher() i=5 2024-09-18T02:05:25.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c76584980 20 add_watcher() i=6 2024-09-18T02:05:25.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94804174709136] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c76584980 20 add_watcher() i=7 2024-09-18T02:05:25.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c76584980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:25.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.523+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563951285ac0 con 0x56395126f160 2024-09-18T02:05:25.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94804174705760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563951282fe0 con 0x56395126f160 2024-09-18T02:05:25.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94804174705760] v32'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.531 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3b2a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:25.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:25.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:25.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 5 note: GC not initialized 2024-09-18T02:05:25.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3b297e2640 20 reqs_thread_entry: start 2024-09-18T02:05:25.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:25.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 20 Filter name: none 2024-09-18T02:05:25.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3a9affd640 20 reqs_thread_entry: start 2024-09-18T02:05:25.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T02:05:25.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639512a91a0 con 0x563951273b50 2024-09-18T02:05:25.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T02:05:25.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:05:25.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T02:05:25.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.527+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639512a7940 con 0x563951273b50 2024-09-18T02:05:25.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c76584980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c76584980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T02:05:25.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c76584980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:05:25.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c76584980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T02:05:25.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c76584980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T02:05:25.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639512a8230 con 0x563951273b50 2024-09-18T02:05:25.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c76584980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T02:05:25.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c76584980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:05:25.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c76584980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T02:05:25.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94804174863744 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639512ac790 con 0x563951273b50 2024-09-18T02:05:25.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== watch-notify(notify (1) cookie 94804174703632 notify 137438953509 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5639512a8bf0 con 0x563951273b50 2024-09-18T02:05:25.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3b4b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94804174703632 notifier 4746 bl.length()=556 2024-09-18T02:05:25.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3b4b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T02:05:25.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(65 notify.5 [notify cookie 94804174863744 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3b4b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:05:25.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.531+0000 7f3b4b7fe640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3b38003eb0 con 0x563951273b50 2024-09-18T02:05:25.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== watch-notify(notify_complete (2) cookie 94804174863744 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563951250ed0 con 0x563951273b50 2024-09-18T02:05:25.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639512a81e0 con 0x563951273b50 2024-09-18T02:05:25.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c76584980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T02:05:25.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c76584980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:05:25.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c76584980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T02:05:25.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94804174863664 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639512a81d0 con 0x5639512784a0 2024-09-18T02:05:25.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== watch-notify(notify (1) cookie 94804174690768 notify 137438953487 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f3c5c041080 con 0x5639512784a0 2024-09-18T02:05:25.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3b4b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94804174690768 notifier 4746 bl.length()=177 2024-09-18T02:05:25.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3b4b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T02:05:25.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3b4b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T02:05:25.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3b4b7fe640 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3b38003eb0 con 0x5639512784a0 2024-09-18T02:05:25.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(68 notify.2 [notify cookie 94804174863664 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== watch-notify(notify_complete (2) cookie 94804174863664 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563950fc1ae0 con 0x5639512784a0 2024-09-18T02:05:25.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.535+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.541 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T02:05:25.533335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:05:25.533324Z","tags":[],"group_ids":[]} 2024-09-18T02:05:25.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.539+0000 7f3b2a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:25.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.539+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94804174705760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639512a6f40 con 0x56395126f160 2024-09-18T02:05:25.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.539+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94804174705760] v32'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.539+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94804174686912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639512a6f40 con 0x7f3c5c037040 2024-09-18T02:05:25.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.539+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94804174686912] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.539+0000 7f3c76584980 20 remove_watcher() i=0 2024-09-18T02:05:25.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.539+0000 7f3c76584980 2 removed watcher, disabling cache 2024-09-18T02:05:25.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.539+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94804174685008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639512a6f40 con 0x56395126f160 2024-09-18T02:05:25.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.543+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94804174685008] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.543+0000 7f3c76584980 20 remove_watcher() i=1 2024-09-18T02:05:25.546 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.543+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94804174690768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639512a6f40 con 0x5639512784a0 2024-09-18T02:05:25.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.543+0000 7f3c6b893640 1 -- 172.21.15.167:0/3373303292 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94804174690768] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c5c00e620 con 0x5639512784a0 2024-09-18T02:05:25.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.543+0000 7f3c76584980 20 remove_watcher() i=2 2024-09-18T02:05:25.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.543+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94804174696592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127d9d0 con 0x7f3c5c037040 2024-09-18T02:05:25.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.547+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94804174696592] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x7f3c5c037040 2024-09-18T02:05:25.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.547+0000 7f3c76584980 20 remove_watcher() i=3 2024-09-18T02:05:25.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.547+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94804174695392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639512a6f40 con 0x56395126f160 2024-09-18T02:05:25.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.547+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94804174695392] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c6c00a4d0 con 0x56395126f160 2024-09-18T02:05:25.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.547+0000 7f3c76584980 20 remove_watcher() i=4 2024-09-18T02:05:25.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.547+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94804174703632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127d9d0 con 0x563951273b50 2024-09-18T02:05:25.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.551+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94804174703632] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.551+0000 7f3c76584980 20 remove_watcher() i=5 2024-09-18T02:05:25.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.551+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94804174701360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56395127ebe0 con 0x563951273b50 2024-09-18T02:05:25.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.551+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94804174701360] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.551+0000 7f3c76584980 20 remove_watcher() i=6 2024-09-18T02:05:25.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.551+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94804174709136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639512a6f40 con 0x563951273b50 2024-09-18T02:05:25.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c74094640 1 -- 172.21.15.167:0/3373303292 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94804174709136] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c640d8020 con 0x563951273b50 2024-09-18T02:05:25.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 20 remove_watcher() i=7 2024-09-18T02:05:25.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563951273b50 msgr2=0x563951275f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563951273b50 0x563951275f40 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56395126f160 msgr2=0x563951271620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56395126f160 0x563951271620 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3c5c037040 msgr2=0x7f3c5c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f3c5c037040 0x7f3c5c036410 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5639512784a0 msgr2=0x56395127a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5639512784a0 0x56395127a8b0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b3c034650 msgr2=0x7f3b3c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b3c034650 0x7f3b3c036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x56395123a670 tx=0x7f3c5c010000 comp rx=0 tx=0).stop 2024-09-18T02:05:25.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 msgr2=0x563951264030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/3373303292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56395125ce70 0x563951264030 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3c640c69d0 tx=0x7f3c64006b20 comp rx=0 tx=0).stop 2024-09-18T02:05:25.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 reap_dead start 2024-09-18T02:05:25.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c74895640 1 -- 172.21.15.167:0/3373303292 reap_dead start 2024-09-18T02:05:25.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 shutdown_connections 2024-09-18T02:05:25.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 >> 172.21.15.167:0/3373303292 conn(0x563951259250 msgr2=0x563951257320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 shutdown_connections 2024-09-18T02:05:25.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3373303292 wait complete. 2024-09-18T02:05:25.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3903079007 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b4c034650 msgr2=0x7f3b4c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/3903079007 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b4c034650 0x7f3b4c036b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00bf60 tx=0x7f3c5c00f000 comp rx=0 tx=0).stop 2024-09-18T02:05:25.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3903079007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563951250570 msgr2=0x563951250990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/3903079007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563951250570 0x563951250990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3c64000bf0 tx=0x7f3c640b5e90 comp rx=0 tx=0).stop 2024-09-18T02:05:25.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3903079007 shutdown_connections 2024-09-18T02:05:25.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/3903079007 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b4c034650 0x7f3b4c036b10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/3903079007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563951250570 0x563951250990 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3903079007 >> 172.21.15.167:0/3903079007 conn(0x5639512456c0 msgr2=0x563951248140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3903079007 shutdown_connections 2024-09-18T02:05:25.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/3903079007 wait complete. 2024-09-18T02:05:25.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56395123c0c0 msgr2=0x56395123e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56395123c0c0 0x56395123e4b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5639510b0800 msgr2=0x563951239840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5639510b0800 0x563951239840 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56395123ffe0 msgr2=0x5639512423d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56395123ffe0 0x5639512423d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b5c0346a0 msgr2=0x7f3b5c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f3b5c0346a0 0x7f3b5c036b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c000f70 tx=0x7f3c5c0012c0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 msgr2=0x563951232740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 --2- 172.21.15.167:0/1684018255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5639510b03f0 0x563951232740 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3c640a4010 tx=0x7f3c64017e40 comp rx=0 tx=0).stop 2024-09-18T02:05:25.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c74895640 1 -- 172.21.15.167:0/1684018255 reap_dead start 2024-09-18T02:05:25.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 shutdown_connections 2024-09-18T02:05:25.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 >> 172.21.15.167:0/1684018255 conn(0x5639511351f0 msgr2=0x563951225c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 shutdown_connections 2024-09-18T02:05:25.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.555+0000 7f3c76584980 1 -- 172.21.15.167:0/1684018255 wait complete. 2024-09-18T02:05:25.570 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T02:05:25.533335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:05:25.533324Z', 'tags': [], 'group_ids': []} 2024-09-18T02:05:25.587 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:05:25.593 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-18T02:05:25.593 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-18T02:05:25.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-18T02:05:25.594 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-18T02:05:25.627 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:25.627 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.623+0000 7f874de7f980 1 Processor -- start 2024-09-18T02:05:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.623+0000 7f874de7f980 1 -- start start 2024-09-18T02:05:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.623+0000 7f874de7f980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55de58fa37d0 0x55de58fa2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.623+0000 7f874de7f980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de58eb4ae0 con 0x55de58fa33c0 2024-09-18T02:05:25.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.623+0000 7f874de7f980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55de58ed8e30 con 0x55de58fa37d0 2024-09-18T02:05:25.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874b18e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55de58fa37d0 0x55de58fa2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874b98f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55de58fa33c0 0x55de58fa1b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33750/0 (socket says 172.21.15.167:33750) 2024-09-18T02:05:25.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874b98f640 1 -- 172.21.15.167:0/61690231 learned_addr learned my addr 172.21.15.167:0/61690231 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:05:25.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874b18e640 1 -- 172.21.15.167:0/61690231 >> v1:172.21.15.81:6789/0 conn(0x55de58fa33c0 legacy=0x55de58fa1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874b18e640 1 -- 172.21.15.167:0/61690231 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de58fa28f0 con 0x55de58fa37d0 2024-09-18T02:05:25.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874b18e640 1 --2- 172.21.15.167:0/61690231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa37d0 0x55de58fa2290 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f874000a480 tx=0x7f874001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c9a88c9f8e06d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874a98d640 1 -- 172.21.15.167:0/61690231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87400b0070 con 0x55de58fa37d0 2024-09-18T02:05:25.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874a98d640 1 -- 172.21.15.167:0/61690231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87400ab540 con 0x55de58fa37d0 2024-09-18T02:05:25.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874a98d640 1 -- 172.21.15.167:0/61690231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87400ab840 con 0x55de58fa37d0 2024-09-18T02:05:25.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874de7f980 1 -- 172.21.15.167:0/61690231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa37d0 msgr2=0x55de58fa2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874de7f980 1 --2- 172.21.15.167:0/61690231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa37d0 0x55de58fa2290 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f874000a480 tx=0x7f874001b280 comp rx=0 tx=0).stop 2024-09-18T02:05:25.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874de7f980 1 -- 172.21.15.167:0/61690231 shutdown_connections 2024-09-18T02:05:25.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874de7f980 1 --2- 172.21.15.167:0/61690231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa37d0 0x55de58fa2290 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.627+0000 7f874de7f980 1 -- 172.21.15.167:0/61690231 >> 172.21.15.167:0/61690231 conn(0x55de590281c0 msgr2=0x55de5902a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.631+0000 7f874de7f980 1 -- 172.21.15.167:0/61690231 shutdown_connections 2024-09-18T02:05:25.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.631+0000 7f874de7f980 1 -- 172.21.15.167:0/61690231 wait complete. 2024-09-18T02:05:25.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.643+0000 7f874de7f980 1 Processor -- start 2024-09-18T02:05:25.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.643+0000 7f874de7f980 1 -- start start 2024-09-18T02:05:25.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.643+0000 7f874de7f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 0x55de59119bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.643+0000 7f874de7f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de58eda200 con 0x55de58fa33c0 2024-09-18T02:05:25.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.643+0000 7f874b98f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 0x55de59119bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.643+0000 7f874b98f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 0x55de59119bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51270/0 (socket says 172.21.15.167:51270) 2024-09-18T02:05:25.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.643+0000 7f874b98f640 1 -- 172.21.15.167:0/628281812 learned_addr learned my addr 172.21.15.167:0/628281812 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.643+0000 7f874b98f640 1 -- 172.21.15.167:0/628281812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5911a180 con 0x55de58fa33c0 2024-09-18T02:05:25.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874b98f640 1 --2- 172.21.15.167:0/628281812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 0x55de59119bb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f873c001d90 tx=0x7f873c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a21416cd2186f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f8639e0b640 1 -- 172.21.15.167:0/628281812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c013030 con 0x55de58fa33c0 2024-09-18T02:05:25.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f8639e0b640 1 -- 172.21.15.167:0/628281812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c00e690 con 0x55de58fa33c0 2024-09-18T02:05:25.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f8639e0b640 1 -- 172.21.15.167:0/628281812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c00ea10 con 0x55de58fa33c0 2024-09-18T02:05:25.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 -- 172.21.15.167:0/628281812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 msgr2=0x55de59119bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 --2- 172.21.15.167:0/628281812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 0x55de59119bb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f873c001d90 tx=0x7f873c001e80 comp rx=0 tx=0).stop 2024-09-18T02:05:25.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 -- 172.21.15.167:0/628281812 shutdown_connections 2024-09-18T02:05:25.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 --2- 172.21.15.167:0/628281812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 0x55de59119bb0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 -- 172.21.15.167:0/628281812 >> 172.21.15.167:0/628281812 conn(0x55de590281c0 msgr2=0x55de591157e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 -- 172.21.15.167:0/628281812 shutdown_connections 2024-09-18T02:05:25.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 -- 172.21.15.167:0/628281812 wait complete. 2024-09-18T02:05:25.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 Processor -- start 2024-09-18T02:05:25.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 -- start start 2024-09-18T02:05:25.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 0x55de59120f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de59038210 con 0x55de58fa33c0 2024-09-18T02:05:25.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874b98f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 0x55de59120f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874b98f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 0x55de59120f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51286/0 (socket says 172.21.15.167:51286) 2024-09-18T02:05:25.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874b98f640 1 -- 172.21.15.167:0/3690930249 learned_addr learned my addr 172.21.15.167:0/3690930249 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874b98f640 1 -- 172.21.15.167:0/3690930249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de59121460 con 0x55de58fa33c0 2024-09-18T02:05:25.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874b98f640 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 0x55de59120f20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x55de5911ad90 tx=0x7f873c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f8633fff640 1 -- 172.21.15.167:0/3690930249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c027070 con 0x55de58fa33c0 2024-09-18T02:05:25.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de591216f0 con 0x55de58fa33c0 2024-09-18T02:05:25.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f8633fff640 1 -- 172.21.15.167:0/3690930249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c019900 con 0x55de58fa33c0 2024-09-18T02:05:25.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f8633fff640 1 -- 172.21.15.167:0/3690930249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c019c20 con 0x55de58fa33c0 2024-09-18T02:05:25.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.647+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de591243d0 con 0x55de58fa33c0 2024-09-18T02:05:25.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f8633fff640 1 -- 172.21.15.167:0/3690930249 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f873c02a070 con 0x55de58fa33c0 2024-09-18T02:05:25.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f8633fff640 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8634034650 0x7f8634036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f8633fff640 1 -- 172.21.15.167:0/3690930249 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f873c01f070 con 0x55de58fa33c0 2024-09-18T02:05:25.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874b18e640 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8634034650 0x7f8634036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874de7f980 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55de58fa37d0 0x55de59128020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de591285a0 con 0x55de58fa37d0 2024-09-18T02:05:25.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874c190640 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55de58fa37d0 0x55de59128020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874b18e640 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8634034650 0x7f8634036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f87400ad000 tx=0x7f87400a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874c190640 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55de58fa37d0 0x55de59128020 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874c190640 1 -- 172.21.15.167:0/3690930249 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de58fa37d0 2024-09-18T02:05:25.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de591255f0 con 0x55de58fa37d0 2024-09-18T02:05:25.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874c190640 1 -- 172.21.15.167:0/3690930249 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f874400a4d0 con 0x55de58fa37d0 2024-09-18T02:05:25.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874de7f980 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55de5912a8b0 0x55de5912cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5912d370 con 0x55de5912a8b0 2024-09-18T02:05:25.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874b98f640 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55de5912a8b0 0x55de5912cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.651+0000 7f874b98f640 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55de5912a8b0 0x55de5912cca0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874b98f640 1 -- 172.21.15.167:0/3690930249 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f873c029030 con 0x55de5912a8b0 2024-09-18T02:05:25.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de59129750 con 0x55de58fa37d0 2024-09-18T02:05:25.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874c190640 1 -- 172.21.15.167:0/3690930249 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f874400a4d0 con 0x55de58fa37d0 2024-09-18T02:05:25.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874de7f980 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55de5912e7d0 0x55de59130bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de591312c0 con 0x55de5912e7d0 2024-09-18T02:05:25.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874b18e640 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55de5912e7d0 0x55de59130bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874b18e640 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55de5912e7d0 0x55de59130bc0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874b18e640 1 -- 172.21.15.167:0/3690930249 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f87400b3040 con 0x55de5912e7d0 2024-09-18T02:05:25.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874de7f980 1 Processor -- start 2024-09-18T02:05:25.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874de7f980 1 -- start start 2024-09-18T02:05:25.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874de7f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5913edb0 0x55de5913f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874de7f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de58f33800 con 0x55de5913edb0 2024-09-18T02:05:25.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874b98f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5913edb0 0x55de5913f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874b98f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5913edb0 0x55de5913f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51298/0 (socket says 172.21.15.167:51298) 2024-09-18T02:05:25.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874b98f640 1 -- 172.21.15.167:0/3615032476 learned_addr learned my addr 172.21.15.167:0/3615032476 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874b98f640 1 -- 172.21.15.167:0/3615032476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5913f710 con 0x55de5913edb0 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874b98f640 1 --2- 172.21.15.167:0/3615032476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5913edb0 0x55de5913f1d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f873c048490 tx=0x7f873c00d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f86317fa640 1 -- 172.21.15.167:0/3615032476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c048a10 con 0x55de5913edb0 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f86317fa640 1 -- 172.21.15.167:0/3615032476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c048bb0 con 0x55de5913edb0 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874de7f980 1 -- 172.21.15.167:0/3615032476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de5913f9a0 con 0x55de5913edb0 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f86317fa640 1 -- 172.21.15.167:0/3615032476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c02a580 con 0x55de5913edb0 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.655+0000 7f874de7f980 1 -- 172.21.15.167:0/3615032476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de59142620 con 0x55de5913edb0 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f86317fa640 1 -- 172.21.15.167:0/3615032476 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f873c036040 con 0x55de5913edb0 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f86317fa640 1 --2- 172.21.15.167:0/3615032476 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8624034650 0x7f8624036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f86317fa640 1 -- 172.21.15.167:0/3615032476 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f873c014070 con 0x55de5913edb0 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874b18e640 1 --2- 172.21.15.167:0/3615032476 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8624034650 0x7f8624036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 Processor -- start 2024-09-18T02:05:25.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 -- start start 2024-09-18T02:05:25.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de5914bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874b18e640 1 --2- 172.21.15.167:0/3615032476 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8624034650 0x7f8624036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55de59128e60 tx=0x7f8740005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de5911a500 con 0x55de5914b6e0 2024-09-18T02:05:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874b98f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de5914bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874b98f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de5914bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51308/0 (socket says 172.21.15.167:51308) 2024-09-18T02:05:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874b98f640 1 -- 172.21.15.167:0/3664089984 learned_addr learned my addr 172.21.15.167:0/3664089984 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874b98f640 1 -- 172.21.15.167:0/3664089984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5914c090 con 0x55de5914b6e0 2024-09-18T02:05:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874b98f640 1 --2- 172.21.15.167:0/3664089984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de5914bac0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f873c047210 tx=0x7f873c048f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bf570d90dd7aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f862affd640 1 -- 172.21.15.167:0/3664089984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c02a720 con 0x55de5914b6e0 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f862affd640 1 -- 172.21.15.167:0/3664089984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c055070 con 0x55de5914b6e0 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f862affd640 1 -- 172.21.15.167:0/3664089984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c012170 con 0x55de5914b6e0 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 -- 172.21.15.167:0/3664089984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 msgr2=0x55de5914bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 --2- 172.21.15.167:0/3664089984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de5914bac0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f873c047210 tx=0x7f873c048f50 comp rx=0 tx=0).stop 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 -- 172.21.15.167:0/3664089984 shutdown_connections 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 --2- 172.21.15.167:0/3664089984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de5914bac0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 -- 172.21.15.167:0/3664089984 >> 172.21.15.167:0/3664089984 conn(0x55de59147ac0 msgr2=0x55de59145bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 -- 172.21.15.167:0/3664089984 shutdown_connections 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 -- 172.21.15.167:0/3664089984 wait complete. 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 Processor -- start 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 -- start start 2024-09-18T02:05:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de59152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.659+0000 7f874de7f980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de5914c530 con 0x55de5914b6e0 2024-09-18T02:05:25.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874b98f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de59152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874b98f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de59152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51322/0 (socket says 172.21.15.167:51322) 2024-09-18T02:05:25.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 learned_addr learned my addr 172.21.15.167:0/1862022020 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de59152e40 con 0x55de5914b6e0 2024-09-18T02:05:25.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874b98f640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de59152900 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f873c0472b0 tx=0x7f873c03aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f86297fa640 1 -- 172.21.15.167:0/1862022020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c038e50 con 0x55de5914b6e0 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f86297fa640 1 -- 172.21.15.167:0/1862022020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c06c030 con 0x55de5914b6e0 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de59152e40 con 0x55de5914b6e0 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f86297fa640 1 -- 172.21.15.167:0/1862022020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c01dc50 con 0x55de5914b6e0 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de59152e40 con 0x55de5914b6e0 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f86297fa640 1 -- 172.21.15.167:0/1862022020 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f873c016070 con 0x55de5914b6e0 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f86297fa640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f86140347f0 0x7f8614036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f86297fa640 1 -- 172.21.15.167:0/1862022020 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f873c005050 con 0x55de5914b6e0 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874b18e640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f86140347f0 0x7f8614036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874de7f980 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55de5915d930 0x55de5915fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de59160540 con 0x55de5915d930 2024-09-18T02:05:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874c190640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55de5915d930 0x55de5915fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874b18e640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f86140347f0 0x7f8614036cb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8740018eb0 tx=0x7f87400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874c190640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55de5915d930 0x55de5915fdf0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.663+0000 7f874de7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 20 realm 2024-09-18T02:05:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de59160950 con 0x55de5915d930 2024-09-18T02:05:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de59161220 con 0x55de5915d930 2024-09-18T02:05:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x55de5915d930 2024-09-18T02:05:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55de59162320 0x55de59164710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de59164d20 con 0x55de59162320 2024-09-18T02:05:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874b98f640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55de59162320 0x55de59164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874b98f640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55de59162320 0x55de59164710 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 20 searching for the correct realm 2024-09-18T02:05:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55de59166c70 0x55de59169080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de59169750 con 0x55de59166c70 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874b18e640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55de59166c70 0x55de59169080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874b18e640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55de59166c70 0x55de59169080 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874b18e640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f87400cd040 0x7f87400da920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de59169750 con 0x7f87400cd040 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.667+0000 7f874c190640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f87400cd040 0x7f87400da920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f87400cd040 0x7f87400da920 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x7f87400cd040 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x55de5915d930 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x55de5915d930 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x55de5915d930 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x55de59162320 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x7f87400cd040 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x55de59166c70 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x55de5915d930 2024-09-18T02:05:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x7f87400cd040 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x55de5915d930 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x7f87400cd040 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.671+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de591615c0 con 0x55de59166c70 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de59166c70 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de59162320 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de59166c70 2024-09-18T02:05:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de59166c70 2024-09-18T02:05:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de5915d930 2024-09-18T02:05:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de5915d930 2024-09-18T02:05:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de59162320 2024-09-18T02:05:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de59166c70 2024-09-18T02:05:25.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x7f87400cd040 2024-09-18T02:05:25.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de5915d930 2024-09-18T02:05:25.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.675+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de59162320 2024-09-18T02:05:25.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de59166c70 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de59162320 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x7f87400cd040 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de59166c70 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de59162320 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x55de5915d930 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f87400e7080 con 0x7f87400cd040 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874de7f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874de7f980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874de7f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874de7f980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874de7f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874de7f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de591655e0 con 0x55de5915d930 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874de7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.679+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de591655e0 con 0x55de5915d930 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de591655e0 con 0x55de59166c70 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 zone default found 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 4 Realm: () 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:25.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 zonegroup default 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de59165f80 con 0x55de59162320 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5916b640 con 0x55de59166c70 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5916ba80 con 0x55de59166c70 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 started sync module instance, tier type = 2024-09-18T02:05:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916aa50 con 0x7f87400cd040 2024-09-18T02:05:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94413465759600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916aa50 con 0x7f87400cd040 2024-09-18T02:05:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.683+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916c520 con 0x55de5915d930 2024-09-18T02:05:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.687+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94413465759600] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.687+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.687+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94413465763888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916aa50 con 0x55de5915d930 2024-09-18T02:05:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.687+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916cf60 con 0x55de59166c70 2024-09-18T02:05:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.687+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94413465763888] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.691+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.691+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94413465757088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916a9c0 con 0x55de59166c70 2024-09-18T02:05:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.691+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916dc60 con 0x7f87400cd040 2024-09-18T02:05:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.691+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.691+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94413465770176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916e370 con 0x7f87400cd040 2024-09-18T02:05:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.691+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916ee90 con 0x55de5915d930 2024-09-18T02:05:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.691+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94413465757088] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.691+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94413465770176] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.691+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.691+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94413465774432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916ee50 con 0x55de5915d930 2024-09-18T02:05:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.691+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916f280 con 0x55de59162320 2024-09-18T02:05:25.697 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.695+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94413465774432] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.695+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.695+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94413465768704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916f670 con 0x55de59162320 2024-09-18T02:05:25.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.695+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916ff40 con 0x55de59162320 2024-09-18T02:05:25.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.695+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94413465768704] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94413465778704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916dea0 con 0x55de59162320 2024-09-18T02:05:25.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de59170d20 con 0x55de59162320 2024-09-18T02:05:25.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94413465778704] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94413465782256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de59170ce0 con 0x55de59162320 2024-09-18T02:05:25.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874de7f980 20 add_watcher() i=0 2024-09-18T02:05:25.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874de7f980 20 add_watcher() i=1 2024-09-18T02:05:25.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874de7f980 20 add_watcher() i=2 2024-09-18T02:05:25.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874de7f980 20 add_watcher() i=3 2024-09-18T02:05:25.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874de7f980 20 add_watcher() i=4 2024-09-18T02:05:25.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874de7f980 20 add_watcher() i=5 2024-09-18T02:05:25.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.699+0000 7f874de7f980 20 add_watcher() i=6 2024-09-18T02:05:25.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94413465782256] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 20 add_watcher() i=7 2024-09-18T02:05:25.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:25.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de59174140 con 0x55de5915d930 2024-09-18T02:05:25.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94413465780512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de59171630 con 0x55de5915d930 2024-09-18T02:05:25.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94413465780512] v32'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f8601fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:25.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:25.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:25.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 5 note: GC not initialized 2024-09-18T02:05:25.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f8600fe1640 20 reqs_thread_entry: start 2024-09-18T02:05:25.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:25.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 20 Filter name: none 2024-09-18T02:05:25.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f857a7fc640 20 reqs_thread_entry: start 2024-09-18T02:05:25.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-18T02:05:25.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de59197820 con 0x7f87400cd040 2024-09-18T02:05:25.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T02:05:25.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-18T02:05:25.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T02:05:25.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:05:25.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.703+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5919b9b0 con 0x55de59162320 2024-09-18T02:05:25.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.707+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v32'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.710 INFO:teuthology.orchestra.run.smithi167.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-18T02:05:25.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.707+0000 7f8601fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:25.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.707+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94413465780512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de59195650 con 0x55de5915d930 2024-09-18T02:05:25.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.707+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94413465780512] v32'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.707+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94413465759600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de59195650 con 0x7f87400cd040 2024-09-18T02:05:25.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.711+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94413465759600] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.711+0000 7f874de7f980 20 remove_watcher() i=0 2024-09-18T02:05:25.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.711+0000 7f874de7f980 2 removed watcher, disabling cache 2024-09-18T02:05:25.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.711+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94413465763888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de59195650 con 0x55de5915d930 2024-09-18T02:05:25.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.711+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94413465763888] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.711+0000 7f874de7f980 20 remove_watcher() i=1 2024-09-18T02:05:25.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.711+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94413465757088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916c030 con 0x55de59166c70 2024-09-18T02:05:25.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.715+0000 7f874b18e640 1 -- 172.21.15.167:0/1862022020 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94413465757088] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87400d8070 con 0x55de59166c70 2024-09-18T02:05:25.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.715+0000 7f874de7f980 20 remove_watcher() i=2 2024-09-18T02:05:25.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.715+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94413465770176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de59195650 con 0x7f87400cd040 2024-09-18T02:05:25.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.715+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94413465770176] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x7f87400cd040 2024-09-18T02:05:25.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.715+0000 7f874de7f980 20 remove_watcher() i=3 2024-09-18T02:05:25.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.715+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94413465774432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916a5a0 con 0x55de5915d930 2024-09-18T02:05:25.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.719+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94413465774432] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f874400a4d0 con 0x55de5915d930 2024-09-18T02:05:25.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.719+0000 7f874de7f980 20 remove_watcher() i=4 2024-09-18T02:05:25.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.719+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94413465768704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916c030 con 0x55de59162320 2024-09-18T02:05:25.723 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.719+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94413465768704] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.719+0000 7f874de7f980 20 remove_watcher() i=5 2024-09-18T02:05:25.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.719+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94413465778704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de59195650 con 0x55de59162320 2024-09-18T02:05:25.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94413465778704] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 20 remove_watcher() i=6 2024-09-18T02:05:25.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94413465782256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5916a5a0 con 0x55de59162320 2024-09-18T02:05:25.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874b98f640 1 -- 172.21.15.167:0/1862022020 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94413465782256] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c03e020 con 0x55de59162320 2024-09-18T02:05:25.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 20 remove_watcher() i=7 2024-09-18T02:05:25.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55de59162320 msgr2=0x55de59164710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55de59162320 0x55de59164710 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55de5915d930 msgr2=0x55de5915fdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55de5915d930 0x55de5915fdf0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f87400cd040 msgr2=0x7f87400da920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f87400cd040 0x7f87400da920 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55de59166c70 msgr2=0x55de59169080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55de59166c70 0x55de59169080 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f86140347f0 msgr2=0x7f8614036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f86140347f0 0x7f8614036cb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8740018eb0 tx=0x7f87400a6000 comp rx=0 tx=0).stop 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 msgr2=0x55de59152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874c190640 1 -- 172.21.15.167:0/1862022020 reap_dead start 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de59152900 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f873c0472b0 tx=0x7f873c03aeb0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 shutdown_connections 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 --2- 172.21.15.167:0/1862022020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5914b6e0 0x55de59152900 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 >> 172.21.15.167:0/1862022020 conn(0x55de59147ac0 msgr2=0x55de59145b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 shutdown_connections 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/1862022020 wait complete. 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/3615032476 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8624034650 msgr2=0x7f8624036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 --2- 172.21.15.167:0/3615032476 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8624034650 0x7f8624036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55de59128e60 tx=0x7f8740005a10 comp rx=0 tx=0).stop 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/3615032476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5913edb0 msgr2=0x55de5913f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 --2- 172.21.15.167:0/3615032476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5913edb0 0x55de5913f1d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f873c048490 tx=0x7f873c00d870 comp rx=0 tx=0).stop 2024-09-18T02:05:25.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 -- 172.21.15.167:0/3615032476 shutdown_connections 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.723+0000 7f874de7f980 1 --2- 172.21.15.167:0/3615032476 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8624034650 0x7f8624036b10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 --2- 172.21.15.167:0/3615032476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5913edb0 0x55de5913f1d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3615032476 >> 172.21.15.167:0/3615032476 conn(0x55de59133f00 msgr2=0x55de59136980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3615032476 shutdown_connections 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3615032476 wait complete. 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55de5912a8b0 msgr2=0x55de5912cca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55de5912a8b0 0x55de5912cca0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55de58fa37d0 msgr2=0x55de59128020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55de58fa37d0 0x55de59128020 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55de5912e7d0 msgr2=0x55de59130bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55de5912e7d0 0x55de59130bc0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8634034650 msgr2=0x7f8634036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f8634034650 0x7f8634036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f87400ad000 tx=0x7f87400a5040 comp rx=0 tx=0).stop 2024-09-18T02:05:25.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 msgr2=0x55de59120f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 --2- 172.21.15.167:0/3690930249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de58fa33c0 0x55de59120f20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x55de5911ad90 tx=0x7f873c000bd0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874c190640 1 -- 172.21.15.167:0/3690930249 reap_dead start 2024-09-18T02:05:25.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 shutdown_connections 2024-09-18T02:05:25.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 >> 172.21.15.167:0/3690930249 conn(0x55de590281c0 msgr2=0x55de59114360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 shutdown_connections 2024-09-18T02:05:25.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.727+0000 7f874de7f980 1 -- 172.21.15.167:0/3690930249 wait complete. 2024-09-18T02:05:25.739 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T02:05:25.785 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:05:25.785 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-18T02:05:25.791 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-18T02:05:25.791 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-18T02:05:25.792 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-18T02:05:25.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-18T02:05:25.792 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-18T02:05:25.830 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:25.831 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:25.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.827+0000 7fb9ae8ea980 1 Processor -- start 2024-09-18T02:05:25.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.827+0000 7fb9ae8ea980 1 -- start start 2024-09-18T02:05:25.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.827+0000 7fb9ae8ea980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5629e6f0fb10 0x5629e6f9e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.827+0000 7fb9ae8ea980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5629e6e23ae0 con 0x5629e6f9e880 2024-09-18T02:05:25.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.827+0000 7fb9ae8ea980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x5629e6e47e30 con 0x5629e6f0fb10 2024-09-18T02:05:25.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.827+0000 7fb9ac3fa640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5629e6f0fb10 0x5629e6f9e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.827+0000 7fb9abbf9640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5629e6f9e880 0x5629e6fa0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33752/0 (socket says 172.21.15.167:33752) 2024-09-18T02:05:25.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.827+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2648492414 learned_addr learned my addr 172.21.15.167:0/2648492414 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:05:25.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.831+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2648492414 >> v1:172.21.15.81:6789/0 conn(0x5629e6f9e880 legacy=0x5629e6fa0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.831+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2648492414 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e6fa33a0 con 0x5629e6f0fb10 2024-09-18T02:05:25.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.831+0000 7fb9ac3fa640 1 --2- 172.21.15.167:0/2648492414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e6f9e340 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400a480 tx=0x7fb9a401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce79012d9aac463 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.831+0000 7fb9ab3f8640 1 -- 172.21.15.167:0/2648492414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40b0070 con 0x5629e6f0fb10 2024-09-18T02:05:25.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.831+0000 7fb9ab3f8640 1 -- 172.21.15.167:0/2648492414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a40ab540 con 0x5629e6f0fb10 2024-09-18T02:05:25.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.831+0000 7fb9ab3f8640 1 -- 172.21.15.167:0/2648492414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40ab840 con 0x5629e6f0fb10 2024-09-18T02:05:25.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.835+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2648492414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 msgr2=0x5629e6f9e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.835+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2648492414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e6f9e340 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400a480 tx=0x7fb9a401b280 comp rx=0 tx=0).stop 2024-09-18T02:05:25.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.835+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2648492414 shutdown_connections 2024-09-18T02:05:25.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.835+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2648492414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e6f9e340 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.835+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2648492414 >> 172.21.15.167:0/2648492414 conn(0x5629e6f96070 msgr2=0x5629e6f98490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.835+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2648492414 shutdown_connections 2024-09-18T02:05:25.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.835+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2648492414 wait complete. 2024-09-18T02:05:25.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 Processor -- start 2024-09-18T02:05:25.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 -- start start 2024-09-18T02:05:25.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e6f9baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5629e6e49200 con 0x5629e6f0fb10 2024-09-18T02:05:25.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ac3fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e6f9baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ac3fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e6f9baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51340/0 (socket says 172.21.15.167:51340) 2024-09-18T02:05:25.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/3317336890 learned_addr learned my addr 172.21.15.167:0/3317336890 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/3317336890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e6f9c070 con 0x5629e6f0fb10 2024-09-18T02:05:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ac3fa640 1 --2- 172.21.15.167:0/3317336890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e6f9baa0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40ae040 tx=0x7fb9a4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ac8426c3813dc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb89a60c640 1 -- 172.21.15.167:0/3317336890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40b0040 con 0x5629e6f0fb10 2024-09-18T02:05:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb89a60c640 1 -- 172.21.15.167:0/3317336890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a40ab9d0 con 0x5629e6f0fb10 2024-09-18T02:05:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb89a60c640 1 -- 172.21.15.167:0/3317336890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40abcf0 con 0x5629e6f0fb10 2024-09-18T02:05:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3317336890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 msgr2=0x5629e6f9baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/3317336890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e6f9baa0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40ae040 tx=0x7fb9a4003030 comp rx=0 tx=0).stop 2024-09-18T02:05:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3317336890 shutdown_connections 2024-09-18T02:05:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/3317336890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e6f9baa0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3317336890 >> 172.21.15.167:0/3317336890 conn(0x5629e6f96070 msgr2=0x5629e7082700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3317336890 shutdown_connections 2024-09-18T02:05:25.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3317336890 wait complete. 2024-09-18T02:05:25.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 Processor -- start 2024-09-18T02:05:25.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 -- start start 2024-09-18T02:05:25.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e708fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ae8ea980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5629e6fa2e40 con 0x5629e6f0fb10 2024-09-18T02:05:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ac3fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e708fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ac3fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e708fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51350/0 (socket says 172.21.15.167:51350) 2024-09-18T02:05:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.851+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/3696692162 learned_addr learned my addr 172.21.15.167:0/3696692162 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/3696692162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e7090410 con 0x5629e6f0fb10 2024-09-18T02:05:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9ac3fa640 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e708fed0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4019930 tx=0x7fb9a4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb898e09640 1 -- 172.21.15.167:0/3696692162 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40b0070 con 0x5629e6f0fb10 2024-09-18T02:05:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629e70906a0 con 0x5629e6f0fb10 2024-09-18T02:05:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb898e09640 1 -- 172.21.15.167:0/3696692162 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a40b68b0 con 0x5629e6f0fb10 2024-09-18T02:05:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb898e09640 1 -- 172.21.15.167:0/3696692162 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40b6b90 con 0x5629e6f0fb10 2024-09-18T02:05:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e7093380 con 0x5629e6f0fb10 2024-09-18T02:05:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb898e09640 1 -- 172.21.15.167:0/3696692162 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb9a40bf3f0 con 0x5629e6f0fb10 2024-09-18T02:05:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb898e09640 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb894034650 0x7fb894036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb898e09640 1 -- 172.21.15.167:0/3696692162 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb9a40bc070 con 0x5629e6f0fb10 2024-09-18T02:05:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9abbf9640 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb894034650 0x7fb894036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629e6f9e880 0x5629e7096e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70974a0 con 0x5629e6f9e880 2024-09-18T02:05:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9acbfb640 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629e6f9e880 0x5629e7096e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9abbf9640 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb894034650 0x7fb894036b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb994001650 tx=0x7fb994006740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9acbfb640 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629e6f9e880 0x5629e7096e60 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9acbfb640 1 -- 172.21.15.167:0/3696692162 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99c0083f0 con 0x5629e6f9e880 2024-09-18T02:05:25.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7094580 con 0x5629e6f9e880 2024-09-18T02:05:25.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9acbfb640 1 -- 172.21.15.167:0/3696692162 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb99c0083f0 con 0x5629e6f9e880 2024-09-18T02:05:25.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629e70997d0 0x5629e709bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.855+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e709c290 con 0x5629e70997d0 2024-09-18T02:05:25.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9ac3fa640 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629e70997d0 0x5629e709bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9ac3fa640 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629e70997d0 0x5629e709bbc0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/3696692162 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70997d0 2024-09-18T02:05:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7098670 con 0x5629e6f9e880 2024-09-18T02:05:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9acbfb640 1 -- 172.21.15.167:0/3696692162 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb99c0083f0 con 0x5629e6f9e880 2024-09-18T02:05:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629e709d6d0 0x5629e709fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70a0250 con 0x5629e709d6d0 2024-09-18T02:05:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9abbf9640 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629e709d6d0 0x5629e709fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9abbf9640 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629e709d6d0 0x5629e709fac0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9abbf9640 1 -- 172.21.15.167:0/3696692162 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb99400f070 con 0x5629e709d6d0 2024-09-18T02:05:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9ae8ea980 1 Processor -- start 2024-09-18T02:05:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.859+0000 7fb9ae8ea980 1 -- start start 2024-09-18T02:05:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ae8ea980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70adce0 0x5629e70ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ae8ea980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5629e6ea2800 con 0x5629e70adce0 2024-09-18T02:05:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ac3fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70adce0 0x5629e70ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ac3fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70adce0 0x5629e70ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51360/0 (socket says 172.21.15.167:51360) 2024-09-18T02:05:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/1792347228 learned_addr learned my addr 172.21.15.167:0/1792347228 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/1792347228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e70ae640 con 0x5629e70adce0 2024-09-18T02:05:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ac3fa640 1 --2- 172.21.15.167:0/1792347228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70adce0 0x5629e70ae100 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40ab510 tx=0x7fb9a40b56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb891ffb640 1 -- 172.21.15.167:0/1792347228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40b4d90 con 0x5629e70adce0 2024-09-18T02:05:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb891ffb640 1 -- 172.21.15.167:0/1792347228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a40e40b0 con 0x5629e70adce0 2024-09-18T02:05:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/1792347228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629e70ae870 con 0x5629e70adce0 2024-09-18T02:05:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb891ffb640 1 -- 172.21.15.167:0/1792347228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40e4390 con 0x5629e70adce0 2024-09-18T02:05:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/1792347228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e70b14f0 con 0x5629e70adce0 2024-09-18T02:05:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb891ffb640 1 -- 172.21.15.167:0/1792347228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb9a40e4950 con 0x5629e70adce0 2024-09-18T02:05:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb891ffb640 1 --2- 172.21.15.167:0/1792347228 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb884034650 0x7fb884036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb891ffb640 1 -- 172.21.15.167:0/1792347228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb9a40d8050 con 0x5629e70adce0 2024-09-18T02:05:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9abbf9640 1 --2- 172.21.15.167:0/1792347228 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb884034650 0x7fb884036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ae8ea980 1 Processor -- start 2024-09-18T02:05:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ae8ea980 1 -- start start 2024-09-18T02:05:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9abbf9640 1 --2- 172.21.15.167:0/1792347228 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb884034650 0x7fb884036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb994006340 tx=0x7fb99400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ae8ea980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70ba940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ae8ea980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5629e6f9a1d0 con 0x5629e70ba540 2024-09-18T02:05:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ac3fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70ba940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ac3fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70ba940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51368/0 (socket says 172.21.15.167:51368) 2024-09-18T02:05:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.863+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/782188392 learned_addr learned my addr 172.21.15.167:0/782188392 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/782188392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e70baf10 con 0x5629e70ba540 2024-09-18T02:05:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ac3fa640 1 --2- 172.21.15.167:0/782188392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70ba940 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40bc040 tx=0x7fb9a40bfd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672a4fabf901bdc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb88b7fe640 1 -- 172.21.15.167:0/782188392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40f2070 con 0x5629e70ba540 2024-09-18T02:05:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb88b7fe640 1 -- 172.21.15.167:0/782188392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a40c0bd0 con 0x5629e70ba540 2024-09-18T02:05:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb88b7fe640 1 -- 172.21.15.167:0/782188392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40bf730 con 0x5629e70ba540 2024-09-18T02:05:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/782188392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 msgr2=0x5629e70ba940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/782188392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70ba940 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40bc040 tx=0x7fb9a40bfd70 comp rx=0 tx=0).stop 2024-09-18T02:05:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/782188392 shutdown_connections 2024-09-18T02:05:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/782188392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70ba940 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/782188392 >> 172.21.15.167:0/782188392 conn(0x5629e70b69b0 msgr2=0x5629e70b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/782188392 shutdown_connections 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/782188392 wait complete. 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 Processor -- start 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 -- start start 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70c1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5629e70bb420 con 0x5629e70ba540 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ac3fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ac3fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70c1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51384/0 (socket says 172.21.15.167:51384) 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 learned_addr learned my addr 172.21.15.167:0/2255805746 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e70c1d50 con 0x5629e70ba540 2024-09-18T02:05:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ac3fa640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70c1810 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40b4f50 tx=0x7fb9a40c0e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb889ffb640 1 -- 172.21.15.167:0/2255805746 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40fc040 con 0x5629e70ba540 2024-09-18T02:05:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629e70c1d50 con 0x5629e70ba540 2024-09-18T02:05:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb889ffb640 1 -- 172.21.15.167:0/2255805746 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a40c09b0 con 0x5629e70ba540 2024-09-18T02:05:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb889ffb640 1 -- 172.21.15.167:0/2255805746 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a40cab60 con 0x5629e70ba540 2024-09-18T02:05:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.867+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e70c21c0 con 0x5629e70ba540 2024-09-18T02:05:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb889ffb640 1 -- 172.21.15.167:0/2255805746 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb9a4109020 con 0x5629e70ba540 2024-09-18T02:05:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb889ffb640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb87c034650 0x7fb87c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb889ffb640 1 -- 172.21.15.167:0/2255805746 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb9a4107020 con 0x5629e70ba540 2024-09-18T02:05:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9abbf9640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb87c034650 0x7fb87c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629e70cc8e0 0x5629e70ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70cf4f0 con 0x5629e70cc8e0 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9acbfb640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629e70cc8e0 0x5629e70ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9abbf9640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb87c034650 0x7fb87c036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5629e70a0650 tx=0x7fb994010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9acbfb640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629e70cc8e0 0x5629e70ceda0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99c0083f0 con 0x5629e70cc8e0 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 20 realm 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70cf900 con 0x5629e70cc8e0 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99c0083f0 con 0x5629e70cc8e0 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d01d0 con 0x5629e70cc8e0 2024-09-18T02:05:25.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99c0083f0 con 0x5629e70cc8e0 2024-09-18T02:05:25.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70cc8e0 2024-09-18T02:05:25.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb99c0083f0 con 0x5629e70cc8e0 2024-09-18T02:05:25.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:25.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629e70d12d0 0x5629e70d36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d3cd0 con 0x5629e70d12d0 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.871+0000 7fb9ac3fa640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629e70d12d0 0x5629e70d36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9ac3fa640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629e70d12d0 0x5629e70d36c0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9ae8ea980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9ae8ea980 20 searching for the correct realm 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629e70d5c20 0x5629e70d8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d8700 con 0x5629e70d5c20 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9abbf9640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629e70d5c20 0x5629e70d8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9abbf9640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629e70d5c20 0x5629e70d8030 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99400f070 con 0x5629e70d5c20 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9abbf9640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb994024070 0x7fb994031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:25.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d8700 con 0x7fb994024070 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb994024070 0x7fb994031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb994024070 0x7fb994031970 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c0083f0 con 0x7fb994024070 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x7fb994024070 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c0083f0 con 0x7fb994024070 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70cc8e0 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70cc8e0 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70cc8e0 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.875+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d12d0 2024-09-18T02:05:25.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x7fb994024070 2024-09-18T02:05:25.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d5c20 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99400f070 con 0x5629e70d5c20 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70cc8e0 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x7fb994024070 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70cc8e0 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x7fb994024070 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d5c20 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d5c20 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d12d0 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d5c20 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.879+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d5c20 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70cc8e0 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70cc8e0 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d12d0 2024-09-18T02:05:25.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d5c20 2024-09-18T02:05:25.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x7fb994024070 2024-09-18T02:05:25.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70cc8e0 2024-09-18T02:05:25.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d12d0 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d5c20 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d12d0 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.883+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x7fb994024070 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d5c20 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70d12d0 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x5629e70cc8e0 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d0570 con 0x7fb994024070 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d4590 con 0x5629e70cc8e0 2024-09-18T02:05:25.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d4590 con 0x5629e70cc8e0 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d4590 con 0x5629e70d5c20 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 zone default found 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 4 Realm: () 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:25.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:25.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:25.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 zonegroup default 2024-09-18T02:05:25.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d5000 con 0x5629e70d12d0 2024-09-18T02:05:25.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70daa10 con 0x5629e70d5c20 2024-09-18T02:05:25.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70dadb0 con 0x5629e70d5c20 2024-09-18T02:05:25.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.887+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.891+0000 7fb9ae8ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:25.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.891+0000 7fb9ae8ea980 20 started sync module instance, tier type = 2024-09-18T02:05:25.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.891+0000 7fb9ae8ea980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:25.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.891+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d9e50 con 0x7fb994024070 2024-09-18T02:05:25.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.891+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.891+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94737970078576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d9e50 con 0x7fb994024070 2024-09-18T02:05:25.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.891+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70db680 con 0x5629e70cc8e0 2024-09-18T02:05:25.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.891+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94737970078576] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.891+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.891+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94737970082128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d9e50 con 0x5629e70cc8e0 2024-09-18T02:05:25.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.891+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70dc090 con 0x5629e70d5c20 2024-09-18T02:05:25.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.895+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94737970082128] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.895+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.895+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94737970076064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70d9dc0 con 0x5629e70d5c20 2024-09-18T02:05:25.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.895+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70dcde0 con 0x7fb994024070 2024-09-18T02:05:25.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.895+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.895+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94737970088544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70dd680 con 0x7fb994024070 2024-09-18T02:05:25.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.895+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70de080 con 0x5629e70cc8e0 2024-09-18T02:05:25.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.899+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94737970076064] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.899+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94737970088544] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.899+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.899+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94737970087040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70dd160 con 0x5629e70cc8e0 2024-09-18T02:05:25.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.899+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70de920 con 0x5629e70d12d0 2024-09-18T02:05:25.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.899+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94737970087040] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.899+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.899+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94737970095216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70dd160 con 0x5629e70d12d0 2024-09-18T02:05:25.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.903+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70df170 con 0x5629e70d12d0 2024-09-18T02:05:25.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.903+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94737970095216] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.903+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.903+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94737970097344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70df590 con 0x5629e70d12d0 2024-09-18T02:05:25.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.903+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70dfe60 con 0x5629e70d12d0 2024-09-18T02:05:25.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94737970099600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e0510 con 0x5629e70d12d0 2024-09-18T02:05:25.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 20 add_watcher() i=0 2024-09-18T02:05:25.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 20 add_watcher() i=1 2024-09-18T02:05:25.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 20 add_watcher() i=2 2024-09-18T02:05:25.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 20 add_watcher() i=3 2024-09-18T02:05:25.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 20 add_watcher() i=4 2024-09-18T02:05:25.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 20 add_watcher() i=5 2024-09-18T02:05:25.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94737970097344] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 20 add_watcher() i=6 2024-09-18T02:05:25.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94737970099600] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 20 add_watcher() i=7 2024-09-18T02:05:25.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:25.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e3410 con 0x5629e70cc8e0 2024-09-18T02:05:25.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94737970102064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e0800 con 0x5629e70cc8e0 2024-09-18T02:05:25.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94737970102064] v32'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.907+0000 7fb8627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:25.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.911+0000 7fb9ae8ea980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:25.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.911+0000 7fb9ae8ea980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:25.912 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.911+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70ebc10 con 0x5629e70cc8e0 2024-09-18T02:05:25.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.911+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.911+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70ec260 con 0x5629e70d12d0 2024-09-18T02:05:25.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.915+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.915+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70ec260 con 0x5629e70d5c20 2024-09-18T02:05:25.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.915+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.915+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70ecd40 con 0x5629e70cc8e0 2024-09-18T02:05:25.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.915+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'225 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.915+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e9a10 con 0x7fb994024070 2024-09-18T02:05:25.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.919+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'74 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.919+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e9a10 con 0x5629e70d5c20 2024-09-18T02:05:25.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.919+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'57 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.919+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70eda70 con 0x5629e70cc8e0 2024-09-18T02:05:25.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.923+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.923+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70eda70 con 0x5629e70d12d0 2024-09-18T02:05:25.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.923+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.923+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70eda70 con 0x7fb994024070 2024-09-18T02:05:25.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.927+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.927+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70eda70 con 0x5629e70d5c20 2024-09-18T02:05:25.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.927+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.927+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70ee020 con 0x7fb994024070 2024-09-18T02:05:25.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.927+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'75 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.931 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.927+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70ee000 con 0x5629e70d12d0 2024-09-18T02:05:25.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.931+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.931+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x7fb994024070 2024-09-18T02:05:25.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.931+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.931+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d12d0 2024-09-18T02:05:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.935+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'65 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.935+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70cc8e0 2024-09-18T02:05:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.935+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'226 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.935+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d5c20 2024-09-18T02:05:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.939+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'70 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.939+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x7fb994024070 2024-09-18T02:05:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.939+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'76 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.939+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d5c20 2024-09-18T02:05:25.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.939+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.939+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70cc8e0 2024-09-18T02:05:25.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.943+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.943+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70cc8e0 2024-09-18T02:05:25.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.943+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'227 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.943+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d5c20 2024-09-18T02:05:25.950 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.947+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'71 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.947+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x7fb994024070 2024-09-18T02:05:25.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.947+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.947+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d5c20 2024-09-18T02:05:25.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.951+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'35 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.951+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d5c20 2024-09-18T02:05:25.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.951+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'44 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.951+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d5c20 2024-09-18T02:05:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.955+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.955+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d5c20 2024-09-18T02:05:25.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.955+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'58 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.955+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d12d0 2024-09-18T02:05:25.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.959+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.959+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d5c20 2024-09-18T02:05:25.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.959+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'40 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.959+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d12d0 2024-09-18T02:05:25.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.963+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.963+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d5c20 2024-09-18T02:05:25.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.963+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'72 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.963+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x5629e70d12d0 2024-09-18T02:05:25.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.967+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'66 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.967+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70edfc0 con 0x7fb994024070 2024-09-18T02:05:25.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.973 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb8617e2640 20 reqs_thread_entry: start 2024-09-18T02:05:25.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:25.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 20 Filter name: none 2024-09-18T02:05:25.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-18T02:05:25.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb7d2ffd640 20 reqs_thread_entry: start 2024-09-18T02:05:25.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e8fc0 con 0x7fb994024070 2024-09-18T02:05:25.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T02:05:25.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-18T02:05:25.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T02:05:25.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:05:25.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e8a30 con 0x5629e70cc8e0 2024-09-18T02:05:25.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 : miss 2024-09-18T02:05:25.976 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:96 8.d 8:b052010b:root::.bucket.meta.myfoo6%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e710b9f0 con 0x7fb994024070 2024-09-18T02:05:25.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(96 .bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T02:05:25.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 info.flags=0x17 2024-09-18T02:05:25.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 to cache LRU end 2024-09-18T02:05:25.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:05:25.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T02:05:25.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 2024-09-18T02:05:25.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:97 4.1b 4:da6a630d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7188f70 con 0x7fb994024070 2024-09-18T02:05:25.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(97 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c026040 con 0x7fb994024070 2024-09-18T02:05:25.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.971+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:98 4.6 4:60a440ab:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7188f70 con 0x5629e70d5c20 2024-09-18T02:05:25.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(98 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:99 4.3c 4:3ea78ab1:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7188f70 con 0x5629e70cc8e0 2024-09-18T02:05:25.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(99 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:100 4.9 4:903a05e5:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7188f70 con 0x5629e70cc8e0 2024-09-18T02:05:25.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(100 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c026040 con 0x5629e70cc8e0 2024-09-18T02:05:25.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:101 4.12 4:4b91de11:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7188f30 con 0x5629e70cc8e0 2024-09-18T02:05:25.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(101 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:102 4.9 4:905ebafe:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7188f30 con 0x5629e70cc8e0 2024-09-18T02:05:25.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(102 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.5 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:103 4.0 4:0265753b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7188f30 con 0x5629e70d5c20 2024-09-18T02:05:25.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(103 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:104 4.24 4:253bf9bb:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7188f30 con 0x5629e70d12d0 2024-09-18T02:05:25.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(104 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.7 [call out=85b] v0'0 uv17 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:105 4.18 4:1bbb3569:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7188f70 con 0x7fb994024070 2024-09-18T02:05:25.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 23 ==== osd_op_reply(105 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.975+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:106 4.3e 4:7ce3cfa2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7188f70 con 0x7fb994024070 2024-09-18T02:05:25.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 24 ==== osd_op_reply(106 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9 [call out=345b] v0'0 uv7 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9ae8ea980 10 cls_bucket_list_unordered: got thirteen 2024-09-18T02:05:25.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:107 4.35 4:ac3b89ba:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7188f70 con 0x5629e70cc8e0 2024-09-18T02:05:25.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(107 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9ae8ea980 20 get_obj_state: octx=0x5629e70ba920 obj=myfoo6:thirteen state=0x5629e7186ff8 s->prefetch_data=0 2024-09-18T02:05:25.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:108 3.d 3:b3a6972e:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7187e20 con 0x5629e70d5c20 2024-09-18T02:05:25.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(108 c5231f36-c36e-44d5-8268-aaf52617db58.4235.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9ae8ea980 10 manifest: total_size = 8 2024-09-18T02:05:25.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9ae8ea980 20 get_obj_state: setting s->obj_tag to _GKMJmzeiqniCMTrolTY1VZ9YsGimmKY 2024-09-18T02:05:25.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9ae8ea980 20 get_obj_state: octx=0x5629e70ba920 obj=myfoo6:thirteen state=0x5629e7186ff8 s->prefetch_data=0 2024-09-18T02:05:25.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9ae8ea980 20 prepare_atomic_modification: state is not atomic. state=0x5629e7186ff8 2024-09-18T02:05:25.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9ae8ea980 20 bucket index object: :.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9 2024-09-18T02:05:25.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:109 4.3e 4:7ce3cfa2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71886e0 con 0x7fb994024070 2024-09-18T02:05:25.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 25 ==== osd_op_reply(109 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9 [stat,call,call] v32'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.979+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:110 3.d 3:b3a6972e:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71886e0 con 0x5629e70d5c20 2024-09-18T02:05:25.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== osd_op_reply(110 c5231f36-c36e-44d5-8268-aaf52617db58.4235.9_thirteen [call] v32'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:111 4.3e 4:7ce3cfa2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71105f0 con 0x7fb994024070 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 20 list_objects_ordered: starting attempt 1 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:112 4.1b 4:da6a630d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71105f0 con 0x7fb994024070 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:113 4.6 4:60a440ab:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71148c0 con 0x5629e70d5c20 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:114 4.3c 4:3ea78ab1:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71105f0 con 0x5629e70cc8e0 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:115 4.9 4:903a05e5:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7119680 con 0x5629e70cc8e0 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:116 4.12 4:4b91de11:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e711bfc0 con 0x5629e70cc8e0 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:117 4.9 4:905ebafe:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e711ec10 con 0x5629e70cc8e0 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:118 4.0 4:0265753b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7121a10 con 0x5629e70d5c20 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:119 4.24 4:253bf9bb:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71247e0 con 0x5629e70d12d0 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:120 4.18 4:1bbb3569:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7121a10 con 0x7fb994024070 2024-09-18T02:05:25.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:121 4.3e 4:7ce3cfa2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7119680 con 0x7fb994024070 2024-09-18T02:05:25.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:122 4.35 4:ac3b89ba:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e712bc50 con 0x5629e70cc8e0 2024-09-18T02:05:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 31 ==== osd_op_reply(113 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 32 ==== osd_op_reply(118 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(114 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 35 ==== osd_op_reply(115 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 36 ==== osd_op_reply(116 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 37 ==== osd_op_reply(122 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 26 ==== osd_op_reply(112 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 27 ==== osd_op_reply(120 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(119 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.7 [call out=85b] v0'0 uv17 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 38 ==== osd_op_reply(117 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.5 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 28 ==== osd_op_reply(111 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9 [stat,call,call] v32'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb88affd640 20 handle_completion(): completion ok for obj=thirteen 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 29 ==== osd_op_reply(121 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[c5231f36-c36e-44d5-8268-aaf52617db58.4235.9])"; uploads.size()=0; is_truncated=0 2024-09-18T02:05:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:123 4.1b 4:da6a630d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71247a0 con 0x7fb994024070 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:124 4.6 4:60a440ab:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71108b0 con 0x5629e70d5c20 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:125 4.3c 4:3ea78ab1:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7110f30 con 0x5629e70cc8e0 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:126 4.9 4:903a05e5:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71137f0 con 0x5629e70cc8e0 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:127 4.12 4:4b91de11:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71247a0 con 0x5629e70cc8e0 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:128 4.9 4:905ebafe:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7114130 con 0x5629e70cc8e0 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:129 4.0 4:0265753b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71171b0 con 0x5629e70d5c20 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:130 4.24 4:253bf9bb:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7110f30 con 0x5629e70d12d0 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:131 4.18 4:1bbb3569:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71247a0 con 0x7fb994024070 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:132 4.3e 4:7ce3cfa2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71108b0 con 0x7fb994024070 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:133 4.35 4:ac3b89ba:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7110f30 con 0x5629e70cc8e0 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 33 ==== osd_op_reply(124 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 34 ==== osd_op_reply(129 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(130 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.7 [call out=85b] v0'0 uv17 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 30 ==== osd_op_reply(123 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 31 ==== osd_op_reply(131 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 32 ==== osd_op_reply(132 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 39 ==== osd_op_reply(125 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 40 ==== osd_op_reply(127 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 41 ==== osd_op_reply(126 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 42 ==== osd_op_reply(133 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.983+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 43 ==== osd_op_reply(128 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.5 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e7114130 con 0x5629e70cc8e0 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 44 ==== osd_op_reply(134 bud.buckets [call] v32'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9ae8ea980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7113c60 con 0x5629e70cc8e0 2024-09-18T02:05:25.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 45 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9ae8ea980 20 rados_obj.operate() r=0 bl.length=166 2024-09-18T02:05:25.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9ae8ea980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-18T02:05:25.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9ae8ea980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-18T02:05:25.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e7113c60 con 0x5629e70cc8e0 2024-09-18T02:05:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 46 ==== osd_op_reply(136 myfoo6 [call,call,delete] v32'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9ae8ea980 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-18T02:05:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9ae8ea980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-18T02:05:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94737970369200 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7114110 con 0x7fb994024070 2024-09-18T02:05:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 33 ==== watch-notify(notify (1) cookie 94737970088544 notify 137438953489 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5629e710af30 con 0x7fb994024070 2024-09-18T02:05:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 34 ==== osd_op_reply(137 notify.3 [notify cookie 94737970369200 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb88b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94737970088544 notifier 4760 bl.length()=150 2024-09-18T02:05:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.987+0000 7fb88b7fe640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb870003d70 con 0x7fb994024070 2024-09-18T02:05:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 35 ==== watch-notify(notify_complete (2) cookie 94737970369200 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5629e70e9390 con 0x7fb994024070 2024-09-18T02:05:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 36 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:139 8.d 8:b052010b:root::.bucket.meta.myfoo6%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e7113c60 con 0x7fb994024070 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 37 ==== osd_op_reply(139 .bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 [call,call,delete] v32'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 from cache 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:c5231f36-c36e-44d5-8268-aaf52617db58.4235.9, ofs0, ns] 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94737970279104 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7113c60 con 0x5629e70d5c20 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 35 ==== watch-notify(notify (1) cookie 94737970076064 notify 137438953488 ret 0) ==== 249+0+0 (crc 0 0 0) 0x5629e70e9560 con 0x5629e70d5c20 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb88b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94737970076064 notifier 4760 bl.length()=207 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 36 ==== osd_op_reply(140 notify.2 [notify cookie 94737970279104 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb88b7fe640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb870003d70 con 0x5629e70d5c20 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 37 ==== watch-notify(notify_complete (2) cookie 94737970279104 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5629e70ea060 con 0x5629e70d5c20 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 38 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:142 4.1b 4:da6a630d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71212b0 con 0x7fb994024070 2024-09-18T02:05:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:143 4.6 4:60a440ab:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e7121650 con 0x5629e70d5c20 2024-09-18T02:05:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:144 4.3c 4:3ea78ab1:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71201d0 con 0x5629e70cc8e0 2024-09-18T02:05:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:145 4.9 4:903a05e5:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e7120ae0 con 0x5629e70cc8e0 2024-09-18T02:05:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:146 4.12 4:4b91de11:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71212b0 con 0x5629e70cc8e0 2024-09-18T02:05:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:147 4.9 4:905ebafe:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71201d0 con 0x5629e70cc8e0 2024-09-18T02:05:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:148 4.0 4:0265753b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e7121650 con 0x5629e70d5c20 2024-09-18T02:05:25.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:149 4.24 4:253bf9bb:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71212b0 con 0x5629e70d12d0 2024-09-18T02:05:25.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:150 4.18 4:1bbb3569:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71201d0 con 0x7fb994024070 2024-09-18T02:05:25.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:151 4.3e 4:7ce3cfa2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e7121650 con 0x7fb994024070 2024-09-18T02:05:25.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.991+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:152 4.35 4:ac3b89ba:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e711ef80 con 0x5629e70cc8e0 2024-09-18T02:05:25.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 39 ==== osd_op_reply(143 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.1 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:25.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 47 ==== osd_op_reply(146 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.4 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 38 ==== osd_op_reply(151 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.9 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 40 ==== osd_op_reply(148 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.6 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(149 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.7 [delete] v32'18 uv18 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 39 ==== osd_op_reply(142 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.0 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 40 ==== osd_op_reply(150 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.8 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 48 ==== osd_op_reply(145 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.3 [delete] v32'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 49 ==== osd_op_reply(144 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.2 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 50 ==== osd_op_reply(152 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.10 [delete] v32'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 51 ==== osd_op_reply(147 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.9.5 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9ae8ea980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 : miss 2024-09-18T02:05:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9ae8ea980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.995+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:153 6.1d 6:bb3e37a6:::pubsub..bucket.myfoo6%2fc5231f36-c36e-44d5-8268-aaf52617db58.4235.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e71212b0 con 0x5629e70d12d0 2024-09-18T02:05:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.999+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(153 pubsub..bucket.myfoo6/c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.999+0000 7fb9ae8ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.999+0000 7fb9ae8ea980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 info.flags=0x0 2024-09-18T02:05:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.999+0000 7fb9ae8ea980 10 adding default.rgw.log++pubsub..bucket.myfoo6/c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 to cache LRU end 2024-09-18T02:05:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.999+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:154 6.1d 6:bb3e37a6:::pubsub..bucket.myfoo6%2fc5231f36-c36e-44d5-8268-aaf52617db58.4235.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71212b0 con 0x5629e70d12d0 2024-09-18T02:05:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.999+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(154 pubsub..bucket.myfoo6/c5231f36-c36e-44d5-8268-aaf52617db58.4235.9 [delete] v32'53 uv42 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:25.999+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71212b0 con 0x5629e70cc8e0 2024-09-18T02:05:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 52 ==== osd_op_reply(155 bud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9ae8ea980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-18T02:05:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71212b0 con 0x5629e70cc8e0 2024-09-18T02:05:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 53 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v32'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9ae8ea980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-18T02:05:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94737970279104 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7113c60 con 0x5629e70d12d0 2024-09-18T02:05:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== watch-notify(notify (1) cookie 94737970095216 notify 137438953511 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5629e70e99e0 con 0x5629e70d12d0 2024-09-18T02:05:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb88affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94737970095216 notifier 4760 bl.length()=170 2024-09-18T02:05:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(157 notify.5 [notify cookie 94737970279104 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb88affd640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb7e00032d0 con 0x5629e70d12d0 2024-09-18T02:05:26.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== watch-notify(notify_complete (2) cookie 94737970279104 notify 137438953511 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5629e70ae640 con 0x5629e70d12d0 2024-09-18T02:05:26.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9ae8ea980 10 removing email index: 2024-09-18T02:05:26.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9ae8ea980 10 removing user buckets index 2024-09-18T02:05:26.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.003+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e71212b0 con 0x5629e70cc8e0 2024-09-18T02:05:26.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.007+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 54 ==== osd_op_reply(159 bud.buckets [delete] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:26.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.007+0000 7fb9ae8ea980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-18T02:05:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.007+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94737970279104 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7113c60 con 0x5629e70d12d0 2024-09-18T02:05:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.007+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== watch-notify(notify (1) cookie 94737970097344 notify 137438953512 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5629e70ae640 con 0x5629e70d12d0 2024-09-18T02:05:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.007+0000 7fb88affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953512 cookie 94737970097344 notifier 4760 bl.length()=160 2024-09-18T02:05:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.007+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 33 ==== osd_op_reply(160 notify.6 [notify cookie 94737970279104 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.007+0000 7fb88affd640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb7e00032d0 con 0x5629e70d12d0 2024-09-18T02:05:26.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.007+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 34 ==== watch-notify(notify_complete (2) cookie 94737970279104 notify 137438953512 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5629e7093380 con 0x5629e70d12d0 2024-09-18T02:05:26.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.007+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 35 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.007+0000 7fb9ae8ea980 10 removing user index: bud 2024-09-18T02:05:26.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.007+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e710a8d0 con 0x7fb994024070 2024-09-18T02:05:26.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 41 ==== osd_op_reply(162 bud [call,call,delete] v32'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:26.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb9ae8ea980 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-18T02:05:26.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb9ae8ea980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-18T02:05:26.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94737970279104 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629e7113c60 con 0x5629e70d12d0 2024-09-18T02:05:26.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 36 ==== watch-notify(notify (1) cookie 94737970095216 notify 137438953513 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5629e7093380 con 0x5629e70d12d0 2024-09-18T02:05:26.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb88affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94737970095216 notifier 4760 bl.length()=152 2024-09-18T02:05:26.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 37 ==== osd_op_reply(163 notify.5 [notify cookie 94737970279104 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb88affd640 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb7e00032d0 con 0x5629e70d12d0 2024-09-18T02:05:26.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 38 ==== watch-notify(notify_complete (2) cookie 94737970279104 notify 137438953513 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5629e70906a0 con 0x5629e70d12d0 2024-09-18T02:05:26.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 39 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb8627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.011+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94737970102064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e711c040 con 0x5629e70cc8e0 2024-09-18T02:05:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.015+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 55 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94737970102064] v32'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.015+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94737970078576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e711c040 con 0x7fb994024070 2024-09-18T02:05:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.015+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 42 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94737970078576] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.015+0000 7fb9ae8ea980 20 remove_watcher() i=0 2024-09-18T02:05:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.015+0000 7fb9ae8ea980 2 removed watcher, disabling cache 2024-09-18T02:05:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.015+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94737970082128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e6db0 con 0x5629e70cc8e0 2024-09-18T02:05:26.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.019+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 56 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94737970082128] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:26.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.019+0000 7fb9ae8ea980 20 remove_watcher() i=1 2024-09-18T02:05:26.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.019+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94737970076064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e6db0 con 0x5629e70d5c20 2024-09-18T02:05:26.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.019+0000 7fb9abbf9640 1 -- 172.21.15.167:0/2255805746 <== osd.3 v2:172.21.15.167:6808/2476454287 41 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94737970076064] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb994040040 con 0x5629e70d5c20 2024-09-18T02:05:26.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.019+0000 7fb9ae8ea980 20 remove_watcher() i=2 2024-09-18T02:05:26.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.019+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94737970088544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e6db0 con 0x7fb994024070 2024-09-18T02:05:26.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.023+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.2 v2:172.21.15.167:6816/2055439504 43 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94737970088544] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x7fb994024070 2024-09-18T02:05:26.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.023+0000 7fb9ae8ea980 20 remove_watcher() i=3 2024-09-18T02:05:26.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.023+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94737970087040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e6db0 con 0x5629e70cc8e0 2024-09-18T02:05:26.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.023+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 <== osd.1 v2:172.21.15.167:6800/15864359 57 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94737970087040] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99c045060 con 0x5629e70cc8e0 2024-09-18T02:05:26.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.023+0000 7fb9ae8ea980 20 remove_watcher() i=4 2024-09-18T02:05:26.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.023+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94737970095216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e6db0 con 0x5629e70d12d0 2024-09-18T02:05:26.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.027+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 40 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94737970095216] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.027+0000 7fb9ae8ea980 20 remove_watcher() i=5 2024-09-18T02:05:26.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.027+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94737970097344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e6db0 con 0x5629e70d12d0 2024-09-18T02:05:26.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 41 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94737970097344] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 20 remove_watcher() i=6 2024-09-18T02:05:26.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94737970099600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629e70e6db0 con 0x5629e70d12d0 2024-09-18T02:05:26.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ac3fa640 1 -- 172.21.15.167:0/2255805746 <== osd.0 v2:172.21.15.81:6800/3087415523 42 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94737970099600] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a40b3040 con 0x5629e70d12d0 2024-09-18T02:05:26.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 20 remove_watcher() i=7 2024-09-18T02:05:26.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629e70d12d0 msgr2=0x5629e70d36c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629e70d12d0 0x5629e70d36c0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629e70cc8e0 msgr2=0x5629e70ceda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629e70cc8e0 0x5629e70ceda0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb994024070 msgr2=0x7fb994031970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fb994024070 0x7fb994031970 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629e70d5c20 msgr2=0x5629e70d8030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629e70d5c20 0x5629e70d8030 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb87c034650 msgr2=0x7fb87c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb87c034650 0x7fb87c036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5629e70a0650 tx=0x7fb994010000 comp rx=0 tx=0).stop 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 msgr2=0x5629e70c1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9acbfb640 1 -- 172.21.15.167:0/2255805746 reap_dead start 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70c1810 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40b4f50 tx=0x7fb9a40c0e90 comp rx=0 tx=0).stop 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 shutdown_connections 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/2255805746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70ba540 0x5629e70c1810 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.031+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 >> 172.21.15.167:0/2255805746 conn(0x5629e70b69b0 msgr2=0x5629e70b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 shutdown_connections 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/2255805746 wait complete. 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/1792347228 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb884034650 msgr2=0x7fb884036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/1792347228 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb884034650 0x7fb884036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb994006340 tx=0x7fb99400f000 comp rx=0 tx=0).stop 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/1792347228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70adce0 msgr2=0x5629e70ae100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/1792347228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70adce0 0x5629e70ae100 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40ab510 tx=0x7fb9a40b56c0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/1792347228 shutdown_connections 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/1792347228 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb884034650 0x7fb884036b10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/1792347228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e70adce0 0x5629e70ae100 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/1792347228 >> 172.21.15.167:0/1792347228 conn(0x5629e70a2e30 msgr2=0x5629e70a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/1792347228 shutdown_connections 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/1792347228 wait complete. 2024-09-18T02:05:26.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629e70997d0 msgr2=0x5629e709bbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5629e70997d0 0x5629e709bbc0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629e6f9e880 msgr2=0x5629e7096e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5629e6f9e880 0x5629e7096e60 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629e709d6d0 msgr2=0x5629e709fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5629e709d6d0 0x5629e709fac0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb894034650 msgr2=0x7fb894036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb894034650 0x7fb894036b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb994001650 tx=0x7fb994006740 comp rx=0 tx=0).stop 2024-09-18T02:05:26.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 msgr2=0x5629e708fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 --2- 172.21.15.167:0/3696692162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629e6f0fb10 0x5629e708fed0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4019930 tx=0x7fb9a4018020 comp rx=0 tx=0).stop 2024-09-18T02:05:26.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9acbfb640 1 -- 172.21.15.167:0/3696692162 reap_dead start 2024-09-18T02:05:26.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 shutdown_connections 2024-09-18T02:05:26.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 >> 172.21.15.167:0/3696692162 conn(0x5629e6f96070 msgr2=0x5629e6f9a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:26.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 shutdown_connections 2024-09-18T02:05:26.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.035+0000 7fb9ae8ea980 1 -- 172.21.15.167:0/3696692162 wait complete. 2024-09-18T02:05:26.050 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-18T02:05:26.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-18T02:05:26.051 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-18T02:05:26.129 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:05:26.129 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:05:26.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.127+0000 7fc94c60c980 1 Processor -- start 2024-09-18T02:05:26.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.127+0000 7fc94c60c980 1 -- start start 2024-09-18T02:05:26.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.127+0000 7fc94c60c980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d17b0d62a0 0x55d17b1643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.127+0000 7fc94c60c980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d17afe9ae0 con 0x55d17b1648f0 2024-09-18T02:05:26.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.127+0000 7fc94c60c980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55d17b00de30 con 0x55d17b0d62a0 2024-09-18T02:05:26.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.127+0000 7fc94a11c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55d17b0d62a0 0x55d17b1643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.127+0000 7fc94991b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55d17b1648f0 0x55d17b166ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33754/0 (socket says 172.21.15.167:33754) 2024-09-18T02:05:26.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.127+0000 7fc94991b640 1 -- 172.21.15.167:0/3346512360 learned_addr learned my addr 172.21.15.167:0/3346512360 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:05:26.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.127+0000 7fc94a11c640 1 -- 172.21.15.167:0/3346512360 >> v1:172.21.15.81:6789/0 conn(0x55d17b1648f0 legacy=0x55d17b166ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.127+0000 7fc94a11c640 1 -- 172.21.15.167:0/3346512360 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d17b0d6830 con 0x55d17b0d62a0 2024-09-18T02:05:26.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.131+0000 7fc94a11c640 1 --2- 172.21.15.167:0/3346512360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b1643b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00a420 tx=0x7fc93c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0c3a4d115ffa62 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.131+0000 7fc94911a640 1 -- 172.21.15.167:0/3346512360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0af070 con 0x55d17b0d62a0 2024-09-18T02:05:26.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.131+0000 7fc94911a640 1 -- 172.21.15.167:0/3346512360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c0aa530 con 0x55d17b0d62a0 2024-09-18T02:05:26.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.131+0000 7fc94911a640 1 -- 172.21.15.167:0/3346512360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0aa850 con 0x55d17b0d62a0 2024-09-18T02:05:26.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.131+0000 7fc94c60c980 1 -- 172.21.15.167:0/3346512360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 msgr2=0x55d17b1643b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.131+0000 7fc94c60c980 1 --2- 172.21.15.167:0/3346512360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b1643b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00a420 tx=0x7fc93c01afd0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.131+0000 7fc94c60c980 1 -- 172.21.15.167:0/3346512360 shutdown_connections 2024-09-18T02:05:26.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.131+0000 7fc94c60c980 1 --2- 172.21.15.167:0/3346512360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b1643b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.131+0000 7fc94c60c980 1 -- 172.21.15.167:0/3346512360 >> 172.21.15.167:0/3346512360 conn(0x55d17b15c0a0 msgr2=0x55d17b15e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:26.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.131+0000 7fc94c60c980 1 -- 172.21.15.167:0/3346512360 shutdown_connections 2024-09-18T02:05:26.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.131+0000 7fc94c60c980 1 -- 172.21.15.167:0/3346512360 wait complete. 2024-09-18T02:05:26.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.147+0000 7fc94c60c980 1 Processor -- start 2024-09-18T02:05:26.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.147+0000 7fc94c60c980 1 -- start start 2024-09-18T02:05:26.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b24ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d17b00f200 con 0x55d17b0d62a0 2024-09-18T02:05:26.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94a11c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b24ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94a11c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b24ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51406/0 (socket says 172.21.15.167:51406) 2024-09-18T02:05:26.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94a11c640 1 -- 172.21.15.167:0/1542373810 learned_addr learned my addr 172.21.15.167:0/1542373810 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:26.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94a11c640 1 -- 172.21.15.167:0/1542373810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d17b24d010 con 0x55d17b0d62a0 2024-09-18T02:05:26.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94a11c640 1 --2- 172.21.15.167:0/1542373810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b24ca40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0aa500 tx=0x7fc93c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2ad284a41d0218 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc838608640 1 -- 172.21.15.167:0/1542373810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0af040 con 0x55d17b0d62a0 2024-09-18T02:05:26.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc838608640 1 -- 172.21.15.167:0/1542373810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c0abb80 con 0x55d17b0d62a0 2024-09-18T02:05:26.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc838608640 1 -- 172.21.15.167:0/1542373810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0b5470 con 0x55d17b0d62a0 2024-09-18T02:05:26.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 -- 172.21.15.167:0/1542373810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 msgr2=0x55d17b24ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1542373810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b24ca40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0aa500 tx=0x7fc93c0033b0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 -- 172.21.15.167:0/1542373810 shutdown_connections 2024-09-18T02:05:26.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1542373810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b24ca40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 -- 172.21.15.167:0/1542373810 >> 172.21.15.167:0/1542373810 conn(0x55d17b15c0a0 msgr2=0x55d17b248670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:26.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 -- 172.21.15.167:0/1542373810 shutdown_connections 2024-09-18T02:05:26.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 -- 172.21.15.167:0/1542373810 wait complete. 2024-09-18T02:05:26.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 Processor -- start 2024-09-18T02:05:26.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 -- start start 2024-09-18T02:05:26.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b253d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94c60c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d17b168f10 con 0x55d17b0d62a0 2024-09-18T02:05:26.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94a11c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b253d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94a11c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b253d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51412/0 (socket says 172.21.15.167:51412) 2024-09-18T02:05:26.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.151+0000 7fc94a11c640 1 -- 172.21.15.167:0/3279901601 learned_addr learned my addr 172.21.15.167:0/3279901601 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:26.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94a11c640 1 -- 172.21.15.167:0/3279901601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d17b254250 con 0x55d17b0d62a0 2024-09-18T02:05:26.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94a11c640 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b253d10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0aa500 tx=0x7fc93c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc836e05640 1 -- 172.21.15.167:0/3279901601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0b58f0 con 0x55d17b0d62a0 2024-09-18T02:05:26.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc836e05640 1 -- 172.21.15.167:0/3279901601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c0c6070 con 0x55d17b0d62a0 2024-09-18T02:05:26.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d17b2544e0 con 0x55d17b0d62a0 2024-09-18T02:05:26.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc836e05640 1 -- 172.21.15.167:0/3279901601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0b5be0 con 0x55d17b0d62a0 2024-09-18T02:05:26.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d17b2571c0 con 0x55d17b0d62a0 2024-09-18T02:05:26.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc836e05640 1 -- 172.21.15.167:0/3279901601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc93c0c0440 con 0x55d17b0d62a0 2024-09-18T02:05:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc836e05640 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc8300346f0 0x7fc830036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc836e05640 1 -- 172.21.15.167:0/3279901601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc93c0bb070 con 0x55d17b0d62a0 2024-09-18T02:05:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94991b640 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc8300346f0 0x7fc830036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94c60c980 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d17b1648f0 0x55d17b25aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b25b220 con 0x55d17b1648f0 2024-09-18T02:05:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94a91d640 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d17b1648f0 0x55d17b25aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94991b640 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc8300346f0 0x7fc830036bb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc940001da0 tx=0x7fc940001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94a91d640 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d17b1648f0 0x55d17b25aca0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94a91d640 1 -- 172.21.15.167:0/3279901601 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9440083f0 con 0x55d17b1648f0 2024-09-18T02:05:26.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.155+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b25bb50 con 0x55d17b1648f0 2024-09-18T02:05:26.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94a91d640 1 -- 172.21.15.167:0/3279901601 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9440083f0 con 0x55d17b1648f0 2024-09-18T02:05:26.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94c60c980 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d17b25d460 0x55d17b25f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b260090 con 0x55d17b25d460 2024-09-18T02:05:26.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94a11c640 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d17b25d460 0x55d17b25f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94a11c640 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d17b25d460 0x55d17b25f900 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94a11c640 1 -- 172.21.15.167:0/3279901601 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b25d460 2024-09-18T02:05:26.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b25c3a0 con 0x55d17b1648f0 2024-09-18T02:05:26.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94a91d640 1 -- 172.21.15.167:0/3279901601 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9440083f0 con 0x55d17b1648f0 2024-09-18T02:05:26.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94c60c980 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d17b2614f0 0x55d17b2638e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b264050 con 0x55d17b2614f0 2024-09-18T02:05:26.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94991b640 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d17b2614f0 0x55d17b2638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94991b640 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d17b2614f0 0x55d17b2638e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94991b640 1 -- 172.21.15.167:0/3279901601 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b2614f0 2024-09-18T02:05:26.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94c60c980 1 Processor -- start 2024-09-18T02:05:26.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.159+0000 7fc94c60c980 1 -- start start 2024-09-18T02:05:26.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94c60c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b271b00 0x55d17b271f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94c60c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d17b068800 con 0x55d17b271b00 2024-09-18T02:05:26.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94a11c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b271b00 0x55d17b271f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94a11c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b271b00 0x55d17b271f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51428/0 (socket says 172.21.15.167:51428) 2024-09-18T02:05:26.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94a11c640 1 -- 172.21.15.167:0/1460185316 learned_addr learned my addr 172.21.15.167:0/1460185316 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:26.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94a11c640 1 -- 172.21.15.167:0/1460185316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d17b272460 con 0x55d17b271b00 2024-09-18T02:05:26.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94a11c640 1 --2- 172.21.15.167:0/1460185316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b271b00 0x55d17b271f20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0e3920 tx=0x7fc93c0be3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc82ffff640 1 -- 172.21.15.167:0/1460185316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0e2440 con 0x55d17b271b00 2024-09-18T02:05:26.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc82ffff640 1 -- 172.21.15.167:0/1460185316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c0bf3d0 con 0x55d17b271b00 2024-09-18T02:05:26.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94c60c980 1 -- 172.21.15.167:0/1460185316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d17b2726f0 con 0x55d17b271b00 2024-09-18T02:05:26.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc82ffff640 1 -- 172.21.15.167:0/1460185316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0bf6d0 con 0x55d17b271b00 2024-09-18T02:05:26.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94c60c980 1 -- 172.21.15.167:0/1460185316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d17b275370 con 0x55d17b271b00 2024-09-18T02:05:26.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc82ffff640 1 -- 172.21.15.167:0/1460185316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc93c0bf870 con 0x55d17b271b00 2024-09-18T02:05:26.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc82ffff640 1 --2- 172.21.15.167:0/1460185316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc824034650 0x7fc824036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc82ffff640 1 -- 172.21.15.167:0/1460185316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc93c0b86b0 con 0x55d17b271b00 2024-09-18T02:05:26.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94991b640 1 --2- 172.21.15.167:0/1460185316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc824034650 0x7fc824036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94c60c980 1 Processor -- start 2024-09-18T02:05:26.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94c60c980 1 -- start start 2024-09-18T02:05:26.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94c60c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b27e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94c60c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d17b24d2d0 con 0x55d17b27e4a0 2024-09-18T02:05:26.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.163+0000 7fc94991b640 1 --2- 172.21.15.167:0/1460185316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc824034650 0x7fc824036b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55d17b260430 tx=0x7fc94000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94a11c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b27e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94a11c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b27e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51434/0 (socket says 172.21.15.167:51434) 2024-09-18T02:05:26.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94a11c640 1 -- 172.21.15.167:0/2969131936 learned_addr learned my addr 172.21.15.167:0/2969131936 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:26.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94a11c640 1 -- 172.21.15.167:0/2969131936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d17b27ee50 con 0x55d17b27e4a0 2024-09-18T02:05:26.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94a11c640 1 --2- 172.21.15.167:0/2969131936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b27e880 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0bfd60 tx=0x7fc93c0bfb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b417e5d1498568fb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc82dffb640 1 -- 172.21.15.167:0/2969131936 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0d5d00 con 0x55d17b27e4a0 2024-09-18T02:05:26.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc82dffb640 1 -- 172.21.15.167:0/2969131936 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c0c9770 con 0x55d17b27e4a0 2024-09-18T02:05:26.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc82dffb640 1 -- 172.21.15.167:0/2969131936 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0d5430 con 0x55d17b27e4a0 2024-09-18T02:05:26.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 -- 172.21.15.167:0/2969131936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 msgr2=0x55d17b27e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 --2- 172.21.15.167:0/2969131936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b27e880 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0bfd60 tx=0x7fc93c0bfb60 comp rx=0 tx=0).stop 2024-09-18T02:05:26.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 -- 172.21.15.167:0/2969131936 shutdown_connections 2024-09-18T02:05:26.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 --2- 172.21.15.167:0/2969131936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b27e880 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 -- 172.21.15.167:0/2969131936 >> 172.21.15.167:0/2969131936 conn(0x55d17b27a880 msgr2=0x55d17b278980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:26.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 -- 172.21.15.167:0/2969131936 shutdown_connections 2024-09-18T02:05:26.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 -- 172.21.15.167:0/2969131936 wait complete. 2024-09-18T02:05:26.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 Processor -- start 2024-09-18T02:05:26.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 -- start start 2024-09-18T02:05:26.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b161cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d17b27f2f0 con 0x55d17b27e4a0 2024-09-18T02:05:26.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94a11c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b161cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94a11c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b161cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51444/0 (socket says 172.21.15.167:51444) 2024-09-18T02:05:26.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 learned_addr learned my addr 172.21.15.167:0/1255826005 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:05:26.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d17b1603d0 con 0x55d17b27e4a0 2024-09-18T02:05:26.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94a11c640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b161cb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0bfd60 tx=0x7fc93c0b83b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc81bfff640 1 -- 172.21.15.167:0/1255826005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0d5b20 con 0x55d17b27e4a0 2024-09-18T02:05:26.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d17b1603d0 con 0x55d17b27e4a0 2024-09-18T02:05:26.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc81bfff640 1 -- 172.21.15.167:0/1255826005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c109070 con 0x55d17b27e4a0 2024-09-18T02:05:26.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc81bfff640 1 -- 172.21.15.167:0/1255826005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c0d5780 con 0x55d17b27e4a0 2024-09-18T02:05:26.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.167+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d17b1603d0 con 0x55d17b27e4a0 2024-09-18T02:05:26.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc81bfff640 1 -- 172.21.15.167:0/1255826005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc93c113060 con 0x55d17b27e4a0 2024-09-18T02:05:26.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc81bfff640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc814034650 0x7fc814036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc81bfff640 1 -- 172.21.15.167:0/1255826005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc93c104bf0 con 0x55d17b27e4a0 2024-09-18T02:05:26.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94991b640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc814034650 0x7fc814036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d17b292950 0x55d17b294e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b295560 con 0x55d17b292950 2024-09-18T02:05:26.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94a91d640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d17b292950 0x55d17b294e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94991b640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc814034650 0x7fc814036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55d17b264430 tx=0x7fc940010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94a91d640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d17b292950 0x55d17b294e10 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9440083f0 con 0x55d17b292950 2024-09-18T02:05:26.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:26.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 20 realm 2024-09-18T02:05:26.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b295970 con 0x55d17b292950 2024-09-18T02:05:26.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9440083f0 con 0x55d17b292950 2024-09-18T02:05:26.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:26.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:05:26.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b296240 con 0x55d17b292950 2024-09-18T02:05:26.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9440083f0 con 0x55d17b292950 2024-09-18T02:05:26.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:26.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b292950 2024-09-18T02:05:26.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9440083f0 con 0x55d17b292950 2024-09-18T02:05:26.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:26.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d17b297340 0x55d17b299730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.171+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b299cf0 con 0x55d17b297340 2024-09-18T02:05:26.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94a11c640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d17b297340 0x55d17b299730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94a11c640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d17b297340 0x55d17b299730 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94c60c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:05:26.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94c60c980 20 searching for the correct realm 2024-09-18T02:05:26.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d17b29bc40 0x55d17b29e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b29e720 con 0x55d17b29bc40 2024-09-18T02:05:26.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94991b640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d17b29bc40 0x55d17b29e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94991b640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d17b29bc40 0x55d17b29e050 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94991b640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc940037040 0x7fc940036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:05:26.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b29e720 con 0x7fc940037040 2024-09-18T02:05:26.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94a91d640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc940037040 0x7fc940036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:05:26.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94a91d640 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc940037040 0x7fc940036410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:05:26.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9440083f0 con 0x7fc940037040 2024-09-18T02:05:26.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x7fc940037040 2024-09-18T02:05:26.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9440083f0 con 0x7fc940037040 2024-09-18T02:05:26.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b292950 2024-09-18T02:05:26.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.175+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b292950 2024-09-18T02:05:26.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b292950 2024-09-18T02:05:26.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b297340 2024-09-18T02:05:26.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x7fc940037040 2024-09-18T02:05:26.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b29bc40 2024-09-18T02:05:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b292950 2024-09-18T02:05:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x7fc940037040 2024-09-18T02:05:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b292950 2024-09-18T02:05:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x7fc940037040 2024-09-18T02:05:26.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b29bc40 2024-09-18T02:05:26.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b29bc40 2024-09-18T02:05:26.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.179+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b297340 2024-09-18T02:05:26.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b29bc40 2024-09-18T02:05:26.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b29bc40 2024-09-18T02:05:26.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b292950 2024-09-18T02:05:26.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b292950 2024-09-18T02:05:26.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b297340 2024-09-18T02:05:26.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b29bc40 2024-09-18T02:05:26.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x7fc940037040 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b292950 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.183+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b297340 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b29bc40 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b297340 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x7fc940037040 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b29bc40 2024-09-18T02:05:26.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b297340 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x55d17b292950 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2965e0 con 0x7fc940037040 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:05:26.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b29a5b0 con 0x55d17b292950 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b29a5b0 con 0x55d17b292950 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.187+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b29a5b0 con 0x55d17b29bc40 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:05:26.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 20 zone default found 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 4 Realm: () 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 20 zonegroup default 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b29afc0 con 0x55d17b297340 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a0a30 con 0x55d17b29bc40 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a0dd0 con 0x55d17b29bc40 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 20 started sync module instance, tier type = 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b29fe70 con 0x7fc940037040 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94358202876560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b29fe70 con 0x7fc940037040 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.191+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a1620 con 0x55d17b292950 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.195+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94358202876560] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.195+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.195+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94358202880640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b29fe70 con 0x55d17b292950 2024-09-18T02:05:26.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.195+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a2030 con 0x55d17b29bc40 2024-09-18T02:05:26.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.195+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.195+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94358202882944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a28d0 con 0x55d17b29bc40 2024-09-18T02:05:26.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.195+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a32d0 con 0x7fc940037040 2024-09-18T02:05:26.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.195+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94358202880640] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.199+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.199+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94358202874304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a36c0 con 0x7fc940037040 2024-09-18T02:05:26.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.199+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a4080 con 0x55d17b292950 2024-09-18T02:05:26.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.199+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94358202882944] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.199+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94358202874304] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.199+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.199+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94358202887648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a3bd0 con 0x55d17b292950 2024-09-18T02:05:26.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.199+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a4420 con 0x55d17b297340 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.203+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94358202887648] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.203+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.203+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94358202891216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a3ff0 con 0x55d17b297340 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.203+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a5170 con 0x55d17b297340 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.203+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.203+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94358202895552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a5590 con 0x55d17b297340 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.203+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a6080 con 0x55d17b297340 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.203+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94358202891216] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94358202899280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a6040 con 0x55d17b297340 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 20 add_watcher() i=0 2024-09-18T02:05:26.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 20 add_watcher() i=1 2024-09-18T02:05:26.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 20 add_watcher() i=2 2024-09-18T02:05:26.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 20 add_watcher() i=3 2024-09-18T02:05:26.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 20 add_watcher() i=4 2024-09-18T02:05:26.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 20 add_watcher() i=5 2024-09-18T02:05:26.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94358202895552] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 20 add_watcher() i=6 2024-09-18T02:05:26.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94358202899280] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 20 add_watcher() i=7 2024-09-18T02:05:26.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 2 all 8 watchers are set, enabling cache 2024-09-18T02:05:26.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a5150 con 0x55d17b292950 2024-09-18T02:05:26.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.207+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94358202894272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a68f0 con 0x55d17b292950 2024-09-18T02:05:26.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.211+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94358202894272] v32'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.211+0000 7fc800fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:26.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.211+0000 7fc94c60c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:05:26.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.211+0000 7fc94c60c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:05:26.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.211+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b18c0 con 0x55d17b292950 2024-09-18T02:05:26.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.211+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'57 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.211+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b1f90 con 0x55d17b297340 2024-09-18T02:05:26.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.215+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.215+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b1f90 con 0x55d17b29bc40 2024-09-18T02:05:26.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.215+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.215+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b2580 con 0x55d17b292950 2024-09-18T02:05:26.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.219+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'230 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.219+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b2a30 con 0x7fc940037040 2024-09-18T02:05:26.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.219+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'77 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.219+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2af850 con 0x55d17b29bc40 2024-09-18T02:05:26.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.219+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'59 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.219+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2af850 con 0x55d17b292950 2024-09-18T02:05:26.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.223+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.223+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3590 con 0x55d17b297340 2024-09-18T02:05:26.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.227+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.227+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3590 con 0x7fc940037040 2024-09-18T02:05:26.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.227+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.227+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3590 con 0x55d17b29bc40 2024-09-18T02:05:26.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.231+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.231+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3a40 con 0x7fc940037040 2024-09-18T02:05:26.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.231+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'78 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.231+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3a40 con 0x55d17b297340 2024-09-18T02:05:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.231+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.231+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3a40 con 0x7fc940037040 2024-09-18T02:05:26.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.235+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.235+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3a40 con 0x55d17b297340 2024-09-18T02:05:26.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.235+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'67 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.235+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3a40 con 0x55d17b292950 2024-09-18T02:05:26.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.239+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'231 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.239+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3a40 con 0x55d17b29bc40 2024-09-18T02:05:26.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.239+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'73 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.239+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b4030 con 0x7fc940037040 2024-09-18T02:05:26.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.243+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'79 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.243+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b4010 con 0x55d17b29bc40 2024-09-18T02:05:26.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.243+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.243+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b4010 con 0x55d17b292950 2024-09-18T02:05:26.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.243+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.243+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x55d17b292950 2024-09-18T02:05:26.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.247+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'232 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.247+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x55d17b29bc40 2024-09-18T02:05:26.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.247+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'74 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.247+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x7fc940037040 2024-09-18T02:05:26.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.251+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.251+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x55d17b29bc40 2024-09-18T02:05:26.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.251+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'36 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.251+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x55d17b29bc40 2024-09-18T02:05:26.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.251+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'45 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.251+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x55d17b29bc40 2024-09-18T02:05:26.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.255+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.255+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x55d17b29bc40 2024-09-18T02:05:26.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.255+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'60 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.255+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x55d17b297340 2024-09-18T02:05:26.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.259+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.259+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x55d17b29bc40 2024-09-18T02:05:26.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.259+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'41 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.259+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x55d17b297340 2024-09-18T02:05:26.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.263+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.263+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x55d17b29bc40 2024-09-18T02:05:26.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.263+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'75 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.263+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x55d17b297340 2024-09-18T02:05:26.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.267+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'68 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.267+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2b3e40 con 0x7fc940037040 2024-09-18T02:05:26.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc77b7fe640 20 reqs_thread_entry: start 2024-09-18T02:05:26.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 20 init_complete bucket index max shards: 11 2024-09-18T02:05:26.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 20 Filter name: none 2024-09-18T02:05:26.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc7797fa640 20 reqs_thread_entry: start 2024-09-18T02:05:26.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T02:05:26.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2aeb80 con 0x55d17b297340 2024-09-18T02:05:26.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T02:05:26.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T02:05:26.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T02:05:26.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:05:26.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2d1980 con 0x55d17b297340 2024-09-18T02:05:26.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 : miss 2024-09-18T02:05:26.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 8.5 8:a62943d1:root::.bucket.meta.myfoo7%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2d1710 con 0x55d17b292950 2024-09-18T02:05:26.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(96 .bucket.meta.myfoo7:c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 20 rados_obj.operate() r=0 bl.length=382 2024-09-18T02:05:26.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 info.flags=0x17 2024-09-18T02:05:26.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 to cache LRU end 2024-09-18T02:05:26.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:05:26.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:05:26.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 2024-09-18T02:05:26.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.271+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:97 4.16 4:68fe7ca5:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34ebf0 con 0x7fc940037040 2024-09-18T02:05:26.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(97 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.0 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944026040 con 0x7fc940037040 2024-09-18T02:05:26.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:98 4.10 4:096d9395:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34ebf0 con 0x55d17b29bc40 2024-09-18T02:05:26.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(98 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:99 4.35 4:ac20687b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34ebf0 con 0x55d17b292950 2024-09-18T02:05:26.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(99 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:100 4.2b 4:d6e9f638:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34ec50 con 0x55d17b292950 2024-09-18T02:05:26.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(100 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:101 4.28 4:146537dc:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34ec50 con 0x55d17b292950 2024-09-18T02:05:26.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(101 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944026040 con 0x55d17b292950 2024-09-18T02:05:26.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:102 4.2a 4:55095e63:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34ec50 con 0x55d17b292950 2024-09-18T02:05:26.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(102 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5 [call out=378b] v0'0 uv8 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94c60c980 10 cls_bucket_list_unordered: got fourteen 2024-09-18T02:05:26.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:103 4.31 4:8f612539:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34ec50 con 0x55d17b292950 2024-09-18T02:05:26.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(103 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:104 4.3b 4:dcae3fc8:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34ec10 con 0x55d17b29bc40 2024-09-18T02:05:26.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(104 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:105 4.b 4:d1e06217:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34ec10 con 0x7fc940037040 2024-09-18T02:05:26.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(105 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.8 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.275+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:106 4.a 4:539a5878:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34ec10 con 0x7fc940037040 2024-09-18T02:05:26.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(106 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:107 4.1c 4:3beada38:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34ec10 con 0x55d17b297340 2024-09-18T02:05:26.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(107 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94c60c980 20 get_obj_state: octx=0x55d17b2b39c0 obj=myfoo7:fourteen state=0x55d17b34cc78 s->prefetch_data=0 2024-09-18T02:05:26.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:108 3.1f 3:fa8659ea:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34daa0 con 0x55d17b292950 2024-09-18T02:05:26.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(108 c5231f36-c36e-44d5-8268-aaf52617db58.4235.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94c60c980 10 manifest: total_size = 8 2024-09-18T02:05:26.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94c60c980 20 get_obj_state: setting s->obj_tag to c5231f36-c36e-44d5-8268-aaf52617db58.4235.15419233823912553643 2024-09-18T02:05:26.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94c60c980 20 get_obj_state: octx=0x55d17b2b39c0 obj=myfoo7:fourteen state=0x55d17b34cc78 s->prefetch_data=0 2024-09-18T02:05:26.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94c60c980 20 prepare_atomic_modification: state is not atomic. state=0x55d17b34cc78 2024-09-18T02:05:26.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94c60c980 20 bucket index object: :.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5 2024-09-18T02:05:26.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:109 4.2a 4:55095e63:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34e360 con 0x55d17b292950 2024-09-18T02:05:26.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 35 ==== osd_op_reply(109 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5 [stat,call,call] v32'9 uv9 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.279+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:110 3.1f 3:fa8659ea:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b34e360 con 0x55d17b292950 2024-09-18T02:05:26.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 36 ==== osd_op_reply(110 c5231f36-c36e-44d5-8268-aaf52617db58.4235.10_fourteen [call] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:111 4.2a 4:55095e63:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2d62c0 con 0x55d17b292950 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 20 list_objects_ordered: starting attempt 1 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:112 4.16 4:68fe7ca5:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2d62c0 con 0x7fc940037040 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:113 4.10 4:096d9395:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2db540 con 0x55d17b29bc40 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:114 4.35 4:ac20687b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2dde50 con 0x55d17b292950 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:115 4.2b 4:d6e9f638:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2d62c0 con 0x55d17b292950 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:116 4.28 4:146537dc:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e2e80 con 0x55d17b292950 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:117 4.2a 4:55095e63:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5830 con 0x55d17b292950 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:118 4.31 4:8f612539:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e8660 con 0x55d17b292950 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:119 4.3b 4:dcae3fc8:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2eb490 con 0x55d17b29bc40 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:120 4.b 4:d1e06217:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2ee290 con 0x7fc940037040 2024-09-18T02:05:26.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:121 4.a 4:539a5878:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2f0bf0 con 0x7fc940037040 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:122 4.1c 4:3beada38:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2f34c0 con 0x55d17b297340 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(113 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 23 ==== osd_op_reply(112 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.0 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== osd_op_reply(119 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc94000e6c0 con 0x55d17b29bc40 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 37 ==== osd_op_reply(114 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 38 ==== osd_op_reply(115 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 39 ==== osd_op_reply(116 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 40 ==== osd_op_reply(118 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 24 ==== osd_op_reply(121 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 25 ==== osd_op_reply(120 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.8 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(122 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 41 ==== osd_op_reply(111 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5 [stat,call,call] v32'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc82d7fa640 20 handle_completion(): completion ok for obj=fourteen 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 42 ==== osd_op_reply(117 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5 [call out=124b] v0'0 uv10 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[c5231f36-c36e-44d5-8268-aaf52617db58.4235.10])"; uploads.size()=0; is_truncated=0 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:123 4.16 4:68fe7ca5:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2ee290 con 0x7fc940037040 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:124 4.10 4:096d9395:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5830 con 0x55d17b29bc40 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:125 4.35 4:ac20687b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e84c0 con 0x55d17b292950 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:126 4.2b 4:d6e9f638:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2ee290 con 0x55d17b292950 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:127 4.28 4:146537dc:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2f34c0 con 0x55d17b292950 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.283+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:128 4.2a 4:55095e63:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2f0bd0 con 0x55d17b292950 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:129 4.31 4:8f612539:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2ee290 con 0x55d17b292950 2024-09-18T02:05:26.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:130 4.3b 4:dcae3fc8:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2f0bd0 con 0x55d17b29bc40 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:131 4.b 4:d1e06217:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2ee290 con 0x7fc940037040 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:132 4.a 4:539a5878:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e84c0 con 0x7fc940037040 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:133 4.1c 4:3beada38:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2edd60 con 0x55d17b297340 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 26 ==== osd_op_reply(123 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.0 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 27 ==== osd_op_reply(132 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 43 ==== osd_op_reply(125 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 31 ==== osd_op_reply(124 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc940051060 con 0x55d17b29bc40 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 44 ==== osd_op_reply(126 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 45 ==== osd_op_reply(127 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 46 ==== osd_op_reply(129 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 47 ==== osd_op_reply(128 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5 [call out=124b] v0'0 uv10 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 28 ==== osd_op_reply(131 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.8 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 32 ==== osd_op_reply(130 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc940051060 con 0x55d17b29bc40 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(133 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.287+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5830 con 0x55d17b297340 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(134 fud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94c60c980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5830 con 0x7fc940037040 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 29 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94c60c980 20 rados_obj.operate() r=0 bl.length=168 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94c60c980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94c60c980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5830 con 0x7fc940037040 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 30 ==== osd_op_reply(136 myfoo7 [call,call,delete] v32'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94c60c980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94c60c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94358203182272 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5830 con 0x7fc940037040 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 31 ==== watch-notify(notify (1) cookie 94358202874304 notify 137438953490 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55d17b2d0c80 con 0x7fc940037040 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc82dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94358202874304 notifier 4767 bl.length()=150 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 32 ==== osd_op_reply(137 notify.3 [notify cookie 94358203182272 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc82dffb640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc810003d70 con 0x7fc940037040 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 33 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 34 ==== watch-notify(notify_complete (2) cookie 94358203182272 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d17b2b12c0 con 0x7fc940037040 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.291+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:139 8.5 8:a62943d1:root::.bucket.meta.myfoo7%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5830 con 0x55d17b292950 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 48 ==== osd_op_reply(139 .bucket.meta.myfoo7:c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 [call,call,delete] v32'5 uv5 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 from cache 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:c5231f36-c36e-44d5-8268-aaf52617db58.4235.10, ofs0, ns] 2024-09-18T02:05:26.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94358203078272 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5830 con 0x55d17b297340 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== watch-notify(notify (1) cookie 94358202899280 notify 137438953514 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55d17b2af2a0 con 0x55d17b297340 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc82d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94358202899280 notifier 4767 bl.length()=208 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc82d7fa640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc7800032d0 con 0x55d17b297340 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(140 notify.7 [notify cookie 94358203078272 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== watch-notify(notify_complete (2) cookie 94358203078272 notify 137438953514 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d17b272460 con 0x55d17b297340 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:142 4.16 4:68fe7ca5:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5830 con 0x7fc940037040 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:143 4.10 4:096d9395:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e83b0 con 0x55d17b29bc40 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:144 4.35 4:ac20687b:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2eb170 con 0x55d17b292950 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:145 4.2b 4:d6e9f638:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2cffc0 con 0x55d17b292950 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:146 4.28 4:146537dc:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5830 con 0x55d17b292950 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:147 4.2a 4:55095e63:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e83b0 con 0x55d17b292950 2024-09-18T02:05:26.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:148 4.31 4:8f612539:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2eb170 con 0x55d17b292950 2024-09-18T02:05:26.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:149 4.3b 4:dcae3fc8:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2cffc0 con 0x55d17b29bc40 2024-09-18T02:05:26.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:150 4.b 4:d1e06217:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5830 con 0x7fc940037040 2024-09-18T02:05:26.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:151 4.a 4:539a5878:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e83b0 con 0x7fc940037040 2024-09-18T02:05:26.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.295+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:152 4.1c 4:3beada38:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5d00 con 0x55d17b297340 2024-09-18T02:05:26.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.299+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 49 ==== osd_op_reply(145 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.3 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.299+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 35 ==== osd_op_reply(142 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.0 [delete] v32'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.299+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 50 ==== osd_op_reply(148 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.6 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.299+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 51 ==== osd_op_reply(147 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.5 [delete] v32'11 uv11 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.299+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 33 ==== osd_op_reply(143 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.1 [delete] v32'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc940051060 con 0x55d17b29bc40 2024-09-18T02:05:26.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.299+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 52 ==== osd_op_reply(146 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.4 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.299+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 34 ==== osd_op_reply(149 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.7 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc940051060 con 0x55d17b29bc40 2024-09-18T02:05:26.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.299+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 53 ==== osd_op_reply(144 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.2 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.299+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== osd_op_reply(152 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.10 [delete] v32'2 uv2 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.299+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 36 ==== osd_op_reply(150 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.8 [delete] v32'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.303+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 37 ==== osd_op_reply(151 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.10.9 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.303+0000 7fc94c60c980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 : miss 2024-09-18T02:05:26.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.303+0000 7fc94c60c980 20 rados->read ofs=0 len=0 2024-09-18T02:05:26.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.303+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:153 6.13 6:cdcbd1d4:::pubsub..bucket.myfoo7%2fc5231f36-c36e-44d5-8268-aaf52617db58.4235.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5ca0 con 0x55d17b297340 2024-09-18T02:05:26.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.303+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 33 ==== osd_op_reply(153 pubsub..bucket.myfoo7/c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.303+0000 7fc94c60c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:05:26.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.303+0000 7fc94c60c980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 info.flags=0x0 2024-09-18T02:05:26.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.303+0000 7fc94c60c980 10 adding default.rgw.log++pubsub..bucket.myfoo7/c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 to cache LRU end 2024-09-18T02:05:26.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.303+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:154 6.13 6:cdcbd1d4:::pubsub..bucket.myfoo7%2fc5231f36-c36e-44d5-8268-aaf52617db58.4235.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5ca0 con 0x55d17b297340 2024-09-18T02:05:26.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.303+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 34 ==== osd_op_reply(154 pubsub..bucket.myfoo7/c5231f36-c36e-44d5-8268-aaf52617db58.4235.10 [delete] v32'33 uv30 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.303+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5ca0 con 0x55d17b297340 2024-09-18T02:05:26.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 35 ==== osd_op_reply(155 fud.buckets [call] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94c60c980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-18T02:05:26.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5ca0 con 0x55d17b297340 2024-09-18T02:05:26.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 36 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94c60c980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T02:05:26.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94358203161760 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2d0470 con 0x55d17b29bc40 2024-09-18T02:05:26.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 35 ==== watch-notify(notify (1) cookie 94358202882944 notify 137438953489 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55d17b2b15a0 con 0x55d17b29bc40 2024-09-18T02:05:26.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc82d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94358202882944 notifier 4767 bl.length()=170 2024-09-18T02:05:26.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc82d7fa640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc7800032d0 con 0x55d17b29bc40 2024-09-18T02:05:26.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 36 ==== osd_op_reply(157 notify.2 [notify cookie 94358203161760 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc940051060 con 0x55d17b29bc40 2024-09-18T02:05:26.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 37 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc940051060 con 0x55d17b29bc40 2024-09-18T02:05:26.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 38 ==== watch-notify(notify_complete (2) cookie 94358203161760 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d17b2afbf0 con 0x55d17b29bc40 2024-09-18T02:05:26.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94c60c980 10 removing email index: 2024-09-18T02:05:26.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94c60c980 10 removing user buckets index 2024-09-18T02:05:26.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.307+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5ca0 con 0x55d17b297340 2024-09-18T02:05:26.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.311+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 37 ==== osd_op_reply(159 fud.buckets [delete] v32'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.311+0000 7fc94c60c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-18T02:05:26.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.311+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94358203161760 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2d0470 con 0x55d17b297340 2024-09-18T02:05:26.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.311+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 38 ==== watch-notify(notify (1) cookie 94358202895552 notify 137438953515 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55d17b272460 con 0x55d17b297340 2024-09-18T02:05:26.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.311+0000 7fc82dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953515 cookie 94358202895552 notifier 4767 bl.length()=160 2024-09-18T02:05:26.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.311+0000 7fc82dffb640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc810003d70 con 0x55d17b297340 2024-09-18T02:05:26.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.311+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 39 ==== osd_op_reply(160 notify.6 [notify cookie 94358203161760 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.311+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 40 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.315+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 41 ==== watch-notify(notify_complete (2) cookie 94358203161760 notify 137438953515 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d17b2571c0 con 0x55d17b297340 2024-09-18T02:05:26.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.315+0000 7fc94c60c980 10 removing user index: fud 2024-09-18T02:05:26.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.315+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5ca0 con 0x55d17b297340 2024-09-18T02:05:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.315+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 42 ==== osd_op_reply(162 fud [call,call,delete] v32'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.315+0000 7fc94c60c980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-18T02:05:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.315+0000 7fc94c60c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T02:05:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.315+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94358203161760 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2cf460 con 0x55d17b297340 2024-09-18T02:05:26.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.315+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 43 ==== watch-notify(notify (1) cookie 94358202891216 notify 137438953516 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55d17b2571c0 con 0x55d17b297340 2024-09-18T02:05:26.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.315+0000 7fc82d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953516 cookie 94358202891216 notifier 4767 bl.length()=152 2024-09-18T02:05:26.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.315+0000 7fc82d7fa640 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc7800032d0 con 0x55d17b297340 2024-09-18T02:05:26.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.315+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 44 ==== osd_op_reply(163 notify.5 [notify cookie 94358203161760 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.319+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.321 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.319+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 46 ==== watch-notify(notify_complete (2) cookie 94358203161760 notify 137438953516 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d17b2544e0 con 0x55d17b297340 2024-09-18T02:05:26.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.319+0000 7fc800fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:05:26.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.319+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94358202894272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5ca0 con 0x55d17b292950 2024-09-18T02:05:26.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.319+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 54 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94358202894272] v32'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.319+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94358202876560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2e5ca0 con 0x7fc940037040 2024-09-18T02:05:26.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.323+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 38 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94358202876560] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.323+0000 7fc94c60c980 20 remove_watcher() i=0 2024-09-18T02:05:26.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.323+0000 7fc94c60c980 2 removed watcher, disabling cache 2024-09-18T02:05:26.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.323+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94358202880640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a0290 con 0x55d17b292950 2024-09-18T02:05:26.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.323+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 55 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94358202880640] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.323+0000 7fc94c60c980 20 remove_watcher() i=1 2024-09-18T02:05:26.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.323+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94358202882944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a0290 con 0x55d17b29bc40 2024-09-18T02:05:26.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.327+0000 7fc94991b640 1 -- 172.21.15.167:0/1255826005 <== osd.3 v2:172.21.15.167:6808/2476454287 39 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94358202882944] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc940051060 con 0x55d17b29bc40 2024-09-18T02:05:26.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.327+0000 7fc94c60c980 20 remove_watcher() i=2 2024-09-18T02:05:26.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.327+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94358202874304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a0290 con 0x7fc940037040 2024-09-18T02:05:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.327+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.2 v2:172.21.15.167:6816/2055439504 39 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94358202874304] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944044190 con 0x7fc940037040 2024-09-18T02:05:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.327+0000 7fc94c60c980 20 remove_watcher() i=3 2024-09-18T02:05:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.327+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94358202887648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a0290 con 0x55d17b292950 2024-09-18T02:05:26.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.331+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 <== osd.1 v2:172.21.15.167:6800/15864359 56 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94358202887648] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc944044190 con 0x55d17b292950 2024-09-18T02:05:26.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.331+0000 7fc94c60c980 20 remove_watcher() i=4 2024-09-18T02:05:26.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.331+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94358202891216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a0290 con 0x55d17b297340 2024-09-18T02:05:26.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.331+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 47 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94358202891216] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.331+0000 7fc94c60c980 20 remove_watcher() i=5 2024-09-18T02:05:26.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.331+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94358202895552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a3bd0 con 0x55d17b297340 2024-09-18T02:05:26.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 48 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94358202895552] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94c60c980 20 remove_watcher() i=6 2024-09-18T02:05:26.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94358202899280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d17b2a4cc0 con 0x55d17b297340 2024-09-18T02:05:26.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94a11c640 1 -- 172.21.15.167:0/1255826005 <== osd.0 v2:172.21.15.81:6800/3087415523 49 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94358202899280] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc93c0b2040 con 0x55d17b297340 2024-09-18T02:05:26.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94c60c980 20 remove_watcher() i=7 2024-09-18T02:05:26.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d17b297340 msgr2=0x55d17b299730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d17b297340 0x55d17b299730 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d17b292950 msgr2=0x55d17b294e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d17b292950 0x55d17b294e10 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc940037040 msgr2=0x7fc940036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc940037040 0x7fc940036410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d17b29bc40 msgr2=0x55d17b29e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.335+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d17b29bc40 0x55d17b29e050 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc814034650 msgr2=0x7fc814036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc814034650 0x7fc814036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55d17b264430 tx=0x7fc940010000 comp rx=0 tx=0).stop 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 msgr2=0x55d17b161cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94a91d640 1 -- 172.21.15.167:0/1255826005 reap_dead start 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b161cb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0bfd60 tx=0x7fc93c0b83b0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 shutdown_connections 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1255826005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b27e4a0 0x55d17b161cb0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 >> 172.21.15.167:0/1255826005 conn(0x55d17b27a880 msgr2=0x55d17b278950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 shutdown_connections 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1255826005 wait complete. 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1460185316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc824034650 msgr2=0x7fc824036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1460185316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc824034650 0x7fc824036b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55d17b260430 tx=0x7fc94000f000 comp rx=0 tx=0).stop 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1460185316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b271b00 msgr2=0x55d17b271f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1460185316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b271b00 0x55d17b271f20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0e3920 tx=0x7fc93c0be3d0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1460185316 shutdown_connections 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1460185316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc824034650 0x7fc824036b10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/1460185316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b271b00 0x55d17b271f20 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1460185316 >> 172.21.15.167:0/1460185316 conn(0x55d17b266c50 msgr2=0x55d17b2696d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1460185316 shutdown_connections 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/1460185316 wait complete. 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d17b25d460 msgr2=0x55d17b25f900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55d17b25d460 0x55d17b25f900 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d17b1648f0 msgr2=0x55d17b25aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55d17b1648f0 0x55d17b25aca0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d17b2614f0 msgr2=0x55d17b2638e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55d17b2614f0 0x55d17b2638e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:05:26.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc8300346f0 msgr2=0x7fc830036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc8300346f0 0x7fc830036bb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc940001da0 tx=0x7fc940001300 comp rx=0 tx=0).stop 2024-09-18T02:05:26.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 msgr2=0x55d17b253d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:05:26.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 --2- 172.21.15.167:0/3279901601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d17b0d62a0 0x55d17b253d10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0aa500 tx=0x7fc93c017d70 comp rx=0 tx=0).stop 2024-09-18T02:05:26.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94a91d640 1 -- 172.21.15.167:0/3279901601 reap_dead start 2024-09-18T02:05:26.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 shutdown_connections 2024-09-18T02:05:26.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 >> 172.21.15.167:0/3279901601 conn(0x55d17b15c0a0 msgr2=0x55d17b2471f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:05:26.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 shutdown_connections 2024-09-18T02:05:26.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:05:26.339+0000 7fc94c60c980 1 -- 172.21.15.167:0/3279901601 wait complete. 2024-09-18T02:06:06.354 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-18T02:06:06.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-18T02:06:06.355 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-18T02:06:06.395 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:06.395 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:06.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.391+0000 7f47efacd980 1 Processor -- start 2024-09-18T02:06:06.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.391+0000 7f47efacd980 1 -- start start 2024-09-18T02:06:06.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.391+0000 7f47efacd980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c3e3768290 0x55c3e37f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.395+0000 7f47efacd980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c3e367bae0 con 0x55c3e37f68e0 2024-09-18T02:06:06.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.395+0000 7f47efacd980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55c3e369fe30 con 0x55c3e3768290 2024-09-18T02:06:06.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.395+0000 7f47ed5dd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c3e3768290 0x55c3e37f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.395+0000 7f47ecddc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55c3e37f68e0 0x55c3e37f8cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:46648/0 (socket says 172.21.15.167:46648) 2024-09-18T02:06:06.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.395+0000 7f47ecddc640 1 -- 172.21.15.167:0/2358387316 learned_addr learned my addr 172.21.15.167:0/2358387316 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:06.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.395+0000 7f47ed5dd640 1 --2- 172.21.15.167:0/2358387316 >> v2:172.21.15.81:3300/0 conn(0x55c3e3768290 0x55c3e37f63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:41292/0 (socket says 172.21.15.167:41292) 2024-09-18T02:06:06.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.395+0000 7f47ed5dd640 1 -- 172.21.15.167:0/2358387316 >> v1:172.21.15.81:6789/0 conn(0x55c3e37f68e0 legacy=0x55c3e37f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.395+0000 7f47ed5dd640 1 -- 172.21.15.167:0/2358387316 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e3768820 con 0x55c3e3768290 2024-09-18T02:06:06.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.399+0000 7f47ed5dd640 1 --2- 172.21.15.167:0/2358387316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e37f63a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f47e400a480 tx=0x7f47e401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb6c49a8773ab28 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.399+0000 7f47dffff640 1 -- 172.21.15.167:0/2358387316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e40b0070 con 0x55c3e3768290 2024-09-18T02:06:06.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.399+0000 7f47dffff640 1 -- 172.21.15.167:0/2358387316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40ab540 con 0x55c3e3768290 2024-09-18T02:06:06.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.399+0000 7f47dffff640 1 -- 172.21.15.167:0/2358387316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e40ab840 con 0x55c3e3768290 2024-09-18T02:06:06.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.399+0000 7f47efacd980 1 -- 172.21.15.167:0/2358387316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 msgr2=0x55c3e37f63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.399+0000 7f47efacd980 1 --2- 172.21.15.167:0/2358387316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e37f63a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f47e400a480 tx=0x7f47e401b280 comp rx=0 tx=0).stop 2024-09-18T02:06:06.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.399+0000 7f47efacd980 1 -- 172.21.15.167:0/2358387316 shutdown_connections 2024-09-18T02:06:06.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.399+0000 7f47efacd980 1 --2- 172.21.15.167:0/2358387316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e37f63a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.399+0000 7f47efacd980 1 -- 172.21.15.167:0/2358387316 >> 172.21.15.167:0/2358387316 conn(0x55c3e37ee090 msgr2=0x55c3e37f04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.399+0000 7f47efacd980 1 -- 172.21.15.167:0/2358387316 shutdown_connections 2024-09-18T02:06:06.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.399+0000 7f47efacd980 1 -- 172.21.15.167:0/2358387316 wait complete. 2024-09-18T02:06:06.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f47efacd980 1 Processor -- start 2024-09-18T02:06:06.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f47efacd980 1 -- start start 2024-09-18T02:06:06.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f47efacd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e37f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f47efacd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c3e36a1200 con 0x55c3e3768290 2024-09-18T02:06:06.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f47ed5dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e37f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f47ed5dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e37f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49862/0 (socket says 172.21.15.167:49862) 2024-09-18T02:06:06.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f47ed5dd640 1 -- 172.21.15.167:0/500852698 learned_addr learned my addr 172.21.15.167:0/500852698 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f47ed5dd640 1 -- 172.21.15.167:0/500852698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e37f40d0 con 0x55c3e3768290 2024-09-18T02:06:06.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f47ed5dd640 1 --2- 172.21.15.167:0/500852698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e37f3b00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f47e40ae040 tx=0x7f47e4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323ea0979248a921 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f46db606640 1 -- 172.21.15.167:0/500852698 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e40b0040 con 0x55c3e3768290 2024-09-18T02:06:06.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f46db606640 1 -- 172.21.15.167:0/500852698 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40ab9b0 con 0x55c3e3768290 2024-09-18T02:06:06.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.415+0000 7f46db606640 1 -- 172.21.15.167:0/500852698 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e40abc90 con 0x55c3e3768290 2024-09-18T02:06:06.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 -- 172.21.15.167:0/500852698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 msgr2=0x55c3e37f3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 --2- 172.21.15.167:0/500852698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e37f3b00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f47e40ae040 tx=0x7f47e4003030 comp rx=0 tx=0).stop 2024-09-18T02:06:06.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 -- 172.21.15.167:0/500852698 shutdown_connections 2024-09-18T02:06:06.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 --2- 172.21.15.167:0/500852698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e37f3b00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 -- 172.21.15.167:0/500852698 >> 172.21.15.167:0/500852698 conn(0x55c3e37ee090 msgr2=0x55c3e38da630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 -- 172.21.15.167:0/500852698 shutdown_connections 2024-09-18T02:06:06.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 -- 172.21.15.167:0/500852698 wait complete. 2024-09-18T02:06:06.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 Processor -- start 2024-09-18T02:06:06.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 -- start start 2024-09-18T02:06:06.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e38e7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c3e37faf00 con 0x55c3e3768290 2024-09-18T02:06:06.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47ed5dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e38e7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47ed5dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e38e7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49864/0 (socket says 172.21.15.167:49864) 2024-09-18T02:06:06.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47ed5dd640 1 -- 172.21.15.167:0/953684124 learned_addr learned my addr 172.21.15.167:0/953684124 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47ed5dd640 1 -- 172.21.15.167:0/953684124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e38e8310 con 0x55c3e3768290 2024-09-18T02:06:06.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47ed5dd640 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e38e7dd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f47e40030b0 tx=0x7f47e4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f46d9e03640 1 -- 172.21.15.167:0/953684124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e40c5070 con 0x55c3e3768290 2024-09-18T02:06:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3e38e85a0 con 0x55c3e3768290 2024-09-18T02:06:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f46d9e03640 1 -- 172.21.15.167:0/953684124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40b6970 con 0x55c3e3768290 2024-09-18T02:06:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f46d9e03640 1 -- 172.21.15.167:0/953684124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e40b0050 con 0x55c3e3768290 2024-09-18T02:06:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3e38eb280 con 0x55c3e3768290 2024-09-18T02:06:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.419+0000 7f46d9e03640 1 -- 172.21.15.167:0/953684124 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f47e40c8070 con 0x55c3e3768290 2024-09-18T02:06:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f46d9e03640 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46d4034650 0x7f46d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f46d9e03640 1 -- 172.21.15.167:0/953684124 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f47e40bc070 con 0x55c3e3768290 2024-09-18T02:06:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47ecddc640 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46d4034650 0x7f46d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47efacd980 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c3e37f68e0 0x55c3e38eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e38ef3f0 con 0x55c3e37f68e0 2024-09-18T02:06:06.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47eddde640 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c3e37f68e0 0x55c3e38eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47ecddc640 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46d4034650 0x7f46d4036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47e00012f0 tx=0x7f47e0006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47eddde640 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c3e37f68e0 0x55c3e38eed80 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47eddde640 1 -- 172.21.15.167:0/953684124 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47e80083f0 con 0x55c3e37f68e0 2024-09-18T02:06:06.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e38ec480 con 0x55c3e37f68e0 2024-09-18T02:06:06.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47eddde640 1 -- 172.21.15.167:0/953684124 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47e80083f0 con 0x55c3e37f68e0 2024-09-18T02:06:06.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47efacd980 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c3e38f1720 0x55c3e38f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e38f41e0 con 0x55c3e38f1720 2024-09-18T02:06:06.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47ed5dd640 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c3e38f1720 0x55c3e38f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47ed5dd640 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c3e38f1720 0x55c3e38f3b10 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47ed5dd640 1 -- 172.21.15.167:0/953684124 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f47e40c7030 con 0x55c3e38f1720 2024-09-18T02:06:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e38f05c0 con 0x55c3e37f68e0 2024-09-18T02:06:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47eddde640 1 -- 172.21.15.167:0/953684124 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47e80083f0 con 0x55c3e37f68e0 2024-09-18T02:06:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47efacd980 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c3e38f5620 0x55c3e38f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.423+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e38f81a0 con 0x55c3e38f5620 2024-09-18T02:06:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47ecddc640 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c3e38f5620 0x55c3e38f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47ecddc640 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c3e38f5620 0x55c3e38f7a10 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47ecddc640 1 -- 172.21.15.167:0/953684124 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f47e000f070 con 0x55c3e38f5620 2024-09-18T02:06:06.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47efacd980 1 Processor -- start 2024-09-18T02:06:06.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47efacd980 1 -- start start 2024-09-18T02:06:06.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47efacd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3905c30 0x55c3e3906050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47efacd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c3e36fa800 con 0x55c3e3905c30 2024-09-18T02:06:06.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47ed5dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3905c30 0x55c3e3906050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47ed5dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3905c30 0x55c3e3906050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49874/0 (socket says 172.21.15.167:49874) 2024-09-18T02:06:06.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47ed5dd640 1 -- 172.21.15.167:0/544765259 learned_addr learned my addr 172.21.15.167:0/544765259 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47ed5dd640 1 -- 172.21.15.167:0/544765259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e3906590 con 0x55c3e3905c30 2024-09-18T02:06:06.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47ed5dd640 1 --2- 172.21.15.167:0/544765259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3905c30 0x55c3e3906050 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f47e4000c10 tx=0x7f47e40aae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f46d2ffd640 1 -- 172.21.15.167:0/544765259 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e40d5040 con 0x55c3e3905c30 2024-09-18T02:06:06.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47efacd980 1 -- 172.21.15.167:0/544765259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3e3906820 con 0x55c3e3905c30 2024-09-18T02:06:06.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f46d2ffd640 1 -- 172.21.15.167:0/544765259 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40aa3b0 con 0x55c3e3905c30 2024-09-18T02:06:06.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f46d2ffd640 1 -- 172.21.15.167:0/544765259 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e40aa690 con 0x55c3e3905c30 2024-09-18T02:06:06.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.427+0000 7f47efacd980 1 -- 172.21.15.167:0/544765259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3e39094a0 con 0x55c3e3905c30 2024-09-18T02:06:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f46d2ffd640 1 -- 172.21.15.167:0/544765259 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f47e40ea060 con 0x55c3e3905c30 2024-09-18T02:06:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f46d2ffd640 1 --2- 172.21.15.167:0/544765259 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46c4034650 0x7f46c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f46d2ffd640 1 -- 172.21.15.167:0/544765259 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f47e40a8070 con 0x55c3e3905c30 2024-09-18T02:06:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47ecddc640 1 --2- 172.21.15.167:0/544765259 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46c4034650 0x7f46c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 Processor -- start 2024-09-18T02:06:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 -- start start 2024-09-18T02:06:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47ecddc640 1 --2- 172.21.15.167:0/544765259 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46c4034650 0x7f46c4036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f47e00062e0 tx=0x7f47e000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 0x55c3e39128d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c3e37f2230 con 0x55c3e39124d0 2024-09-18T02:06:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47ed5dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 0x55c3e39128d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47ed5dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 0x55c3e39128d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49886/0 (socket says 172.21.15.167:49886) 2024-09-18T02:06:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3202547741 learned_addr learned my addr 172.21.15.167:0/3202547741 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3202547741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e3912ea0 con 0x55c3e39124d0 2024-09-18T02:06:06.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47ed5dd640 1 --2- 172.21.15.167:0/3202547741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 0x55c3e39128d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f47e40aafe0 tx=0x7f47e40ccfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51661fc8c9ca6532 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f46d0ff9640 1 -- 172.21.15.167:0/3202547741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e40e31a0 con 0x55c3e39124d0 2024-09-18T02:06:06.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f46d0ff9640 1 -- 172.21.15.167:0/3202547741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40e0200 con 0x55c3e39124d0 2024-09-18T02:06:06.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f46d0ff9640 1 -- 172.21.15.167:0/3202547741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e40e3340 con 0x55c3e39124d0 2024-09-18T02:06:06.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 -- 172.21.15.167:0/3202547741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 msgr2=0x55c3e39128d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 --2- 172.21.15.167:0/3202547741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 0x55c3e39128d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f47e40aafe0 tx=0x7f47e40ccfc0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 -- 172.21.15.167:0/3202547741 shutdown_connections 2024-09-18T02:06:06.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 --2- 172.21.15.167:0/3202547741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 0x55c3e39128d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 -- 172.21.15.167:0/3202547741 >> 172.21.15.167:0/3202547741 conn(0x55c3e390e940 msgr2=0x55c3e390ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 -- 172.21.15.167:0/3202547741 shutdown_connections 2024-09-18T02:06:06.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 -- 172.21.15.167:0/3202547741 wait complete. 2024-09-18T02:06:06.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 Processor -- start 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 -- start start 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 0x55c3e3919780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.431+0000 7f47efacd980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c3e39133b0 con 0x55c3e39124d0 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47ed5dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 0x55c3e3919780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47ed5dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 0x55c3e3919780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49892/0 (socket says 172.21.15.167:49892) 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 learned_addr learned my addr 172.21.15.167:0/3566668694 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e3919cc0 con 0x55c3e39124d0 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47ed5dd640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 0x55c3e3919780 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f47e40aafe0 tx=0x7f47e40dcf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f46c2ffd640 1 -- 172.21.15.167:0/3566668694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e410b070 con 0x55c3e39124d0 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3e3919cc0 con 0x55c3e39124d0 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f46c2ffd640 1 -- 172.21.15.167:0/3566668694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40c9b60 con 0x55c3e39124d0 2024-09-18T02:06:06.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f46c2ffd640 1 -- 172.21.15.167:0/3566668694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e40cc8b0 con 0x55c3e39124d0 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3e391a130 con 0x55c3e39124d0 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f46c2ffd640 1 -- 172.21.15.167:0/3566668694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f47e410e070 con 0x55c3e39124d0 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f46c2ffd640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46b8034650 0x7f46b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f46c2ffd640 1 -- 172.21.15.167:0/3566668694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f47e4101030 con 0x55c3e39124d0 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47ecddc640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46b8034650 0x7f46b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47efacd980 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c3e3924880 0x55c3e3926d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3927490 con 0x55c3e3924880 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47eddde640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c3e3924880 0x55c3e3926d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47ecddc640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46b8034650 0x7f46b8036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55c3e38f85a0 tx=0x7f47e0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.435+0000 7f47eddde640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c3e3924880 0x55c3e3926d40 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47e80083f0 con 0x55c3e3924880 2024-09-18T02:06:06.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 20 realm 2024-09-18T02:06:06.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e39278a0 con 0x55c3e3924880 2024-09-18T02:06:06.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47e80083f0 con 0x55c3e3924880 2024-09-18T02:06:06.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:06.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928170 con 0x55c3e3924880 2024-09-18T02:06:06.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47e80083f0 con 0x55c3e3924880 2024-09-18T02:06:06.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3924880 2024-09-18T02:06:06.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47e80083f0 con 0x55c3e3924880 2024-09-18T02:06:06.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:06.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c3e3929270 0x55c3e392b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e392bc70 con 0x55c3e3929270 2024-09-18T02:06:06.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47ed5dd640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c3e3929270 0x55c3e392b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47ed5dd640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c3e3929270 0x55c3e392b660 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 20 searching for the correct realm 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c3e392dbc0 0x55c3e392ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3930680 con 0x55c3e392dbc0 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47ecddc640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c3e392dbc0 0x55c3e392ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47ecddc640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c3e392dbc0 0x55c3e392ffb0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e000f070 con 0x55c3e392dbc0 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47ecddc640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f47e0024070 0x7f47e0031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3930680 con 0x7f47e0024070 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.439+0000 7f47eddde640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f47e0024070 0x7f47e0031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f47e0024070 0x7f47e0031460 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e80083f0 con 0x7f47e0024070 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x7f47e0024070 2024-09-18T02:06:06.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e80083f0 con 0x7f47e0024070 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3924880 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3924880 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3924880 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3929270 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x7f47e0024070 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e392dbc0 2024-09-18T02:06:06.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e000f070 con 0x55c3e392dbc0 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3924880 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x7f47e0024070 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3924880 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x7f47e0024070 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.443+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e392dbc0 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e392dbc0 2024-09-18T02:06:06.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3929270 2024-09-18T02:06:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e392dbc0 2024-09-18T02:06:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e392dbc0 2024-09-18T02:06:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3924880 2024-09-18T02:06:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3924880 2024-09-18T02:06:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3929270 2024-09-18T02:06:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e392dbc0 2024-09-18T02:06:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x7f47e0024070 2024-09-18T02:06:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3924880 2024-09-18T02:06:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.447+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3929270 2024-09-18T02:06:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e392dbc0 2024-09-18T02:06:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3929270 2024-09-18T02:06:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x7f47e0024070 2024-09-18T02:06:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e392dbc0 2024-09-18T02:06:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3929270 2024-09-18T02:06:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x55c3e3924880 2024-09-18T02:06:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3928510 con 0x7f47e0024070 2024-09-18T02:06:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.451+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e392c530 con 0x55c3e3924880 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e392c530 con 0x55c3e3924880 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e392c530 con 0x55c3e392dbc0 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 zone default found 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 4 Realm: () 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 zonegroup default 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e392cf30 con 0x55c3e3929270 2024-09-18T02:06:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e392cac0 con 0x55c3e392dbc0 2024-09-18T02:06:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3932a60 con 0x55c3e392dbc0 2024-09-18T02:06:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 started sync module instance, tier type = 2024-09-18T02:06:06.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:06.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3931e20 con 0x7f47e0024070 2024-09-18T02:06:06.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94299825054528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3931e20 con 0x7f47e0024070 2024-09-18T02:06:06.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.455+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3933530 con 0x55c3e3924880 2024-09-18T02:06:06.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.459+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94299825054528] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.459+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.459+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94299825057856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3931e20 con 0x55c3e3924880 2024-09-18T02:06:06.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.459+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3933f70 con 0x55c3e392dbc0 2024-09-18T02:06:06.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.463+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94299825057856] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.463+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.463+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94299825052016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3931d90 con 0x55c3e392dbc0 2024-09-18T02:06:06.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.463+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3934cc0 con 0x7f47e0024070 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.463+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.463+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94299825064224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e39353b0 con 0x7f47e0024070 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.463+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3935ed0 con 0x55c3e3924880 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.463+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94299825052016] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.463+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94299825064224] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.467+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.467+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94299825068448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3935e90 con 0x55c3e3924880 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.467+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e39362c0 con 0x55c3e3929270 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.467+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94299825068448] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.467+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.467+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94299825062752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e39366b0 con 0x55c3e3929270 2024-09-18T02:06:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.467+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3937070 con 0x55c3e3929270 2024-09-18T02:06:06.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94299825062752] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94299825073088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3937490 con 0x55c3e3929270 2024-09-18T02:06:06.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3937e50 con 0x55c3e3929270 2024-09-18T02:06:06.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94299825073088] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94299825074416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3937e50 con 0x55c3e3929270 2024-09-18T02:06:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47efacd980 20 add_watcher() i=0 2024-09-18T02:06:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47efacd980 20 add_watcher() i=1 2024-09-18T02:06:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47efacd980 20 add_watcher() i=2 2024-09-18T02:06:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47efacd980 20 add_watcher() i=3 2024-09-18T02:06:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47efacd980 20 add_watcher() i=4 2024-09-18T02:06:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47efacd980 20 add_watcher() i=5 2024-09-18T02:06:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.471+0000 7f47efacd980 20 add_watcher() i=6 2024-09-18T02:06:06.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94299825074416] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f47efacd980 20 add_watcher() i=7 2024-09-18T02:06:06.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f47efacd980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:06.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e393b170 con 0x55c3e3924880 2024-09-18T02:06:06.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94299825089456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3937fc0 con 0x55c3e3924880 2024-09-18T02:06:06.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94299825089456] v32'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f46a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:06.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f47efacd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:06.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f47efacd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:06.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f47efacd980 5 note: GC not initialized 2024-09-18T02:06:06.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.475+0000 7f46a2fe5640 20 reqs_thread_entry: start 2024-09-18T02:06:06.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47efacd980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:06.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47efacd980 20 Filter name: none 2024-09-18T02:06:06.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f46a0fe1640 20 reqs_thread_entry: start 2024-09-18T02:06:06.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47efacd980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:06:06.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47efacd980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3e395e880 con 0x55c3e3924880 2024-09-18T02:06:06.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47efacd980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:06:06.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47efacd980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:06:06.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47efacd980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:06:06.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47efacd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:06.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3961310 con 0x55c3e3929270 2024-09-18T02:06:06.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 usage.10 [call] v32'34 uv34 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.479+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3961310 con 0x55c3e3929270 2024-09-18T02:06:06.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.483+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(64 usage.10 [call] v32'35 uv34 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.483+0000 7f46a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:06.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.483+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94299825089456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e391e330 con 0x55c3e3924880 2024-09-18T02:06:06.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.483+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94299825089456] v32'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.483+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94299825054528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e393abb0 con 0x7f47e0024070 2024-09-18T02:06:06.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.487+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94299825054528] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.487+0000 7f47efacd980 20 remove_watcher() i=0 2024-09-18T02:06:06.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.487+0000 7f47efacd980 2 removed watcher, disabling cache 2024-09-18T02:06:06.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.487+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94299825057856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e395e420 con 0x55c3e3924880 2024-09-18T02:06:06.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.487+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94299825057856] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.487+0000 7f47efacd980 20 remove_watcher() i=1 2024-09-18T02:06:06.492 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.487+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94299825052016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e395e420 con 0x55c3e392dbc0 2024-09-18T02:06:06.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.491+0000 7f47ecddc640 1 -- 172.21.15.167:0/3566668694 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94299825052016] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0040040 con 0x55c3e392dbc0 2024-09-18T02:06:06.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.491+0000 7f47efacd980 20 remove_watcher() i=2 2024-09-18T02:06:06.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.491+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94299825064224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3931970 con 0x7f47e0024070 2024-09-18T02:06:06.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.491+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94299825064224] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x7f47e0024070 2024-09-18T02:06:06.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.491+0000 7f47efacd980 20 remove_watcher() i=3 2024-09-18T02:06:06.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.491+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94299825068448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3934920 con 0x55c3e3924880 2024-09-18T02:06:06.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.495+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94299825068448] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e8026040 con 0x55c3e3924880 2024-09-18T02:06:06.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.495+0000 7f47efacd980 20 remove_watcher() i=4 2024-09-18T02:06:06.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.495+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94299825062752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3931970 con 0x55c3e3929270 2024-09-18T02:06:06.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.495+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94299825062752] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.495+0000 7f47efacd980 20 remove_watcher() i=5 2024-09-18T02:06:06.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.495+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94299825073088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e39359a0 con 0x55c3e3929270 2024-09-18T02:06:06.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94299825073088] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 20 remove_watcher() i=6 2024-09-18T02:06:06.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94299825074416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3e3934920 con 0x55c3e3929270 2024-09-18T02:06:06.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47ed5dd640 1 -- 172.21.15.167:0/3566668694 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94299825074416] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e410d030 con 0x55c3e3929270 2024-09-18T02:06:06.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 20 remove_watcher() i=7 2024-09-18T02:06:06.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c3e3929270 msgr2=0x55c3e392b660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c3e3929270 0x55c3e392b660 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c3e3924880 msgr2=0x55c3e3926d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c3e3924880 0x55c3e3926d40 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f47e0024070 msgr2=0x7f47e0031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f47e0024070 0x7f47e0031460 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c3e392dbc0 msgr2=0x55c3e392ffb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c3e392dbc0 0x55c3e392ffb0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46b8034650 msgr2=0x7f46b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46b8034650 0x7f46b8036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55c3e38f85a0 tx=0x7f47e0010000 comp rx=0 tx=0).stop 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 msgr2=0x55c3e3919780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47efacd980 1 --2- 172.21.15.167:0/3566668694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e39124d0 0x55c3e3919780 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f47e40aafe0 tx=0x7f47e40dcf30 comp rx=0 tx=0).stop 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 reap_dead start 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.499+0000 7f47eddde640 1 -- 172.21.15.167:0/3566668694 reap_dead start 2024-09-18T02:06:06.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 shutdown_connections 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 >> 172.21.15.167:0/3566668694 conn(0x55c3e390e940 msgr2=0x55c3e390ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 shutdown_connections 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/3566668694 wait complete. 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/544765259 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46c4034650 msgr2=0x7f46c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 --2- 172.21.15.167:0/544765259 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46c4034650 0x7f46c4036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f47e00062e0 tx=0x7f47e000f000 comp rx=0 tx=0).stop 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/544765259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3905c30 msgr2=0x55c3e3906050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 --2- 172.21.15.167:0/544765259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3905c30 0x55c3e3906050 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f47e4000c10 tx=0x7f47e40aae90 comp rx=0 tx=0).stop 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/544765259 shutdown_connections 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 --2- 172.21.15.167:0/544765259 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46c4034650 0x7f46c4036b10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 --2- 172.21.15.167:0/544765259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3905c30 0x55c3e3906050 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/544765259 >> 172.21.15.167:0/544765259 conn(0x55c3e38fad80 msgr2=0x55c3e38fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/544765259 shutdown_connections 2024-09-18T02:06:06.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/544765259 wait complete. 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c3e38f1720 msgr2=0x55c3e38f3b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c3e38f1720 0x55c3e38f3b10 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c3e37f68e0 msgr2=0x55c3e38eed80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c3e37f68e0 0x55c3e38eed80 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c3e38f5620 msgr2=0x55c3e38f7a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c3e38f5620 0x55c3e38f7a10 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46d4034650 msgr2=0x7f46d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f46d4034650 0x7f46d4036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47e00012f0 tx=0x7f47e0006700 comp rx=0 tx=0).stop 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 msgr2=0x55c3e38e7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 --2- 172.21.15.167:0/953684124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3e3768290 0x55c3e38e7dd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f47e40030b0 tx=0x7f47e4018020 comp rx=0 tx=0).stop 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47eddde640 1 -- 172.21.15.167:0/953684124 reap_dead start 2024-09-18T02:06:06.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 shutdown_connections 2024-09-18T02:06:06.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 >> 172.21.15.167:0/953684124 conn(0x55c3e37ee090 msgr2=0x55c3e37f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 shutdown_connections 2024-09-18T02:06:06.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.503+0000 7f47efacd980 1 -- 172.21.15.167:0/953684124 wait complete. 2024-09-18T02:06:06.517 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-18T02:06:06.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-18T02:06:06.517 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-18T02:06:06.597 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:06.597 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:06.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.595+0000 7f7b8217c980 1 Processor -- start 2024-09-18T02:06:06.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.595+0000 7f7b8217c980 1 -- start start 2024-09-18T02:06:06.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.595+0000 7f7b8217c980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x563275f5ca80 0x563275f5ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.598 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.595+0000 7f7b8217c980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563275de0ae0 con 0x563275ecd2d0 2024-09-18T02:06:06.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.595+0000 7f7b8217c980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x563275e04e30 con 0x563275f5ca80 2024-09-18T02:06:06.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.595+0000 7f7b7f48b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x563275f5ca80 0x563275f5ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.595+0000 7f7b7fc8c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x563275ecd2d0 0x563275f5b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33778/0 (socket says 172.21.15.167:33778) 2024-09-18T02:06:06.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.595+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2995620595 learned_addr learned my addr 172.21.15.167:0/2995620595 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:06.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.595+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2995620595 >> v1:172.21.15.81:6789/0 conn(0x563275ecd2d0 legacy=0x563275f5b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.595+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2995620595 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563275f603c0 con 0x563275f5ca80 2024-09-18T02:06:06.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.599+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/2995620595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275f5ca80 0x563275f5ee70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400a480 tx=0x7f7b7401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86689b7261f2dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.599+0000 7f7b7ec8a640 1 -- 172.21.15.167:0/2995620595 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b740b0070 con 0x563275f5ca80 2024-09-18T02:06:06.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.599+0000 7f7b7ec8a640 1 -- 172.21.15.167:0/2995620595 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b740ab540 con 0x563275f5ca80 2024-09-18T02:06:06.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.599+0000 7f7b7ec8a640 1 -- 172.21.15.167:0/2995620595 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b740ab840 con 0x563275f5ca80 2024-09-18T02:06:06.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.599+0000 7f7b8217c980 1 -- 172.21.15.167:0/2995620595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275f5ca80 msgr2=0x563275f5ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.599+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2995620595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275f5ca80 0x563275f5ee70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400a480 tx=0x7f7b7401b280 comp rx=0 tx=0).stop 2024-09-18T02:06:06.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.599+0000 7f7b8217c980 1 -- 172.21.15.167:0/2995620595 shutdown_connections 2024-09-18T02:06:06.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.599+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2995620595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275f5ca80 0x563275f5ee70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.599+0000 7f7b8217c980 1 -- 172.21.15.167:0/2995620595 >> 172.21.15.167:0/2995620595 conn(0x563275f53090 msgr2=0x563275f554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.599+0000 7f7b8217c980 1 -- 172.21.15.167:0/2995620595 shutdown_connections 2024-09-18T02:06:06.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.599+0000 7f7b8217c980 1 -- 172.21.15.167:0/2995620595 wait complete. 2024-09-18T02:06:06.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.615+0000 7f7b8217c980 1 Processor -- start 2024-09-18T02:06:06.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.615+0000 7f7b8217c980 1 -- start start 2024-09-18T02:06:06.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.615+0000 7f7b8217c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 0x563275f58ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.615+0000 7f7b8217c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563275e06200 con 0x563275ecd2d0 2024-09-18T02:06:06.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.615+0000 7f7b7fc8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 0x563275f58ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.615+0000 7f7b7fc8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 0x563275f58ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49906/0 (socket says 172.21.15.167:49906) 2024-09-18T02:06:06.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.615+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/602535890 learned_addr learned my addr 172.21.15.167:0/602535890 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.615+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/602535890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563275f59090 con 0x563275ecd2d0 2024-09-18T02:06:06.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b7fc8c640 1 --2- 172.21.15.167:0/602535890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 0x563275f58ac0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7b700015f0 tx=0x7f7b70001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59dbd0ed757591a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7a6de0b640 1 -- 172.21.15.167:0/602535890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b70004530 con 0x563275ecd2d0 2024-09-18T02:06:06.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7a6de0b640 1 -- 172.21.15.167:0/602535890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b700046f0 con 0x563275ecd2d0 2024-09-18T02:06:06.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7a6de0b640 1 -- 172.21.15.167:0/602535890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b70004a90 con 0x563275ecd2d0 2024-09-18T02:06:06.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 -- 172.21.15.167:0/602535890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 msgr2=0x563275f58ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 --2- 172.21.15.167:0/602535890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 0x563275f58ac0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7b700015f0 tx=0x7f7b70001ab0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 -- 172.21.15.167:0/602535890 shutdown_connections 2024-09-18T02:06:06.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 --2- 172.21.15.167:0/602535890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 0x563275f58ac0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 -- 172.21.15.167:0/602535890 >> 172.21.15.167:0/602535890 conn(0x563275f53090 msgr2=0x56327603f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 -- 172.21.15.167:0/602535890 shutdown_connections 2024-09-18T02:06:06.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 -- 172.21.15.167:0/602535890 wait complete. 2024-09-18T02:06:06.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 Processor -- start 2024-09-18T02:06:06.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 -- start start 2024-09-18T02:06:06.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 0x56327604cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563275f5fe30 con 0x563275ecd2d0 2024-09-18T02:06:06.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b7fc8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 0x56327604cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b7fc8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 0x56327604cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49918/0 (socket says 172.21.15.167:49918) 2024-09-18T02:06:06.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/4216458027 learned_addr learned my addr 172.21.15.167:0/4216458027 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/4216458027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327604d4a0 con 0x563275ecd2d0 2024-09-18T02:06:06.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b7fc8c640 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 0x56327604cf60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x563275f58640 tx=0x7f7b70000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7a67fff640 1 -- 172.21.15.167:0/4216458027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b70013760 con 0x563275ecd2d0 2024-09-18T02:06:06.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56327604d730 con 0x563275ecd2d0 2024-09-18T02:06:06.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7a67fff640 1 -- 172.21.15.167:0/4216458027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b70013900 con 0x563275ecd2d0 2024-09-18T02:06:06.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7a67fff640 1 -- 172.21.15.167:0/4216458027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b70013be0 con 0x563275ecd2d0 2024-09-18T02:06:06.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.619+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563276050410 con 0x563275ecd2d0 2024-09-18T02:06:06.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7a67fff640 1 -- 172.21.15.167:0/4216458027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b70010070 con 0x563275ecd2d0 2024-09-18T02:06:06.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7a67fff640 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a680346a0 0x7f7a68036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7a67fff640 1 -- 172.21.15.167:0/4216458027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7b70018070 con 0x563275ecd2d0 2024-09-18T02:06:06.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a680346a0 0x7f7a68036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b8217c980 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563275f5ca80 0x563276053f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632760545c0 con 0x563275f5ca80 2024-09-18T02:06:06.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b8048d640 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563275f5ca80 0x563276053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a680346a0 0x7f7a68036b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7b740ad000 tx=0x7f7b740a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b8048d640 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563275f5ca80 0x563276053f50 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b8048d640 1 -- 172.21.15.167:0/4216458027 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b780083f0 con 0x563275f5ca80 2024-09-18T02:06:06.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563276051630 con 0x563275f5ca80 2024-09-18T02:06:06.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b8048d640 1 -- 172.21.15.167:0/4216458027 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b780083f0 con 0x563275f5ca80 2024-09-18T02:06:06.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b8217c980 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5632760568f0 0x563276058ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632760593b0 con 0x5632760568f0 2024-09-18T02:06:06.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b7fc8c640 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5632760568f0 0x563276058ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.623+0000 7f7b7fc8c640 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5632760568f0 0x563276058ce0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/4216458027 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b7001b030 con 0x5632760568f0 2024-09-18T02:06:06.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563276055790 con 0x563275f5ca80 2024-09-18T02:06:06.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b8048d640 1 -- 172.21.15.167:0/4216458027 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b780083f0 con 0x563275f5ca80 2024-09-18T02:06:06.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b8217c980 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56327605a7f0 0x56327605cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56327605d370 con 0x56327605a7f0 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56327605a7f0 0x56327605cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56327605a7f0 0x56327605cbe0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b7f48b640 1 -- 172.21.15.167:0/4216458027 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b740b3040 con 0x56327605a7f0 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b8217c980 1 Processor -- start 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b8217c980 1 -- start start 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b8217c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56327606ae20 0x56327606b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b8217c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563275e5f800 con 0x56327606ae20 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b7fc8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56327606ae20 0x56327606b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b7fc8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56327606ae20 0x56327606b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49928/0 (socket says 172.21.15.167:49928) 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/1983166695 learned_addr learned my addr 172.21.15.167:0/1983166695 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/1983166695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327606b780 con 0x56327606ae20 2024-09-18T02:06:06.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7b7fc8c640 1 --2- 172.21.15.167:0/1983166695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56327606ae20 0x56327606b240 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7b700483b0 tx=0x7f7b70012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.627+0000 7f7a657fa640 1 -- 172.21.15.167:0/1983166695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b70039030 con 0x56327606ae20 2024-09-18T02:06:06.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b8217c980 1 -- 172.21.15.167:0/1983166695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56327606ba10 con 0x56327606ae20 2024-09-18T02:06:06.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7a657fa640 1 -- 172.21.15.167:0/1983166695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b700413d0 con 0x56327606ae20 2024-09-18T02:06:06.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7a657fa640 1 -- 172.21.15.167:0/1983166695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b70043040 con 0x56327606ae20 2024-09-18T02:06:06.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b8217c980 1 -- 172.21.15.167:0/1983166695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56327606e690 con 0x56327606ae20 2024-09-18T02:06:06.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7a657fa640 1 -- 172.21.15.167:0/1983166695 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b700415c0 con 0x56327606ae20 2024-09-18T02:06:06.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7a657fa640 1 --2- 172.21.15.167:0/1983166695 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a580346a0 0x7f7a58036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7a657fa640 1 -- 172.21.15.167:0/1983166695 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7b7003d070 con 0x56327606ae20 2024-09-18T02:06:06.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/1983166695 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a580346a0 0x7f7a58036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b8217c980 1 Processor -- start 2024-09-18T02:06:06.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b8217c980 1 -- start start 2024-09-18T02:06:06.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b8217c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x5632760779a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b8217c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563275f572b0 con 0x5632760775a0 2024-09-18T02:06:06.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/1983166695 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a580346a0 0x7f7a58036b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7b7401b2c0 tx=0x7f7b74005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b7fc8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x5632760779a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b7fc8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x5632760779a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49930/0 (socket says 172.21.15.167:49930) 2024-09-18T02:06:06.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/590811893 learned_addr learned my addr 172.21.15.167:0/590811893 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/590811893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563276077f70 con 0x5632760775a0 2024-09-18T02:06:06.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7b7fc8c640 1 --2- 172.21.15.167:0/590811893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x5632760779a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7b700336a0 tx=0x7f7b70033f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89de12e6fde004bc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7a5effd640 1 -- 172.21.15.167:0/590811893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b70034890 con 0x5632760775a0 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7a5effd640 1 -- 172.21.15.167:0/590811893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b70035d40 con 0x5632760775a0 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.631+0000 7f7a5effd640 1 -- 172.21.15.167:0/590811893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b70028cc0 con 0x5632760775a0 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 -- 172.21.15.167:0/590811893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 msgr2=0x5632760779a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 --2- 172.21.15.167:0/590811893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x5632760779a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7b700336a0 tx=0x7f7b70033f40 comp rx=0 tx=0).stop 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 -- 172.21.15.167:0/590811893 shutdown_connections 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 --2- 172.21.15.167:0/590811893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x5632760779a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 -- 172.21.15.167:0/590811893 >> 172.21.15.167:0/590811893 conn(0x5632760738e0 msgr2=0x563276071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 -- 172.21.15.167:0/590811893 shutdown_connections 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 -- 172.21.15.167:0/590811893 wait complete. 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 Processor -- start 2024-09-18T02:06:06.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 -- start start 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x56327607e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563276078340 con 0x5632760775a0 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b7fc8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x56327607e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b7fc8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x56327607e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49944/0 (socket says 172.21.15.167:49944) 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 learned_addr learned my addr 172.21.15.167:0/2648471318 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327607ec30 con 0x5632760775a0 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b7fc8c640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x56327607e6f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7b700483e0 tx=0x7f7b70037540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7a5d7fa640 1 -- 172.21.15.167:0/2648471318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b70028b70 con 0x5632760775a0 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56327607ec30 con 0x5632760775a0 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7a5d7fa640 1 -- 172.21.15.167:0/2648471318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b700357b0 con 0x5632760775a0 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7a5d7fa640 1 -- 172.21.15.167:0/2648471318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b70028d10 con 0x5632760775a0 2024-09-18T02:06:06.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56327607f0a0 con 0x5632760775a0 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.635+0000 7f7a5d7fa640 1 -- 172.21.15.167:0/2648471318 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b70066040 con 0x5632760775a0 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7a5d7fa640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a48034650 0x7f7a48036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7a5d7fa640 1 -- 172.21.15.167:0/2648471318 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7b70064020 con 0x5632760775a0 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a48034650 0x7f7a48036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563276089790 0x56327608bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56327608c380 con 0x563276089790 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8048d640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563276089790 0x56327608bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a48034650 0x7f7a48036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7b740abaa0 tx=0x7f7b740b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8048d640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563276089790 0x56327608bc30 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b780083f0 con 0x563276089790 2024-09-18T02:06:06.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 20 realm 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56327608c790 con 0x563276089790 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b780083f0 con 0x563276089790 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56327608d030 con 0x563276089790 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b780083f0 con 0x563276089790 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x563276089790 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b780083f0 con 0x563276089790 2024-09-18T02:06:06.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:06.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56327608e130 0x563276090520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563276090aa0 con 0x56327608e130 2024-09-18T02:06:06.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b7fc8c640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56327608e130 0x563276090520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.639+0000 7f7b7fc8c640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56327608e130 0x563276090520 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8217c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:06.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8217c980 20 searching for the correct realm 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5632760929f0 0x563276094eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563276095580 con 0x5632760929f0 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5632760929f0 0x563276094eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5632760929f0 0x563276094eb0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b7f48b640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7b740dc040 0x7f7b740ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563276095580 con 0x7f7b740dc040 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7b740dc040 0x7f7b740ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7b740dc040 0x7f7b740ce430 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b780083f0 con 0x7f7b740dc040 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x7f7b740dc040 2024-09-18T02:06:06.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b780083f0 con 0x7f7b740dc040 2024-09-18T02:06:06.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x563276089790 2024-09-18T02:06:06.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x563276089790 2024-09-18T02:06:06.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x563276089790 2024-09-18T02:06:06.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x56327608e130 2024-09-18T02:06:06.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.643+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x7f7b740dc040 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x5632760929f0 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x563276089790 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x7f7b740dc040 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x563276089790 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x7f7b740dc040 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x5632760929f0 2024-09-18T02:06:06.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x5632760929f0 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x56327608e130 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x5632760929f0 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x5632760929f0 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x563276089790 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.647+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x563276089790 2024-09-18T02:06:06.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x56327608e130 2024-09-18T02:06:06.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x5632760929f0 2024-09-18T02:06:06.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x7f7b740dc040 2024-09-18T02:06:06.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x563276089790 2024-09-18T02:06:06.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x56327608e130 2024-09-18T02:06:06.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x5632760929f0 2024-09-18T02:06:06.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x56327608e130 2024-09-18T02:06:06.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x7f7b740dc040 2024-09-18T02:06:06.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.651+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x5632760929f0 2024-09-18T02:06:06.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x56327608e130 2024-09-18T02:06:06.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x563276089790 2024-09-18T02:06:06.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56327608d3d0 con 0x7f7b740dc040 2024-09-18T02:06:06.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:06.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:06.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:06.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:06.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:06.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:06.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632760912f0 con 0x563276089790 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632760912f0 con 0x563276089790 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632760912f0 con 0x5632760929f0 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 zone default found 2024-09-18T02:06:06.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 4 Realm: () 2024-09-18T02:06:06.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:06.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:06.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:06.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 zonegroup default 2024-09-18T02:06:06.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563276091b90 con 0x56327608e130 2024-09-18T02:06:06.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632760973e0 con 0x5632760929f0 2024-09-18T02:06:06.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.655+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563276097780 con 0x5632760929f0 2024-09-18T02:06:06.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b8217c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b8217c980 20 started sync module instance, tier type = 2024-09-18T02:06:06.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b8217c980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:06.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563276096880 con 0x7f7b740dc040 2024-09-18T02:06:06.668 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94774728682960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563276096880 con 0x7f7b740dc040 2024-09-18T02:06:06.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563276098140 con 0x563276089790 2024-09-18T02:06:06.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94774728682960] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94774728687008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563276096880 con 0x563276089790 2024-09-18T02:06:06.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.659+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563276098b80 con 0x5632760929f0 2024-09-18T02:06:06.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.663+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94774728687008] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.663+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.663+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94774728680400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632760967f0 con 0x5632760929f0 2024-09-18T02:06:06.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.663+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563276099880 con 0x7f7b740dc040 2024-09-18T02:06:06.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.663+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.663+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94774728692960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563276099f90 con 0x7f7b740dc040 2024-09-18T02:06:06.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.663+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609aab0 con 0x563276089790 2024-09-18T02:06:06.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.667+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94774728680400] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.667+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94774728692960] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.667+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.667+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94774728697216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609aa70 con 0x563276089790 2024-09-18T02:06:06.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.667+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609aea0 con 0x56327608e130 2024-09-18T02:06:06.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.667+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94774728697216] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.671+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.671+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94774728694240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609b290 con 0x56327608e130 2024-09-18T02:06:06.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.671+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609bb20 con 0x56327608e130 2024-09-18T02:06:06.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.671+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94774728694240] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.671+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.671+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94774728691488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609b750 con 0x56327608e130 2024-09-18T02:06:06.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.671+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609c900 con 0x56327608e130 2024-09-18T02:06:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94774728704976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609cd70 con 0x56327608e130 2024-09-18T02:06:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 20 add_watcher() i=0 2024-09-18T02:06:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 20 add_watcher() i=1 2024-09-18T02:06:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 20 add_watcher() i=2 2024-09-18T02:06:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 20 add_watcher() i=3 2024-09-18T02:06:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 20 add_watcher() i=4 2024-09-18T02:06:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 20 add_watcher() i=5 2024-09-18T02:06:06.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94774728691488] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 20 add_watcher() i=6 2024-09-18T02:06:06.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94774728704976] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 20 add_watcher() i=7 2024-09-18T02:06:06.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:06.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56327609cd70 con 0x563276089790 2024-09-18T02:06:06.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.675+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94774728706240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609cce0 con 0x563276089790 2024-09-18T02:06:06.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94774728706240] v32'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7a35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:06.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8217c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:06.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8217c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:06.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8217c980 5 note: GC not initialized 2024-09-18T02:06:06.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7a34fe1640 20 reqs_thread_entry: start 2024-09-18T02:06:06.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8217c980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:06.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8217c980 20 Filter name: none 2024-09-18T02:06:06.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f79ae7fc640 20 reqs_thread_entry: start 2024-09-18T02:06:06.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8217c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632760c2fe0 con 0x563276089790 2024-09-18T02:06:06.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8217c980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:06:06.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632760c4530 con 0x56327608e130 2024-09-18T02:06:06.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv34 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7a35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:06.683 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.679+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94774728706240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632760a1e60 con 0x563276089790 2024-09-18T02:06:06.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.683+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94774728706240] v32'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.683+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94774728682960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609c8c0 con 0x7f7b740dc040 2024-09-18T02:06:06.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.683+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94774728682960] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.683+0000 7f7b8217c980 20 remove_watcher() i=0 2024-09-18T02:06:06.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.683+0000 7f7b8217c980 2 removed watcher, disabling cache 2024-09-18T02:06:06.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.683+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94774728687008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609c8c0 con 0x563276089790 2024-09-18T02:06:06.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.687+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94774728687008] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.687+0000 7f7b8217c980 20 remove_watcher() i=1 2024-09-18T02:06:06.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.687+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94774728680400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609c8c0 con 0x5632760929f0 2024-09-18T02:06:06.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.687+0000 7f7b7f48b640 1 -- 172.21.15.167:0/2648471318 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94774728680400] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b740c9030 con 0x5632760929f0 2024-09-18T02:06:06.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.687+0000 7f7b8217c980 20 remove_watcher() i=2 2024-09-18T02:06:06.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.687+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94774728692960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632760963d0 con 0x7f7b740dc040 2024-09-18T02:06:06.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.687+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94774728692960] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x7f7b740dc040 2024-09-18T02:06:06.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.687+0000 7f7b8217c980 20 remove_watcher() i=3 2024-09-18T02:06:06.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.687+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94774728697216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609c8c0 con 0x563276089790 2024-09-18T02:06:06.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.691+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94774728697216] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78026040 con 0x563276089790 2024-09-18T02:06:06.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.691+0000 7f7b8217c980 20 remove_watcher() i=4 2024-09-18T02:06:06.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.691+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94774728694240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632760963d0 con 0x56327608e130 2024-09-18T02:06:06.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.691+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94774728694240] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.691+0000 7f7b8217c980 20 remove_watcher() i=5 2024-09-18T02:06:06.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.691+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94774728691488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56327609c8c0 con 0x56327608e130 2024-09-18T02:06:06.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.695+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94774728691488] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.695+0000 7f7b8217c980 20 remove_watcher() i=6 2024-09-18T02:06:06.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.695+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94774728704976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632760963d0 con 0x56327608e130 2024-09-18T02:06:06.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b7fc8c640 1 -- 172.21.15.167:0/2648471318 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94774728704976] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7007c070 con 0x56327608e130 2024-09-18T02:06:06.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 20 remove_watcher() i=7 2024-09-18T02:06:06.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56327608e130 msgr2=0x563276090520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56327608e130 0x563276090520 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563276089790 msgr2=0x56327608bc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563276089790 0x56327608bc30 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7b740dc040 msgr2=0x7f7b740ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7b740dc040 0x7f7b740ce430 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5632760929f0 msgr2=0x563276094eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5632760929f0 0x563276094eb0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a48034650 msgr2=0x7f7a48036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a48034650 0x7f7a48036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7b740abaa0 tx=0x7f7b740b9040 comp rx=0 tx=0).stop 2024-09-18T02:06:06.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8048d640 1 -- 172.21.15.167:0/2648471318 reap_dead start 2024-09-18T02:06:06.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 msgr2=0x56327607e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x56327607e6f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7b700483e0 tx=0x7f7b70037540 comp rx=0 tx=0).stop 2024-09-18T02:06:06.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 shutdown_connections 2024-09-18T02:06:06.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/2648471318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5632760775a0 0x56327607e6f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 >> 172.21.15.167:0/2648471318 conn(0x5632760738e0 msgr2=0x5632760719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 shutdown_connections 2024-09-18T02:06:06.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/2648471318 wait complete. 2024-09-18T02:06:06.708 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/1983166695 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a580346a0 msgr2=0x7f7a58036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/1983166695 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a580346a0 0x7f7a58036b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7b7401b2c0 tx=0x7f7b74005a10 comp rx=0 tx=0).stop 2024-09-18T02:06:06.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/1983166695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56327606ae20 msgr2=0x56327606b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/1983166695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56327606ae20 0x56327606b240 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7b700483b0 tx=0x7f7b70012ef0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/1983166695 shutdown_connections 2024-09-18T02:06:06.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/1983166695 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a580346a0 0x7f7a58036b60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/1983166695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56327606ae20 0x56327606b240 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/1983166695 >> 172.21.15.167:0/1983166695 conn(0x56327605ff70 msgr2=0x5632760629f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/1983166695 shutdown_connections 2024-09-18T02:06:06.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/1983166695 wait complete. 2024-09-18T02:06:06.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5632760568f0 msgr2=0x563276058ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5632760568f0 0x563276058ce0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563275f5ca80 msgr2=0x563276053f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563275f5ca80 0x563276053f50 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56327605a7f0 msgr2=0x56327605cbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56327605a7f0 0x56327605cbe0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a680346a0 msgr2=0x7f7a68036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7a680346a0 0x7f7a68036b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7b740ad000 tx=0x7f7b740a5040 comp rx=0 tx=0).stop 2024-09-18T02:06:06.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 msgr2=0x56327604cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 --2- 172.21.15.167:0/4216458027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563275ecd2d0 0x56327604cf60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x563275f58640 tx=0x7f7b70000f50 comp rx=0 tx=0).stop 2024-09-18T02:06:06.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8048d640 1 -- 172.21.15.167:0/4216458027 reap_dead start 2024-09-18T02:06:06.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 shutdown_connections 2024-09-18T02:06:06.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 >> 172.21.15.167:0/4216458027 conn(0x563275f53090 msgr2=0x56327603f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 shutdown_connections 2024-09-18T02:06:06.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.699+0000 7f7b8217c980 1 -- 172.21.15.167:0/4216458027 wait complete. 2024-09-18T02:06:06.714 INFO:teuthology.orchestra.run.smithi167.stdout:{"entries":[],"summary":[]} 2024-09-18T02:06:06.715 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-18T02:06:06.715 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-18T02:06:06.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-18T02:06:06.716 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-18T02:06:06.790 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:06.790 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:06.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.787+0000 7f01fd51d980 1 Processor -- start 2024-09-18T02:06:06.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.787+0000 7f01fd51d980 1 -- start start 2024-09-18T02:06:06.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.787+0000 7f01fd51d980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c5fdf07a90 0x55c5fdf09e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.787+0000 7f01fd51d980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c5fdd8bae0 con 0x55c5fde782e0 2024-09-18T02:06:06.792 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.787+0000 7f01fd51d980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55c5fddafe30 con 0x55c5fdf07a90 2024-09-18T02:06:06.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.791+0000 7f01fa82c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55c5fdf07a90 0x55c5fdf09e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.793 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.791+0000 7f01fb02d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55c5fde782e0 0x55c5fdf06370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33784/0 (socket says 172.21.15.167:33784) 2024-09-18T02:06:06.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.791+0000 7f01fb02d640 1 -- 172.21.15.167:0/2899688100 learned_addr learned my addr 172.21.15.167:0/2899688100 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:06.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.791+0000 7f01fa82c640 1 -- 172.21.15.167:0/2899688100 >> v1:172.21.15.81:6789/0 conn(0x55c5fde782e0 legacy=0x55c5fdf06370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.794 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.791+0000 7f01fa82c640 1 -- 172.21.15.167:0/2899688100 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5fdf0b3d0 con 0x55c5fdf07a90 2024-09-18T02:06:06.795 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.791+0000 7f01fa82c640 1 --2- 172.21.15.167:0/2899688100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fdf07a90 0x55c5fdf09e80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f01f000a480 tx=0x7f01f001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b0927d3e0254e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.791+0000 7f01fa02b640 1 -- 172.21.15.167:0/2899688100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f00b0070 con 0x55c5fdf07a90 2024-09-18T02:06:06.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.791+0000 7f01fa02b640 1 -- 172.21.15.167:0/2899688100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f00ab540 con 0x55c5fdf07a90 2024-09-18T02:06:06.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.791+0000 7f01fa02b640 1 -- 172.21.15.167:0/2899688100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f00ab840 con 0x55c5fdf07a90 2024-09-18T02:06:06.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.791+0000 7f01fd51d980 1 -- 172.21.15.167:0/2899688100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fdf07a90 msgr2=0x55c5fdf09e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.796 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.791+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2899688100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fdf07a90 0x55c5fdf09e80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f01f000a480 tx=0x7f01f001b280 comp rx=0 tx=0).stop 2024-09-18T02:06:06.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.795+0000 7f01fd51d980 1 -- 172.21.15.167:0/2899688100 shutdown_connections 2024-09-18T02:06:06.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.795+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2899688100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fdf07a90 0x55c5fdf09e80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.795+0000 7f01fd51d980 1 -- 172.21.15.167:0/2899688100 >> 172.21.15.167:0/2899688100 conn(0x55c5fdefe0a0 msgr2=0x55c5fdf004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.795+0000 7f01fd51d980 1 -- 172.21.15.167:0/2899688100 shutdown_connections 2024-09-18T02:06:06.797 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.795+0000 7f01fd51d980 1 -- 172.21.15.167:0/2899688100 wait complete. 2024-09-18T02:06:06.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.807+0000 7f01fd51d980 1 Processor -- start 2024-09-18T02:06:06.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.807+0000 7f01fd51d980 1 -- start start 2024-09-18T02:06:06.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.807+0000 7f01fd51d980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 0x55c5fdfeea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c5fddb1200 con 0x55c5fde782e0 2024-09-18T02:06:06.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fb02d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 0x55c5fdfeea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fb02d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 0x55c5fdfeea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49954/0 (socket says 172.21.15.167:49954) 2024-09-18T02:06:06.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fb02d640 1 -- 172.21.15.167:0/142312690 learned_addr learned my addr 172.21.15.167:0/142312690 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.813 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fb02d640 1 -- 172.21.15.167:0/142312690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5fdfef050 con 0x55c5fde782e0 2024-09-18T02:06:06.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fb02d640 1 --2- 172.21.15.167:0/142312690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 0x55c5fdfeea80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f01ec001e20 tx=0x7f01ec00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d144939c979dd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f00e960a640 1 -- 172.21.15.167:0/142312690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec012020 con 0x55c5fde782e0 2024-09-18T02:06:06.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f00e960a640 1 -- 172.21.15.167:0/142312690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ec00e7c0 con 0x55c5fde782e0 2024-09-18T02:06:06.814 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f00e960a640 1 -- 172.21.15.167:0/142312690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec00eb00 con 0x55c5fde782e0 2024-09-18T02:06:06.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 -- 172.21.15.167:0/142312690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 msgr2=0x55c5fdfeea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 --2- 172.21.15.167:0/142312690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 0x55c5fdfeea80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f01ec001e20 tx=0x7f01ec00b790 comp rx=0 tx=0).stop 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 -- 172.21.15.167:0/142312690 shutdown_connections 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 --2- 172.21.15.167:0/142312690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 0x55c5fdfeea80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 -- 172.21.15.167:0/142312690 >> 172.21.15.167:0/142312690 conn(0x55c5fdefe0a0 msgr2=0x55c5fdfea6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 -- 172.21.15.167:0/142312690 shutdown_connections 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 -- 172.21.15.167:0/142312690 wait complete. 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 Processor -- start 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 -- start start 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 0x55c5fdff5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fd51d980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c5fdf0ae40 con 0x55c5fde782e0 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fb02d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 0x55c5fdff5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fb02d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 0x55c5fdff5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49964/0 (socket says 172.21.15.167:49964) 2024-09-18T02:06:06.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fb02d640 1 -- 172.21.15.167:0/2629135375 learned_addr learned my addr 172.21.15.167:0/2629135375 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.811+0000 7f01fb02d640 1 -- 172.21.15.167:0/2629135375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5fdff62f0 con 0x55c5fde782e0 2024-09-18T02:06:06.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fb02d640 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 0x55c5fdff5db0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f01ec001e20 tx=0x7f01ec000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f00e7e07640 1 -- 172.21.15.167:0/2629135375 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec012030 con 0x55c5fde782e0 2024-09-18T02:06:06.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5fdff6580 con 0x55c5fde782e0 2024-09-18T02:06:06.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f00e7e07640 1 -- 172.21.15.167:0/2629135375 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ec001480 con 0x55c5fde782e0 2024-09-18T02:06:06.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f00e7e07640 1 -- 172.21.15.167:0/2629135375 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec01a940 con 0x55c5fde782e0 2024-09-18T02:06:06.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5fdff9260 con 0x55c5fde782e0 2024-09-18T02:06:06.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f00e7e07640 1 -- 172.21.15.167:0/2629135375 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01ec015020 con 0x55c5fde782e0 2024-09-18T02:06:06.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f00e7e07640 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00e0034650 0x7f00e0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f00e7e07640 1 -- 172.21.15.167:0/2629135375 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f01ec020030 con 0x55c5fde782e0 2024-09-18T02:06:06.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fa82c640 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00e0034650 0x7f00e0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5fdf07a90 0x55c5fdffcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fdffd3b0 con 0x55c5fdf07a90 2024-09-18T02:06:06.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fb82e640 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5fdf07a90 0x55c5fdffcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fa82c640 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00e0034650 0x7f00e0036b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f01f00ad000 tx=0x7f01f00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fb82e640 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5fdf07a90 0x55c5fdffcd40 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fb82e640 1 -- 172.21.15.167:0/2629135375 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fdf07a90 2024-09-18T02:06:06.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fdffa480 con 0x55c5fdf07a90 2024-09-18T02:06:06.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fb82e640 1 -- 172.21.15.167:0/2629135375 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fdf07a90 2024-09-18T02:06:06.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5fdfff700 0x55c5fe001af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.815+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0021e0 con 0x55c5fdfff700 2024-09-18T02:06:06.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fb02d640 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5fdfff700 0x55c5fe001af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fb02d640 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5fdfff700 0x55c5fe001af0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fb02d640 1 -- 172.21.15.167:0/2629135375 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fdfff700 2024-09-18T02:06:06.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fdffe5a0 con 0x55c5fdf07a90 2024-09-18T02:06:06.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fb82e640 1 -- 172.21.15.167:0/2629135375 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fdf07a90 2024-09-18T02:06:06.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5fe003640 0x55c5fe005a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe006170 con 0x55c5fe003640 2024-09-18T02:06:06.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fa82c640 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5fe003640 0x55c5fe005a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fa82c640 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5fe003640 0x55c5fe005a30 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fa82c640 1 -- 172.21.15.167:0/2629135375 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f01f00b3040 con 0x55c5fe003640 2024-09-18T02:06:06.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fd51d980 1 Processor -- start 2024-09-18T02:06:06.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fd51d980 1 -- start start 2024-09-18T02:06:06.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fd51d980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe013c40 0x55c5fe014060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fd51d980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c5fde0a800 con 0x55c5fe013c40 2024-09-18T02:06:06.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fb02d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe013c40 0x55c5fe014060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fb02d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe013c40 0x55c5fe014060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49966/0 (socket says 172.21.15.167:49966) 2024-09-18T02:06:06.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.819+0000 7f01fb02d640 1 -- 172.21.15.167:0/1261866920 learned_addr learned my addr 172.21.15.167:0/1261866920 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fb02d640 1 -- 172.21.15.167:0/1261866920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5fe0145a0 con 0x55c5fe013c40 2024-09-18T02:06:06.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fb02d640 1 --2- 172.21.15.167:0/1261866920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe013c40 0x55c5fe014060 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00d010 tx=0x7f01ec018700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f00e5602640 1 -- 172.21.15.167:0/1261866920 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec017d80 con 0x55c5fe013c40 2024-09-18T02:06:06.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fd51d980 1 -- 172.21.15.167:0/1261866920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5fe014830 con 0x55c5fe013c40 2024-09-18T02:06:06.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f00e5602640 1 -- 172.21.15.167:0/1261866920 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ec041c00 con 0x55c5fe013c40 2024-09-18T02:06:06.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f00e5602640 1 -- 172.21.15.167:0/1261866920 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec041f00 con 0x55c5fe013c40 2024-09-18T02:06:06.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fd51d980 1 -- 172.21.15.167:0/1261866920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5fe0174b0 con 0x55c5fe013c40 2024-09-18T02:06:06.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f00e5602640 1 -- 172.21.15.167:0/1261866920 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01ec009070 con 0x55c5fe013c40 2024-09-18T02:06:06.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f00e5602640 1 --2- 172.21.15.167:0/1261866920 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00d4034650 0x7f00d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f00e5602640 1 -- 172.21.15.167:0/1261866920 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f01ec005050 con 0x55c5fe013c40 2024-09-18T02:06:06.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fa82c640 1 --2- 172.21.15.167:0/1261866920 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00d4034650 0x7f00d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fd51d980 1 Processor -- start 2024-09-18T02:06:06.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fd51d980 1 -- start start 2024-09-18T02:06:06.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fd51d980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe020970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fd51d980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c5fdfef3d0 con 0x55c5fe020570 2024-09-18T02:06:06.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fa82c640 1 --2- 172.21.15.167:0/1261866920 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00d4034650 0x7f00d4036b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55c5fdffd880 tx=0x7f01f0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fb02d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe020970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fb02d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe020970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49968/0 (socket says 172.21.15.167:49968) 2024-09-18T02:06:06.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fb02d640 1 -- 172.21.15.167:0/2453808391 learned_addr learned my addr 172.21.15.167:0/2453808391 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.823+0000 7f01fb02d640 1 -- 172.21.15.167:0/2453808391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5fe020f40 con 0x55c5fe020570 2024-09-18T02:06:06.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fb02d640 1 --2- 172.21.15.167:0/2453808391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe020970 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f01ec016f70 tx=0x7f01ec02ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709cac02b950bbfa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f00deffd640 1 -- 172.21.15.167:0/2453808391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec061070 con 0x55c5fe020570 2024-09-18T02:06:06.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f00deffd640 1 -- 172.21.15.167:0/2453808391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ec00caa0 con 0x55c5fe020570 2024-09-18T02:06:06.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f00deffd640 1 -- 172.21.15.167:0/2453808391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec058040 con 0x55c5fe020570 2024-09-18T02:06:06.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 -- 172.21.15.167:0/2453808391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 msgr2=0x55c5fe020970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2453808391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe020970 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f01ec016f70 tx=0x7f01ec02ddf0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 -- 172.21.15.167:0/2453808391 shutdown_connections 2024-09-18T02:06:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2453808391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe020970 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 -- 172.21.15.167:0/2453808391 >> 172.21.15.167:0/2453808391 conn(0x55c5fe01c950 msgr2=0x55c5fe01aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 -- 172.21.15.167:0/2453808391 shutdown_connections 2024-09-18T02:06:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 -- 172.21.15.167:0/2453808391 wait complete. 2024-09-18T02:06:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 Processor -- start 2024-09-18T02:06:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 -- start start 2024-09-18T02:06:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe027730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c5fe0213c0 con 0x55c5fe020570 2024-09-18T02:06:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fb02d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe027730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fb02d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe027730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:49982/0 (socket says 172.21.15.167:49982) 2024-09-18T02:06:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 learned_addr learned my addr 172.21.15.167:0/1330613311 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5fe027c70 con 0x55c5fe020570 2024-09-18T02:06:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fb02d640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe027730 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00cd50 tx=0x7f01ec02f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f00dd7fa640 1 -- 172.21.15.167:0/1330613311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec061040 con 0x55c5fe020570 2024-09-18T02:06:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5fe027c70 con 0x55c5fe020570 2024-09-18T02:06:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5fe027c70 con 0x55c5fe020570 2024-09-18T02:06:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f00dd7fa640 1 -- 172.21.15.167:0/1330613311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ec04ede0 con 0x55c5fe020570 2024-09-18T02:06:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.827+0000 7f00dd7fa640 1 -- 172.21.15.167:0/1330613311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec02b420 con 0x55c5fe020570 2024-09-18T02:06:06.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f00dd7fa640 1 -- 172.21.15.167:0/1330613311 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01ec06e020 con 0x55c5fe020570 2024-09-18T02:06:06.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f00dd7fa640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00c4034650 0x7f00c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f00dd7fa640 1 -- 172.21.15.167:0/1330613311 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f01ec06c020 con 0x55c5fe020570 2024-09-18T02:06:06.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fa82c640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00c4034650 0x7f00c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5fe032830 0x55c5fe034cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe035440 con 0x55c5fe032830 2024-09-18T02:06:06.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fb82e640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5fe032830 0x55c5fe034cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fa82c640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00c4034650 0x7f00c4036b10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f01f0000c10 tx=0x7f01f00b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fb82e640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5fe032830 0x55c5fe034cf0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 20 realm 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe035850 con 0x55c5fe032830 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe036120 con 0x55c5fe032830 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe032830 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5fe037220 0x55c5fe039610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe039c20 con 0x55c5fe037220 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fb02d640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5fe037220 0x55c5fe039610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.831+0000 7f01fb02d640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5fe037220 0x55c5fe039610 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fd51d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fd51d980 20 searching for the correct realm 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5fe03bb70 0x55c5fe03df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe03e650 con 0x55c5fe03bb70 2024-09-18T02:06:06.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fa82c640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5fe03bb70 0x55c5fe03df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fa82c640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5fe03bb70 0x55c5fe03df80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fa82c640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f01f00dc040 0x7f01f00dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:06.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe03e650 con 0x7f01f00dc040 2024-09-18T02:06:06.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f01f00dc040 0x7f01f00dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:06.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f01f00dc040 0x7f01f00dd430 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:06.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x7f01f00dc040 2024-09-18T02:06:06.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe032830 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe032830 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe032830 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.835+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe037220 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x7f01f00dc040 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe03bb70 2024-09-18T02:06:06.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe032830 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x7f01f00dc040 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe032830 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x7f01f00dc040 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe03bb70 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe03bb70 2024-09-18T02:06:06.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe037220 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe03bb70 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.839+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe03bb70 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe032830 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe032830 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe037220 2024-09-18T02:06:06.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe03bb70 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x7f01f00dc040 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe032830 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe037220 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe03bb70 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.843+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe037220 2024-09-18T02:06:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x7f01f00dc040 2024-09-18T02:06:06.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe03bb70 2024-09-18T02:06:06.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.854 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe037220 2024-09-18T02:06:06.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x55c5fe032830 2024-09-18T02:06:06.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0364c0 con 0x7f01f00dc040 2024-09-18T02:06:06.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:06.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:06.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:06.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:06.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:06.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:06.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe03a4e0 con 0x55c5fe032830 2024-09-18T02:06:06.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe03a4e0 con 0x55c5fe032830 2024-09-18T02:06:06.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe03a4e0 con 0x55c5fe03bb70 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 zone default found 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 4 Realm: () 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 zonegroup default 2024-09-18T02:06:06.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe03ae20 con 0x55c5fe037220 2024-09-18T02:06:06.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.847+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0404e0 con 0x55c5fe03bb70 2024-09-18T02:06:06.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fd51d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe040940 con 0x55c5fe03bb70 2024-09-18T02:06:06.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fd51d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fd51d980 20 started sync module instance, tier type = 2024-09-18T02:06:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fd51d980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe03f950 con 0x7f01f00dc040 2024-09-18T02:06:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94308858592896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe03f950 con 0x7f01f00dc040 2024-09-18T02:06:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe041410 con 0x55c5fe032830 2024-09-18T02:06:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.851+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94308858592896] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.855+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.855+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94308858597088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe03f950 con 0x55c5fe032830 2024-09-18T02:06:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.855+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe041e20 con 0x55c5fe03bb70 2024-09-18T02:06:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.855+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94308858597088] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.855+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.855+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94308858590368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe03f8c0 con 0x55c5fe03bb70 2024-09-18T02:06:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.855+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe042b70 con 0x7f01f00dc040 2024-09-18T02:06:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.859+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.859+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94308858603504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe043410 con 0x7f01f00dc040 2024-09-18T02:06:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.859+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe043dd0 con 0x55c5fe032830 2024-09-18T02:06:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.859+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94308858590368] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.859+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94308858603504] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.859+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.859+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94308858607904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe043380 con 0x55c5fe032830 2024-09-18T02:06:06.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.859+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe043d40 con 0x55c5fe037220 2024-09-18T02:06:06.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.863+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94308858607904] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.863+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.863+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94308858605568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe044670 con 0x55c5fe037220 2024-09-18T02:06:06.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.863+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe044ec0 con 0x55c5fe037220 2024-09-18T02:06:06.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.863+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.863+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94308858611584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0452b0 con 0x55c5fe037220 2024-09-18T02:06:06.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.863+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94308858605568] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.863+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe044200 con 0x55c5fe037220 2024-09-18T02:06:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.867+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94308858611584] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.867+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.867+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94308858612992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe045270 con 0x55c5fe037220 2024-09-18T02:06:06.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.867+0000 7f01fd51d980 20 add_watcher() i=0 2024-09-18T02:06:06.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.867+0000 7f01fd51d980 20 add_watcher() i=1 2024-09-18T02:06:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.867+0000 7f01fd51d980 20 add_watcher() i=2 2024-09-18T02:06:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.867+0000 7f01fd51d980 20 add_watcher() i=3 2024-09-18T02:06:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.867+0000 7f01fd51d980 20 add_watcher() i=4 2024-09-18T02:06:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.867+0000 7f01fd51d980 20 add_watcher() i=5 2024-09-18T02:06:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.867+0000 7f01fd51d980 20 add_watcher() i=6 2024-09-18T02:06:06.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.871+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94308858612992] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.871+0000 7f01fd51d980 20 add_watcher() i=7 2024-09-18T02:06:06.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.871+0000 7f01fd51d980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:06.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.871+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe048d80 con 0x55c5fe032830 2024-09-18T02:06:06.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.871+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.871+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94308858615968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe046210 con 0x55c5fe032830 2024-09-18T02:06:06.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.871+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94308858615968] v32'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.871+0000 7f00b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:06.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.871+0000 7f01fd51d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:06.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.871+0000 7f01fd51d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:06.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.871+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0515e0 con 0x55c5fe032830 2024-09-18T02:06:06.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.875+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'58 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.875+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe051c10 con 0x55c5fe037220 2024-09-18T02:06:06.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.875+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.875+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe051c10 con 0x55c5fe03bb70 2024-09-18T02:06:06.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.879+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.879+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe052240 con 0x55c5fe032830 2024-09-18T02:06:06.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.879+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'239 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.879+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe052660 con 0x7f01f00dc040 2024-09-18T02:06:06.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.879+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'80 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.879+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe052a60 con 0x55c5fe03bb70 2024-09-18T02:06:06.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.883+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'61 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.883+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe052fd0 con 0x55c5fe032830 2024-09-18T02:06:06.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.883+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.883+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053060 con 0x55c5fe037220 2024-09-18T02:06:06.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.887+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.887+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053140 con 0x7f01f00dc040 2024-09-18T02:06:06.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.887+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.887+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053140 con 0x55c5fe03bb70 2024-09-18T02:06:06.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.891+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.891+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053650 con 0x7f01f00dc040 2024-09-18T02:06:06.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.891+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'81 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.891+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053650 con 0x55c5fe037220 2024-09-18T02:06:06.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.895+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.895+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053650 con 0x7f01f00dc040 2024-09-18T02:06:06.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.895+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.895+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053650 con 0x55c5fe037220 2024-09-18T02:06:06.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.899+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'69 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.899+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053650 con 0x55c5fe032830 2024-09-18T02:06:06.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.899+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'240 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.899+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053650 con 0x55c5fe03bb70 2024-09-18T02:06:06.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.903+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'76 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.903+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0536e0 con 0x7f01f00dc040 2024-09-18T02:06:06.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.903+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'82 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.903+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0536e0 con 0x55c5fe03bb70 2024-09-18T02:06:06.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.903+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'40 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.903+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0536e0 con 0x55c5fe032830 2024-09-18T02:06:06.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.907+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.907+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0536e0 con 0x55c5fe032830 2024-09-18T02:06:06.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.907+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'241 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.907+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0536e0 con 0x55c5fe03bb70 2024-09-18T02:06:06.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.911+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'77 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.911+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053700 con 0x7f01f00dc040 2024-09-18T02:06:06.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.911+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.911+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053700 con 0x55c5fe03bb70 2024-09-18T02:06:06.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.915+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'37 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.915+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053700 con 0x55c5fe03bb70 2024-09-18T02:06:06.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.915+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'46 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.915+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053700 con 0x55c5fe03bb70 2024-09-18T02:06:06.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.915+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.915+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053700 con 0x55c5fe03bb70 2024-09-18T02:06:06.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.919+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'62 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.921 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.919+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053700 con 0x55c5fe037220 2024-09-18T02:06:06.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.919+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.919+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053700 con 0x55c5fe03bb70 2024-09-18T02:06:06.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.923+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'43 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.925 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.923+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053700 con 0x55c5fe037220 2024-09-18T02:06:06.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.923+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.923+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053700 con 0x55c5fe03bb70 2024-09-18T02:06:06.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.927+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'78 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.927+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053700 con 0x55c5fe037220 2024-09-18T02:06:06.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.931+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'70 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.931+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe053700 con 0x7f01f00dc040 2024-09-18T02:06:06.935 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.931+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.931+0000 7f00b0fe1640 20 reqs_thread_entry: start 2024-09-18T02:06:06.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.931+0000 7f01fd51d980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:06.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.931+0000 7f01fd51d980 20 Filter name: none 2024-09-18T02:06:06.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.931+0000 7f002a7fc640 20 reqs_thread_entry: start 2024-09-18T02:06:06.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.931+0000 7f01fd51d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T02:06:06.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.931+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.936 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.931+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe04f980 con 0x55c5fe032830 2024-09-18T02:06:06.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T02:06:06.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T02:06:06.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T02:06:06.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:06.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe04f470 con 0x7f01f00dc040 2024-09-18T02:06:06.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 : miss 2024-09-18T02:06:06.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:96 8.c 8:3094757c:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe071230 con 0x55c5fe032830 2024-09-18T02:06:06.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(96 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T02:06:06.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 info.flags=0x17 2024-09-18T02:06:06.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 to cache LRU end 2024-09-18T02:06:06.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:06.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T02:06:06.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 2024-09-18T02:06:06.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:97 4.2a 4:5487fad7:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee780 con 0x55c5fe032830 2024-09-18T02:06:06.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(97 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:98 4.28 4:1429daa8:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee7c0 con 0x55c5fe032830 2024-09-18T02:06:06.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(98 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.935+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:99 4.26 4:64be8629:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee7c0 con 0x55c5fe037220 2024-09-18T02:06:06.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(99 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:100 4.13 4:cb163f4d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee800 con 0x7f01f00dc040 2024-09-18T02:06:06.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(100 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:101 4.2 4:41409fae:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee800 con 0x55c5fe032830 2024-09-18T02:06:06.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(101 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fd51d980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-18T02:06:06.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:102 4.19 4:9b30d497:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee800 con 0x55c5fe03bb70 2024-09-18T02:06:06.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(102 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:103 4.37 4:ed135ba2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee800 con 0x55c5fe037220 2024-09-18T02:06:06.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(103 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:104 4.34 4:2c76433d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee800 con 0x7f01f00dc040 2024-09-18T02:06:06.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(104 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:105 4.30 4:0d21cf73:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee800 con 0x55c5fe03bb70 2024-09-18T02:06:06.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(105 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.939+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:106 4.28 4:17296254:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee7c0 con 0x55c5fe032830 2024-09-18T02:06:06.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(106 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:107 4.1d 4:bb9e5694:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee7c0 con 0x55c5fe03bb70 2024-09-18T02:06:06.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(107 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f01f00c9030 con 0x55c5fe03bb70 2024-09-18T02:06:06.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fd51d980 20 get_obj_state: octx=0x7f01f400aae0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55c5fe0ec828 s->prefetch_data=0 2024-09-18T02:06:06.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:108 3.1b 3:d819ce30:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ed6b0 con 0x55c5fe03bb70 2024-09-18T02:06:06.946 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== osd_op_reply(108 c5231f36-c36e-44d5-8268-aaf52617db58.4235.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fd51d980 10 manifest: total_size = 6 2024-09-18T02:06:06.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fd51d980 20 get_obj_state: setting s->obj_tag to c5231f36-c36e-44d5-8268-aaf52617db58.4235.12504584983684508474 2024-09-18T02:06:06.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fd51d980 20 get_obj_state: octx=0x7f01f400aae0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55c5fe0ec828 s->prefetch_data=0 2024-09-18T02:06:06.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fd51d980 20 prepare_atomic_modification: state is not atomic. state=0x55c5fe0ec828 2024-09-18T02:06:06.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fd51d980 20 bucket index object: :.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4 2024-09-18T02:06:06.947 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:109 4.2 4:41409fae:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ee130 con 0x55c5fe032830 2024-09-18T02:06:06.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(109 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.943+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:110 3.1b 3:d819ce30:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0edb60 con 0x55c5fe03bb70 2024-09-18T02:06:06.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 31 ==== osd_op_reply(110 c5231f36-c36e-44d5-8268-aaf52617db58.4235.7_15f6f8dc036519d7fe15b39338f6e5db [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:111 4.2 4:41409fae:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe075fe0 con 0x55c5fe032830 2024-09-18T02:06:06.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 20 list_objects_ordered: starting attempt 1 2024-09-18T02:06:06.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T02:06:06.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:112 4.2a 4:5487fad7:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe075fe0 con 0x55c5fe032830 2024-09-18T02:06:06.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:113 4.28 4:1429daa8:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe07a290 con 0x55c5fe032830 2024-09-18T02:06:06.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:114 4.26 4:64be8629:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe07cc30 con 0x55c5fe037220 2024-09-18T02:06:06.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:115 4.13 4:cb163f4d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe075fe0 con 0x7f01f00dc040 2024-09-18T02:06:06.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:116 4.2 4:41409fae:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe081be0 con 0x55c5fe032830 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:117 4.19 4:9b30d497:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe07cc30 con 0x55c5fe03bb70 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 35 ==== osd_op_reply(112 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:118 4.37 4:ed135ba2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe081be0 con 0x55c5fe037220 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 36 ==== osd_op_reply(113 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:119 4.34 4:2c76433d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0eca50 con 0x7f01f00dc040 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:120 4.30 4:0d21cf73:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe079de0 con 0x55c5fe03bb70 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:121 4.28 4:17296254:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe089f50 con 0x55c5fe032830 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 23 ==== osd_op_reply(115 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:122 4.1d 4:bb9e5694:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08cdd0 con 0x55c5fe03bb70 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 32 ==== osd_op_reply(117 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(114 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 24 ==== osd_op_reply(119 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(118 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 37 ==== osd_op_reply(121 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 33 ==== osd_op_reply(120 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 34 ==== osd_op_reply(122 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 38 ==== osd_op_reply(111 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.947+0000 7f00deffd640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-18T02:06:06.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 39 ==== osd_op_reply(116 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[c5231f36-c36e-44d5-8268-aaf52617db58.4235.7])"; uploads.size()=0; is_truncated=0 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:123 4.2a 4:5487fad7:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe075b10 con 0x55c5fe032830 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:124 4.28 4:1429daa8:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0897f0 con 0x55c5fe032830 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:125 4.26 4:64be8629:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe089be0 con 0x55c5fe037220 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:126 4.13 4:cb163f4d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe086a50 con 0x7f01f00dc040 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:127 4.2 4:41409fae:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0897f0 con 0x55c5fe032830 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:128 4.19 4:9b30d497:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe075b10 con 0x55c5fe03bb70 2024-09-18T02:06:06.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:129 4.37 4:ed135ba2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe089be0 con 0x55c5fe037220 2024-09-18T02:06:06.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:130 4.34 4:2c76433d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0897f0 con 0x7f01f00dc040 2024-09-18T02:06:06.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:131 4.30 4:0d21cf73:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe086a50 con 0x55c5fe03bb70 2024-09-18T02:06:06.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:132 4.28 4:17296254:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe089be0 con 0x55c5fe032830 2024-09-18T02:06:06.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:133 4.1d 4:bb9e5694:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08e300 con 0x55c5fe03bb70 2024-09-18T02:06:06.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 40 ==== osd_op_reply(123 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 41 ==== osd_op_reply(124 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 25 ==== osd_op_reply(126 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 35 ==== osd_op_reply(128 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 42 ==== osd_op_reply(127 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 26 ==== osd_op_reply(130 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 36 ==== osd_op_reply(131 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(125 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01ec008030 con 0x55c5fe037220 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 37 ==== osd_op_reply(133 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(129 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 43 ==== osd_op_reply(132 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.951+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe075a90 con 0x7f01f00dc040 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 27 ==== osd_op_reply(134 foo.buckets [call] v32'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fd51d980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0899c0 con 0x7f01f00dc040 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 28 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fd51d980 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T02:06:06.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fd51d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T02:06:06.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fd51d980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T02:06:06.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe075a90 con 0x7f01f00dc040 2024-09-18T02:06:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 29 ==== osd_op_reply(136 myfoo [call,call,delete] v32'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fd51d980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-18T02:06:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fd51d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T02:06:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.955+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94308858813072 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0899c0 con 0x55c5fe037220 2024-09-18T02:06:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== watch-notify(notify (1) cookie 94308858611584 notify 137438953517 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55c5fe052a60 con 0x55c5fe037220 2024-09-18T02:06:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f00de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953517 cookie 94308858611584 notifier 4788 bl.length()=149 2024-09-18T02:06:06.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f00de7fc640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f00300032d0 con 0x55c5fe037220 2024-09-18T02:06:06.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(137 notify.6 [notify cookie 94308858813072 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:06.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:06.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== watch-notify(notify_complete (2) cookie 94308858813072 notify 137438953517 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5fe0145a0 con 0x55c5fe037220 2024-09-18T02:06:06.963 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:139 8.c 8:3094757c:root::.bucket.meta.myfoo%3ac5231f36-c36e-44d5-8268-aaf52617db58.4235.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08c5a0 con 0x55c5fe032830 2024-09-18T02:06:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 44 ==== osd_op_reply(139 .bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 [call,call,delete] v32'7 uv7 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f01fd51d980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 from cache 2024-09-18T02:06:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f01fd51d980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:c5231f36-c36e-44d5-8268-aaf52617db58.4235.7, ofs0, ns] 2024-09-18T02:06:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94308858794400 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0899c0 con 0x55c5fe037220 2024-09-18T02:06:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== watch-notify(notify (1) cookie 94308858612992 notify 137438953518 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55c5fe0145a0 con 0x55c5fe037220 2024-09-18T02:06:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f00deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953518 cookie 94308858612992 notifier 4788 bl.length()=206 2024-09-18T02:06:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 33 ==== osd_op_reply(140 notify.7 [notify cookie 94308858794400 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.959+0000 7f00deffd640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f00c0003d70 con 0x55c5fe037220 2024-09-18T02:06:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 34 ==== watch-notify(notify_complete (2) cookie 94308858794400 notify 137438953518 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5fdff9260 con 0x55c5fe037220 2024-09-18T02:06:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 35 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:142 4.2a 4:5487fad7:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe075a90 con 0x55c5fe032830 2024-09-18T02:06:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:143 4.28 4:1429daa8:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08cc00 con 0x55c5fe032830 2024-09-18T02:06:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:144 4.26 4:64be8629:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08a920 con 0x55c5fe037220 2024-09-18T02:06:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:145 4.13 4:cb163f4d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08ad00 con 0x7f01f00dc040 2024-09-18T02:06:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:146 4.2 4:41409fae:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08cc00 con 0x55c5fe032830 2024-09-18T02:06:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:147 4.19 4:9b30d497:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08b0a0 con 0x55c5fe03bb70 2024-09-18T02:06:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:148 4.37 4:ed135ba2:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08ad00 con 0x55c5fe037220 2024-09-18T02:06:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:149 4.34 4:2c76433d:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08a920 con 0x7f01f00dc040 2024-09-18T02:06:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:150 4.30 4:0d21cf73:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08cc00 con 0x55c5fe03bb70 2024-09-18T02:06:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:151 4.28 4:17296254:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08bef0 con 0x55c5fe032830 2024-09-18T02:06:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:152 4.1d 4:bb9e5694:::.dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe08a920 con 0x55c5fe03bb70 2024-09-18T02:06:06.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 45 ==== osd_op_reply(142 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.0 [delete] v32'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.963+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 38 ==== osd_op_reply(150 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.8 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 39 ==== osd_op_reply(152 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.10 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 30 ==== osd_op_reply(149 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.7 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 31 ==== osd_op_reply(145 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.3 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 46 ==== osd_op_reply(143 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.1 [delete] v32'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 36 ==== osd_op_reply(148 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.6 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:06.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 47 ==== osd_op_reply(146 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.4 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 37 ==== osd_op_reply(144 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.2 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:06.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 48 ==== osd_op_reply(151 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.9 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 40 ==== osd_op_reply(147 .dir.c5231f36-c36e-44d5-8268-aaf52617db58.4235.7.5 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fd51d980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 : miss 2024-09-18T02:06:06.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fd51d980 20 rados->read ofs=0 len=0 2024-09-18T02:06:06.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:153 6.7 6:e47679e1:::pubsub..bucket.myfoo%2fc5231f36-c36e-44d5-8268-aaf52617db58.4235.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0899c0 con 0x55c5fe03bb70 2024-09-18T02:06:06.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 41 ==== osd_op_reply(153 pubsub..bucket.myfoo/c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fd51d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:06.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fd51d980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 info.flags=0x0 2024-09-18T02:06:06.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fd51d980 10 adding default.rgw.log++pubsub..bucket.myfoo/c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 to cache LRU end 2024-09-18T02:06:06.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:154 6.7 6:e47679e1:::pubsub..bucket.myfoo%2fc5231f36-c36e-44d5-8268-aaf52617db58.4235.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe081b70 con 0x55c5fe03bb70 2024-09-18T02:06:06.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 42 ==== osd_op_reply(154 pubsub..bucket.myfoo/c5231f36-c36e-44d5-8268-aaf52617db58.4235.7 [delete] v32'79 uv57 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.967+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe081b70 con 0x7f01f00dc040 2024-09-18T02:06:06.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.971+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 32 ==== osd_op_reply(155 foo.buckets [call] v32'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.971+0000 7f01fd51d980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-18T02:06:06.974 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.971+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe037220 2024-09-18T02:06:06.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.971+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 38 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:06.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.971+0000 7f01fd51d980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-18T02:06:06.977 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.971+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94308858894784 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x7f01f00dc040 2024-09-18T02:06:06.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 33 ==== watch-notify(notify (1) cookie 94308858603504 notify 137438953491 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55c5fe070770 con 0x7f01f00dc040 2024-09-18T02:06:06.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f00de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94308858603504 notifier 4788 bl.length()=170 2024-09-18T02:06:06.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 34 ==== osd_op_reply(157 notify.3 [notify cookie 94308858894784 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f00de7fc640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f00300032d0 con 0x7f01f00dc040 2024-09-18T02:06:06.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 35 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 36 ==== watch-notify(notify_complete (2) cookie 94308858894784 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5fe052410 con 0x7f01f00dc040 2024-09-18T02:06:06.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f01fd51d980 10 removing email index: foo@foo.com 2024-09-18T02:06:06.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe032830 2024-09-18T02:06:06.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 49 ==== osd_op_reply(159 foo@foo.com [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f01fd51d980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-18T02:06:06.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94308858894784 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x7f01f00dc040 2024-09-18T02:06:06.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 37 ==== watch-notify(notify (1) cookie 94308858603504 notify 137438953492 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55c5fe052410 con 0x7f01f00dc040 2024-09-18T02:06:06.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f00deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94308858603504 notifier 4788 bl.length()=162 2024-09-18T02:06:06.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 38 ==== osd_op_reply(160 notify.3 [notify cookie 94308858894784 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.975+0000 7f00deffd640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f00c0003d70 con 0x7f01f00dc040 2024-09-18T02:06:06.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.979+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 39 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.979+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 40 ==== watch-notify(notify_complete (2) cookie 94308858894784 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5fe052240 con 0x7f01f00dc040 2024-09-18T02:06:06.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.979+0000 7f01fd51d980 10 removing user buckets index 2024-09-18T02:06:06.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.979+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x7f01f00dc040 2024-09-18T02:06:06.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.979+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 41 ==== osd_op_reply(162 foo.buckets [delete] v32'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.979+0000 7f01fd51d980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-18T02:06:06.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.979+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94308858894784 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe037220 2024-09-18T02:06:06.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.979+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 39 ==== watch-notify(notify (1) cookie 94308858605568 notify 137438953519 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c5fdff9260 con 0x55c5fe037220 2024-09-18T02:06:06.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.979+0000 7f00deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953519 cookie 94308858605568 notifier 4788 bl.length()=160 2024-09-18T02:06:06.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.979+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 40 ==== osd_op_reply(163 notify.5 [notify cookie 94308858894784 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:06.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.979+0000 7f00deffd640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f00c0003d70 con 0x55c5fe037220 2024-09-18T02:06:06.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 41 ==== watch-notify(notify_complete (2) cookie 94308858894784 notify 137438953519 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5fdff6580 con 0x55c5fe037220 2024-09-18T02:06:06.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 42 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:06.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fd51d980 10 removing user index: foo 2024-09-18T02:06:06.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe032830 2024-09-18T02:06:06.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 50 ==== osd_op_reply(165 foo [call,call,delete] v32'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fd51d980 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-18T02:06:06.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fd51d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T02:06:06.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94308858894784 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe032830 2024-09-18T02:06:06.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 51 ==== watch-notify(notify (1) cookie 94308858607904 notify 137438953490 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c5fe052240 con 0x55c5fe032830 2024-09-18T02:06:06.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f00deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94308858607904 notifier 4788 bl.length()=152 2024-09-18T02:06:06.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 52 ==== osd_op_reply(166 notify.4 [notify cookie 94308858894784 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f00deffd640 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f00c0003d70 con 0x55c5fe032830 2024-09-18T02:06:06.988 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 53 ==== watch-notify(notify_complete (2) cookie 94308858894784 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5fe051e10 con 0x55c5fe032830 2024-09-18T02:06:06.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.983+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 54 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.987+0000 7f00b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:06.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.987+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94308858615968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe032830 2024-09-18T02:06:06.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.987+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 55 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94308858615968] v32'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.987+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94308858592896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x7f01f00dc040 2024-09-18T02:06:06.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.987+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 42 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94308858592896] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.987+0000 7f01fd51d980 20 remove_watcher() i=0 2024-09-18T02:06:06.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.987+0000 7f01fd51d980 2 removed watcher, disabling cache 2024-09-18T02:06:06.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.987+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94308858597088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe032830 2024-09-18T02:06:06.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.991+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 56 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94308858597088] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:06.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.991+0000 7f01fd51d980 20 remove_watcher() i=1 2024-09-18T02:06:06.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.991+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94308858590368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe03bb70 2024-09-18T02:06:06.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.995+0000 7f01fa82c640 1 -- 172.21.15.167:0/1330613311 <== osd.3 v2:172.21.15.167:6808/2476454287 43 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94308858590368] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f00f6390 con 0x55c5fe03bb70 2024-09-18T02:06:06.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.995+0000 7f01fd51d980 20 remove_watcher() i=2 2024-09-18T02:06:06.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.995+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94308858603504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x7f01f00dc040 2024-09-18T02:06:06.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.995+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.2 v2:172.21.15.167:6816/2055439504 43 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94308858603504] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x7f01f00dc040 2024-09-18T02:06:06.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.995+0000 7f01fd51d980 20 remove_watcher() i=3 2024-09-18T02:06:06.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.995+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94308858607904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe032830 2024-09-18T02:06:07.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.999+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 <== osd.1 v2:172.21.15.167:6800/15864359 57 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94308858607904] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f400a4d0 con 0x55c5fe032830 2024-09-18T02:06:07.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.999+0000 7f01fd51d980 20 remove_watcher() i=4 2024-09-18T02:06:07.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.999+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94308858605568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe037220 2024-09-18T02:06:07.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.999+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 43 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94308858605568] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:07.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.999+0000 7f01fd51d980 20 remove_watcher() i=5 2024-09-18T02:06:07.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:06.999+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94308858611584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe037220 2024-09-18T02:06:07.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.003+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 44 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94308858611584] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:07.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.003+0000 7f01fd51d980 20 remove_watcher() i=6 2024-09-18T02:06:07.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.003+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94308858612992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5fe0ecf50 con 0x55c5fe037220 2024-09-18T02:06:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.003+0000 7f01fb02d640 1 -- 172.21.15.167:0/1330613311 <== osd.0 v2:172.21.15.81:6800/3087415523 45 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94308858612992] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec08b060 con 0x55c5fe037220 2024-09-18T02:06:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.003+0000 7f01fd51d980 20 remove_watcher() i=7 2024-09-18T02:06:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.003+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5fe037220 msgr2=0x55c5fe039610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.003+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5fe037220 0x55c5fe039610 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5fe032830 msgr2=0x55c5fe034cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5fe032830 0x55c5fe034cf0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f01f00dc040 msgr2=0x7f01f00dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f01f00dc040 0x7f01f00dd430 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5fe03bb70 msgr2=0x55c5fe03df80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5fe03bb70 0x55c5fe03df80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00c4034650 msgr2=0x7f00c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00c4034650 0x7f00c4036b10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f01f0000c10 tx=0x7f01f00b9040 comp rx=0 tx=0).stop 2024-09-18T02:06:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 msgr2=0x55c5fe027730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fb82e640 1 -- 172.21.15.167:0/1330613311 reap_dead start 2024-09-18T02:06:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe027730 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00cd50 tx=0x7f01ec02f3e0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 shutdown_connections 2024-09-18T02:06:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1330613311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe020570 0x55c5fe027730 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 >> 172.21.15.167:0/1330613311 conn(0x55c5fe01c950 msgr2=0x55c5fe01aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 shutdown_connections 2024-09-18T02:06:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1330613311 wait complete. 2024-09-18T02:06:07.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1261866920 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00d4034650 msgr2=0x7f00d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1261866920 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00d4034650 0x7f00d4036b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55c5fdffd880 tx=0x7f01f0005a10 comp rx=0 tx=0).stop 2024-09-18T02:06:07.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1261866920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe013c40 msgr2=0x55c5fe014060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1261866920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe013c40 0x55c5fe014060 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00d010 tx=0x7f01ec018700 comp rx=0 tx=0).stop 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1261866920 shutdown_connections 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1261866920 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00d4034650 0x7f00d4036b10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/1261866920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fe013c40 0x55c5fe014060 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1261866920 >> 172.21.15.167:0/1261866920 conn(0x55c5fe008d90 msgr2=0x55c5fe00b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1261866920 shutdown_connections 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/1261866920 wait complete. 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5fdfff700 msgr2=0x55c5fe001af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55c5fdfff700 0x55c5fe001af0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5fdf07a90 msgr2=0x55c5fdffcd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55c5fdf07a90 0x55c5fdffcd40 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5fe003640 msgr2=0x55c5fe005a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55c5fe003640 0x55c5fe005a30 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00e0034650 msgr2=0x7f00e0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f00e0034650 0x7f00e0036b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f01f00ad000 tx=0x7f01f00a5040 comp rx=0 tx=0).stop 2024-09-18T02:06:07.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 msgr2=0x55c5fdff5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 --2- 172.21.15.167:0/2629135375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5fde782e0 0x55c5fdff5db0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f01ec001e20 tx=0x7f01ec000ee0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fb82e640 1 -- 172.21.15.167:0/2629135375 reap_dead start 2024-09-18T02:06:07.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 shutdown_connections 2024-09-18T02:06:07.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 >> 172.21.15.167:0/2629135375 conn(0x55c5fdefe0a0 msgr2=0x55c5fdfe9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 shutdown_connections 2024-09-18T02:06:07.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.007+0000 7f01fd51d980 1 -- 172.21.15.167:0/2629135375 wait complete. 2024-09-18T02:06:07.029 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T02:06:07.029 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T02:06:07.029 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T02:06:07.109 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:07.109 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:07.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.107+0000 7f7d1f308980 1 Processor -- start 2024-09-18T02:06:07.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.107+0000 7f7d1f308980 1 -- start start 2024-09-18T02:06:07.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.107+0000 7f7d1f308980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5624cff9db90 0x5624cff9c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.107+0000 7f7d1f308980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5624cfeafae0 con 0x5624cff9dfa0 2024-09-18T02:06:07.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.107+0000 7f7d1f308980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x5624cfed3e30 con 0x5624cff9db90 2024-09-18T02:06:07.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.107+0000 7f7d1ce18640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5624cff9db90 0x5624cff9c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.107+0000 7f7d1c617640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5624cff9dfa0 0x5624cff9c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33786/0 (socket says 172.21.15.167:33786) 2024-09-18T02:06:07.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.107+0000 7f7d1c617640 1 -- 172.21.15.167:0/1462879825 learned_addr learned my addr 172.21.15.167:0/1462879825 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:07.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.107+0000 7f7d1ce18640 1 -- 172.21.15.167:0/1462879825 >> v1:172.21.15.81:6789/0 conn(0x5624cff9dfa0 legacy=0x5624cff9c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.107+0000 7f7d1ce18640 1 -- 172.21.15.167:0/1462879825 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624cff9d0c0 con 0x5624cff9db90 2024-09-18T02:06:07.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.111+0000 7f7d1ce18640 1 --2- 172.21.15.167:0/1462879825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9db90 0x5624cff9c350 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00a480 tx=0x7f7d0c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d0bfee4a8f9408 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.111+0000 7f7d1be16640 1 -- 172.21.15.167:0/1462879825 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0b0070 con 0x5624cff9db90 2024-09-18T02:06:07.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.111+0000 7f7d1be16640 1 -- 172.21.15.167:0/1462879825 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0ab540 con 0x5624cff9db90 2024-09-18T02:06:07.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.111+0000 7f7d1be16640 1 -- 172.21.15.167:0/1462879825 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0ab840 con 0x5624cff9db90 2024-09-18T02:06:07.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.111+0000 7f7d1f308980 1 -- 172.21.15.167:0/1462879825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9db90 msgr2=0x5624cff9c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.111+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1462879825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9db90 0x5624cff9c350 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00a480 tx=0x7f7d0c01b280 comp rx=0 tx=0).stop 2024-09-18T02:06:07.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.111+0000 7f7d1f308980 1 -- 172.21.15.167:0/1462879825 shutdown_connections 2024-09-18T02:06:07.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.111+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1462879825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9db90 0x5624cff9c350 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.111+0000 7f7d1f308980 1 -- 172.21.15.167:0/1462879825 >> 172.21.15.167:0/1462879825 conn(0x5624d0023170 msgr2=0x5624d0025590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.111+0000 7f7d1f308980 1 -- 172.21.15.167:0/1462879825 shutdown_connections 2024-09-18T02:06:07.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.111+0000 7f7d1f308980 1 -- 172.21.15.167:0/1462879825 wait complete. 2024-09-18T02:06:07.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.127+0000 7f7d1f308980 1 Processor -- start 2024-09-18T02:06:07.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.127+0000 7f7d1f308980 1 -- start start 2024-09-18T02:06:07.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.127+0000 7f7d1f308980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9db90 0x5624d0114c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.127+0000 7f7d1f308980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5624cfed5200 con 0x5624cff9db90 2024-09-18T02:06:07.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.127+0000 7f7d1ce18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9db90 0x5624d0114c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.127+0000 7f7d1ce18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9db90 0x5624d0114c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50000/0 (socket says 172.21.15.167:50000) 2024-09-18T02:06:07.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.127+0000 7f7d1ce18640 1 -- 172.21.15.167:0/360044945 learned_addr learned my addr 172.21.15.167:0/360044945 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.127+0000 7f7d1ce18640 1 -- 172.21.15.167:0/360044945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624d0115220 con 0x5624cff9db90 2024-09-18T02:06:07.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1ce18640 1 --2- 172.21.15.167:0/360044945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9db90 0x5624d0114c50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c017e90 tx=0x7f7d0c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a9c84cc494bc23 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7c0ae0d640 1 -- 172.21.15.167:0/360044945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0b0040 con 0x5624cff9db90 2024-09-18T02:06:07.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7c0ae0d640 1 -- 172.21.15.167:0/360044945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0ab9d0 con 0x5624cff9db90 2024-09-18T02:06:07.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7c0ae0d640 1 -- 172.21.15.167:0/360044945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0abcf0 con 0x5624cff9db90 2024-09-18T02:06:07.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 -- 172.21.15.167:0/360044945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9db90 msgr2=0x5624d0114c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 --2- 172.21.15.167:0/360044945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9db90 0x5624d0114c50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c017e90 tx=0x7f7d0c003030 comp rx=0 tx=0).stop 2024-09-18T02:06:07.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 -- 172.21.15.167:0/360044945 shutdown_connections 2024-09-18T02:06:07.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 --2- 172.21.15.167:0/360044945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9db90 0x5624d0114c50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 -- 172.21.15.167:0/360044945 >> 172.21.15.167:0/360044945 conn(0x5624d0023170 msgr2=0x5624d0110880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 -- 172.21.15.167:0/360044945 shutdown_connections 2024-09-18T02:06:07.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 -- 172.21.15.167:0/360044945 wait complete. 2024-09-18T02:06:07.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 Processor -- start 2024-09-18T02:06:07.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 -- start start 2024-09-18T02:06:07.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9dfa0 0x5624d011c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.135 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5624d00331c0 con 0x5624cff9dfa0 2024-09-18T02:06:07.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1ce18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9dfa0 0x5624d011c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1ce18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9dfa0 0x5624d011c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50006/0 (socket says 172.21.15.167:50006) 2024-09-18T02:06:07.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1ce18640 1 -- 172.21.15.167:0/1918543443 learned_addr learned my addr 172.21.15.167:0/1918543443 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1ce18640 1 -- 172.21.15.167:0/1918543443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624d011c670 con 0x5624cff9dfa0 2024-09-18T02:06:07.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1ce18640 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9dfa0 0x5624d011c130 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c019930 tx=0x7f7d0c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7c0960a640 1 -- 172.21.15.167:0/1918543443 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0b0070 con 0x5624cff9dfa0 2024-09-18T02:06:07.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624d011c900 con 0x5624cff9dfa0 2024-09-18T02:06:07.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624d011f5e0 con 0x5624cff9dfa0 2024-09-18T02:06:07.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7c0960a640 1 -- 172.21.15.167:0/1918543443 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0b6b80 con 0x5624cff9dfa0 2024-09-18T02:06:07.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.131+0000 7f7c0960a640 1 -- 172.21.15.167:0/1918543443 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0cd060 con 0x5624cff9dfa0 2024-09-18T02:06:07.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7c0960a640 1 -- 172.21.15.167:0/1918543443 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7d0c0c8480 con 0x5624cff9dfa0 2024-09-18T02:06:07.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7c0960a640 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7c040346f0 0x7f7c04036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7c0960a640 1 -- 172.21.15.167:0/1918543443 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7d0c0a8070 con 0x5624cff9dfa0 2024-09-18T02:06:07.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1c617640 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7c040346f0 0x7f7c04036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5624d0121220 0x5624d0123610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d0123b50 con 0x5624d0121220 2024-09-18T02:06:07.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1d619640 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5624d0121220 0x5624d0123610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1c617640 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7c040346f0 0x7f7c04036bb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7d100012f0 tx=0x7f7d10006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1d619640 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5624d0121220 0x5624d0123610 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1d619640 1 -- 172.21.15.167:0/1918543443 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d140083f0 con 0x5624d0121220 2024-09-18T02:06:07.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d0123f80 con 0x5624d0121220 2024-09-18T02:06:07.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1d619640 1 -- 172.21.15.167:0/1918543443 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d140083f0 con 0x5624d0121220 2024-09-18T02:06:07.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5624d0125d90 0x5624d0128180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d0128870 con 0x5624d0125d90 2024-09-18T02:06:07.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1ce18640 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5624d0125d90 0x5624d0128180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.135+0000 7f7d1ce18640 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5624d0125d90 0x5624d0128180 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1ce18640 1 -- 172.21.15.167:0/1918543443 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d0c0b3040 con 0x5624d0125d90 2024-09-18T02:06:07.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d0124c30 con 0x5624d0121220 2024-09-18T02:06:07.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1d619640 1 -- 172.21.15.167:0/1918543443 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d140083f0 con 0x5624d0121220 2024-09-18T02:06:07.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5624d0129cd0 0x5624d012c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d012c800 con 0x5624d0129cd0 2024-09-18T02:06:07.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1c617640 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5624d0129cd0 0x5624d012c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1c617640 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5624d0129cd0 0x5624d012c0c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1c617640 1 -- 172.21.15.167:0/1918543443 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0129cd0 2024-09-18T02:06:07.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1f308980 1 Processor -- start 2024-09-18T02:06:07.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1f308980 1 -- start start 2024-09-18T02:06:07.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1f308980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d013a2d0 0x5624d013a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1f308980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5624cff2e800 con 0x5624d013a2d0 2024-09-18T02:06:07.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1ce18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d013a2d0 0x5624d013a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1ce18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d013a2d0 0x5624d013a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50018/0 (socket says 172.21.15.167:50018) 2024-09-18T02:06:07.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.139+0000 7f7d1ce18640 1 -- 172.21.15.167:0/2370706220 learned_addr learned my addr 172.21.15.167:0/2370706220 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1ce18640 1 -- 172.21.15.167:0/2370706220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624d013ac30 con 0x5624d013a2d0 2024-09-18T02:06:07.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1ce18640 1 --2- 172.21.15.167:0/2370706220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d013a2d0 0x5624d013a6f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0ab510 tx=0x7f7d0c0d14c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7c027fc640 1 -- 172.21.15.167:0/2370706220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0e8070 con 0x5624d013a2d0 2024-09-18T02:06:07.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7c027fc640 1 -- 172.21.15.167:0/2370706220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0aabd0 con 0x5624d013a2d0 2024-09-18T02:06:07.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1f308980 1 -- 172.21.15.167:0/2370706220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624d013ae60 con 0x5624d013a2d0 2024-09-18T02:06:07.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7c027fc640 1 -- 172.21.15.167:0/2370706220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0c6720 con 0x5624d013a2d0 2024-09-18T02:06:07.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1f308980 1 -- 172.21.15.167:0/2370706220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624d013dae0 con 0x5624d013a2d0 2024-09-18T02:06:07.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7c027fc640 1 -- 172.21.15.167:0/2370706220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7d0c0eb070 con 0x5624d013a2d0 2024-09-18T02:06:07.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7c027fc640 1 --2- 172.21.15.167:0/2370706220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7bf4034650 0x7f7bf4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7c027fc640 1 -- 172.21.15.167:0/2370706220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7d0c0eec00 con 0x5624d013a2d0 2024-09-18T02:06:07.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1c617640 1 --2- 172.21.15.167:0/2370706220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7bf4034650 0x7f7bf4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1f308980 1 Processor -- start 2024-09-18T02:06:07.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1f308980 1 -- start start 2024-09-18T02:06:07.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1c617640 1 --2- 172.21.15.167:0/2370706220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7bf4034650 0x7f7bf4036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7d100062e0 tx=0x7f7d1000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1f308980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d0146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1f308980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5624d01155a0 con 0x5624d0146bb0 2024-09-18T02:06:07.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1ce18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d0146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1ce18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d0146fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50032/0 (socket says 172.21.15.167:50032) 2024-09-18T02:06:07.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1ce18640 1 -- 172.21.15.167:0/1463850878 learned_addr learned my addr 172.21.15.167:0/1463850878 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.143+0000 7f7d1ce18640 1 -- 172.21.15.167:0/1463850878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624d0147580 con 0x5624d0146bb0 2024-09-18T02:06:07.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1ce18640 1 --2- 172.21.15.167:0/1463850878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d0146fb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0d1a10 tx=0x7f7d0c0d5fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5643de21aa846c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7bf3fff640 1 -- 172.21.15.167:0/1463850878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0c88a0 con 0x5624d0146bb0 2024-09-18T02:06:07.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7bf3fff640 1 -- 172.21.15.167:0/1463850878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0d1a80 con 0x5624d0146bb0 2024-09-18T02:06:07.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7bf3fff640 1 -- 172.21.15.167:0/1463850878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0c68c0 con 0x5624d0146bb0 2024-09-18T02:06:07.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 -- 172.21.15.167:0/1463850878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 msgr2=0x5624d0146fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1463850878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d0146fb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0d1a10 tx=0x7f7d0c0d5fd0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 -- 172.21.15.167:0/1463850878 shutdown_connections 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1463850878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d0146fb0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 -- 172.21.15.167:0/1463850878 >> 172.21.15.167:0/1463850878 conn(0x5624d0142f90 msgr2=0x5624d0141090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 -- 172.21.15.167:0/1463850878 shutdown_connections 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 -- 172.21.15.167:0/1463850878 wait complete. 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 Processor -- start 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 -- start start 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d014dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5624d0147580 con 0x5624d0146bb0 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1ce18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d014dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1ce18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d014dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50048/0 (socket says 172.21.15.167:50048) 2024-09-18T02:06:07.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 learned_addr learned my addr 172.21.15.167:0/3256067066 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624d014e1f0 con 0x5624d0146bb0 2024-09-18T02:06:07.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1ce18640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d014dcb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0d2df0 tx=0x7f7d0c0bbfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7bf27fc640 1 -- 172.21.15.167:0/3256067066 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0d2a10 con 0x5624d0146bb0 2024-09-18T02:06:07.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7bf27fc640 1 -- 172.21.15.167:0/3256067066 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0e4370 con 0x5624d0146bb0 2024-09-18T02:06:07.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624d014e1f0 con 0x5624d0146bb0 2024-09-18T02:06:07.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7bf27fc640 1 -- 172.21.15.167:0/3256067066 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c0e4650 con 0x5624d0146bb0 2024-09-18T02:06:07.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.147+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624d014e1f0 con 0x5624d0146bb0 2024-09-18T02:06:07.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7bf27fc640 1 -- 172.21.15.167:0/3256067066 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7d0c0e47f0 con 0x5624d0146bb0 2024-09-18T02:06:07.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7bf27fc640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7be8034650 0x7f7be8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7bf27fc640 1 -- 172.21.15.167:0/3256067066 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7d0c109070 con 0x5624d0146bb0 2024-09-18T02:06:07.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1c617640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7be8034650 0x7f7be8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5624d0158bb0 0x5624d015b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d015b7a0 con 0x5624d0158bb0 2024-09-18T02:06:07.156 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1d619640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5624d0158bb0 0x5624d015b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1c617640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7be8034650 0x7f7be8036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5624d0128c40 tx=0x7f7d10010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1d619640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5624d0158bb0 0x5624d015b050 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d140083f0 con 0x5624d0158bb0 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 20 realm 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d015bbb0 con 0x5624d0158bb0 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d140083f0 con 0x5624d0158bb0 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c450 con 0x5624d0158bb0 2024-09-18T02:06:07.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d140083f0 con 0x5624d0158bb0 2024-09-18T02:06:07.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:07.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0158bb0 2024-09-18T02:06:07.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d140083f0 con 0x5624d0158bb0 2024-09-18T02:06:07.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:07.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5624d015d550 0x5624d015f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d015fec0 con 0x5624d015d550 2024-09-18T02:06:07.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1ce18640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5624d015d550 0x5624d015f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.151+0000 7f7d1ce18640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5624d015d550 0x5624d015f940 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1f308980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:07.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1f308980 20 searching for the correct realm 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1f308980 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5624d0161df0 0x5624d0164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d0164950 con 0x5624d0161df0 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1c617640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5624d0161df0 0x5624d0164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1c617640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5624d0161df0 0x5624d0164280 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1c617640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7d10024070 0x7f7d10031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d0164950 con 0x7f7d10024070 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7d10024070 0x7f7d10031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7d10024070 0x7f7d10031970 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d140083f0 con 0x7f7d10024070 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x7f7d10024070 2024-09-18T02:06:07.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d140083f0 con 0x7f7d10024070 2024-09-18T02:06:07.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0158bb0 2024-09-18T02:06:07.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0158bb0 2024-09-18T02:06:07.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0158bb0 2024-09-18T02:06:07.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.155+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d015d550 2024-09-18T02:06:07.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x7f7d10024070 2024-09-18T02:06:07.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0161df0 2024-09-18T02:06:07.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0158bb0 2024-09-18T02:06:07.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x7f7d10024070 2024-09-18T02:06:07.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0158bb0 2024-09-18T02:06:07.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x7f7d10024070 2024-09-18T02:06:07.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0161df0 2024-09-18T02:06:07.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0161df0 2024-09-18T02:06:07.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d015d550 2024-09-18T02:06:07.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0161df0 2024-09-18T02:06:07.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.159+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0161df0 2024-09-18T02:06:07.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0158bb0 2024-09-18T02:06:07.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0158bb0 2024-09-18T02:06:07.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d015d550 2024-09-18T02:06:07.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0161df0 2024-09-18T02:06:07.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x7f7d10024070 2024-09-18T02:06:07.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0158bb0 2024-09-18T02:06:07.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d015d550 2024-09-18T02:06:07.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0161df0 2024-09-18T02:06:07.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.163+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d015d550 2024-09-18T02:06:07.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x7f7d10024070 2024-09-18T02:06:07.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0161df0 2024-09-18T02:06:07.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d015d550 2024-09-18T02:06:07.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x5624d0158bb0 2024-09-18T02:06:07.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5624d015c7f0 con 0x7f7d10024070 2024-09-18T02:06:07.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:07.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:07.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:07.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:07.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:07.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:07.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d0160710 con 0x5624d0158bb0 2024-09-18T02:06:07.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:07.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d0160710 con 0x5624d0158bb0 2024-09-18T02:06:07.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:07.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d0160710 con 0x5624d0161df0 2024-09-18T02:06:07.178 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:07.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 zone default found 2024-09-18T02:06:07.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 4 Realm: () 2024-09-18T02:06:07.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:07.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:07.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:07.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 zonegroup default 2024-09-18T02:06:07.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.167+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d0160fb0 con 0x5624d015d550 2024-09-18T02:06:07.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:07.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d01667b0 con 0x5624d0161df0 2024-09-18T02:06:07.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:07.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d0166b50 con 0x5624d0161df0 2024-09-18T02:06:07.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:07.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 20 started sync module instance, tier type = 2024-09-18T02:06:07.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:07.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0165c50 con 0x7f7d10024070 2024-09-18T02:06:07.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94716109939056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0165c50 con 0x7f7d10024070 2024-09-18T02:06:07.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0167510 con 0x5624d0158bb0 2024-09-18T02:06:07.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.171+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94716109939056] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.175+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.175+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94716109943152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0165c50 con 0x5624d0158bb0 2024-09-18T02:06:07.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.175+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0167f20 con 0x5624d0161df0 2024-09-18T02:06:07.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.175+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94716109943152] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.175+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.175+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94716109936544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0165bc0 con 0x5624d0161df0 2024-09-18T02:06:07.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.175+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0168cd0 con 0x7f7d10024070 2024-09-18T02:06:07.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.179+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.179+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94716109948864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0169570 con 0x7f7d10024070 2024-09-18T02:06:07.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.179+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0169f70 con 0x5624d0158bb0 2024-09-18T02:06:07.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.179+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94716109948864] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.179+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94716109936544] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.179+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.179+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94716109947664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0169040 con 0x5624d0158bb0 2024-09-18T02:06:07.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.179+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d016a810 con 0x5624d015d550 2024-09-18T02:06:07.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.183+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94716109947664] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.183+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.183+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94716109955936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0169040 con 0x5624d015d550 2024-09-18T02:06:07.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.183+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d016b060 con 0x5624d015d550 2024-09-18T02:06:07.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.183+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.183+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94716109955936] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.183+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94716109960192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d016b820 con 0x5624d015d550 2024-09-18T02:06:07.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.183+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d016c1e0 con 0x5624d015d550 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94716109960192] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94716109962544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d016c600 con 0x5624d015d550 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1f308980 20 add_watcher() i=0 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1f308980 20 add_watcher() i=1 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1f308980 20 add_watcher() i=2 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1f308980 20 add_watcher() i=3 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1f308980 20 add_watcher() i=4 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1f308980 20 add_watcher() i=5 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1f308980 20 add_watcher() i=6 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94716109962544] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1f308980 20 add_watcher() i=7 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1f308980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.187+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d016f8a0 con 0x5624d0158bb0 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94716109963968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d016cb90 con 0x5624d0158bb0 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94716109963968] v32'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7bd2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1f308980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1f308980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1f308980 5 note: GC not initialized 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7bd1fe3640 20 reqs_thread_entry: start 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1f308980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1f308980 20 Filter name: none 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7b437fe640 20 reqs_thread_entry: start 2024-09-18T02:06:07.198 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1f308980 20 rados->read ofs=0 len=0 2024-09-18T02:06:07.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5624d0192b30 con 0x5624d0158bb0 2024-09-18T02:06:07.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.191+0000 7f7d1f308980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:07.199 INFO:teuthology.orchestra.run.smithi167.stderr:could not fetch user info: no user info saved 2024-09-18T02:06:07.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.195+0000 7f7bd2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:07.199 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.195+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94716109963968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0192af0 con 0x5624d0158bb0 2024-09-18T02:06:07.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.195+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94716109963968] v32'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.195+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94716109939056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0192af0 con 0x7f7d10024070 2024-09-18T02:06:07.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.195+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94716109939056] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.195+0000 7f7d1f308980 20 remove_watcher() i=0 2024-09-18T02:06:07.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.195+0000 7f7d1f308980 2 removed watcher, disabling cache 2024-09-18T02:06:07.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.195+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94716109943152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0192af0 con 0x5624d0158bb0 2024-09-18T02:06:07.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.199+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94716109943152] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.199+0000 7f7d1f308980 20 remove_watcher() i=1 2024-09-18T02:06:07.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.199+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94716109936544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0192af0 con 0x5624d0161df0 2024-09-18T02:06:07.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.199+0000 7f7d1c617640 1 -- 172.21.15.167:0/3256067066 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94716109936544] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1000f070 con 0x5624d0161df0 2024-09-18T02:06:07.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.199+0000 7f7d1f308980 20 remove_watcher() i=2 2024-09-18T02:06:07.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.199+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94716109948864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0167170 con 0x7f7d10024070 2024-09-18T02:06:07.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.203+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94716109948864] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x7f7d10024070 2024-09-18T02:06:07.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.203+0000 7f7d1f308980 20 remove_watcher() i=3 2024-09-18T02:06:07.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.203+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94716109947664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d01657a0 con 0x5624d0158bb0 2024-09-18T02:06:07.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.203+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94716109947664] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14026040 con 0x5624d0158bb0 2024-09-18T02:06:07.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.203+0000 7f7d1f308980 20 remove_watcher() i=4 2024-09-18T02:06:07.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.203+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94716109955936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d01687c0 con 0x5624d015d550 2024-09-18T02:06:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.207+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94716109955936] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.207+0000 7f7d1f308980 20 remove_watcher() i=5 2024-09-18T02:06:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.207+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94716109960192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0167170 con 0x5624d015d550 2024-09-18T02:06:07.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.207+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94716109960192] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.207+0000 7f7d1f308980 20 remove_watcher() i=6 2024-09-18T02:06:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.207+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94716109962544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5624d0168310 con 0x5624d015d550 2024-09-18T02:06:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1ce18640 1 -- 172.21.15.167:0/3256067066 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94716109962544] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d0c112020 con 0x5624d015d550 2024-09-18T02:06:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 20 remove_watcher() i=7 2024-09-18T02:06:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5624d015d550 msgr2=0x5624d015f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5624d015d550 0x5624d015f940 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5624d0158bb0 msgr2=0x5624d015b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5624d0158bb0 0x5624d015b050 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7d10024070 msgr2=0x7f7d10031970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f7d10024070 0x7f7d10031970 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5624d0161df0 msgr2=0x5624d0164280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5624d0161df0 0x5624d0164280 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7be8034650 msgr2=0x7f7be8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7be8034650 0x7f7be8036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5624d0128c40 tx=0x7f7d10010000 comp rx=0 tx=0).stop 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 msgr2=0x5624d014dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1d619640 1 -- 172.21.15.167:0/3256067066 reap_dead start 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d014dcb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0d2df0 tx=0x7f7d0c0bbfa0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 shutdown_connections 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/3256067066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d0146bb0 0x5624d014dcb0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 >> 172.21.15.167:0/3256067066 conn(0x5624d0142f90 msgr2=0x5624d0141060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 shutdown_connections 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/3256067066 wait complete. 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/2370706220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7bf4034650 msgr2=0x7f7bf4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/2370706220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7bf4034650 0x7f7bf4036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7d100062e0 tx=0x7f7d1000f000 comp rx=0 tx=0).stop 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/2370706220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d013a2d0 msgr2=0x5624d013a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/2370706220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d013a2d0 0x5624d013a6f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0ab510 tx=0x7f7d0c0d14c0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/2370706220 shutdown_connections 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/2370706220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7bf4034650 0x7f7bf4036b10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/2370706220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624d013a2d0 0x5624d013a6f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/2370706220 >> 172.21.15.167:0/2370706220 conn(0x5624d012f420 msgr2=0x5624d0131ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/2370706220 shutdown_connections 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/2370706220 wait complete. 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5624d0125d90 msgr2=0x5624d0128180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5624d0125d90 0x5624d0128180 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5624d0121220 msgr2=0x5624d0123610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5624d0121220 0x5624d0123610 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5624d0129cd0 msgr2=0x5624d012c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5624d0129cd0 0x5624d012c0c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7c040346f0 msgr2=0x7f7c04036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7c040346f0 0x7f7c04036bb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7d100012f0 tx=0x7f7d10006700 comp rx=0 tx=0).stop 2024-09-18T02:06:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9dfa0 msgr2=0x5624d011c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 --2- 172.21.15.167:0/1918543443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624cff9dfa0 0x5624d011c130 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c019930 tx=0x7f7d0c018020 comp rx=0 tx=0).stop 2024-09-18T02:06:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1d619640 1 -- 172.21.15.167:0/1918543443 reap_dead start 2024-09-18T02:06:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 shutdown_connections 2024-09-18T02:06:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.211+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 >> 172.21.15.167:0/1918543443 conn(0x5624d0023170 msgr2=0x5624d010f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.215+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 shutdown_connections 2024-09-18T02:06:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.215+0000 7f7d1f308980 1 -- 172.21.15.167:0/1918543443 wait complete. 2024-09-18T02:06:07.227 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T02:06:07.227 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-18T02:06:07.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-18T02:06:07.228 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-18T02:06:07.300 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:07.300 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:07.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.299+0000 7f68a079e980 1 Processor -- start 2024-09-18T02:06:07.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.299+0000 7f68a079e980 1 -- start start 2024-09-18T02:06:07.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.299+0000 7f68a079e980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55bc434ad3e0 0x55bc4353b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.299+0000 7f68a079e980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bc433c0ae0 con 0x55bc4353b900 2024-09-18T02:06:07.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.299+0000 7f68a079e980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55bc433e4e30 con 0x55bc434ad3e0 2024-09-18T02:06:07.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.299+0000 7f689e2ae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55bc434ad3e0 0x55bc4353b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.299+0000 7f689daad640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55bc4353b900 0x55bc4353dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33796/0 (socket says 172.21.15.167:33796) 2024-09-18T02:06:07.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.299+0000 7f689daad640 1 -- 172.21.15.167:0/2203952604 learned_addr learned my addr 172.21.15.167:0/2203952604 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:07.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.299+0000 7f689e2ae640 1 -- 172.21.15.167:0/2203952604 >> v1:172.21.15.81:6789/0 conn(0x55bc4353b900 legacy=0x55bc4353dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.299+0000 7f689e2ae640 1 -- 172.21.15.167:0/2203952604 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc434ad970 con 0x55bc434ad3e0 2024-09-18T02:06:07.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.303+0000 7f689e2ae640 1 --2- 172.21.15.167:0/2203952604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc4353b3c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f689000a420 tx=0x7f689001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363879b8929d53bf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.303+0000 7f689d2ac640 1 -- 172.21.15.167:0/2203952604 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68900af070 con 0x55bc434ad3e0 2024-09-18T02:06:07.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.303+0000 7f689d2ac640 1 -- 172.21.15.167:0/2203952604 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68900aa530 con 0x55bc434ad3e0 2024-09-18T02:06:07.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.303+0000 7f689d2ac640 1 -- 172.21.15.167:0/2203952604 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68900aa850 con 0x55bc434ad3e0 2024-09-18T02:06:07.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.303+0000 7f68a079e980 1 -- 172.21.15.167:0/2203952604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 msgr2=0x55bc4353b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.303+0000 7f68a079e980 1 --2- 172.21.15.167:0/2203952604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc4353b3c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f689000a420 tx=0x7f689001afd0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.303+0000 7f68a079e980 1 -- 172.21.15.167:0/2203952604 shutdown_connections 2024-09-18T02:06:07.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.303+0000 7f68a079e980 1 --2- 172.21.15.167:0/2203952604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc4353b3c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.303+0000 7f68a079e980 1 -- 172.21.15.167:0/2203952604 >> 172.21.15.167:0/2203952604 conn(0x55bc435330b0 msgr2=0x55bc435354d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.303+0000 7f68a079e980 1 -- 172.21.15.167:0/2203952604 shutdown_connections 2024-09-18T02:06:07.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.303+0000 7f68a079e980 1 -- 172.21.15.167:0/2203952604 wait complete. 2024-09-18T02:06:07.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f68a079e980 1 Processor -- start 2024-09-18T02:06:07.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f68a079e980 1 -- start start 2024-09-18T02:06:07.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f68a079e980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc43623a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.322 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f68a079e980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bc433e6200 con 0x55bc434ad3e0 2024-09-18T02:06:07.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f689e2ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc43623a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f689e2ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc43623a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50072/0 (socket says 172.21.15.167:50072) 2024-09-18T02:06:07.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f689e2ae640 1 -- 172.21.15.167:0/1915446446 learned_addr learned my addr 172.21.15.167:0/1915446446 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f689e2ae640 1 -- 172.21.15.167:0/1915446446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc43624060 con 0x55bc434ad3e0 2024-09-18T02:06:07.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f689e2ae640 1 --2- 172.21.15.167:0/1915446446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc43623a90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f68900ad040 tx=0x7f68900033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e77e21a8773d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f678c608640 1 -- 172.21.15.167:0/1915446446 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68900af050 con 0x55bc434ad3e0 2024-09-18T02:06:07.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f678c608640 1 -- 172.21.15.167:0/1915446446 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68900b0040 con 0x55bc434ad3e0 2024-09-18T02:06:07.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.319+0000 7f678c608640 1 -- 172.21.15.167:0/1915446446 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68900aaca0 con 0x55bc434ad3e0 2024-09-18T02:06:07.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 -- 172.21.15.167:0/1915446446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 msgr2=0x55bc43623a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 --2- 172.21.15.167:0/1915446446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc43623a90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f68900ad040 tx=0x7f68900033b0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 -- 172.21.15.167:0/1915446446 shutdown_connections 2024-09-18T02:06:07.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 --2- 172.21.15.167:0/1915446446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc43623a90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 -- 172.21.15.167:0/1915446446 >> 172.21.15.167:0/1915446446 conn(0x55bc435330b0 msgr2=0x55bc4361f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 -- 172.21.15.167:0/1915446446 shutdown_connections 2024-09-18T02:06:07.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 -- 172.21.15.167:0/1915446446 wait complete. 2024-09-18T02:06:07.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 Processor -- start 2024-09-18T02:06:07.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 -- start start 2024-09-18T02:06:07.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc4362ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bc4353ff20 con 0x55bc434ad3e0 2024-09-18T02:06:07.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f689e2ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc4362ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f689e2ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc4362ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50082/0 (socket says 172.21.15.167:50082) 2024-09-18T02:06:07.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f689e2ae640 1 -- 172.21.15.167:0/1477305677 learned_addr learned my addr 172.21.15.167:0/1477305677 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f689e2ae640 1 -- 172.21.15.167:0/1477305677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc4362b280 con 0x55bc434ad3e0 2024-09-18T02:06:07.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f689e2ae640 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc4362ad40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6890019680 tx=0x7f6890019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f678ae05640 1 -- 172.21.15.167:0/1477305677 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68900c5070 con 0x55bc434ad3e0 2024-09-18T02:06:07.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f678ae05640 1 -- 172.21.15.167:0/1477305677 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68900b6d60 con 0x55bc434ad3e0 2024-09-18T02:06:07.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc4362b510 con 0x55bc434ad3e0 2024-09-18T02:06:07.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f678ae05640 1 -- 172.21.15.167:0/1477305677 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68900c15f0 con 0x55bc434ad3e0 2024-09-18T02:06:07.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc4362e1f0 con 0x55bc434ad3e0 2024-09-18T02:06:07.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 Processor -- start 2024-09-18T02:06:07.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.323+0000 7f68a079e980 1 -- start start 2024-09-18T02:06:07.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43537390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bc4343f800 con 0x55bc43538e10 2024-09-18T02:06:07.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f678ae05640 1 -- 172.21.15.167:0/1477305677 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f68900c8070 con 0x55bc434ad3e0 2024-09-18T02:06:07.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689eaaf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43537390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689eaaf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43537390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50084/0 (socket says 172.21.15.167:50084) 2024-09-18T02:06:07.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689eaaf640 1 -- 172.21.15.167:0/3733353399 learned_addr learned my addr 172.21.15.167:0/3733353399 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f678ae05640 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6784034650 0x7f6784036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f678ae05640 1 -- 172.21.15.167:0/1477305677 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f68900bb070 con 0x55bc434ad3e0 2024-09-18T02:06:07.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689e2ae640 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6784034650 0x7f6784036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689eaaf640 1 -- 172.21.15.167:0/3733353399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc435378d0 con 0x55bc43538e10 2024-09-18T02:06:07.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689e2ae640 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6784034650 0x7f6784036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f68900e51b0 tx=0x7f68900a3b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689eaaf640 1 --2- 172.21.15.167:0/3733353399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43537390 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f689800a440 tx=0x7f689800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36a01c5bb8fec86 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f6788e01640 1 -- 172.21.15.167:0/3733353399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6898008850 con 0x55bc43538e10 2024-09-18T02:06:07.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f6788e01640 1 -- 172.21.15.167:0/3733353399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6898008a10 con 0x55bc43538e10 2024-09-18T02:06:07.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f6788e01640 1 -- 172.21.15.167:0/3733353399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6898008d30 con 0x55bc43538e10 2024-09-18T02:06:07.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 -- 172.21.15.167:0/3733353399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 msgr2=0x55bc43537390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 --2- 172.21.15.167:0/3733353399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43537390 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f689800a440 tx=0x7f689800a900 comp rx=0 tx=0).stop 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 -- 172.21.15.167:0/3733353399 shutdown_connections 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 --2- 172.21.15.167:0/3733353399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43537390 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 -- 172.21.15.167:0/3733353399 >> 172.21.15.167:0/3733353399 conn(0x55bc4353b900 msgr2=0x55bc43633410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 -- 172.21.15.167:0/3733353399 shutdown_connections 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 -- 172.21.15.167:0/3733353399 wait complete. 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 Processor -- start 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 -- start start 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43641060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f68a079e980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bc43537b90 con 0x55bc43538e10 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689eaaf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43641060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689eaaf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43641060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50098/0 (socket says 172.21.15.167:50098) 2024-09-18T02:06:07.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689eaaf640 1 -- 172.21.15.167:0/3404271841 learned_addr learned my addr 172.21.15.167:0/3404271841 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689eaaf640 1 -- 172.21.15.167:0/3404271841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc436415a0 con 0x55bc43538e10 2024-09-18T02:06:07.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.327+0000 7f689eaaf640 1 --2- 172.21.15.167:0/3404271841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43641060 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6898010000 tx=0x7f6898003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f6782ffd640 1 -- 172.21.15.167:0/3404271841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6898013a70 con 0x55bc43538e10 2024-09-18T02:06:07.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f6782ffd640 1 -- 172.21.15.167:0/3404271841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6898023070 con 0x55bc43538e10 2024-09-18T02:06:07.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f6782ffd640 1 -- 172.21.15.167:0/3404271841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6898013d40 con 0x55bc43538e10 2024-09-18T02:06:07.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f68a079e980 1 -- 172.21.15.167:0/3404271841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc43641830 con 0x55bc43538e10 2024-09-18T02:06:07.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f68a079e980 1 -- 172.21.15.167:0/3404271841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc43644510 con 0x55bc43538e10 2024-09-18T02:06:07.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f6782ffd640 1 -- 172.21.15.167:0/3404271841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6898028460 con 0x55bc43538e10 2024-09-18T02:06:07.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f68a079e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:07.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f68a079e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:07.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f6782ffd640 1 --2- 172.21.15.167:0/3404271841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6778034650 0x7f6778036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f6782ffd640 1 -- 172.21.15.167:0/3404271841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6898049ee0 con 0x55bc43538e10 2024-09-18T02:06:07.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f689daad640 1 --2- 172.21.15.167:0/3404271841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6778034650 0x7f6778036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f68a079e980 1 Processor -- start 2024-09-18T02:06:07.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f68a079e980 1 -- start start 2024-09-18T02:06:07.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f68a079e980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4365a870 0x55bc4365ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f689daad640 1 --2- 172.21.15.167:0/3404271841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6778034650 0x7f6778036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6888000f70 tx=0x7f6888001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f68a079e980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bc43624320 con 0x55bc4365a870 2024-09-18T02:06:07.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f689e2ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4365a870 0x55bc4365ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f689e2ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4365a870 0x55bc4365ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50102/0 (socket says 172.21.15.167:50102) 2024-09-18T02:06:07.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f689e2ae640 1 -- 172.21.15.167:0/2653994806 learned_addr learned my addr 172.21.15.167:0/2653994806 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f689e2ae640 1 -- 172.21.15.167:0/2653994806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc4365b260 con 0x55bc4365a870 2024-09-18T02:06:07.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.331+0000 7f689e2ae640 1 --2- 172.21.15.167:0/2653994806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4365a870 0x55bc4365ac90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f68900bcab0 tx=0x7f68900a8480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f6762fe5640 1 -- 172.21.15.167:0/2653994806 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68900ec070 con 0x55bc4365a870 2024-09-18T02:06:07.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f68a079e980 1 -- 172.21.15.167:0/2653994806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc4365dee0 con 0x55bc4365a870 2024-09-18T02:06:07.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f6762fe5640 1 -- 172.21.15.167:0/2653994806 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68900c17e0 con 0x55bc4365a870 2024-09-18T02:06:07.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f68a079e980 1 -- 172.21.15.167:0/2653994806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc4365e290 con 0x55bc4365a870 2024-09-18T02:06:07.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f6762fe5640 1 -- 172.21.15.167:0/2653994806 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68900b4400 con 0x55bc4365a870 2024-09-18T02:06:07.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f6762fe5640 1 -- 172.21.15.167:0/2653994806 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f68900ef070 con 0x55bc4365a870 2024-09-18T02:06:07.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f6762fe5640 1 --2- 172.21.15.167:0/2653994806 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f66e0034650 0x7f66e0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f6762fe5640 1 -- 172.21.15.167:0/2653994806 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f68900f2bf0 con 0x55bc4365a870 2024-09-18T02:06:07.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f689daad640 1 --2- 172.21.15.167:0/2653994806 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f66e0034650 0x7f66e0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f6760fe1640 20 reqs_thread_entry: start 2024-09-18T02:06:07.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f68a079e980 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bc43660450 0x55bc43662860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc43662f30 con 0x55bc43660450 2024-09-18T02:06:07.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f689daad640 1 --2- 172.21.15.167:0/2653994806 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f66e0034650 0x7f66e0036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55bc43633fb0 tx=0x7f688800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f689eaaf640 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bc43660450 0x55bc43662860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f689eaaf640 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bc43660450 0x55bc43662860 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f689eaaf640 1 -- 172.21.15.167:0/1477305677 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f689801e7a0 con 0x55bc43660450 2024-09-18T02:06:07.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f68a079e980 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bc43664d50 0x55bc43667140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:2 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc43667790 con 0x55bc43664d50 2024-09-18T02:06:07.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f689e2ae640 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bc43664d50 0x55bc43667140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.335+0000 7f689e2ae640 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bc43664d50 0x55bc43667140 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f689e2ae640 1 -- 172.21.15.167:0/1477305677 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(2 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f68900ee030 con 0x55bc43664d50 2024-09-18T02:06:07.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/3404271841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6778034650 msgr2=0x7f6778036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/3404271841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6778034650 0x7f6778036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6888000f70 tx=0x7f6888001240 comp rx=0 tx=0).stop 2024-09-18T02:06:07.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/3404271841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 msgr2=0x55bc43641060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/3404271841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43641060 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6898010000 tx=0x7f6898003000 comp rx=0 tx=0).stop 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/3404271841 shutdown_connections 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/3404271841 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6778034650 0x7f6778036b10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/3404271841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc43538e10 0x55bc43641060 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/3404271841 >> 172.21.15.167:0/3404271841 conn(0x55bc4353b900 msgr2=0x55bc43636240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/3404271841 shutdown_connections 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/3404271841 wait complete. 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/2653994806 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f66e0034650 msgr2=0x7f66e0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/2653994806 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f66e0034650 0x7f66e0036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55bc43633fb0 tx=0x7f688800f000 comp rx=0 tx=0).stop 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/2653994806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4365a870 msgr2=0x55bc4365ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/2653994806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4365a870 0x55bc4365ac90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f68900bcab0 tx=0x7f68900a8480 comp rx=0 tx=0).stop 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/2653994806 shutdown_connections 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/2653994806 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f66e0034650 0x7f66e0036b10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/2653994806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4365a870 0x55bc4365ac90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/2653994806 >> 172.21.15.167:0/2653994806 conn(0x55bc4364f880 msgr2=0x55bc43652210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/2653994806 shutdown_connections 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/2653994806 wait complete. 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bc43664d50 msgr2=0x55bc43667140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bc43664d50 0x55bc43667140 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bc43660450 msgr2=0x55bc43662860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bc43660450 0x55bc43662860 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6784034650 msgr2=0x7f6784036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6784034650 0x7f6784036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f68900e51b0 tx=0x7f68900a3b80 comp rx=0 tx=0).stop 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 msgr2=0x55bc4362ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc4362ad40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6890019680 tx=0x7f6890019810 comp rx=0 tx=0).stop 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 shutdown_connections 2024-09-18T02:06:07.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55bc43664d50 0x55bc43667140 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55bc43660450 0x55bc43662860 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6784034650 0x7f6784036b10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 --2- 172.21.15.167:0/1477305677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc434ad3e0 0x55bc4362ad40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 >> 172.21.15.167:0/1477305677 conn(0x55bc435330b0 msgr2=0x55bc4361e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 shutdown_connections 2024-09-18T02:06:07.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.339+0000 7f68a079e980 1 -- 172.21.15.167:0/1477305677 wait complete. 2024-09-18T02:06:07.353 INFO:teuthology.orchestra.run.smithi167.stdout:{"id":"c5231f36-c36e-44d5-8268-aaf52617db58","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-18T02:06:07.353 DEBUG:tasks.util.rgw: json result: {'id': 'c5231f36-c36e-44d5-8268-aaf52617db58', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-18T02:06:07.354 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-18T02:06:07.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-18T02:06:07.354 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-18T02:06:07.430 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:07.430 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:07.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.427+0000 7f6ce36ff980 1 Processor -- start 2024-09-18T02:06:07.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.427+0000 7f6ce36ff980 1 -- start start 2024-09-18T02:06:07.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.427+0000 7f6ce36ff980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564896dc7830 0x564896dc9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.427+0000 7f6ce36ff980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564896c4dae0 con 0x564896d39af0 2024-09-18T02:06:07.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.427+0000 7f6ce36ff980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x564896c71e30 con 0x564896dc7830 2024-09-18T02:06:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.427+0000 7f6ce0a0e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564896dc7830 0x564896dc9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.427+0000 7f6ce0a0e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x564896dc7830 0x564896dc9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50116/0 (socket says 172.21.15.167:50116) 2024-09-18T02:06:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.427+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/1742374773 learned_addr learned my addr 172.21.15.167:0/1742374773 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.427+0000 7f6ce120f640 1 --1- 172.21.15.167:0/1742374773 >> v1:172.21.15.81:6789/0 conn(0x564896d39af0 0x564896dc6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33806/0 (socket says 172.21.15.167:33806) 2024-09-18T02:06:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/1742374773 >> v1:172.21.15.81:6789/0 conn(0x564896d39af0 legacy=0x564896dc6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/1742374773 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564896dca190 con 0x564896dc7830 2024-09-18T02:06:07.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6ce0a0e640 1 --2- 172.21.15.167:0/1742374773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896dc7830 0x564896dc9c50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00a5c0 tx=0x7f6ccc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df38c8f81544b6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6cdbfff640 1 -- 172.21.15.167:0/1742374773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ccc0af070 con 0x564896dc7830 2024-09-18T02:06:07.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6cdbfff640 1 -- 172.21.15.167:0/1742374773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ccc0aa530 con 0x564896dc7830 2024-09-18T02:06:07.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6cdbfff640 1 -- 172.21.15.167:0/1742374773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ccc0aa830 con 0x564896dc7830 2024-09-18T02:06:07.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1742374773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896dc7830 msgr2=0x564896dc9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/1742374773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896dc7830 0x564896dc9c50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00a5c0 tx=0x7f6ccc01b340 comp rx=0 tx=0).stop 2024-09-18T02:06:07.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1742374773 shutdown_connections 2024-09-18T02:06:07.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/1742374773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896dc7830 0x564896dc9c50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1742374773 >> 172.21.15.167:0/1742374773 conn(0x564896dc0050 msgr2=0x564896dc2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.431+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1742374773 shutdown_connections 2024-09-18T02:06:07.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.435+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1742374773 wait complete. 2024-09-18T02:06:07.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.447+0000 7f6ce36ff980 1 Processor -- start 2024-09-18T02:06:07.453 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.447+0000 7f6ce36ff980 1 -- start start 2024-09-18T02:06:07.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.447+0000 7f6ce36ff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896eb74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.447+0000 7f6ce36ff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564896c73200 con 0x564896d39af0 2024-09-18T02:06:07.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce120f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896eb74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce120f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896eb74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50118/0 (socket says 172.21.15.167:50118) 2024-09-18T02:06:07.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce120f640 1 -- 172.21.15.167:0/2488264331 learned_addr learned my addr 172.21.15.167:0/2488264331 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce120f640 1 -- 172.21.15.167:0/2488264331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564896eb7a80 con 0x564896d39af0 2024-09-18T02:06:07.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce120f640 1 --2- 172.21.15.167:0/2488264331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896eb74b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4001690 tx=0x7f6cd4001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62a6ab57ce114b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6bcf606640 1 -- 172.21.15.167:0/2488264331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd4003460 con 0x564896d39af0 2024-09-18T02:06:07.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6bcf606640 1 -- 172.21.15.167:0/2488264331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd4003600 con 0x564896d39af0 2024-09-18T02:06:07.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6bcf606640 1 -- 172.21.15.167:0/2488264331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd4003920 con 0x564896d39af0 2024-09-18T02:06:07.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce36ff980 1 -- 172.21.15.167:0/2488264331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 msgr2=0x564896eb74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/2488264331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896eb74b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4001690 tx=0x7f6cd4001b50 comp rx=0 tx=0).stop 2024-09-18T02:06:07.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce36ff980 1 -- 172.21.15.167:0/2488264331 shutdown_connections 2024-09-18T02:06:07.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/2488264331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896eb74b0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce36ff980 1 -- 172.21.15.167:0/2488264331 >> 172.21.15.167:0/2488264331 conn(0x564896dc0050 msgr2=0x564896eb30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce36ff980 1 -- 172.21.15.167:0/2488264331 shutdown_connections 2024-09-18T02:06:07.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce36ff980 1 -- 172.21.15.167:0/2488264331 wait complete. 2024-09-18T02:06:07.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce36ff980 1 Processor -- start 2024-09-18T02:06:07.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce36ff980 1 -- start start 2024-09-18T02:06:07.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce36ff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896ebe800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce36ff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564896dd59f0 con 0x564896d39af0 2024-09-18T02:06:07.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce120f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896ebe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce120f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896ebe800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50122/0 (socket says 172.21.15.167:50122) 2024-09-18T02:06:07.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.451+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 learned_addr learned my addr 172.21.15.167:0/3241073629 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564896ebed40 con 0x564896d39af0 2024-09-18T02:06:07.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce120f640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896ebe800 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4000f90 tx=0x7f6cd4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6bcde03640 1 -- 172.21.15.167:0/3241073629 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd4022020 con 0x564896d39af0 2024-09-18T02:06:07.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6bcde03640 1 -- 172.21.15.167:0/3241073629 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd4006840 con 0x564896d39af0 2024-09-18T02:06:07.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6bcde03640 1 -- 172.21.15.167:0/3241073629 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd401e800 con 0x564896d39af0 2024-09-18T02:06:07.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564896ebefd0 con 0x564896d39af0 2024-09-18T02:06:07.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564896ec1cb0 con 0x564896d39af0 2024-09-18T02:06:07.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 Processor -- start 2024-09-18T02:06:07.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 -- start start 2024-09-18T02:06:07.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ecb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564896ccc800 con 0x564896ecb5c0 2024-09-18T02:06:07.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6bcde03640 1 -- 172.21.15.167:0/3241073629 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6cd4025020 con 0x564896d39af0 2024-09-18T02:06:07.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce1a10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ecb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce1a10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ecb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50132/0 (socket says 172.21.15.167:50132) 2024-09-18T02:06:07.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce1a10640 1 -- 172.21.15.167:0/878607150 learned_addr learned my addr 172.21.15.167:0/878607150 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6bcde03640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6bc8034600 0x7f6bc8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6bcde03640 1 -- 172.21.15.167:0/3241073629 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6cd4049be0 con 0x564896d39af0 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce120f640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6bc8034600 0x7f6bc8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce1a10640 1 -- 172.21.15.167:0/878607150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564896ecbf00 con 0x564896ecb5c0 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce1a10640 1 --2- 172.21.15.167:0/878607150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ecb9c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00a440 tx=0x7f6cdc00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcef07bcee417be server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce120f640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6bc8034600 0x7f6bc8036ac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6cd401ef50 tx=0x7f6cd4006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6bc77fe640 1 -- 172.21.15.167:0/878607150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cdc008850 con 0x564896ecb5c0 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6bc77fe640 1 -- 172.21.15.167:0/878607150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cdc008a10 con 0x564896ecb5c0 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6bc77fe640 1 -- 172.21.15.167:0/878607150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cdc008d30 con 0x564896ecb5c0 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 -- 172.21.15.167:0/878607150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 msgr2=0x564896ecb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/878607150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ecb9c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00a440 tx=0x7f6cdc00a900 comp rx=0 tx=0).stop 2024-09-18T02:06:07.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 -- 172.21.15.167:0/878607150 shutdown_connections 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/878607150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ecb9c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 -- 172.21.15.167:0/878607150 >> 172.21.15.167:0/878607150 conn(0x564896dc7830 msgr2=0x564896ec6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 -- 172.21.15.167:0/878607150 shutdown_connections 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.455+0000 7f6ce36ff980 1 -- 172.21.15.167:0/878607150 wait complete. 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 1 Processor -- start 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 1 -- start start 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ed2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564896ecc8e0 con 0x564896ecb5c0 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce1a10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ed2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce1a10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ed2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50138/0 (socket says 172.21.15.167:50138) 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce1a10640 1 -- 172.21.15.167:0/220238776 learned_addr learned my addr 172.21.15.167:0/220238776 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce1a10640 1 -- 172.21.15.167:0/220238776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564896ed2ed0 con 0x564896ecb5c0 2024-09-18T02:06:07.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce1a10640 1 --2- 172.21.15.167:0/220238776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ed2990 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x564896ecc370 tx=0x7f6cdc003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6bc5ffb640 1 -- 172.21.15.167:0/220238776 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cdc013a20 con 0x564896ecb5c0 2024-09-18T02:06:07.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6bc5ffb640 1 -- 172.21.15.167:0/220238776 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cdc019040 con 0x564896ecb5c0 2024-09-18T02:06:07.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6bc5ffb640 1 -- 172.21.15.167:0/220238776 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cdc013d50 con 0x564896ecb5c0 2024-09-18T02:06:07.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 1 -- 172.21.15.167:0/220238776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564896ed3160 con 0x564896ecb5c0 2024-09-18T02:06:07.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 1 -- 172.21.15.167:0/220238776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564896ed5e40 con 0x564896ecb5c0 2024-09-18T02:06:07.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6bc5ffb640 1 -- 172.21.15.167:0/220238776 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6cdc01e420 con 0x564896ecb5c0 2024-09-18T02:06:07.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:07.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:07.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6bc5ffb640 1 --2- 172.21.15.167:0/220238776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6bb8034650 0x7f6bb8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6bc5ffb640 1 -- 172.21.15.167:0/220238776 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6cdc04a1c0 con 0x564896ecb5c0 2024-09-18T02:06:07.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 1 Processor -- start 2024-09-18T02:06:07.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce1a10640 1 --2- 172.21.15.167:0/220238776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6bb8034650 0x7f6bb8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 1 -- start start 2024-09-18T02:06:07.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896eec210 0x564896eec630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.459+0000 7f6ce36ff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564896eb7da0 con 0x564896eec210 2024-09-18T02:06:07.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce1a10640 1 --2- 172.21.15.167:0/220238776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6bb8034650 0x7f6bb8036b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc026ac0 tx=0x7f6cdc0269d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce120f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896eec210 0x564896eec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce120f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896eec210 0x564896eec630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50142/0 (socket says 172.21.15.167:50142) 2024-09-18T02:06:07.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce120f640 1 -- 172.21.15.167:0/1023169807 learned_addr learned my addr 172.21.15.167:0/1023169807 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce120f640 1 -- 172.21.15.167:0/1023169807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564896eecc00 con 0x564896eec210 2024-09-18T02:06:07.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce120f640 1 --2- 172.21.15.167:0/1023169807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896eec210 0x564896eec630 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4047ff0 tx=0x7f6cd4010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ba67dc640 1 -- 172.21.15.167:0/1023169807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd4028050 con 0x564896eec210 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ba67dc640 1 -- 172.21.15.167:0/1023169807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd40281f0 con 0x564896eec210 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1023169807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564896eef760 con 0x564896eec210 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ba67dc640 1 -- 172.21.15.167:0/1023169807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd40284f0 con 0x564896eec210 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1023169807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564896eefb60 con 0x564896eec210 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ba67dc640 1 -- 172.21.15.167:0/1023169807 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6cd401d3e0 con 0x564896eec210 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ba67dc640 1 --2- 172.21.15.167:0/1023169807 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b240346a0 0x7f6b24036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ba67dc640 1 -- 172.21.15.167:0/1023169807 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6cd4054bf0 con 0x564896eec210 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce0a0e640 1 --2- 172.21.15.167:0/1023169807 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b240346a0 0x7f6b24036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6b17fff640 20 reqs_thread_entry: start 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564896ef1d20 0x564896ef4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564896ef4810 con 0x564896ef1d20 2024-09-18T02:06:07.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce0a0e640 1 --2- 172.21.15.167:0/1023169807 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b240346a0 0x7f6b24036b60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0ac000 tx=0x7f6ccc0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce1a10640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564896ef1d20 0x564896ef4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.463+0000 7f6ce1a10640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564896ef1d20 0x564896ef4190 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564896ef50a0 con 0x564896ef1d20 2024-09-18T02:06:07.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564896ef69b0 0x564896ef8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564896ef9510 con 0x564896ef69b0 2024-09-18T02:06:07.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce120f640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564896ef69b0 0x564896ef8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce120f640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564896ef69b0 0x564896ef8e20 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6cd405c040 con 0x564896ef69b0 2024-09-18T02:06:07.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564896f040f0 con 0x564896ef1d20 2024-09-18T02:06:07.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.480 INFO:teuthology.orchestra.run.smithi167.stderr:NOTICE: set zone's realm_id= 2024-09-18T02:06:07.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564896f02a70 0x564896eff980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896f02a70 2024-09-18T02:06:07.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce0a0e640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564896f02a70 0x564896eff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce0a0e640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564896f02a70 0x564896eff980 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ccc0b2040 con 0x564896f02a70 2024-09-18T02:06:07.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce0a0e640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f6ccc009040 0x7f6ccc0b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x7f6ccc009040 2024-09-18T02:06:07.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.467+0000 7f6ce1a10640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f6ccc009040 0x7f6ccc0b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f6ccc009040 0x7f6ccc0b5470 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x7f6ccc009040 2024-09-18T02:06:07.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x7f6ccc009040 2024-09-18T02:06:07.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x7f6ccc009040 2024-09-18T02:06:07.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef1d20 2024-09-18T02:06:07.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.481 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef1d20 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef1d20 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef69b0 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd405c040 con 0x564896ef69b0 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x7f6ccc009040 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x7f6ccc009040 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896f02a70 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ccc0b2040 con 0x564896f02a70 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef1d20 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x7f6ccc009040 2024-09-18T02:06:07.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x7f6ccc009040 2024-09-18T02:06:07.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef1d20 2024-09-18T02:06:07.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x7f6ccc009040 2024-09-18T02:06:07.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(17 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6cdc024020 con 0x7f6ccc009040 2024-09-18T02:06:07.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.471+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896f02a70 2024-09-18T02:06:07.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6ccc0b2040 con 0x564896f02a70 2024-09-18T02:06:07.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896f02a70 2024-09-18T02:06:07.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ccc0b2040 con 0x564896f02a70 2024-09-18T02:06:07.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef69b0 2024-09-18T02:06:07.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd405c040 con 0x564896ef69b0 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896f02a70 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ccc0b2040 con 0x564896f02a70 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896f02a70 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ccc0b2040 con 0x564896f02a70 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef1d20 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef1d20 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef69b0 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd405c040 con 0x564896ef69b0 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896f02a70 2024-09-18T02:06:07.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ccc0b2040 con 0x564896f02a70 2024-09-18T02:06:07.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x7f6ccc009040 2024-09-18T02:06:07.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x7f6ccc009040 2024-09-18T02:06:07.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.475+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef1d20 2024-09-18T02:06:07.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef69b0 2024-09-18T02:06:07.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd405c040 con 0x564896ef69b0 2024-09-18T02:06:07.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896f02a70 2024-09-18T02:06:07.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ccc0b2040 con 0x564896f02a70 2024-09-18T02:06:07.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef69b0 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd405c040 con 0x564896ef69b0 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x7f6ccc009040 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x7f6ccc009040 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896f02a70 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ccc0b2040 con 0x564896f02a70 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce0a0e640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef69b0 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6cd405c040 con 0x564896ef69b0 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x564896ef1d20 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(35 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564896f016c0 con 0x7f6ccc009040 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(36 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cdc024020 con 0x7f6ccc009040 2024-09-18T02:06:07.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.479+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564896efc800 con 0x564896ef1d20 2024-09-18T02:06:07.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.483+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.483+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:38 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564896efcba0 con 0x564896ef69b0 2024-09-18T02:06:07.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.483+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(38 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6cd405c040 con 0x564896ef69b0 2024-09-18T02:06:07.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.483+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:39 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564896efec40 con 0x564896ef69b0 2024-09-18T02:06:07.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.483+0000 7f6ce120f640 1 -- 172.21.15.167:0/3241073629 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(39 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [create,call,writefull 0~1155] v32'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f6cd405c040 con 0x564896ef69b0 2024-09-18T02:06:07.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.483+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564896f01f40 con 0x564896ef1d20 2024-09-18T02:06:07.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.487+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.487+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564896f022e0 con 0x564896ef1d20 2024-09-18T02:06:07.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.487+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f6cdc024020 con 0x564896ef1d20 2024-09-18T02:06:07.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.487+0000 7f6ce36ff980 1 -- 172.21.15.167:0/220238776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6bb8034650 msgr2=0x7f6bb8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.487+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/220238776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6bb8034650 0x7f6bb8036b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc026ac0 tx=0x7f6cdc0269d0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.487+0000 7f6ce36ff980 1 -- 172.21.15.167:0/220238776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 msgr2=0x564896ed2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.487+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/220238776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ed2990 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x564896ecc370 tx=0x7f6cdc003000 comp rx=0 tx=0).stop 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.487+0000 7f6ce36ff980 1 -- 172.21.15.167:0/220238776 shutdown_connections 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.487+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/220238776 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6bb8034650 0x7f6bb8036b10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.487+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/220238776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896ecb5c0 0x564896ed2990 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.487+0000 7f6ce36ff980 1 -- 172.21.15.167:0/220238776 >> 172.21.15.167:0/220238776 conn(0x564896dc7830 msgr2=0x564896ec6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/220238776 shutdown_connections 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/220238776 wait complete. 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1023169807 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b240346a0 msgr2=0x7f6b24036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/1023169807 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b240346a0 0x7f6b24036b60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0ac000 tx=0x7f6ccc0a5000 comp rx=0 tx=0).stop 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1023169807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896eec210 msgr2=0x564896eec630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/1023169807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896eec210 0x564896eec630 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4047ff0 tx=0x7f6cd4010ed0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1023169807 shutdown_connections 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/1023169807 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6b240346a0 0x7f6b24036b60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/1023169807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896eec210 0x564896eec630 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1023169807 >> 172.21.15.167:0/1023169807 conn(0x564896ee12a0 msgr2=0x564896ee3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1023169807 shutdown_connections 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/1023169807 wait complete. 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564896ef69b0 msgr2=0x564896ef8e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x564896ef69b0 0x564896ef8e20 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564896ef1d20 msgr2=0x564896ef4190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x564896ef1d20 0x564896ef4190 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f6ccc009040 msgr2=0x7f6ccc0b5470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f6ccc009040 0x7f6ccc0b5470 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564896f02a70 msgr2=0x564896eff980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x564896f02a70 0x564896eff980 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6bc8034600 msgr2=0x7f6bc8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6bc8034600 0x7f6bc8036ac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6cd401ef50 tx=0x7f6cd4006720 comp rx=0 tx=0).stop 2024-09-18T02:06:07.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 msgr2=0x564896ebe800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce1a10640 1 -- 172.21.15.167:0/3241073629 reap_dead start 2024-09-18T02:06:07.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896ebe800 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4000f90 tx=0x7f6cd4001260 comp rx=0 tx=0).stop 2024-09-18T02:06:07.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 shutdown_connections 2024-09-18T02:06:07.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 --2- 172.21.15.167:0/3241073629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564896d39af0 0x564896ebe800 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 >> 172.21.15.167:0/3241073629 conn(0x564896dc0050 msgr2=0x564896eb1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 shutdown_connections 2024-09-18T02:06:07.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.491+0000 7f6ce36ff980 1 -- 172.21.15.167:0/3241073629 wait complete. 2024-09-18T02:06:07.504 INFO:teuthology.orchestra.run.smithi167.stdout:{"id":"c5231f36-c36e-44d5-8268-aaf52617db58","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-18T02:06:07.504 DEBUG:tasks.util.rgw: json result: {'id': 'c5231f36-c36e-44d5-8268-aaf52617db58', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-18T02:06:07.504 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-18T02:06:07.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-18T02:06:07.505 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-18T02:06:07.577 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:07.578 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:07.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.575+0000 7f22a9f36980 1 Processor -- start 2024-09-18T02:06:07.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.575+0000 7f22a9f36980 1 -- start start 2024-09-18T02:06:07.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.575+0000 7f22a9f36980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x563fdda43670 0x563fdda43a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.575+0000 7f22a9f36980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563fdd954ae0 con 0x563fdda43fc0 2024-09-18T02:06:07.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.575+0000 7f22a9f36980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x563fdd978e30 con 0x563fdda43670 2024-09-18T02:06:07.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.575+0000 7f22a7a46640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x563fdda43670 0x563fdda43a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.575+0000 7f22a7a46640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x563fdda43670 0x563fdda43a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50152/0 (socket says 172.21.15.167:50152) 2024-09-18T02:06:07.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.575+0000 7f22a7245640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x563fdda43fc0 0x563fdda469e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33818/0 (socket says 172.21.15.167:33818) 2024-09-18T02:06:07.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.575+0000 7f22a7a46640 1 -- 172.21.15.167:0/3564155742 learned_addr learned my addr 172.21.15.167:0/3564155742 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.579+0000 7f22a7a46640 1 -- 172.21.15.167:0/3564155742 >> v1:172.21.15.81:6789/0 conn(0x563fdda43fc0 legacy=0x563fdda469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.579+0000 7f22a7a46640 1 -- 172.21.15.167:0/3564155742 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fdda47210 con 0x563fdda43670 2024-09-18T02:06:07.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.579+0000 7f22a7a46640 1 --2- 172.21.15.167:0/3564155742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43670 0x563fdda43a50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f22a000a5c0 tx=0x7f22a001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164345e05c346ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.583+0000 7f22a6a44640 1 -- 172.21.15.167:0/3564155742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a00a6070 con 0x563fdda43670 2024-09-18T02:06:07.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.583+0000 7f22a6a44640 1 -- 172.21.15.167:0/3564155742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a00af070 con 0x563fdda43670 2024-09-18T02:06:07.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.583+0000 7f22a6a44640 1 -- 172.21.15.167:0/3564155742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a00aa470 con 0x563fdda43670 2024-09-18T02:06:07.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.583+0000 7f22a9f36980 1 -- 172.21.15.167:0/3564155742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43670 msgr2=0x563fdda43a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.583+0000 7f22a9f36980 1 --2- 172.21.15.167:0/3564155742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43670 0x563fdda43a50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f22a000a5c0 tx=0x7f22a001b340 comp rx=0 tx=0).stop 2024-09-18T02:06:07.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.583+0000 7f22a9f36980 1 -- 172.21.15.167:0/3564155742 shutdown_connections 2024-09-18T02:06:07.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.583+0000 7f22a9f36980 1 --2- 172.21.15.167:0/3564155742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43670 0x563fdda43a50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.583+0000 7f22a9f36980 1 -- 172.21.15.167:0/3564155742 >> 172.21.15.167:0/3564155742 conn(0x563fdda42220 msgr2=0x563fdda42630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.583+0000 7f22a9f36980 1 -- 172.21.15.167:0/3564155742 shutdown_connections 2024-09-18T02:06:07.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.583+0000 7f22a9f36980 1 -- 172.21.15.167:0/3564155742 wait complete. 2024-09-18T02:06:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a9f36980 1 Processor -- start 2024-09-18T02:06:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a9f36980 1 -- start start 2024-09-18T02:06:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a9f36980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbbe3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a9f36980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563fdd97a200 con 0x563fdda43fc0 2024-09-18T02:06:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a7a46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbbe3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a7a46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbbe3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50164/0 (socket says 172.21.15.167:50164) 2024-09-18T02:06:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a7a46640 1 -- 172.21.15.167:0/3741657714 learned_addr learned my addr 172.21.15.167:0/3741657714 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a7a46640 1 -- 172.21.15.167:0/3741657714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fddbbe980 con 0x563fdda43fc0 2024-09-18T02:06:07.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a7a46640 1 --2- 172.21.15.167:0/3741657714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbbe3b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f22a001b380 tx=0x7f22a0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72361a42b3155c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f2195e0b640 1 -- 172.21.15.167:0/3741657714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a00aa840 con 0x563fdda43fc0 2024-09-18T02:06:07.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f2195e0b640 1 -- 172.21.15.167:0/3741657714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a00aaa00 con 0x563fdda43fc0 2024-09-18T02:06:07.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f2195e0b640 1 -- 172.21.15.167:0/3741657714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a00aad20 con 0x563fdda43fc0 2024-09-18T02:06:07.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a9f36980 1 -- 172.21.15.167:0/3741657714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 msgr2=0x563fddbbe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a9f36980 1 --2- 172.21.15.167:0/3741657714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbbe3b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f22a001b380 tx=0x7f22a0003030 comp rx=0 tx=0).stop 2024-09-18T02:06:07.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a9f36980 1 -- 172.21.15.167:0/3741657714 shutdown_connections 2024-09-18T02:06:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a9f36980 1 --2- 172.21.15.167:0/3741657714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbbe3b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a9f36980 1 -- 172.21.15.167:0/3741657714 >> 172.21.15.167:0/3741657714 conn(0x563fdda42220 msgr2=0x563fddbb9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a9f36980 1 -- 172.21.15.167:0/3741657714 shutdown_connections 2024-09-18T02:06:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.599+0000 7f22a9f36980 1 -- 172.21.15.167:0/3741657714 wait complete. 2024-09-18T02:06:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a9f36980 1 Processor -- start 2024-09-18T02:06:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a9f36980 1 -- start start 2024-09-18T02:06:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a9f36980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbc5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a9f36980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563fddadc910 con 0x563fdda43fc0 2024-09-18T02:06:07.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a7a46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbc5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a7a46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbc5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50166/0 (socket says 172.21.15.167:50166) 2024-09-18T02:06:07.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a7a46640 1 -- 172.21.15.167:0/507891723 learned_addr learned my addr 172.21.15.167:0/507891723 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a7a46640 1 -- 172.21.15.167:0/507891723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fddbc5ad0 con 0x563fdda43fc0 2024-09-18T02:06:07.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a7a46640 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbc5590 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f22a00030b0 tx=0x7f22a00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f218ffff640 1 -- 172.21.15.167:0/507891723 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a00cb030 con 0x563fdda43fc0 2024-09-18T02:06:07.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f218ffff640 1 -- 172.21.15.167:0/507891723 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a0000e50 con 0x563fdda43fc0 2024-09-18T02:06:07.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f218ffff640 1 -- 172.21.15.167:0/507891723 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a00c6780 con 0x563fdda43fc0 2024-09-18T02:06:07.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fddbc5d60 con 0x563fdda43fc0 2024-09-18T02:06:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fddbc8a40 con 0x563fdda43fc0 2024-09-18T02:06:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a9f36980 1 Processor -- start 2024-09-18T02:06:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a9f36980 1 -- start start 2024-09-18T02:06:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a9f36980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.603+0000 7f22a9f36980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563fdd9d3800 con 0x563fddbd2720 2024-09-18T02:06:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a8247640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a8247640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50170/0 (socket says 172.21.15.167:50170) 2024-09-18T02:06:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a8247640 1 -- 172.21.15.167:0/3192008802 learned_addr learned my addr 172.21.15.167:0/3192008802 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f218ffff640 1 -- 172.21.15.167:0/507891723 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f22a00ce070 con 0x563fdda43fc0 2024-09-18T02:06:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f218ffff640 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2190034650 0x7f2190036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f218ffff640 1 -- 172.21.15.167:0/507891723 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f22a00cc070 con 0x563fdda43fc0 2024-09-18T02:06:07.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a8247640 1 -- 172.21.15.167:0/3192008802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fddbd3060 con 0x563fddbd2720 2024-09-18T02:06:07.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a7a46640 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2190034650 0x7f2190036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a8247640 1 --2- 172.21.15.167:0/3192008802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd2b20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f229800a430 tx=0x7f229800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ef0218c32b2a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a7a46640 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2190034650 0x7f2190036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f22a00aa990 tx=0x7f22a00cf3b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f218dffb640 1 -- 172.21.15.167:0/3192008802 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f229800f6e0 con 0x563fddbd2720 2024-09-18T02:06:07.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f218dffb640 1 -- 172.21.15.167:0/3192008802 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2298015070 con 0x563fddbd2720 2024-09-18T02:06:07.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f218dffb640 1 -- 172.21.15.167:0/3192008802 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f229800fa10 con 0x563fddbd2720 2024-09-18T02:06:07.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 -- 172.21.15.167:0/3192008802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 msgr2=0x563fddbd2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 --2- 172.21.15.167:0/3192008802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd2b20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f229800a430 tx=0x7f229800a8f0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 -- 172.21.15.167:0/3192008802 shutdown_connections 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 --2- 172.21.15.167:0/3192008802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd2b20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 -- 172.21.15.167:0/3192008802 >> 172.21.15.167:0/3192008802 conn(0x563fddbcdc20 msgr2=0x563fddbd0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 -- 172.21.15.167:0/3192008802 shutdown_connections 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 -- 172.21.15.167:0/3192008802 wait complete. 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 Processor -- start 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 -- start start 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563fddbd3a40 con 0x563fddbd2720 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a8247640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a8247640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50172/0 (socket says 172.21.15.167:50172) 2024-09-18T02:06:07.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a8247640 1 -- 172.21.15.167:0/2089358740 learned_addr learned my addr 172.21.15.167:0/2089358740 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a8247640 1 -- 172.21.15.167:0/2089358740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fddbda020 con 0x563fddbd2720 2024-09-18T02:06:07.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a8247640 1 --2- 172.21.15.167:0/2089358740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd9ae0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x563fddbd34d0 tx=0x7f2298003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f2187fff640 1 -- 172.21.15.167:0/2089358740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f229800fe00 con 0x563fddbd2720 2024-09-18T02:06:07.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f2187fff640 1 -- 172.21.15.167:0/2089358740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2298010a20 con 0x563fddbd2720 2024-09-18T02:06:07.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 -- 172.21.15.167:0/2089358740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fddbda2b0 con 0x563fddbd2720 2024-09-18T02:06:07.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f2187fff640 1 -- 172.21.15.167:0/2089358740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2298010dc0 con 0x563fddbd2720 2024-09-18T02:06:07.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.607+0000 7f22a9f36980 1 -- 172.21.15.167:0/2089358740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fddbdcf90 con 0x563fddbd2720 2024-09-18T02:06:07.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a9f36980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:07.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a9f36980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:07.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f2187fff640 1 -- 172.21.15.167:0/2089358740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f229801a480 con 0x563fddbd2720 2024-09-18T02:06:07.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f2187fff640 1 --2- 172.21.15.167:0/2089358740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2180034650 0x7f2180036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a9f36980 1 Processor -- start 2024-09-18T02:06:07.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f2187fff640 1 -- 172.21.15.167:0/2089358740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f229804a440 con 0x563fddbd2720 2024-09-18T02:06:07.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a8247640 1 --2- 172.21.15.167:0/2089358740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2180034650 0x7f2180036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a9f36980 1 -- start start 2024-09-18T02:06:07.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a9f36980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbf3400 0x563fddbf3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a9f36980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563fddbbec40 con 0x563fddbf3400 2024-09-18T02:06:07.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a8247640 1 --2- 172.21.15.167:0/2089358740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2180034650 0x7f2180036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f229802e920 tx=0x7f229802e7b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a7a46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbf3400 0x563fddbf3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a7a46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbf3400 0x563fddbf3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50178/0 (socket says 172.21.15.167:50178) 2024-09-18T02:06:07.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a7a46640 1 -- 172.21.15.167:0/1351779550 learned_addr learned my addr 172.21.15.167:0/1351779550 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a7a46640 1 -- 172.21.15.167:0/1351779550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fddbf3df0 con 0x563fddbf3400 2024-09-18T02:06:07.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a7a46640 1 --2- 172.21.15.167:0/1351779550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbf3400 0x563fddbf3820 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f22a00cf570 tx=0x7f22a00e3960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f211ffff640 1 -- 172.21.15.167:0/1351779550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a00bdc10 con 0x563fddbf3400 2024-09-18T02:06:07.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f211ffff640 1 -- 172.21.15.167:0/1351779550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a00e5070 con 0x563fddbf3400 2024-09-18T02:06:07.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a9f36980 1 -- 172.21.15.167:0/1351779550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fddbf6950 con 0x563fddbf3400 2024-09-18T02:06:07.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f211ffff640 1 -- 172.21.15.167:0/1351779550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a00bddb0 con 0x563fddbf3400 2024-09-18T02:06:07.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.611+0000 7f22a9f36980 1 -- 172.21.15.167:0/1351779550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fddbf6950 con 0x563fddbf3400 2024-09-18T02:06:07.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f211ffff640 1 -- 172.21.15.167:0/1351779550 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f22a00d6ad0 con 0x563fddbf3400 2024-09-18T02:06:07.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f211ffff640 1 --2- 172.21.15.167:0/1351779550 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f20e8034650 0x7f20e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f211ffff640 1 -- 172.21.15.167:0/1351779550 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f22a00efbf0 con 0x563fddbf3400 2024-09-18T02:06:07.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a7245640 1 --2- 172.21.15.167:0/1351779550 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f20e8034650 0x7f20e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f211dffb640 20 reqs_thread_entry: start 2024-09-18T02:06:07.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a9f36980 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563fddbf8b90 0x563fddbfafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563fddbfb620 con 0x563fddbf8b90 2024-09-18T02:06:07.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a8247640 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563fddbf8b90 0x563fddbfafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a7245640 1 --2- 172.21.15.167:0/1351779550 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f20e8034650 0x7f20e8036b10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x563fddbce7e0 tx=0x7f229c001330 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a8247640 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563fddbf8b90 0x563fddbfafa0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a8247640 1 -- 172.21.15.167:0/507891723 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f229800e070 con 0x563fddbf8b90 2024-09-18T02:06:07.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563fddbfbf00 con 0x563fddbf8b90 2024-09-18T02:06:07.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a8247640 1 -- 172.21.15.167:0/507891723 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f229800e070 con 0x563fddbf8b90 2024-09-18T02:06:07.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a9f36980 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563fddbfd810 0x563fddbffc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563fddc00370 con 0x563fddbfd810 2024-09-18T02:06:07.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a7a46640 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563fddbfd810 0x563fddbffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.615+0000 7f22a7a46640 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563fddbfd810 0x563fddbffc80 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a7a46640 1 -- 172.21.15.167:0/507891723 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f22a00f4020 con 0x563fddbfd810 2024-09-18T02:06:07.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/2089358740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2180034650 msgr2=0x7f2180036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/2089358740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2180034650 0x7f2180036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f229802e920 tx=0x7f229802e7b0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/2089358740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 msgr2=0x563fddbd9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/2089358740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd9ae0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x563fddbd34d0 tx=0x7f2298003380 comp rx=0 tx=0).stop 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/2089358740 shutdown_connections 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/2089358740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2180034650 0x7f2180036b10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/2089358740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbd2720 0x563fddbd9ae0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/2089358740 >> 172.21.15.167:0/2089358740 conn(0x563fddbcdc20 msgr2=0x563fddbcc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/2089358740 shutdown_connections 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/2089358740 wait complete. 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/1351779550 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f20e8034650 msgr2=0x7f20e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/1351779550 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f20e8034650 0x7f20e8036b10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x563fddbce7e0 tx=0x7f229c001330 comp rx=0 tx=0).stop 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/1351779550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbf3400 msgr2=0x563fddbf3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/1351779550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbf3400 0x563fddbf3820 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f22a00cf570 tx=0x7f22a00e3960 comp rx=0 tx=0).stop 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/1351779550 shutdown_connections 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/1351779550 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f20e8034650 0x7f20e8036b10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/1351779550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fddbf3400 0x563fddbf3820 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/1351779550 >> 172.21.15.167:0/1351779550 conn(0x563fddbe83d0 msgr2=0x563fddbeacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/1351779550 shutdown_connections 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/1351779550 wait complete. 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563fddbfd810 msgr2=0x563fddbffc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563fddbfd810 0x563fddbffc80 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563fddbf8b90 msgr2=0x563fddbfafa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563fddbf8b90 0x563fddbfafa0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2190034650 msgr2=0x7f2190036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2190034650 0x7f2190036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f22a00aa990 tx=0x7f22a00cf3b0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 msgr2=0x563fddbc5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbc5590 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f22a00030b0 tx=0x7f22a00180e0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 shutdown_connections 2024-09-18T02:06:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563fddbfd810 0x563fddbffc80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563fddbf8b90 0x563fddbfafa0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2190034650 0x7f2190036b10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 --2- 172.21.15.167:0/507891723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fdda43fc0 0x563fddbc5590 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 >> 172.21.15.167:0/507891723 conn(0x563fdda42220 msgr2=0x563fddbb8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 shutdown_connections 2024-09-18T02:06:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.619+0000 7f22a9f36980 1 -- 172.21.15.167:0/507891723 wait complete. 2024-09-18T02:06:07.635 INFO:teuthology.orchestra.run.smithi167.stdout:{"id":"c5231f36-c36e-44d5-8268-aaf52617db58","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-18T02:06:07.635 DEBUG:tasks.util.rgw: json result: {'id': 'c5231f36-c36e-44d5-8268-aaf52617db58', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-18T02:06:07.635 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T02:06:07.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T02:06:07.636 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-18T02:06:07.709 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:07.709 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:07.710 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.707+0000 7fdfe8372980 1 Processor -- start 2024-09-18T02:06:07.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.707+0000 7fdfe8372980 1 -- start start 2024-09-18T02:06:07.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.707+0000 7fdfe8372980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f4abaedbe0 0x55f4abaeffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.707+0000 7fdfe8372980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4ab96fae0 con 0x55f4abae9930 2024-09-18T02:06:07.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.707+0000 7fdfe8372980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55f4ab993e30 con 0x55f4abaedbe0 2024-09-18T02:06:07.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.707+0000 7fdfe5681640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f4abaedbe0 0x55f4abaeffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.707+0000 7fdfe5e82640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55f4abae9930 0x55f4abae9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33832/0 (socket says 172.21.15.167:33832) 2024-09-18T02:06:07.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.707+0000 7fdfe5681640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f4abaedbe0 0x55f4abaeffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50186/0 (socket says 172.21.15.167:50186) 2024-09-18T02:06:07.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.707+0000 7fdfe5e82640 1 -- 172.21.15.167:0/4059582608 learned_addr learned my addr 172.21.15.167:0/4059582608 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:07.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.707+0000 7fdfe5681640 1 -- 172.21.15.167:0/4059582608 >> v1:172.21.15.81:6789/0 conn(0x55f4abae9930 legacy=0x55f4abae9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.707+0000 7fdfe5681640 1 -- 172.21.15.167:0/4059582608 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4abaf1520 con 0x55f4abaedbe0 2024-09-18T02:06:07.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.711+0000 7fdfe5681640 1 --2- 172.21.15.167:0/4059582608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abaedbe0 0x55f4abaeffd0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00a480 tx=0x7fdfdc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f53105b8f80314 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.711+0000 7fdfe4e80640 1 -- 172.21.15.167:0/4059582608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfdc0b0070 con 0x55f4abaedbe0 2024-09-18T02:06:07.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.711+0000 7fdfe4e80640 1 -- 172.21.15.167:0/4059582608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfdc0ab540 con 0x55f4abaedbe0 2024-09-18T02:06:07.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.711+0000 7fdfe4e80640 1 -- 172.21.15.167:0/4059582608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfdc0ab840 con 0x55f4abaedbe0 2024-09-18T02:06:07.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.711+0000 7fdfe8372980 1 -- 172.21.15.167:0/4059582608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abaedbe0 msgr2=0x55f4abaeffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.711+0000 7fdfe8372980 1 --2- 172.21.15.167:0/4059582608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abaedbe0 0x55f4abaeffd0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00a480 tx=0x7fdfdc01b280 comp rx=0 tx=0).stop 2024-09-18T02:06:07.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.711+0000 7fdfe8372980 1 -- 172.21.15.167:0/4059582608 shutdown_connections 2024-09-18T02:06:07.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.711+0000 7fdfe8372980 1 --2- 172.21.15.167:0/4059582608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abaedbe0 0x55f4abaeffd0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.711+0000 7fdfe8372980 1 -- 172.21.15.167:0/4059582608 >> 172.21.15.167:0/4059582608 conn(0x55f4aba5d1e0 msgr2=0x55f4aba5d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.711+0000 7fdfe8372980 1 -- 172.21.15.167:0/4059582608 shutdown_connections 2024-09-18T02:06:07.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.711+0000 7fdfe8372980 1 -- 172.21.15.167:0/4059582608 wait complete. 2024-09-18T02:06:07.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fdfe8372980 1 Processor -- start 2024-09-18T02:06:07.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fdfe8372980 1 -- start start 2024-09-18T02:06:07.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fdfe8372980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbd4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fdfe8372980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f4ab995200 con 0x55f4abae9930 2024-09-18T02:06:07.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fdfe5e82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbd4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fdfe5e82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbd4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50192/0 (socket says 172.21.15.167:50192) 2024-09-18T02:06:07.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fdfe5e82640 1 -- 172.21.15.167:0/818789211 learned_addr learned my addr 172.21.15.167:0/818789211 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fdfe5e82640 1 -- 172.21.15.167:0/818789211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4abbd5210 con 0x55f4abae9930 2024-09-18T02:06:07.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fdfe5e82640 1 --2- 172.21.15.167:0/818789211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbd4c40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8001d90 tx=0x7fdfd8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2ace1eabdbee1b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fded3e07640 1 -- 172.21.15.167:0/818789211 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfd8013030 con 0x55f4abae9930 2024-09-18T02:06:07.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fded3e07640 1 -- 172.21.15.167:0/818789211 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd800e690 con 0x55f4abae9930 2024-09-18T02:06:07.732 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.727+0000 7fded3e07640 1 -- 172.21.15.167:0/818789211 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfd800ea10 con 0x55f4abae9930 2024-09-18T02:06:07.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 -- 172.21.15.167:0/818789211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 msgr2=0x55f4abbd4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 --2- 172.21.15.167:0/818789211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbd4c40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8001d90 tx=0x7fdfd8001e80 comp rx=0 tx=0).stop 2024-09-18T02:06:07.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 -- 172.21.15.167:0/818789211 shutdown_connections 2024-09-18T02:06:07.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 --2- 172.21.15.167:0/818789211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbd4c40 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 -- 172.21.15.167:0/818789211 >> 172.21.15.167:0/818789211 conn(0x55f4aba5d1e0 msgr2=0x55f4abbd0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 -- 172.21.15.167:0/818789211 shutdown_connections 2024-09-18T02:06:07.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 -- 172.21.15.167:0/818789211 wait complete. 2024-09-18T02:06:07.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 Processor -- start 2024-09-18T02:06:07.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 -- start start 2024-09-18T02:06:07.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbdc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f4abaf1020 con 0x55f4abae9930 2024-09-18T02:06:07.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe5e82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbdc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe5e82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbdc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50202/0 (socket says 172.21.15.167:50202) 2024-09-18T02:06:07.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe5e82640 1 -- 172.21.15.167:0/2214955064 learned_addr learned my addr 172.21.15.167:0/2214955064 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe5e82640 1 -- 172.21.15.167:0/2214955064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4abbdc5b0 con 0x55f4abae9930 2024-09-18T02:06:07.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe5e82640 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbdc070 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55f4abbd5e20 tx=0x7fdfd8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fded2604640 1 -- 172.21.15.167:0/2214955064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfd8027070 con 0x55f4abae9930 2024-09-18T02:06:07.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fded2604640 1 -- 172.21.15.167:0/2214955064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd80198e0 con 0x55f4abae9930 2024-09-18T02:06:07.738 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4abbdc840 con 0x55f4abae9930 2024-09-18T02:06:07.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fded2604640 1 -- 172.21.15.167:0/2214955064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfd8019c00 con 0x55f4abae9930 2024-09-18T02:06:07.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4abbdf520 con 0x55f4abae9930 2024-09-18T02:06:07.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 Processor -- start 2024-09-18T02:06:07.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 -- start start 2024-09-18T02:06:07.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbe9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.731+0000 7fdfe8372980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f4ab9ee800 con 0x55f4abbe8e30 2024-09-18T02:06:07.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe6683640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbe9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe6683640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbe9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50208/0 (socket says 172.21.15.167:50208) 2024-09-18T02:06:07.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe6683640 1 -- 172.21.15.167:0/483585878 learned_addr learned my addr 172.21.15.167:0/483585878 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fded2604640 1 -- 172.21.15.167:0/2214955064 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdfd802a070 con 0x55f4abae9930 2024-09-18T02:06:07.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fded2604640 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdecc0346f0 0x7fdecc036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fded2604640 1 -- 172.21.15.167:0/2214955064 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdfd801f070 con 0x55f4abae9930 2024-09-18T02:06:07.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe5e82640 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdecc0346f0 0x7fdecc036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe6683640 1 -- 172.21.15.167:0/483585878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4abbe9770 con 0x55f4abbe8e30 2024-09-18T02:06:07.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe6683640 1 --2- 172.21.15.167:0/483585878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbe9230 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000a430 tx=0x7fdfe000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6bb57ac100c34f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe5e82640 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdecc0346f0 0x7fdecc036bb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8001790 tx=0x7fdfd8001720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdecbfff640 1 -- 172.21.15.167:0/483585878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfe000f6e0 con 0x55f4abbe8e30 2024-09-18T02:06:07.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdecbfff640 1 -- 172.21.15.167:0/483585878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe0015070 con 0x55f4abbe8e30 2024-09-18T02:06:07.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdecbfff640 1 -- 172.21.15.167:0/483585878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfe000fa10 con 0x55f4abbe8e30 2024-09-18T02:06:07.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 -- 172.21.15.167:0/483585878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 msgr2=0x55f4abbe9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 --2- 172.21.15.167:0/483585878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbe9230 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000a430 tx=0x7fdfe000a8f0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 -- 172.21.15.167:0/483585878 shutdown_connections 2024-09-18T02:06:07.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 --2- 172.21.15.167:0/483585878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbe9230 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 -- 172.21.15.167:0/483585878 >> 172.21.15.167:0/483585878 conn(0x55f4abaedbe0 msgr2=0x55f4abbe4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 -- 172.21.15.167:0/483585878 shutdown_connections 2024-09-18T02:06:07.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 -- 172.21.15.167:0/483585878 wait complete. 2024-09-18T02:06:07.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 Processor -- start 2024-09-18T02:06:07.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 -- start start 2024-09-18T02:06:07.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbf0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f4abbea150 con 0x55f4abbe8e30 2024-09-18T02:06:07.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe6683640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbf0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe6683640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbf0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50212/0 (socket says 172.21.15.167:50212) 2024-09-18T02:06:07.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe6683640 1 -- 172.21.15.167:0/2957367213 learned_addr learned my addr 172.21.15.167:0/2957367213 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe6683640 1 -- 172.21.15.167:0/2957367213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4abbf07d0 con 0x55f4abbe8e30 2024-09-18T02:06:07.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe6683640 1 --2- 172.21.15.167:0/2957367213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbf0290 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000a930 tx=0x7fdfe0003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdeca7fc640 1 -- 172.21.15.167:0/2957367213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfe0005a50 con 0x55f4abbe8e30 2024-09-18T02:06:07.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.735+0000 7fdfe8372980 1 -- 172.21.15.167:0/2957367213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4abbf0a60 con 0x55f4abbe8e30 2024-09-18T02:06:07.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdeca7fc640 1 -- 172.21.15.167:0/2957367213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe00109a0 con 0x55f4abbe8e30 2024-09-18T02:06:07.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdeca7fc640 1 -- 172.21.15.167:0/2957367213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfe0010cc0 con 0x55f4abbe8e30 2024-09-18T02:06:07.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe8372980 1 -- 172.21.15.167:0/2957367213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4abbf3740 con 0x55f4abbe8e30 2024-09-18T02:06:07.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe8372980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe8372980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdeca7fc640 1 -- 172.21.15.167:0/2957367213 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdfe001a480 con 0x55f4abbe8e30 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe8372980 1 Processor -- start 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdeca7fc640 1 --2- 172.21.15.167:0/2957367213 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdec0034650 0x7fdec0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdeca7fc640 1 -- 172.21.15.167:0/2957367213 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdfe004a340 con 0x55f4abbe8e30 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe8372980 1 -- start start 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe6683640 1 --2- 172.21.15.167:0/2957367213 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdec0034650 0x7fdec0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe8372980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abc09ae0 0x55f4abc09f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe8372980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f4abbd5590 con 0x55f4abc09ae0 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe6683640 1 --2- 172.21.15.167:0/2957367213 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdec0034650 0x7fdec0036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000ffd0 tx=0x7fdfe0024f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe5e82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abc09ae0 0x55f4abc09f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe5e82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abc09ae0 0x55f4abc09f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50222/0 (socket says 172.21.15.167:50222) 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe5e82640 1 -- 172.21.15.167:0/583770326 learned_addr learned my addr 172.21.15.167:0/583770326 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe5e82640 1 -- 172.21.15.167:0/583770326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4abc0a4d0 con 0x55f4abc09ae0 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe5e82640 1 --2- 172.21.15.167:0/583770326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abc09ae0 0x55f4abc09f00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8001ee0 tx=0x7fdfd800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdeaa7e4640 1 -- 172.21.15.167:0/583770326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfd8049df0 con 0x55f4abc09ae0 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdeaa7e4640 1 -- 172.21.15.167:0/583770326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd8047070 con 0x55f4abc09ae0 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe8372980 1 -- 172.21.15.167:0/583770326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4abc0d030 con 0x55f4abc09ae0 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdeaa7e4640 1 -- 172.21.15.167:0/583770326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfd8016360 con 0x55f4abc09ae0 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.739+0000 7fdfe8372980 1 -- 172.21.15.167:0/583770326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4abc0d430 con 0x55f4abc09ae0 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdeaa7e4640 1 -- 172.21.15.167:0/583770326 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdfd8016070 con 0x55f4abc09ae0 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdeaa7e4640 1 --2- 172.21.15.167:0/583770326 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fde28034650 0x7fde28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdeaa7e4640 1 -- 172.21.15.167:0/583770326 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdfd8014070 con 0x55f4abc09ae0 2024-09-18T02:06:07.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdfe5681640 1 --2- 172.21.15.167:0/583770326 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fde28034650 0x7fde28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fde1bfff640 20 reqs_thread_entry: start 2024-09-18T02:06:07.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f4abc0f590 0x55f4abc11a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4abc120f0 con 0x55f4abc0f590 2024-09-18T02:06:07.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdfe5681640 1 --2- 172.21.15.167:0/583770326 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fde28034650 0x7fde28036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0ad000 tx=0x7fdfdc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdfe6683640 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f4abc0f590 0x55f4abc11a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.749 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdfe6683640 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f4abc0f590 0x55f4abc11a20 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdfe6683640 1 -- 172.21.15.167:0/2214955064 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdfe000e070 con 0x55f4abc0f590 2024-09-18T02:06:07.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f4abc13f10 0x55f4abc16300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:2 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4abc16950 con 0x55f4abc13f10 2024-09-18T02:06:07.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdfe5e82640 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f4abc13f10 0x55f4abc16300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.743+0000 7fdfe5e82640 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f4abc13f10 0x55f4abc16300 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe5e82640 1 -- 172.21.15.167:0/2214955064 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(2 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fdfd805b040 con 0x55f4abc13f10 2024-09-18T02:06:07.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4abc1b760 con 0x55f4abc13f10 2024-09-18T02:06:07.750 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe5e82640 1 -- 172.21.15.167:0/2214955064 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [stat,call,call,writefull 0~993] v32'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fdfd805b040 con 0x55f4abc13f10 2024-09-18T02:06:07.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe8372980 1 -- 172.21.15.167:0/2957367213 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdec0034650 msgr2=0x7fdec0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2957367213 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdec0034650 0x7fdec0036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000ffd0 tx=0x7fdfe0024f10 comp rx=0 tx=0).stop 2024-09-18T02:06:07.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe8372980 1 -- 172.21.15.167:0/2957367213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 msgr2=0x55f4abbf0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.753 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2957367213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbf0290 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000a930 tx=0x7fdfe0003380 comp rx=0 tx=0).stop 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe8372980 1 -- 172.21.15.167:0/2957367213 shutdown_connections 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2957367213 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdec0034650 0x7fdec0036b10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2957367213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abbe8e30 0x55f4abbf0290 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe8372980 1 -- 172.21.15.167:0/2957367213 >> 172.21.15.167:0/2957367213 conn(0x55f4abaedbe0 msgr2=0x55f4abbe4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe8372980 1 -- 172.21.15.167:0/2957367213 shutdown_connections 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.747+0000 7fdfe8372980 1 -- 172.21.15.167:0/2957367213 wait complete. 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/583770326 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fde28034650 msgr2=0x7fde28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/583770326 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fde28034650 0x7fde28036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0ad000 tx=0x7fdfdc0a5040 comp rx=0 tx=0).stop 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/583770326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abc09ae0 msgr2=0x55f4abc09f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/583770326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abc09ae0 0x55f4abc09f00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8001ee0 tx=0x7fdfd800c940 comp rx=0 tx=0).stop 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/583770326 shutdown_connections 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/583770326 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fde28034650 0x7fde28036b10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/583770326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abc09ae0 0x55f4abc09f00 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.754 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/583770326 >> 172.21.15.167:0/583770326 conn(0x55f4abbfeab0 msgr2=0x55f4abc013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/583770326 shutdown_connections 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/583770326 wait complete. 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f4abc13f10 msgr2=0x55f4abc16300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f4abc13f10 0x55f4abc16300 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f4abc0f590 msgr2=0x55f4abc11a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f4abc0f590 0x55f4abc11a20 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdecc0346f0 msgr2=0x7fdecc036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdecc0346f0 0x7fdecc036bb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8001790 tx=0x7fdfd8001720 comp rx=0 tx=0).stop 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 msgr2=0x55f4abbdc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbdc070 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55f4abbd5e20 tx=0x7fdfd8000bd0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 shutdown_connections 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f4abc13f10 0x55f4abc16300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.755 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f4abc0f590 0x55f4abc11a20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdecc0346f0 0x7fdecc036bb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 --2- 172.21.15.167:0/2214955064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4abae9930 0x55f4abbdc070 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 >> 172.21.15.167:0/2214955064 conn(0x55f4aba5d1e0 msgr2=0x55f4abbcf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 shutdown_connections 2024-09-18T02:06:07.756 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.751+0000 7fdfe8372980 1 -- 172.21.15.167:0/2214955064 wait complete. 2024-09-18T02:06:07.763 INFO:teuthology.orchestra.run.smithi167.stdout:{"id":"c5231f36-c36e-44d5-8268-aaf52617db58","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-18T02:06:07.763 DEBUG:tasks.util.rgw: json result: {'id': 'c5231f36-c36e-44d5-8268-aaf52617db58', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-18T02:06:07.763 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-18T02:06:07.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-18T02:06:07.764 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-18T02:06:07.840 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:07.840 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:07.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.839+0000 7fa7eb199980 1 Processor -- start 2024-09-18T02:06:07.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.839+0000 7fa7eb199980 1 -- start start 2024-09-18T02:06:07.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.839+0000 7fa7eb199980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5604eb95d560 0x5604eb95d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.839+0000 7fa7eb199980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5604eb7e6ae0 con 0x5604eb95deb0 2024-09-18T02:06:07.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.839+0000 7fa7eb199980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x5604eb80ae30 con 0x5604eb95d560 2024-09-18T02:06:07.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.839+0000 7fa7e8ca9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5604eb95d560 0x5604eb95d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.839+0000 7fa7e84a8640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5604eb95deb0 0x5604eb9628e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33844/0 (socket says 172.21.15.167:33844) 2024-09-18T02:06:07.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.839+0000 7fa7e84a8640 1 -- 172.21.15.167:0/1315761046 learned_addr learned my addr 172.21.15.167:0/1315761046 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:07.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.839+0000 7fa7e8ca9640 1 -- 172.21.15.167:0/1315761046 >> v1:172.21.15.81:6789/0 conn(0x5604eb95deb0 legacy=0x5604eb9628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.839+0000 7fa7e8ca9640 1 -- 172.21.15.167:0/1315761046 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604eb965130 con 0x5604eb95d560 2024-09-18T02:06:07.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.843+0000 7fa7e8ca9640 1 --2- 172.21.15.167:0/1315761046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eb95d940 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800a420 tx=0x7fa7d801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5017fea1703372 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.843+0000 7fa7e7ca7640 1 -- 172.21.15.167:0/1315761046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d80af070 con 0x5604eb95d560 2024-09-18T02:06:07.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.843+0000 7fa7e7ca7640 1 -- 172.21.15.167:0/1315761046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d80aa530 con 0x5604eb95d560 2024-09-18T02:06:07.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.843+0000 7fa7e7ca7640 1 -- 172.21.15.167:0/1315761046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d80aa850 con 0x5604eb95d560 2024-09-18T02:06:07.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.843+0000 7fa7eb199980 1 -- 172.21.15.167:0/1315761046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 msgr2=0x5604eb95d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.843+0000 7fa7eb199980 1 --2- 172.21.15.167:0/1315761046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eb95d940 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800a420 tx=0x7fa7d801afd0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.843+0000 7fa7eb199980 1 -- 172.21.15.167:0/1315761046 shutdown_connections 2024-09-18T02:06:07.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.843+0000 7fa7eb199980 1 --2- 172.21.15.167:0/1315761046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eb95d940 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.843+0000 7fa7eb199980 1 -- 172.21.15.167:0/1315761046 >> 172.21.15.167:0/1315761046 conn(0x5604eb959080 msgr2=0x5604eb95b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.843+0000 7fa7eb199980 1 -- 172.21.15.167:0/1315761046 shutdown_connections 2024-09-18T02:06:07.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.843+0000 7fa7eb199980 1 -- 172.21.15.167:0/1315761046 wait complete. 2024-09-18T02:06:07.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 Processor -- start 2024-09-18T02:06:07.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 -- start start 2024-09-18T02:06:07.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eb8d2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604eb80c200 con 0x5604eb95d560 2024-09-18T02:06:07.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7e8ca9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eb8d2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7e8ca9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eb8d2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50232/0 (socket says 172.21.15.167:50232) 2024-09-18T02:06:07.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7e8ca9640 1 -- 172.21.15.167:0/1204463466 learned_addr learned my addr 172.21.15.167:0/1204463466 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7e8ca9640 1 -- 172.21.15.167:0/1204463466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604eb8d31c0 con 0x5604eb95d560 2024-09-18T02:06:07.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7e8ca9640 1 --2- 172.21.15.167:0/1204463466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eb8d2bf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800a420 tx=0x7fa7d80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2fb78624b64797 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa6d6e0d640 1 -- 172.21.15.167:0/1204463466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d80af050 con 0x5604eb95d560 2024-09-18T02:06:07.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa6d6e0d640 1 -- 172.21.15.167:0/1204463466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d80b0040 con 0x5604eb95d560 2024-09-18T02:06:07.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa6d6e0d640 1 -- 172.21.15.167:0/1204463466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d80aac60 con 0x5604eb95d560 2024-09-18T02:06:07.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 -- 172.21.15.167:0/1204463466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 msgr2=0x5604eb8d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 --2- 172.21.15.167:0/1204463466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eb8d2bf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800a420 tx=0x7fa7d80033b0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 -- 172.21.15.167:0/1204463466 shutdown_connections 2024-09-18T02:06:07.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 --2- 172.21.15.167:0/1204463466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eb8d2bf0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 -- 172.21.15.167:0/1204463466 >> 172.21.15.167:0/1204463466 conn(0x5604eb959080 msgr2=0x5604eba444e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 -- 172.21.15.167:0/1204463466 shutdown_connections 2024-09-18T02:06:07.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 -- 172.21.15.167:0/1204463466 wait complete. 2024-09-18T02:06:07.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 Processor -- start 2024-09-18T02:06:07.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 -- start start 2024-09-18T02:06:07.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eba50ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7eb199980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604eb964b70 con 0x5604eb95d560 2024-09-18T02:06:07.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.859+0000 7fa7e8ca9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eba50ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7e8ca9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eba50ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50242/0 (socket says 172.21.15.167:50242) 2024-09-18T02:06:07.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7e8ca9640 1 -- 172.21.15.167:0/3694964536 learned_addr learned my addr 172.21.15.167:0/3694964536 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7e8ca9640 1 -- 172.21.15.167:0/3694964536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604eba510e0 con 0x5604eb95d560 2024-09-18T02:06:07.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7e8ca9640 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eba50ba0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa7d801b870 tx=0x7fa7d8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa6d560a640 1 -- 172.21.15.167:0/3694964536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d80c5020 con 0x5604eb95d560 2024-09-18T02:06:07.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa6d560a640 1 -- 172.21.15.167:0/3694964536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d80b6cb0 con 0x5604eb95d560 2024-09-18T02:06:07.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604eba51370 con 0x5604eb95d560 2024-09-18T02:06:07.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa6d560a640 1 -- 172.21.15.167:0/3694964536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d80c1480 con 0x5604eb95d560 2024-09-18T02:06:07.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604eba54050 con 0x5604eb95d560 2024-09-18T02:06:07.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7eb199980 1 Processor -- start 2024-09-18T02:06:07.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7eb199980 1 -- start start 2024-09-18T02:06:07.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7eb199980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba5ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7eb199980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604eb865800 con 0x5604eba5d9b0 2024-09-18T02:06:07.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7e94aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba5ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa6d560a640 1 -- 172.21.15.167:0/3694964536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa7d80c8070 con 0x5604eb95d560 2024-09-18T02:06:07.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7e94aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba5ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50244/0 (socket says 172.21.15.167:50244) 2024-09-18T02:06:07.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7e94aa640 1 -- 172.21.15.167:0/884425911 learned_addr learned my addr 172.21.15.167:0/884425911 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa6d560a640 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6d0034650 0x7fa6d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa6d560a640 1 -- 172.21.15.167:0/3694964536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa7d80bb070 con 0x5604eb95d560 2024-09-18T02:06:07.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7e8ca9640 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6d0034650 0x7fa6d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7e94aa640 1 -- 172.21.15.167:0/884425911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604eba5e2f0 con 0x5604eba5d9b0 2024-09-18T02:06:07.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7e8ca9640 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6d0034650 0x7fa6d0036b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8000f70 tx=0x7fa7d80c0460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa7e94aa640 1 --2- 172.21.15.167:0/884425911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba5ddb0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000a440 tx=0x7fa7e000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61420ad8e8a59816 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa6ceffd640 1 -- 172.21.15.167:0/884425911 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e0008850 con 0x5604eba5d9b0 2024-09-18T02:06:07.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa6ceffd640 1 -- 172.21.15.167:0/884425911 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e0008a10 con 0x5604eba5d9b0 2024-09-18T02:06:07.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.863+0000 7fa6ceffd640 1 -- 172.21.15.167:0/884425911 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e0008d30 con 0x5604eba5d9b0 2024-09-18T02:06:07.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 -- 172.21.15.167:0/884425911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 msgr2=0x5604eba5ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 --2- 172.21.15.167:0/884425911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba5ddb0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000a440 tx=0x7fa7e000a900 comp rx=0 tx=0).stop 2024-09-18T02:06:07.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 -- 172.21.15.167:0/884425911 shutdown_connections 2024-09-18T02:06:07.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 --2- 172.21.15.167:0/884425911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba5ddb0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 -- 172.21.15.167:0/884425911 >> 172.21.15.167:0/884425911 conn(0x5604eb95deb0 msgr2=0x5604eba592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 -- 172.21.15.167:0/884425911 shutdown_connections 2024-09-18T02:06:07.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 -- 172.21.15.167:0/884425911 wait complete. 2024-09-18T02:06:07.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 Processor -- start 2024-09-18T02:06:07.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 -- start start 2024-09-18T02:06:07.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba64d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604eba5ecd0 con 0x5604eba5d9b0 2024-09-18T02:06:07.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7e94aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba64d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7e94aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba64d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50256/0 (socket says 172.21.15.167:50256) 2024-09-18T02:06:07.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7e94aa640 1 -- 172.21.15.167:0/220348194 learned_addr learned my addr 172.21.15.167:0/220348194 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7e94aa640 1 -- 172.21.15.167:0/220348194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604eba65290 con 0x5604eba5d9b0 2024-09-18T02:06:07.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7e94aa640 1 --2- 172.21.15.167:0/220348194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba64d50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5604eba5e760 tx=0x7fa7e0003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa6cd7fa640 1 -- 172.21.15.167:0/220348194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e0013a70 con 0x5604eba5d9b0 2024-09-18T02:06:07.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa6cd7fa640 1 -- 172.21.15.167:0/220348194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e0023070 con 0x5604eba5d9b0 2024-09-18T02:06:07.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 -- 172.21.15.167:0/220348194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604eba65520 con 0x5604eba5d9b0 2024-09-18T02:06:07.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa6cd7fa640 1 -- 172.21.15.167:0/220348194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e0013d40 con 0x5604eba5d9b0 2024-09-18T02:06:07.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 -- 172.21.15.167:0/220348194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604eba68200 con 0x5604eba5d9b0 2024-09-18T02:06:07.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:07.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:07.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa6cd7fa640 1 -- 172.21.15.167:0/220348194 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa7e0028460 con 0x5604eba5d9b0 2024-09-18T02:06:07.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa6cd7fa640 1 --2- 172.21.15.167:0/220348194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6c0034650 0x7fa6c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.867+0000 7fa7eb199980 1 Processor -- start 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa6cd7fa640 1 -- 172.21.15.167:0/220348194 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa7e0049fa0 con 0x5604eba5d9b0 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7e94aa640 1 --2- 172.21.15.167:0/220348194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6c0034650 0x7fa6c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7eb199980 1 -- start start 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7eb199980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba7e670 0x5604eba7ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7eb199980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604eb8d3480 con 0x5604eba7e670 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7e94aa640 1 --2- 172.21.15.167:0/220348194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6c0034650 0x7fa6c0036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa7e001e590 tx=0x7fa7e001e460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7e8ca9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba7e670 0x5604eba7ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7e8ca9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba7e670 0x5604eba7ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50260/0 (socket says 172.21.15.167:50260) 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7e8ca9640 1 -- 172.21.15.167:0/3411990220 learned_addr learned my addr 172.21.15.167:0/3411990220 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7e8ca9640 1 -- 172.21.15.167:0/3411990220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604eba7f060 con 0x5604eba7e670 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7e8ca9640 1 --2- 172.21.15.167:0/3411990220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba7e670 0x5604eba7ea90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80b68f0 tx=0x7fa7d8005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa6ad7e2640 1 -- 172.21.15.167:0/3411990220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d80dc050 con 0x5604eba7e670 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7eb199980 1 -- 172.21.15.167:0/3411990220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604eba81bc0 con 0x5604eba7e670 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa6ad7e2640 1 -- 172.21.15.167:0/3411990220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d80da030 con 0x5604eba7e670 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa6ad7e2640 1 -- 172.21.15.167:0/3411990220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d80bf760 con 0x5604eba7e670 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7eb199980 1 -- 172.21.15.167:0/3411990220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604eba81fc0 con 0x5604eba7e670 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa6ad7e2640 1 -- 172.21.15.167:0/3411990220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa7d80bf950 con 0x5604eba7e670 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa6ad7e2640 1 --2- 172.21.15.167:0/3411990220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6240345e0 0x7fa624036aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa6ad7e2640 1 -- 172.21.15.167:0/3411990220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa7d80b9130 con 0x5604eba7e670 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7e84a8640 1 --2- 172.21.15.167:0/3411990220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6240345e0 0x7fa624036aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa62effd640 20 reqs_thread_entry: start 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604eba84180 0x5604eba86570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604eba86bb0 con 0x5604eba84180 2024-09-18T02:06:07.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7e84a8640 1 --2- 172.21.15.167:0/3411990220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6240345e0 0x7fa624036aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x5604eba59e60 tx=0x7fa7dc001280 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.871+0000 7fa7e94aa640 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604eba84180 0x5604eba86570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7e94aa640 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604eba84180 0x5604eba86570 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7e94aa640 1 -- 172.21.15.167:0/3694964536 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7e001e7a0 con 0x5604eba84180 2024-09-18T02:06:07.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604eba87130 con 0x5604eba84180 2024-09-18T02:06:07.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7e94aa640 1 -- 172.21.15.167:0/3694964536 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7e001e7a0 con 0x5604eba84180 2024-09-18T02:06:07.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604eba88d50 0x5604eba8b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:3 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604eba8b8d0 con 0x5604eba88d50 2024-09-18T02:06:07.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7e8ca9640 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604eba88d50 0x5604eba8b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7e8ca9640 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604eba88d50 0x5604eba8b1e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7e8ca9640 1 -- 172.21.15.167:0/3694964536 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(3 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa7d80df070 con 0x5604eba88d50 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/220348194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6c0034650 msgr2=0x7fa6c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/220348194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6c0034650 0x7fa6c0036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa7e001e590 tx=0x7fa7e001e460 comp rx=0 tx=0).stop 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/220348194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 msgr2=0x5604eba64d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/220348194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba64d50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5604eba5e760 tx=0x7fa7e0003000 comp rx=0 tx=0).stop 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/220348194 shutdown_connections 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/220348194 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6c0034650 0x7fa6c0036b10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/220348194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba5d9b0 0x5604eba64d50 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/220348194 >> 172.21.15.167:0/220348194 conn(0x5604eb95deb0 msgr2=0x5604eba58e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/220348194 shutdown_connections 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/220348194 wait complete. 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3411990220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6240345e0 msgr2=0x7fa624036aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3411990220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6240345e0 0x7fa624036aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x5604eba59e60 tx=0x7fa7dc001280 comp rx=0 tx=0).stop 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3411990220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba7e670 msgr2=0x5604eba7ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3411990220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba7e670 0x5604eba7ea90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80b68f0 tx=0x7fa7d8005470 comp rx=0 tx=0).stop 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3411990220 shutdown_connections 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3411990220 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6240345e0 0x7fa624036aa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3411990220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eba7e670 0x5604eba7ea90 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3411990220 >> 172.21.15.167:0/3411990220 conn(0x5604eba73640 msgr2=0x5604eba75f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3411990220 shutdown_connections 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3411990220 wait complete. 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604eba84180 msgr2=0x5604eba86570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604eba84180 0x5604eba86570 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604eba88d50 msgr2=0x5604eba8b1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604eba88d50 0x5604eba8b1e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6d0034650 msgr2=0x7fa6d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6d0034650 0x7fa6d0036b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8000f70 tx=0x7fa7d80c0460 comp rx=0 tx=0).stop 2024-09-18T02:06:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 msgr2=0x5604eba50ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.875+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eba50ba0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa7d801b870 tx=0x7fa7d8019810 comp rx=0 tx=0).stop 2024-09-18T02:06:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.879+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 shutdown_connections 2024-09-18T02:06:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.879+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5604eba84180 0x5604eba86570 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.879+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5604eba88d50 0x5604eba8b1e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.879+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa6d0034650 0x7fa6d0036b10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.879+0000 7fa7eb199980 1 --2- 172.21.15.167:0/3694964536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604eb95d560 0x5604eba50ba0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.879+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 >> 172.21.15.167:0/3694964536 conn(0x5604eb959080 msgr2=0x5604eba43060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.879+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 shutdown_connections 2024-09-18T02:06:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.879+0000 7fa7eb199980 1 -- 172.21.15.167:0/3694964536 wait complete. 2024-09-18T02:06:07.892 INFO:teuthology.orchestra.run.smithi167.stdout:{"id":"b6f58232-12d9-447d-8d4f-091dad0fc7cc","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"c5231f36-c36e-44d5-8268-aaf52617db58","zones":[{"id":"c5231f36-c36e-44d5-8268-aaf52617db58","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-18T02:06:07.892 DEBUG:tasks.util.rgw: json result: {'id': 'b6f58232-12d9-447d-8d4f-091dad0fc7cc', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'c5231f36-c36e-44d5-8268-aaf52617db58', 'zones': [{'id': 'c5231f36-c36e-44d5-8268-aaf52617db58', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-18T02:06:07.895 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-18T02:06:07.915 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-18T02:06:07.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-18T02:06:07.915 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-18T02:06:07.984 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:07.985 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:07.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.983+0000 7fa8610c6980 1 Processor -- start 2024-09-18T02:06:07.985 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.983+0000 7fa8610c6980 1 -- start start 2024-09-18T02:06:07.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.983+0000 7fa8610c6980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55cae46d3a60 0x55cae4762310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:07.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.983+0000 7fa8610c6980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cae45e7ae0 con 0x55cae4762850 2024-09-18T02:06:07.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.983+0000 7fa8610c6980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55cae460be30 con 0x55cae46d3a60 2024-09-18T02:06:07.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.983+0000 7fa85ebd6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55cae46d3a60 0x55cae4762310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:07.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.983+0000 7fa85e3d5640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55cae4762850 0x55cae4764c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33858/0 (socket says 172.21.15.167:33858) 2024-09-18T02:06:07.986 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.983+0000 7fa85e3d5640 1 -- 172.21.15.167:0/3656752768 learned_addr learned my addr 172.21.15.167:0/3656752768 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:07.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.983+0000 7fa85ebd6640 1 -- 172.21.15.167:0/3656752768 >> v1:172.21.15.81:6789/0 conn(0x55cae4762850 legacy=0x55cae4764c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.987 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.983+0000 7fa85ebd6640 1 -- 172.21.15.167:0/3656752768 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cae4767370 con 0x55cae46d3a60 2024-09-18T02:06:07.990 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.987+0000 7fa85ebd6640 1 --2- 172.21.15.167:0/3656752768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae4762310 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa85000a480 tx=0x7fa85001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05f62f5cb393f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:07.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.987+0000 7fa85dbd4640 1 -- 172.21.15.167:0/3656752768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8500b0070 con 0x55cae46d3a60 2024-09-18T02:06:07.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.987+0000 7fa85dbd4640 1 -- 172.21.15.167:0/3656752768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8500ab540 con 0x55cae46d3a60 2024-09-18T02:06:07.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.987+0000 7fa85dbd4640 1 -- 172.21.15.167:0/3656752768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8500ab840 con 0x55cae46d3a60 2024-09-18T02:06:07.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.987+0000 7fa8610c6980 1 -- 172.21.15.167:0/3656752768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 msgr2=0x55cae4762310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:07.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.987+0000 7fa8610c6980 1 --2- 172.21.15.167:0/3656752768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae4762310 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa85000a480 tx=0x7fa85001b280 comp rx=0 tx=0).stop 2024-09-18T02:06:07.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.987+0000 7fa8610c6980 1 -- 172.21.15.167:0/3656752768 shutdown_connections 2024-09-18T02:06:07.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.987+0000 7fa8610c6980 1 --2- 172.21.15.167:0/3656752768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae4762310 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:07.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.987+0000 7fa8610c6980 1 -- 172.21.15.167:0/3656752768 >> 172.21.15.167:0/3656752768 conn(0x55cae475a000 msgr2=0x55cae475c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:07.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.987+0000 7fa8610c6980 1 -- 172.21.15.167:0/3656752768 shutdown_connections 2024-09-18T02:06:07.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:07.987+0000 7fa8610c6980 1 -- 172.21.15.167:0/3656752768 wait complete. 2024-09-18T02:06:08.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.003+0000 7fa8610c6980 1 Processor -- start 2024-09-18T02:06:08.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.003+0000 7fa8610c6980 1 -- start start 2024-09-18T02:06:08.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.003+0000 7fa8610c6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae475fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.003+0000 7fa8610c6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cae460d200 con 0x55cae46d3a60 2024-09-18T02:06:08.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.003+0000 7fa85ebd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae475fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.003+0000 7fa85ebd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae475fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50266/0 (socket says 172.21.15.167:50266) 2024-09-18T02:06:08.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.003+0000 7fa85ebd6640 1 -- 172.21.15.167:0/3022319120 learned_addr learned my addr 172.21.15.167:0/3022319120 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.003+0000 7fa85ebd6640 1 -- 172.21.15.167:0/3022319120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cae4760040 con 0x55cae46d3a60 2024-09-18T02:06:08.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.003+0000 7fa85ebd6640 1 --2- 172.21.15.167:0/3022319120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae475fa70 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa8500ae040 tx=0x7fa850003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167cacf7cc8d4068 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa74ce09640 1 -- 172.21.15.167:0/3022319120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8500b0040 con 0x55cae46d3a60 2024-09-18T02:06:08.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa74ce09640 1 -- 172.21.15.167:0/3022319120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8500ab9d0 con 0x55cae46d3a60 2024-09-18T02:06:08.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa74ce09640 1 -- 172.21.15.167:0/3022319120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8500abcf0 con 0x55cae46d3a60 2024-09-18T02:06:08.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 -- 172.21.15.167:0/3022319120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 msgr2=0x55cae475fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 --2- 172.21.15.167:0/3022319120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae475fa70 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa8500ae040 tx=0x7fa850003030 comp rx=0 tx=0).stop 2024-09-18T02:06:08.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 -- 172.21.15.167:0/3022319120 shutdown_connections 2024-09-18T02:06:08.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 --2- 172.21.15.167:0/3022319120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae475fa70 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 -- 172.21.15.167:0/3022319120 >> 172.21.15.167:0/3022319120 conn(0x55cae475a000 msgr2=0x55cae48467a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 -- 172.21.15.167:0/3022319120 shutdown_connections 2024-09-18T02:06:08.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 -- 172.21.15.167:0/3022319120 wait complete. 2024-09-18T02:06:08.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 Processor -- start 2024-09-18T02:06:08.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 -- start start 2024-09-18T02:06:08.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae48540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cae4766db0 con 0x55cae46d3a60 2024-09-18T02:06:08.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa85ebd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae48540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa85ebd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae48540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50276/0 (socket says 172.21.15.167:50276) 2024-09-18T02:06:08.011 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa85ebd6640 1 -- 172.21.15.167:0/2002740347 learned_addr learned my addr 172.21.15.167:0/2002740347 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa85ebd6640 1 -- 172.21.15.167:0/2002740347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cae48545e0 con 0x55cae46d3a60 2024-09-18T02:06:08.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa85ebd6640 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae48540a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa85001b2c0 tx=0x7fa850018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa74b606640 1 -- 172.21.15.167:0/2002740347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8500c5070 con 0x55cae46d3a60 2024-09-18T02:06:08.012 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa74b606640 1 -- 172.21.15.167:0/2002740347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8500b6830 con 0x55cae46d3a60 2024-09-18T02:06:08.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cae4854870 con 0x55cae46d3a60 2024-09-18T02:06:08.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa74b606640 1 -- 172.21.15.167:0/2002740347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8500b0050 con 0x55cae46d3a60 2024-09-18T02:06:08.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.007+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cae4857550 con 0x55cae46d3a60 2024-09-18T02:06:08.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa74b606640 1 -- 172.21.15.167:0/2002740347 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa8500b6b30 con 0x55cae46d3a60 2024-09-18T02:06:08.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa74b606640 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa7440346a0 0x7fa744036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa74b606640 1 -- 172.21.15.167:0/2002740347 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa8500bc070 con 0x55cae46d3a60 2024-09-18T02:06:08.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa85e3d5640 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa7440346a0 0x7fa744036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55cae4762850 0x55cae485b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae485b6a0 con 0x55cae4762850 2024-09-18T02:06:08.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa85f3d7640 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55cae4762850 0x55cae485b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa85e3d5640 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa7440346a0 0x7fa744036b60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa848001da0 tx=0x7fa848001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa85f3d7640 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55cae4762850 0x55cae485b030 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa85f3d7640 1 -- 172.21.15.167:0/2002740347 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4762850 2024-09-18T02:06:08.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae485bf90 con 0x55cae4762850 2024-09-18T02:06:08.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa85f3d7640 1 -- 172.21.15.167:0/2002740347 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4762850 2024-09-18T02:06:08.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55cae485d8a0 0x55cae485fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae48604f0 con 0x55cae485d8a0 2024-09-18T02:06:08.016 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa85ebd6640 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55cae485d8a0 0x55cae485fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.011+0000 7fa85ebd6640 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55cae485d8a0 0x55cae485fd60 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa85ebd6640 1 -- 172.21.15.167:0/2002740347 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa8500b3040 con 0x55cae485d8a0 2024-09-18T02:06:08.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae485c7e0 con 0x55cae4762850 2024-09-18T02:06:08.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa85f3d7640 1 -- 172.21.15.167:0/2002740347 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4762850 2024-09-18T02:06:08.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55cae4861950 0x55cae4863d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae4864430 con 0x55cae4861950 2024-09-18T02:06:08.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa85e3d5640 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55cae4861950 0x55cae4863d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa85e3d5640 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55cae4861950 0x55cae4863d40 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa85e3d5640 1 -- 172.21.15.167:0/2002740347 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4861950 2024-09-18T02:06:08.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa8610c6980 1 Processor -- start 2024-09-18T02:06:08.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa8610c6980 1 -- start start 2024-09-18T02:06:08.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa8610c6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae4871f00 0x55cae4872320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa8610c6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cae4666800 con 0x55cae4871f00 2024-09-18T02:06:08.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa85ebd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae4871f00 0x55cae4872320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa85ebd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae4871f00 0x55cae4872320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50280/0 (socket says 172.21.15.167:50280) 2024-09-18T02:06:08.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa85ebd6640 1 -- 172.21.15.167:0/2849232898 learned_addr learned my addr 172.21.15.167:0/2849232898 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa85ebd6640 1 -- 172.21.15.167:0/2849232898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cae4872860 con 0x55cae4871f00 2024-09-18T02:06:08.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa85ebd6640 1 --2- 172.21.15.167:0/2849232898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae4871f00 0x55cae4872320 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa8500e25d0 tx=0x7fa8500b5db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa748e01640 1 -- 172.21.15.167:0/2849232898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8500b6e20 con 0x55cae4871f00 2024-09-18T02:06:08.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa748e01640 1 -- 172.21.15.167:0/2849232898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8500e1120 con 0x55cae4871f00 2024-09-18T02:06:08.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa8610c6980 1 -- 172.21.15.167:0/2849232898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cae4872af0 con 0x55cae4871f00 2024-09-18T02:06:08.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa748e01640 1 -- 172.21.15.167:0/2849232898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8500aa830 con 0x55cae4871f00 2024-09-18T02:06:08.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.015+0000 7fa8610c6980 1 -- 172.21.15.167:0/2849232898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cae4875770 con 0x55cae4871f00 2024-09-18T02:06:08.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa748e01640 1 -- 172.21.15.167:0/2849232898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa8500aa9d0 con 0x55cae4871f00 2024-09-18T02:06:08.024 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa748e01640 1 --2- 172.21.15.167:0/2849232898 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa7380346a0 0x7fa738036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa748e01640 1 -- 172.21.15.167:0/2849232898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa8500a8070 con 0x55cae4871f00 2024-09-18T02:06:08.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa85e3d5640 1 --2- 172.21.15.167:0/2849232898 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa7380346a0 0x7fa738036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 Processor -- start 2024-09-18T02:06:08.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 -- start start 2024-09-18T02:06:08.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa85e3d5640 1 --2- 172.21.15.167:0/2849232898 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa7380346a0 0x7fa738036b60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55cae48587b0 tx=0x7fa84800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae487ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cae475e1a0 con 0x55cae487e850 2024-09-18T02:06:08.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa85ebd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae487ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa85ebd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae487ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50286/0 (socket says 172.21.15.167:50286) 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1267701901 learned_addr learned my addr 172.21.15.167:0/1267701901 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1267701901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cae487f200 con 0x55cae487e850 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa85ebd6640 1 --2- 172.21.15.167:0/1267701901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae487ec30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa8500b4a50 tx=0x7fa8500d4f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da64e16ac0ac4e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa7427fc640 1 -- 172.21.15.167:0/1267701901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8500fa020 con 0x55cae487e850 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa7427fc640 1 -- 172.21.15.167:0/1267701901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8500e8a70 con 0x55cae487e850 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa7427fc640 1 -- 172.21.15.167:0/1267701901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8500e8e60 con 0x55cae487e850 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 -- 172.21.15.167:0/1267701901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 msgr2=0x55cae487ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1267701901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae487ec30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa8500b4a50 tx=0x7fa8500d4f20 comp rx=0 tx=0).stop 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 -- 172.21.15.167:0/1267701901 shutdown_connections 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1267701901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae487ec30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 -- 172.21.15.167:0/1267701901 >> 172.21.15.167:0/1267701901 conn(0x55cae487ac30 msgr2=0x55cae4878d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 -- 172.21.15.167:0/1267701901 shutdown_connections 2024-09-18T02:06:08.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 -- 172.21.15.167:0/1267701901 wait complete. 2024-09-18T02:06:08.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.019+0000 7fa8610c6980 1 Processor -- start 2024-09-18T02:06:08.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa8610c6980 1 -- start start 2024-09-18T02:06:08.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa8610c6980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae48859e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa8610c6980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cae487f6a0 con 0x55cae487e850 2024-09-18T02:06:08.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa85ebd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae48859e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa85ebd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae48859e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50300/0 (socket says 172.21.15.167:50300) 2024-09-18T02:06:08.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 learned_addr learned my addr 172.21.15.167:0/1281523308 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.031 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cae4885f20 con 0x55cae487e850 2024-09-18T02:06:08.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa85ebd6640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae48859e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa8500e8a20 tx=0x7fa8500f4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa740ff9640 1 -- 172.21.15.167:0/1281523308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa85010e070 con 0x55cae487e850 2024-09-18T02:06:08.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa740ff9640 1 -- 172.21.15.167:0/1281523308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8500bfc40 con 0x55cae487e850 2024-09-18T02:06:08.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cae4885f20 con 0x55cae487e850 2024-09-18T02:06:08.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa740ff9640 1 -- 172.21.15.167:0/1281523308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8500e27e0 con 0x55cae487e850 2024-09-18T02:06:08.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cae4885f20 con 0x55cae487e850 2024-09-18T02:06:08.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa740ff9640 1 -- 172.21.15.167:0/1281523308 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa850111070 con 0x55cae487e850 2024-09-18T02:06:08.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa740ff9640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa728034650 0x7fa728036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa740ff9640 1 -- 172.21.15.167:0/1281523308 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa850106050 con 0x55cae487e850 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa85e3d5640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa728034650 0x7fa728036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55cae4890980 0x55cae4892e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae4893590 con 0x55cae4890980 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa85f3d7640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55cae4890980 0x55cae4892e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa85e3d5640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa728034650 0x7fa728036b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55cae4864830 tx=0x7fa848010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.023+0000 7fa85f3d7640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55cae4890980 0x55cae4892e40 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 20 realm 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae48939a0 con 0x55cae4890980 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894270 con 0x55cae4890980 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4890980 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:08.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55cae4895370 0x55cae4897760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae4897d70 con 0x55cae4895370 2024-09-18T02:06:08.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85ebd6640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55cae4895370 0x55cae4897760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85ebd6640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55cae4895370 0x55cae4897760 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:08.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 20 searching for the correct realm 2024-09-18T02:06:08.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55cae4899cc0 0x55cae489c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae489c7a0 con 0x55cae4899cc0 2024-09-18T02:06:08.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85e3d5640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55cae4899cc0 0x55cae489c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85e3d5640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55cae4899cc0 0x55cae489c0d0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85e3d5640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa848037040 0x7fa848036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae489c7a0 con 0x7fa848037040 2024-09-18T02:06:08.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.027+0000 7fa85f3d7640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa848037040 0x7fa848036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa848037040 0x7fa848036410 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x7fa848037040 2024-09-18T02:06:08.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4890980 2024-09-18T02:06:08.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4890980 2024-09-18T02:06:08.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4890980 2024-09-18T02:06:08.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4895370 2024-09-18T02:06:08.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x7fa848037040 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4899cc0 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4890980 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x7fa848037040 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4890980 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.031+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x7fa848037040 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4899cc0 2024-09-18T02:06:08.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4899cc0 2024-09-18T02:06:08.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4895370 2024-09-18T02:06:08.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4899cc0 2024-09-18T02:06:08.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4899cc0 2024-09-18T02:06:08.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4890980 2024-09-18T02:06:08.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4890980 2024-09-18T02:06:08.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cae4894610 con 0x55cae4895370 2024-09-18T02:06:08.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa850120040 con 0x55cae4899cc0 2024-09-18T02:06:08.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa850120040 con 0x7fa848037040 2024-09-18T02:06:08.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.035+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa850120040 con 0x55cae4890980 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa850120040 con 0x55cae4895370 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa850120040 con 0x55cae4899cc0 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa850120040 con 0x55cae4895370 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa850120040 con 0x7fa848037040 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa850120040 con 0x55cae4899cc0 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa850120040 con 0x55cae4895370 2024-09-18T02:06:08.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa850120040 con 0x55cae4890980 2024-09-18T02:06:08.051 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa850120040 con 0x7fa848037040 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa8610c6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa8610c6980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa8610c6980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa8610c6980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa8610c6980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa8610c6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.039+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae4898630 con 0x55cae4890980 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae4898630 con 0x55cae4890980 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae4898630 con 0x55cae4899cc0 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 zone default found 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 4 Realm: () 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:08.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 zonegroup default 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae4898f90 con 0x55cae4895370 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae489e660 con 0x55cae4899cc0 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae489eaf0 con 0x55cae4899cc0 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 started sync module instance, tier type = 2024-09-18T02:06:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae489daa0 con 0x7fa848037040 2024-09-18T02:06:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94329905995760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae489daa0 con 0x7fa848037040 2024-09-18T02:06:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.043+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae489f600 con 0x55cae4890980 2024-09-18T02:06:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.047+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94329905995760] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.047+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.047+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94329906000112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae489daa0 con 0x55cae4890980 2024-09-18T02:06:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.047+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a0010 con 0x55cae4899cc0 2024-09-18T02:06:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.051+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94329906000112] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.051+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.051+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94329905993200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae489da10 con 0x55cae4899cc0 2024-09-18T02:06:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.051+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a0d60 con 0x7fa848037040 2024-09-18T02:06:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.051+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.051+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94329906006464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a1470 con 0x7fa848037040 2024-09-18T02:06:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.051+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a1f90 con 0x55cae4890980 2024-09-18T02:06:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.051+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94329905993200] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.051+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94329906006464] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.055+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.055+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94329906010720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a1f50 con 0x55cae4890980 2024-09-18T02:06:08.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.055+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a2380 con 0x55cae4895370 2024-09-18T02:06:08.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.055+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94329906010720] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.055+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.055+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94329906007744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a2770 con 0x55cae4895370 2024-09-18T02:06:08.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.055+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a3000 con 0x55cae4895370 2024-09-18T02:06:08.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94329906007744] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94329906004992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a2c30 con 0x55cae4895370 2024-09-18T02:06:08.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a3de0 con 0x55cae4895370 2024-09-18T02:06:08.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94329906018480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a3da0 con 0x55cae4895370 2024-09-18T02:06:08.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa8610c6980 20 add_watcher() i=0 2024-09-18T02:06:08.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa8610c6980 20 add_watcher() i=1 2024-09-18T02:06:08.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa8610c6980 20 add_watcher() i=2 2024-09-18T02:06:08.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa8610c6980 20 add_watcher() i=3 2024-09-18T02:06:08.066 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa8610c6980 20 add_watcher() i=4 2024-09-18T02:06:08.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa8610c6980 20 add_watcher() i=5 2024-09-18T02:06:08.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94329906004992] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.059+0000 7fa8610c6980 20 add_watcher() i=6 2024-09-18T02:06:08.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94329906018480] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 20 add_watcher() i=7 2024-09-18T02:06:08.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:08.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a31e0 con 0x55cae4890980 2024-09-18T02:06:08.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94329906020816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48a31e0 con 0x55cae4890980 2024-09-18T02:06:08.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94329906020816] v32'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa7157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 5 note: GC not initialized 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa68ffff640 20 reqs_thread_entry: start 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 20 Filter name: none 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa68dffb640 20 reqs_thread_entry: start 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.063+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae48ca940 con 0x55cae4895370 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-18T02:06:08.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:08.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-18T02:06:08.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae48c90e0 con 0x55cae4890980 2024-09-18T02:06:08.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-18T02:06:08.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-18T02:06:08.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-18T02:06:08.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-18T02:06:08.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48c9b00 con 0x55cae4895370 2024-09-18T02:06:08.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:08.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:08.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T02:06:08.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94329906173216 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae48ce410 con 0x55cae4890980 2024-09-18T02:06:08.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== watch-notify(notify (1) cookie 94329906010720 notify 137438953491 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7fa858018cb0 con 0x55cae4890980 2024-09-18T02:06:08.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa7427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94329906010720 notifier 4837 bl.length()=649 2024-09-18T02:06:08.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa7427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:08.073 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa7427fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:08.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify cookie 94329906173216 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa7427fc640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa724003eb0 con 0x55cae4890980 2024-09-18T02:06:08.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.067+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== watch-notify(notify_complete (2) cookie 94329906173216 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa858045440 con 0x55cae4890980 2024-09-18T02:06:08.074 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48c9520 con 0x55cae4890980 2024-09-18T02:06:08.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v32'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa8610c6980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-18T02:06:08.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa8610c6980 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-18T02:06:08.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa8610c6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-18T02:06:08.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94329906173216 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cae48ce410 con 0x55cae4899cc0 2024-09-18T02:06:08.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== watch-notify(notify (1) cookie 94329905993200 notify 137438953490 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fa848041080 con 0x55cae4899cc0 2024-09-18T02:06:08.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa7427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94329905993200 notifier 4837 bl.length()=177 2024-09-18T02:06:08.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa7427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-18T02:06:08.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa7427fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-18T02:06:08.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa7427fc640 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa724003eb0 con 0x55cae4899cc0 2024-09-18T02:06:08.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(68 notify.2 [notify cookie 94329906173216 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== watch-notify(notify_complete (2) cookie 94329906173216 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cae45e7ae0 con 0x55cae4899cc0 2024-09-18T02:06:08.076 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T02:06:08.069645Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.069630Z","tags":[],"group_ids":[]} 2024-09-18T02:06:08.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa7157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:08.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.071+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94329906020816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48c86e0 con 0x55cae4890980 2024-09-18T02:06:08.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.075+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94329906020816] v32'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.075+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94329905995760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48c86e0 con 0x7fa848037040 2024-09-18T02:06:08.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.075+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94329905995760] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.075+0000 7fa8610c6980 20 remove_watcher() i=0 2024-09-18T02:06:08.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.075+0000 7fa8610c6980 2 removed watcher, disabling cache 2024-09-18T02:06:08.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.075+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94329906000112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae489dff0 con 0x55cae4890980 2024-09-18T02:06:08.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.079+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94329906000112] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.079+0000 7fa8610c6980 20 remove_watcher() i=1 2024-09-18T02:06:08.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.079+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94329905993200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48c86e0 con 0x55cae4899cc0 2024-09-18T02:06:08.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.079+0000 7fa85e3d5640 1 -- 172.21.15.167:0/1281523308 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94329905993200] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84800e6c0 con 0x55cae4899cc0 2024-09-18T02:06:08.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.079+0000 7fa8610c6980 20 remove_watcher() i=2 2024-09-18T02:06:08.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.079+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94329906006464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae489f0f0 con 0x7fa848037040 2024-09-18T02:06:08.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.079+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94329906006464] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x7fa848037040 2024-09-18T02:06:08.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.079+0000 7fa8610c6980 20 remove_watcher() i=3 2024-09-18T02:06:08.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.079+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94329906010720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae489d5f0 con 0x55cae4890980 2024-09-18T02:06:08.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.083+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94329906010720] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa85800a4d0 con 0x55cae4890980 2024-09-18T02:06:08.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.083+0000 7fa8610c6980 20 remove_watcher() i=4 2024-09-18T02:06:08.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.083+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94329906007744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae48c86e0 con 0x55cae4895370 2024-09-18T02:06:08.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.083+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94329906007744] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.083+0000 7fa8610c6980 20 remove_watcher() i=5 2024-09-18T02:06:08.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.083+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94329906004992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae489f0f0 con 0x55cae4895370 2024-09-18T02:06:08.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.087+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94329906004992] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.087+0000 7fa8610c6980 20 remove_watcher() i=6 2024-09-18T02:06:08.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.087+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94329906018480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cae489d5f0 con 0x55cae4895370 2024-09-18T02:06:08.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.087+0000 7fa85ebd6640 1 -- 172.21.15.167:0/1281523308 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94329906018480] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa850110030 con 0x55cae4895370 2024-09-18T02:06:08.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.087+0000 7fa8610c6980 20 remove_watcher() i=7 2024-09-18T02:06:08.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.087+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55cae4895370 msgr2=0x55cae4897760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.087+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55cae4895370 0x55cae4897760 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55cae4890980 msgr2=0x55cae4892e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55cae4890980 0x55cae4892e40 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa848037040 msgr2=0x7fa848036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fa848037040 0x7fa848036410 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55cae4899cc0 msgr2=0x55cae489c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55cae4899cc0 0x55cae489c0d0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa728034650 msgr2=0x7fa728036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa728034650 0x7fa728036b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55cae4864830 tx=0x7fa848010000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 msgr2=0x55cae48859e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae48859e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa8500e8a20 tx=0x7fa8500f4000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa85f3d7640 1 -- 172.21.15.167:0/1281523308 reap_dead start 2024-09-18T02:06:08.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 shutdown_connections 2024-09-18T02:06:08.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/1281523308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae487e850 0x55cae48859e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 >> 172.21.15.167:0/1281523308 conn(0x55cae487ac30 msgr2=0x55cae4878d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 shutdown_connections 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/1281523308 wait complete. 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2849232898 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa7380346a0 msgr2=0x7fa738036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2849232898 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa7380346a0 0x7fa738036b60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55cae48587b0 tx=0x7fa84800f000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2849232898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae4871f00 msgr2=0x55cae4872320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2849232898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae4871f00 0x55cae4872320 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa8500e25d0 tx=0x7fa8500b5db0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2849232898 shutdown_connections 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2849232898 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa7380346a0 0x7fa738036b60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2849232898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae4871f00 0x55cae4872320 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2849232898 >> 172.21.15.167:0/2849232898 conn(0x55cae4867050 msgr2=0x55cae4869ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2849232898 shutdown_connections 2024-09-18T02:06:08.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2849232898 wait complete. 2024-09-18T02:06:08.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55cae485d8a0 msgr2=0x55cae485fd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55cae485d8a0 0x55cae485fd60 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55cae4762850 msgr2=0x55cae485b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55cae4762850 0x55cae485b030 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55cae4861950 msgr2=0x55cae4863d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55cae4861950 0x55cae4863d40 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa7440346a0 msgr2=0x7fa744036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa7440346a0 0x7fa744036b60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa848001da0 tx=0x7fa848001300 comp rx=0 tx=0).stop 2024-09-18T02:06:08.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 msgr2=0x55cae48540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 --2- 172.21.15.167:0/2002740347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cae46d3a60 0x55cae48540a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa85001b2c0 tx=0x7fa850018020 comp rx=0 tx=0).stop 2024-09-18T02:06:08.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa85f3d7640 1 -- 172.21.15.167:0/2002740347 reap_dead start 2024-09-18T02:06:08.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 shutdown_connections 2024-09-18T02:06:08.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 >> 172.21.15.167:0/2002740347 conn(0x55cae475a000 msgr2=0x55cae48463e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 shutdown_connections 2024-09-18T02:06:08.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.091+0000 7fa8610c6980 1 -- 172.21.15.167:0/2002740347 wait complete. 2024-09-18T02:06:08.104 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:08.104 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:08.105 ERROR:root:0 2024-09-18T02:06:08.106 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:08.113 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000cc7d3a16b0efb03e-0066ea3590-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:06:08.113 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-18T02:06:08.127 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:08.127 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-18T02:06:08.144 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-18T02:06:08.144 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-18T02:06:08.165 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-18T02:06:08.165 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-18T02:06:08.175 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-18T02:06:08.175 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:08.178 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:08.179 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-18T02:06:08.182 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:08.182 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T02:06:08.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T02:06:08.183 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-18T02:06:08.213 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:08.213 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:08.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.211+0000 7f289e831980 1 Processor -- start 2024-09-18T02:06:08.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.211+0000 7f289e831980 1 -- start start 2024-09-18T02:06:08.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.211+0000 7f289e831980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56197032c2a0 0x5619703bc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.211+0000 7f289e831980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56197023fae0 con 0x5619703bccf0 2024-09-18T02:06:08.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.211+0000 7f289e831980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x561970263e30 con 0x56197032c2a0 2024-09-18T02:06:08.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.211+0000 7f289c341640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56197032c2a0 0x5619703bc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.211+0000 7f289bb40640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5619703bccf0 0x5619703bf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33860/0 (socket says 172.21.15.167:33860) 2024-09-18T02:06:08.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.211+0000 7f289bb40640 1 -- 172.21.15.167:0/3624469257 learned_addr learned my addr 172.21.15.167:0/3624469257 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:08.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.211+0000 7f289c341640 1 -- 172.21.15.167:0/3624469257 >> v1:172.21.15.81:6789/0 conn(0x5619703bccf0 legacy=0x5619703bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.211+0000 7f289c341640 1 -- 172.21.15.167:0/3624469257 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56197032c680 con 0x56197032c2a0 2024-09-18T02:06:08.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.215+0000 7f289c341640 1 --2- 172.21.15.167:0/3624469257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619703bc7b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f288c00a420 tx=0x7f288c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469d0d6d4745f789 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.215+0000 7f289b33f640 1 -- 172.21.15.167:0/3624469257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0af070 con 0x56197032c2a0 2024-09-18T02:06:08.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.215+0000 7f289b33f640 1 -- 172.21.15.167:0/3624469257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c0aa530 con 0x56197032c2a0 2024-09-18T02:06:08.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.215+0000 7f289b33f640 1 -- 172.21.15.167:0/3624469257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0aa850 con 0x56197032c2a0 2024-09-18T02:06:08.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.215+0000 7f289e831980 1 -- 172.21.15.167:0/3624469257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 msgr2=0x5619703bc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.215+0000 7f289e831980 1 --2- 172.21.15.167:0/3624469257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619703bc7b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f288c00a420 tx=0x7f288c01afd0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.215+0000 7f289e831980 1 -- 172.21.15.167:0/3624469257 shutdown_connections 2024-09-18T02:06:08.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.215+0000 7f289e831980 1 --2- 172.21.15.167:0/3624469257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619703bc7b0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.215+0000 7f289e831980 1 -- 172.21.15.167:0/3624469257 >> 172.21.15.167:0/3624469257 conn(0x5619703b20a0 msgr2=0x5619703b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.215+0000 7f289e831980 1 -- 172.21.15.167:0/3624469257 shutdown_connections 2024-09-18T02:06:08.219 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.215+0000 7f289e831980 1 -- 172.21.15.167:0/3624469257 wait complete. 2024-09-18T02:06:08.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 Processor -- start 2024-09-18T02:06:08.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 -- start start 2024-09-18T02:06:08.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619704a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561970265200 con 0x56197032c2a0 2024-09-18T02:06:08.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289c341640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619704a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289c341640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619704a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50318/0 (socket says 172.21.15.167:50318) 2024-09-18T02:06:08.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289c341640 1 -- 172.21.15.167:0/2979414213 learned_addr learned my addr 172.21.15.167:0/2979414213 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289c341640 1 -- 172.21.15.167:0/2979414213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619704a52f0 con 0x56197032c2a0 2024-09-18T02:06:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289c341640 1 --2- 172.21.15.167:0/2979414213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619704a4d20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f288c018c00 tx=0x7f288c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3327b3741c0b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f278a60c640 1 -- 172.21.15.167:0/2979414213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0af040 con 0x56197032c2a0 2024-09-18T02:06:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f278a60c640 1 -- 172.21.15.167:0/2979414213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c0aaa60 con 0x56197032c2a0 2024-09-18T02:06:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f278a60c640 1 -- 172.21.15.167:0/2979414213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0aad60 con 0x56197032c2a0 2024-09-18T02:06:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 -- 172.21.15.167:0/2979414213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 msgr2=0x5619704a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 --2- 172.21.15.167:0/2979414213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619704a4d20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f288c018c00 tx=0x7f288c0033b0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 -- 172.21.15.167:0/2979414213 shutdown_connections 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 --2- 172.21.15.167:0/2979414213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619704a4d20 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 -- 172.21.15.167:0/2979414213 >> 172.21.15.167:0/2979414213 conn(0x5619703b20a0 msgr2=0x5619704a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 -- 172.21.15.167:0/2979414213 shutdown_connections 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 -- 172.21.15.167:0/2979414213 wait complete. 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 Processor -- start 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 -- start start 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619704abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289e831980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5619703c3230 con 0x56197032c2a0 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289c341640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619704abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289c341640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619704abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50320/0 (socket says 172.21.15.167:50320) 2024-09-18T02:06:08.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.231+0000 7f289c341640 1 -- 172.21.15.167:0/2361180582 learned_addr learned my addr 172.21.15.167:0/2361180582 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289c341640 1 -- 172.21.15.167:0/2361180582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619704ac450 con 0x56197032c2a0 2024-09-18T02:06:08.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289c341640 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619704abf10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f288c019680 tx=0x7f288c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f2788e09640 1 -- 172.21.15.167:0/2361180582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0c5070 con 0x56197032c2a0 2024-09-18T02:06:08.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f2788e09640 1 -- 172.21.15.167:0/2361180582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c0c1880 con 0x56197032c2a0 2024-09-18T02:06:08.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619704ac6e0 con 0x56197032c2a0 2024-09-18T02:06:08.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f2788e09640 1 -- 172.21.15.167:0/2361180582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0cf060 con 0x56197032c2a0 2024-09-18T02:06:08.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619704af3c0 con 0x56197032c2a0 2024-09-18T02:06:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f2788e09640 1 -- 172.21.15.167:0/2361180582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f288c0c8070 con 0x56197032c2a0 2024-09-18T02:06:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f2788e09640 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2784034650 0x7f2784036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f2788e09640 1 -- 172.21.15.167:0/2361180582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f288c0bb070 con 0x56197032c2a0 2024-09-18T02:06:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289bb40640 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2784034650 0x7f2784036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289e831980 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5619703bccf0 0x5619704b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704b34c0 con 0x5619703bccf0 2024-09-18T02:06:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289cb42640 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5619703bccf0 0x5619704b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289bb40640 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2784034650 0x7f2784036b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2890000f70 tx=0x7f28900012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289cb42640 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5619703bccf0 0x5619704b2ea0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289cb42640 1 -- 172.21.15.167:0/2361180582 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28940083f0 con 0x5619703bccf0 2024-09-18T02:06:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704b05e0 con 0x5619703bccf0 2024-09-18T02:06:08.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289cb42640 1 -- 172.21.15.167:0/2361180582 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28940083f0 con 0x5619703bccf0 2024-09-18T02:06:08.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289e831980 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5619704b5860 0x5619704b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.235+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704b8320 con 0x5619704b5860 2024-09-18T02:06:08.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289c341640 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5619704b5860 0x5619704b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289c341640 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5619704b5860 0x5619704b7c50 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289c341640 1 -- 172.21.15.167:0/2361180582 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704b5860 2024-09-18T02:06:08.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704b4700 con 0x5619703bccf0 2024-09-18T02:06:08.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289cb42640 1 -- 172.21.15.167:0/2361180582 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28940083f0 con 0x5619703bccf0 2024-09-18T02:06:08.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289e831980 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5619704b9760 0x5619704bbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704bc2e0 con 0x5619704b9760 2024-09-18T02:06:08.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289bb40640 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5619704b9760 0x5619704bbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289bb40640 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5619704b9760 0x5619704bbb50 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289bb40640 1 -- 172.21.15.167:0/2361180582 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f289000e620 con 0x5619704b9760 2024-09-18T02:06:08.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289e831980 1 Processor -- start 2024-09-18T02:06:08.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289e831980 1 -- start start 2024-09-18T02:06:08.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289e831980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704c9d70 0x5619704ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289e831980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5619702be800 con 0x5619704c9d70 2024-09-18T02:06:08.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289c341640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704c9d70 0x5619704ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289c341640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704c9d70 0x5619704ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50334/0 (socket says 172.21.15.167:50334) 2024-09-18T02:06:08.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.239+0000 7f289c341640 1 -- 172.21.15.167:0/334900316 learned_addr learned my addr 172.21.15.167:0/334900316 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289c341640 1 -- 172.21.15.167:0/334900316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619704ca6d0 con 0x5619704c9d70 2024-09-18T02:06:08.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289c341640 1 --2- 172.21.15.167:0/334900316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704c9d70 0x5619704ca190 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f288c005710 tx=0x7f288c0d9350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f2781ffb640 1 -- 172.21.15.167:0/334900316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0d3850 con 0x5619704c9d70 2024-09-18T02:06:08.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289e831980 1 -- 172.21.15.167:0/334900316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619704ca960 con 0x5619704c9d70 2024-09-18T02:06:08.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f2781ffb640 1 -- 172.21.15.167:0/334900316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c0d39f0 con 0x5619704c9d70 2024-09-18T02:06:08.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f2781ffb640 1 -- 172.21.15.167:0/334900316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0e3870 con 0x5619704c9d70 2024-09-18T02:06:08.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289e831980 1 -- 172.21.15.167:0/334900316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619704cd5e0 con 0x5619704c9d70 2024-09-18T02:06:08.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f2781ffb640 1 -- 172.21.15.167:0/334900316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f288c0e3a10 con 0x5619704c9d70 2024-09-18T02:06:08.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f2781ffb640 1 --2- 172.21.15.167:0/334900316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2774034650 0x7f2774036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f2781ffb640 1 -- 172.21.15.167:0/334900316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f288c0e1030 con 0x5619704c9d70 2024-09-18T02:06:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289bb40640 1 --2- 172.21.15.167:0/334900316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2774034650 0x7f2774036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289e831980 1 Processor -- start 2024-09-18T02:06:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289e831980 1 -- start start 2024-09-18T02:06:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289bb40640 1 --2- 172.21.15.167:0/334900316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2774034650 0x7f2774036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f289000bf60 tx=0x7f289000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289e831980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704d6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289e831980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5619704a55b0 con 0x5619704d6710 2024-09-18T02:06:08.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289c341640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704d6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289c341640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704d6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50340/0 (socket says 172.21.15.167:50340) 2024-09-18T02:06:08.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289c341640 1 -- 172.21.15.167:0/2902386971 learned_addr learned my addr 172.21.15.167:0/2902386971 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289c341640 1 -- 172.21.15.167:0/2902386971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619704d70c0 con 0x5619704d6710 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f289c341640 1 --2- 172.21.15.167:0/2902386971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704d6af0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f288c0e5010 tx=0x7f288c0c2bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa63c7624fe28af server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.243+0000 7f277b7fe640 1 -- 172.21.15.167:0/2902386971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0d9580 con 0x5619704d6710 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f277b7fe640 1 -- 172.21.15.167:0/2902386971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c0c2470 con 0x5619704d6710 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f277b7fe640 1 -- 172.21.15.167:0/2902386971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0d9720 con 0x5619704d6710 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 -- 172.21.15.167:0/2902386971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 msgr2=0x5619704d6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 --2- 172.21.15.167:0/2902386971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704d6af0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f288c0e5010 tx=0x7f288c0c2bc0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 -- 172.21.15.167:0/2902386971 shutdown_connections 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 --2- 172.21.15.167:0/2902386971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704d6af0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 -- 172.21.15.167:0/2902386971 >> 172.21.15.167:0/2902386971 conn(0x5619704d2af0 msgr2=0x5619704d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 -- 172.21.15.167:0/2902386971 shutdown_connections 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 -- 172.21.15.167:0/2902386971 wait complete. 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 Processor -- start 2024-09-18T02:06:08.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 -- start start 2024-09-18T02:06:08.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704dd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5619704d7560 con 0x5619704d6710 2024-09-18T02:06:08.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289c341640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704dd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289c341640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704dd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50352/0 (socket says 172.21.15.167:50352) 2024-09-18T02:06:08.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 learned_addr learned my addr 172.21.15.167:0/3964063520 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619704dde10 con 0x5619704d6710 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289c341640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704dd8d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f288c0c2c90 tx=0x7f288c0c0d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f2779ffb640 1 -- 172.21.15.167:0/3964063520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c10b070 con 0x5619704d6710 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619704dde10 con 0x5619704d6710 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f2779ffb640 1 -- 172.21.15.167:0/3964063520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c0b9e60 con 0x5619704d6710 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f2779ffb640 1 -- 172.21.15.167:0/3964063520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0f1680 con 0x5619704d6710 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619704de280 con 0x5619704d6710 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f2779ffb640 1 -- 172.21.15.167:0/3964063520 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f288c104040 con 0x5619704d6710 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f2779ffb640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f276c034650 0x7f276c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f2779ffb640 1 -- 172.21.15.167:0/3964063520 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f288c0be6f0 con 0x5619704d6710 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.247+0000 7f289bb40640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f276c034650 0x7f276c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5619704e8900 0x5619704eadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.254 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704eb510 con 0x5619704e8900 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289cb42640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5619704e8900 0x5619704eadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289bb40640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f276c034650 0x7f276c036b10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5619704bc6e0 tx=0x7f2890010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289cb42640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5619704e8900 0x5619704eadc0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28940083f0 con 0x5619704e8900 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 realm 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704eb920 con 0x5619704e8900 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28940083f0 con 0x5619704e8900 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec1f0 con 0x5619704e8900 2024-09-18T02:06:08.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28940083f0 con 0x5619704e8900 2024-09-18T02:06:08.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704e8900 2024-09-18T02:06:08.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28940083f0 con 0x5619704e8900 2024-09-18T02:06:08.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:08.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5619704ed2f0 0x5619704ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704efcf0 con 0x5619704ed2f0 2024-09-18T02:06:08.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289c341640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5619704ed2f0 0x5619704ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289c341640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5619704ed2f0 0x5619704ef6e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 20 searching for the correct realm 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5619704f1c40 0x5619704f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704f4700 con 0x5619704f1c40 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289bb40640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5619704f1c40 0x5619704f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.251+0000 7f289bb40640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5619704f1c40 0x5619704f4030 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289bb40640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2890037040 0x7f2890036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704f4700 con 0x7f2890037040 2024-09-18T02:06:08.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2890037040 0x7f2890036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2890037040 0x7f2890036410 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28940083f0 con 0x7f2890037040 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x7f2890037040 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28940083f0 con 0x7f2890037040 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704e8900 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704e8900 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704e8900 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704ed2f0 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x7f2890037040 2024-09-18T02:06:08.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704f1c40 2024-09-18T02:06:08.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704e8900 2024-09-18T02:06:08.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x7f2890037040 2024-09-18T02:06:08.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704e8900 2024-09-18T02:06:08.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x7f2890037040 2024-09-18T02:06:08.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.255+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704f1c40 2024-09-18T02:06:08.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704f1c40 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704ed2f0 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704f1c40 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704f1c40 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704e8900 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704e8900 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704ed2f0 2024-09-18T02:06:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704f1c40 2024-09-18T02:06:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x7f2890037040 2024-09-18T02:06:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704e8900 2024-09-18T02:06:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.259+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704ed2f0 2024-09-18T02:06:08.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704f1c40 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704ed2f0 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x7f2890037040 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704f1c40 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704ed2f0 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x5619704e8900 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.271 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619704ec590 con 0x7f2890037040 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704f05b0 con 0x5619704e8900 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704f05b0 con 0x5619704e8900 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704f05b0 con 0x5619704f1c40 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 zone default found 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 4 Realm: () 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:08.273 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 zonegroup default 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.263+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704f0fa0 con 0x5619704ed2f0 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704f6a10 con 0x5619704f1c40 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704f6db0 con 0x5619704f1c40 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.274 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 20 started sync module instance, tier type = 2024-09-18T02:06:08.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:08.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f5e50 con 0x7f2890037040 2024-09-18T02:06:08.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94667258422128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f5e50 con 0x7f2890037040 2024-09-18T02:06:08.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f7600 con 0x5619704e8900 2024-09-18T02:06:08.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.267+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94667258422128] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.271+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.276 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.271+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94667258425952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f5e50 con 0x5619704e8900 2024-09-18T02:06:08.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.271+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f8010 con 0x5619704f1c40 2024-09-18T02:06:08.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.271+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.271+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94667258428256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f88b0 con 0x5619704f1c40 2024-09-18T02:06:08.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.271+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f92f0 con 0x7f2890037040 2024-09-18T02:06:08.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.271+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94667258425952] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.271+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.271+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94667258432960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f96e0 con 0x7f2890037040 2024-09-18T02:06:08.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.271+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704fa0a0 con 0x5619704e8900 2024-09-18T02:06:08.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.275+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94667258428256] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.275+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94667258432960] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.275+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.275+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94667258419616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f9bf0 con 0x5619704e8900 2024-09-18T02:06:08.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.275+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704fa440 con 0x5619704ed2f0 2024-09-18T02:06:08.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.275+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94667258419616] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.275+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.275+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94667258436592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704fa010 con 0x5619704ed2f0 2024-09-18T02:06:08.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.275+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704fb140 con 0x5619704ed2f0 2024-09-18T02:06:08.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94667258441328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704fb9e0 con 0x5619704ed2f0 2024-09-18T02:06:08.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704fc4b0 con 0x5619704ed2f0 2024-09-18T02:06:08.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94667258436592] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94667258441328] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94667258445728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704fb530 con 0x5619704ed2f0 2024-09-18T02:06:08.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289e831980 20 add_watcher() i=0 2024-09-18T02:06:08.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289e831980 20 add_watcher() i=1 2024-09-18T02:06:08.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289e831980 20 add_watcher() i=2 2024-09-18T02:06:08.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289e831980 20 add_watcher() i=3 2024-09-18T02:06:08.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289e831980 20 add_watcher() i=4 2024-09-18T02:06:08.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289e831980 20 add_watcher() i=5 2024-09-18T02:06:08.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.279+0000 7f289e831980 20 add_watcher() i=6 2024-09-18T02:06:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94667258445728] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 20 add_watcher() i=7 2024-09-18T02:06:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619704fb530 con 0x5619704e8900 2024-09-18T02:06:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94667258439648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704fb530 con 0x5619704e8900 2024-09-18T02:06:08.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94667258439648] v32'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.287 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f27527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:08.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:08.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:08.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 5 note: GC not initialized 2024-09-18T02:06:08.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f27517e2640 20 reqs_thread_entry: start 2024-09-18T02:06:08.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:08.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 20 Filter name: none 2024-09-18T02:06:08.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f26c2ffd640 20 reqs_thread_entry: start 2024-09-18T02:06:08.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T02:06:08.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.283+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561970522b20 con 0x5619704ed2f0 2024-09-18T02:06:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f288c0c7030 con 0x5619704ed2f0 2024-09-18T02:06:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289e831980 20 rados_obj.operate() r=0 bl.length=473 2024-09-18T02:06:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289e831980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T02:06:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289e831980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289e831980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619705293f0 con 0x5619704ed2f0 2024-09-18T02:06:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f288c12d040 con 0x5619704ed2f0 2024-09-18T02:06:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289e831980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289e831980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289e831980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T02:06:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94667258629728 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561970524b00 con 0x5619704e8900 2024-09-18T02:06:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== watch-notify(notify (1) cookie 94667258419616 notify 137438953493 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f2894010040 con 0x5619704e8900 2024-09-18T02:06:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f277b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94667258419616 notifier 4844 bl.length()=636 2024-09-18T02:06:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f277b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f277b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:08.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 notify.4 [notify cookie 94667258629728 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f277b7fe640 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2760003eb0 con 0x5619704e8900 2024-09-18T02:06:08.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.287+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.291+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== watch-notify(notify_complete (2) cookie 94667258629728 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f289402b440 con 0x5619704e8900 2024-09-18T02:06:08.293 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T02:06:08.069645Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.069630Z","tags":[],"group_ids":[]} 2024-09-18T02:06:08.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.291+0000 7f27527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:08.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.291+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94667258439648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561970520920 con 0x5619704e8900 2024-09-18T02:06:08.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.291+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94667258439648] v32'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.291+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94667258422128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561970520920 con 0x7f2890037040 2024-09-18T02:06:08.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.291+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94667258422128] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.291+0000 7f289e831980 20 remove_watcher() i=0 2024-09-18T02:06:08.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.291+0000 7f289e831980 2 removed watcher, disabling cache 2024-09-18T02:06:08.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.291+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94667258425952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561970520920 con 0x5619704e8900 2024-09-18T02:06:08.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.295+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94667258425952] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.295+0000 7f289e831980 20 remove_watcher() i=1 2024-09-18T02:06:08.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.295+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94667258428256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f7260 con 0x5619704f1c40 2024-09-18T02:06:08.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.295+0000 7f289bb40640 1 -- 172.21.15.167:0/3964063520 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94667258428256] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f289000e620 con 0x5619704f1c40 2024-09-18T02:06:08.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.295+0000 7f289e831980 20 remove_watcher() i=2 2024-09-18T02:06:08.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.295+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94667258432960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561970520920 con 0x7f2890037040 2024-09-18T02:06:08.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.299+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94667258432960] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x7f2890037040 2024-09-18T02:06:08.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.299+0000 7f289e831980 20 remove_watcher() i=3 2024-09-18T02:06:08.300 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.299+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94667258419616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f7260 con 0x5619704e8900 2024-09-18T02:06:08.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.299+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94667258419616] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2894026040 con 0x5619704e8900 2024-09-18T02:06:08.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.299+0000 7f289e831980 20 remove_watcher() i=4 2024-09-18T02:06:08.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.299+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94667258436592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561970520920 con 0x5619704ed2f0 2024-09-18T02:06:08.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.303+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94667258436592] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f288c12d040 con 0x5619704ed2f0 2024-09-18T02:06:08.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.303+0000 7f289e831980 20 remove_watcher() i=5 2024-09-18T02:06:08.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.303+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94667258441328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f59a0 con 0x5619704ed2f0 2024-09-18T02:06:08.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.303+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94667258441328] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f288c12d040 con 0x5619704ed2f0 2024-09-18T02:06:08.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.303+0000 7f289e831980 20 remove_watcher() i=6 2024-09-18T02:06:08.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.303+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94667258445728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619704f7260 con 0x5619704ed2f0 2024-09-18T02:06:08.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289c341640 1 -- 172.21.15.167:0/3964063520 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94667258445728] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f288c12d040 con 0x5619704ed2f0 2024-09-18T02:06:08.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 20 remove_watcher() i=7 2024-09-18T02:06:08.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5619704ed2f0 msgr2=0x5619704ef6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5619704ed2f0 0x5619704ef6e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5619704e8900 msgr2=0x5619704eadc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5619704e8900 0x5619704eadc0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2890037040 msgr2=0x7f2890036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f2890037040 0x7f2890036410 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5619704f1c40 msgr2=0x5619704f4030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5619704f1c40 0x5619704f4030 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f276c034650 msgr2=0x7f276c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f276c034650 0x7f276c036b10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5619704bc6e0 tx=0x7f2890010000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289cb42640 1 -- 172.21.15.167:0/3964063520 reap_dead start 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 msgr2=0x5619704dd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704dd8d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f288c0c2c90 tx=0x7f288c0c0d60 comp rx=0 tx=0).stop 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 shutdown_connections 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/3964063520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704d6710 0x5619704dd8d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 >> 172.21.15.167:0/3964063520 conn(0x5619704d2af0 msgr2=0x5619704d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 shutdown_connections 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/3964063520 wait complete. 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/334900316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2774034650 msgr2=0x7f2774036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/334900316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2774034650 0x7f2774036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f289000bf60 tx=0x7f289000f000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/334900316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704c9d70 msgr2=0x5619704ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/334900316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704c9d70 0x5619704ca190 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f288c005710 tx=0x7f288c0d9350 comp rx=0 tx=0).stop 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/334900316 shutdown_connections 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/334900316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2774034650 0x7f2774036b10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/334900316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619704c9d70 0x5619704ca190 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/334900316 >> 172.21.15.167:0/334900316 conn(0x5619704beec0 msgr2=0x5619704c1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/334900316 shutdown_connections 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/334900316 wait complete. 2024-09-18T02:06:08.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5619704b5860 msgr2=0x5619704b7c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5619704b5860 0x5619704b7c50 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5619703bccf0 msgr2=0x5619704b2ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5619703bccf0 0x5619704b2ea0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5619704b9760 msgr2=0x5619704bbb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5619704b9760 0x5619704bbb50 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2784034650 msgr2=0x7f2784036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2784034650 0x7f2784036b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2890000f70 tx=0x7f28900012c0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 msgr2=0x5619704abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 --2- 172.21.15.167:0/2361180582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56197032c2a0 0x5619704abf10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f288c019680 tx=0x7f288c017d70 comp rx=0 tx=0).stop 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289cb42640 1 -- 172.21.15.167:0/2361180582 reap_dead start 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 shutdown_connections 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 >> 172.21.15.167:0/2361180582 conn(0x5619703b20a0 msgr2=0x56197049f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 shutdown_connections 2024-09-18T02:06:08.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.307+0000 7f289e831980 1 -- 172.21.15.167:0/2361180582 wait complete. 2024-09-18T02:06:08.319 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:08.320 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:08.320 ERROR:root:0 2024-09-18T02:06:08.320 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-18T02:06:08.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-18T02:06:08.320 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-18T02:06:08.400 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:08.400 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:08.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74fd16e980 1 Processor -- start 2024-09-18T02:06:08.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74fd16e980 1 -- start start 2024-09-18T02:06:08.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74fd16e980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x559972f09270 0x559972f99700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74fd16e980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559972e1cae0 con 0x559972f99c40 2024-09-18T02:06:08.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74fd16e980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x559972e40e30 con 0x559972f09270 2024-09-18T02:06:08.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74fac7e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x559972f09270 0x559972f99700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.402 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74fa47d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x559972f99c40 0x559972f9c030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33862/0 (socket says 172.21.15.167:33862) 2024-09-18T02:06:08.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74fa47d640 1 -- 172.21.15.167:0/541518816 learned_addr learned my addr 172.21.15.167:0/541518816 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:08.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74f9c7c640 1 -- 172.21.15.167:0/541518816 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118398323 0 0) 0x559972e1cae0 con 0x559972f99c40 2024-09-18T02:06:08.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74f9c7c640 1 -- 172.21.15.167:0/541518816 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74e4001e20 con 0x559972f99c40 2024-09-18T02:06:08.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74fac7e640 1 -- 172.21.15.167:0/541518816 >> v1:172.21.15.81:6789/0 conn(0x559972f99c40 legacy=0x559972f9c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.399+0000 7f74fac7e640 1 -- 172.21.15.167:0/541518816 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559972f09650 con 0x559972f09270 2024-09-18T02:06:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.403+0000 7f74fac7e640 1 --2- 172.21.15.167:0/541518816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x559972f99700 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f74f400a420 tx=0x7f74f401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e31fff55087191 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.403+0000 7f74f9c7c640 1 -- 172.21.15.167:0/541518816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40af070 con 0x559972f09270 2024-09-18T02:06:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.403+0000 7f74f9c7c640 1 -- 172.21.15.167:0/541518816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f40aa530 con 0x559972f09270 2024-09-18T02:06:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.403+0000 7f74f9c7c640 1 -- 172.21.15.167:0/541518816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40aa850 con 0x559972f09270 2024-09-18T02:06:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.403+0000 7f74fd16e980 1 -- 172.21.15.167:0/541518816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 msgr2=0x559972f99700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.403+0000 7f74fd16e980 1 --2- 172.21.15.167:0/541518816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x559972f99700 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f74f400a420 tx=0x7f74f401afd0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.403+0000 7f74fd16e980 1 -- 172.21.15.167:0/541518816 shutdown_connections 2024-09-18T02:06:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.403+0000 7f74fd16e980 1 --2- 172.21.15.167:0/541518816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x559972f99700 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.403+0000 7f74fd16e980 1 -- 172.21.15.167:0/541518816 >> 172.21.15.167:0/541518816 conn(0x559972f8f030 msgr2=0x559972f91450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.403+0000 7f74fd16e980 1 -- 172.21.15.167:0/541518816 shutdown_connections 2024-09-18T02:06:08.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.403+0000 7f74fd16e980 1 -- 172.21.15.167:0/541518816 wait complete. 2024-09-18T02:06:08.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.415+0000 7f74fd16e980 1 Processor -- start 2024-09-18T02:06:08.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.415+0000 7f74fd16e980 1 -- start start 2024-09-18T02:06:08.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.415+0000 7f74fd16e980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x5599730819f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.415+0000 7f74fd16e980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559972e42200 con 0x559972f09270 2024-09-18T02:06:08.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.415+0000 7f74fac7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x5599730819f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.415+0000 7f74fac7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x5599730819f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50382/0 (socket says 172.21.15.167:50382) 2024-09-18T02:06:08.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.415+0000 7f74fac7e640 1 -- 172.21.15.167:0/3994058460 learned_addr learned my addr 172.21.15.167:0/3994058460 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.415+0000 7f74fac7e640 1 -- 172.21.15.167:0/3994058460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559973081fc0 con 0x559972f09270 2024-09-18T02:06:08.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.415+0000 7f74fac7e640 1 --2- 172.21.15.167:0/3994058460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x5599730819f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f74f4017be0 tx=0x7f74f40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3eaa2c8f3229e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f73e8e09640 1 -- 172.21.15.167:0/3994058460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40af040 con 0x559972f09270 2024-09-18T02:06:08.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f73e8e09640 1 -- 172.21.15.167:0/3994058460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f40aa9a0 con 0x559972f09270 2024-09-18T02:06:08.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f73e8e09640 1 -- 172.21.15.167:0/3994058460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40aacc0 con 0x559972f09270 2024-09-18T02:06:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 -- 172.21.15.167:0/3994058460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 msgr2=0x5599730819f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 --2- 172.21.15.167:0/3994058460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x5599730819f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f74f4017be0 tx=0x7f74f40033b0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 -- 172.21.15.167:0/3994058460 shutdown_connections 2024-09-18T02:06:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 --2- 172.21.15.167:0/3994058460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x5599730819f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 -- 172.21.15.167:0/3994058460 >> 172.21.15.167:0/3994058460 conn(0x559972f8f030 msgr2=0x55997307d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 -- 172.21.15.167:0/3994058460 shutdown_connections 2024-09-18T02:06:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 -- 172.21.15.167:0/3994058460 wait complete. 2024-09-18T02:06:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 Processor -- start 2024-09-18T02:06:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 -- start start 2024-09-18T02:06:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x559973088be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559972fa01b0 con 0x559972f09270 2024-09-18T02:06:08.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fac7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x559973088be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fac7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x559973088be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50390/0 (socket says 172.21.15.167:50390) 2024-09-18T02:06:08.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fac7e640 1 -- 172.21.15.167:0/2721467954 learned_addr learned my addr 172.21.15.167:0/2721467954 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fac7e640 1 -- 172.21.15.167:0/2721467954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559973089120 con 0x559972f09270 2024-09-18T02:06:08.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fac7e640 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x559973088be0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f74f40ad040 tx=0x7f74f4017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f73e7606640 1 -- 172.21.15.167:0/2721467954 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40af040 con 0x559972f09270 2024-09-18T02:06:08.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f73e7606640 1 -- 172.21.15.167:0/2721467954 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f40b6c30 con 0x559972f09270 2024-09-18T02:06:08.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599730893b0 con 0x559972f09270 2024-09-18T02:06:08.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55997308c090 con 0x559972f09270 2024-09-18T02:06:08.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.419+0000 7f73e7606640 1 -- 172.21.15.167:0/2721467954 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40c6450 con 0x559972f09270 2024-09-18T02:06:08.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f73e7606640 1 -- 172.21.15.167:0/2721467954 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74f40b2040 con 0x559972f09270 2024-09-18T02:06:08.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f73e7606640 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73e0034650 0x7f73e0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f73e7606640 1 -- 172.21.15.167:0/2721467954 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f74f40e4a80 con 0x559972f09270 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fa47d640 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73e0034650 0x7f73e0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fd16e980 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559972f99c40 0x55997308fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559973090190 con 0x559972f99c40 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fb47f640 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559972f99c40 0x55997308fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fa47d640 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73e0034650 0x7f73e0036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f74f0000f70 tx=0x7f74f00010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fb47f640 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559972f99c40 0x55997308fb70 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fb47f640 1 -- 172.21.15.167:0/2721467954 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74ec0083f0 con 0x559972f99c40 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55997308d290 con 0x559972f99c40 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fb47f640 1 -- 172.21.15.167:0/2721467954 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74ec0083f0 con 0x559972f99c40 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fd16e980 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5599730924f0 0x5599730948e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559973094fb0 con 0x5599730924f0 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fac7e640 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5599730924f0 0x5599730948e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.423+0000 7f74fac7e640 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5599730924f0 0x5599730948e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fac7e640 1 -- 172.21.15.167:0/2721467954 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730924f0 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559973091390 con 0x559972f99c40 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fb47f640 1 -- 172.21.15.167:0/2721467954 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74ec0083f0 con 0x559972f99c40 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fd16e980 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5599730963f0 0x5599730987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559973098f20 con 0x5599730963f0 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fa47d640 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5599730963f0 0x5599730987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fa47d640 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5599730963f0 0x5599730987e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fa47d640 1 -- 172.21.15.167:0/2721467954 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730963f0 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fd16e980 1 Processor -- start 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fd16e980 1 -- start start 2024-09-18T02:06:08.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fd16e980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730a69b0 0x5599730a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fd16e980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559972e9b800 con 0x5599730a69b0 2024-09-18T02:06:08.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fac7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730a69b0 0x5599730a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fac7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730a69b0 0x5599730a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50400/0 (socket says 172.21.15.167:50400) 2024-09-18T02:06:08.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fac7e640 1 -- 172.21.15.167:0/4062068479 learned_addr learned my addr 172.21.15.167:0/4062068479 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fac7e640 1 -- 172.21.15.167:0/4062068479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599730a7310 con 0x5599730a69b0 2024-09-18T02:06:08.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fac7e640 1 --2- 172.21.15.167:0/4062068479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730a69b0 0x5599730a6dd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f74f40e2fe0 tx=0x7f74f40b3f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f73e4e01640 1 -- 172.21.15.167:0/4062068479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40e4e60 con 0x5599730a69b0 2024-09-18T02:06:08.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f73e4e01640 1 -- 172.21.15.167:0/4062068479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f40e9070 con 0x5599730a69b0 2024-09-18T02:06:08.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f73e4e01640 1 -- 172.21.15.167:0/4062068479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40c7150 con 0x5599730a69b0 2024-09-18T02:06:08.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fd16e980 1 -- 172.21.15.167:0/4062068479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599730a75a0 con 0x5599730a69b0 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.427+0000 7f74fd16e980 1 -- 172.21.15.167:0/4062068479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599730a75a0 con 0x5599730a69b0 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f73e4e01640 1 -- 172.21.15.167:0/4062068479 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74f40b3760 con 0x5599730a69b0 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f73e4e01640 1 --2- 172.21.15.167:0/4062068479 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73d4034650 0x7f73d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f73e4e01640 1 -- 172.21.15.167:0/4062068479 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f74f40e0070 con 0x5599730a69b0 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fa47d640 1 --2- 172.21.15.167:0/4062068479 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73d4034650 0x7f73d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 Processor -- start 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 -- start start 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559973082280 con 0x5599730b30f0 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fa47d640 1 --2- 172.21.15.167:0/4062068479 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73d4034650 0x7f73d4036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f74f000c010 tx=0x7f74f000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fac7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fac7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50408/0 (socket says 172.21.15.167:50408) 2024-09-18T02:06:08.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fac7e640 1 -- 172.21.15.167:0/3310185023 learned_addr learned my addr 172.21.15.167:0/3310185023 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fac7e640 1 -- 172.21.15.167:0/3310185023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599730b3ac0 con 0x5599730b30f0 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fac7e640 1 --2- 172.21.15.167:0/3310185023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730b34f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f74f40d4fd0 tx=0x7f74f40eb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f9e5ded8de4d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f73de7fc640 1 -- 172.21.15.167:0/3310185023 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40eed30 con 0x5599730b30f0 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f73de7fc640 1 -- 172.21.15.167:0/3310185023 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f40d9d60 con 0x5599730b30f0 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f73de7fc640 1 -- 172.21.15.167:0/3310185023 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40dddd0 con 0x5599730b30f0 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 -- 172.21.15.167:0/3310185023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 msgr2=0x5599730b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 --2- 172.21.15.167:0/3310185023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730b34f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f74f40d4fd0 tx=0x7f74f40eb000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 -- 172.21.15.167:0/3310185023 shutdown_connections 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 --2- 172.21.15.167:0/3310185023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730b34f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 -- 172.21.15.167:0/3310185023 >> 172.21.15.167:0/3310185023 conn(0x5599730af4d0 msgr2=0x5599730ad5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 -- 172.21.15.167:0/3310185023 shutdown_connections 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 -- 172.21.15.167:0/3310185023 wait complete. 2024-09-18T02:06:08.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 Processor -- start 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 -- start start 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730ba3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fd16e980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5599730b3f40 con 0x5599730b30f0 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fac7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730ba3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fac7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730ba3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50422/0 (socket says 172.21.15.167:50422) 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.431+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 learned_addr learned my addr 172.21.15.167:0/1207471020 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599730ba8f0 con 0x5599730b30f0 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fac7e640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730ba3b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f74f40e1700 tx=0x7f74f40c3ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f73dcff9640 1 -- 172.21.15.167:0/1207471020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40ddca0 con 0x5599730b30f0 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599730ba8f0 con 0x5599730b30f0 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f73dcff9640 1 -- 172.21.15.167:0/1207471020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f40ee460 con 0x5599730b30f0 2024-09-18T02:06:08.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599730ba8f0 con 0x5599730b30f0 2024-09-18T02:06:08.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f73dcff9640 1 -- 172.21.15.167:0/1207471020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f40ee610 con 0x5599730b30f0 2024-09-18T02:06:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f73dcff9640 1 -- 172.21.15.167:0/1207471020 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74f4115060 con 0x5599730b30f0 2024-09-18T02:06:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f73dcff9640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73c4034650 0x7f73c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f73dcff9640 1 -- 172.21.15.167:0/1207471020 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f74f4118bb0 con 0x5599730b30f0 2024-09-18T02:06:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fa47d640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73c4034650 0x7f73c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5599730c53c0 0x5599730c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730c7fd0 con 0x5599730c53c0 2024-09-18T02:06:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fb47f640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5599730c53c0 0x5599730c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fa47d640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73c4034650 0x7f73c4036b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x559973099320 tx=0x7f74f0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fb47f640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5599730c53c0 0x5599730c7880 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74ec0083f0 con 0x5599730c53c0 2024-09-18T02:06:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 20 realm 2024-09-18T02:06:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730c83e0 con 0x5599730c53c0 2024-09-18T02:06:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74ec0083f0 con 0x5599730c53c0 2024-09-18T02:06:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730c8c80 con 0x5599730c53c0 2024-09-18T02:06:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74ec0083f0 con 0x5599730c53c0 2024-09-18T02:06:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c53c0 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74ec0083f0 con 0x5599730c53c0 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5599730c9d80 0x5599730cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.435+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730cc810 con 0x5599730c9d80 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fac7e640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5599730c9d80 0x5599730cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fac7e640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5599730c9d80 0x5599730cc170 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fd16e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fd16e980 20 searching for the correct realm 2024-09-18T02:06:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fd16e980 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5599730ce6f0 0x5599730d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730d11e0 con 0x5599730ce6f0 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fa47d640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5599730ce6f0 0x5599730d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fa47d640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5599730ce6f0 0x5599730d0b60 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fa47d640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f74f0037040 0x7f74f0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730d11e0 con 0x7f74f0037040 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f74f0037040 0x7f74f0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f74f0037040 0x7f74f0036410 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec0083f0 con 0x7f74f0037040 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x7f74f0037040 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec0083f0 con 0x7f74f0037040 2024-09-18T02:06:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c53c0 2024-09-18T02:06:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c53c0 2024-09-18T02:06:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c53c0 2024-09-18T02:06:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.439+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c9d80 2024-09-18T02:06:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x7f74f0037040 2024-09-18T02:06:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730ce6f0 2024-09-18T02:06:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c53c0 2024-09-18T02:06:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x7f74f0037040 2024-09-18T02:06:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c53c0 2024-09-18T02:06:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x7f74f0037040 2024-09-18T02:06:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730ce6f0 2024-09-18T02:06:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730ce6f0 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c9d80 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730ce6f0 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730ce6f0 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.443+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c53c0 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c53c0 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c9d80 2024-09-18T02:06:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730ce6f0 2024-09-18T02:06:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x7f74f0037040 2024-09-18T02:06:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c53c0 2024-09-18T02:06:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c9d80 2024-09-18T02:06:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730ce6f0 2024-09-18T02:06:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c9d80 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x7f74f0037040 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730ce6f0 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.447+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c9d80 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x5599730c53c0 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599730c9020 con 0x7f74f0037040 2024-09-18T02:06:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730cd060 con 0x5599730c53c0 2024-09-18T02:06:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730cd060 con 0x5599730c53c0 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730cd060 con 0x5599730ce6f0 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 zone default found 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 4 Realm: () 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 zonegroup default 2024-09-18T02:06:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730cda50 con 0x5599730c9d80 2024-09-18T02:06:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730cd5e0 con 0x5599730ce6f0 2024-09-18T02:06:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730d35a0 con 0x5599730ce6f0 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 started sync module instance, tier type = 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.451+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d2980 con 0x7f74f0037040 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.455+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.455+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117548600992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d2980 con 0x7f74f0037040 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.455+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d40b0 con 0x5599730c53c0 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.455+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94117548600992] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.455+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.455+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94117548604320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d2980 con 0x5599730c53c0 2024-09-18T02:06:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.455+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d4ac0 con 0x5599730ce6f0 2024-09-18T02:06:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.459+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94117548604320] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.459+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.459+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94117548598480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d28f0 con 0x5599730ce6f0 2024-09-18T02:06:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.459+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d5980 con 0x7f74f0037040 2024-09-18T02:06:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.459+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.459+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94117548611040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d5ff0 con 0x7f74f0037040 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.459+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d6b10 con 0x5599730c53c0 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.459+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94117548598480] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.459+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94117548611040] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.459+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.463+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117548615136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d6ad0 con 0x5599730c53c0 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.463+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d6f00 con 0x5599730c9d80 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.463+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94117548615136] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.463+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.463+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94117548612160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d72a0 con 0x5599730c9d80 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.463+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d7b50 con 0x5599730c9d80 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94117548621552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d87c0 con 0x5599730c9d80 2024-09-18T02:06:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d9210 con 0x5599730c9d80 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94117548612160] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94117548621552] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94117548625152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d8310 con 0x5599730c9d80 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fd16e980 20 add_watcher() i=0 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fd16e980 20 add_watcher() i=1 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fd16e980 20 add_watcher() i=2 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fd16e980 20 add_watcher() i=3 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fd16e980 20 add_watcher() i=4 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fd16e980 20 add_watcher() i=5 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.467+0000 7f74fd16e980 20 add_watcher() i=6 2024-09-18T02:06:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94117548625152] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 20 add_watcher() i=7 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730dc310 con 0x5599730c53c0 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94117548609200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d9790 con 0x5599730c53c0 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94117548609200] v32'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f73b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 5 note: GC not initialized 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f732bfff640 20 reqs_thread_entry: start 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 20 Filter name: none 2024-09-18T02:06:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f7329ffb640 20 reqs_thread_entry: start 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730ff850 con 0x5599730c9d80 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.471+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599730fdff0 con 0x5599730ce6f0 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fd16e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fd16e980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fd16e980 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fd16e980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fd16e980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730fe890 con 0x5599730c9d80 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fd16e980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fd16e980 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fd16e980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94117548778464 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559973102e40 con 0x7f74f0037040 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== watch-notify(notify (1) cookie 94117548600992 notify 137438953495 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f74ec010040 con 0x7f74f0037040 2024-09-18T02:06:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f73de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94117548600992 notifier 4851 bl.length()=533 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f73de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f73de7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f73de7fc640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f73c0003eb0 con 0x7f74f0037040 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(65 notify.0 [notify cookie 94117548778464 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== watch-notify(notify_complete (2) cookie 94117548778464 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f74ec00a960 con 0x7f74f0037040 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.475+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730fe890 con 0x5599730ce6f0 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fd16e980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fd16e980 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fd16e980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94117548778464 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559973102fa0 con 0x5599730c53c0 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== watch-notify(notify (1) cookie 94117548604320 notify 137438953494 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7f74ec00a960 con 0x5599730c53c0 2024-09-18T02:06:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f73ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94117548604320 notifier 4851 bl.length()=176 2024-09-18T02:06:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f73ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-18T02:06:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f73ddffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-18T02:06:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(68 notify.1 [notify cookie 94117548778464 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f73ddffb640 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7330003410 con 0x5599730c53c0 2024-09-18T02:06:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== watch-notify(notify_complete (2) cookie 94117548778464 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f74ec02b720 con 0x5599730c53c0 2024-09-18T02:06:08.491 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-18T02:06:08.477074Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.477063Z","tags":[],"group_ids":[]} 2024-09-18T02:06:08.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f73b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:08.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94117548609200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730fd650 con 0x5599730c53c0 2024-09-18T02:06:08.493 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94117548609200] v32'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.479+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94117548600992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730fd650 con 0x7f74f0037040 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.483+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94117548600992] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.483+0000 7f74fd16e980 20 remove_watcher() i=0 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.483+0000 7f74fd16e980 2 removed watcher, disabling cache 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.483+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94117548604320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730fd650 con 0x5599730c53c0 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.483+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94117548604320] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.483+0000 7f74fd16e980 20 remove_watcher() i=1 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.483+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94117548598480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730fd650 con 0x5599730ce6f0 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.487+0000 7f74fa47d640 1 -- 172.21.15.167:0/1207471020 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94117548598480] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f000e6c0 con 0x5599730ce6f0 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.487+0000 7f74fd16e980 20 remove_watcher() i=2 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.487+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94117548611040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d24d0 con 0x7f74f0037040 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.487+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94117548611040] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x7f74f0037040 2024-09-18T02:06:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.487+0000 7f74fd16e980 20 remove_watcher() i=3 2024-09-18T02:06:08.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.487+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94117548615136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730fd650 con 0x5599730c53c0 2024-09-18T02:06:08.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.491+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94117548615136] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74ec026040 con 0x5599730c53c0 2024-09-18T02:06:08.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.491+0000 7f74fd16e980 20 remove_watcher() i=4 2024-09-18T02:06:08.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.491+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94117548612160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d24d0 con 0x5599730c9d80 2024-09-18T02:06:08.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.491+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94117548612160] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.491+0000 7f74fd16e980 20 remove_watcher() i=5 2024-09-18T02:06:08.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.491+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94117548621552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d5a90 con 0x5599730c9d80 2024-09-18T02:06:08.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94117548621552] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 20 remove_watcher() i=6 2024-09-18T02:06:08.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94117548625152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599730d5a90 con 0x5599730c9d80 2024-09-18T02:06:08.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fac7e640 1 -- 172.21.15.167:0/1207471020 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94117548625152] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74f40a8070 con 0x5599730c9d80 2024-09-18T02:06:08.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 20 remove_watcher() i=7 2024-09-18T02:06:08.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5599730c9d80 msgr2=0x5599730cc170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5599730c9d80 0x5599730cc170 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5599730c53c0 msgr2=0x5599730c7880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5599730c53c0 0x5599730c7880 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f74f0037040 msgr2=0x7f74f0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f74f0037040 0x7f74f0036410 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5599730ce6f0 msgr2=0x5599730d0b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5599730ce6f0 0x5599730d0b60 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73c4034650 msgr2=0x7f73c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73c4034650 0x7f73c4036b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x559973099320 tx=0x7f74f0010000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fb47f640 1 -- 172.21.15.167:0/1207471020 reap_dead start 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 msgr2=0x5599730ba3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730ba3b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f74f40e1700 tx=0x7f74f40c3ef0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 shutdown_connections 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 --2- 172.21.15.167:0/1207471020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730b30f0 0x5599730ba3b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 >> 172.21.15.167:0/1207471020 conn(0x5599730af4d0 msgr2=0x5599730ad5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 shutdown_connections 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/1207471020 wait complete. 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/4062068479 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73d4034650 msgr2=0x7f73d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 --2- 172.21.15.167:0/4062068479 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73d4034650 0x7f73d4036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f74f000c010 tx=0x7f74f000f000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/4062068479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730a69b0 msgr2=0x5599730a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 --2- 172.21.15.167:0/4062068479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730a69b0 0x5599730a6dd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f74f40e2fe0 tx=0x7f74f40b3f90 comp rx=0 tx=0).stop 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/4062068479 shutdown_connections 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 --2- 172.21.15.167:0/4062068479 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73d4034650 0x7f73d4036b10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 --2- 172.21.15.167:0/4062068479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599730a69b0 0x5599730a6dd0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/4062068479 >> 172.21.15.167:0/4062068479 conn(0x55997309bb00 msgr2=0x55997309e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/4062068479 shutdown_connections 2024-09-18T02:06:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.495+0000 7f74fd16e980 1 -- 172.21.15.167:0/4062068479 wait complete. 2024-09-18T02:06:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5599730924f0 msgr2=0x5599730948e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5599730924f0 0x5599730948e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559972f99c40 msgr2=0x55997308fb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x559972f99c40 0x55997308fb70 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5599730963f0 msgr2=0x5599730987e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5599730963f0 0x5599730987e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73e0034650 msgr2=0x7f73e0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f73e0034650 0x7f73e0036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f74f0000f70 tx=0x7f74f00010b0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 msgr2=0x559973088be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 --2- 172.21.15.167:0/2721467954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559972f09270 0x559973088be0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f74f40ad040 tx=0x7f74f4017d70 comp rx=0 tx=0).stop 2024-09-18T02:06:08.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fb47f640 1 -- 172.21.15.167:0/2721467954 reap_dead start 2024-09-18T02:06:08.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 shutdown_connections 2024-09-18T02:06:08.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 >> 172.21.15.167:0/2721467954 conn(0x559972f8f030 msgr2=0x55997307c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 shutdown_connections 2024-09-18T02:06:08.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.499+0000 7f74fd16e980 1 -- 172.21.15.167:0/2721467954 wait complete. 2024-09-18T02:06:08.509 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-18T02:06:08.477074Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.477063Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:08.510 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-18T02:06:08.477074Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.477063Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:08.510 ERROR:root:0 2024-09-18T02:06:08.510 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:08.515 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:08.515 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-18T02:06:08.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-18T02:06:08.516 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-18T02:06:08.584 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:08.584 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:08.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.583+0000 7f00ea489980 1 Processor -- start 2024-09-18T02:06:08.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.583+0000 7f00ea489980 1 -- start start 2024-09-18T02:06:08.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.583+0000 7f00ea489980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x561a73bd7290 0x561a73c677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.583+0000 7f00ea489980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561a73aeaae0 con 0x561a73c67ce0 2024-09-18T02:06:08.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.583+0000 7f00ea489980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x561a73b0ee30 con 0x561a73bd7290 2024-09-18T02:06:08.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.583+0000 7f00e7f99640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x561a73bd7290 0x561a73c677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.583+0000 7f00e7f99640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x561a73bd7290 0x561a73c677a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50434/0 (socket says 172.21.15.167:50434) 2024-09-18T02:06:08.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.583+0000 7f00e7f99640 1 -- 172.21.15.167:0/2621789128 learned_addr learned my addr 172.21.15.167:0/2621789128 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.583+0000 7f00e7798640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x561a73c67ce0 0x561a73c6a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33878/0 (socket says 172.21.15.167:33878) 2024-09-18T02:06:08.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.583+0000 7f00e7f99640 1 -- 172.21.15.167:0/2621789128 >> v1:172.21.15.81:6789/0 conn(0x561a73c67ce0 legacy=0x561a73c6a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.587 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.583+0000 7f00e7f99640 1 -- 172.21.15.167:0/2621789128 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a73bd7670 con 0x561a73bd7290 2024-09-18T02:06:08.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.587+0000 7f00e7f99640 1 --2- 172.21.15.167:0/2621789128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73c677a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f00d800a5c0 tx=0x7f00d801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ff4717bf61d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.587+0000 7f00e6f97640 1 -- 172.21.15.167:0/2621789128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80a6070 con 0x561a73bd7290 2024-09-18T02:06:08.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.587+0000 7f00e6f97640 1 -- 172.21.15.167:0/2621789128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d80af070 con 0x561a73bd7290 2024-09-18T02:06:08.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.587+0000 7f00e6f97640 1 -- 172.21.15.167:0/2621789128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80aa5c0 con 0x561a73bd7290 2024-09-18T02:06:08.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.587+0000 7f00ea489980 1 -- 172.21.15.167:0/2621789128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 msgr2=0x561a73c677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.587+0000 7f00ea489980 1 --2- 172.21.15.167:0/2621789128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73c677a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f00d800a5c0 tx=0x7f00d801b340 comp rx=0 tx=0).stop 2024-09-18T02:06:08.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.587+0000 7f00ea489980 1 -- 172.21.15.167:0/2621789128 shutdown_connections 2024-09-18T02:06:08.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.587+0000 7f00ea489980 1 --2- 172.21.15.167:0/2621789128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73c677a0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.587+0000 7f00ea489980 1 -- 172.21.15.167:0/2621789128 >> 172.21.15.167:0/2621789128 conn(0x561a73c5d090 msgr2=0x561a73c5f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.587+0000 7f00ea489980 1 -- 172.21.15.167:0/2621789128 shutdown_connections 2024-09-18T02:06:08.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.587+0000 7f00ea489980 1 -- 172.21.15.167:0/2621789128 wait complete. 2024-09-18T02:06:08.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.599+0000 7f00ea489980 1 Processor -- start 2024-09-18T02:06:08.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.599+0000 7f00ea489980 1 -- start start 2024-09-18T02:06:08.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.599+0000 7f00ea489980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73d4fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.599+0000 7f00ea489980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561a73b10200 con 0x561a73bd7290 2024-09-18T02:06:08.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.599+0000 7f00e7f99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73d4fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.599+0000 7f00e7f99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73d4fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50442/0 (socket says 172.21.15.167:50442) 2024-09-18T02:06:08.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.599+0000 7f00e7f99640 1 -- 172.21.15.167:0/2745911250 learned_addr learned my addr 172.21.15.167:0/2745911250 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.599+0000 7f00e7f99640 1 -- 172.21.15.167:0/2745911250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a73d501d0 con 0x561a73bd7290 2024-09-18T02:06:08.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00e7f99640 1 --2- 172.21.15.167:0/2745911250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73d4fc00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f00d80199f0 tx=0x7f00d8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8b03674ef06314 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7effd5e0b640 1 -- 172.21.15.167:0/2745911250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80aa9c0 con 0x561a73bd7290 2024-09-18T02:06:08.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7effd5e0b640 1 -- 172.21.15.167:0/2745911250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d80aab80 con 0x561a73bd7290 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7effd5e0b640 1 -- 172.21.15.167:0/2745911250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80bd3f0 con 0x561a73bd7290 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 -- 172.21.15.167:0/2745911250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 msgr2=0x561a73d4fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 --2- 172.21.15.167:0/2745911250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73d4fc00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f00d80199f0 tx=0x7f00d8003030 comp rx=0 tx=0).stop 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 -- 172.21.15.167:0/2745911250 shutdown_connections 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 --2- 172.21.15.167:0/2745911250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73d4fc00 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 -- 172.21.15.167:0/2745911250 >> 172.21.15.167:0/2745911250 conn(0x561a73c5d090 msgr2=0x561a73d4b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 -- 172.21.15.167:0/2745911250 shutdown_connections 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 -- 172.21.15.167:0/2745911250 wait complete. 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 Processor -- start 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 -- start start 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73d56df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561a73c6e220 con 0x561a73bd7290 2024-09-18T02:06:08.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00e7f99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73d56df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00e7f99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73d56df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50456/0 (socket says 172.21.15.167:50456) 2024-09-18T02:06:08.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00e7f99640 1 -- 172.21.15.167:0/3673114881 learned_addr learned my addr 172.21.15.167:0/3673114881 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00e7f99640 1 -- 172.21.15.167:0/3673114881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a73d57330 con 0x561a73bd7290 2024-09-18T02:06:08.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00e7f99640 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73d56df0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f00d801b170 tx=0x7f00d80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7effcffff640 1 -- 172.21.15.167:0/3673114881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80bd700 con 0x561a73bd7290 2024-09-18T02:06:08.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7effcffff640 1 -- 172.21.15.167:0/3673114881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d80bd8a0 con 0x561a73bd7290 2024-09-18T02:06:08.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a73d575c0 con 0x561a73bd7290 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7effcffff640 1 -- 172.21.15.167:0/3673114881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80bdb80 con 0x561a73bd7290 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.603+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a73d5a2a0 con 0x561a73bd7290 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7effcffff640 1 -- 172.21.15.167:0/3673114881 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00d80c6440 con 0x561a73bd7290 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7effcffff640 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effd0034650 0x7effd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7effcffff640 1 -- 172.21.15.167:0/3673114881 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f00d80e5af0 con 0x561a73bd7290 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00e7798640 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effd0034650 0x7effd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00ea489980 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561a73c67ce0 0x561a73d5dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d5e3f0 con 0x561a73c67ce0 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00e879a640 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561a73c67ce0 0x561a73d5dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00e7798640 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effd0034650 0x7effd0036b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f00dc001e50 tx=0x7f00dc0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00e879a640 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561a73c67ce0 0x561a73d5dd80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00e879a640 1 -- 172.21.15.167:0/3673114881 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73c67ce0 2024-09-18T02:06:08.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d5ece0 con 0x561a73c67ce0 2024-09-18T02:06:08.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00e879a640 1 -- 172.21.15.167:0/3673114881 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73c67ce0 2024-09-18T02:06:08.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00ea489980 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561a73d605f0 0x561a73d62ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d63240 con 0x561a73d605f0 2024-09-18T02:06:08.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00e7f99640 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561a73d605f0 0x561a73d62ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.607+0000 7f00e7f99640 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561a73d605f0 0x561a73d62ab0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00e7f99640 1 -- 172.21.15.167:0/3673114881 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f00d80cd020 con 0x561a73d605f0 2024-09-18T02:06:08.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d5f530 con 0x561a73c67ce0 2024-09-18T02:06:08.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00e879a640 1 -- 172.21.15.167:0/3673114881 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73c67ce0 2024-09-18T02:06:08.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00ea489980 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561a73d646a0 0x561a73d66a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d67180 con 0x561a73d646a0 2024-09-18T02:06:08.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00e7798640 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561a73d646a0 0x561a73d66a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00e7798640 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561a73d646a0 0x561a73d66a90 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00e7798640 1 -- 172.21.15.167:0/3673114881 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f00dc00f700 con 0x561a73d646a0 2024-09-18T02:06:08.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00ea489980 1 Processor -- start 2024-09-18T02:06:08.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00ea489980 1 -- start start 2024-09-18T02:06:08.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00ea489980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d74c50 0x561a73d75070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00ea489980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561a73b69800 con 0x561a73d74c50 2024-09-18T02:06:08.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00e7f99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d74c50 0x561a73d75070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00e7f99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d74c50 0x561a73d75070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50460/0 (socket says 172.21.15.167:50460) 2024-09-18T02:06:08.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00e7f99640 1 -- 172.21.15.167:0/3352915419 learned_addr learned my addr 172.21.15.167:0/3352915419 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00e7f99640 1 -- 172.21.15.167:0/3352915419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a73d755b0 con 0x561a73d74c50 2024-09-18T02:06:08.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00e7f99640 1 --2- 172.21.15.167:0/3352915419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d74c50 0x561a73d75070 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f00d80a4050 tx=0x7f00d80b3950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7effcd7fa640 1 -- 172.21.15.167:0/3352915419 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80bcb90 con 0x561a73d74c50 2024-09-18T02:06:08.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00ea489980 1 -- 172.21.15.167:0/3352915419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a73d757e0 con 0x561a73d74c50 2024-09-18T02:06:08.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7effcd7fa640 1 -- 172.21.15.167:0/3352915419 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d80bcd30 con 0x561a73d74c50 2024-09-18T02:06:08.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7effcd7fa640 1 -- 172.21.15.167:0/3352915419 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80c0bb0 con 0x561a73d74c50 2024-09-18T02:06:08.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.611+0000 7f00ea489980 1 -- 172.21.15.167:0/3352915419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a73d757e0 con 0x561a73d74c50 2024-09-18T02:06:08.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7effcd7fa640 1 -- 172.21.15.167:0/3352915419 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00d80c0d50 con 0x561a73d74c50 2024-09-18T02:06:08.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7effcd7fa640 1 --2- 172.21.15.167:0/3352915419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effc0034650 0x7effc0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7effcd7fa640 1 -- 172.21.15.167:0/3352915419 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f00d80eb070 con 0x561a73d74c50 2024-09-18T02:06:08.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00e7798640 1 --2- 172.21.15.167:0/3352915419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effc0034650 0x7effc0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 Processor -- start 2024-09-18T02:06:08.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 -- start start 2024-09-18T02:06:08.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00e7798640 1 --2- 172.21.15.167:0/3352915419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effc0034650 0x7effc0036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x561a73d5b500 tx=0x7f00dc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d815f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561a73d50490 con 0x561a73d81210 2024-09-18T02:06:08.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00e7f99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d815f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00e7f99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d815f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50468/0 (socket says 172.21.15.167:50468) 2024-09-18T02:06:08.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00e7f99640 1 -- 172.21.15.167:0/3100469352 learned_addr learned my addr 172.21.15.167:0/3100469352 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00e7f99640 1 -- 172.21.15.167:0/3100469352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a73d81bc0 con 0x561a73d81210 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00e7f99640 1 --2- 172.21.15.167:0/3100469352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d815f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f00d80c0990 tx=0x7f00d80d52c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fb0c14b1c356fe server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7effc6ffd640 1 -- 172.21.15.167:0/3100469352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80fe030 con 0x561a73d81210 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7effc6ffd640 1 -- 172.21.15.167:0/3100469352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d80b3c00 con 0x561a73d81210 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7effc6ffd640 1 -- 172.21.15.167:0/3100469352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80f5070 con 0x561a73d81210 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 -- 172.21.15.167:0/3100469352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 msgr2=0x561a73d815f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 --2- 172.21.15.167:0/3100469352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d815f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f00d80c0990 tx=0x7f00d80d52c0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 -- 172.21.15.167:0/3100469352 shutdown_connections 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 --2- 172.21.15.167:0/3100469352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d815f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 -- 172.21.15.167:0/3100469352 >> 172.21.15.167:0/3100469352 conn(0x561a73d7d5f0 msgr2=0x561a73d7b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 -- 172.21.15.167:0/3100469352 shutdown_connections 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 -- 172.21.15.167:0/3100469352 wait complete. 2024-09-18T02:06:08.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 Processor -- start 2024-09-18T02:06:08.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 -- start start 2024-09-18T02:06:08.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d883f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.615+0000 7f00ea489980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561a73d82060 con 0x561a73d81210 2024-09-18T02:06:08.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e7f99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d883f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e7f99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d883f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50476/0 (socket says 172.21.15.167:50476) 2024-09-18T02:06:08.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 learned_addr learned my addr 172.21.15.167:0/2352163281 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a73d88930 con 0x561a73d81210 2024-09-18T02:06:08.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e7f99640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d883f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f00d80c9ff0 tx=0x7f00d80b7f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7effc57fa640 1 -- 172.21.15.167:0/2352163281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80c6730 con 0x561a73d81210 2024-09-18T02:06:08.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7effc57fa640 1 -- 172.21.15.167:0/2352163281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d8111030 con 0x561a73d81210 2024-09-18T02:06:08.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a73d88930 con 0x561a73d81210 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7effc57fa640 1 -- 172.21.15.167:0/2352163281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d80c68d0 con 0x561a73d81210 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a73d88930 con 0x561a73d81210 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7effc57fa640 1 -- 172.21.15.167:0/2352163281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00d80cfa10 con 0x561a73d81210 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7effc57fa640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effb0034600 0x7effb0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7effc57fa640 1 -- 172.21.15.167:0/2352163281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f00d8102050 con 0x561a73d81210 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e7798640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effb0034600 0x7effb0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561a73d93410 0x561a73d958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d96020 con 0x561a73d93410 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e879a640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561a73d93410 0x561a73d958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e7798640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effb0034600 0x7effb0036ac0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x561a73d67580 tx=0x7f00dc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e879a640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561a73d93410 0x561a73d958d0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 20 realm 2024-09-18T02:06:08.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d96430 con 0x561a73d93410 2024-09-18T02:06:08.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:08.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d96d00 con 0x561a73d93410 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.619+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d93410 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00ea489980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00ea489980 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561a73d97e00 0x561a73d9a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d9a800 con 0x561a73d97e00 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e7f99640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561a73d97e00 0x561a73d9a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e7f99640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561a73d97e00 0x561a73d9a1f0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00ea489980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00ea489980 20 searching for the correct realm 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00ea489980 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561a73d9c750 0x561a73d9eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d9f230 con 0x561a73d9c750 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e7798640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561a73d9c750 0x561a73d9eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e7798640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561a73d9c750 0x561a73d9eb60 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e7798640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00dc01fbe0 0x7f00dc03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d9f230 con 0x7f00dc01fbe0 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e879a640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00dc01fbe0 0x7f00dc03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e879a640 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00dc01fbe0 0x7f00dc03a3c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d93410 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.623+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d93410 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d93410 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d97e00 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d9c750 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d93410 2024-09-18T02:06:08.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d93410 2024-09-18T02:06:08.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d9c750 2024-09-18T02:06:08.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d9c750 2024-09-18T02:06:08.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d97e00 2024-09-18T02:06:08.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d9c750 2024-09-18T02:06:08.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.627+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d9c750 2024-09-18T02:06:08.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d93410 2024-09-18T02:06:08.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d93410 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d97e00 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d9c750 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d93410 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d97e00 2024-09-18T02:06:08.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d9c750 2024-09-18T02:06:08.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d97e00 2024-09-18T02:06:08.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.631+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d9c750 2024-09-18T02:06:08.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d97e00 2024-09-18T02:06:08.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x561a73d93410 2024-09-18T02:06:08.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a73d970a0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:08.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:08.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:08.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:08.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:08.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d9b0c0 con 0x561a73d93410 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d9b0c0 con 0x561a73d93410 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d9b0c0 con 0x561a73d9c750 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 zone default found 2024-09-18T02:06:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 4 Realm: () 2024-09-18T02:06:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 zonegroup default 2024-09-18T02:06:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d9bab0 con 0x561a73d97e00 2024-09-18T02:06:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73d9b680 con 0x561a73d9c750 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73da1670 con 0x561a73d9c750 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 started sync module instance, tier type = 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.635+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da09d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.639+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.639+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94671612808944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da09d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.639+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da2150 con 0x561a73d93410 2024-09-18T02:06:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.639+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94671612808944] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.639+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.639+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94671612812352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da09d0 con 0x561a73d93410 2024-09-18T02:06:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.639+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da2b60 con 0x561a73d9c750 2024-09-18T02:06:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.643+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94671612812352] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.643+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.643+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94671612806432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da0940 con 0x561a73d9c750 2024-09-18T02:06:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.643+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da3860 con 0x7f00dc01fbe0 2024-09-18T02:06:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.643+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.643+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94671612818656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da4100 con 0x7f00dc01fbe0 2024-09-18T02:06:08.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.643+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da4ac0 con 0x561a73d93410 2024-09-18T02:06:08.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.643+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94671612806432] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.647+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94671612818656] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.647+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.647+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94671612823056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da4070 con 0x561a73d93410 2024-09-18T02:06:08.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.647+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da4a30 con 0x561a73d97e00 2024-09-18T02:06:08.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.647+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94671612823056] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.647+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.647+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94671612820720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da5360 con 0x561a73d97e00 2024-09-18T02:06:08.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.647+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da5bb0 con 0x561a73d97e00 2024-09-18T02:06:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.651+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.651+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94671612829520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da6820 con 0x561a73d97e00 2024-09-18T02:06:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.651+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da7220 con 0x561a73d97e00 2024-09-18T02:06:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.651+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94671612820720] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.651+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94671612829520] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94671612830576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da6d70 con 0x561a73d97e00 2024-09-18T02:06:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 20 add_watcher() i=0 2024-09-18T02:06:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 20 add_watcher() i=1 2024-09-18T02:06:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 20 add_watcher() i=2 2024-09-18T02:06:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 20 add_watcher() i=3 2024-09-18T02:06:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 20 add_watcher() i=4 2024-09-18T02:06:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 20 add_watcher() i=5 2024-09-18T02:06:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 20 add_watcher() i=6 2024-09-18T02:06:08.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94671612830576] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 20 add_watcher() i=7 2024-09-18T02:06:08.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:08.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73daa3d0 con 0x561a73d93410 2024-09-18T02:06:08.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94671612825184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da77a0 con 0x561a73d93410 2024-09-18T02:06:08.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94671612825184] v32'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7eff9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.655+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da9c40 con 0x561a73d93410 2024-09-18T02:06:08.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.659+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.659+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db3490 con 0x561a73d97e00 2024-09-18T02:06:08.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.659+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.659+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db3490 con 0x561a73d9c750 2024-09-18T02:06:08.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.663+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.663+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db3f50 con 0x561a73d93410 2024-09-18T02:06:08.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.663+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'252 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.663+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db2b90 con 0x7f00dc01fbe0 2024-09-18T02:06:08.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.663+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'83 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.663+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db2b90 con 0x561a73d9c750 2024-09-18T02:06:08.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.663+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'63 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.663+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db4c40 con 0x561a73d93410 2024-09-18T02:06:08.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.667+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.667+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db50f0 con 0x561a73d97e00 2024-09-18T02:06:08.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.671+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.671+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db50f0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.671+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.671+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db50f0 con 0x561a73d9c750 2024-09-18T02:06:08.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.671+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.671+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5180 con 0x7f00dc01fbe0 2024-09-18T02:06:08.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.675+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'84 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.675+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5180 con 0x561a73d97e00 2024-09-18T02:06:08.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.675+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'37 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.675+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5180 con 0x7f00dc01fbe0 2024-09-18T02:06:08.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.675+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.675+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5180 con 0x561a73d97e00 2024-09-18T02:06:08.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.679+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'71 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.679+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5180 con 0x561a73d93410 2024-09-18T02:06:08.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.679+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'253 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.679+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5180 con 0x561a73d9c750 2024-09-18T02:06:08.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.683+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'80 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.683+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5250 con 0x7f00dc01fbe0 2024-09-18T02:06:08.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.683+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'85 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.683+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5210 con 0x561a73d9c750 2024-09-18T02:06:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.687+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.687+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db52c0 con 0x561a73d93410 2024-09-18T02:06:08.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.687+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.687+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db59f0 con 0x561a73d93410 2024-09-18T02:06:08.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.687+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'254 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.692 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.687+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db57c0 con 0x561a73d9c750 2024-09-18T02:06:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.691+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'81 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.691+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5870 con 0x7f00dc01fbe0 2024-09-18T02:06:08.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.691+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.691+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5870 con 0x561a73d9c750 2024-09-18T02:06:08.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.695+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'38 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.696 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.695+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5870 con 0x561a73d9c750 2024-09-18T02:06:08.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.695+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'47 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.695+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5870 con 0x561a73d9c750 2024-09-18T02:06:08.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.695+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.695+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5870 con 0x561a73d9c750 2024-09-18T02:06:08.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.699+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'64 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.699+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5870 con 0x561a73d97e00 2024-09-18T02:06:08.702 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.699+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.699+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5870 con 0x561a73d9c750 2024-09-18T02:06:08.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.703+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'44 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.703+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5870 con 0x561a73d97e00 2024-09-18T02:06:08.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.703+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.703+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5870 con 0x561a73d9c750 2024-09-18T02:06:08.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.707+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'82 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.707+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5870 con 0x561a73d97e00 2024-09-18T02:06:08.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.707+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'72 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.707+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db5870 con 0x7f00dc01fbe0 2024-09-18T02:06:08.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7eff9cfe1640 20 reqs_thread_entry: start 2024-09-18T02:06:08.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00ea489980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:08.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00ea489980 20 Filter name: none 2024-09-18T02:06:08.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7eff167fc640 20 reqs_thread_entry: start 2024-09-18T02:06:08.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00ea489980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-18T02:06:08.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00ea489980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73db1f80 con 0x561a73d97e00 2024-09-18T02:06:08.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00ea489980 20 rados_obj.operate() r=0 bl.length=349 2024-09-18T02:06:08.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00ea489980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-18T02:06:08.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00ea489980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T02:06:08.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00ea489980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:08.716 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.711+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73db1f80 con 0x561a73d97e00 2024-09-18T02:06:08.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00ea489980 10 removing key index: system_akey 2024-09-18T02:06:08.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73db1f80 con 0x561a73d9c750 2024-09-18T02:06:08.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(96 system_akey [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00ea489980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-18T02:06:08.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94671613010112 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73dd3ac0 con 0x561a73d93410 2024-09-18T02:06:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== watch-notify(notify (1) cookie 94671612812352 notify 137438953495 ret 0) ==== 203+0+0 (crc 0 0 0) 0x561a73db2650 con 0x561a73d93410 2024-09-18T02:06:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7effc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94671612812352 notifier 4858 bl.length()=161 2024-09-18T02:06:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(97 notify.1 [notify cookie 94671613010112 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7effc6ffd640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7effac003d70 con 0x561a73d93410 2024-09-18T02:06:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== watch-notify(notify_complete (2) cookie 94671613010112 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a73db2f30 con 0x561a73d93410 2024-09-18T02:06:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00ea489980 10 removing email index: 2024-09-18T02:06:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00ea489980 10 removing user buckets index 2024-09-18T02:06:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.715+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73dd1560 con 0x561a73d97e00 2024-09-18T02:06:08.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(99 system_user.buckets [delete] v32'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7f00ea489980 10 removing user index: system_user 2024-09-18T02:06:08.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73dd3080 con 0x561a73d97e00 2024-09-18T02:06:08.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(100 system_user [call,call,delete] v32'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7f00ea489980 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-18T02:06:08.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7f00ea489980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-18T02:06:08.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94671613005920 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a73dd2980 con 0x7f00dc01fbe0 2024-09-18T02:06:08.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== watch-notify(notify (1) cookie 94671612808944 notify 137438953496 ret 0) ==== 202+0+0 (crc 0 0 0) 0x561a73db2f30 con 0x7f00dc01fbe0 2024-09-18T02:06:08.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7effc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94671612808944 notifier 4858 bl.length()=160 2024-09-18T02:06:08.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(101 notify.0 [notify cookie 94671613005920 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7effc6ffd640 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7effac003d70 con 0x7f00dc01fbe0 2024-09-18T02:06:08.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.719+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 23 ==== watch-notify(notify_complete (2) cookie 94671613005920 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a73db2480 con 0x7f00dc01fbe0 2024-09-18T02:06:08.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.723+0000 7eff9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:08.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.723+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94671612825184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73dd2d70 con 0x561a73d93410 2024-09-18T02:06:08.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.723+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94671612825184] v32'255 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.726 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.723+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94671612808944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da4e60 con 0x7f00dc01fbe0 2024-09-18T02:06:08.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.723+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94671612808944] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.723+0000 7f00ea489980 20 remove_watcher() i=0 2024-09-18T02:06:08.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.723+0000 7f00ea489980 2 removed watcher, disabling cache 2024-09-18T02:06:08.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.723+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94671612812352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da0ef0 con 0x561a73d93410 2024-09-18T02:06:08.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.727+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94671612812352] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x561a73d93410 2024-09-18T02:06:08.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.727+0000 7f00ea489980 20 remove_watcher() i=1 2024-09-18T02:06:08.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.727+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94671612806432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da0ef0 con 0x561a73d9c750 2024-09-18T02:06:08.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.727+0000 7f00e7798640 1 -- 172.21.15.167:0/2352163281 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94671612806432] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00dc037040 con 0x561a73d9c750 2024-09-18T02:06:08.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.727+0000 7f00ea489980 20 remove_watcher() i=2 2024-09-18T02:06:08.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.727+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94671612818656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da0520 con 0x7f00dc01fbe0 2024-09-18T02:06:08.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.731+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.2 v2:172.21.15.167:6816/2055439504 25 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94671612818656] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e000a4d0 con 0x7f00dc01fbe0 2024-09-18T02:06:08.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.731+0000 7f00ea489980 20 remove_watcher() i=3 2024-09-18T02:06:08.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.731+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94671612823056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da0ef0 con 0x561a73d93410 2024-09-18T02:06:08.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.731+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94671612823056] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e004e040 con 0x561a73d93410 2024-09-18T02:06:08.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.731+0000 7f00ea489980 20 remove_watcher() i=4 2024-09-18T02:06:08.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.731+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94671612820720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da34e0 con 0x561a73d97e00 2024-09-18T02:06:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.735+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94671612820720] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.735+0000 7f00ea489980 20 remove_watcher() i=5 2024-09-18T02:06:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.735+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94671612829520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da0520 con 0x561a73d97e00 2024-09-18T02:06:08.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.735+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94671612829520] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.735+0000 7f00ea489980 20 remove_watcher() i=6 2024-09-18T02:06:08.740 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.735+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94671612830576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a73da4610 con 0x561a73d97e00 2024-09-18T02:06:08.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00e7f99640 1 -- 172.21.15.167:0/2352163281 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94671612830576] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00d811d070 con 0x561a73d97e00 2024-09-18T02:06:08.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 20 remove_watcher() i=7 2024-09-18T02:06:08.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561a73d97e00 msgr2=0x561a73d9a1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.744 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561a73d97e00 0x561a73d9a1f0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561a73d93410 msgr2=0x561a73d958d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561a73d93410 0x561a73d958d0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00dc01fbe0 msgr2=0x7f00dc03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f00dc01fbe0 0x7f00dc03a3c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561a73d9c750 msgr2=0x561a73d9eb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561a73d9c750 0x561a73d9eb60 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effb0034600 msgr2=0x7effb0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effb0034600 0x7effb0036ac0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x561a73d67580 tx=0x7f00dc010000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 msgr2=0x561a73d883f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00e879a640 1 -- 172.21.15.167:0/2352163281 reap_dead start 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d883f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f00d80c9ff0 tx=0x7f00d80b7f90 comp rx=0 tx=0).stop 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 shutdown_connections 2024-09-18T02:06:08.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/2352163281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d81210 0x561a73d883f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 >> 172.21.15.167:0/2352163281 conn(0x561a73d7d5f0 msgr2=0x561a73d7b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 shutdown_connections 2024-09-18T02:06:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/2352163281 wait complete. 2024-09-18T02:06:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3352915419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effc0034650 msgr2=0x7effc0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/3352915419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effc0034650 0x7effc0036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x561a73d5b500 tx=0x7f00dc00f000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3352915419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d74c50 msgr2=0x561a73d75070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/3352915419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d74c50 0x561a73d75070 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f00d80a4050 tx=0x7f00d80b3950 comp rx=0 tx=0).stop 2024-09-18T02:06:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3352915419 shutdown_connections 2024-09-18T02:06:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/3352915419 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effc0034650 0x7effc0036b10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/3352915419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73d74c50 0x561a73d75070 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3352915419 >> 172.21.15.167:0/3352915419 conn(0x561a73d69da0 msgr2=0x561a73d6c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3352915419 shutdown_connections 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3352915419 wait complete. 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561a73d605f0 msgr2=0x561a73d62ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x561a73d605f0 0x561a73d62ab0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561a73c67ce0 msgr2=0x561a73d5dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x561a73c67ce0 0x561a73d5dd80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561a73d646a0 msgr2=0x561a73d66a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x561a73d646a0 0x561a73d66a90 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effd0034650 msgr2=0x7effd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7effd0034650 0x7effd0036b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f00dc001e50 tx=0x7f00dc0013b0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 msgr2=0x561a73d56df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 --2- 172.21.15.167:0/3673114881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a73bd7290 0x561a73d56df0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f00d801b170 tx=0x7f00d80180e0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.747 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00e879a640 1 -- 172.21.15.167:0/3673114881 reap_dead start 2024-09-18T02:06:08.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 shutdown_connections 2024-09-18T02:06:08.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 >> 172.21.15.167:0/3673114881 conn(0x561a73c5d090 msgr2=0x561a73d4a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 shutdown_connections 2024-09-18T02:06:08.748 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.739+0000 7f00ea489980 1 -- 172.21.15.167:0/3673114881 wait complete. 2024-09-18T02:06:08.752 ERROR:root:None 2024-09-18T02:06:08.752 ERROR:root:0 2024-09-18T02:06:08.752 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-18T02:06:08.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-18T02:06:08.753 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-18T02:06:08.838 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:08.838 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:08.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.835+0000 7f5fe5782980 1 Processor -- start 2024-09-18T02:06:08.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.835+0000 7f5fe5782980 1 -- start start 2024-09-18T02:06:08.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.835+0000 7f5fe5782980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562827baf880 0x562827bafc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.835+0000 7f5fe5782980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562827a35ae0 con 0x562827bb01d0 2024-09-18T02:06:08.839 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.835+0000 7f5fe5782980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x562827a59e30 con 0x562827baf880 2024-09-18T02:06:08.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.835+0000 7f5fe3292640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562827baf880 0x562827bafc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.835+0000 7f5fe2a91640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x562827bb01d0 0x562827bb4c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33890/0 (socket says 172.21.15.167:33890) 2024-09-18T02:06:08.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.835+0000 7f5fe2a91640 1 -- 172.21.15.167:0/359545395 learned_addr learned my addr 172.21.15.167:0/359545395 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:08.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.835+0000 7f5fe2290640 1 -- 172.21.15.167:0/359545395 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4294491316 0 0) 0x562827a35ae0 con 0x562827bb01d0 2024-09-18T02:06:08.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.835+0000 7f5fe2290640 1 -- 172.21.15.167:0/359545395 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fcc001e20 con 0x562827bb01d0 2024-09-18T02:06:08.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe3292640 1 -- 172.21.15.167:0/359545395 >> v1:172.21.15.81:6789/0 conn(0x562827bb01d0 legacy=0x562827bb4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe3292640 1 -- 172.21.15.167:0/359545395 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562827bb7450 con 0x562827baf880 2024-09-18T02:06:08.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe3292640 1 --2- 172.21.15.167:0/359545395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827bafc60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400a480 tx=0x7f5fd401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a6b4fbc8d05a53 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe2290640 1 -- 172.21.15.167:0/359545395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40b0070 con 0x562827baf880 2024-09-18T02:06:08.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe2290640 1 -- 172.21.15.167:0/359545395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd40ab540 con 0x562827baf880 2024-09-18T02:06:08.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe2290640 1 -- 172.21.15.167:0/359545395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40ab840 con 0x562827baf880 2024-09-18T02:06:08.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe5782980 1 -- 172.21.15.167:0/359545395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 msgr2=0x562827bafc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe5782980 1 --2- 172.21.15.167:0/359545395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827bafc60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400a480 tx=0x7f5fd401b280 comp rx=0 tx=0).stop 2024-09-18T02:06:08.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe5782980 1 -- 172.21.15.167:0/359545395 shutdown_connections 2024-09-18T02:06:08.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe5782980 1 --2- 172.21.15.167:0/359545395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827bafc60 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe5782980 1 -- 172.21.15.167:0/359545395 >> 172.21.15.167:0/359545395 conn(0x562827b231d0 msgr2=0x562827b235e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe5782980 1 -- 172.21.15.167:0/359545395 shutdown_connections 2024-09-18T02:06:08.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.839+0000 7f5fe5782980 1 -- 172.21.15.167:0/359545395 wait complete. 2024-09-18T02:06:08.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 Processor -- start 2024-09-18T02:06:08.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 -- start start 2024-09-18T02:06:08.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827c9aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562827a5b200 con 0x562827baf880 2024-09-18T02:06:08.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe3292640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827c9aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe3292640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827c9aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50498/0 (socket says 172.21.15.167:50498) 2024-09-18T02:06:08.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe3292640 1 -- 172.21.15.167:0/772397992 learned_addr learned my addr 172.21.15.167:0/772397992 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe3292640 1 -- 172.21.15.167:0/772397992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562827c9b020 con 0x562827baf880 2024-09-18T02:06:08.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe3292640 1 --2- 172.21.15.167:0/772397992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827c9aa50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4000c10 tx=0x7f5fd4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c9abc40934c1ef server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5ed160a640 1 -- 172.21.15.167:0/772397992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40b0070 con 0x562827baf880 2024-09-18T02:06:08.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5ed160a640 1 -- 172.21.15.167:0/772397992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd40bc070 con 0x562827baf880 2024-09-18T02:06:08.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5ed160a640 1 -- 172.21.15.167:0/772397992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40abc30 con 0x562827baf880 2024-09-18T02:06:08.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 -- 172.21.15.167:0/772397992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 msgr2=0x562827c9aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 --2- 172.21.15.167:0/772397992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827c9aa50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4000c10 tx=0x7f5fd4003030 comp rx=0 tx=0).stop 2024-09-18T02:06:08.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 -- 172.21.15.167:0/772397992 shutdown_connections 2024-09-18T02:06:08.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 --2- 172.21.15.167:0/772397992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827c9aa50 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 -- 172.21.15.167:0/772397992 >> 172.21.15.167:0/772397992 conn(0x562827b231d0 msgr2=0x562827c96680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 -- 172.21.15.167:0/772397992 shutdown_connections 2024-09-18T02:06:08.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 -- 172.21.15.167:0/772397992 wait complete. 2024-09-18T02:06:08.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 Processor -- start 2024-09-18T02:06:08.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 -- start start 2024-09-18T02:06:08.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827ca1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe5782980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562827bb6e90 con 0x562827baf880 2024-09-18T02:06:08.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe3292640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827ca1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe3292640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827ca1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50510/0 (socket says 172.21.15.167:50510) 2024-09-18T02:06:08.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.855+0000 7f5fe3292640 1 -- 172.21.15.167:0/588146089 learned_addr learned my addr 172.21.15.167:0/588146089 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe3292640 1 -- 172.21.15.167:0/588146089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562827ca21c0 con 0x562827baf880 2024-09-18T02:06:08.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe3292640 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827ca1c80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4019930 tx=0x7f5fd4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5ecfe07640 1 -- 172.21.15.167:0/588146089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40b77c0 con 0x562827baf880 2024-09-18T02:06:08.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562827ca2450 con 0x562827baf880 2024-09-18T02:06:08.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5ecfe07640 1 -- 172.21.15.167:0/588146089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd40b1040 con 0x562827baf880 2024-09-18T02:06:08.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5ecfe07640 1 -- 172.21.15.167:0/588146089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40b7ab0 con 0x562827baf880 2024-09-18T02:06:08.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562827ca5130 con 0x562827baf880 2024-09-18T02:06:08.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5ecfe07640 1 -- 172.21.15.167:0/588146089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5fd40b7c50 con 0x562827baf880 2024-09-18T02:06:08.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5ecfe07640 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ec8034650 0x7f5ec8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5ecfe07640 1 -- 172.21.15.167:0/588146089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5fd40a8070 con 0x562827baf880 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe2a91640 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ec8034650 0x7f5ec8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe5782980 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562827bb01d0 0x562827ca8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ca9280 con 0x562827bb01d0 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe3a93640 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562827bb01d0 0x562827ca8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe2a91640 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ec8034650 0x7f5ec8036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8000f70 tx=0x7f5fd80010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe3a93640 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562827bb01d0 0x562827ca8c10 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe3a93640 1 -- 172.21.15.167:0/588146089 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827bb01d0 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ca6330 con 0x562827bb01d0 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe3a93640 1 -- 172.21.15.167:0/588146089 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827bb01d0 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe5782980 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562827cab600 0x562827cad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.859+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827cae0c0 con 0x562827cab600 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe3292640 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562827cab600 0x562827cad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe3292640 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562827cab600 0x562827cad9f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe3292640 1 -- 172.21.15.167:0/588146089 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827cab600 2024-09-18T02:06:08.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827caa4a0 con 0x562827bb01d0 2024-09-18T02:06:08.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe3a93640 1 -- 172.21.15.167:0/588146089 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827bb01d0 2024-09-18T02:06:08.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe5782980 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562827caf520 0x562827cb1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827cb2010 con 0x562827caf520 2024-09-18T02:06:08.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe2a91640 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562827caf520 0x562827cb1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe2a91640 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562827caf520 0x562827cb1910 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe2a91640 1 -- 172.21.15.167:0/588146089 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827caf520 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe5782980 1 Processor -- start 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe5782980 1 -- start start 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe5782980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827cbfae0 0x562827cbff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe5782980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562827ab4800 con 0x562827cbfae0 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe3292640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827cbfae0 0x562827cbff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe3292640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827cbfae0 0x562827cbff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50518/0 (socket says 172.21.15.167:50518) 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.863+0000 7f5fe3292640 1 -- 172.21.15.167:0/4221453210 learned_addr learned my addr 172.21.15.167:0/4221453210 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe3292640 1 -- 172.21.15.167:0/4221453210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562827cc0440 con 0x562827cbfae0 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe3292640 1 --2- 172.21.15.167:0/4221453210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827cbfae0 0x562827cbff00 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40bf900 tx=0x7f5fd40aa6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5ecd602640 1 -- 172.21.15.167:0/4221453210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40ceb20 con 0x562827cbfae0 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe5782980 1 -- 172.21.15.167:0/4221453210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562827cc06d0 con 0x562827cbfae0 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5ecd602640 1 -- 172.21.15.167:0/4221453210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd40cecc0 con 0x562827cbfae0 2024-09-18T02:06:08.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5ecd602640 1 -- 172.21.15.167:0/4221453210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40cc660 con 0x562827cbfae0 2024-09-18T02:06:08.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe5782980 1 -- 172.21.15.167:0/4221453210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562827cc06d0 con 0x562827cbfae0 2024-09-18T02:06:08.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5ecd602640 1 -- 172.21.15.167:0/4221453210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5fd40b57d0 con 0x562827cbfae0 2024-09-18T02:06:08.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5ecd602640 1 --2- 172.21.15.167:0/4221453210 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ebc034650 0x7f5ebc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5ecd602640 1 -- 172.21.15.167:0/4221453210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5fd40d80c0 con 0x562827cbfae0 2024-09-18T02:06:08.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe2a91640 1 --2- 172.21.15.167:0/4221453210 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ebc034650 0x7f5ebc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe5782980 1 Processor -- start 2024-09-18T02:06:08.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe5782980 1 -- start start 2024-09-18T02:06:08.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe2a91640 1 --2- 172.21.15.167:0/4221453210 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ebc034650 0x7f5ebc036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800c010 tx=0x7f5fd800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe5782980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827ccc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe5782980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562827c9b2e0 con 0x562827ccc270 2024-09-18T02:06:08.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe3292640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827ccc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe3292640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827ccc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50530/0 (socket says 172.21.15.167:50530) 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe3292640 1 -- 172.21.15.167:0/1779114375 learned_addr learned my addr 172.21.15.167:0/1779114375 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe3292640 1 -- 172.21.15.167:0/1779114375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562827cccc20 con 0x562827ccc270 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5fe3292640 1 --2- 172.21.15.167:0/1779114375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827ccc650 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4005410 tx=0x7f5fd40e17b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956ba8dac889451e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5ec6ffd640 1 -- 172.21.15.167:0/1779114375 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40d5ab0 con 0x562827ccc270 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5ec6ffd640 1 -- 172.21.15.167:0/1779114375 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd40e9460 con 0x562827ccc270 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.867+0000 7f5ec6ffd640 1 -- 172.21.15.167:0/1779114375 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40d5c50 con 0x562827ccc270 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 -- 172.21.15.167:0/1779114375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 msgr2=0x562827ccc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 --2- 172.21.15.167:0/1779114375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827ccc650 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4005410 tx=0x7f5fd40e17b0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 -- 172.21.15.167:0/1779114375 shutdown_connections 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 --2- 172.21.15.167:0/1779114375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827ccc650 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 -- 172.21.15.167:0/1779114375 >> 172.21.15.167:0/1779114375 conn(0x562827cc8650 msgr2=0x562827cc6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 -- 172.21.15.167:0/1779114375 shutdown_connections 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 -- 172.21.15.167:0/1779114375 wait complete. 2024-09-18T02:06:08.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 Processor -- start 2024-09-18T02:06:08.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 -- start start 2024-09-18T02:06:08.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827cd3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562827ccd0c0 con 0x562827ccc270 2024-09-18T02:06:08.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe3292640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827cd3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe3292640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827cd3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50534/0 (socket says 172.21.15.167:50534) 2024-09-18T02:06:08.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 learned_addr learned my addr 172.21.15.167:0/498284127 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:08.876 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562827cd39d0 con 0x562827ccc270 2024-09-18T02:06:08.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe3292640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827cd3490 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40e15c0 tx=0x7f5fd40daf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5ec57fa640 1 -- 172.21.15.167:0/498284127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40b5e00 con 0x562827ccc270 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562827cd39d0 con 0x562827ccc270 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5ec57fa640 1 -- 172.21.15.167:0/498284127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd40e18b0 con 0x562827ccc270 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5ec57fa640 1 -- 172.21.15.167:0/498284127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40e1b90 con 0x562827ccc270 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562827cd39d0 con 0x562827ccc270 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5ec57fa640 1 -- 172.21.15.167:0/498284127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5fd4104040 con 0x562827ccc270 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5ec57fa640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5eac034650 0x7f5eac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5ec57fa640 1 -- 172.21.15.167:0/498284127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5fd4102020 con 0x562827ccc270 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.871+0000 7f5fe2a91640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5eac034650 0x7f5eac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562827cde3b0 0x562827ce0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ce0f90 con 0x562827cde3b0 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe3a93640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562827cde3b0 0x562827ce0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe2a91640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5eac034650 0x7f5eac036b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x562827ca9bb0 tx=0x7f5fd8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe3a93640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562827cde3b0 0x562827ce0840 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 20 realm 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ce13a0 con 0x562827cde3b0 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1c40 con 0x562827cde3b0 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827cde3b0 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562827ce2d40 0x562827ce5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ce5780 con 0x562827ce2d40 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe3292640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562827ce2d40 0x562827ce5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe3292640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562827ce2d40 0x562827ce5130 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 20 searching for the correct realm 2024-09-18T02:06:08.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562827ce7660 0x562827ce9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827cea150 con 0x562827ce7660 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe2a91640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562827ce7660 0x562827ce9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe2a91640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562827ce7660 0x562827ce9ad0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe2a91640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5fd8037040 0x7f5fd8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.875+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827cea150 con 0x7f5fd8037040 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5fd8037040 0x7f5fd8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5fd8037040 0x7f5fd8036410 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x7f5fd8037040 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827cde3b0 2024-09-18T02:06:08.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827cde3b0 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827cde3b0 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce2d40 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x7f5fd8037040 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce7660 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827cde3b0 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x7f5fd8037040 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827cde3b0 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x7f5fd8037040 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.879+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce7660 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce7660 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce2d40 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce7660 2024-09-18T02:06:08.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce7660 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827cde3b0 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827cde3b0 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce2d40 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce7660 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x7f5fd8037040 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.894 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827cde3b0 2024-09-18T02:06:08.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.883+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce2d40 2024-09-18T02:06:08.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce7660 2024-09-18T02:06:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce2d40 2024-09-18T02:06:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x7f5fd8037040 2024-09-18T02:06:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce7660 2024-09-18T02:06:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827ce2d40 2024-09-18T02:06:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x562827cde3b0 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562827ce1fe0 con 0x7f5fd8037040 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ce5fd0 con 0x562827cde3b0 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ce5fd0 con 0x562827cde3b0 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ce5fd0 con 0x562827ce7660 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 zone default found 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 4 Realm: () 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 zonegroup default 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.887+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ce69c0 con 0x562827ce2d40 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827ce6550 con 0x562827ce7660 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827cec530 con 0x562827ce7660 2024-09-18T02:06:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 20 started sync module instance, tier type = 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827ceb8f0 con 0x7f5fd8037040 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94730466541072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827ceb8f0 con 0x7f5fd8037040 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827ced040 con 0x562827cde3b0 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.891+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94730466541072] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.895+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.895+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94730466544432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827ceb8f0 con 0x562827cde3b0 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.895+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827ceda50 con 0x562827ce7660 2024-09-18T02:06:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.895+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94730466544432] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.895+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.895+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94730466538560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827ceb860 con 0x562827ce7660 2024-09-18T02:06:08.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.895+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cee910 con 0x7f5fd8037040 2024-09-18T02:06:08.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.899+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.899+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94730466551152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827ceef80 con 0x7f5fd8037040 2024-09-18T02:06:08.906 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.899+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cefaa0 con 0x562827cde3b0 2024-09-18T02:06:08.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.899+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94730466538560] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.899+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94730466551152] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.899+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.899+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94730466555248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cefa60 con 0x562827cde3b0 2024-09-18T02:06:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.899+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cefe90 con 0x562827ce2d40 2024-09-18T02:06:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.903+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94730466555248] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.903+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.903+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94730466552272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cf0230 con 0x562827ce2d40 2024-09-18T02:06:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.903+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cf0ae0 con 0x562827ce2d40 2024-09-18T02:06:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.903+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.903+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94730466561664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cf1750 con 0x562827ce2d40 2024-09-18T02:06:08.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.903+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cf21a0 con 0x562827ce2d40 2024-09-18T02:06:08.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.903+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94730466552272] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94730466565264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cf2420 con 0x562827ce2d40 2024-09-18T02:06:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 20 add_watcher() i=0 2024-09-18T02:06:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 20 add_watcher() i=1 2024-09-18T02:06:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 20 add_watcher() i=2 2024-09-18T02:06:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 20 add_watcher() i=3 2024-09-18T02:06:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 20 add_watcher() i=4 2024-09-18T02:06:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 20 add_watcher() i=5 2024-09-18T02:06:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94730466561664] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 20 add_watcher() i=6 2024-09-18T02:06:08.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94730466565264] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 20 add_watcher() i=7 2024-09-18T02:06:08.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:08.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827cf12a0 con 0x562827cde3b0 2024-09-18T02:06:08.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.911 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.907+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94730466562720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cf2960 con 0x562827cde3b0 2024-09-18T02:06:08.913 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94730466562720] v32'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5e99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 5 note: GC not initialized 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5e98fe1640 20 reqs_thread_entry: start 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 20 Filter name: none 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5e127fc640 20 reqs_thread_entry: start 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827d18b00 con 0x562827ce7660 2024-09-18T02:06:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 20 rados->read ofs=0 len=0 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827d172a0 con 0x562827ce7660 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-18T02:06:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827d17b40 con 0x562827ce7660 2024-09-18T02:06:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v32'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-18T02:06:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T02:06:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-18T02:06:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94730466719376 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827d1c5a0 con 0x562827ce7660 2024-09-18T02:06:08.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== watch-notify(notify (1) cookie 94730466538560 notify 137438953491 ret 0) ==== 584+0+0 (crc 0 0 0) 0x562827d17ee0 con 0x562827ce7660 2024-09-18T02:06:08.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5ec6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94730466538560 notifier 4865 bl.length()=542 2024-09-18T02:06:08.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(65 notify.2 [notify cookie 94730466719376 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5ec6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-18T02:06:08.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5ec6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T02:06:08.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5ec6ffd640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5ea8003eb0 con 0x562827ce7660 2024-09-18T02:06:08.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== watch-notify(notify_complete (2) cookie 94730466719376 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562827d18550 con 0x562827ce7660 2024-09-18T02:06:08.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.911+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827d1a0d0 con 0x562827ce7660 2024-09-18T02:06:08.918 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v32'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5fe5782980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-18T02:06:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5fe5782980 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-18T02:06:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5fe5782980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-18T02:06:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94730466719296 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562827d1c5a0 con 0x562827ce2d40 2024-09-18T02:06:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== watch-notify(notify (1) cookie 94730466552272 notify 137438953520 ret 0) ==== 217+0+0 (crc 0 0 0) 0x562827cc0440 con 0x562827ce2d40 2024-09-18T02:06:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5ec6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953520 cookie 94730466552272 notifier 4865 bl.length()=175 2024-09-18T02:06:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5ec6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-18T02:06:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5ec6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-18T02:06:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5ec6ffd640 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5ea8003eb0 con 0x562827ce2d40 2024-09-18T02:06:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(68 notify.5 [notify cookie 94730466719296 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== watch-notify(notify_complete (2) cookie 94730466719296 notify 137438953520 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5fd40db030 con 0x562827ce2d40 2024-09-18T02:06:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.921 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-18T02:06:08.914426Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.914411Z","tags":[],"group_ids":[]} 2024-09-18T02:06:08.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5e99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:08.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.915+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94730466562720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827d16900 con 0x562827cde3b0 2024-09-18T02:06:08.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.919+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94730466562720] v32'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.919+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94730466541072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827d16900 con 0x7f5fd8037040 2024-09-18T02:06:08.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.919+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94730466541072] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.919+0000 7f5fe5782980 20 remove_watcher() i=0 2024-09-18T02:06:08.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.919+0000 7f5fe5782980 2 removed watcher, disabling cache 2024-09-18T02:06:08.922 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.919+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94730466544432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827d16900 con 0x562827cde3b0 2024-09-18T02:06:08.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.919+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94730466544432] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.919+0000 7f5fe5782980 20 remove_watcher() i=1 2024-09-18T02:06:08.924 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.919+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94730466538560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827d16900 con 0x562827ce7660 2024-09-18T02:06:08.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.923+0000 7f5fe2a91640 1 -- 172.21.15.167:0/498284127 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94730466538560] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd800e6c0 con 0x562827ce7660 2024-09-18T02:06:08.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.923+0000 7f5fe5782980 20 remove_watcher() i=2 2024-09-18T02:06:08.926 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.923+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94730466551152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827d16900 con 0x7f5fd8037040 2024-09-18T02:06:08.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.923+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94730466551152] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x7f5fd8037040 2024-09-18T02:06:08.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.923+0000 7f5fe5782980 20 remove_watcher() i=3 2024-09-18T02:06:08.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.923+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94730466555248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cee570 con 0x562827cde3b0 2024-09-18T02:06:08.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.927+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94730466555248] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc00a4d0 con 0x562827cde3b0 2024-09-18T02:06:08.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.927+0000 7f5fe5782980 20 remove_watcher() i=4 2024-09-18T02:06:08.930 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.927+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94730466552272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827d16900 con 0x562827ce2d40 2024-09-18T02:06:08.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.927+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94730466552272] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.927+0000 7f5fe5782980 20 remove_watcher() i=5 2024-09-18T02:06:08.932 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.927+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94730466561664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827ceea20 con 0x562827ce2d40 2024-09-18T02:06:08.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94730466561664] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.933 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 20 remove_watcher() i=6 2024-09-18T02:06:08.934 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94730466565264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562827cf1330 con 0x562827ce2d40 2024-09-18T02:06:08.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe3292640 1 -- 172.21.15.167:0/498284127 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94730466565264] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd40c1400 con 0x562827ce2d40 2024-09-18T02:06:08.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 20 remove_watcher() i=7 2024-09-18T02:06:08.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562827ce2d40 msgr2=0x562827ce5130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562827ce2d40 0x562827ce5130 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562827cde3b0 msgr2=0x562827ce0840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562827cde3b0 0x562827ce0840 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5fd8037040 msgr2=0x7f5fd8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f5fd8037040 0x7f5fd8036410 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562827ce7660 msgr2=0x562827ce9ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562827ce7660 0x562827ce9ad0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5eac034650 msgr2=0x7f5eac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5eac034650 0x7f5eac036b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x562827ca9bb0 tx=0x7f5fd8010000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 msgr2=0x562827cd3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe3a93640 1 -- 172.21.15.167:0/498284127 reap_dead start 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827cd3490 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40e15c0 tx=0x7f5fd40daf90 comp rx=0 tx=0).stop 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 shutdown_connections 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 --2- 172.21.15.167:0/498284127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827ccc270 0x562827cd3490 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 >> 172.21.15.167:0/498284127 conn(0x562827cc8650 msgr2=0x562827cc6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 shutdown_connections 2024-09-18T02:06:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.931+0000 7f5fe5782980 1 -- 172.21.15.167:0/498284127 wait complete. 2024-09-18T02:06:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/4221453210 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ebc034650 msgr2=0x7f5ebc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 --2- 172.21.15.167:0/4221453210 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ebc034650 0x7f5ebc036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800c010 tx=0x7f5fd800f000 comp rx=0 tx=0).stop 2024-09-18T02:06:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/4221453210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827cbfae0 msgr2=0x562827cbff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 --2- 172.21.15.167:0/4221453210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827cbfae0 0x562827cbff00 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40bf900 tx=0x7f5fd40aa6a0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/4221453210 shutdown_connections 2024-09-18T02:06:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 --2- 172.21.15.167:0/4221453210 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ebc034650 0x7f5ebc036b10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 --2- 172.21.15.167:0/4221453210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827cbfae0 0x562827cbff00 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/4221453210 >> 172.21.15.167:0/4221453210 conn(0x562827cb4c30 msgr2=0x562827cb76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/4221453210 shutdown_connections 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/4221453210 wait complete. 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562827cab600 msgr2=0x562827cad9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562827cab600 0x562827cad9f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562827bb01d0 msgr2=0x562827ca8c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562827bb01d0 0x562827ca8c10 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562827caf520 msgr2=0x562827cb1910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562827caf520 0x562827cb1910 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ec8034650 msgr2=0x7f5ec8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5ec8034650 0x7f5ec8036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8000f70 tx=0x7f5fd80010b0 comp rx=0 tx=0).stop 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 msgr2=0x562827ca1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 --2- 172.21.15.167:0/588146089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562827baf880 0x562827ca1c80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4019930 tx=0x7f5fd4018020 comp rx=0 tx=0).stop 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe3a93640 1 -- 172.21.15.167:0/588146089 reap_dead start 2024-09-18T02:06:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 shutdown_connections 2024-09-18T02:06:08.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 >> 172.21.15.167:0/588146089 conn(0x562827b231d0 msgr2=0x562827c95200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:08.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 shutdown_connections 2024-09-18T02:06:08.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:08.935+0000 7f5fe5782980 1 -- 172.21.15.167:0/588146089 wait complete. 2024-09-18T02:06:08.946 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-18T02:06:08.914426Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.914411Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:08.946 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-18T02:06:08.914426Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.914411Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:08.946 ERROR:root:0 2024-09-18T02:06:08.947 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:08.952 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:08.952 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-18T02:06:08.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-18T02:06:08.952 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-18T02:06:09.015 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:09.015 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f74620f1980 1 Processor -- start 2024-09-18T02:06:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f74620f1980 1 -- start start 2024-09-18T02:06:09.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f74620f1980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x557f42699ec0 0x557f4269c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f74620f1980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557f4251bae0 con 0x557f42608290 2024-09-18T02:06:09.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f74620f1980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x557f4253fe30 con 0x557f42699ec0 2024-09-18T02:06:09.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f745f400640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x557f42699ec0 0x557f4269c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f745fc01640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x557f42608290 0x557f426987a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33892/0 (socket says 172.21.15.167:33892) 2024-09-18T02:06:09.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f745fc01640 1 -- 172.21.15.167:0/2641821795 learned_addr learned my addr 172.21.15.167:0/2641821795 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:09.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f745ebff640 1 -- 172.21.15.167:0/2641821795 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1912870808 0 0) 0x557f4251bae0 con 0x557f42608290 2024-09-18T02:06:09.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f745ebff640 1 -- 172.21.15.167:0/2641821795 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f744c001e20 con 0x557f42608290 2024-09-18T02:06:09.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f745f400640 1 -- 172.21.15.167:0/2641821795 >> v1:172.21.15.81:6789/0 conn(0x557f42608290 legacy=0x557f426987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f745f400640 1 -- 172.21.15.167:0/2641821795 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f42608670 con 0x557f42699ec0 2024-09-18T02:06:09.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.015+0000 7f745f400640 1 --2- 172.21.15.167:0/2641821795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42699ec0 0x557f4269c2b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f744800a480 tx=0x7f744801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa9331a5c110ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.019+0000 7f745ebff640 1 -- 172.21.15.167:0/2641821795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74480b0070 con 0x557f42699ec0 2024-09-18T02:06:09.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.019+0000 7f745ebff640 1 -- 172.21.15.167:0/2641821795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74480ab540 con 0x557f42699ec0 2024-09-18T02:06:09.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.019+0000 7f745ebff640 1 -- 172.21.15.167:0/2641821795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74480ab820 con 0x557f42699ec0 2024-09-18T02:06:09.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.019+0000 7f74620f1980 1 -- 172.21.15.167:0/2641821795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42699ec0 msgr2=0x557f4269c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.019+0000 7f74620f1980 1 --2- 172.21.15.167:0/2641821795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42699ec0 0x557f4269c2b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f744800a480 tx=0x7f744801b280 comp rx=0 tx=0).stop 2024-09-18T02:06:09.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.019+0000 7f74620f1980 1 -- 172.21.15.167:0/2641821795 shutdown_connections 2024-09-18T02:06:09.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.019+0000 7f74620f1980 1 --2- 172.21.15.167:0/2641821795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42699ec0 0x557f4269c2b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.019+0000 7f74620f1980 1 -- 172.21.15.167:0/2641821795 >> 172.21.15.167:0/2641821795 conn(0x557f4268e090 msgr2=0x557f426904b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.019+0000 7f74620f1980 1 -- 172.21.15.167:0/2641821795 shutdown_connections 2024-09-18T02:06:09.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.019+0000 7f74620f1980 1 -- 172.21.15.167:0/2641821795 wait complete. 2024-09-18T02:06:09.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f74620f1980 1 Processor -- start 2024-09-18T02:06:09.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f74620f1980 1 -- start start 2024-09-18T02:06:09.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f74620f1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 0x557f42780a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f74620f1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557f42541200 con 0x557f42608290 2024-09-18T02:06:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f745fc01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 0x557f42780a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f745fc01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 0x557f42780a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50554/0 (socket says 172.21.15.167:50554) 2024-09-18T02:06:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f745fc01640 1 -- 172.21.15.167:0/555674694 learned_addr learned my addr 172.21.15.167:0/555674694 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f745fc01640 1 -- 172.21.15.167:0/555674694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f42781030 con 0x557f42608290 2024-09-18T02:06:09.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f745fc01640 1 --2- 172.21.15.167:0/555674694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 0x557f42780a60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7450006fc0 tx=0x7f7450001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c81723bdb07c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f734de0b640 1 -- 172.21.15.167:0/555674694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450004530 con 0x557f42608290 2024-09-18T02:06:09.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f734de0b640 1 -- 172.21.15.167:0/555674694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74500046d0 con 0x557f42608290 2024-09-18T02:06:09.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.031+0000 7f734de0b640 1 -- 172.21.15.167:0/555674694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450004a70 con 0x557f42608290 2024-09-18T02:06:09.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 -- 172.21.15.167:0/555674694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 msgr2=0x557f42780a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 --2- 172.21.15.167:0/555674694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 0x557f42780a60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7450006fc0 tx=0x7f7450001af0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 -- 172.21.15.167:0/555674694 shutdown_connections 2024-09-18T02:06:09.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 --2- 172.21.15.167:0/555674694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 0x557f42780a60 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 -- 172.21.15.167:0/555674694 >> 172.21.15.167:0/555674694 conn(0x557f4268e090 msgr2=0x557f4277c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 -- 172.21.15.167:0/555674694 shutdown_connections 2024-09-18T02:06:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 -- 172.21.15.167:0/555674694 wait complete. 2024-09-18T02:06:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 Processor -- start 2024-09-18T02:06:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 -- start start 2024-09-18T02:06:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 0x557f42787db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557f4269f220 con 0x557f42608290 2024-09-18T02:06:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f745fc01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 0x557f42787db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f745fc01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 0x557f42787db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50566/0 (socket says 172.21.15.167:50566) 2024-09-18T02:06:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f745fc01640 1 -- 172.21.15.167:0/800211064 learned_addr learned my addr 172.21.15.167:0/800211064 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f745fc01640 1 -- 172.21.15.167:0/800211064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f427882f0 con 0x557f42608290 2024-09-18T02:06:09.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f745fc01640 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 0x557f42787db0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7450002260 tx=0x7f7450000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f7347fff640 1 -- 172.21.15.167:0/800211064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450013760 con 0x557f42608290 2024-09-18T02:06:09.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f42788580 con 0x557f42608290 2024-09-18T02:06:09.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f7347fff640 1 -- 172.21.15.167:0/800211064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7450013900 con 0x557f42608290 2024-09-18T02:06:09.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f7347fff640 1 -- 172.21.15.167:0/800211064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450013c00 con 0x557f42608290 2024-09-18T02:06:09.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f4278b260 con 0x557f42608290 2024-09-18T02:06:09.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f7347fff640 1 -- 172.21.15.167:0/800211064 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7450010070 con 0x557f42608290 2024-09-18T02:06:09.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f7347fff640 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7348034650 0x7f7348036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.035+0000 7f7347fff640 1 -- 172.21.15.167:0/800211064 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7450018070 con 0x557f42608290 2024-09-18T02:06:09.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f745f400640 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7348034650 0x7f7348036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f74620f1980 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x557f42699ec0 0x557f4278ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f4278f360 con 0x557f42699ec0 2024-09-18T02:06:09.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f7460402640 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x557f42699ec0 0x557f4278ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f745f400640 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7348034650 0x7f7348036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f74480ad000 tx=0x7f74480a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f7460402640 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x557f42699ec0 0x557f4278ed40 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f7460402640 1 -- 172.21.15.167:0/800211064 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74580083f0 con 0x557f42699ec0 2024-09-18T02:06:09.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f4278c480 con 0x557f42699ec0 2024-09-18T02:06:09.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f7460402640 1 -- 172.21.15.167:0/800211064 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74580083f0 con 0x557f42699ec0 2024-09-18T02:06:09.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f74620f1980 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x557f427916b0 0x557f42793aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f42794170 con 0x557f427916b0 2024-09-18T02:06:09.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f745fc01640 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x557f427916b0 0x557f42793aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f745fc01640 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x557f427916b0 0x557f42793aa0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f745fc01640 1 -- 172.21.15.167:0/800211064 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f745001b030 con 0x557f427916b0 2024-09-18T02:06:09.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f42790550 con 0x557f42699ec0 2024-09-18T02:06:09.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f7460402640 1 -- 172.21.15.167:0/800211064 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74580083f0 con 0x557f42699ec0 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f74620f1980 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x557f427955b0 0x557f427979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f42798130 con 0x557f427955b0 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f745f400640 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x557f427955b0 0x557f427979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.039+0000 7f745f400640 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x557f427955b0 0x557f427979a0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f745f400640 1 -- 172.21.15.167:0/800211064 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f74480abc10 con 0x557f427955b0 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f74620f1980 1 Processor -- start 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f74620f1980 1 -- start start 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f74620f1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427a5bc0 0x557f427a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f74620f1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557f4259a800 con 0x557f427a5bc0 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f745fc01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427a5bc0 0x557f427a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f745fc01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427a5bc0 0x557f427a5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50568/0 (socket says 172.21.15.167:50568) 2024-09-18T02:06:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f745fc01640 1 -- 172.21.15.167:0/2179440721 learned_addr learned my addr 172.21.15.167:0/2179440721 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f745fc01640 1 -- 172.21.15.167:0/2179440721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f427a6520 con 0x557f427a5bc0 2024-09-18T02:06:09.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f745fc01640 1 --2- 172.21.15.167:0/2179440721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427a5bc0 0x557f427a5fe0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f74500484a0 tx=0x7f7450010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f73457fa640 1 -- 172.21.15.167:0/2179440721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450037070 con 0x557f427a5bc0 2024-09-18T02:06:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f73457fa640 1 -- 172.21.15.167:0/2179440721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7450020360 con 0x557f427a5bc0 2024-09-18T02:06:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f74620f1980 1 -- 172.21.15.167:0/2179440721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f427a67b0 con 0x557f427a5bc0 2024-09-18T02:06:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f73457fa640 1 -- 172.21.15.167:0/2179440721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450041ad0 con 0x557f427a5bc0 2024-09-18T02:06:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f74620f1980 1 -- 172.21.15.167:0/2179440721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f427a9430 con 0x557f427a5bc0 2024-09-18T02:06:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f73457fa640 1 -- 172.21.15.167:0/2179440721 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7450029d10 con 0x557f427a5bc0 2024-09-18T02:06:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f73457fa640 1 --2- 172.21.15.167:0/2179440721 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7338034650 0x7f7338036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f73457fa640 1 -- 172.21.15.167:0/2179440721 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f745003b020 con 0x557f427a5bc0 2024-09-18T02:06:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f745f400640 1 --2- 172.21.15.167:0/2179440721 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7338034650 0x7f7338036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f74620f1980 1 Processor -- start 2024-09-18T02:06:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.043+0000 7f74620f1980 1 -- start start 2024-09-18T02:06:09.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f745f400640 1 --2- 172.21.15.167:0/2179440721 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7338034650 0x7f7338036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x557f42798530 tx=0x7f7448005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557f427813b0 con 0x557f427b25e0 2024-09-18T02:06:09.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f745fc01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f745fc01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50578/0 (socket says 172.21.15.167:50578) 2024-09-18T02:06:09.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f745fc01640 1 -- 172.21.15.167:0/3485458970 learned_addr learned my addr 172.21.15.167:0/3485458970 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f745fc01640 1 -- 172.21.15.167:0/3485458970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f427b2fb0 con 0x557f427b25e0 2024-09-18T02:06:09.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f745fc01640 1 --2- 172.21.15.167:0/3485458970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b29e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7450038fd0 tx=0x7f7450011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2932a421d2a143bd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f733effd640 1 -- 172.21.15.167:0/3485458970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450028810 con 0x557f427b25e0 2024-09-18T02:06:09.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f733effd640 1 -- 172.21.15.167:0/3485458970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745004b030 con 0x557f427b25e0 2024-09-18T02:06:09.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f733effd640 1 -- 172.21.15.167:0/3485458970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450051ce0 con 0x557f427b25e0 2024-09-18T02:06:09.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 -- 172.21.15.167:0/3485458970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 msgr2=0x557f427b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 --2- 172.21.15.167:0/3485458970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b29e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7450038fd0 tx=0x7f7450011e80 comp rx=0 tx=0).stop 2024-09-18T02:06:09.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 -- 172.21.15.167:0/3485458970 shutdown_connections 2024-09-18T02:06:09.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 --2- 172.21.15.167:0/3485458970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b29e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 -- 172.21.15.167:0/3485458970 >> 172.21.15.167:0/3485458970 conn(0x557f427ae910 msgr2=0x557f427aca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 -- 172.21.15.167:0/3485458970 shutdown_connections 2024-09-18T02:06:09.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 -- 172.21.15.167:0/3485458970 wait complete. 2024-09-18T02:06:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 Processor -- start 2024-09-18T02:06:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 -- start start 2024-09-18T02:06:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557f427b34a0 con 0x557f427b25e0 2024-09-18T02:06:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f745fc01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f745fc01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50594/0 (socket says 172.21.15.167:50594) 2024-09-18T02:06:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 learned_addr learned my addr 172.21.15.167:0/358968961 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f427b9cb0 con 0x557f427b25e0 2024-09-18T02:06:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f745fc01640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b9770 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7450011ec0 tx=0x7f7450025f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f733d7fa640 1 -- 172.21.15.167:0/358968961 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450051ce0 con 0x557f427b25e0 2024-09-18T02:06:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f427b9cb0 con 0x557f427b25e0 2024-09-18T02:06:09.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f733d7fa640 1 -- 172.21.15.167:0/358968961 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7450048580 con 0x557f427b25e0 2024-09-18T02:06:09.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.047+0000 7f733d7fa640 1 -- 172.21.15.167:0/358968961 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450051e80 con 0x557f427b25e0 2024-09-18T02:06:09.055 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f427b9cb0 con 0x557f427b25e0 2024-09-18T02:06:09.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f733d7fa640 1 -- 172.21.15.167:0/358968961 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7450064070 con 0x557f427b25e0 2024-09-18T02:06:09.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f733d7fa640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7328034650 0x7f7328036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f733d7fa640 1 -- 172.21.15.167:0/358968961 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7450062020 con 0x557f427b25e0 2024-09-18T02:06:09.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f745f400640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7328034650 0x7f7328036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x557f427c4810 0x557f427c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427c73f0 con 0x557f427c4810 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f7460402640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x557f427c4810 0x557f427c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f745f400640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7328034650 0x7f7328036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f74480ab510 tx=0x7f74480a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f7460402640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x557f427c4810 0x557f427c6ca0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74580083f0 con 0x557f427c4810 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 20 realm 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427c7800 con 0x557f427c4810 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74580083f0 con 0x557f427c4810 2024-09-18T02:06:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427c80a0 con 0x557f427c4810 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74580083f0 con 0x557f427c4810 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c4810 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74580083f0 con 0x557f427c4810 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x557f427c91a0 0x557f427cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427cbc30 con 0x557f427c91a0 2024-09-18T02:06:09.061 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.051+0000 7f745fc01640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x557f427c91a0 0x557f427cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f745fc01640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x557f427c91a0 0x557f427cb590 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f74620f1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f74620f1980 20 searching for the correct realm 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f74620f1980 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x557f427cdb10 0x557f427cff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427d0600 con 0x557f427cdb10 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f745f400640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x557f427cdb10 0x557f427cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f745f400640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x557f427cdb10 0x557f427cff80 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f745f400640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f74480de040 0x7f74480df430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427d0600 con 0x7f74480de040 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f74480de040 0x7f74480df430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f74480de040 0x7f74480df430 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74580083f0 con 0x7f74480de040 2024-09-18T02:06:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x7f74480de040 2024-09-18T02:06:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74580083f0 con 0x7f74480de040 2024-09-18T02:06:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c4810 2024-09-18T02:06:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c4810 2024-09-18T02:06:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c4810 2024-09-18T02:06:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.055+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c91a0 2024-09-18T02:06:09.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x7f74480de040 2024-09-18T02:06:09.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.068 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427cdb10 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c4810 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x7f74480de040 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c4810 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x7f74480de040 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427cdb10 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427cdb10 2024-09-18T02:06:09.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c91a0 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427cdb10 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427cdb10 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c4810 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.059+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c4810 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c91a0 2024-09-18T02:06:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427cdb10 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x7f74480de040 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c4810 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c91a0 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427cdb10 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c91a0 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x7f74480de040 2024-09-18T02:06:09.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427cdb10 2024-09-18T02:06:09.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.063+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c91a0 2024-09-18T02:06:09.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x557f427c4810 2024-09-18T02:06:09.075 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f427c8440 con 0x7f74480de040 2024-09-18T02:06:09.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:09.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:09.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:09.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:09.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:09.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:09.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427cc480 con 0x557f427c4810 2024-09-18T02:06:09.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427cc480 con 0x557f427c4810 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427cc480 con 0x557f427cdb10 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 zone default found 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 4 Realm: () 2024-09-18T02:06:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 zonegroup default 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427ccec0 con 0x557f427c91a0 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427d2910 con 0x557f427cdb10 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427d2cb0 con 0x557f427cdb10 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 started sync module instance, tier type = 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.067+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d1d50 con 0x7f74480de040 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.071+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.071+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94005064704320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d2560 con 0x7f74480de040 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.071+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d3500 con 0x557f427c4810 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.071+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94005064704320] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.071+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.071+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94005064708176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d3470 con 0x557f427c4810 2024-09-18T02:06:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.071+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d42b0 con 0x557f427cdb10 2024-09-18T02:06:09.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.075+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.075+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94005064711584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d4b50 con 0x557f427cdb10 2024-09-18T02:06:09.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.075+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d5550 con 0x7f74480de040 2024-09-18T02:06:09.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.075+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94005064708176] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.075+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.075+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94005064716384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d5970 con 0x7f74480de040 2024-09-18T02:06:09.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.075+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d6330 con 0x557f427c4810 2024-09-18T02:06:09.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.075+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94005064711584] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.075+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94005064716384] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.079+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.079+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94005064710304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d5e80 con 0x557f427c4810 2024-09-18T02:06:09.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.079+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d66d0 con 0x557f427c91a0 2024-09-18T02:06:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.079+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.079+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94005064720304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d6f20 con 0x557f427c91a0 2024-09-18T02:06:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.079+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d78e0 con 0x557f427c91a0 2024-09-18T02:06:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.079+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94005064710304] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94005064725552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d7d00 con 0x557f427c91a0 2024-09-18T02:06:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d86c0 con 0x557f427c91a0 2024-09-18T02:06:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94005064720304] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94005064725552] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94005064726608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d7c70 con 0x557f427c91a0 2024-09-18T02:06:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f74620f1980 20 add_watcher() i=0 2024-09-18T02:06:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f74620f1980 20 add_watcher() i=1 2024-09-18T02:06:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f74620f1980 20 add_watcher() i=2 2024-09-18T02:06:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f74620f1980 20 add_watcher() i=3 2024-09-18T02:06:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f74620f1980 20 add_watcher() i=4 2024-09-18T02:06:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f74620f1980 20 add_watcher() i=5 2024-09-18T02:06:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.083+0000 7f74620f1980 20 add_watcher() i=6 2024-09-18T02:06:09.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.087+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94005064726608] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.087+0000 7f74620f1980 20 add_watcher() i=7 2024-09-18T02:06:09.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.087+0000 7f74620f1980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:09.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.087+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427db6f0 con 0x557f427c4810 2024-09-18T02:06:09.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.087+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.087+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94005064729104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d8ae0 con 0x557f427c4810 2024-09-18T02:06:09.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.087+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94005064729104] v32'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.087+0000 7f7315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:09.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.087+0000 7f74620f1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:09.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.087+0000 7f74620f1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:09.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.087+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e3f40 con 0x557f427c4810 2024-09-18T02:06:09.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.091+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'60 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.091+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e4610 con 0x557f427c91a0 2024-09-18T02:06:09.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.091+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.091+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e4610 con 0x557f427cdb10 2024-09-18T02:06:09.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.091+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.096 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.091+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e50b0 con 0x557f427c4810 2024-09-18T02:06:09.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.095+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'259 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.095+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e1d10 con 0x7f74480de040 2024-09-18T02:06:09.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.095+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'86 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.095+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e1d10 con 0x557f427cdb10 2024-09-18T02:06:09.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.095+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'65 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.095+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e5de0 con 0x557f427c4810 2024-09-18T02:06:09.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.099+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.099+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e5de0 con 0x557f427c91a0 2024-09-18T02:06:09.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.099+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.099+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e5de0 con 0x7f74480de040 2024-09-18T02:06:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.103+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.103+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e5e70 con 0x557f427cdb10 2024-09-18T02:06:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.103+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.103+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x7f74480de040 2024-09-18T02:06:09.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.103+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'87 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.103+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427c91a0 2024-09-18T02:06:09.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.107+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'38 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.107+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x7f74480de040 2024-09-18T02:06:09.111 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.107+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.107+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6290 con 0x557f427c91a0 2024-09-18T02:06:09.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.111+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'73 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.111+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6290 con 0x557f427c4810 2024-09-18T02:06:09.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.111+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'260 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.115 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.111+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6290 con 0x557f427cdb10 2024-09-18T02:06:09.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.115+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'83 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.115+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6290 con 0x7f74480de040 2024-09-18T02:06:09.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.115+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'88 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.118 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.115+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427cdb10 2024-09-18T02:06:09.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.115+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.115+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427c4810 2024-09-18T02:06:09.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.119+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.119+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427c4810 2024-09-18T02:06:09.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.119+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'261 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.119+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427cdb10 2024-09-18T02:06:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.123+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'84 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.123+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x7f74480de040 2024-09-18T02:06:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.123+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.123+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427cdb10 2024-09-18T02:06:09.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.123+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'39 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.123+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427cdb10 2024-09-18T02:06:09.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.127+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'48 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.127+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427cdb10 2024-09-18T02:06:09.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.127+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.127+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427cdb10 2024-09-18T02:06:09.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.127+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'66 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.127+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427c91a0 2024-09-18T02:06:09.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.131+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.131+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427cdb10 2024-09-18T02:06:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.131+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'45 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.131+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427c91a0 2024-09-18T02:06:09.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.135+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'61 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.135+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427cdb10 2024-09-18T02:06:09.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.135+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'85 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.139 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.135+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x557f427c91a0 2024-09-18T02:06:09.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.139+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'74 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.139+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427e6320 con 0x7f74480de040 2024-09-18T02:06:09.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.139+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.139+0000 7f7314fe1640 20 reqs_thread_entry: start 2024-09-18T02:06:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.139+0000 7f74620f1980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.139+0000 7f74620f1980 20 Filter name: none 2024-09-18T02:06:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.139+0000 7f728e7fc640 20 reqs_thread_entry: start 2024-09-18T02:06:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.139+0000 7f74620f1980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-18T02:06:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.139+0000 7f74620f1980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.139+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f427e12f0 con 0x557f427cdb10 2024-09-18T02:06:09.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f74620f1980 20 rados_obj.operate() r=0 bl.length=363 2024-09-18T02:06:09.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f74620f1980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-18T02:06:09.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f74620f1980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T02:06:09.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f74620f1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:09.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f42804130 con 0x557f427cdb10 2024-09-18T02:06:09.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f74480cb030 con 0x557f427cdb10 2024-09-18T02:06:09.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f74620f1980 10 removing key index: true_admin_akey 2024-09-18T02:06:09.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f42802110 con 0x557f427cdb10 2024-09-18T02:06:09.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(96 true_admin_akey [delete] v32'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f74480f5040 con 0x557f427cdb10 2024-09-18T02:06:09.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f74620f1980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-18T02:06:09.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94005064903792 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f42804650 con 0x557f427c91a0 2024-09-18T02:06:09.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== watch-notify(notify (1) cookie 94005064720304 notify 137438953521 ret 0) ==== 207+0+0 (crc 0 0 0) 0x557f427e1b10 con 0x557f427c91a0 2024-09-18T02:06:09.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f733effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953521 cookie 94005064720304 notifier 4872 bl.length()=165 2024-09-18T02:06:09.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(97 notify.5 [notify cookie 94005064903792 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f733effd640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7324003d70 con 0x557f427c91a0 2024-09-18T02:06:09.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.143+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== watch-notify(notify_complete (2) cookie 94005064903792 notify 137438953521 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557f427a6520 con 0x557f427c91a0 2024-09-18T02:06:09.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f74620f1980 10 removing email index: 2024-09-18T02:06:09.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f74620f1980 10 removing user buckets index 2024-09-18T02:06:09.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f428045d0 con 0x557f427cdb10 2024-09-18T02:06:09.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== osd_op_reply(99 a_user.buckets [delete] v32'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f74480f5040 con 0x557f427cdb10 2024-09-18T02:06:09.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f74620f1980 10 removing user index: a_user 2024-09-18T02:06:09.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f42804130 con 0x557f427cdb10 2024-09-18T02:06:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 31 ==== osd_op_reply(100 a_user [call,call,delete] v32'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f74480f5040 con 0x557f427cdb10 2024-09-18T02:06:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f74620f1980 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-18T02:06:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f74620f1980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-18T02:06:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94005064899680 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f42803540 con 0x557f427cdb10 2024-09-18T02:06:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 32 ==== watch-notify(notify (1) cookie 94005064711584 notify 137438953492 ret 0) ==== 197+0+0 (crc 0 0 0) 0x557f427e1860 con 0x557f427cdb10 2024-09-18T02:06:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f733e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94005064711584 notifier 4872 bl.length()=155 2024-09-18T02:06:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f733e7fc640 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f72940032d0 con 0x557f427cdb10 2024-09-18T02:06:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 33 ==== osd_op_reply(101 notify.2 [notify cookie 94005064899680 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f74480f5040 con 0x557f427cdb10 2024-09-18T02:06:09.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74480f5040 con 0x557f427cdb10 2024-09-18T02:06:09.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 35 ==== watch-notify(notify_complete (2) cookie 94005064899680 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557f427e5c10 con 0x557f427cdb10 2024-09-18T02:06:09.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f7315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:09.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.147+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94005064729104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427dfc30 con 0x557f427c4810 2024-09-18T02:06:09.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.151+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94005064729104] v32'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.151+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94005064704320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427dfc30 con 0x7f74480de040 2024-09-18T02:06:09.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.151+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94005064704320] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.151+0000 7f74620f1980 20 remove_watcher() i=0 2024-09-18T02:06:09.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.151+0000 7f74620f1980 2 removed watcher, disabling cache 2024-09-18T02:06:09.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.151+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94005064708176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d2140 con 0x557f427c4810 2024-09-18T02:06:09.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.155+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94005064708176] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.155+0000 7f74620f1980 20 remove_watcher() i=1 2024-09-18T02:06:09.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.155+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94005064711584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d2140 con 0x557f427cdb10 2024-09-18T02:06:09.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.155+0000 7f745f400640 1 -- 172.21.15.167:0/358968961 <== osd.3 v2:172.21.15.167:6808/2476454287 36 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94005064711584] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74480f5040 con 0x557f427cdb10 2024-09-18T02:06:09.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.155+0000 7f74620f1980 20 remove_watcher() i=2 2024-09-18T02:06:09.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.155+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94005064716384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d3da0 con 0x7f74480de040 2024-09-18T02:06:09.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.159+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94005064716384] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x7f74480de040 2024-09-18T02:06:09.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.159+0000 7f74620f1980 20 remove_watcher() i=3 2024-09-18T02:06:09.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.159+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94005064710304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d2140 con 0x557f427c4810 2024-09-18T02:06:09.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.159+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94005064710304] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7458026040 con 0x557f427c4810 2024-09-18T02:06:09.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.159+0000 7f74620f1980 20 remove_watcher() i=4 2024-09-18T02:06:09.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.159+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94005064720304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d5060 con 0x557f427c91a0 2024-09-18T02:06:09.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.163+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94005064720304] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.163+0000 7f74620f1980 20 remove_watcher() i=5 2024-09-18T02:06:09.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.163+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94005064725552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d3da0 con 0x557f427c91a0 2024-09-18T02:06:09.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.163+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94005064725552] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.163+0000 7f74620f1980 20 remove_watcher() i=6 2024-09-18T02:06:09.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.163+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94005064726608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f427d38a0 con 0x557f427c91a0 2024-09-18T02:06:09.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f745fc01640 1 -- 172.21.15.167:0/358968961 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94005064726608] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f745007b070 con 0x557f427c91a0 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 20 remove_watcher() i=7 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x557f427c91a0 msgr2=0x557f427cb590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x557f427c91a0 0x557f427cb590 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x557f427c4810 msgr2=0x557f427c6ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x557f427c4810 0x557f427c6ca0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f74480de040 msgr2=0x7f74480df430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f74480de040 0x7f74480df430 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x557f427cdb10 msgr2=0x557f427cff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x557f427cdb10 0x557f427cff80 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7328034650 msgr2=0x7f7328036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7328034650 0x7f7328036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f74480ab510 tx=0x7f74480a6000 comp rx=0 tx=0).stop 2024-09-18T02:06:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f7460402640 1 -- 172.21.15.167:0/358968961 reap_dead start 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 msgr2=0x557f427b9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b9770 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7450011ec0 tx=0x7f7450025f40 comp rx=0 tx=0).stop 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 shutdown_connections 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/358968961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427b25e0 0x557f427b9770 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 >> 172.21.15.167:0/358968961 conn(0x557f427ae910 msgr2=0x557f427ac9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 shutdown_connections 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/358968961 wait complete. 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/2179440721 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7338034650 msgr2=0x7f7338036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/2179440721 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7338034650 0x7f7338036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x557f42798530 tx=0x7f7448005a10 comp rx=0 tx=0).stop 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/2179440721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427a5bc0 msgr2=0x557f427a5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/2179440721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427a5bc0 0x557f427a5fe0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f74500484a0 tx=0x7f7450010d50 comp rx=0 tx=0).stop 2024-09-18T02:06:09.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/2179440721 shutdown_connections 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/2179440721 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7338034650 0x7f7338036b10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/2179440721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f427a5bc0 0x557f427a5fe0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/2179440721 >> 172.21.15.167:0/2179440721 conn(0x557f4279ad10 msgr2=0x557f4279d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/2179440721 shutdown_connections 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/2179440721 wait complete. 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x557f427916b0 msgr2=0x557f42793aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x557f427916b0 0x557f42793aa0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x557f42699ec0 msgr2=0x557f4278ed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x557f42699ec0 0x557f4278ed40 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x557f427955b0 msgr2=0x557f427979a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x557f427955b0 0x557f427979a0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7348034650 msgr2=0x7f7348036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7348034650 0x7f7348036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f74480ad000 tx=0x7f74480a5040 comp rx=0 tx=0).stop 2024-09-18T02:06:09.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 msgr2=0x557f42787db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 --2- 172.21.15.167:0/800211064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f42608290 0x557f42787db0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7450002260 tx=0x7f7450000f50 comp rx=0 tx=0).stop 2024-09-18T02:06:09.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f7460402640 1 -- 172.21.15.167:0/800211064 reap_dead start 2024-09-18T02:06:09.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 shutdown_connections 2024-09-18T02:06:09.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 >> 172.21.15.167:0/800211064 conn(0x557f4268e090 msgr2=0x557f4277b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 shutdown_connections 2024-09-18T02:06:09.175 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.167+0000 7f74620f1980 1 -- 172.21.15.167:0/800211064 wait complete. 2024-09-18T02:06:09.181 ERROR:root:None 2024-09-18T02:06:09.181 ERROR:root:0 2024-09-18T02:06:09.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-18T02:06:09.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-18T02:06:09.181 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-18T02:06:09.259 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:09.259 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:09.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.255+0000 7fc86a3f8980 1 Processor -- start 2024-09-18T02:06:09.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.255+0000 7fc86a3f8980 1 -- start start 2024-09-18T02:06:09.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.255+0000 7fc86a3f8980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562ed734b8f0 0x562ed734bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.255+0000 7fc86a3f8980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562ed71d1ae0 con 0x562ed734c240 2024-09-18T02:06:09.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.255+0000 7fc86a3f8980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x562ed71f5e30 con 0x562ed734b8f0 2024-09-18T02:06:09.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.259+0000 7fc867f08640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x562ed734b8f0 0x562ed734bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.259+0000 7fc867707640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x562ed734c240 0x562ed7350c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33898/0 (socket says 172.21.15.167:33898) 2024-09-18T02:06:09.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.259+0000 7fc867707640 1 -- 172.21.15.167:0/2469240391 learned_addr learned my addr 172.21.15.167:0/2469240391 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:09.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.259+0000 7fc867f08640 1 -- 172.21.15.167:0/2469240391 >> v1:172.21.15.81:6789/0 conn(0x562ed734c240 legacy=0x562ed7350c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.259+0000 7fc867f08640 1 -- 172.21.15.167:0/2469240391 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ed73534c0 con 0x562ed734b8f0 2024-09-18T02:06:09.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.259+0000 7fc867f08640 1 --2- 172.21.15.167:0/2469240391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734b8f0 0x562ed734bcd0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc85800a480 tx=0x7fc85801b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ccb0fb89bc8859 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.259+0000 7fc866f06640 1 -- 172.21.15.167:0/2469240391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580af070 con 0x562ed734b8f0 2024-09-18T02:06:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.259+0000 7fc866f06640 1 -- 172.21.15.167:0/2469240391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8580a3e50 con 0x562ed734b8f0 2024-09-18T02:06:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.259+0000 7fc866f06640 1 -- 172.21.15.167:0/2469240391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580aa680 con 0x562ed734b8f0 2024-09-18T02:06:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.263+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2469240391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734b8f0 msgr2=0x562ed734bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.263+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/2469240391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734b8f0 0x562ed734bcd0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc85800a480 tx=0x7fc85801b110 comp rx=0 tx=0).stop 2024-09-18T02:06:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.263+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2469240391 shutdown_connections 2024-09-18T02:06:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.263+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/2469240391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734b8f0 0x562ed734bcd0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.263+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2469240391 >> 172.21.15.167:0/2469240391 conn(0x562ed72bf240 msgr2=0x562ed72bf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.263+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2469240391 shutdown_connections 2024-09-18T02:06:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.263+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2469240391 wait complete. 2024-09-18T02:06:09.278 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.275+0000 7fc86a3f8980 1 Processor -- start 2024-09-18T02:06:09.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.275+0000 7fc86a3f8980 1 -- start start 2024-09-18T02:06:09.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.275+0000 7fc86a3f8980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734b8f0 0x562ed7436c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.275+0000 7fc86a3f8980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562ed71f7200 con 0x562ed734b8f0 2024-09-18T02:06:09.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.275+0000 7fc867f08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734b8f0 0x562ed7436c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.275+0000 7fc867f08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734b8f0 0x562ed7436c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50616/0 (socket says 172.21.15.167:50616) 2024-09-18T02:06:09.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.275+0000 7fc867f08640 1 -- 172.21.15.167:0/1911784203 learned_addr learned my addr 172.21.15.167:0/1911784203 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.280 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.275+0000 7fc867f08640 1 -- 172.21.15.167:0/1911784203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ed7437210 con 0x562ed734b8f0 2024-09-18T02:06:09.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.275+0000 7fc867f08640 1 --2- 172.21.15.167:0/1911784203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734b8f0 0x562ed7436c40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc8580ad040 tx=0x7fc858003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7b404c43898285 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc754e19640 1 -- 172.21.15.167:0/1911784203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580af040 con 0x562ed734b8f0 2024-09-18T02:06:09.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc754e19640 1 -- 172.21.15.167:0/1911784203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8580aa870 con 0x562ed734b8f0 2024-09-18T02:06:09.281 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc754e19640 1 -- 172.21.15.167:0/1911784203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580aab50 con 0x562ed734b8f0 2024-09-18T02:06:09.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1911784203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734b8f0 msgr2=0x562ed7436c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1911784203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734b8f0 0x562ed7436c40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc8580ad040 tx=0x7fc858003030 comp rx=0 tx=0).stop 2024-09-18T02:06:09.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1911784203 shutdown_connections 2024-09-18T02:06:09.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1911784203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734b8f0 0x562ed7436c40 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1911784203 >> 172.21.15.167:0/1911784203 conn(0x562ed72bf240 msgr2=0x562ed7432870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.283 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1911784203 shutdown_connections 2024-09-18T02:06:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1911784203 wait complete. 2024-09-18T02:06:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 Processor -- start 2024-09-18T02:06:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 -- start start 2024-09-18T02:06:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734c240 0x562ed743e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562ed7352f00 con 0x562ed734c240 2024-09-18T02:06:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc867f08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734c240 0x562ed743e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc867f08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734c240 0x562ed743e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50618/0 (socket says 172.21.15.167:50618) 2024-09-18T02:06:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc867f08640 1 -- 172.21.15.167:0/352142576 learned_addr learned my addr 172.21.15.167:0/352142576 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc867f08640 1 -- 172.21.15.167:0/352142576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ed743e5e0 con 0x562ed734c240 2024-09-18T02:06:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc867f08640 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734c240 0x562ed743e0a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc85800a480 tx=0x7fc858017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc753616640 1 -- 172.21.15.167:0/352142576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580c2070 con 0x562ed734c240 2024-09-18T02:06:09.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc753616640 1 -- 172.21.15.167:0/352142576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8580b5a60 con 0x562ed734c240 2024-09-18T02:06:09.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ed743e870 con 0x562ed734c240 2024-09-18T02:06:09.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc753616640 1 -- 172.21.15.167:0/352142576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580af070 con 0x562ed734c240 2024-09-18T02:06:09.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.279+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ed7441550 con 0x562ed734c240 2024-09-18T02:06:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc753616640 1 -- 172.21.15.167:0/352142576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc8580c5070 con 0x562ed734c240 2024-09-18T02:06:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc753616640 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc74c0346a0 0x7fc74c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc753616640 1 -- 172.21.15.167:0/352142576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc8580ba070 con 0x562ed734c240 2024-09-18T02:06:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc867707640 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc74c0346a0 0x7fc74c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562ed7443020 0x562ed7445410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed7445a60 con 0x562ed7443020 2024-09-18T02:06:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc868709640 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562ed7443020 0x562ed7445410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc867707640 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc74c0346a0 0x7fc74c036b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc850006fd0 tx=0x7fc850006680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc868709640 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562ed7443020 0x562ed7445410 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc868709640 1 -- 172.21.15.167:0/352142576 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8600083f0 con 0x562ed7443020 2024-09-18T02:06:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed7442730 con 0x562ed7443020 2024-09-18T02:06:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc868709640 1 -- 172.21.15.167:0/352142576 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8600083f0 con 0x562ed7443020 2024-09-18T02:06:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562ed7447d90 0x562ed744a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed744a820 con 0x562ed7447d90 2024-09-18T02:06:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc867f08640 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562ed7447d90 0x562ed744a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc867f08640 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562ed7447d90 0x562ed744a180 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.283+0000 7fc867f08640 1 -- 172.21.15.167:0/352142576 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8580ce070 con 0x562ed7447d90 2024-09-18T02:06:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed7446c00 con 0x562ed7443020 2024-09-18T02:06:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc868709640 1 -- 172.21.15.167:0/352142576 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8600083f0 con 0x562ed7443020 2024-09-18T02:06:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562ed744bc60 0x562ed744e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed744e7c0 con 0x562ed744bc60 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc867707640 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562ed744bc60 0x562ed744e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc867707640 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562ed744bc60 0x562ed744e050 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc867707640 1 -- 172.21.15.167:0/352142576 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc85000f070 con 0x562ed744bc60 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc86a3f8980 1 Processor -- start 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc86a3f8980 1 -- start start 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc86a3f8980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed745c280 0x562ed745c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc86a3f8980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562ed7250800 con 0x562ed745c280 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc867f08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed745c280 0x562ed745c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc867f08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed745c280 0x562ed745c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50620/0 (socket says 172.21.15.167:50620) 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc867f08640 1 -- 172.21.15.167:0/2331863011 learned_addr learned my addr 172.21.15.167:0/2331863011 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc867f08640 1 -- 172.21.15.167:0/2331863011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ed745cbe0 con 0x562ed745c280 2024-09-18T02:06:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc867f08640 1 --2- 172.21.15.167:0/2331863011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed745c280 0x562ed745c6a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc8580e2aa0 tx=0x7fc8580e43a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc750e11640 1 -- 172.21.15.167:0/2331863011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580e1070 con 0x562ed745c280 2024-09-18T02:06:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2331863011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ed745ce70 con 0x562ed745c280 2024-09-18T02:06:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc750e11640 1 -- 172.21.15.167:0/2331863011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc858008170 con 0x562ed745c280 2024-09-18T02:06:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc750e11640 1 -- 172.21.15.167:0/2331863011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580e1380 con 0x562ed745c280 2024-09-18T02:06:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.287+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2331863011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ed745ce70 con 0x562ed745c280 2024-09-18T02:06:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc750e11640 1 -- 172.21.15.167:0/2331863011 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc8580e1520 con 0x562ed745c280 2024-09-18T02:06:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc750e11640 1 --2- 172.21.15.167:0/2331863011 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc740034650 0x7fc740036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc750e11640 1 -- 172.21.15.167:0/2331863011 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc8580ac0c0 con 0x562ed745c280 2024-09-18T02:06:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc867707640 1 --2- 172.21.15.167:0/2331863011 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc740034650 0x7fc740036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 Processor -- start 2024-09-18T02:06:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 -- start start 2024-09-18T02:06:09.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc867707640 1 --2- 172.21.15.167:0/2331863011 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc740034650 0x7fc740036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x562ed7445f40 tx=0x7fc85000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed7468ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562ed74374d0 con 0x562ed7468af0 2024-09-18T02:06:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc867f08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed7468ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc867f08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed7468ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50632/0 (socket says 172.21.15.167:50632) 2024-09-18T02:06:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc867f08640 1 -- 172.21.15.167:0/1019022546 learned_addr learned my addr 172.21.15.167:0/1019022546 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc867f08640 1 -- 172.21.15.167:0/1019022546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ed74694c0 con 0x562ed7468af0 2024-09-18T02:06:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc867f08640 1 --2- 172.21.15.167:0/1019022546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed7468ef0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc858008380 tx=0x7fc8580bd420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46b38d6c517dd87 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc74a7fc640 1 -- 172.21.15.167:0/1019022546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580b4500 con 0x562ed7468af0 2024-09-18T02:06:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc74a7fc640 1 -- 172.21.15.167:0/1019022546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8580dcb10 con 0x562ed7468af0 2024-09-18T02:06:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc74a7fc640 1 -- 172.21.15.167:0/1019022546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580dcdf0 con 0x562ed7468af0 2024-09-18T02:06:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1019022546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 msgr2=0x562ed7468ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1019022546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed7468ef0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc858008380 tx=0x7fc8580bd420 comp rx=0 tx=0).stop 2024-09-18T02:06:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1019022546 shutdown_connections 2024-09-18T02:06:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1019022546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed7468ef0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1019022546 >> 172.21.15.167:0/1019022546 conn(0x562ed7464e20 msgr2=0x562ed7462f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1019022546 shutdown_connections 2024-09-18T02:06:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1019022546 wait complete. 2024-09-18T02:06:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 Processor -- start 2024-09-18T02:06:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 -- start start 2024-09-18T02:06:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed746fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.291+0000 7fc86a3f8980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562ed74699b0 con 0x562ed7468af0 2024-09-18T02:06:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc867f08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed746fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc867f08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed746fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50640/0 (socket says 172.21.15.167:50640) 2024-09-18T02:06:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 learned_addr learned my addr 172.21.15.167:0/1847379768 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ed7470100 con 0x562ed7468af0 2024-09-18T02:06:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc867f08640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed746fbc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fc858008380 tx=0x7fc8580aef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc748ff9640 1 -- 172.21.15.167:0/1847379768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580fd040 con 0x562ed7468af0 2024-09-18T02:06:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ed7470100 con 0x562ed7468af0 2024-09-18T02:06:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc748ff9640 1 -- 172.21.15.167:0/1847379768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8580bf070 con 0x562ed7468af0 2024-09-18T02:06:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc748ff9640 1 -- 172.21.15.167:0/1847379768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8580bf350 con 0x562ed7468af0 2024-09-18T02:06:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ed7470100 con 0x562ed7468af0 2024-09-18T02:06:09.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc748ff9640 1 -- 172.21.15.167:0/1847379768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc85810a020 con 0x562ed7468af0 2024-09-18T02:06:09.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc748ff9640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc730034650 0x7fc730036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc748ff9640 1 -- 172.21.15.167:0/1847379768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc858108020 con 0x562ed7468af0 2024-09-18T02:06:09.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc867707640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc730034650 0x7fc730036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562ed747abb0 0x562ed747d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed747d7c0 con 0x562ed747abb0 2024-09-18T02:06:09.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc868709640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562ed747abb0 0x562ed747d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc867707640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc730034650 0x7fc730036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc850004fd0 tx=0x7fc850010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc868709640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562ed747abb0 0x562ed747d070 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8600083f0 con 0x562ed747abb0 2024-09-18T02:06:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 20 realm 2024-09-18T02:06:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed747dbd0 con 0x562ed747abb0 2024-09-18T02:06:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8600083f0 con 0x562ed747abb0 2024-09-18T02:06:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e470 con 0x562ed747abb0 2024-09-18T02:06:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8600083f0 con 0x562ed747abb0 2024-09-18T02:06:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.295+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747abb0 2024-09-18T02:06:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8600083f0 con 0x562ed747abb0 2024-09-18T02:06:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc86a3f8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562ed747f570 0x562ed7481960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed7482000 con 0x562ed747f570 2024-09-18T02:06:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc867f08640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562ed747f570 0x562ed7481960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc867f08640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562ed747f570 0x562ed7481960 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc86a3f8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc86a3f8980 20 searching for the correct realm 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562ed7483ee0 0x562ed7486330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed74869b0 con 0x562ed7483ee0 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc867707640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562ed7483ee0 0x562ed7486330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc867707640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562ed7483ee0 0x562ed7486330 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc85000f070 con 0x562ed7483ee0 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc867707640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc850024070 0x7fc850031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed74869b0 con 0x7fc850024070 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc868709640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc850024070 0x7fc850031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc868709640 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc850024070 0x7fc850031970 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8600083f0 con 0x7fc850024070 2024-09-18T02:06:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x7fc850024070 2024-09-18T02:06:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8600083f0 con 0x7fc850024070 2024-09-18T02:06:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747abb0 2024-09-18T02:06:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747abb0 2024-09-18T02:06:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.299+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747abb0 2024-09-18T02:06:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747f570 2024-09-18T02:06:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x7fc850024070 2024-09-18T02:06:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed7483ee0 2024-09-18T02:06:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc85000f070 con 0x562ed7483ee0 2024-09-18T02:06:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747abb0 2024-09-18T02:06:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x7fc850024070 2024-09-18T02:06:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747abb0 2024-09-18T02:06:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x7fc850024070 2024-09-18T02:06:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed7483ee0 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed7483ee0 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747f570 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed7483ee0 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.303+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed7483ee0 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747abb0 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747abb0 2024-09-18T02:06:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747f570 2024-09-18T02:06:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed7483ee0 2024-09-18T02:06:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x7fc850024070 2024-09-18T02:06:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747abb0 2024-09-18T02:06:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747f570 2024-09-18T02:06:09.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed7483ee0 2024-09-18T02:06:09.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747f570 2024-09-18T02:06:09.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x7fc850024070 2024-09-18T02:06:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.307+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed7483ee0 2024-09-18T02:06:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747f570 2024-09-18T02:06:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x562ed747abb0 2024-09-18T02:06:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ed747e810 con 0x7fc850024070 2024-09-18T02:06:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed7482850 con 0x562ed747abb0 2024-09-18T02:06:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed7482850 con 0x562ed747abb0 2024-09-18T02:06:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed7482850 con 0x562ed7483ee0 2024-09-18T02:06:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 zone default found 2024-09-18T02:06:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 4 Realm: () 2024-09-18T02:06:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 zonegroup default 2024-09-18T02:06:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed7483250 con 0x562ed747f570 2024-09-18T02:06:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed7482de0 con 0x562ed7483ee0 2024-09-18T02:06:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed7488d90 con 0x562ed7483ee0 2024-09-18T02:06:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 started sync module instance, tier type = 2024-09-18T02:06:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.311+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed7488150 con 0x7fc850024070 2024-09-18T02:06:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.315+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.315+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94759180338800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed7488150 con 0x7fc850024070 2024-09-18T02:06:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.315+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed74898b0 con 0x562ed747abb0 2024-09-18T02:06:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.315+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94759180338800] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.315+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.315+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94759180342208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed7488150 con 0x562ed747abb0 2024-09-18T02:06:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.315+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748a2f0 con 0x562ed7483ee0 2024-09-18T02:06:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.319+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94759180342208] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.319+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.319+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94759180336288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed74880c0 con 0x562ed7483ee0 2024-09-18T02:06:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.319+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748b050 con 0x7fc850024070 2024-09-18T02:06:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.319+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.319+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94759180348224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748b8f0 con 0x7fc850024070 2024-09-18T02:06:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.319+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748c2f0 con 0x562ed747abb0 2024-09-18T02:06:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.319+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94759180348224] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.319+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94759180336288] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.323+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.323+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94759180347024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748b3f0 con 0x562ed747abb0 2024-09-18T02:06:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.323+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748cb90 con 0x562ed747f570 2024-09-18T02:06:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.323+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94759180347024] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.323+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.323+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94759180355296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748b3f0 con 0x562ed747f570 2024-09-18T02:06:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.323+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748d3e0 con 0x562ed747f570 2024-09-18T02:06:09.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94759180357904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748dba0 con 0x562ed747f570 2024-09-18T02:06:09.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748e6a0 con 0x562ed747f570 2024-09-18T02:06:09.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94759180355296] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94759180357904] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94759180362128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748d5f0 con 0x562ed747f570 2024-09-18T02:06:09.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc86a3f8980 20 add_watcher() i=0 2024-09-18T02:06:09.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc86a3f8980 20 add_watcher() i=1 2024-09-18T02:06:09.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc86a3f8980 20 add_watcher() i=2 2024-09-18T02:06:09.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc86a3f8980 20 add_watcher() i=3 2024-09-18T02:06:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc86a3f8980 20 add_watcher() i=4 2024-09-18T02:06:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc86a3f8980 20 add_watcher() i=5 2024-09-18T02:06:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.327+0000 7fc86a3f8980 20 add_watcher() i=6 2024-09-18T02:06:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94759180362128] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 20 add_watcher() i=7 2024-09-18T02:06:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed7491690 con 0x562ed747abb0 2024-09-18T02:06:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94759180353024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748eb40 con 0x562ed747abb0 2024-09-18T02:06:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94759180353024] v32'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc71d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 5 note: GC not initialized 2024-09-18T02:06:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc697fff640 20 reqs_thread_entry: start 2024-09-18T02:06:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 20 Filter name: none 2024-09-18T02:06:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc695ffb640 20 reqs_thread_entry: start 2024-09-18T02:06:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T02:06:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.331+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed74b4c90 con 0x562ed747f570 2024-09-18T02:06:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc86a3f8980 20 rados_obj.operate() r=0 bl.length=460 2024-09-18T02:06:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc86a3f8980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T02:06:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc86a3f8980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc86a3f8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed74bb2a0 con 0x562ed747f570 2024-09-18T02:06:09.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc86a3f8980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:09.343 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc86a3f8980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc86a3f8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T02:06:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94759180545296 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ed74b69b0 con 0x562ed747abb0 2024-09-18T02:06:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== watch-notify(notify (1) cookie 94759180347024 notify 137438953496 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fc860010040 con 0x562ed747abb0 2024-09-18T02:06:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc74a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94759180347024 notifier 4879 bl.length()=666 2024-09-18T02:06:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc74a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc74a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 notify.4 [notify cookie 94759180545296 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.335+0000 7fc74a7fc640 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc72c003eb0 con 0x562ed747abb0 2024-09-18T02:06:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.339+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.339+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== watch-notify(notify_complete (2) cookie 94759180545296 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc86000a6c0 con 0x562ed747abb0 2024-09-18T02:06:09.345 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T02:06:08.069645Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.069630Z","tags":[],"group_ids":[]} 2024-09-18T02:06:09.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.339+0000 7fc71d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:09.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.339+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94759180353024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed74b2a90 con 0x562ed747abb0 2024-09-18T02:06:09.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.339+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94759180353024] v32'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.339+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94759180338800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed74b2a90 con 0x7fc850024070 2024-09-18T02:06:09.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.339+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94759180338800] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.339+0000 7fc86a3f8980 20 remove_watcher() i=0 2024-09-18T02:06:09.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.339+0000 7fc86a3f8980 2 removed watcher, disabling cache 2024-09-18T02:06:09.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.339+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94759180342208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed74b2a90 con 0x562ed747abb0 2024-09-18T02:06:09.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.343+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94759180342208] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.343+0000 7fc86a3f8980 20 remove_watcher() i=1 2024-09-18T02:06:09.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.343+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94759180336288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed74b2a90 con 0x562ed7483ee0 2024-09-18T02:06:09.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.343+0000 7fc867707640 1 -- 172.21.15.167:0/1847379768 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94759180336288] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850040040 con 0x562ed7483ee0 2024-09-18T02:06:09.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.343+0000 7fc86a3f8980 20 remove_watcher() i=2 2024-09-18T02:06:09.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.343+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94759180348224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed7487ca0 con 0x7fc850024070 2024-09-18T02:06:09.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.347+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94759180348224] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x7fc850024070 2024-09-18T02:06:09.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.347+0000 7fc86a3f8980 20 remove_watcher() i=3 2024-09-18T02:06:09.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.347+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94759180347024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748ab40 con 0x562ed747abb0 2024-09-18T02:06:09.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.347+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94759180347024] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860026040 con 0x562ed747abb0 2024-09-18T02:06:09.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.347+0000 7fc86a3f8980 20 remove_watcher() i=4 2024-09-18T02:06:09.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.347+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94759180355296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed7487ca0 con 0x562ed747f570 2024-09-18T02:06:09.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.351+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94759180355296] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.351+0000 7fc86a3f8980 20 remove_watcher() i=5 2024-09-18T02:06:09.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.351+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94759180357904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748a690 con 0x562ed747f570 2024-09-18T02:06:09.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.351+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94759180357904] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.351+0000 7fc86a3f8980 20 remove_watcher() i=6 2024-09-18T02:06:09.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.351+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94759180362128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ed748c6e0 con 0x562ed747f570 2024-09-18T02:06:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc867f08640 1 -- 172.21.15.167:0/1847379768 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94759180362128] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8580eb070 con 0x562ed747f570 2024-09-18T02:06:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 20 remove_watcher() i=7 2024-09-18T02:06:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562ed747f570 msgr2=0x562ed7481960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562ed747f570 0x562ed7481960 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562ed747abb0 msgr2=0x562ed747d070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562ed747abb0 0x562ed747d070 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc850024070 msgr2=0x7fc850031970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fc850024070 0x7fc850031970 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562ed7483ee0 msgr2=0x562ed7486330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562ed7483ee0 0x562ed7486330 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc730034650 msgr2=0x7fc730036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc730034650 0x7fc730036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc850004fd0 tx=0x7fc850010000 comp rx=0 tx=0).stop 2024-09-18T02:06:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc868709640 1 -- 172.21.15.167:0/1847379768 reap_dead start 2024-09-18T02:06:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 msgr2=0x562ed746fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed746fbc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fc858008380 tx=0x7fc8580aef20 comp rx=0 tx=0).stop 2024-09-18T02:06:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 shutdown_connections 2024-09-18T02:06:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/1847379768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed7468af0 0x562ed746fbc0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 >> 172.21.15.167:0/1847379768 conn(0x562ed7464e20 msgr2=0x562ed7462ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 shutdown_connections 2024-09-18T02:06:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/1847379768 wait complete. 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2331863011 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc740034650 msgr2=0x7fc740036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/2331863011 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc740034650 0x7fc740036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x562ed7445f40 tx=0x7fc85000f000 comp rx=0 tx=0).stop 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2331863011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed745c280 msgr2=0x562ed745c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/2331863011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed745c280 0x562ed745c6a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc8580e2aa0 tx=0x7fc8580e43a0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2331863011 shutdown_connections 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/2331863011 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc740034650 0x7fc740036b10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/2331863011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed745c280 0x562ed745c6a0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2331863011 >> 172.21.15.167:0/2331863011 conn(0x562ed74513d0 msgr2=0x562ed7453e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2331863011 shutdown_connections 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/2331863011 wait complete. 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562ed7447d90 msgr2=0x562ed744a180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x562ed7447d90 0x562ed744a180 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562ed7443020 msgr2=0x562ed7445410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x562ed7443020 0x562ed7445410 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562ed744bc60 msgr2=0x562ed744e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x562ed744bc60 0x562ed744e050 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc74c0346a0 msgr2=0x7fc74c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fc74c0346a0 0x7fc74c036b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc850006fd0 tx=0x7fc850006680 comp rx=0 tx=0).stop 2024-09-18T02:06:09.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734c240 msgr2=0x562ed743e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 --2- 172.21.15.167:0/352142576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562ed734c240 0x562ed743e0a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc85800a480 tx=0x7fc858017eb0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc868709640 1 -- 172.21.15.167:0/352142576 reap_dead start 2024-09-18T02:06:09.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 shutdown_connections 2024-09-18T02:06:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 >> 172.21.15.167:0/352142576 conn(0x562ed72bf240 msgr2=0x562ed74313f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 shutdown_connections 2024-09-18T02:06:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.355+0000 7fc86a3f8980 1 -- 172.21.15.167:0/352142576 wait complete. 2024-09-18T02:06:09.367 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:09.367 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:09.368 ERROR:root:0 2024-09-18T02:06:09.368 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:09.372 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:09.372 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-18T02:06:09.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-18T02:06:09.373 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-18T02:06:09.435 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:09.436 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:09.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.435+0000 7f6156a20980 1 Processor -- start 2024-09-18T02:06:09.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.435+0000 7f6156a20980 1 -- start start 2024-09-18T02:06:09.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.435+0000 7f6156a20980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ebcb9899e0 0x55ebcb98bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.435+0000 7f6156a20980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ebcb80dae0 con 0x55ebcb985660 2024-09-18T02:06:09.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.435+0000 7f6156a20980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55ebcb831e30 con 0x55ebcb9899e0 2024-09-18T02:06:09.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.435+0000 7f6153d2f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ebcb9899e0 0x55ebcb98bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.435+0000 7f6154530640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55ebcb985660 0x55ebcb985a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33914/0 (socket says 172.21.15.167:33914) 2024-09-18T02:06:09.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.435+0000 7f6154530640 1 -- 172.21.15.167:0/851375905 learned_addr learned my addr 172.21.15.167:0/851375905 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:09.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.435+0000 7f6153d2f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55ebcb9899e0 0x55ebcb98bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50642/0 (socket says 172.21.15.167:50642) 2024-09-18T02:06:09.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.435+0000 7f6153d2f640 1 -- 172.21.15.167:0/851375905 >> v1:172.21.15.81:6789/0 conn(0x55ebcb985660 legacy=0x55ebcb985a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.435+0000 7f6153d2f640 1 -- 172.21.15.167:0/851375905 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcb98d320 con 0x55ebcb9899e0 2024-09-18T02:06:09.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.439+0000 7f6153d2f640 1 --2- 172.21.15.167:0/851375905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb9899e0 0x55ebcb98bdd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f614800a480 tx=0x7f614801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95ec2fd532f853c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.439+0000 7f615352e640 1 -- 172.21.15.167:0/851375905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61480b0070 con 0x55ebcb9899e0 2024-09-18T02:06:09.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.439+0000 7f615352e640 1 -- 172.21.15.167:0/851375905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61480ab540 con 0x55ebcb9899e0 2024-09-18T02:06:09.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.439+0000 7f615352e640 1 -- 172.21.15.167:0/851375905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61480ab840 con 0x55ebcb9899e0 2024-09-18T02:06:09.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.439+0000 7f6156a20980 1 -- 172.21.15.167:0/851375905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb9899e0 msgr2=0x55ebcb98bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.439+0000 7f6156a20980 1 --2- 172.21.15.167:0/851375905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb9899e0 0x55ebcb98bdd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f614800a480 tx=0x7f614801b280 comp rx=0 tx=0).stop 2024-09-18T02:06:09.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.439+0000 7f6156a20980 1 -- 172.21.15.167:0/851375905 shutdown_connections 2024-09-18T02:06:09.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.439+0000 7f6156a20980 1 --2- 172.21.15.167:0/851375905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb9899e0 0x55ebcb98bdd0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.439+0000 7f6156a20980 1 -- 172.21.15.167:0/851375905 >> 172.21.15.167:0/851375905 conn(0x55ebcb981180 msgr2=0x55ebcb9835a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.439+0000 7f6156a20980 1 -- 172.21.15.167:0/851375905 shutdown_connections 2024-09-18T02:06:09.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.439+0000 7f6156a20980 1 -- 172.21.15.167:0/851375905 wait complete. 2024-09-18T02:06:09.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f6156a20980 1 Processor -- start 2024-09-18T02:06:09.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f6156a20980 1 -- start start 2024-09-18T02:06:09.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f6156a20980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 0x55ebcb8fbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f6156a20980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebcb833200 con 0x55ebcb985660 2024-09-18T02:06:09.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f6154530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 0x55ebcb8fbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f6154530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 0x55ebcb8fbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50652/0 (socket says 172.21.15.167:50652) 2024-09-18T02:06:09.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f6154530640 1 -- 172.21.15.167:0/1015719110 learned_addr learned my addr 172.21.15.167:0/1015719110 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f6154530640 1 -- 172.21.15.167:0/1015719110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcb8fc130 con 0x55ebcb985660 2024-09-18T02:06:09.455 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f6154530640 1 --2- 172.21.15.167:0/1015719110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 0x55ebcb8fbb60 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f614c0015f0 tx=0x7f614c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1d6d346563cc24 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f604260c640 1 -- 172.21.15.167:0/1015719110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c004530 con 0x55ebcb985660 2024-09-18T02:06:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f604260c640 1 -- 172.21.15.167:0/1015719110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c0046f0 con 0x55ebcb985660 2024-09-18T02:06:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.451+0000 7f604260c640 1 -- 172.21.15.167:0/1015719110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c004a90 con 0x55ebcb985660 2024-09-18T02:06:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 -- 172.21.15.167:0/1015719110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 msgr2=0x55ebcb8fbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 --2- 172.21.15.167:0/1015719110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 0x55ebcb8fbb60 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f614c0015f0 tx=0x7f614c001ab0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 -- 172.21.15.167:0/1015719110 shutdown_connections 2024-09-18T02:06:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 --2- 172.21.15.167:0/1015719110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 0x55ebcb8fbb60 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 -- 172.21.15.167:0/1015719110 >> 172.21.15.167:0/1015719110 conn(0x55ebcb981180 msgr2=0x55ebcba6c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 -- 172.21.15.167:0/1015719110 shutdown_connections 2024-09-18T02:06:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 -- 172.21.15.167:0/1015719110 wait complete. 2024-09-18T02:06:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 Processor -- start 2024-09-18T02:06:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 -- start start 2024-09-18T02:06:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 0x55ebcba7a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebcb98ce20 con 0x55ebcb985660 2024-09-18T02:06:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6154530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 0x55ebcba7a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6154530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 0x55ebcba7a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50662/0 (socket says 172.21.15.167:50662) 2024-09-18T02:06:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6154530640 1 -- 172.21.15.167:0/2371651800 learned_addr learned my addr 172.21.15.167:0/2371651800 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6154530640 1 -- 172.21.15.167:0/2371651800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcba7a5e0 con 0x55ebcb985660 2024-09-18T02:06:09.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6154530640 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 0x55ebcba7a0a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x55ebcb8fb6e0 tx=0x7f614c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6040e09640 1 -- 172.21.15.167:0/2371651800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c013760 con 0x55ebcb985660 2024-09-18T02:06:09.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6040e09640 1 -- 172.21.15.167:0/2371651800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c013900 con 0x55ebcb985660 2024-09-18T02:06:09.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebcba7a870 con 0x55ebcb985660 2024-09-18T02:06:09.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebcba7d550 con 0x55ebcb985660 2024-09-18T02:06:09.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6040e09640 1 -- 172.21.15.167:0/2371651800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c013ab0 con 0x55ebcb985660 2024-09-18T02:06:09.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6040e09640 1 -- 172.21.15.167:0/2371651800 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f614c010070 con 0x55ebcb985660 2024-09-18T02:06:09.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6040e09640 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f603c034650 0x7f603c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6040e09640 1 -- 172.21.15.167:0/2371651800 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f614c018070 con 0x55ebcb985660 2024-09-18T02:06:09.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.455+0000 7f6153d2f640 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f603c034650 0x7f603c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6156a20980 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebcb9899e0 0x55ebcba811a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcba816e0 con 0x55ebcb9899e0 2024-09-18T02:06:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6154d31640 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebcb9899e0 0x55ebcba811a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6153d2f640 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f603c034650 0x7f603c036b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f61480ad000 tx=0x7f61480a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6154d31640 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebcb9899e0 0x55ebcba811a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6154d31640 1 -- 172.21.15.167:0/2371651800 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61440083f0 con 0x55ebcb9899e0 2024-09-18T02:06:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcba7e770 con 0x55ebcb9899e0 2024-09-18T02:06:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6154d31640 1 -- 172.21.15.167:0/2371651800 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61440083f0 con 0x55ebcb9899e0 2024-09-18T02:06:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6156a20980 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebcba83a20 0x55ebcba85e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcba864e0 con 0x55ebcba83a20 2024-09-18T02:06:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6154530640 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebcba83a20 0x55ebcba85e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6154530640 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebcba83a20 0x55ebcba85e10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6154530640 1 -- 172.21.15.167:0/2371651800 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcba83a20 2024-09-18T02:06:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcba828c0 con 0x55ebcb9899e0 2024-09-18T02:06:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6154d31640 1 -- 172.21.15.167:0/2371651800 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61440083f0 con 0x55ebcb9899e0 2024-09-18T02:06:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6156a20980 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebcba87920 0x55ebcba89d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcba8a4a0 con 0x55ebcba87920 2024-09-18T02:06:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6153d2f640 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebcba87920 0x55ebcba89d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6153d2f640 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebcba87920 0x55ebcba89d10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6153d2f640 1 -- 172.21.15.167:0/2371651800 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f61480abd10 con 0x55ebcba87920 2024-09-18T02:06:09.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.459+0000 7f6156a20980 1 Processor -- start 2024-09-18T02:06:09.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6156a20980 1 -- start start 2024-09-18T02:06:09.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6156a20980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcba97ef0 0x55ebcba98310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6156a20980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebcb88c800 con 0x55ebcba97ef0 2024-09-18T02:06:09.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6154530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcba97ef0 0x55ebcba98310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6154530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcba97ef0 0x55ebcba98310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50670/0 (socket says 172.21.15.167:50670) 2024-09-18T02:06:09.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6154530640 1 -- 172.21.15.167:0/2128793591 learned_addr learned my addr 172.21.15.167:0/2128793591 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6154530640 1 -- 172.21.15.167:0/2128793591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcba98850 con 0x55ebcba97ef0 2024-09-18T02:06:09.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6154530640 1 --2- 172.21.15.167:0/2128793591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcba97ef0 0x55ebcba98310 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f614c0482d0 tx=0x7f614c041d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6039ffb640 1 -- 172.21.15.167:0/2128793591 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c029470 con 0x55ebcba97ef0 2024-09-18T02:06:09.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6156a20980 1 -- 172.21.15.167:0/2128793591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebcba98ae0 con 0x55ebcba97ef0 2024-09-18T02:06:09.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6039ffb640 1 -- 172.21.15.167:0/2128793591 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c029610 con 0x55ebcba97ef0 2024-09-18T02:06:09.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6039ffb640 1 -- 172.21.15.167:0/2128793591 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c010b10 con 0x55ebcba97ef0 2024-09-18T02:06:09.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6156a20980 1 -- 172.21.15.167:0/2128793591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebcba9b760 con 0x55ebcba97ef0 2024-09-18T02:06:09.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6039ffb640 1 -- 172.21.15.167:0/2128793591 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f614c0125d0 con 0x55ebcba97ef0 2024-09-18T02:06:09.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6039ffb640 1 --2- 172.21.15.167:0/2128793591 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f602c034650 0x7f602c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6039ffb640 1 -- 172.21.15.167:0/2128793591 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f614c03c070 con 0x55ebcba97ef0 2024-09-18T02:06:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6153d2f640 1 --2- 172.21.15.167:0/2128793591 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f602c034650 0x7f602c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6156a20980 1 Processor -- start 2024-09-18T02:06:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6156a20980 1 -- start start 2024-09-18T02:06:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6153d2f640 1 --2- 172.21.15.167:0/2128793591 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f602c034650 0x7f602c036b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55ebcba8a8a0 tx=0x7f6148005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6156a20980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaa4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6156a20980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebcb8fa350 con 0x55ebcbaa48f0 2024-09-18T02:06:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6154530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaa4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6154530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaa4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50684/0 (socket says 172.21.15.167:50684) 2024-09-18T02:06:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.463+0000 7f6154530640 1 -- 172.21.15.167:0/1461673693 learned_addr learned my addr 172.21.15.167:0/1461673693 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6154530640 1 -- 172.21.15.167:0/1461673693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcbaa52c0 con 0x55ebcbaa48f0 2024-09-18T02:06:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6154530640 1 --2- 172.21.15.167:0/1461673693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaa4cf0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f614c039fd0 tx=0x7f614c015e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841f2c2da4a060b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f60337fe640 1 -- 172.21.15.167:0/1461673693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c0128c0 con 0x55ebcbaa48f0 2024-09-18T02:06:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f60337fe640 1 -- 172.21.15.167:0/1461673693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c049450 con 0x55ebcbaa48f0 2024-09-18T02:06:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f60337fe640 1 -- 172.21.15.167:0/1461673693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c0333d0 con 0x55ebcbaa48f0 2024-09-18T02:06:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 -- 172.21.15.167:0/1461673693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 msgr2=0x55ebcbaa4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 --2- 172.21.15.167:0/1461673693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaa4cf0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f614c039fd0 tx=0x7f614c015e40 comp rx=0 tx=0).stop 2024-09-18T02:06:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 -- 172.21.15.167:0/1461673693 shutdown_connections 2024-09-18T02:06:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 --2- 172.21.15.167:0/1461673693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaa4cf0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 -- 172.21.15.167:0/1461673693 >> 172.21.15.167:0/1461673693 conn(0x55ebcbaa0c70 msgr2=0x55ebcba9ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 -- 172.21.15.167:0/1461673693 shutdown_connections 2024-09-18T02:06:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 -- 172.21.15.167:0/1461673693 wait complete. 2024-09-18T02:06:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 Processor -- start 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 -- start start 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaaba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebcbaa5680 con 0x55ebcbaa48f0 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6154530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaaba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6154530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaaba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50696/0 (socket says 172.21.15.167:50696) 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 learned_addr learned my addr 172.21.15.167:0/498341713 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcbaabfa0 con 0x55ebcbaa48f0 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6154530640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaaba60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f614c015e80 tx=0x7f614c031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6031ffb640 1 -- 172.21.15.167:0/498341713 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c020840 con 0x55ebcbaa48f0 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebcbaabfa0 con 0x55ebcbaa48f0 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6031ffb640 1 -- 172.21.15.167:0/498341713 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c033d60 con 0x55ebcbaa48f0 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebcbaabfa0 con 0x55ebcbaa48f0 2024-09-18T02:06:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.467+0000 7f6031ffb640 1 -- 172.21.15.167:0/498341713 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c028720 con 0x55ebcbaa48f0 2024-09-18T02:06:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6031ffb640 1 -- 172.21.15.167:0/498341713 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f614c06e030 con 0x55ebcbaa48f0 2024-09-18T02:06:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6031ffb640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6024034650 0x7f6024036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6031ffb640 1 -- 172.21.15.167:0/498341713 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f614c06c070 con 0x55ebcbaa48f0 2024-09-18T02:06:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6153d2f640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6024034650 0x7f6024036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebcbab6bc0 0x55ebcbab9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbab97b0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6154d31640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebcbab6bc0 0x55ebcbab9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6153d2f640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6024034650 0x7f6024036b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f61480c2010 tx=0x7f61480a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6154d31640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebcbab6bc0 0x55ebcbab9060 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61440083f0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 20 realm 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbab9bc0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61440083f0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba460 con 0x55ebcbab6bc0 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61440083f0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x55ebcbab6bc0 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61440083f0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebcbabb560 0x55ebcbabd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbabdff0 con 0x55ebcbabb560 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6154530640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebcbabb560 0x55ebcbabd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.471+0000 7f6154530640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebcbabb560 0x55ebcbabd950 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6156a20980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6156a20980 20 searching for the correct realm 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6156a20980 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebcbabfed0 0x55ebcbac2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac29a0 con 0x55ebcbabfed0 2024-09-18T02:06:09.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6153d2f640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebcbabfed0 0x55ebcbac2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6153d2f640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebcbabfed0 0x55ebcbac2320 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6153d2f640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f61480ce040 0x7f61480db920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac29a0 con 0x7f61480ce040 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f61480ce040 0x7f61480db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f61480ce040 0x7f61480db920 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440083f0 con 0x7f61480ce040 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x7f61480ce040 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440083f0 con 0x7f61480ce040 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x55ebcbab6bc0 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x55ebcbab6bc0 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x55ebcbab6bc0 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.485 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x55ebcbabb560 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x7f61480ce040 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.475+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x55ebcbabfed0 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x55ebcbab6bc0 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x7f61480ce040 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x55ebcbab6bc0 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x7f61480ce040 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaba800 con 0x55ebcbabfed0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbabfed0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbabb560 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbabfed0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbabfed0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbab6bc0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbab6bc0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.479+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbabb560 2024-09-18T02:06:09.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbabfed0 2024-09-18T02:06:09.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x7f61480ce040 2024-09-18T02:06:09.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbab6bc0 2024-09-18T02:06:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbabb560 2024-09-18T02:06:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbabfed0 2024-09-18T02:06:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbabb560 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x7f61480ce040 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbabfed0 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.483+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbabb560 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x55ebcbab6bc0 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61480e8080 con 0x7f61480ce040 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbabe840 con 0x55ebcbab6bc0 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbabe840 con 0x55ebcbab6bc0 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbabe840 con 0x55ebcbabfed0 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 zone default found 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 4 Realm: () 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 zonegroup default 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbabf240 con 0x55ebcbabb560 2024-09-18T02:06:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbabedd0 con 0x55ebcbabfed0 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac4d60 con 0x55ebcbabfed0 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 started sync module instance, tier type = 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.487+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac4140 con 0x7f61480ce040 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.491+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.491+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94471222740576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac4140 con 0x7f61480ce040 2024-09-18T02:06:09.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.491+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac5880 con 0x55ebcbab6bc0 2024-09-18T02:06:09.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.491+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94471222740576] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.491+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.491+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94471222743920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac4140 con 0x55ebcbab6bc0 2024-09-18T02:06:09.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.491+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac6290 con 0x55ebcbabfed0 2024-09-18T02:06:09.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94471222743920] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94471222738064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac40b0 con 0x55ebcbabfed0 2024-09-18T02:06:09.502 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac6f90 con 0x7f61480ce040 2024-09-18T02:06:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94471222750192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac76a0 con 0x7f61480ce040 2024-09-18T02:06:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac81c0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94471222750192] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94471222738064] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94471222748720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac8180 con 0x55ebcbab6bc0 2024-09-18T02:06:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.495+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac85b0 con 0x55ebcbabb560 2024-09-18T02:06:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.499+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94471222748720] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.499+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.499+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94471222754448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac89a0 con 0x55ebcbabb560 2024-09-18T02:06:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.499+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac9360 con 0x55ebcbabb560 2024-09-18T02:06:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94471222759088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac9780 con 0x55ebcbabb560 2024-09-18T02:06:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaca230 con 0x55ebcbabb560 2024-09-18T02:06:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94471222754448] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94471222759088] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94471222751472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac92d0 con 0x55ebcbabb560 2024-09-18T02:06:09.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6156a20980 20 add_watcher() i=0 2024-09-18T02:06:09.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6156a20980 20 add_watcher() i=1 2024-09-18T02:06:09.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6156a20980 20 add_watcher() i=2 2024-09-18T02:06:09.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6156a20980 20 add_watcher() i=3 2024-09-18T02:06:09.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6156a20980 20 add_watcher() i=4 2024-09-18T02:06:09.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6156a20980 20 add_watcher() i=5 2024-09-18T02:06:09.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.503+0000 7f6156a20980 20 add_watcher() i=6 2024-09-18T02:06:09.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94471222751472] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 20 add_watcher() i=7 2024-09-18T02:06:09.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:09.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac9760 con 0x55ebcbab6bc0 2024-09-18T02:06:09.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94471222762768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac9760 con 0x55ebcbab6bc0 2024-09-18T02:06:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94471222762768] v32'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f600a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 5 note: GC not initialized 2024-09-18T02:06:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f60097e2640 20 reqs_thread_entry: start 2024-09-18T02:06:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 20 Filter name: none 2024-09-18T02:06:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f5f7affd640 20 reqs_thread_entry: start 2024-09-18T02:06:09.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T02:06:09.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaf07b0 con 0x55ebcbabb560 2024-09-18T02:06:09.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 20 rados_obj.operate() r=0 bl.length=490 2024-09-18T02:06:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T02:06:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.507+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaf7100 con 0x55ebcbabb560 2024-09-18T02:06:09.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f6156a20980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:09.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f6156a20980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f6156a20980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T02:06:09.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94471222946672 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaf27f0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== watch-notify(notify (1) cookie 94471222748720 notify 137438953497 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f6144010040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f60337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94471222748720 notifier 4886 bl.length()=666 2024-09-18T02:06:09.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f60337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:09.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f60337fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 notify.4 [notify cookie 94471222946672 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f60337fe640 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6018003eb0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== watch-notify(notify_complete (2) cookie 94471222946672 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f614400a6c0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.516 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T02:06:08.069645Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.069630Z","tags":[],"group_ids":[]} 2024-09-18T02:06:09.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f600a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:09.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.511+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94471222762768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaee5b0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.515+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94471222762768] v32'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.515+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94471222740576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaee5b0 con 0x7f61480ce040 2024-09-18T02:06:09.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.515+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94471222740576] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.515+0000 7f6156a20980 20 remove_watcher() i=0 2024-09-18T02:06:09.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.515+0000 7f6156a20980 2 removed watcher, disabling cache 2024-09-18T02:06:09.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.515+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94471222743920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaee5b0 con 0x55ebcbab6bc0 2024-09-18T02:06:09.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.519+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94471222743920] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.519+0000 7f6156a20980 20 remove_watcher() i=1 2024-09-18T02:06:09.520 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.519+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94471222738064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac5370 con 0x55ebcbabfed0 2024-09-18T02:06:09.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.519+0000 7f6153d2f640 1 -- 172.21.15.167:0/498341713 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94471222738064] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61480d9070 con 0x55ebcbabfed0 2024-09-18T02:06:09.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.519+0000 7f6156a20980 20 remove_watcher() i=2 2024-09-18T02:06:09.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.519+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94471222750192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaee5b0 con 0x7f61480ce040 2024-09-18T02:06:09.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.519+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94471222750192] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x7f61480ce040 2024-09-18T02:06:09.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.519+0000 7f6156a20980 20 remove_watcher() i=3 2024-09-18T02:06:09.523 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.519+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94471222748720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac3c90 con 0x55ebcbab6bc0 2024-09-18T02:06:09.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.523+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94471222748720] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6144026040 con 0x55ebcbab6bc0 2024-09-18T02:06:09.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.523+0000 7f6156a20980 20 remove_watcher() i=4 2024-09-18T02:06:09.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.523+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94471222754448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbaee5b0 con 0x55ebcbabb560 2024-09-18T02:06:09.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.523+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94471222754448] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.523+0000 7f6156a20980 20 remove_watcher() i=5 2024-09-18T02:06:09.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.523+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94471222759088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac6630 con 0x55ebcbabb560 2024-09-18T02:06:09.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94471222759088] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 20 remove_watcher() i=6 2024-09-18T02:06:09.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94471222751472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ebcbac3c90 con 0x55ebcbabb560 2024-09-18T02:06:09.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6154530640 1 -- 172.21.15.167:0/498341713 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94471222751472] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c01b030 con 0x55ebcbabb560 2024-09-18T02:06:09.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 20 remove_watcher() i=7 2024-09-18T02:06:09.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebcbabb560 msgr2=0x55ebcbabd950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebcbabb560 0x55ebcbabd950 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebcbab6bc0 msgr2=0x55ebcbab9060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebcbab6bc0 0x55ebcbab9060 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f61480ce040 msgr2=0x7f61480db920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f61480ce040 0x7f61480db920 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebcbabfed0 msgr2=0x55ebcbac2320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebcbabfed0 0x55ebcbac2320 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6024034650 msgr2=0x7f6024036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6024034650 0x7f6024036b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f61480c2010 tx=0x7f61480a6000 comp rx=0 tx=0).stop 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 msgr2=0x55ebcbaaba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6154d31640 1 -- 172.21.15.167:0/498341713 reap_dead start 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaaba60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f614c015e80 tx=0x7f614c031f10 comp rx=0 tx=0).stop 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 shutdown_connections 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/498341713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcbaa48f0 0x55ebcbaaba60 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 >> 172.21.15.167:0/498341713 conn(0x55ebcbaa0c70 msgr2=0x55ebcba9ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 shutdown_connections 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/498341713 wait complete. 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/2128793591 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f602c034650 msgr2=0x7f602c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/2128793591 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f602c034650 0x7f602c036b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55ebcba8a8a0 tx=0x7f6148005a10 comp rx=0 tx=0).stop 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/2128793591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcba97ef0 msgr2=0x55ebcba98310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/2128793591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcba97ef0 0x55ebcba98310 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f614c0482d0 tx=0x7f614c041d00 comp rx=0 tx=0).stop 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/2128793591 shutdown_connections 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/2128793591 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f602c034650 0x7f602c036b10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/2128793591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcba97ef0 0x55ebcba98310 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/2128793591 >> 172.21.15.167:0/2128793591 conn(0x55ebcba8d040 msgr2=0x55ebcba8fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/2128793591 shutdown_connections 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/2128793591 wait complete. 2024-09-18T02:06:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebcba83a20 msgr2=0x55ebcba85e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55ebcba83a20 0x55ebcba85e10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebcb9899e0 msgr2=0x55ebcba811a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.527+0000 7f6156a20980 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55ebcb9899e0 0x55ebcba811a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.531+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebcba87920 msgr2=0x55ebcba89d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.531+0000 7f6156a20980 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55ebcba87920 0x55ebcba89d10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.531+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f603c034650 msgr2=0x7f603c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.531+0000 7f6156a20980 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f603c034650 0x7f603c036b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f61480ad000 tx=0x7f61480a5040 comp rx=0 tx=0).stop 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.531+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 msgr2=0x55ebcba7a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.531+0000 7f6156a20980 1 --2- 172.21.15.167:0/2371651800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebcb985660 0x55ebcba7a0a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x55ebcb8fb6e0 tx=0x7f614c000f50 comp rx=0 tx=0).stop 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.531+0000 7f6154d31640 1 -- 172.21.15.167:0/2371651800 reap_dead start 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.531+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 shutdown_connections 2024-09-18T02:06:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.531+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 >> 172.21.15.167:0/2371651800 conn(0x55ebcb981180 msgr2=0x55ebcba6c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.531+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 shutdown_connections 2024-09-18T02:06:09.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.531+0000 7f6156a20980 1 -- 172.21.15.167:0/2371651800 wait complete. 2024-09-18T02:06:09.541 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:09.542 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:09.542 ERROR:root:0 2024-09-18T02:06:09.542 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:09.546 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:09.546 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T02:06:09.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T02:06:09.547 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-18T02:06:09.618 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:09.619 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:09.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.615+0000 7f041a0cc980 1 Processor -- start 2024-09-18T02:06:09.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.615+0000 7f041a0cc980 1 -- start start 2024-09-18T02:06:09.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.615+0000 7f041a0cc980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55e73a90ead0 0x55e73a910ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.615+0000 7f041a0cc980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e73a792ae0 con 0x55e73a87f2a0 2024-09-18T02:06:09.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.615+0000 7f041a0cc980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55e73a7b6e30 con 0x55e73a90ead0 2024-09-18T02:06:09.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f04173db640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55e73a90ead0 0x55e73a910ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f0417bdc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55e73a87f2a0 0x55e73a90d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33922/0 (socket says 172.21.15.167:33922) 2024-09-18T02:06:09.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f0417bdc640 1 -- 172.21.15.167:0/3751290543 learned_addr learned my addr 172.21.15.167:0/3751290543 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:09.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f04173db640 1 -- 172.21.15.167:0/3751290543 >> v1:172.21.15.81:6789/0 conn(0x55e73a87f2a0 legacy=0x55e73a90d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f04173db640 1 -- 172.21.15.167:0/3751290543 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e73a87f830 con 0x55e73a90ead0 2024-09-18T02:06:09.621 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f0416bda640 1 -- 172.21.15.167:0/3751290543 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 434312770 0 0) 0x55e73a792ae0 con 0x55e73a87f2a0 2024-09-18T02:06:09.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f04173db640 1 --2- 172.21.15.167:0/3751290543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a90ead0 0x55e73a910ec0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f040c00a480 tx=0x7f040c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0da0a69f28b463 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f0416bda640 1 -- 172.21.15.167:0/3751290543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c0b0070 con 0x55e73a90ead0 2024-09-18T02:06:09.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f0416bda640 1 -- 172.21.15.167:0/3751290543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c0ab540 con 0x55e73a90ead0 2024-09-18T02:06:09.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f0416bda640 1 -- 172.21.15.167:0/3751290543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c0ab840 con 0x55e73a90ead0 2024-09-18T02:06:09.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f041a0cc980 1 -- 172.21.15.167:0/3751290543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a90ead0 msgr2=0x55e73a910ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f041a0cc980 1 --2- 172.21.15.167:0/3751290543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a90ead0 0x55e73a910ec0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f040c00a480 tx=0x7f040c01b280 comp rx=0 tx=0).stop 2024-09-18T02:06:09.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f041a0cc980 1 -- 172.21.15.167:0/3751290543 shutdown_connections 2024-09-18T02:06:09.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f041a0cc980 1 --2- 172.21.15.167:0/3751290543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a90ead0 0x55e73a910ec0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f041a0cc980 1 -- 172.21.15.167:0/3751290543 >> 172.21.15.167:0/3751290543 conn(0x55e73a9050a0 msgr2=0x55e73a9074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f041a0cc980 1 -- 172.21.15.167:0/3751290543 shutdown_connections 2024-09-18T02:06:09.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.619+0000 7f041a0cc980 1 -- 172.21.15.167:0/3751290543 wait complete. 2024-09-18T02:06:09.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f041a0cc980 1 Processor -- start 2024-09-18T02:06:09.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f041a0cc980 1 -- start start 2024-09-18T02:06:09.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f041a0cc980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 0x55e73a90ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f041a0cc980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e73a7b8200 con 0x55e73a87f2a0 2024-09-18T02:06:09.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f0417bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 0x55e73a90ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f0417bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 0x55e73a90ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50702/0 (socket says 172.21.15.167:50702) 2024-09-18T02:06:09.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f0417bdc640 1 -- 172.21.15.167:0/932051082 learned_addr learned my addr 172.21.15.167:0/932051082 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f0417bdc640 1 -- 172.21.15.167:0/932051082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e73a90b0e0 con 0x55e73a87f2a0 2024-09-18T02:06:09.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f0417bdc640 1 --2- 172.21.15.167:0/932051082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 0x55e73a90ab10 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f04080016c0 tx=0x7f0408001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c47a223f4d6c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f0305e0b640 1 -- 172.21.15.167:0/932051082 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408003460 con 0x55e73a87f2a0 2024-09-18T02:06:09.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f0305e0b640 1 -- 172.21.15.167:0/932051082 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408003600 con 0x55e73a87f2a0 2024-09-18T02:06:09.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f0305e0b640 1 -- 172.21.15.167:0/932051082 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408003920 con 0x55e73a87f2a0 2024-09-18T02:06:09.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f041a0cc980 1 -- 172.21.15.167:0/932051082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 msgr2=0x55e73a90ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f041a0cc980 1 --2- 172.21.15.167:0/932051082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 0x55e73a90ab10 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f04080016c0 tx=0x7f0408001b80 comp rx=0 tx=0).stop 2024-09-18T02:06:09.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f041a0cc980 1 -- 172.21.15.167:0/932051082 shutdown_connections 2024-09-18T02:06:09.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f041a0cc980 1 --2- 172.21.15.167:0/932051082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 0x55e73a90ab10 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f041a0cc980 1 -- 172.21.15.167:0/932051082 >> 172.21.15.167:0/932051082 conn(0x55e73a9050a0 msgr2=0x55e73a9f1470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f041a0cc980 1 -- 172.21.15.167:0/932051082 shutdown_connections 2024-09-18T02:06:09.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.635+0000 7f041a0cc980 1 -- 172.21.15.167:0/932051082 wait complete. 2024-09-18T02:06:09.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f041a0cc980 1 Processor -- start 2024-09-18T02:06:09.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f041a0cc980 1 -- start start 2024-09-18T02:06:09.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f041a0cc980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 0x55e73a9fee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.641 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f041a0cc980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e73a911f10 con 0x55e73a87f2a0 2024-09-18T02:06:09.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f0417bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 0x55e73a9fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f0417bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 0x55e73a9fee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50712/0 (socket says 172.21.15.167:50712) 2024-09-18T02:06:09.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f0417bdc640 1 -- 172.21.15.167:0/480442757 learned_addr learned my addr 172.21.15.167:0/480442757 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.642 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f0417bdc640 1 -- 172.21.15.167:0/480442757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e73a9ff350 con 0x55e73a87f2a0 2024-09-18T02:06:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f0417bdc640 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 0x55e73a9fee10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f04080012f0 tx=0x7f0408001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f02fffff640 1 -- 172.21.15.167:0/480442757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408013760 con 0x55e73a87f2a0 2024-09-18T02:06:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f02fffff640 1 -- 172.21.15.167:0/480442757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408023070 con 0x55e73a87f2a0 2024-09-18T02:06:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e73a9ff5e0 con 0x55e73a87f2a0 2024-09-18T02:06:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e73aa022c0 con 0x55e73a87f2a0 2024-09-18T02:06:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f02fffff640 1 -- 172.21.15.167:0/480442757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408013a30 con 0x55e73a87f2a0 2024-09-18T02:06:09.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f02fffff640 1 -- 172.21.15.167:0/480442757 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0408010070 con 0x55e73a87f2a0 2024-09-18T02:06:09.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f02fffff640 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0300034650 0x7f0300036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.644 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f02fffff640 1 -- 172.21.15.167:0/480442757 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f0408049bd0 con 0x55e73a87f2a0 2024-09-18T02:06:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f04173db640 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0300034650 0x7f0300036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f041a0cc980 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e73a90ead0 0x55e73aa05de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa06420 con 0x55e73a90ead0 2024-09-18T02:06:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.639+0000 7f04183dd640 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e73a90ead0 0x55e73aa05de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f04173db640 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0300034650 0x7f0300036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f040c0ad000 tx=0x7f040c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f04183dd640 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e73a90ead0 0x55e73aa05de0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f04183dd640 1 -- 172.21.15.167:0/480442757 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04100083f0 con 0x55e73a90ead0 2024-09-18T02:06:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa034e0 con 0x55e73a90ead0 2024-09-18T02:06:09.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f04183dd640 1 -- 172.21.15.167:0/480442757 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04100083f0 con 0x55e73a90ead0 2024-09-18T02:06:09.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f041a0cc980 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e73aa08770 0x55e73aa0ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa0b230 con 0x55e73aa08770 2024-09-18T02:06:09.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f0417bdc640 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e73aa08770 0x55e73aa0ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.646 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f0417bdc640 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e73aa08770 0x55e73aa0ab60 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f0417bdc640 1 -- 172.21.15.167:0/480442757 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f040800f030 con 0x55e73aa08770 2024-09-18T02:06:09.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa07610 con 0x55e73a90ead0 2024-09-18T02:06:09.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f04183dd640 1 -- 172.21.15.167:0/480442757 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04100083f0 con 0x55e73a90ead0 2024-09-18T02:06:09.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f041a0cc980 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e73aa0c670 0x55e73aa0ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa0f1f0 con 0x55e73aa0c670 2024-09-18T02:06:09.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f04173db640 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e73aa0c670 0x55e73aa0ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f04173db640 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e73aa0c670 0x55e73aa0ea60 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.648 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f04173db640 1 -- 172.21.15.167:0/480442757 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f040c0b3040 con 0x55e73aa0c670 2024-09-18T02:06:09.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.643+0000 7f041a0cc980 1 Processor -- start 2024-09-18T02:06:09.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f041a0cc980 1 -- start start 2024-09-18T02:06:09.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f041a0cc980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa1cc80 0x55e73aa1d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f041a0cc980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e73a811800 con 0x55e73aa1cc80 2024-09-18T02:06:09.649 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f0417bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa1cc80 0x55e73aa1d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f0417bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa1cc80 0x55e73aa1d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50726/0 (socket says 172.21.15.167:50726) 2024-09-18T02:06:09.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f0417bdc640 1 -- 172.21.15.167:0/3052064847 learned_addr learned my addr 172.21.15.167:0/3052064847 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f0417bdc640 1 -- 172.21.15.167:0/3052064847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e73aa1d5e0 con 0x55e73aa1cc80 2024-09-18T02:06:09.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f0417bdc640 1 --2- 172.21.15.167:0/3052064847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa1cc80 0x55e73aa1d0a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f040801dfd0 tx=0x7f0408028bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f02fd7fa640 1 -- 172.21.15.167:0/3052064847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408041e60 con 0x55e73aa1cc80 2024-09-18T02:06:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f02fd7fa640 1 -- 172.21.15.167:0/3052064847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408019040 con 0x55e73aa1cc80 2024-09-18T02:06:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f041a0cc980 1 -- 172.21.15.167:0/3052064847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e73aa1d870 con 0x55e73aa1cc80 2024-09-18T02:06:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f02fd7fa640 1 -- 172.21.15.167:0/3052064847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408041c60 con 0x55e73aa1cc80 2024-09-18T02:06:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f041a0cc980 1 -- 172.21.15.167:0/3052064847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e73aa204f0 con 0x55e73aa1cc80 2024-09-18T02:06:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f02fd7fa640 1 -- 172.21.15.167:0/3052064847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0408041170 con 0x55e73aa1cc80 2024-09-18T02:06:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f02fd7fa640 1 --2- 172.21.15.167:0/3052064847 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f02f0034650 0x7f02f0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f02fd7fa640 1 -- 172.21.15.167:0/3052064847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f04080202a0 con 0x55e73aa1cc80 2024-09-18T02:06:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f04173db640 1 --2- 172.21.15.167:0/3052064847 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f02f0034650 0x7f02f0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f041a0cc980 1 Processor -- start 2024-09-18T02:06:09.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f041a0cc980 1 -- start start 2024-09-18T02:06:09.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f04173db640 1 --2- 172.21.15.167:0/3052064847 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f02f0034650 0x7f02f0036b10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f040c000c10 tx=0x7f040c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f041a0cc980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 0x55e73aa29b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f041a0cc980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e73a909300 con 0x55e73aa29730 2024-09-18T02:06:09.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.647+0000 7f0417bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 0x55e73aa29b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f0417bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 0x55e73aa29b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50738/0 (socket says 172.21.15.167:50738) 2024-09-18T02:06:09.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f0417bdc640 1 -- 172.21.15.167:0/2265914159 learned_addr learned my addr 172.21.15.167:0/2265914159 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f0417bdc640 1 -- 172.21.15.167:0/2265914159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e73aa2a0e0 con 0x55e73aa29730 2024-09-18T02:06:09.655 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f0417bdc640 1 --2- 172.21.15.167:0/2265914159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 0x55e73aa29b10 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0408006b70 tx=0x7f0408032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3be4f9757c15473 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f02f6ffd640 1 -- 172.21.15.167:0/2265914159 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040805c070 con 0x55e73aa29730 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f02f6ffd640 1 -- 172.21.15.167:0/2265914159 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040803d9a0 con 0x55e73aa29730 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f02f6ffd640 1 -- 172.21.15.167:0/2265914159 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04080493e0 con 0x55e73aa29730 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 -- 172.21.15.167:0/2265914159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 msgr2=0x55e73aa29b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 --2- 172.21.15.167:0/2265914159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 0x55e73aa29b10 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0408006b70 tx=0x7f0408032e60 comp rx=0 tx=0).stop 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 -- 172.21.15.167:0/2265914159 shutdown_connections 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 --2- 172.21.15.167:0/2265914159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 0x55e73aa29b10 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 -- 172.21.15.167:0/2265914159 >> 172.21.15.167:0/2265914159 conn(0x55e73aa25b10 msgr2=0x55e73aa23c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 -- 172.21.15.167:0/2265914159 shutdown_connections 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 -- 172.21.15.167:0/2265914159 wait complete. 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 Processor -- start 2024-09-18T02:06:09.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 -- start start 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 0x55e73aa30930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e73aa2a580 con 0x55e73aa29730 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f0417bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 0x55e73aa30930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f0417bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 0x55e73aa30930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50752/0 (socket says 172.21.15.167:50752) 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 learned_addr learned my addr 172.21.15.167:0/1509374772 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e73aa30e70 con 0x55e73aa29730 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f0417bdc640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 0x55e73aa30930 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0408041670 tx=0x7f040802aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f02f57fa640 1 -- 172.21.15.167:0/1509374772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408027a70 con 0x55e73aa29730 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e73aa30e70 con 0x55e73aa29730 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f02f57fa640 1 -- 172.21.15.167:0/1509374772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408067070 con 0x55e73aa29730 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f02f57fa640 1 -- 172.21.15.167:0/1509374772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04080496a0 con 0x55e73aa29730 2024-09-18T02:06:09.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.651+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e73aa312e0 con 0x55e73aa29730 2024-09-18T02:06:09.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f02f57fa640 1 -- 172.21.15.167:0/1509374772 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0408074060 con 0x55e73aa29730 2024-09-18T02:06:09.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f02f57fa640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f02e0034600 0x7f02e0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f02f57fa640 1 -- 172.21.15.167:0/1509374772 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f040806ebd0 con 0x55e73aa29730 2024-09-18T02:06:09.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f04173db640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f02e0034600 0x7f02e0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e73aa3baa0 0x55e73aa3df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3e6b0 con 0x55e73aa3baa0 2024-09-18T02:06:09.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f04183dd640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e73aa3baa0 0x55e73aa3df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f04173db640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f02e0034600 0x7f02e0036ac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f040c0ae040 tx=0x7f040c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f04183dd640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e73aa3baa0 0x55e73aa3df60 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04100083f0 con 0x55e73aa3baa0 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 20 realm 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3eac0 con 0x55e73aa3baa0 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04100083f0 con 0x55e73aa3baa0 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f360 con 0x55e73aa3baa0 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04100083f0 con 0x55e73aa3baa0 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa3baa0 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04100083f0 con 0x55e73aa3baa0 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e73aa40460 0x55e73aa42850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa42ef0 con 0x55e73aa40460 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f0417bdc640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e73aa40460 0x55e73aa42850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.655+0000 7f0417bdc640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e73aa40460 0x55e73aa42850 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f041a0cc980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f041a0cc980 20 searching for the correct realm 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f041a0cc980 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e73aa44dd0 0x55e73aa47220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa478a0 con 0x55e73aa44dd0 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04173db640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e73aa44dd0 0x55e73aa47220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04173db640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e73aa44dd0 0x55e73aa47220 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04173db640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f040c0db040 0x7f040c0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa478a0 con 0x7f040c0db040 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f040c0db040 0x7f040c0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f040c0db040 0x7f040c0cd920 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04100083f0 con 0x7f040c0db040 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x7f040c0db040 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04100083f0 con 0x7f040c0db040 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa3baa0 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa3baa0 2024-09-18T02:06:09.670 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa3baa0 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa40460 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x7f040c0db040 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa44dd0 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa3baa0 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.659+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x7f040c0db040 2024-09-18T02:06:09.671 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa3baa0 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x7f040c0db040 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa44dd0 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa44dd0 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa40460 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa44dd0 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.672 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa44dd0 2024-09-18T02:06:09.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa3baa0 2024-09-18T02:06:09.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa3baa0 2024-09-18T02:06:09.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa40460 2024-09-18T02:06:09.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa44dd0 2024-09-18T02:06:09.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x7f040c0db040 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.663+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa3baa0 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa40460 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa44dd0 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa40460 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x7f040c0db040 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa44dd0 2024-09-18T02:06:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa40460 2024-09-18T02:06:09.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x55e73aa3baa0 2024-09-18T02:06:09.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa3f700 con 0x7f040c0db040 2024-09-18T02:06:09.678 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa43740 con 0x55e73aa3baa0 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.679 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa43740 con 0x55e73aa3baa0 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.667+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa43740 con 0x55e73aa44dd0 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 20 zone default found 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 4 Realm: () 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 20 zonegroup default 2024-09-18T02:06:09.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa440e0 con 0x55e73aa40460 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa49790 con 0x55e73aa44dd0 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa49bf0 con 0x55e73aa44dd0 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 20 started sync module instance, tier type = 2024-09-18T02:06:09.681 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:09.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa48ba0 con 0x7f040c0db040 2024-09-18T02:06:09.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94451609669824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa48ba0 con 0x7f040c0db040 2024-09-18T02:06:09.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4a6f0 con 0x55e73aa3baa0 2024-09-18T02:06:09.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.671+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94451609669824] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.675+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.675+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94451609674176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa48ba0 con 0x55e73aa3baa0 2024-09-18T02:06:09.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.675+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4b100 con 0x55e73aa44dd0 2024-09-18T02:06:09.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.675+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94451609674176] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.675+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.675+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94451609667312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa48b10 con 0x55e73aa44dd0 2024-09-18T02:06:09.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.675+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4be50 con 0x7f040c0db040 2024-09-18T02:06:09.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.679+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.679+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94451609680592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4c6f0 con 0x7f040c0db040 2024-09-18T02:06:09.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.679+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4d0b0 con 0x55e73aa3baa0 2024-09-18T02:06:09.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.679+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94451609667312] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.679+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94451609680592] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.679+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.679+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94451609684992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4c660 con 0x55e73aa3baa0 2024-09-18T02:06:09.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.679+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4d020 con 0x55e73aa40460 2024-09-18T02:06:09.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.679+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94451609684992] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.683+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.683+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94451609682656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4d950 con 0x55e73aa40460 2024-09-18T02:06:09.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.683+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4e1a0 con 0x55e73aa40460 2024-09-18T02:06:09.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.683+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.686 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.683+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94451609682656] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.683+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94451609691456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4ee10 con 0x55e73aa40460 2024-09-18T02:06:09.687 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.683+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4d4c0 con 0x55e73aa40460 2024-09-18T02:06:09.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94451609687232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4f7d0 con 0x55e73aa40460 2024-09-18T02:06:09.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 20 add_watcher() i=0 2024-09-18T02:06:09.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 20 add_watcher() i=1 2024-09-18T02:06:09.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 20 add_watcher() i=2 2024-09-18T02:06:09.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 20 add_watcher() i=3 2024-09-18T02:06:09.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 20 add_watcher() i=4 2024-09-18T02:06:09.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 20 add_watcher() i=5 2024-09-18T02:06:09.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94451609691456] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.689 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 20 add_watcher() i=6 2024-09-18T02:06:09.690 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94451609687232] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 20 add_watcher() i=7 2024-09-18T02:06:09.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:09.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4f7d0 con 0x55e73aa3baa0 2024-09-18T02:06:09.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.691 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.687+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94451609695008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4f740 con 0x55e73aa3baa0 2024-09-18T02:06:09.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94451609695008] v32'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f02cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:09.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:09.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:09.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 5 note: GC not initialized 2024-09-18T02:06:09.693 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f02ccfe1640 20 reqs_thread_entry: start 2024-09-18T02:06:09.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:09.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 20 Filter name: none 2024-09-18T02:06:09.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f02467fc640 20 reqs_thread_entry: start 2024-09-18T02:06:09.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T02:06:09.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.694 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa75e30 con 0x55e73aa40460 2024-09-18T02:06:09.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 20 rados_obj.operate() r=0 bl.length=490 2024-09-18T02:06:09.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T02:06:09.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:09.695 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.691+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa7c760 con 0x55e73aa40460 2024-09-18T02:06:09.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f041a0cc980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:09.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f041a0cc980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f041a0cc980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T02:06:09.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94451609878992 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa77df0 con 0x55e73aa3baa0 2024-09-18T02:06:09.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== watch-notify(notify (1) cookie 94451609684992 notify 137438953498 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f0410010040 con 0x55e73aa3baa0 2024-09-18T02:06:09.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f02f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94451609684992 notifier 4893 bl.length()=679 2024-09-18T02:06:09.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f02f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:09.698 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f02f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 notify.4 [notify cookie 94451609878992 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f02f6ffd640 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f02dc003eb0 con 0x55e73aa3baa0 2024-09-18T02:06:09.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== watch-notify(notify_complete (2) cookie 94451609878992 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f041002b440 con 0x55e73aa3baa0 2024-09-18T02:06:09.699 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T02:06:08.069645Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.069630Z","tags":[],"group_ids":[]} 2024-09-18T02:06:09.699 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f02cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:09.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.695+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94451609695008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa73c30 con 0x55e73aa3baa0 2024-09-18T02:06:09.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.699+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94451609695008] v32'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.699+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94451609669824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa73c30 con 0x7f040c0db040 2024-09-18T02:06:09.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.699+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94451609669824] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.699+0000 7f041a0cc980 20 remove_watcher() i=0 2024-09-18T02:06:09.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.699+0000 7f041a0cc980 2 removed watcher, disabling cache 2024-09-18T02:06:09.701 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.699+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94451609674176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa73c30 con 0x55e73aa3baa0 2024-09-18T02:06:09.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.699+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94451609674176] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.699+0000 7f041a0cc980 20 remove_watcher() i=1 2024-09-18T02:06:09.703 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.699+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94451609667312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa73c30 con 0x55e73aa44dd0 2024-09-18T02:06:09.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.703+0000 7f04173db640 1 -- 172.21.15.167:0/1509374772 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94451609667312] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0cb070 con 0x55e73aa44dd0 2024-09-18T02:06:09.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.703+0000 7f041a0cc980 20 remove_watcher() i=2 2024-09-18T02:06:09.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.703+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94451609680592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa486f0 con 0x7f040c0db040 2024-09-18T02:06:09.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.703+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94451609680592] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x7f040c0db040 2024-09-18T02:06:09.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.703+0000 7f041a0cc980 20 remove_watcher() i=3 2024-09-18T02:06:09.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.703+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94451609684992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa73c30 con 0x55e73aa3baa0 2024-09-18T02:06:09.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.707+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94451609684992] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0410026040 con 0x55e73aa3baa0 2024-09-18T02:06:09.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.707+0000 7f041a0cc980 20 remove_watcher() i=4 2024-09-18T02:06:09.709 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.707+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94451609682656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa486f0 con 0x55e73aa40460 2024-09-18T02:06:09.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.707+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94451609682656] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.707+0000 7f041a0cc980 20 remove_watcher() i=5 2024-09-18T02:06:09.711 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.707+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94451609691456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa4cc00 con 0x55e73aa40460 2024-09-18T02:06:09.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94451609691456] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 20 remove_watcher() i=6 2024-09-18T02:06:09.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94451609687232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e73aa73c30 con 0x55e73aa40460 2024-09-18T02:06:09.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f0417bdc640 1 -- 172.21.15.167:0/1509374772 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94451609687232] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040803b070 con 0x55e73aa40460 2024-09-18T02:06:09.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 20 remove_watcher() i=7 2024-09-18T02:06:09.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e73aa40460 msgr2=0x55e73aa42850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e73aa40460 0x55e73aa42850 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e73aa3baa0 msgr2=0x55e73aa3df60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e73aa3baa0 0x55e73aa3df60 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f040c0db040 msgr2=0x7f040c0cd920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f040c0db040 0x7f040c0cd920 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e73aa44dd0 msgr2=0x55e73aa47220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e73aa44dd0 0x55e73aa47220 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f02e0034600 msgr2=0x7f02e0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f02e0034600 0x7f02e0036ac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f040c0ae040 tx=0x7f040c0a6000 comp rx=0 tx=0).stop 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 msgr2=0x55e73aa30930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 --2- 172.21.15.167:0/1509374772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa29730 0x55e73aa30930 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0408041670 tx=0x7f040802aef0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f04183dd640 1 -- 172.21.15.167:0/1509374772 reap_dead start 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 shutdown_connections 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 >> 172.21.15.167:0/1509374772 conn(0x55e73aa25b10 msgr2=0x55e73aa23be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 shutdown_connections 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/1509374772 wait complete. 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/3052064847 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f02f0034650 msgr2=0x7f02f0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 --2- 172.21.15.167:0/3052064847 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f02f0034650 0x7f02f0036b10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f040c000c10 tx=0x7f040c005a10 comp rx=0 tx=0).stop 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/3052064847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa1cc80 msgr2=0x55e73aa1d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 --2- 172.21.15.167:0/3052064847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa1cc80 0x55e73aa1d0a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f040801dfd0 tx=0x7f0408028bd0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/3052064847 shutdown_connections 2024-09-18T02:06:09.719 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 --2- 172.21.15.167:0/3052064847 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f02f0034650 0x7f02f0036b10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 --2- 172.21.15.167:0/3052064847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73aa1cc80 0x55e73aa1d0a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/3052064847 >> 172.21.15.167:0/3052064847 conn(0x55e73aa11dd0 msgr2=0x55e73aa14850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.711+0000 7f041a0cc980 1 -- 172.21.15.167:0/3052064847 shutdown_connections 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 -- 172.21.15.167:0/3052064847 wait complete. 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e73aa08770 msgr2=0x55e73aa0ab60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55e73aa08770 0x55e73aa0ab60 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e73a90ead0 msgr2=0x55e73aa05de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55e73a90ead0 0x55e73aa05de0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e73aa0c670 msgr2=0x55e73aa0ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55e73aa0c670 0x55e73aa0ea60 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0300034650 msgr2=0x7f0300036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.720 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f0300034650 0x7f0300036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f040c0ad000 tx=0x7f040c0a5040 comp rx=0 tx=0).stop 2024-09-18T02:06:09.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 msgr2=0x55e73a9fee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 --2- 172.21.15.167:0/480442757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e73a87f2a0 0x55e73a9fee10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f04080012f0 tx=0x7f0408001260 comp rx=0 tx=0).stop 2024-09-18T02:06:09.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f04183dd640 1 -- 172.21.15.167:0/480442757 reap_dead start 2024-09-18T02:06:09.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 shutdown_connections 2024-09-18T02:06:09.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 >> 172.21.15.167:0/480442757 conn(0x55e73a9050a0 msgr2=0x55e73a9f10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 shutdown_connections 2024-09-18T02:06:09.721 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.715+0000 7f041a0cc980 1 -- 172.21.15.167:0/480442757 wait complete. 2024-09-18T02:06:09.726 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:09.726 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:09.726 ERROR:root:0 2024-09-18T02:06:09.726 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:09.731 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:09.731 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-18T02:06:09.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-18T02:06:09.732 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-18T02:06:09.798 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:09.799 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:09.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.795+0000 7fddac58c980 1 Processor -- start 2024-09-18T02:06:09.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.795+0000 7fddac58c980 1 -- start start 2024-09-18T02:06:09.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.795+0000 7fddac58c980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x563d914672a0 0x563d914f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.795+0000 7fddac58c980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d9137aae0 con 0x563d914f58f0 2024-09-18T02:06:09.800 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.795+0000 7fddac58c980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x563d9139ee30 con 0x563d914672a0 2024-09-18T02:06:09.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.799+0000 7fddaa09c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x563d914672a0 0x563d914f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.799+0000 7fdda989b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x563d914f58f0 0x563d914f7ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33938/0 (socket says 172.21.15.167:33938) 2024-09-18T02:06:09.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.799+0000 7fdda989b640 1 -- 172.21.15.167:0/3865377810 learned_addr learned my addr 172.21.15.167:0/3865377810 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:09.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.799+0000 7fdda909a640 1 -- 172.21.15.167:0/3865377810 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130779706 0 0) 0x563d9137aae0 con 0x563d914f58f0 2024-09-18T02:06:09.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.799+0000 7fdda909a640 1 -- 172.21.15.167:0/3865377810 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd94001e20 con 0x563d914f58f0 2024-09-18T02:06:09.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.799+0000 7fddaa09c640 1 -- 172.21.15.167:0/3865377810 >> v1:172.21.15.81:6789/0 conn(0x563d914f58f0 legacy=0x563d914f7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.799+0000 7fddaa09c640 1 -- 172.21.15.167:0/3865377810 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d91467830 con 0x563d914672a0 2024-09-18T02:06:09.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.799+0000 7fddaa09c640 1 --2- 172.21.15.167:0/3865377810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d914f53b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fdda400a420 tx=0x7fdda401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53950692eb727bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.799+0000 7fdda909a640 1 -- 172.21.15.167:0/3865377810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40af070 con 0x563d914672a0 2024-09-18T02:06:09.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.799+0000 7fdda909a640 1 -- 172.21.15.167:0/3865377810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda40aa530 con 0x563d914672a0 2024-09-18T02:06:09.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.799+0000 7fdda909a640 1 -- 172.21.15.167:0/3865377810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40aa850 con 0x563d914672a0 2024-09-18T02:06:09.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.803+0000 7fddac58c980 1 -- 172.21.15.167:0/3865377810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 msgr2=0x563d914f53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.803+0000 7fddac58c980 1 --2- 172.21.15.167:0/3865377810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d914f53b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fdda400a420 tx=0x7fdda401afd0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.803+0000 7fddac58c980 1 -- 172.21.15.167:0/3865377810 shutdown_connections 2024-09-18T02:06:09.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.803+0000 7fddac58c980 1 --2- 172.21.15.167:0/3865377810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d914f53b0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.803+0000 7fddac58c980 1 -- 172.21.15.167:0/3865377810 >> 172.21.15.167:0/3865377810 conn(0x563d914ed0a0 msgr2=0x563d914ef4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.803+0000 7fddac58c980 1 -- 172.21.15.167:0/3865377810 shutdown_connections 2024-09-18T02:06:09.805 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.803+0000 7fddac58c980 1 -- 172.21.15.167:0/3865377810 wait complete. 2024-09-18T02:06:09.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 Processor -- start 2024-09-18T02:06:09.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 -- start start 2024-09-18T02:06:09.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d915dd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563d913a0200 con 0x563d914672a0 2024-09-18T02:06:09.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddaa09c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d915dd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddaa09c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d915dd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50768/0 (socket says 172.21.15.167:50768) 2024-09-18T02:06:09.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddaa09c640 1 -- 172.21.15.167:0/2839974671 learned_addr learned my addr 172.21.15.167:0/2839974671 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddaa09c640 1 -- 172.21.15.167:0/2839974671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d915ddee0 con 0x563d914672a0 2024-09-18T02:06:09.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddaa09c640 1 --2- 172.21.15.167:0/2839974671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d915dd910 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fdda400a420 tx=0x7fdda40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551e7463b05e2ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fdc98608640 1 -- 172.21.15.167:0/2839974671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40af050 con 0x563d914672a0 2024-09-18T02:06:09.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fdc98608640 1 -- 172.21.15.167:0/2839974671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda40b0040 con 0x563d914672a0 2024-09-18T02:06:09.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fdc98608640 1 -- 172.21.15.167:0/2839974671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40aab00 con 0x563d914672a0 2024-09-18T02:06:09.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 -- 172.21.15.167:0/2839974671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 msgr2=0x563d915dd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 --2- 172.21.15.167:0/2839974671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d915dd910 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fdda400a420 tx=0x7fdda40033b0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 -- 172.21.15.167:0/2839974671 shutdown_connections 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 --2- 172.21.15.167:0/2839974671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d915dd910 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 -- 172.21.15.167:0/2839974671 >> 172.21.15.167:0/2839974671 conn(0x563d914ed0a0 msgr2=0x563d915d9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 -- 172.21.15.167:0/2839974671 shutdown_connections 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 -- 172.21.15.167:0/2839974671 wait complete. 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 Processor -- start 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 -- start start 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d915e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.815+0000 7fddac58c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563d914f9f10 con 0x563d914672a0 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddaa09c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d915e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddaa09c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d915e4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50770/0 (socket says 172.21.15.167:50770) 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddaa09c640 1 -- 172.21.15.167:0/2613494760 learned_addr learned my addr 172.21.15.167:0/2613494760 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddaa09c640 1 -- 172.21.15.167:0/2613494760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d915e5000 con 0x563d914672a0 2024-09-18T02:06:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddaa09c640 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d915e4ac0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fdda4019680 tx=0x7fdda4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fdc96e05640 1 -- 172.21.15.167:0/2613494760 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40c5070 con 0x563d914672a0 2024-09-18T02:06:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d915e5290 con 0x563d914672a0 2024-09-18T02:06:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d915e7f70 con 0x563d914672a0 2024-09-18T02:06:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fdc96e05640 1 -- 172.21.15.167:0/2613494760 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda40b6b60 con 0x563d914672a0 2024-09-18T02:06:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fdc96e05640 1 -- 172.21.15.167:0/2613494760 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40ce060 con 0x563d914672a0 2024-09-18T02:06:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fdc96e05640 1 -- 172.21.15.167:0/2613494760 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdda40c1480 con 0x563d914672a0 2024-09-18T02:06:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fdc96e05640 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc900346a0 0x7fdc90036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fdc96e05640 1 -- 172.21.15.167:0/2613494760 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdda40bb070 con 0x563d914672a0 2024-09-18T02:06:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fdda989b640 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc900346a0 0x7fdc90036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddac58c980 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563d914f58f0 0x563d915ebbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d915ec100 con 0x563d914f58f0 2024-09-18T02:06:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddaa89d640 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563d914f58f0 0x563d915ebbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fdda989b640 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc900346a0 0x7fdc90036b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdda0001dc0 tx=0x7fdda0001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddaa89d640 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563d914f58f0 0x563d915ebbc0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddaa89d640 1 -- 172.21.15.167:0/2613494760 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd9c0083f0 con 0x563d914f58f0 2024-09-18T02:06:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.819+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d915e9170 con 0x563d914f58f0 2024-09-18T02:06:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddaa89d640 1 -- 172.21.15.167:0/2613494760 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd9c0083f0 con 0x563d914f58f0 2024-09-18T02:06:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddac58c980 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563d915ee3d0 0x563d915f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d915f0e90 con 0x563d915ee3d0 2024-09-18T02:06:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddaa09c640 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563d915ee3d0 0x563d915f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddaa09c640 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563d915ee3d0 0x563d915f07c0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddaa09c640 1 -- 172.21.15.167:0/2613494760 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdda40b2070 con 0x563d915ee3d0 2024-09-18T02:06:09.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d915ed240 con 0x563d914f58f0 2024-09-18T02:06:09.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddaa89d640 1 -- 172.21.15.167:0/2613494760 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd9c0083f0 con 0x563d914f58f0 2024-09-18T02:06:09.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddac58c980 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563d915f22d0 0x563d915f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d915f4e30 con 0x563d915f22d0 2024-09-18T02:06:09.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fdda989b640 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563d915f22d0 0x563d915f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fdda989b640 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563d915f22d0 0x563d915f46c0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fdda989b640 1 -- 172.21.15.167:0/2613494760 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d915f22d0 2024-09-18T02:06:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddac58c980 1 Processor -- start 2024-09-18T02:06:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddac58c980 1 -- start start 2024-09-18T02:06:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddac58c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d91602900 0x563d91602d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddac58c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563d913f9800 con 0x563d91602900 2024-09-18T02:06:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddaa09c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d91602900 0x563d91602d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddaa09c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d91602900 0x563d91602d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50782/0 (socket says 172.21.15.167:50782) 2024-09-18T02:06:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.823+0000 7fddaa09c640 1 -- 172.21.15.167:0/171319373 learned_addr learned my addr 172.21.15.167:0/171319373 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddaa09c640 1 -- 172.21.15.167:0/171319373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d91603260 con 0x563d91602900 2024-09-18T02:06:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddaa09c640 1 --2- 172.21.15.167:0/171319373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d91602900 0x563d91602d20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fdda40bf8b0 tx=0x7fdda40bf4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fdc8ffff640 1 -- 172.21.15.167:0/171319373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40bfc80 con 0x563d91602900 2024-09-18T02:06:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fdc8ffff640 1 -- 172.21.15.167:0/171319373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda40bfe20 con 0x563d91602900 2024-09-18T02:06:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddac58c980 1 -- 172.21.15.167:0/171319373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d91603490 con 0x563d91602900 2024-09-18T02:06:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fdc8ffff640 1 -- 172.21.15.167:0/171319373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40d2870 con 0x563d91602900 2024-09-18T02:06:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddac58c980 1 -- 172.21.15.167:0/171319373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d91603490 con 0x563d91602900 2024-09-18T02:06:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fdc8ffff640 1 -- 172.21.15.167:0/171319373 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdda40ee060 con 0x563d91602900 2024-09-18T02:06:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fdc8ffff640 1 --2- 172.21.15.167:0/171319373 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc84034650 0x7fdc84036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fdc8ffff640 1 -- 172.21.15.167:0/171319373 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdda40e1070 con 0x563d91602900 2024-09-18T02:06:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fdda989b640 1 --2- 172.21.15.167:0/171319373 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc84034650 0x7fdc84036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddac58c980 1 Processor -- start 2024-09-18T02:06:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddac58c980 1 -- start start 2024-09-18T02:06:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fdda989b640 1 --2- 172.21.15.167:0/171319373 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc84034650 0x7fdc84036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdda000bfe0 tx=0x7fdda000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddac58c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d914f1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddac58c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563d915de1a0 con 0x563d914f1370 2024-09-18T02:06:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddaa09c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d914f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddaa09c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d914f1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50800/0 (socket says 172.21.15.167:50800) 2024-09-18T02:06:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddaa09c640 1 -- 172.21.15.167:0/2600703390 learned_addr learned my addr 172.21.15.167:0/2600703390 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddaa09c640 1 -- 172.21.15.167:0/2600703390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d914f1d40 con 0x563d914f1370 2024-09-18T02:06:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fddaa09c640 1 --2- 172.21.15.167:0/2600703390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d914f1770 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fdda40d26b0 tx=0x7fdda40e6a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df827934633d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fdc8dffb640 1 -- 172.21.15.167:0/2600703390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40d3430 con 0x563d914f1370 2024-09-18T02:06:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fdc8dffb640 1 -- 172.21.15.167:0/2600703390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda40da5f0 con 0x563d914f1370 2024-09-18T02:06:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.827+0000 7fdc8dffb640 1 -- 172.21.15.167:0/2600703390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40c1770 con 0x563d914f1370 2024-09-18T02:06:09.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 -- 172.21.15.167:0/2600703390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 msgr2=0x563d914f1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 --2- 172.21.15.167:0/2600703390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d914f1770 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fdda40d26b0 tx=0x7fdda40e6a80 comp rx=0 tx=0).stop 2024-09-18T02:06:09.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 -- 172.21.15.167:0/2600703390 shutdown_connections 2024-09-18T02:06:09.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 --2- 172.21.15.167:0/2600703390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d914f1770 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 -- 172.21.15.167:0/2600703390 >> 172.21.15.167:0/2600703390 conn(0x563d9160b240 msgr2=0x563d91609340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 -- 172.21.15.167:0/2600703390 shutdown_connections 2024-09-18T02:06:09.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 -- 172.21.15.167:0/2600703390 wait complete. 2024-09-18T02:06:09.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 Processor -- start 2024-09-18T02:06:09.835 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 -- start start 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d91618310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563d914f2370 con 0x563d914f1370 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddaa09c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d91618310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddaa09c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d91618310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50814/0 (socket says 172.21.15.167:50814) 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 learned_addr learned my addr 172.21.15.167:0/1434195217 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d91618850 con 0x563d914f1370 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddaa09c640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d91618310 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fdda40d26b0 tx=0x7fdda40dc1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fdc7bfff640 1 -- 172.21.15.167:0/1434195217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40d3430 con 0x563d914f1370 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d91618850 con 0x563d914f1370 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fdc7bfff640 1 -- 172.21.15.167:0/1434195217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda40c3df0 con 0x563d914f1370 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fdc7bfff640 1 -- 172.21.15.167:0/1434195217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda40d35f0 con 0x563d914f1370 2024-09-18T02:06:09.836 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d91618850 con 0x563d914f1370 2024-09-18T02:06:09.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fdc7bfff640 1 -- 172.21.15.167:0/1434195217 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdda4100040 con 0x563d914f1370 2024-09-18T02:06:09.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fdc7bfff640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc74034650 0x7fdc74036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fdc7bfff640 1 -- 172.21.15.167:0/1434195217 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdda40fe020 con 0x563d914f1370 2024-09-18T02:06:09.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fdda989b640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc74034650 0x7fdc74036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563d91623310 0x563d916257d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.831+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d91625f20 con 0x563d91623310 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddaa89d640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563d91623310 0x563d916257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fdda989b640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc74034650 0x7fdc74036b10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x563d915ec5c0 tx=0x7fdda0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddaa89d640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563d91623310 0x563d916257d0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd9c0083f0 con 0x563d91623310 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 20 realm 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d91626330 con 0x563d91623310 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd9c0083f0 con 0x563d91623310 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d91626c00 con 0x563d91623310 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd9c0083f0 con 0x563d91623310 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91623310 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd9c0083f0 con 0x563d91623310 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563d91627d00 0x563d9162a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d9162a6b0 con 0x563d91627d00 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddaa09c640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563d91627d00 0x563d9162a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddaa09c640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563d91627d00 0x563d9162a0f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:09.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 20 searching for the correct realm 2024-09-18T02:06:09.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563d9162c600 0x563d9162ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d9162f0e0 con 0x563d9162c600 2024-09-18T02:06:09.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fdda989b640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563d9162c600 0x563d9162ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fdda989b640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563d9162c600 0x563d9162ea10 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fdda989b640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fdda0037040 0x7fdda0036920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.835+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d9162f0e0 con 0x7fdda0037040 2024-09-18T02:06:09.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fdda0037040 0x7fdda0036920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.843 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fdda0037040 0x7fdda0036920 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c0083f0 con 0x7fdda0037040 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x7fdda0037040 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c0083f0 con 0x7fdda0037040 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91623310 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91623310 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91623310 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91627d00 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x7fdda0037040 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d9162c600 2024-09-18T02:06:09.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91623310 2024-09-18T02:06:09.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x7fdda0037040 2024-09-18T02:06:09.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91623310 2024-09-18T02:06:09.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x7fdda0037040 2024-09-18T02:06:09.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d9162c600 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.839+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d9162c600 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91627d00 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d9162c600 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d9162c600 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91623310 2024-09-18T02:06:09.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91623310 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91627d00 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d9162c600 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x7fdda0037040 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91623310 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91627d00 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d9162c600 2024-09-18T02:06:09.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.843+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91627d00 2024-09-18T02:06:09.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x7fdda0037040 2024-09-18T02:06:09.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d9162c600 2024-09-18T02:06:09.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91627d00 2024-09-18T02:06:09.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x563d91623310 2024-09-18T02:06:09.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563d91626fa0 con 0x7fdda0037040 2024-09-18T02:06:09.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.857 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:09.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:09.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:09.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:09.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:09.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:09.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d9162af70 con 0x563d91623310 2024-09-18T02:06:09.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d9162af70 con 0x563d91623310 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d9162af70 con 0x563d9162c600 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 zone default found 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 4 Realm: () 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 zonegroup default 2024-09-18T02:06:09.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d9162b940 con 0x563d91627d00 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d9162b4a0 con 0x563d9162c600 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.847+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d91631490 con 0x563d9162c600 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fddac58c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fddac58c980 20 started sync module instance, tier type = 2024-09-18T02:06:09.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fddac58c980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:09.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91630880 con 0x7fdda0037040 2024-09-18T02:06:09.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94822432181632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91630880 con 0x7fdda0037040 2024-09-18T02:06:09.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91631f50 con 0x563d91623310 2024-09-18T02:06:09.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94822432181632] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94822432184928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91630880 con 0x563d91623310 2024-09-18T02:06:09.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.851+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91632960 con 0x563d9162c600 2024-09-18T02:06:09.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.855+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94822432184928] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.855+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.855+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94822432179152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d916307f0 con 0x563d9162c600 2024-09-18T02:06:09.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.855+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d916336f0 con 0x7fdda0037040 2024-09-18T02:06:09.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.855+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.855+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94822432190976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91633fc0 con 0x7fdda0037040 2024-09-18T02:06:09.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.855+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91634980 con 0x563d91623310 2024-09-18T02:06:09.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.859+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94822432179152] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.859+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94822432190976] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.859+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.859+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94822432195792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d916348f0 con 0x563d91623310 2024-09-18T02:06:09.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.859+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91633f10 con 0x563d91627d00 2024-09-18T02:06:09.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.859+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94822432195792] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.859+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.859+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94822432193120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91635220 con 0x563d91627d00 2024-09-18T02:06:09.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.859+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91635a70 con 0x563d91627d00 2024-09-18T02:06:09.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94822432193120] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94822432198000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d916362c0 con 0x563d91627d00 2024-09-18T02:06:09.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91636c80 con 0x563d91627d00 2024-09-18T02:06:09.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94822432204752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d916370a0 con 0x563d91627d00 2024-09-18T02:06:09.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddac58c980 20 add_watcher() i=0 2024-09-18T02:06:09.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddac58c980 20 add_watcher() i=1 2024-09-18T02:06:09.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddac58c980 20 add_watcher() i=2 2024-09-18T02:06:09.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddac58c980 20 add_watcher() i=3 2024-09-18T02:06:09.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddac58c980 20 add_watcher() i=4 2024-09-18T02:06:09.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.863+0000 7fddac58c980 20 add_watcher() i=5 2024-09-18T02:06:09.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94822432198000] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 20 add_watcher() i=6 2024-09-18T02:06:09.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94822432204752] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 20 add_watcher() i=7 2024-09-18T02:06:09.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:09.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d91635e10 con 0x563d91623310 2024-09-18T02:06:09.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94822432205808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91635e10 con 0x563d91623310 2024-09-18T02:06:09.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94822432205808] v32'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fdc60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:09.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:09.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:09.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 5 note: GC not initialized 2024-09-18T02:06:09.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fdbdb7fe640 20 reqs_thread_entry: start 2024-09-18T02:06:09.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:09.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 20 Filter name: none 2024-09-18T02:06:09.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fdbd97fa640 20 reqs_thread_entry: start 2024-09-18T02:06:09.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T02:06:09.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 20 rados->read ofs=0 len=0 2024-09-18T02:06:09.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.867+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d9165d700 con 0x563d91627d00 2024-09-18T02:06:09.873 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.871+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.871+0000 7fddac58c980 20 rados_obj.operate() r=0 bl.length=503 2024-09-18T02:06:09.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.871+0000 7fddac58c980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T02:06:09.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.871+0000 7fddac58c980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.871+0000 7fddac58c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:09.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.871+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d916640c0 con 0x563d91627d00 2024-09-18T02:06:09.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddac58c980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:09.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddac58c980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddac58c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T02:06:09.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94822432389936 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563d9165f7b0 con 0x563d91623310 2024-09-18T02:06:09.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== watch-notify(notify (1) cookie 94822432195792 notify 137438953499 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fdd9c010040 con 0x563d91623310 2024-09-18T02:06:09.877 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fdc8dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94822432195792 notifier 4900 bl.length()=636 2024-09-18T02:06:09.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fdc8dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:09.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fdc8dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:09.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 notify.4 [notify cookie 94822432389936 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fdc8dffb640 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fdc70003eb0 con 0x563d91623310 2024-09-18T02:06:09.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== watch-notify(notify_complete (2) cookie 94822432389936 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdd9c02b440 con 0x563d91623310 2024-09-18T02:06:09.878 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T02:06:08.069645Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.069630Z","tags":[],"group_ids":[]} 2024-09-18T02:06:09.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fdc60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:09.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94822432205808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d9165b4f0 con 0x563d91623310 2024-09-18T02:06:09.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94822432205808] v32'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.875+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94822432181632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d9165b4f0 con 0x7fdda0037040 2024-09-18T02:06:09.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.879+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94822432181632] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.879+0000 7fddac58c980 20 remove_watcher() i=0 2024-09-18T02:06:09.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.879+0000 7fddac58c980 2 removed watcher, disabling cache 2024-09-18T02:06:09.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.879+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94822432184928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d9165b4f0 con 0x563d91623310 2024-09-18T02:06:09.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.879+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94822432184928] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.879+0000 7fddac58c980 20 remove_watcher() i=1 2024-09-18T02:06:09.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.879+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94822432179152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91631a60 con 0x563d9162c600 2024-09-18T02:06:09.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.883+0000 7fdda989b640 1 -- 172.21.15.167:0/1434195217 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94822432179152] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda000e6e0 con 0x563d9162c600 2024-09-18T02:06:09.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.883+0000 7fddac58c980 20 remove_watcher() i=2 2024-09-18T02:06:09.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.883+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94822432190976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d9165b4f0 con 0x7fdda0037040 2024-09-18T02:06:09.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.883+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94822432190976] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x7fdda0037040 2024-09-18T02:06:09.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.883+0000 7fddac58c980 20 remove_watcher() i=3 2024-09-18T02:06:09.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.883+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94822432195792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d916303d0 con 0x563d91623310 2024-09-18T02:06:09.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.883+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94822432195792] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c026040 con 0x563d91623310 2024-09-18T02:06:09.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.883+0000 7fddac58c980 20 remove_watcher() i=4 2024-09-18T02:06:09.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.883+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94822432193120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d91631a60 con 0x563d91627d00 2024-09-18T02:06:09.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.887+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94822432193120] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.887+0000 7fddac58c980 20 remove_watcher() i=5 2024-09-18T02:06:09.890 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.887+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94822432198000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d9165b4f0 con 0x563d91627d00 2024-09-18T02:06:09.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.887+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94822432198000] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 20 remove_watcher() i=6 2024-09-18T02:06:09.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94822432204752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563d916344d0 con 0x563d91627d00 2024-09-18T02:06:09.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddaa09c640 1 -- 172.21.15.167:0/1434195217 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94822432204752] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda40b2070 con 0x563d91627d00 2024-09-18T02:06:09.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 20 remove_watcher() i=7 2024-09-18T02:06:09.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563d91627d00 msgr2=0x563d9162a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563d91627d00 0x563d9162a0f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563d91623310 msgr2=0x563d916257d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563d91623310 0x563d916257d0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fdda0037040 msgr2=0x7fdda0036920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fdda0037040 0x7fdda0036920 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563d9162c600 msgr2=0x563d9162ea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563d9162c600 0x563d9162ea10 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc74034650 msgr2=0x7fdc74036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc74034650 0x7fdc74036b10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x563d915ec5c0 tx=0x7fdda0010000 comp rx=0 tx=0).stop 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 msgr2=0x563d91618310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddaa89d640 1 -- 172.21.15.167:0/1434195217 reap_dead start 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d91618310 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fdda40d26b0 tx=0x7fdda40dc1c0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 shutdown_connections 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/1434195217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914f1370 0x563d91618310 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 >> 172.21.15.167:0/1434195217 conn(0x563d9160b240 msgr2=0x563d91609310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 shutdown_connections 2024-09-18T02:06:09.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/1434195217 wait complete. 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/171319373 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc84034650 msgr2=0x7fdc84036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/171319373 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc84034650 0x7fdc84036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdda000bfe0 tx=0x7fdda000f000 comp rx=0 tx=0).stop 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/171319373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d91602900 msgr2=0x563d91602d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/171319373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d91602900 0x563d91602d20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fdda40bf8b0 tx=0x7fdda40bf4b0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/171319373 shutdown_connections 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/171319373 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc84034650 0x7fdc84036b10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/171319373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d91602900 0x563d91602d20 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/171319373 >> 172.21.15.167:0/171319373 conn(0x563d915f7a50 msgr2=0x563d915fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/171319373 shutdown_connections 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/171319373 wait complete. 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563d915ee3d0 msgr2=0x563d915f07c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x563d915ee3d0 0x563d915f07c0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563d914f58f0 msgr2=0x563d915ebbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x563d914f58f0 0x563d915ebbc0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563d915f22d0 msgr2=0x563d915f46c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x563d915f22d0 0x563d915f46c0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc900346a0 msgr2=0x7fdc90036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fdc900346a0 0x7fdc90036b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdda0001dc0 tx=0x7fdda0001360 comp rx=0 tx=0).stop 2024-09-18T02:06:09.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 msgr2=0x563d915e4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 --2- 172.21.15.167:0/2613494760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d914672a0 0x563d915e4ac0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fdda4019680 tx=0x7fdda4019810 comp rx=0 tx=0).stop 2024-09-18T02:06:09.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddaa89d640 1 -- 172.21.15.167:0/2613494760 reap_dead start 2024-09-18T02:06:09.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 shutdown_connections 2024-09-18T02:06:09.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 >> 172.21.15.167:0/2613494760 conn(0x563d914ed0a0 msgr2=0x563d915d80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 shutdown_connections 2024-09-18T02:06:09.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.891+0000 7fddac58c980 1 -- 172.21.15.167:0/2613494760 wait complete. 2024-09-18T02:06:09.905 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:09.905 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:09.905 ERROR:root:0 2024-09-18T02:06:09.905 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T02:06:09.905 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T02:06:09.905 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-18T02:06:09.977 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:09.977 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:09.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.975+0000 7fed924a3980 1 Processor -- start 2024-09-18T02:06:09.978 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.975+0000 7fed924a3980 1 -- start start 2024-09-18T02:06:09.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.975+0000 7fed924a3980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x565238bda580 0x565238bda960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.975+0000 7fed924a3980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565238a63ae0 con 0x565238bdaed0 2024-09-18T02:06:09.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.975+0000 7fed924a3980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x565238a87e30 con 0x565238bda580 2024-09-18T02:06:09.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.975+0000 7fed8ffb3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x565238bda580 0x565238bda960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.979 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.975+0000 7fed8ffb3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x565238bda580 0x565238bda960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50828/0 (socket says 172.21.15.167:50828) 2024-09-18T02:06:09.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.975+0000 7fed8ffb3640 1 -- 172.21.15.167:0/2735951518 learned_addr learned my addr 172.21.15.167:0/2735951518 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.975+0000 7fed8ffb3640 1 -- 172.21.15.167:0/2735951518 >> v1:172.21.15.81:6789/0 conn(0x565238bdaed0 legacy=0x565238bdf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.980 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.975+0000 7fed8ffb3640 1 -- 172.21.15.167:0/2735951518 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565238be2150 con 0x565238bda580 2024-09-18T02:06:09.981 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.979+0000 7fed8ffb3640 1 --2- 172.21.15.167:0/2735951518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238bda960 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fed8800a4e0 tx=0x7fed8801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29291c01ef72c74 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.979+0000 7fed8efb1640 1 -- 172.21.15.167:0/2735951518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880aa540 con 0x565238bda580 2024-09-18T02:06:09.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.979+0000 7fed8efb1640 1 -- 172.21.15.167:0/2735951518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed880aa6e0 con 0x565238bda580 2024-09-18T02:06:09.982 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.979+0000 7fed8efb1640 1 -- 172.21.15.167:0/2735951518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880aaa40 con 0x565238bda580 2024-09-18T02:06:09.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.979+0000 7fed924a3980 1 -- 172.21.15.167:0/2735951518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 msgr2=0x565238bda960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.979+0000 7fed924a3980 1 --2- 172.21.15.167:0/2735951518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238bda960 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fed8800a4e0 tx=0x7fed8801b090 comp rx=0 tx=0).stop 2024-09-18T02:06:09.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.979+0000 7fed924a3980 1 -- 172.21.15.167:0/2735951518 shutdown_connections 2024-09-18T02:06:09.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.979+0000 7fed924a3980 1 --2- 172.21.15.167:0/2735951518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238bda960 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.979+0000 7fed924a3980 1 -- 172.21.15.167:0/2735951518 >> 172.21.15.167:0/2735951518 conn(0x565238bd60a0 msgr2=0x565238bd84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:09.983 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.979+0000 7fed924a3980 1 -- 172.21.15.167:0/2735951518 shutdown_connections 2024-09-18T02:06:09.984 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.979+0000 7fed924a3980 1 -- 172.21.15.167:0/2735951518 wait complete. 2024-09-18T02:06:09.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.991+0000 7fed924a3980 1 Processor -- start 2024-09-18T02:06:09.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.991+0000 7fed924a3980 1 -- start start 2024-09-18T02:06:09.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.991+0000 7fed924a3980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238cc59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:09.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x565238a89200 con 0x565238bda580 2024-09-18T02:06:09.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed8ffb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238cc59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:09.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed8ffb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238cc59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50844/0 (socket says 172.21.15.167:50844) 2024-09-18T02:06:09.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4181112468 learned_addr learned my addr 172.21.15.167:0/4181112468 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:09.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4181112468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565238cc5f70 con 0x565238bda580 2024-09-18T02:06:09.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed8ffb3640 1 --2- 172.21.15.167:0/4181112468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238cc59a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fed88017ca0 tx=0x7fed880033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c621ea8ca0e6b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:09.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fec7de0b640 1 -- 172.21.15.167:0/4181112468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880b9070 con 0x565238bda580 2024-09-18T02:06:09.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fec7de0b640 1 -- 172.21.15.167:0/4181112468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed880aaa80 con 0x565238bda580 2024-09-18T02:06:09.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fec7de0b640 1 -- 172.21.15.167:0/4181112468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880aad60 con 0x565238bda580 2024-09-18T02:06:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 -- 172.21.15.167:0/4181112468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 msgr2=0x565238cc59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 --2- 172.21.15.167:0/4181112468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238cc59a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fed88017ca0 tx=0x7fed880033b0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 -- 172.21.15.167:0/4181112468 shutdown_connections 2024-09-18T02:06:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 --2- 172.21.15.167:0/4181112468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238cc59a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 -- 172.21.15.167:0/4181112468 >> 172.21.15.167:0/4181112468 conn(0x565238bd60a0 msgr2=0x565238cc15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 -- 172.21.15.167:0/4181112468 shutdown_connections 2024-09-18T02:06:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 -- 172.21.15.167:0/4181112468 wait complete. 2024-09-18T02:06:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 Processor -- start 2024-09-18T02:06:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 -- start start 2024-09-18T02:06:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238cccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed924a3980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x565238be1b90 con 0x565238bda580 2024-09-18T02:06:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed8ffb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238cccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed8ffb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238cccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50848/0 (socket says 172.21.15.167:50848) 2024-09-18T02:06:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed8ffb3640 1 -- 172.21.15.167:0/3205613129 learned_addr learned my addr 172.21.15.167:0/3205613129 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.995+0000 7fed8ffb3640 1 -- 172.21.15.167:0/3205613129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565238ccd080 con 0x565238bda580 2024-09-18T02:06:10.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed8ffb3640 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238cccb40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fed8801aec0 tx=0x7fed88017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fec77fff640 1 -- 172.21.15.167:0/3205613129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880cc070 con 0x565238bda580 2024-09-18T02:06:10.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565238ccd310 con 0x565238bda580 2024-09-18T02:06:10.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565238ccfff0 con 0x565238bda580 2024-09-18T02:06:10.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fec77fff640 1 -- 172.21.15.167:0/3205613129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed880c7410 con 0x565238bda580 2024-09-18T02:06:10.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fec77fff640 1 -- 172.21.15.167:0/3205613129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880b9070 con 0x565238bda580 2024-09-18T02:06:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fec77fff640 1 -- 172.21.15.167:0/3205613129 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fed880b3040 con 0x565238bda580 2024-09-18T02:06:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fec77fff640 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec78034650 0x7fec78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fec77fff640 1 -- 172.21.15.167:0/3205613129 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fed880c4070 con 0x565238bda580 2024-09-18T02:06:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed8f7b2640 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec78034650 0x7fec78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed924a3980 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x565238bdaed0 0x565238cd3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238cd4180 con 0x565238bdaed0 2024-09-18T02:06:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed907b4640 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x565238bdaed0 0x565238cd3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed8f7b2640 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec78034650 0x7fec78036b10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fed84000f70 tx=0x7fed84001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed907b4640 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x565238bdaed0 0x565238cd3c40 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed907b4640 1 -- 172.21.15.167:0/3205613129 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238bdaed0 2024-09-18T02:06:10.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238cd4a60 con 0x565238bdaed0 2024-09-18T02:06:10.004 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed907b4640 1 -- 172.21.15.167:0/3205613129 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed800083f0 con 0x565238bdaed0 2024-09-18T02:06:10.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed924a3980 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x565238cd63b0 0x565238cd8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:09.999+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238cd8fd0 con 0x565238cd63b0 2024-09-18T02:06:10.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed8ffb3640 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x565238cd63b0 0x565238cd8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.005 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed8ffb3640 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x565238cd63b0 0x565238cd8840 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed8ffb3640 1 -- 172.21.15.167:0/3205613129 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fed880c7c10 con 0x565238cd63b0 2024-09-18T02:06:10.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238cd52b0 con 0x565238bdaed0 2024-09-18T02:06:10.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed907b4640 1 -- 172.21.15.167:0/3205613129 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed800083f0 con 0x565238bdaed0 2024-09-18T02:06:10.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed924a3980 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x565238cda430 0x565238cdc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238cdcf60 con 0x565238cda430 2024-09-18T02:06:10.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed8f7b2640 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x565238cda430 0x565238cdc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.006 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed8f7b2640 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x565238cda430 0x565238cdc820 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed8f7b2640 1 -- 172.21.15.167:0/3205613129 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fed8400d040 con 0x565238cda430 2024-09-18T02:06:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed924a3980 1 Processor -- start 2024-09-18T02:06:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed924a3980 1 -- start start 2024-09-18T02:06:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed924a3980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238b50560 0x565238cee750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed924a3980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x565238ae2800 con 0x565238b50560 2024-09-18T02:06:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed8ffb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238b50560 0x565238cee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed8ffb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238b50560 0x565238cee750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50850/0 (socket says 172.21.15.167:50850) 2024-09-18T02:06:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed8ffb3640 1 -- 172.21.15.167:0/1368036601 learned_addr learned my addr 172.21.15.167:0/1368036601 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.003+0000 7fed8ffb3640 1 -- 172.21.15.167:0/1368036601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565238ceec90 con 0x565238b50560 2024-09-18T02:06:10.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed8ffb3640 1 --2- 172.21.15.167:0/1368036601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238b50560 0x565238cee750 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fed880e2ef0 tx=0x7fed880c79e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fec757fa640 1 -- 172.21.15.167:0/1368036601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880e8020 con 0x565238b50560 2024-09-18T02:06:10.009 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fec757fa640 1 -- 172.21.15.167:0/1368036601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed880a9e60 con 0x565238b50560 2024-09-18T02:06:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 -- 172.21.15.167:0/1368036601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565238ceeec0 con 0x565238b50560 2024-09-18T02:06:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fec757fa640 1 -- 172.21.15.167:0/1368036601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880a9530 con 0x565238b50560 2024-09-18T02:06:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 -- 172.21.15.167:0/1368036601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565238cef390 con 0x565238b50560 2024-09-18T02:06:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fec757fa640 1 -- 172.21.15.167:0/1368036601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fed880a96d0 con 0x565238b50560 2024-09-18T02:06:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fec757fa640 1 --2- 172.21.15.167:0/1368036601 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec68034650 0x7fec68036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fec757fa640 1 -- 172.21.15.167:0/1368036601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fed880e1050 con 0x565238b50560 2024-09-18T02:06:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed8f7b2640 1 --2- 172.21.15.167:0/1368036601 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec68034650 0x7fec68036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 Processor -- start 2024-09-18T02:06:10.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 -- start start 2024-09-18T02:06:10.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed8f7b2640 1 --2- 172.21.15.167:0/1368036601 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec68034650 0x7fec68036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x565238cd1370 tx=0x7fed84006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238ceaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x565238cc6230 con 0x565238cea710 2024-09-18T02:06:10.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed8ffb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238ceaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed8ffb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238ceaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50868/0 (socket says 172.21.15.167:50868) 2024-09-18T02:06:10.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed8ffb3640 1 -- 172.21.15.167:0/203428139 learned_addr learned my addr 172.21.15.167:0/203428139 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed8ffb3640 1 -- 172.21.15.167:0/203428139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565238ceb0c0 con 0x565238cea710 2024-09-18T02:06:10.013 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed8ffb3640 1 --2- 172.21.15.167:0/203428139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238ceaaf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fed880e7ff0 tx=0x7fed880b4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4b74f1b6ab145c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fec6effd640 1 -- 172.21.15.167:0/203428139 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880fd070 con 0x565238cea710 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fec6effd640 1 -- 172.21.15.167:0/203428139 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed880e4140 con 0x565238cea710 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fec6effd640 1 -- 172.21.15.167:0/203428139 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed88004610 con 0x565238cea710 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 -- 172.21.15.167:0/203428139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 msgr2=0x565238ceaaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 --2- 172.21.15.167:0/203428139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238ceaaf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fed880e7ff0 tx=0x7fed880b4f90 comp rx=0 tx=0).stop 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 -- 172.21.15.167:0/203428139 shutdown_connections 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 --2- 172.21.15.167:0/203428139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238ceaaf0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 -- 172.21.15.167:0/203428139 >> 172.21.15.167:0/203428139 conn(0x565238cf4840 msgr2=0x565238cf2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 -- 172.21.15.167:0/203428139 shutdown_connections 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.007+0000 7fed924a3980 1 -- 172.21.15.167:0/203428139 wait complete. 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 1 Processor -- start 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 1 -- start start 2024-09-18T02:06:10.014 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238d01860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x565238ceb710 con 0x565238cea710 2024-09-18T02:06:10.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed8ffb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238d01860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed8ffb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238d01860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50874/0 (socket says 172.21.15.167:50874) 2024-09-18T02:06:10.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 learned_addr learned my addr 172.21.15.167:0/4201718795 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565238d01da0 con 0x565238cea710 2024-09-18T02:06:10.015 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed8ffb3640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238d01860 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fed8801b0b0 tx=0x7fed880d1f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fec6d7fa640 1 -- 172.21.15.167:0/4201718795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880e1250 con 0x565238cea710 2024-09-18T02:06:10.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565238d01da0 con 0x565238cea710 2024-09-18T02:06:10.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fec6d7fa640 1 -- 172.21.15.167:0/4201718795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed880bc7a0 con 0x565238cea710 2024-09-18T02:06:10.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fec6d7fa640 1 -- 172.21.15.167:0/4201718795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880e3220 con 0x565238cea710 2024-09-18T02:06:10.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565238d01da0 con 0x565238cea710 2024-09-18T02:06:10.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fec6d7fa640 1 -- 172.21.15.167:0/4201718795 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fed88100070 con 0x565238cea710 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fec6d7fa640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec58034650 0x7fec58036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fec6d7fa640 1 -- 172.21.15.167:0/4201718795 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fed8810a070 con 0x565238cea710 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed8f7b2640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec58034650 0x7fec58036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x565238d0c890 0x565238d0ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d0f4a0 con 0x565238d0c890 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed8f7b2640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec58034650 0x7fec58036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fed84010fd0 tx=0x7fed84011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed907b4640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x565238d0c890 0x565238d0ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed907b4640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x565238d0c890 0x565238d0ed50 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 20 realm 2024-09-18T02:06:10.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d0f8b0 con 0x565238d0c890 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.011+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d10180 con 0x565238d0c890 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed924a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d0c890 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed924a3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:10.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed924a3980 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x565238d11280 0x565238d13670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d13c40 con 0x565238d11280 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed8ffb3640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x565238d11280 0x565238d13670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed8ffb3640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x565238d11280 0x565238d13670 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed924a3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed924a3980 20 searching for the correct realm 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed924a3980 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x565238d15b90 0x565238d17fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d18690 con 0x565238d15b90 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed8f7b2640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x565238d15b90 0x565238d17fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed8f7b2640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x565238d15b90 0x565238d17fc0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed8f7b2640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fed8400f3d0 0x7fed8400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d18690 con 0x7fed8400f3d0 2024-09-18T02:06:10.023 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed907b4640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fed8400f3d0 0x7fed8400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed907b4640 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fed8400f3d0 0x7fed8400f7f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.032 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.015+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x7fed8400f3d0 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d0c890 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d0c890 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d0c890 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d11280 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x7fed8400f3d0 2024-09-18T02:06:10.033 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d15b90 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d0c890 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x7fed8400f3d0 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d0c890 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x7fed8400f3d0 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d15b90 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.034 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d15b90 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.019+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d11280 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d15b90 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d15b90 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d0c890 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d0c890 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.035 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d11280 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d15b90 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x7fed8400f3d0 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d0c890 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d11280 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d15b90 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d11280 2024-09-18T02:06:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.023+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x7fed8400f3d0 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d15b90 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d11280 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x565238d0c890 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565238d10520 con 0x7fed8400f3d0 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d14500 con 0x565238d0c890 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d14500 con 0x565238d0c890 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d14500 con 0x565238d15b90 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 zone default found 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 4 Realm: () 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 zonegroup default 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d14f20 con 0x565238d11280 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d1a9a0 con 0x565238d15b90 2024-09-18T02:06:10.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d1ad40 con 0x565238d15b90 2024-09-18T02:06:10.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 started sync module instance, tier type = 2024-09-18T02:06:10.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:10.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.027+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d19de0 con 0x7fed8400f3d0 2024-09-18T02:06:10.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.031+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.031+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94911140569600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d19de0 con 0x7fed8400f3d0 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.031+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1b590 con 0x565238d0c890 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.031+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94911140569600] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.031+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.031+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94911140573680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d19de0 con 0x565238d0c890 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.031+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1bfa0 con 0x565238d15b90 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.035+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94911140573680] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.035+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.035+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94911140567344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d19d50 con 0x565238d15b90 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.035+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1cca0 con 0x7fed8400f3d0 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.035+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.035+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94911140579312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1d0c0 con 0x7fed8400f3d0 2024-09-18T02:06:10.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.035+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1db80 con 0x565238d0c890 2024-09-18T02:06:10.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.035+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94911140567344] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.039+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94911140579312] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.039+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.039+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94911140582992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1cc10 con 0x565238d0c890 2024-09-18T02:06:10.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.039+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1e420 con 0x565238d11280 2024-09-18T02:06:10.044 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.039+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94911140582992] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.039+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.039+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94911140585328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1cc10 con 0x565238d11280 2024-09-18T02:06:10.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.039+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1ec70 con 0x565238d11280 2024-09-18T02:06:10.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94911140585328] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94911140589584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1f8e0 con 0x565238d11280 2024-09-18T02:06:10.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1c340 con 0x565238d11280 2024-09-18T02:06:10.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94911140589584] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94911140590640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1f850 con 0x565238d11280 2024-09-18T02:06:10.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed924a3980 20 add_watcher() i=0 2024-09-18T02:06:10.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed924a3980 20 add_watcher() i=1 2024-09-18T02:06:10.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed924a3980 20 add_watcher() i=2 2024-09-18T02:06:10.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed924a3980 20 add_watcher() i=3 2024-09-18T02:06:10.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed924a3980 20 add_watcher() i=4 2024-09-18T02:06:10.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed924a3980 20 add_watcher() i=5 2024-09-18T02:06:10.049 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.043+0000 7fed924a3980 20 add_watcher() i=6 2024-09-18T02:06:10.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94911140590640] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 20 add_watcher() i=7 2024-09-18T02:06:10.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:10.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d232d0 con 0x565238d0c890 2024-09-18T02:06:10.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.050 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94911140593136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d20730 con 0x565238d0c890 2024-09-18T02:06:10.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94911140593136] v32'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fec45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:10.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:10.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:10.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 5 note: GC not initialized 2024-09-18T02:06:10.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fec44fe1640 20 reqs_thread_entry: start 2024-09-18T02:06:10.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:10.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 20 Filter name: none 2024-09-18T02:06:10.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7febbe7fc640 20 reqs_thread_entry: start 2024-09-18T02:06:10.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T02:06:10.052 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.047+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d468c0 con 0x565238d11280 2024-09-18T02:06:10.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.051+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.051+0000 7fed924a3980 20 rados_obj.operate() r=0 bl.length=460 2024-09-18T02:06:10.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.051+0000 7fed924a3980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T02:06:10.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.051+0000 7fed924a3980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.053 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.051+0000 7fed924a3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:10.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.051+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d4cef0 con 0x565238d11280 2024-09-18T02:06:10.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed924a3980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:10.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed924a3980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed924a3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T02:06:10.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94911140776288 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565238d485e0 con 0x565238d0c890 2024-09-18T02:06:10.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== watch-notify(notify (1) cookie 94911140582992 notify 137438953500 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fed80010040 con 0x565238d0c890 2024-09-18T02:06:10.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fec6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94911140582992 notifier 4907 bl.length()=666 2024-09-18T02:06:10.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fec6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:10.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fec6effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 notify.4 [notify cookie 94911140776288 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fec6effd640 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fec54003eb0 con 0x565238d0c890 2024-09-18T02:06:10.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== watch-notify(notify_complete (2) cookie 94911140776288 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fed8000ab50 con 0x565238d0c890 2024-09-18T02:06:10.058 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T02:06:08.069645Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.069630Z","tags":[],"group_ids":[]} 2024-09-18T02:06:10.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fec45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:10.058 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94911140593136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d446c0 con 0x565238d0c890 2024-09-18T02:06:10.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94911140593136] v32'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.059 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94911140569600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d446c0 con 0x7fed8400f3d0 2024-09-18T02:06:10.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94911140569600] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed924a3980 20 remove_watcher() i=0 2024-09-18T02:06:10.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed924a3980 2 removed watcher, disabling cache 2024-09-18T02:06:10.060 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.055+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94911140573680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d446c0 con 0x565238d0c890 2024-09-18T02:06:10.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.059+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94911140573680] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.059+0000 7fed924a3980 20 remove_watcher() i=1 2024-09-18T02:06:10.062 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.059+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94911140567344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d446c0 con 0x565238d15b90 2024-09-18T02:06:10.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.059+0000 7fed8f7b2640 1 -- 172.21.15.167:0/4201718795 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94911140567344] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed84036040 con 0x565238d15b90 2024-09-18T02:06:10.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.059+0000 7fed924a3980 20 remove_watcher() i=2 2024-09-18T02:06:10.064 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.059+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94911140579312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d19930 con 0x7fed8400f3d0 2024-09-18T02:06:10.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.063+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94911140579312] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x7fed8400f3d0 2024-09-18T02:06:10.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.063+0000 7fed924a3980 20 remove_watcher() i=3 2024-09-18T02:06:10.065 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.063+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94911140582992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d446c0 con 0x565238d0c890 2024-09-18T02:06:10.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.063+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94911140582992] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed800083f0 con 0x565238d0c890 2024-09-18T02:06:10.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.063+0000 7fed924a3980 20 remove_watcher() i=4 2024-09-18T02:06:10.067 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.063+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94911140585328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d1c7f0 con 0x565238d11280 2024-09-18T02:06:10.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.067+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94911140585328] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.069 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.067+0000 7fed924a3980 20 remove_watcher() i=5 2024-09-18T02:06:10.070 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.067+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94911140589584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d19930 con 0x565238d11280 2024-09-18T02:06:10.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.067+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94911140589584] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.071 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.067+0000 7fed924a3980 20 remove_watcher() i=6 2024-09-18T02:06:10.072 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.067+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94911140590640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565238d446c0 con 0x565238d11280 2024-09-18T02:06:10.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed8ffb3640 1 -- 172.21.15.167:0/4201718795 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94911140590640] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed88113020 con 0x565238d11280 2024-09-18T02:06:10.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 20 remove_watcher() i=7 2024-09-18T02:06:10.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x565238d11280 msgr2=0x565238d13670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x565238d11280 0x565238d13670 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x565238d0c890 msgr2=0x565238d0ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x565238d0c890 0x565238d0ed50 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fed8400f3d0 msgr2=0x7fed8400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fed8400f3d0 0x7fed8400f7f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x565238d15b90 msgr2=0x565238d17fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.076 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x565238d15b90 0x565238d17fc0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec58034650 msgr2=0x7fec58036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec58034650 0x7fec58036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fed84010fd0 tx=0x7fed84011000 comp rx=0 tx=0).stop 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 msgr2=0x565238d01860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed907b4640 1 -- 172.21.15.167:0/4201718795 reap_dead start 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238d01860 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fed8801b0b0 tx=0x7fed880d1f90 comp rx=0 tx=0).stop 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 shutdown_connections 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/4201718795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238cea710 0x565238d01860 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 >> 172.21.15.167:0/4201718795 conn(0x565238cf4840 msgr2=0x565238cf2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 shutdown_connections 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/4201718795 wait complete. 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/1368036601 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec68034650 msgr2=0x7fec68036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/1368036601 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec68034650 0x7fec68036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x565238cd1370 tx=0x7fed84006000 comp rx=0 tx=0).stop 2024-09-18T02:06:10.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/1368036601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238b50560 msgr2=0x565238cee750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/1368036601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238b50560 0x565238cee750 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fed880e2ef0 tx=0x7fed880c79e0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/1368036601 shutdown_connections 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/1368036601 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec68034650 0x7fec68036b10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/1368036601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238b50560 0x565238cee750 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/1368036601 >> 172.21.15.167:0/1368036601 conn(0x565238cdfb60 msgr2=0x565238ce25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/1368036601 shutdown_connections 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/1368036601 wait complete. 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x565238cd63b0 msgr2=0x565238cd8840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x565238cd63b0 0x565238cd8840 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x565238bdaed0 msgr2=0x565238cd3c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x565238bdaed0 0x565238cd3c40 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x565238cda430 msgr2=0x565238cdc820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x565238cda430 0x565238cdc820 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec78034650 msgr2=0x7fec78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec78034650 0x7fec78036b10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fed84000f70 tx=0x7fed84001420 comp rx=0 tx=0).stop 2024-09-18T02:06:10.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 msgr2=0x565238cccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 --2- 172.21.15.167:0/3205613129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565238bda580 0x565238cccb40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fed8801aec0 tx=0x7fed88017e30 comp rx=0 tx=0).stop 2024-09-18T02:06:10.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed907b4640 1 -- 172.21.15.167:0/3205613129 reap_dead start 2024-09-18T02:06:10.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 shutdown_connections 2024-09-18T02:06:10.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 >> 172.21.15.167:0/3205613129 conn(0x565238bd60a0 msgr2=0x565238cc0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 shutdown_connections 2024-09-18T02:06:10.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.071+0000 7fed924a3980 1 -- 172.21.15.167:0/3205613129 wait complete. 2024-09-18T02:06:10.084 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:10.084 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:10.084 ERROR:root:0 2024-09-18T02:06:10.084 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.089 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000a179c0ddfae60cfe-0066ea3592-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:06:10.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T02:06:10.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T02:06:10.090 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-18T02:06:10.163 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:10.163 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:10.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50feff980 1 Processor -- start 2024-09-18T02:06:10.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50feff980 1 -- start start 2024-09-18T02:06:10.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50feff980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f044aa78f0 0x55f044aa7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50feff980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f04492dae0 con 0x55f044aa8240 2024-09-18T02:06:10.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50feff980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55f044951e30 con 0x55f044aa78f0 2024-09-18T02:06:10.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50da0f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f044aa78f0 0x55f044aa7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50d20e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55f044aa8240 0x55f044aacc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33960/0 (socket says 172.21.15.167:33960) 2024-09-18T02:06:10.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50da0f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55f044aa78f0 0x55f044aa7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50880/0 (socket says 172.21.15.167:50880) 2024-09-18T02:06:10.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50d20e640 1 -- 172.21.15.167:0/1213283136 learned_addr learned my addr 172.21.15.167:0/1213283136 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:10.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50da0f640 1 -- 172.21.15.167:0/1213283136 >> v1:172.21.15.81:6789/0 conn(0x55f044aa8240 legacy=0x55f044aacc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50da0f640 1 -- 172.21.15.167:0/1213283136 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f044aaf4c0 con 0x55f044aa78f0 2024-09-18T02:06:10.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.163+0000 7fd50da0f640 1 --2- 172.21.15.167:0/1213283136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044aa7cd0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd50800a420 tx=0x7fd50801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fc9e6368146839 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.167+0000 7fd50ca0d640 1 -- 172.21.15.167:0/1213283136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5080af070 con 0x55f044aa78f0 2024-09-18T02:06:10.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.167+0000 7fd50ca0d640 1 -- 172.21.15.167:0/1213283136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5080aa530 con 0x55f044aa78f0 2024-09-18T02:06:10.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.167+0000 7fd50ca0d640 1 -- 172.21.15.167:0/1213283136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5080aa850 con 0x55f044aa78f0 2024-09-18T02:06:10.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.167+0000 7fd50feff980 1 -- 172.21.15.167:0/1213283136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 msgr2=0x55f044aa7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.167+0000 7fd50feff980 1 --2- 172.21.15.167:0/1213283136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044aa7cd0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd50800a420 tx=0x7fd50801afd0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.167+0000 7fd50feff980 1 -- 172.21.15.167:0/1213283136 shutdown_connections 2024-09-18T02:06:10.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.167+0000 7fd50feff980 1 --2- 172.21.15.167:0/1213283136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044aa7cd0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.167+0000 7fd50feff980 1 -- 172.21.15.167:0/1213283136 >> 172.21.15.167:0/1213283136 conn(0x55f044a1b240 msgr2=0x55f044a1b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.167+0000 7fd50feff980 1 -- 172.21.15.167:0/1213283136 shutdown_connections 2024-09-18T02:06:10.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.167+0000 7fd50feff980 1 -- 172.21.15.167:0/1213283136 wait complete. 2024-09-18T02:06:10.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50feff980 1 Processor -- start 2024-09-18T02:06:10.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50feff980 1 -- start start 2024-09-18T02:06:10.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50feff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044b92c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50feff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f044953200 con 0x55f044aa78f0 2024-09-18T02:06:10.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50da0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044b92c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50da0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044b92c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50888/0 (socket says 172.21.15.167:50888) 2024-09-18T02:06:10.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50da0f640 1 -- 172.21.15.167:0/1340597500 learned_addr learned my addr 172.21.15.167:0/1340597500 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50da0f640 1 -- 172.21.15.167:0/1340597500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f044b93210 con 0x55f044aa78f0 2024-09-18T02:06:10.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50da0f640 1 --2- 172.21.15.167:0/1340597500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044b92c40 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd50800a420 tx=0x7fd5080033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d78b54949b29f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd3fbe07640 1 -- 172.21.15.167:0/1340597500 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5080af050 con 0x55f044aa78f0 2024-09-18T02:06:10.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd3fbe07640 1 -- 172.21.15.167:0/1340597500 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5080b0040 con 0x55f044aa78f0 2024-09-18T02:06:10.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd3fbe07640 1 -- 172.21.15.167:0/1340597500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5080aac60 con 0x55f044aa78f0 2024-09-18T02:06:10.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50feff980 1 -- 172.21.15.167:0/1340597500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 msgr2=0x55f044b92c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50feff980 1 --2- 172.21.15.167:0/1340597500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044b92c40 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd50800a420 tx=0x7fd5080033b0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50feff980 1 -- 172.21.15.167:0/1340597500 shutdown_connections 2024-09-18T02:06:10.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50feff980 1 --2- 172.21.15.167:0/1340597500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044b92c40 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.179+0000 7fd50feff980 1 -- 172.21.15.167:0/1340597500 >> 172.21.15.167:0/1340597500 conn(0x55f044a1b240 msgr2=0x55f044b8e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50feff980 1 -- 172.21.15.167:0/1340597500 shutdown_connections 2024-09-18T02:06:10.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50feff980 1 -- 172.21.15.167:0/1340597500 wait complete. 2024-09-18T02:06:10.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50feff980 1 Processor -- start 2024-09-18T02:06:10.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50feff980 1 -- start start 2024-09-18T02:06:10.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50feff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044b99eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50feff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f044aaef00 con 0x55f044aa78f0 2024-09-18T02:06:10.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50da0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044b99eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50da0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044b99eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50900/0 (socket says 172.21.15.167:50900) 2024-09-18T02:06:10.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50da0f640 1 -- 172.21.15.167:0/3408649737 learned_addr learned my addr 172.21.15.167:0/3408649737 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50da0f640 1 -- 172.21.15.167:0/3408649737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f044b9a3f0 con 0x55f044aa78f0 2024-09-18T02:06:10.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50da0f640 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044b99eb0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd50801b870 tx=0x7fd508019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd3fa604640 1 -- 172.21.15.167:0/3408649737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5080c5020 con 0x55f044aa78f0 2024-09-18T02:06:10.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f044b9a680 con 0x55f044aa78f0 2024-09-18T02:06:10.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd3fa604640 1 -- 172.21.15.167:0/3408649737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5080b6cb0 con 0x55f044aa78f0 2024-09-18T02:06:10.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f044b9d360 con 0x55f044aa78f0 2024-09-18T02:06:10.191 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd3fa604640 1 -- 172.21.15.167:0/3408649737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5080b6e60 con 0x55f044aa78f0 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd3fa604640 1 -- 172.21.15.167:0/3408649737 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd5080b4400 con 0x55f044aa78f0 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd3fa604640 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3f4034650 0x7fd3f4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd3fa604640 1 -- 172.21.15.167:0/3408649737 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd5080bb070 con 0x55f044aa78f0 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50d20e640 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3f4034650 0x7fd3f4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50feff980 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f044aa8240 0x55f044ba0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044ba1530 con 0x55f044aa8240 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.183+0000 7fd50e210640 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f044aa8240 0x55f044ba0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50d20e640 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3f4034650 0x7fd3f4036b10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd504000f70 tx=0x7fd5040012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50e210640 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f044aa8240 0x55f044ba0fb0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50e210640 1 -- 172.21.15.167:0/3408649737 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5000083f0 con 0x55f044aa8240 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044b9e580 con 0x55f044aa8240 2024-09-18T02:06:10.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50e210640 1 -- 172.21.15.167:0/3408649737 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5000083f0 con 0x55f044aa8240 2024-09-18T02:06:10.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50feff980 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f044ba38d0 0x55f044ba5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044ba6390 con 0x55f044ba38d0 2024-09-18T02:06:10.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50da0f640 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f044ba38d0 0x55f044ba5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50da0f640 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f044ba38d0 0x55f044ba5cc0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50da0f640 1 -- 172.21.15.167:0/3408649737 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd5080c7070 con 0x55f044ba38d0 2024-09-18T02:06:10.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044ba2770 con 0x55f044aa8240 2024-09-18T02:06:10.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50e210640 1 -- 172.21.15.167:0/3408649737 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5000083f0 con 0x55f044aa8240 2024-09-18T02:06:10.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50feff980 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f044ba77d0 0x55f044ba9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044baa350 con 0x55f044ba77d0 2024-09-18T02:06:10.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50d20e640 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f044ba77d0 0x55f044ba9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50d20e640 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f044ba77d0 0x55f044ba9bc0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.187+0000 7fd50d20e640 1 -- 172.21.15.167:0/3408649737 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd50400e620 con 0x55f044ba77d0 2024-09-18T02:06:10.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50feff980 1 Processor -- start 2024-09-18T02:06:10.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50feff980 1 -- start start 2024-09-18T02:06:10.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50feff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bb7de0 0x55f044bb8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50feff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f0449ac800 con 0x55f044bb7de0 2024-09-18T02:06:10.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50da0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bb7de0 0x55f044bb8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50da0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bb7de0 0x55f044bb8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50918/0 (socket says 172.21.15.167:50918) 2024-09-18T02:06:10.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50da0f640 1 -- 172.21.15.167:0/3319237105 learned_addr learned my addr 172.21.15.167:0/3319237105 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50da0f640 1 -- 172.21.15.167:0/3319237105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f044bb8740 con 0x55f044bb7de0 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50da0f640 1 --2- 172.21.15.167:0/3319237105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bb7de0 0x55f044bb8200 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd5080c8890 tx=0x7fd5080bf660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd3f37fe640 1 -- 172.21.15.167:0/3319237105 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5080a9860 con 0x55f044bb7de0 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd3f37fe640 1 -- 172.21.15.167:0/3319237105 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5080a9a00 con 0x55f044bb7de0 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50feff980 1 -- 172.21.15.167:0/3319237105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f044bb89d0 con 0x55f044bb7de0 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd3f37fe640 1 -- 172.21.15.167:0/3319237105 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5080051d0 con 0x55f044bb7de0 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50feff980 1 -- 172.21.15.167:0/3319237105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f044bbb650 con 0x55f044bb7de0 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd3f37fe640 1 -- 172.21.15.167:0/3319237105 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd5080bfa30 con 0x55f044bb7de0 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd3f37fe640 1 --2- 172.21.15.167:0/3319237105 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3e8034650 0x7fd3e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd3f37fe640 1 -- 172.21.15.167:0/3319237105 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd5080cbd10 con 0x55f044bb7de0 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50d20e640 1 --2- 172.21.15.167:0/3319237105 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3e8034650 0x7fd3e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50feff980 1 Processor -- start 2024-09-18T02:06:10.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50feff980 1 -- start start 2024-09-18T02:06:10.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50d20e640 1 --2- 172.21.15.167:0/3319237105 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3e8034650 0x7fd3e8036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd50400bf60 tx=0x7fd50400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50feff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bc4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.191+0000 7fd50feff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f044b934d0 con 0x55f044bc46e0 2024-09-18T02:06:10.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50da0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bc4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50da0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bc4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50932/0 (socket says 172.21.15.167:50932) 2024-09-18T02:06:10.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50da0f640 1 -- 172.21.15.167:0/2406022983 learned_addr learned my addr 172.21.15.167:0/2406022983 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50da0f640 1 -- 172.21.15.167:0/2406022983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f044bc50b0 con 0x55f044bc46e0 2024-09-18T02:06:10.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50da0f640 1 --2- 172.21.15.167:0/2406022983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bc4ae0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd5080b8010 tx=0x7fd508004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b8aa54d28b21dd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd3f17fa640 1 -- 172.21.15.167:0/2406022983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5080bfd20 con 0x55f044bc46e0 2024-09-18T02:06:10.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd3f17fa640 1 -- 172.21.15.167:0/2406022983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5080dc400 con 0x55f044bc46e0 2024-09-18T02:06:10.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd3f17fa640 1 -- 172.21.15.167:0/2406022983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5080e49f0 con 0x55f044bc46e0 2024-09-18T02:06:10.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 -- 172.21.15.167:0/2406022983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 msgr2=0x55f044bc4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 --2- 172.21.15.167:0/2406022983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bc4ae0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd5080b8010 tx=0x7fd508004e40 comp rx=0 tx=0).stop 2024-09-18T02:06:10.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 -- 172.21.15.167:0/2406022983 shutdown_connections 2024-09-18T02:06:10.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 --2- 172.21.15.167:0/2406022983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bc4ae0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 -- 172.21.15.167:0/2406022983 >> 172.21.15.167:0/2406022983 conn(0x55f044bc0b10 msgr2=0x55f044bbec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 -- 172.21.15.167:0/2406022983 shutdown_connections 2024-09-18T02:06:10.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 -- 172.21.15.167:0/2406022983 wait complete. 2024-09-18T02:06:10.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 Processor -- start 2024-09-18T02:06:10.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 -- start start 2024-09-18T02:06:10.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bcb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f044bc5580 con 0x55f044bc46e0 2024-09-18T02:06:10.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50da0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bcb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50da0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bcb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50934/0 (socket says 172.21.15.167:50934) 2024-09-18T02:06:10.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 learned_addr learned my addr 172.21.15.167:0/4271629944 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f044bcbe90 con 0x55f044bc46e0 2024-09-18T02:06:10.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50da0f640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bcb950 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd5080b8010 tx=0x7fd5080cb9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd3df7fe640 1 -- 172.21.15.167:0/4271629944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd508108070 con 0x55f044bc46e0 2024-09-18T02:06:10.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f044bcbe90 con 0x55f044bc46e0 2024-09-18T02:06:10.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd3df7fe640 1 -- 172.21.15.167:0/4271629944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5080d08c0 con 0x55f044bc46e0 2024-09-18T02:06:10.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd3df7fe640 1 -- 172.21.15.167:0/4271629944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5080d0be0 con 0x55f044bc46e0 2024-09-18T02:06:10.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.195+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f044bcc300 con 0x55f044bc46e0 2024-09-18T02:06:10.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd3df7fe640 1 -- 172.21.15.167:0/4271629944 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd50810b070 con 0x55f044bc46e0 2024-09-18T02:06:10.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd3df7fe640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3d8034650 0x7fd3d8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd3df7fe640 1 -- 172.21.15.167:0/4271629944 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd50810ebf0 con 0x55f044bc46e0 2024-09-18T02:06:10.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50d20e640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3d8034650 0x7fd3d8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f044bd69b0 0x55f044bd8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044bd95a0 con 0x55f044bd69b0 2024-09-18T02:06:10.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50e210640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f044bd69b0 0x55f044bd8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50d20e640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3d8034650 0x7fd3d8036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55f044baa750 tx=0x7fd504010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50e210640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f044bd69b0 0x55f044bd8e50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5000083f0 con 0x55f044bd69b0 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 20 realm 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044bd99b0 con 0x55f044bd69b0 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5000083f0 con 0x55f044bd69b0 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda250 con 0x55f044bd69b0 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5000083f0 con 0x55f044bd69b0 2024-09-18T02:06:10.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bd69b0 2024-09-18T02:06:10.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5000083f0 con 0x55f044bd69b0 2024-09-18T02:06:10.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:10.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f044bdb350 0x55f044bdd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044bddde0 con 0x55f044bdb350 2024-09-18T02:06:10.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50da0f640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f044bdb350 0x55f044bdd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.199+0000 7fd50da0f640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f044bdb350 0x55f044bdd740 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50feff980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50feff980 20 searching for the correct realm 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50feff980 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f044bdfcc0 0x55f044be2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044be27b0 con 0x55f044bdfcc0 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50d20e640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f044bdfcc0 0x55f044be2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50d20e640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f044bdfcc0 0x55f044be2130 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50d20e640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fd504037040 0x7fd504036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044be27b0 con 0x7fd504037040 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fd504037040 0x7fd504036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fd504037040 0x7fd504036410 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5000083f0 con 0x7fd504037040 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x7fd504037040 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5000083f0 con 0x7fd504037040 2024-09-18T02:06:10.227 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bd69b0 2024-09-18T02:06:10.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bd69b0 2024-09-18T02:06:10.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bd69b0 2024-09-18T02:06:10.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdb350 2024-09-18T02:06:10.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x7fd504037040 2024-09-18T02:06:10.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdfcc0 2024-09-18T02:06:10.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.203+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bd69b0 2024-09-18T02:06:10.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x7fd504037040 2024-09-18T02:06:10.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bd69b0 2024-09-18T02:06:10.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x7fd504037040 2024-09-18T02:06:10.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdfcc0 2024-09-18T02:06:10.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdfcc0 2024-09-18T02:06:10.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdb350 2024-09-18T02:06:10.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdfcc0 2024-09-18T02:06:10.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdfcc0 2024-09-18T02:06:10.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bd69b0 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bd69b0 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdb350 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.207+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdfcc0 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x7fd504037040 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bd69b0 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdb350 2024-09-18T02:06:10.231 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdfcc0 2024-09-18T02:06:10.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdb350 2024-09-18T02:06:10.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x7fd504037040 2024-09-18T02:06:10.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdfcc0 2024-09-18T02:06:10.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bdb350 2024-09-18T02:06:10.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x55f044bd69b0 2024-09-18T02:06:10.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.211+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f044bda5f0 con 0x7fd504037040 2024-09-18T02:06:10.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:10.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:10.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:10.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044bde630 con 0x55f044bd69b0 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044bde630 con 0x55f044bd69b0 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044bde630 con 0x55f044bdfcc0 2024-09-18T02:06:10.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:10.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 zone default found 2024-09-18T02:06:10.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 4 Realm: () 2024-09-18T02:06:10.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:10.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:10.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:10.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 zonegroup default 2024-09-18T02:06:10.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044bdf020 con 0x55f044bdb350 2024-09-18T02:06:10.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044bdebb0 con 0x55f044bdfcc0 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044be4bf0 con 0x55f044bdfcc0 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 started sync module instance, tier type = 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:10.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be3f50 con 0x7fd504037040 2024-09-18T02:06:10.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94490433832048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be3f50 con 0x7fd504037040 2024-09-18T02:06:10.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.215+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be56d0 con 0x55f044bd69b0 2024-09-18T02:06:10.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.219+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94490433832048] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.219+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.219+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94490433835456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be3f50 con 0x55f044bd69b0 2024-09-18T02:06:10.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.219+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be60e0 con 0x55f044bdfcc0 2024-09-18T02:06:10.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.219+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94490433835456] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.219+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.223+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94490433829536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be3ec0 con 0x55f044bdfcc0 2024-09-18T02:06:10.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.223+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be6e20 con 0x7fd504037040 2024-09-18T02:06:10.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.223+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.223+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94490433841456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be76c0 con 0x7fd504037040 2024-09-18T02:06:10.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.223+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be80c0 con 0x55f044bd69b0 2024-09-18T02:06:10.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.223+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94490433829536] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.223+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94490433841456] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.223+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.223+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94490433840256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be71c0 con 0x55f044bd69b0 2024-09-18T02:06:10.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.223+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be8960 con 0x55f044bdb350 2024-09-18T02:06:10.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.227+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.227+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94490433848496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be71c0 con 0x55f044bdb350 2024-09-18T02:06:10.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.227+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be96e0 con 0x55f044bdb350 2024-09-18T02:06:10.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.227+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94490433840256] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.227+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94490433848496] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.227+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.227+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94490433850624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be9a80 con 0x55f044bdb350 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.227+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044bea310 con 0x55f044bdb350 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.231+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.231+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94490433854080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044bea9a0 con 0x55f044bdb350 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.231+0000 7fd50feff980 20 add_watcher() i=0 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.231+0000 7fd50feff980 20 add_watcher() i=1 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.231+0000 7fd50feff980 20 add_watcher() i=2 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.231+0000 7fd50feff980 20 add_watcher() i=3 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.231+0000 7fd50feff980 20 add_watcher() i=4 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.231+0000 7fd50feff980 20 add_watcher() i=5 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.231+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94490433850624] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.231+0000 7fd50feff980 20 add_watcher() i=6 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94490433854080] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 20 add_watcher() i=7 2024-09-18T02:06:10.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044bed8c0 con 0x55f044bd69b0 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94490433856480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044beacb0 con 0x55f044bd69b0 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94490433856480] v32'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd3bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 5 note: GC not initialized 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd3be7fc640 20 reqs_thread_entry: start 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 20 Filter name: none 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd32ffff640 20 reqs_thread_entry: start 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T02:06:10.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044c10dc0 con 0x55f044bdb350 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 20 rados_obj.operate() r=0 bl.length=490 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.235+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044c176b0 con 0x55f044bdb350 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd50feff980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd50feff980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd50feff980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94490434040096 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f044c12d80 con 0x55f044bd69b0 2024-09-18T02:06:10.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== watch-notify(notify (1) cookie 94490433840256 notify 137438953501 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fd500010040 con 0x55f044bd69b0 2024-09-18T02:06:10.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd3f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94490433840256 notifier 4914 bl.length()=636 2024-09-18T02:06:10.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd3f17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:10.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd3f17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 notify.4 [notify cookie 94490434040096 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd3f17fa640 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd3d0003eb0 con 0x55f044bd69b0 2024-09-18T02:06:10.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== watch-notify(notify_complete (2) cookie 94490434040096 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd50002b440 con 0x55f044bd69b0 2024-09-18T02:06:10.247 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T02:06:08.069645Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.069630Z","tags":[],"group_ids":[]} 2024-09-18T02:06:10.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd3bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:10.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.239+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94490433856480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044c0ebc0 con 0x55f044bd69b0 2024-09-18T02:06:10.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.243+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94490433856480] v32'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.243+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94490433832048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044c0ebc0 con 0x7fd504037040 2024-09-18T02:06:10.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.243+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94490433832048] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.243+0000 7fd50feff980 20 remove_watcher() i=0 2024-09-18T02:06:10.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.243+0000 7fd50feff980 2 removed watcher, disabling cache 2024-09-18T02:06:10.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.243+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94490433835456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044c0ebc0 con 0x55f044bd69b0 2024-09-18T02:06:10.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.247+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94490433835456] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.247+0000 7fd50feff980 20 remove_watcher() i=1 2024-09-18T02:06:10.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.247+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94490433829536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044c0ebc0 con 0x55f044bdfcc0 2024-09-18T02:06:10.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.247+0000 7fd50d20e640 1 -- 172.21.15.167:0/4271629944 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94490433829536] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50400e620 con 0x55f044bdfcc0 2024-09-18T02:06:10.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.247+0000 7fd50feff980 20 remove_watcher() i=2 2024-09-18T02:06:10.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.247+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94490433841456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044c0ebc0 con 0x7fd504037040 2024-09-18T02:06:10.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.247+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94490433841456] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x7fd504037040 2024-09-18T02:06:10.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.247+0000 7fd50feff980 20 remove_watcher() i=3 2024-09-18T02:06:10.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.247+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94490433840256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044c0ebc0 con 0x55f044bd69b0 2024-09-18T02:06:10.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.251+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94490433840256] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd500026040 con 0x55f044bd69b0 2024-09-18T02:06:10.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.251+0000 7fd50feff980 20 remove_watcher() i=4 2024-09-18T02:06:10.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.251+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94490433848496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be6480 con 0x55f044bdb350 2024-09-18T02:06:10.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.251+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94490433848496] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.251+0000 7fd50feff980 20 remove_watcher() i=5 2024-09-18T02:06:10.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.251+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94490433850624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044c0ebc0 con 0x55f044bdb350 2024-09-18T02:06:10.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.255+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94490433850624] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.255+0000 7fd50feff980 20 remove_watcher() i=6 2024-09-18T02:06:10.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.255+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94490433854080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f044be84b0 con 0x55f044bdb350 2024-09-18T02:06:10.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50da0f640 1 -- 172.21.15.167:0/4271629944 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94490433854080] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50810a030 con 0x55f044bdb350 2024-09-18T02:06:10.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 20 remove_watcher() i=7 2024-09-18T02:06:10.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f044bdb350 msgr2=0x55f044bdd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f044bdb350 0x55f044bdd740 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f044bd69b0 msgr2=0x55f044bd8e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f044bd69b0 0x55f044bd8e50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fd504037040 msgr2=0x7fd504036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7fd504037040 0x7fd504036410 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f044bdfcc0 msgr2=0x55f044be2130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f044bdfcc0 0x55f044be2130 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3d8034650 msgr2=0x7fd3d8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3d8034650 0x7fd3d8036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55f044baa750 tx=0x7fd504010000 comp rx=0 tx=0).stop 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50e210640 1 -- 172.21.15.167:0/4271629944 reap_dead start 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 msgr2=0x55f044bcb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bcb950 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd5080b8010 tx=0x7fd5080cb9b0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 shutdown_connections 2024-09-18T02:06:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/4271629944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bc46e0 0x55f044bcb950 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 >> 172.21.15.167:0/4271629944 conn(0x55f044bc0b10 msgr2=0x55f044bbebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 shutdown_connections 2024-09-18T02:06:10.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/4271629944 wait complete. 2024-09-18T02:06:10.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3319237105 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3e8034650 msgr2=0x7fd3e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/3319237105 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3e8034650 0x7fd3e8036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd50400bf60 tx=0x7fd50400f000 comp rx=0 tx=0).stop 2024-09-18T02:06:10.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3319237105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bb7de0 msgr2=0x55f044bb8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/3319237105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bb7de0 0x55f044bb8200 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd5080c8890 tx=0x7fd5080bf660 comp rx=0 tx=0).stop 2024-09-18T02:06:10.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3319237105 shutdown_connections 2024-09-18T02:06:10.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/3319237105 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3e8034650 0x7fd3e8036b10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/3319237105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044bb7de0 0x55f044bb8200 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3319237105 >> 172.21.15.167:0/3319237105 conn(0x55f044bacf30 msgr2=0x55f044baf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3319237105 shutdown_connections 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3319237105 wait complete. 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f044ba38d0 msgr2=0x55f044ba5cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55f044ba38d0 0x55f044ba5cc0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f044aa8240 msgr2=0x55f044ba0fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55f044aa8240 0x55f044ba0fb0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f044ba77d0 msgr2=0x55f044ba9bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55f044ba77d0 0x55f044ba9bc0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3f4034650 msgr2=0x7fd3f4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fd3f4034650 0x7fd3f4036b10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd504000f70 tx=0x7fd5040012c0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 msgr2=0x55f044b99eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 --2- 172.21.15.167:0/3408649737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f044aa78f0 0x55f044b99eb0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd50801b870 tx=0x7fd508019810 comp rx=0 tx=0).stop 2024-09-18T02:06:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50e210640 1 -- 172.21.15.167:0/3408649737 reap_dead start 2024-09-18T02:06:10.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 shutdown_connections 2024-09-18T02:06:10.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 >> 172.21.15.167:0/3408649737 conn(0x55f044a1b240 msgr2=0x55f044b8d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 shutdown_connections 2024-09-18T02:06:10.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.259+0000 7fd50feff980 1 -- 172.21.15.167:0/3408649737 wait complete. 2024-09-18T02:06:10.271 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:10.272 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:10.272 ERROR:root:0 2024-09-18T02:06:10.272 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T02:06:10.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T02:06:10.272 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-18T02:06:10.349 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:10.350 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:10.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.347+0000 7f476671b980 1 Processor -- start 2024-09-18T02:06:10.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.347+0000 7f476671b980 1 -- start start 2024-09-18T02:06:10.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.347+0000 7f476671b980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56241aeeea20 0x56241aef0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.347+0000 7f476671b980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56241ad72ae0 con 0x56241aeea6a0 2024-09-18T02:06:10.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.347+0000 7f476671b980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x56241ad96e30 con 0x56241aeeea20 2024-09-18T02:06:10.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.347+0000 7f4763a2a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56241aeeea20 0x56241aef0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.347+0000 7f4763a2a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x56241aeeea20 0x56241aef0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50950/0 (socket says 172.21.15.167:50950) 2024-09-18T02:06:10.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.347+0000 7f4763a2a640 1 -- 172.21.15.167:0/1486443968 learned_addr learned my addr 172.21.15.167:0/1486443968 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.347+0000 7f4763a2a640 1 -- 172.21.15.167:0/1486443968 >> v1:172.21.15.81:6789/0 conn(0x56241aeea6a0 legacy=0x56241aeeaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.347+0000 7f4763a2a640 1 -- 172.21.15.167:0/1486443968 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56241aef2360 con 0x56241aeeea20 2024-09-18T02:06:10.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.351+0000 7f4763a2a640 1 --2- 172.21.15.167:0/1486443968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeeea20 0x56241aef0e10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f475800a4e0 tx=0x7f475801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4d337743a974f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.351+0000 7f4763229640 1 -- 172.21.15.167:0/1486443968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47580aa540 con 0x56241aeeea20 2024-09-18T02:06:10.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.351+0000 7f4763229640 1 -- 172.21.15.167:0/1486443968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47580aa6e0 con 0x56241aeeea20 2024-09-18T02:06:10.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.351+0000 7f4763229640 1 -- 172.21.15.167:0/1486443968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47580aaa40 con 0x56241aeeea20 2024-09-18T02:06:10.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.351+0000 7f476671b980 1 -- 172.21.15.167:0/1486443968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeeea20 msgr2=0x56241aef0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.351+0000 7f476671b980 1 --2- 172.21.15.167:0/1486443968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeeea20 0x56241aef0e10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f475800a4e0 tx=0x7f475801b090 comp rx=0 tx=0).stop 2024-09-18T02:06:10.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.351+0000 7f476671b980 1 -- 172.21.15.167:0/1486443968 shutdown_connections 2024-09-18T02:06:10.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.351+0000 7f476671b980 1 --2- 172.21.15.167:0/1486443968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeeea20 0x56241aef0e10 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.351+0000 7f476671b980 1 -- 172.21.15.167:0/1486443968 >> 172.21.15.167:0/1486443968 conn(0x56241aee61c0 msgr2=0x56241aee85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.351+0000 7f476671b980 1 -- 172.21.15.167:0/1486443968 shutdown_connections 2024-09-18T02:06:10.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.351+0000 7f476671b980 1 -- 172.21.15.167:0/1486443968 wait complete. 2024-09-18T02:06:10.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 Processor -- start 2024-09-18T02:06:10.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 -- start start 2024-09-18T02:06:10.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 0x56241afd5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56241ad98200 con 0x56241aeea6a0 2024-09-18T02:06:10.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476422b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 0x56241afd5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476422b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 0x56241afd5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50962/0 (socket says 172.21.15.167:50962) 2024-09-18T02:06:10.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476422b640 1 -- 172.21.15.167:0/3837615890 learned_addr learned my addr 172.21.15.167:0/3837615890 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476422b640 1 -- 172.21.15.167:0/3837615890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56241afd6060 con 0x56241aeea6a0 2024-09-18T02:06:10.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476422b640 1 --2- 172.21.15.167:0/3837615890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 0x56241afd5a90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f475400b1f0 tx=0x7f475400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5935f2ae6665f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f465260c640 1 -- 172.21.15.167:0/3837615890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f475400a040 con 0x56241aeea6a0 2024-09-18T02:06:10.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f465260c640 1 -- 172.21.15.167:0/3837615890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475400f750 con 0x56241aeea6a0 2024-09-18T02:06:10.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f465260c640 1 -- 172.21.15.167:0/3837615890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f475400fa70 con 0x56241aeea6a0 2024-09-18T02:06:10.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 -- 172.21.15.167:0/3837615890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 msgr2=0x56241afd5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 --2- 172.21.15.167:0/3837615890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 0x56241afd5a90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f475400b1f0 tx=0x7f475400b6b0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 -- 172.21.15.167:0/3837615890 shutdown_connections 2024-09-18T02:06:10.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 --2- 172.21.15.167:0/3837615890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 0x56241afd5a90 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 -- 172.21.15.167:0/3837615890 >> 172.21.15.167:0/3837615890 conn(0x56241aee61c0 msgr2=0x56241afd16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 -- 172.21.15.167:0/3837615890 shutdown_connections 2024-09-18T02:06:10.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 -- 172.21.15.167:0/3837615890 wait complete. 2024-09-18T02:06:10.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 Processor -- start 2024-09-18T02:06:10.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 -- start start 2024-09-18T02:06:10.372 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 0x56241afdce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476671b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56241aef1e60 con 0x56241aeea6a0 2024-09-18T02:06:10.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476422b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 0x56241afdce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476422b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 0x56241afdce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50964/0 (socket says 172.21.15.167:50964) 2024-09-18T02:06:10.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.367+0000 7f476422b640 1 -- 172.21.15.167:0/1482084476 learned_addr learned my addr 172.21.15.167:0/1482084476 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f476422b640 1 -- 172.21.15.167:0/1482084476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56241afdd340 con 0x56241aeea6a0 2024-09-18T02:06:10.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f476422b640 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 0x56241afdce00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f475400b6f0 tx=0x7f4754000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4650e09640 1 -- 172.21.15.167:0/1482084476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4754001300 con 0x56241aeea6a0 2024-09-18T02:06:10.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56241afdd5d0 con 0x56241aeea6a0 2024-09-18T02:06:10.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56241afe02b0 con 0x56241aeea6a0 2024-09-18T02:06:10.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4650e09640 1 -- 172.21.15.167:0/1482084476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475401c9c0 con 0x56241aeea6a0 2024-09-18T02:06:10.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4650e09640 1 -- 172.21.15.167:0/1482084476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f475402c060 con 0x56241aeea6a0 2024-09-18T02:06:10.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4650e09640 1 -- 172.21.15.167:0/1482084476 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4754017050 con 0x56241aeea6a0 2024-09-18T02:06:10.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4650e09640 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f464c034650 0x7f464c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4650e09640 1 -- 172.21.15.167:0/1482084476 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4754015020 con 0x56241aeea6a0 2024-09-18T02:06:10.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4763a2a640 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f464c034650 0x7f464c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f476671b980 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56241aeeea20 0x56241afe3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241afe4440 con 0x56241aeeea20 2024-09-18T02:06:10.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4764a2c640 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56241aeeea20 0x56241afe3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4763a2a640 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f464c034650 0x7f464c036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f47580ab000 tx=0x7f47580a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4764a2c640 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56241aeeea20 0x56241afe3f00 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4764a2c640 1 -- 172.21.15.167:0/1482084476 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f475c0083f0 con 0x56241aeeea20 2024-09-18T02:06:10.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241afe14d0 con 0x56241aeeea20 2024-09-18T02:06:10.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f4764a2c640 1 -- 172.21.15.167:0/1482084476 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f475c0083f0 con 0x56241aeeea20 2024-09-18T02:06:10.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f476671b980 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56241afe67e0 0x56241afe8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.371+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241afe92c0 con 0x56241afe67e0 2024-09-18T02:06:10.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476422b640 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56241afe67e0 0x56241afe8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476422b640 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56241afe67e0 0x56241afe8bd0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476422b640 1 -- 172.21.15.167:0/1482084476 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f475402e070 con 0x56241afe67e0 2024-09-18T02:06:10.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241afe5680 con 0x56241aeeea20 2024-09-18T02:06:10.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f4764a2c640 1 -- 172.21.15.167:0/1482084476 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f475c0083f0 con 0x56241aeeea20 2024-09-18T02:06:10.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476671b980 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56241afea720 0x56241afecb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.378 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241afed250 con 0x56241afea720 2024-09-18T02:06:10.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f4763a2a640 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56241afea720 0x56241afecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.379 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f4763a2a640 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56241afea720 0x56241afecb10 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f4763a2a640 1 -- 172.21.15.167:0/1482084476 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f47580bc040 con 0x56241afea720 2024-09-18T02:06:10.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476671b980 1 Processor -- start 2024-09-18T02:06:10.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476671b980 1 -- start start 2024-09-18T02:06:10.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476671b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241afface0 0x56241affb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476671b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56241adf1800 con 0x56241afface0 2024-09-18T02:06:10.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476422b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241afface0 0x56241affb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476422b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241afface0 0x56241affb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50974/0 (socket says 172.21.15.167:50974) 2024-09-18T02:06:10.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.375+0000 7f476422b640 1 -- 172.21.15.167:0/922907903 learned_addr learned my addr 172.21.15.167:0/922907903 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476422b640 1 -- 172.21.15.167:0/922907903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56241affb640 con 0x56241afface0 2024-09-18T02:06:10.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476422b640 1 --2- 172.21.15.167:0/922907903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241afface0 0x56241affb100 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f47540486a0 tx=0x7f47540420a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f4649ffb640 1 -- 172.21.15.167:0/922907903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4754040070 con 0x56241afface0 2024-09-18T02:06:10.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f4649ffb640 1 -- 172.21.15.167:0/922907903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47540488b0 con 0x56241afface0 2024-09-18T02:06:10.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476671b980 1 -- 172.21.15.167:0/922907903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56241affb8d0 con 0x56241afface0 2024-09-18T02:06:10.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f4649ffb640 1 -- 172.21.15.167:0/922907903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4754048b90 con 0x56241afface0 2024-09-18T02:06:10.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476671b980 1 -- 172.21.15.167:0/922907903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56241affe550 con 0x56241afface0 2024-09-18T02:06:10.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f4649ffb640 1 -- 172.21.15.167:0/922907903 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f475403a070 con 0x56241afface0 2024-09-18T02:06:10.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f4649ffb640 1 --2- 172.21.15.167:0/922907903 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f463c034650 0x7f463c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f4649ffb640 1 -- 172.21.15.167:0/922907903 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f475401e040 con 0x56241afface0 2024-09-18T02:06:10.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f4763a2a640 1 --2- 172.21.15.167:0/922907903 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f463c034650 0x7f463c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476671b980 1 Processor -- start 2024-09-18T02:06:10.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476671b980 1 -- start start 2024-09-18T02:06:10.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476671b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241ae61270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476671b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56241afd63e0 con 0x56241ae60e70 2024-09-18T02:06:10.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f4763a2a640 1 --2- 172.21.15.167:0/922907903 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f463c034650 0x7f463c036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x56241afe4960 tx=0x7f4758005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476422b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241ae61270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476422b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241ae61270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50982/0 (socket says 172.21.15.167:50982) 2024-09-18T02:06:10.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476422b640 1 -- 172.21.15.167:0/1866218150 learned_addr learned my addr 172.21.15.167:0/1866218150 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476422b640 1 -- 172.21.15.167:0/1866218150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56241ae61840 con 0x56241ae60e70 2024-09-18T02:06:10.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f476422b640 1 --2- 172.21.15.167:0/1866218150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241ae61270 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f475401c680 tx=0x7f4754042b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fc4ea1c52e6390 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f46437fe640 1 -- 172.21.15.167:0/1866218150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4754048d30 con 0x56241ae60e70 2024-09-18T02:06:10.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f46437fe640 1 -- 172.21.15.167:0/1866218150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4754041260 con 0x56241ae60e70 2024-09-18T02:06:10.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.379+0000 7f46437fe640 1 -- 172.21.15.167:0/1866218150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4754042430 con 0x56241ae60e70 2024-09-18T02:06:10.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 -- 172.21.15.167:0/1866218150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 msgr2=0x56241ae61270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 --2- 172.21.15.167:0/1866218150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241ae61270 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f475401c680 tx=0x7f4754042b80 comp rx=0 tx=0).stop 2024-09-18T02:06:10.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 -- 172.21.15.167:0/1866218150 shutdown_connections 2024-09-18T02:06:10.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 --2- 172.21.15.167:0/1866218150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241ae61270 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 -- 172.21.15.167:0/1866218150 >> 172.21.15.167:0/1866218150 conn(0x56241b003a30 msgr2=0x56241b001b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 -- 172.21.15.167:0/1866218150 shutdown_connections 2024-09-18T02:06:10.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 -- 172.21.15.167:0/1866218150 wait complete. 2024-09-18T02:06:10.387 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 Processor -- start 2024-09-18T02:06:10.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 -- start start 2024-09-18T02:06:10.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241b010a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56241ae5fa00 con 0x56241ae60e70 2024-09-18T02:06:10.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476422b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241b010a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476422b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241b010a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:50994/0 (socket says 172.21.15.167:50994) 2024-09-18T02:06:10.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 learned_addr learned my addr 172.21.15.167:0/392751172 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56241b010f60 con 0x56241ae60e70 2024-09-18T02:06:10.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476422b640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241b010a20 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4754047470 tx=0x7f475401adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f4641ffb640 1 -- 172.21.15.167:0/392751172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4754066040 con 0x56241ae60e70 2024-09-18T02:06:10.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56241b010f60 con 0x56241ae60e70 2024-09-18T02:06:10.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f4641ffb640 1 -- 172.21.15.167:0/392751172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4754019600 con 0x56241ae60e70 2024-09-18T02:06:10.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f4641ffb640 1 -- 172.21.15.167:0/392751172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4754019900 con 0x56241ae60e70 2024-09-18T02:06:10.390 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56241b0113d0 con 0x56241ae60e70 2024-09-18T02:06:10.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f4641ffb640 1 -- 172.21.15.167:0/392751172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f475403b860 con 0x56241ae60e70 2024-09-18T02:06:10.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f4641ffb640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4634034650 0x7f4634036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f4641ffb640 1 -- 172.21.15.167:0/392751172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4754078950 con 0x56241ae60e70 2024-09-18T02:06:10.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f4763a2a640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4634034650 0x7f4634036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.395 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56241b01bb80 0x56241b01e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.383+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b01e790 con 0x56241b01bb80 2024-09-18T02:06:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4764a2c640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56241b01bb80 0x56241b01e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4763a2a640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4634034650 0x7f4634036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f475800a190 tx=0x7f47580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4764a2c640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56241b01bb80 0x56241b01e040 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f475c0083f0 con 0x56241b01bb80 2024-09-18T02:06:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 20 realm 2024-09-18T02:06:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b01eba0 con 0x56241b01bb80 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f475c0083f0 con 0x56241b01bb80 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f440 con 0x56241b01bb80 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f475c0083f0 con 0x56241b01bb80 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b01bb80 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f475c0083f0 con 0x56241b01bb80 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56241b020540 0x56241b022930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b022f80 con 0x56241b020540 2024-09-18T02:06:10.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476422b640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56241b020540 0x56241b022930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476422b640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56241b020540 0x56241b022930 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:10.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 20 searching for the correct realm 2024-09-18T02:06:10.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56241b024e60 0x56241b0272d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b027950 con 0x56241b024e60 2024-09-18T02:06:10.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4763a2a640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56241b024e60 0x56241b0272d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4763a2a640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56241b024e60 0x56241b0272d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4763a2a640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f47580cd050 0x7f47580cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.387+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b027950 con 0x7f47580cd050 2024-09-18T02:06:10.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f47580cd050 0x7f47580cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f47580cd050 0x7f47580cd430 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c0083f0 con 0x7f47580cd050 2024-09-18T02:06:10.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x7f47580cd050 2024-09-18T02:06:10.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c0083f0 con 0x7f47580cd050 2024-09-18T02:06:10.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b01bb80 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b01bb80 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b01bb80 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b020540 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x7f47580cd050 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b024e60 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b01bb80 2024-09-18T02:06:10.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x7f47580cd050 2024-09-18T02:06:10.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b01bb80 2024-09-18T02:06:10.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x7f47580cd050 2024-09-18T02:06:10.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b024e60 2024-09-18T02:06:10.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.391+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b024e60 2024-09-18T02:06:10.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b020540 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b024e60 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b024e60 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b01bb80 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b01bb80 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b020540 2024-09-18T02:06:10.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b024e60 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x7f47580cd050 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b01bb80 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b020540 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b024e60 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.395+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b020540 2024-09-18T02:06:10.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x7f47580cd050 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b024e60 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b020540 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x56241b01bb80 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56241b01f7e0 con 0x7f47580cd050 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:10.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b0237d0 con 0x56241b01bb80 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b0237d0 con 0x56241b01bb80 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:10.411 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b0237d0 con 0x56241b024e60 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 zone default found 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 4 Realm: () 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 zonegroup default 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b0241d0 con 0x56241b020540 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.399+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b023d60 con 0x56241b024e60 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f476671b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b029d10 con 0x56241b024e60 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f476671b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f476671b980 20 started sync module instance, tier type = 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f476671b980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b0290f0 con 0x7f47580cd050 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94713071965680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b0290f0 con 0x7f47580cd050 2024-09-18T02:06:10.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02a7b0 con 0x56241b01bb80 2024-09-18T02:06:10.414 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94713071965680] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94713071968960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b0290f0 con 0x56241b01bb80 2024-09-18T02:06:10.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.403+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02b1c0 con 0x56241b024e60 2024-09-18T02:06:10.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.407+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.407+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94713071971600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02ba10 con 0x56241b024e60 2024-09-18T02:06:10.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.407+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02c410 con 0x7f47580cd050 2024-09-18T02:06:10.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.407+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94713071968960] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.407+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.407+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94713071963200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02c800 con 0x7f47580cd050 2024-09-18T02:06:10.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.407+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02d1c0 con 0x56241b01bb80 2024-09-18T02:06:10.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.407+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94713071971600] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.411+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94713071963200] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.411+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.411+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94713071976224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02cd10 con 0x56241b01bb80 2024-09-18T02:06:10.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.411+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02d560 con 0x56241b020540 2024-09-18T02:06:10.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.411+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94713071976224] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.411+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.411+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94713071979792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02d130 con 0x56241b020540 2024-09-18T02:06:10.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.411+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02e260 con 0x56241b020540 2024-09-18T02:06:10.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94713071986176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02eed0 con 0x56241b020540 2024-09-18T02:06:10.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02f890 con 0x56241b020540 2024-09-18T02:06:10.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94713071979792] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94713071986176] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94713071987232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02ee40 con 0x56241b020540 2024-09-18T02:06:10.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476671b980 20 add_watcher() i=0 2024-09-18T02:06:10.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476671b980 20 add_watcher() i=1 2024-09-18T02:06:10.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476671b980 20 add_watcher() i=2 2024-09-18T02:06:10.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476671b980 20 add_watcher() i=3 2024-09-18T02:06:10.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476671b980 20 add_watcher() i=4 2024-09-18T02:06:10.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476671b980 20 add_watcher() i=5 2024-09-18T02:06:10.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.415+0000 7f476671b980 20 add_watcher() i=6 2024-09-18T02:06:10.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94713071987232] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.421 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 20 add_watcher() i=7 2024-09-18T02:06:10.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:10.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b0328c0 con 0x56241b01bb80 2024-09-18T02:06:10.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94713071989728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02fd20 con 0x56241b01bb80 2024-09-18T02:06:10.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94713071989728] v32'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f461a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:10.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:10.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:10.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 5 note: GC not initialized 2024-09-18T02:06:10.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f46197e2640 20 reqs_thread_entry: start 2024-09-18T02:06:10.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:10.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 20 Filter name: none 2024-09-18T02:06:10.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f458affd640 20 reqs_thread_entry: start 2024-09-18T02:06:10.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T02:06:10.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.419+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b055ec0 con 0x56241b020540 2024-09-18T02:06:10.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.423+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.423+0000 7f476671b980 20 rados_obj.operate() r=0 bl.length=460 2024-09-18T02:06:10.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.423+0000 7f476671b980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T02:06:10.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.423+0000 7f476671b980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.423+0000 7f476671b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:10.426 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.423+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b05c480 con 0x56241b020540 2024-09-18T02:06:10.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.423+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.423+0000 7f476671b980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:10.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.423+0000 7f476671b980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.428 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.423+0000 7f476671b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T02:06:10.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.423+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94713072172784 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56241b057bb0 con 0x56241b01bb80 2024-09-18T02:06:10.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== watch-notify(notify (1) cookie 94713071976224 notify 137438953502 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f475c010040 con 0x56241b01bb80 2024-09-18T02:06:10.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f46437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94713071976224 notifier 4921 bl.length()=649 2024-09-18T02:06:10.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f46437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:10.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f46437fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 notify.4 [notify cookie 94713072172784 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f46437fe640 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4628003eb0 con 0x56241b01bb80 2024-09-18T02:06:10.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== watch-notify(notify_complete (2) cookie 94713072172784 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f475c02b440 con 0x56241b01bb80 2024-09-18T02:06:10.429 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T02:06:08.069645Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.069630Z","tags":[],"group_ids":[]} 2024-09-18T02:06:10.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f461a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:10.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94713071989728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b05b7d0 con 0x56241b01bb80 2024-09-18T02:06:10.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94713071989728] v32'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94713071965680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b05b7d0 con 0x7f47580cd050 2024-09-18T02:06:10.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94713071965680] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f476671b980 20 remove_watcher() i=0 2024-09-18T02:06:10.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f476671b980 2 removed watcher, disabling cache 2024-09-18T02:06:10.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.427+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94713071968960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b05b7d0 con 0x56241b01bb80 2024-09-18T02:06:10.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.431+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94713071968960] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.431+0000 7f476671b980 20 remove_watcher() i=1 2024-09-18T02:06:10.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.431+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94713071971600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b05b7d0 con 0x56241b024e60 2024-09-18T02:06:10.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.431+0000 7f4763a2a640 1 -- 172.21.15.167:0/392751172 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94713071971600] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47580ca070 con 0x56241b024e60 2024-09-18T02:06:10.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.431+0000 7f476671b980 20 remove_watcher() i=2 2024-09-18T02:06:10.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.431+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94713071963200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b0295f0 con 0x7f47580cd050 2024-09-18T02:06:10.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.435+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94713071963200] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x7f47580cd050 2024-09-18T02:06:10.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.435+0000 7f476671b980 20 remove_watcher() i=3 2024-09-18T02:06:10.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.435+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94713071976224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02a2c0 con 0x56241b01bb80 2024-09-18T02:06:10.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.435+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94713071976224] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f475c026040 con 0x56241b01bb80 2024-09-18T02:06:10.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.435+0000 7f476671b980 20 remove_watcher() i=4 2024-09-18T02:06:10.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.435+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94713071979792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02ad10 con 0x56241b020540 2024-09-18T02:06:10.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.439+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94713071979792] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.439+0000 7f476671b980 20 remove_watcher() i=5 2024-09-18T02:06:10.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.439+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94713071986176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b0295f0 con 0x56241b020540 2024-09-18T02:06:10.443 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.439+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94713071986176] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.439+0000 7f476671b980 20 remove_watcher() i=6 2024-09-18T02:06:10.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.439+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94713071987232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56241b02bf20 con 0x56241b020540 2024-09-18T02:06:10.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476422b640 1 -- 172.21.15.167:0/392751172 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94713071987232] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4754070020 con 0x56241b020540 2024-09-18T02:06:10.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 20 remove_watcher() i=7 2024-09-18T02:06:10.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56241b020540 msgr2=0x56241b022930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56241b020540 0x56241b022930 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56241b01bb80 msgr2=0x56241b01e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56241b01bb80 0x56241b01e040 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f47580cd050 msgr2=0x7f47580cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f47580cd050 0x7f47580cd430 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56241b024e60 msgr2=0x56241b0272d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56241b024e60 0x56241b0272d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4634034650 msgr2=0x7f4634036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4634034650 0x7f4634036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f475800a190 tx=0x7f47580a6000 comp rx=0 tx=0).stop 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 msgr2=0x56241b010a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f4764a2c640 1 -- 172.21.15.167:0/392751172 reap_dead start 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241b010a20 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4754047470 tx=0x7f475401adb0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 shutdown_connections 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/392751172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241ae60e70 0x56241b010a20 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 >> 172.21.15.167:0/392751172 conn(0x56241b003a30 msgr2=0x56241b001b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 shutdown_connections 2024-09-18T02:06:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/392751172 wait complete. 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/922907903 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f463c034650 msgr2=0x7f463c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/922907903 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f463c034650 0x7f463c036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x56241afe4960 tx=0x7f4758005e50 comp rx=0 tx=0).stop 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/922907903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241afface0 msgr2=0x56241affb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/922907903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241afface0 0x56241affb100 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f47540486a0 tx=0x7f47540420a0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/922907903 shutdown_connections 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/922907903 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f463c034650 0x7f463c036b10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/922907903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241afface0 0x56241affb100 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/922907903 >> 172.21.15.167:0/922907903 conn(0x56241afefe30 msgr2=0x56241aff28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/922907903 shutdown_connections 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/922907903 wait complete. 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56241afe67e0 msgr2=0x56241afe8bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x56241afe67e0 0x56241afe8bd0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56241aeeea20 msgr2=0x56241afe3f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x56241aeeea20 0x56241afe3f00 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56241afea720 msgr2=0x56241afecb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x56241afea720 0x56241afecb10 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f464c034650 msgr2=0x7f464c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f464c034650 0x7f464c036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f47580ab000 tx=0x7f47580a5000 comp rx=0 tx=0).stop 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 msgr2=0x56241afdce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 --2- 172.21.15.167:0/1482084476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56241aeea6a0 0x56241afdce00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f475400b6f0 tx=0x7f4754000ee0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f4764a2c640 1 -- 172.21.15.167:0/1482084476 reap_dead start 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 shutdown_connections 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 >> 172.21.15.167:0/1482084476 conn(0x56241aee61c0 msgr2=0x56241afd0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 shutdown_connections 2024-09-18T02:06:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.443+0000 7f476671b980 1 -- 172.21.15.167:0/1482084476 wait complete. 2024-09-18T02:06:10.456 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:10.457 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:10.457 ERROR:root:0 2024-09-18T02:06:10.457 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T02:06:10.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T02:06:10.457 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-18T02:06:10.531 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:06:10.531 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:06:10.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.527+0000 7f61ba841980 1 Processor -- start 2024-09-18T02:06:10.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.527+0000 7f61ba841980 1 -- start start 2024-09-18T02:06:10.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.531+0000 7f61ba841980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55fda2565c70 0x55fda2568060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.531+0000 7f61ba841980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fda23e7ae0 con 0x55fda25618f0 2024-09-18T02:06:10.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.531+0000 7f61ba841980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x55fda240be30 con 0x55fda2565c70 2024-09-18T02:06:10.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.531+0000 7f61b7b50640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55fda2565c70 0x55fda2568060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.531+0000 7f61b8351640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x55fda25618f0 0x55fda2561cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:33990/0 (socket says 172.21.15.167:33990) 2024-09-18T02:06:10.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.531+0000 7f61b7b50640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x55fda2565c70 0x55fda2568060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51006/0 (socket says 172.21.15.167:51006) 2024-09-18T02:06:10.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.531+0000 7f61b8351640 1 -- 172.21.15.167:0/1697128697 learned_addr learned my addr 172.21.15.167:0/1697128697 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:06:10.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.531+0000 7f61b7b50640 1 -- 172.21.15.167:0/1697128697 >> v1:172.21.15.81:6789/0 conn(0x55fda25618f0 legacy=0x55fda2561cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.531+0000 7f61b7b50640 1 -- 172.21.15.167:0/1697128697 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda25695b0 con 0x55fda2565c70 2024-09-18T02:06:10.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.531+0000 7f61b7b50640 1 --2- 172.21.15.167:0/1697128697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda2565c70 0x55fda2568060 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f61a800a480 tx=0x7f61a801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4024f998766a3654 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.531+0000 7f61b734f640 1 -- 172.21.15.167:0/1697128697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a80b0070 con 0x55fda2565c70 2024-09-18T02:06:10.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.535+0000 7f61b734f640 1 -- 172.21.15.167:0/1697128697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a80ab540 con 0x55fda2565c70 2024-09-18T02:06:10.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.535+0000 7f61b734f640 1 -- 172.21.15.167:0/1697128697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a80ab840 con 0x55fda2565c70 2024-09-18T02:06:10.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.535+0000 7f61ba841980 1 -- 172.21.15.167:0/1697128697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda2565c70 msgr2=0x55fda2568060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.535+0000 7f61ba841980 1 --2- 172.21.15.167:0/1697128697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda2565c70 0x55fda2568060 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f61a800a480 tx=0x7f61a801b280 comp rx=0 tx=0).stop 2024-09-18T02:06:10.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.535+0000 7f61ba841980 1 -- 172.21.15.167:0/1697128697 shutdown_connections 2024-09-18T02:06:10.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.535+0000 7f61ba841980 1 --2- 172.21.15.167:0/1697128697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda2565c70 0x55fda2568060 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.535+0000 7f61ba841980 1 -- 172.21.15.167:0/1697128697 >> 172.21.15.167:0/1697128697 conn(0x55fda24d5240 msgr2=0x55fda24d5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.535+0000 7f61ba841980 1 -- 172.21.15.167:0/1697128697 shutdown_connections 2024-09-18T02:06:10.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.535+0000 7f61ba841980 1 -- 172.21.15.167:0/1697128697 wait complete. 2024-09-18T02:06:10.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61ba841980 1 Processor -- start 2024-09-18T02:06:10.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61ba841980 1 -- start start 2024-09-18T02:06:10.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61ba841980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 0x55fda264ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61ba841980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fda240d200 con 0x55fda25618f0 2024-09-18T02:06:10.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61b8351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 0x55fda264ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61b8351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 0x55fda264ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51018/0 (socket says 172.21.15.167:51018) 2024-09-18T02:06:10.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61b8351640 1 -- 172.21.15.167:0/4240986175 learned_addr learned my addr 172.21.15.167:0/4240986175 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61b8351640 1 -- 172.21.15.167:0/4240986175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda264d3e0 con 0x55fda25618f0 2024-09-18T02:06:10.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61b8351640 1 --2- 172.21.15.167:0/4240986175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 0x55fda264ce10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f61ac001d90 tx=0x7f61ac001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efc11f0520d9f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f60a660c640 1 -- 172.21.15.167:0/4240986175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ac013030 con 0x55fda25618f0 2024-09-18T02:06:10.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f60a660c640 1 -- 172.21.15.167:0/4240986175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac00e690 con 0x55fda25618f0 2024-09-18T02:06:10.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f60a660c640 1 -- 172.21.15.167:0/4240986175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ac00ea10 con 0x55fda25618f0 2024-09-18T02:06:10.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61ba841980 1 -- 172.21.15.167:0/4240986175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 msgr2=0x55fda264ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61ba841980 1 --2- 172.21.15.167:0/4240986175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 0x55fda264ce10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f61ac001d90 tx=0x7f61ac001e80 comp rx=0 tx=0).stop 2024-09-18T02:06:10.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61ba841980 1 -- 172.21.15.167:0/4240986175 shutdown_connections 2024-09-18T02:06:10.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61ba841980 1 --2- 172.21.15.167:0/4240986175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 0x55fda264ce10 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61ba841980 1 -- 172.21.15.167:0/4240986175 >> 172.21.15.167:0/4240986175 conn(0x55fda24d5240 msgr2=0x55fda26489a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61ba841980 1 -- 172.21.15.167:0/4240986175 shutdown_connections 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.547+0000 7f61ba841980 1 -- 172.21.15.167:0/4240986175 wait complete. 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61ba841980 1 Processor -- start 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61ba841980 1 -- start start 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61ba841980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 0x55fda2654180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61ba841980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fda25690b0 con 0x55fda25618f0 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61b8351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 0x55fda2654180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61b8351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 0x55fda2654180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51032/0 (socket says 172.21.15.167:51032) 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61b8351640 1 -- 172.21.15.167:0/1876681726 learned_addr learned my addr 172.21.15.167:0/1876681726 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61b8351640 1 -- 172.21.15.167:0/1876681726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda26546c0 con 0x55fda25618f0 2024-09-18T02:06:10.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61b8351640 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 0x55fda2654180 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x55fda264dff0 tx=0x7f61ac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f60a4e09640 1 -- 172.21.15.167:0/1876681726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ac027070 con 0x55fda25618f0 2024-09-18T02:06:10.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fda2654950 con 0x55fda25618f0 2024-09-18T02:06:10.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fda2657630 con 0x55fda25618f0 2024-09-18T02:06:10.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f60a4e09640 1 -- 172.21.15.167:0/1876681726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac019900 con 0x55fda25618f0 2024-09-18T02:06:10.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f60a4e09640 1 -- 172.21.15.167:0/1876681726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ac031060 con 0x55fda25618f0 2024-09-18T02:06:10.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f60a4e09640 1 -- 172.21.15.167:0/1876681726 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f61ac02a070 con 0x55fda25618f0 2024-09-18T02:06:10.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f60a4e09640 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f60a0034650 0x7f60a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f60a4e09640 1 -- 172.21.15.167:0/1876681726 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f61ac01f070 con 0x55fda25618f0 2024-09-18T02:06:10.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61b7b50640 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f60a0034650 0x7f60a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61ba841980 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55fda2659100 0x55fda265b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda265bb80 con 0x55fda2659100 2024-09-18T02:06:10.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61b8b52640 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55fda2659100 0x55fda265b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.551+0000 7f61b7b50640 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f60a0034650 0x7f60a0036b10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f61a80ad000 tx=0x7f61a80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61b8b52640 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55fda2659100 0x55fda265b510 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61b8b52640 1 -- 172.21.15.167:0/1876681726 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2659100 2024-09-18T02:06:10.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda2658850 con 0x55fda2659100 2024-09-18T02:06:10.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61b8b52640 1 -- 172.21.15.167:0/1876681726 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2659100 2024-09-18T02:06:10.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61ba841980 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55fda265ded0 0x55fda26602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda26609b0 con 0x55fda265ded0 2024-09-18T02:06:10.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61b8351640 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55fda265ded0 0x55fda26602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61b8351640 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55fda265ded0 0x55fda26602c0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61b8351640 1 -- 172.21.15.167:0/1876681726 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f61ac029030 con 0x55fda265ded0 2024-09-18T02:06:10.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda265cd40 con 0x55fda2659100 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61b8b52640 1 -- 172.21.15.167:0/1876681726 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2659100 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61ba841980 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55fda2661e10 0x55fda2664200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda2664900 con 0x55fda2661e10 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61b7b50640 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55fda2661e10 0x55fda2664200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61b7b50640 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55fda2661e10 0x55fda2664200 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61b7b50640 1 -- 172.21.15.167:0/1876681726 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f61a80b3040 con 0x55fda2661e10 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61ba841980 1 Processor -- start 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.555+0000 7f61ba841980 1 -- start start 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61ba841980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda26723d0 0x55fda26727f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61ba841980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fda2466800 con 0x55fda26723d0 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61b8351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda26723d0 0x55fda26727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.561 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61b8351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda26723d0 0x55fda26727f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51044/0 (socket says 172.21.15.167:51044) 2024-09-18T02:06:10.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61b8351640 1 -- 172.21.15.167:0/3148894113 learned_addr learned my addr 172.21.15.167:0/3148894113 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61b8351640 1 -- 172.21.15.167:0/3148894113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda2672d30 con 0x55fda26723d0 2024-09-18T02:06:10.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61b8351640 1 --2- 172.21.15.167:0/3148894113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda26723d0 0x55fda26727f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00bc00 tx=0x7f61ac02bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f609dffb640 1 -- 172.21.15.167:0/3148894113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ac047200 con 0x55fda26723d0 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61ba841980 1 -- 172.21.15.167:0/3148894113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fda2672fc0 con 0x55fda26723d0 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f609dffb640 1 -- 172.21.15.167:0/3148894113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac03d070 con 0x55fda26723d0 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f609dffb640 1 -- 172.21.15.167:0/3148894113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ac041dc0 con 0x55fda26723d0 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61ba841980 1 -- 172.21.15.167:0/3148894113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fda2675c40 con 0x55fda26723d0 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f609dffb640 1 -- 172.21.15.167:0/3148894113 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f61ac016070 con 0x55fda26723d0 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f609dffb640 1 --2- 172.21.15.167:0/3148894113 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6090034650 0x7f6090036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f609dffb640 1 -- 172.21.15.167:0/3148894113 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f61ac014070 con 0x55fda26723d0 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61b7b50640 1 --2- 172.21.15.167:0/3148894113 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6090034650 0x7f6090036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61ba841980 1 Processor -- start 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61ba841980 1 -- start start 2024-09-18T02:06:10.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61ba841980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 0x55fda267f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61b7b50640 1 --2- 172.21.15.167:0/3148894113 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6090034650 0x7f6090036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55fda265c050 tx=0x7f61a8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61ba841980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fda264d760 con 0x55fda267ec90 2024-09-18T02:06:10.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61b8351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 0x55fda267f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61b8351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 0x55fda267f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51060/0 (socket says 172.21.15.167:51060) 2024-09-18T02:06:10.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.559+0000 7f61b8351640 1 -- 172.21.15.167:0/1073204582 learned_addr learned my addr 172.21.15.167:0/1073204582 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61b8351640 1 -- 172.21.15.167:0/1073204582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda267f640 con 0x55fda267ec90 2024-09-18T02:06:10.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61b8351640 1 --2- 172.21.15.167:0/1073204582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 0x55fda267f070 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f61ac005fd0 tx=0x7f61ac0173d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325be6db95b3c4e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f60977fe640 1 -- 172.21.15.167:0/1073204582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ac02e920 con 0x55fda267ec90 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f60977fe640 1 -- 172.21.15.167:0/1073204582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac02a570 con 0x55fda267ec90 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f60977fe640 1 -- 172.21.15.167:0/1073204582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ac030170 con 0x55fda267ec90 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 -- 172.21.15.167:0/1073204582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 msgr2=0x55fda267f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 --2- 172.21.15.167:0/1073204582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 0x55fda267f070 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f61ac005fd0 tx=0x7f61ac0173d0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 -- 172.21.15.167:0/1073204582 shutdown_connections 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 --2- 172.21.15.167:0/1073204582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 0x55fda267f070 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 -- 172.21.15.167:0/1073204582 >> 172.21.15.167:0/1073204582 conn(0x55fda267b070 msgr2=0x55fda2679170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 -- 172.21.15.167:0/1073204582 shutdown_connections 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 -- 172.21.15.167:0/1073204582 wait complete. 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 Processor -- start 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 -- start start 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 0x55fda2685e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fda267fae0 con 0x55fda267ec90 2024-09-18T02:06:10.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61b8351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 0x55fda2685e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61b8351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 0x55fda2685e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:51068/0 (socket says 172.21.15.167:51068) 2024-09-18T02:06:10.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 learned_addr learned my addr 172.21.15.167:0/3022030767 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:06:10.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda26863b0 con 0x55fda267ec90 2024-09-18T02:06:10.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61b8351640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 0x55fda2685e70 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f61ac047430 tx=0x7f61ac005ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f6095ffb640 1 -- 172.21.15.167:0/3022030767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ac02a720 con 0x55fda267ec90 2024-09-18T02:06:10.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fda26863b0 con 0x55fda267ec90 2024-09-18T02:06:10.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f6095ffb640 1 -- 172.21.15.167:0/3022030767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac00c580 con 0x55fda267ec90 2024-09-18T02:06:10.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f6095ffb640 1 -- 172.21.15.167:0/3022030767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ac02aa30 con 0x55fda267ec90 2024-09-18T02:06:10.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.563+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fda2686820 con 0x55fda267ec90 2024-09-18T02:06:10.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f6095ffb640 1 -- 172.21.15.167:0/3022030767 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f61ac072030 con 0x55fda267ec90 2024-09-18T02:06:10.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f6095ffb640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6088034650 0x7f6088036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f6095ffb640 1 -- 172.21.15.167:0/3022030767 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f61ac070070 con 0x55fda267ec90 2024-09-18T02:06:10.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61b7b50640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6088034650 0x7f6088036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55fda2690f00 0x55fda26933a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda2693af0 con 0x55fda2690f00 2024-09-18T02:06:10.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61b8b52640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55fda2690f00 0x55fda26933a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61b7b50640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6088034650 0x7f6088036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55fda2664d00 tx=0x7f61a80b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61b8b52640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55fda2690f00 0x55fda26933a0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 20 realm 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda2693f00 con 0x55fda2690f00 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda26947a0 con 0x55fda2690f00 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x55fda2690f00 2024-09-18T02:06:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55fda26958a0 0x55fda2697c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda26982e0 con 0x55fda26958a0 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61b8351640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55fda26958a0 0x55fda2697c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.567+0000 7f61b8351640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55fda26958a0 0x55fda2697c90 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61ba841980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61ba841980 20 searching for the correct realm 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61ba841980 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55fda269a1c0 0x55fda269c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda269ccb0 con 0x55fda269a1c0 2024-09-18T02:06:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b7b50640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55fda269a1c0 0x55fda269c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b7b50640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55fda269a1c0 0x55fda269c630 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b7b50640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f61a80cd040 0x7f61a80b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda269ccb0 con 0x7f61a80cd040 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f61a80cd040 0x7f61a80b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f61a80cd040 0x7f61a80b7420 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x7f61a80cd040 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x55fda2690f00 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x55fda2690f00 2024-09-18T02:06:10.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x55fda2690f00 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x55fda26958a0 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x7f61a80cd040 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x55fda269a1c0 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x55fda2690f00 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.571+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x7f61a80cd040 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x55fda2690f00 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x7f61a80cd040 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fda2694b40 con 0x55fda269a1c0 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda269a1c0 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda26958a0 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda269a1c0 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda269a1c0 2024-09-18T02:06:10.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda2690f00 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda2690f00 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda26958a0 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda269a1c0 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x7f61a80cd040 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.575+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda2690f00 2024-09-18T02:06:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda26958a0 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda269a1c0 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda26958a0 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x7f61a80cd040 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda269a1c0 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda26958a0 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x55fda2690f00 2024-09-18T02:06:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a80e7080 con 0x7f61a80cd040 2024-09-18T02:06:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:06:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:06:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:06:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:06:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda2698b30 con 0x55fda2690f00 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda2698b30 con 0x55fda2690f00 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.579+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda2698b30 con 0x55fda269a1c0 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 20 zone default found 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 4 Realm: () 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 20 zonegroup default 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda2699520 con 0x55fda26958a0 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda26990a0 con 0x55fda269a1c0 2024-09-18T02:06:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda269f0a0 con 0x55fda269a1c0 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 20 started sync module instance, tier type = 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda269e450 con 0x7f61a80cd040 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94547839936880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda269e450 con 0x7f61a80cd040 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda269fb20 con 0x55fda2690f00 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.583+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94547839936880] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.587+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.587+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94547839940480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda269e450 con 0x55fda2690f00 2024-09-18T02:06:10.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.587+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a0560 con 0x55fda269a1c0 2024-09-18T02:06:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.587+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94547839940480] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.587+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.587+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94547839934368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda269e3c0 con 0x55fda269a1c0 2024-09-18T02:06:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.587+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a12a0 con 0x7f61a80cd040 2024-09-18T02:06:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.591+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.591+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94547839946160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a11d0 con 0x7f61a80cd040 2024-09-18T02:06:10.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.591+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a2160 con 0x55fda2690f00 2024-09-18T02:06:10.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.591+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94547839934368] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.591+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94547839946160] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.591+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.591+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94547839944960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a1cb0 con 0x55fda2690f00 2024-09-18T02:06:10.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.591+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a2a00 con 0x55fda26958a0 2024-09-18T02:06:10.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.595+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94547839944960] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.595+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.595+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94547839952208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a1cb0 con 0x55fda26958a0 2024-09-18T02:06:10.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.595+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a3250 con 0x55fda26958a0 2024-09-18T02:06:10.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.595+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94547839952208] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.595+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(56 notify.6 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.599 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.595+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94547839948352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a3250 con 0x55fda26958a0 2024-09-18T02:06:10.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.595+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a3c50 con 0x55fda26958a0 2024-09-18T02:06:10.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(58 notify.7 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94547839956832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a3b80 con 0x55fda26958a0 2024-09-18T02:06:10.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 20 add_watcher() i=0 2024-09-18T02:06:10.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 20 add_watcher() i=1 2024-09-18T02:06:10.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 20 add_watcher() i=2 2024-09-18T02:06:10.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 20 add_watcher() i=3 2024-09-18T02:06:10.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 20 add_watcher() i=4 2024-09-18T02:06:10.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 20 add_watcher() i=5 2024-09-18T02:06:10.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94547839948352] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 20 add_watcher() i=6 2024-09-18T02:06:10.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94547839956832] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 20 add_watcher() i=7 2024-09-18T02:06:10.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 2 all 8 watchers are set, enabling cache 2024-09-18T02:06:10.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a2da0 con 0x55fda2690f00 2024-09-18T02:06:10.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.599+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94547839954336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a4120 con 0x55fda2690f00 2024-09-18T02:06:10.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94547839954336] v32'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f606e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:10.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:06:10.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:06:10.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 5 note: GC not initialized 2024-09-18T02:06:10.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f606d7e2640 20 reqs_thread_entry: start 2024-09-18T02:06:10.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 20 init_complete bucket index max shards: 11 2024-09-18T02:06:10.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 20 Filter name: none 2024-09-18T02:06:10.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f5fdeffd640 20 reqs_thread_entry: start 2024-09-18T02:06:10.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T02:06:10.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 20 rados->read ofs=0 len=0 2024-09-18T02:06:10.606 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda26ca780 con 0x55fda26958a0 2024-09-18T02:06:10.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 20 rados_obj.operate() r=0 bl.length=473 2024-09-18T02:06:10.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T02:06:10.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T02:06:10.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.603+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26d1060 con 0x55fda26958a0 2024-09-18T02:06:10.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61ba841980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:10.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61ba841980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61ba841980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T02:06:10.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94547840142032 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fda26cc790 con 0x55fda2690f00 2024-09-18T02:06:10.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== watch-notify(notify (1) cookie 94547839944960 notify 137438953503 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f61b00188b0 con 0x55fda2690f00 2024-09-18T02:06:10.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f60977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94547839944960 notifier 4928 bl.length()=649 2024-09-18T02:06:10.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f60977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T02:06:10.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f60977fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T02:06:10.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(64 notify.4 [notify cookie 94547840142032 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f60977fe640 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f607c003eb0 con 0x55fda2690f00 2024-09-18T02:06:10.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== watch-notify(notify_complete (2) cookie 94547840142032 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f61b0018b50 con 0x55fda2690f00 2024-09-18T02:06:10.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.611 INFO:teuthology.orchestra.run.smithi167.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T02:06:08.069645Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T02:06:08.069630Z","tags":[],"group_ids":[]} 2024-09-18T02:06:10.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f606e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:06:10.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94547839954336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26d03b0 con 0x55fda2690f00 2024-09-18T02:06:10.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94547839954336] v32'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.612 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.607+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94547839936880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26d03b0 con 0x7f61a80cd040 2024-09-18T02:06:10.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.611+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94547839936880] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.611+0000 7f61ba841980 20 remove_watcher() i=0 2024-09-18T02:06:10.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.611+0000 7f61ba841980 2 removed watcher, disabling cache 2024-09-18T02:06:10.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.611+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94547839940480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26d03b0 con 0x55fda2690f00 2024-09-18T02:06:10.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.611+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94547839940480] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.611+0000 7f61ba841980 20 remove_watcher() i=1 2024-09-18T02:06:10.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.611+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94547839934368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26d03b0 con 0x55fda269a1c0 2024-09-18T02:06:10.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.615+0000 7f61b7b50640 1 -- 172.21.15.167:0/3022030767 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94547839934368] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80d8070 con 0x55fda269a1c0 2024-09-18T02:06:10.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.615+0000 7f61ba841980 20 remove_watcher() i=2 2024-09-18T02:06:10.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.615+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94547839946160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26d03b0 con 0x7f61a80cd040 2024-09-18T02:06:10.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.615+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94547839946160] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x7f61a80cd040 2024-09-18T02:06:10.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.615+0000 7f61ba841980 20 remove_watcher() i=3 2024-09-18T02:06:10.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.615+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94547839944960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda269dfa0 con 0x55fda2690f00 2024-09-18T02:06:10.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.619+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94547839944960] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x55fda2690f00 2024-09-18T02:06:10.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.619+0000 7f61ba841980 20 remove_watcher() i=4 2024-09-18T02:06:10.620 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.619+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94547839952208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a0db0 con 0x55fda26958a0 2024-09-18T02:06:10.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.619+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94547839952208] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.619+0000 7f61ba841980 20 remove_watcher() i=5 2024-09-18T02:06:10.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.619+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94547839948352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda26a0900 con 0x55fda26958a0 2024-09-18T02:06:10.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94547839948352] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 20 remove_watcher() i=6 2024-09-18T02:06:10.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94547839956832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fda269dfa0 con 0x55fda26958a0 2024-09-18T02:06:10.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61b8351640 1 -- 172.21.15.167:0/3022030767 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94547839956832] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ac029030 con 0x55fda26958a0 2024-09-18T02:06:10.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 20 remove_watcher() i=7 2024-09-18T02:06:10.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55fda26958a0 msgr2=0x55fda2697c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55fda26958a0 0x55fda2697c90 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55fda2690f00 msgr2=0x55fda26933a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55fda2690f00 0x55fda26933a0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f61a80cd040 msgr2=0x7f61a80b7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f61a80cd040 0x7f61a80b7420 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55fda269a1c0 msgr2=0x55fda269c630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55fda269a1c0 0x55fda269c630 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6088034650 msgr2=0x7f6088036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6088034650 0x7f6088036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55fda2664d00 tx=0x7f61a80b9040 comp rx=0 tx=0).stop 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 msgr2=0x55fda2685e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/3022030767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda267ec90 0x55fda2685e70 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f61ac047430 tx=0x7f61ac005ea0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 reap_dead start 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61b8b52640 1 -- 172.21.15.167:0/3022030767 reap_dead start 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 shutdown_connections 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 >> 172.21.15.167:0/3022030767 conn(0x55fda267b070 msgr2=0x55fda2679140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 shutdown_connections 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3022030767 wait complete. 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3148894113 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6090034650 msgr2=0x7f6090036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/3148894113 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6090034650 0x7f6090036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55fda265c050 tx=0x7f61a8005a10 comp rx=0 tx=0).stop 2024-09-18T02:06:10.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3148894113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda26723d0 msgr2=0x55fda26727f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/3148894113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda26723d0 0x55fda26727f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00bc00 tx=0x7f61ac02bb00 comp rx=0 tx=0).stop 2024-09-18T02:06:10.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3148894113 shutdown_connections 2024-09-18T02:06:10.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/3148894113 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f6090034650 0x7f6090036b10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/3148894113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda26723d0 0x55fda26727f0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3148894113 >> 172.21.15.167:0/3148894113 conn(0x55fda2667520 msgr2=0x55fda2669fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3148894113 shutdown_connections 2024-09-18T02:06:10.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/3148894113 wait complete. 2024-09-18T02:06:10.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55fda265ded0 msgr2=0x55fda26602c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x55fda265ded0 0x55fda26602c0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55fda2659100 msgr2=0x55fda265b510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x55fda2659100 0x55fda265b510 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55fda2661e10 msgr2=0x55fda2664200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.623+0000 7f61ba841980 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x55fda2661e10 0x55fda2664200 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.627+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f60a0034650 msgr2=0x7f60a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.627+0000 7f61ba841980 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f60a0034650 0x7f60a0036b10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f61a80ad000 tx=0x7f61a80a5040 comp rx=0 tx=0).stop 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.627+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 msgr2=0x55fda2654180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.627+0000 7f61ba841980 1 --2- 172.21.15.167:0/1876681726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda25618f0 0x55fda2654180 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x55fda264dff0 tx=0x7f61ac000bd0 comp rx=0 tx=0).stop 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.627+0000 7f61b8b52640 1 -- 172.21.15.167:0/1876681726 reap_dead start 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.627+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 shutdown_connections 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.627+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 >> 172.21.15.167:0/1876681726 conn(0x55fda24d5240 msgr2=0x55fda2647520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.627+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 shutdown_connections 2024-09-18T02:06:10.632 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:06:10.627+0000 7f61ba841980 1 -- 172.21.15.167:0/1876681726 wait complete. 2024-09-18T02:06:10.637 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:10.637 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T02:06:08.069645Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T02:06:08.069630Z', 'tags': [], 'group_ids': []} 2024-09-18T02:06:10.638 ERROR:root:0 2024-09-18T02:06:10.638 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-18T02:06:10.644 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.645 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.648 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.648 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-18T02:06:10.654 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.654 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.658 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.659 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-18T02:06:10.667 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-18T02:06:10.668 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.671 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.672 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-18T02:06:10.680 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:06:10.680 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.683 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.684 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-18T02:06:10.691 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-18T02:06:10.691 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.695 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.695 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-18T02:06:10.704 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-18T02:06:10.705 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.708 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.709 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-18T02:06:10.716 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:06:10.716 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.720 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.720 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-18T02:06:10.729 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:06:10.729 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.733 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.733 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-18T02:06:10.742 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:06:10.743 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.748 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.749 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.755 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-18T02:06:10.756 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-18T02:06:10.762 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-18T02:06:10.785 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-18T02:06:10.792 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-18T02:06:10.792 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-18T02:06:10.798 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b6f58232-12d9-447d-8d4f-091dad0fc7cc', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.11', 'marker': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T02:06:10.775714Z', 'creation_time': '2024-09-18T02:06:10.767422Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T02:06:10.798 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-18T02:06:10.804 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b6f58232-12d9-447d-8d4f-091dad0fc7cc', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.11', 'marker': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T02:06:10.775714Z', 'creation_time': '2024-09-18T02:06:10.767422Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-18T02:06:10.812 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-18T02:06:10.818 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b6f58232-12d9-447d-8d4f-091dad0fc7cc', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.11', 'marker': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T02:06:10.775714Z', 'creation_time': '2024-09-18T02:06:10.767422Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T02:06:10.819 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-18T02:06:10.823 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000352d7e03a6a2f15a-0066ea3592-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:06:10.831 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-18T02:06:10.841 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:06:10.842 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-18T02:06:10.858 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:06:10.910 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.11'} 2024-09-18T02:06:10.932 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:06:10.936 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.11'} 2024-09-18T02:06:10.959 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:06:10.959 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-18T02:06:10.980 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:06:10.993 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-18T02:06:11.005 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:06:11.005 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-18T02:06:11.012 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b6f58232-12d9-447d-8d4f-091dad0fc7cc', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.11', 'marker': 'c5231f36-c36e-44d5-8268-aaf52617db58.4235.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T02:06:10.944695Z', 'creation_time': '2024-09-18T02:06:10.767422Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T02:07:11.127 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-18T02:07:11.160 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-18T02:07:11.161 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-18T02:07:11.190 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-18T02:07:11.191 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-18T02:07:11.196 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-18T02:07:11.197 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-18T02:07:11.202 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-18T02:07:11.202 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-18T02:07:11.207 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-18T02:07:11.208 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-18T02:07:11.213 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-18T02:07:11.214 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-18T02:07:11.219 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-18T02:00:00.000000Z', 'epoch': 1726624800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-18T02:07:11.220 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-18T02:07:11.230 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:07:11.230 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-18T02:07:11.235 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-18T02:07:11.235 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-18T02:07:11.251 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:07:11.256 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-18T02:07:11.272 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:07:11.647 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-18T02:07:11.653 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000a655128b9d1776a0-0066ea35cf-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:07:11.835 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-18T02:07:11.841 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-18T02:07:11.851 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-18T02:07:11.857 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-18T02:07:12.009 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-18T02:07:12.096 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:07:12.096 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-18T02:07:12.106 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-18T02:07:12.106 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-18T02:07:12.115 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-18T02:07:12.138 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-18T02:07:12.143 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000595a3a50ffedb0a9-0066ea35d0-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:07:12.187 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-18T02:07:12.263 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:07:12.263 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T02:07:12.268 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000f82462ded9208220-0066ea35d0-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:07:12.269 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-18T02:07:12.272 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'ecc0241d-08c6-448c-b756-3dfc0b24e44a'}]}} 2024-09-18T02:07:12.272 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-18T02:07:12.295 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T02:07:12.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-18T02:07:12.299 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-18T02:07:12.300 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-18T02:07:12.305 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000005b3e16eda5afcefc-0066ea35d0-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:07:12.305 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-18T02:07:12.309 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000009894198463e095d9-0066ea35d0-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:07:12.332 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-18T02:07:12.336 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-18T02:07:12.337 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-18T02:07:12.341 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000008529cc6be1b26db4-0066ea35d0-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:07:12.342 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-18T02:07:12.345 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000459a460a1070aae1-0066ea35d0-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:07:12.346 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-18T02:07:12.350 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-18T02:07:12.351 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-18T02:07:12.354 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000df516080b1eb5dd8-0066ea35d0-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:07:12.355 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-18T02:07:12.358 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000002e9ab24621f20d55-0066ea35d0-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:07:12.359 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-18T02:07:12.362 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b9e106bce181757c-0066ea35d0-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:07:12.363 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-18T02:07:12.366 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000ca0708697f59cab6-0066ea35d0-4235-default', 'HostId': '4235-default-default'} 2024-09-18T02:07:12.367 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-18T02:07:12.386 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:07:12.387 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-18T02:07:12.391 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-18T02:07:12.391 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-18T02:07:12.401 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:07:12.402 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-18T02:07:12.406 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-18T02:07:12.406 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-18T02:07:12.416 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T02:07:12.421 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-18T02:07:12.430 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-18T02:07:12.430 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T02:07:12.432 INFO:tasks.rgw.client.0.smithi167.stdout:2024-09-18T02:07:12.426+0000 7f60e5630640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 29436) UID: 0 2024-09-18T02:07:12.432 INFO:tasks.rgw.client.0.smithi167.stdout:2024-09-18T02:07:12.426+0000 7f60e8e78a40 -1 shutting down 2024-09-18T02:07:42.937 INFO:tasks.rgw.client.0:Stopped 2024-09-18T02:07:42.938 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-18T02:07:42.944 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/vault-root-token 2024-09-18T02:07:43.001 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-18T02:07:43.056 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-18T02:07:43.056 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-18T02:07:43.057 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-18T02:07:43.135 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2024-09-18T02:07:43.136 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T02:07:43.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.134+0000 7f4ee6e75980 1 Processor -- start 2024-09-18T02:07:43.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.134+0000 7f4ee6e75980 1 -- start start 2024-09-18T02:07:43.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.134+0000 7f4ee6e75980 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5568c16eba90 0x5568c16ede80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.134+0000 7f4ee6e75980 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568c156fae0 con 0x5568c165bac0 2024-09-18T02:07:43.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.134+0000 7f4ee6e75980 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x5568c1593e30 con 0x5568c16eba90 2024-09-18T02:07:43.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.134+0000 7f4ee4184640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x5568c16eba90 0x5568c16ede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.134+0000 7f4ee4985640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x5568c165bac0 0x5568c16ea370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.167:60134/0 (socket says 172.21.15.167:60134) 2024-09-18T02:07:43.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.134+0000 7f4ee4985640 1 -- 172.21.15.167:0/1574832915 learned_addr learned my addr 172.21.15.167:0/1574832915 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-18T02:07:43.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.134+0000 7f4ee4184640 1 -- 172.21.15.167:0/1574832915 >> v1:172.21.15.81:6789/0 conn(0x5568c165bac0 legacy=0x5568c16ea370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.134+0000 7f4ee4184640 1 -- 172.21.15.167:0/1574832915 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568c16ef3d0 con 0x5568c16eba90 2024-09-18T02:07:43.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.138+0000 7f4ee4184640 1 --2- 172.21.15.167:0/1574832915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16eba90 0x5568c16ede80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800a480 tx=0x7f4ed801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed73a932d33ee9e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.138+0000 7f4ee3983640 1 -- 172.21.15.167:0/1574832915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ed80b0070 con 0x5568c16eba90 2024-09-18T02:07:43.140 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.138+0000 7f4ee3983640 1 -- 172.21.15.167:0/1574832915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ed80ab540 con 0x5568c16eba90 2024-09-18T02:07:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.138+0000 7f4ee3983640 1 -- 172.21.15.167:0/1574832915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ed80ab840 con 0x5568c16eba90 2024-09-18T02:07:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.138+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1574832915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16eba90 msgr2=0x5568c16ede80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.138+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/1574832915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16eba90 0x5568c16ede80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800a480 tx=0x7f4ed801b280 comp rx=0 tx=0).stop 2024-09-18T02:07:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.138+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1574832915 shutdown_connections 2024-09-18T02:07:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.138+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/1574832915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16eba90 0x5568c16ede80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.138+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1574832915 >> 172.21.15.167:0/1574832915 conn(0x5568c16e2060 msgr2=0x5568c16e4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.138+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1574832915 shutdown_connections 2024-09-18T02:07:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.138+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1574832915 wait complete. 2024-09-18T02:07:43.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4ee6e75980 1 Processor -- start 2024-09-18T02:07:43.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4ee6e75980 1 -- start start 2024-09-18T02:07:43.157 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4ee6e75980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 0x5568c17d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4ee6e75980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5568c1595200 con 0x5568c165bac0 2024-09-18T02:07:43.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4ee4985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 0x5568c17d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4ee4985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 0x5568c17d2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:35848/0 (socket says 172.21.15.167:35848) 2024-09-18T02:07:43.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4ee4985640 1 -- 172.21.15.167:0/4026751775 learned_addr learned my addr 172.21.15.167:0/4026751775 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:07:43.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4ee4985640 1 -- 172.21.15.167:0/4026751775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568c17d30b0 con 0x5568c165bac0 2024-09-18T02:07:43.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4ee4985640 1 --2- 172.21.15.167:0/4026751775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 0x5568c17d2ae0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0017b0 tx=0x7f4edc001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf366dbb1fe57c07 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4dd2e0d640 1 -- 172.21.15.167:0/4026751775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc016070 con 0x5568c165bac0 2024-09-18T02:07:43.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4dd2e0d640 1 -- 172.21.15.167:0/4026751775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc004530 con 0x5568c165bac0 2024-09-18T02:07:43.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.154+0000 7f4dd2e0d640 1 -- 172.21.15.167:0/4026751775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc004870 con 0x5568c165bac0 2024-09-18T02:07:43.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 -- 172.21.15.167:0/4026751775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 msgr2=0x5568c17d2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/4026751775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 0x5568c17d2ae0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0017b0 tx=0x7f4edc001c70 comp rx=0 tx=0).stop 2024-09-18T02:07:43.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 -- 172.21.15.167:0/4026751775 shutdown_connections 2024-09-18T02:07:43.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/4026751775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 0x5568c17d2ae0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 -- 172.21.15.167:0/4026751775 >> 172.21.15.167:0/4026751775 conn(0x5568c16e2060 msgr2=0x5568c17ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:43.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 -- 172.21.15.167:0/4026751775 shutdown_connections 2024-09-18T02:07:43.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 -- 172.21.15.167:0/4026751775 wait complete. 2024-09-18T02:07:43.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 Processor -- start 2024-09-18T02:07:43.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 -- start start 2024-09-18T02:07:43.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 0x5568c17d9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5568c16eee10 con 0x5568c165bac0 2024-09-18T02:07:43.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee4985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 0x5568c17d9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee4985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 0x5568c17d9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:35854/0 (socket says 172.21.15.167:35854) 2024-09-18T02:07:43.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee4985640 1 -- 172.21.15.167:0/30531026 learned_addr learned my addr 172.21.15.167:0/30531026 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:07:43.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee4985640 1 -- 172.21.15.167:0/30531026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568c17da400 con 0x5568c165bac0 2024-09-18T02:07:43.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee4985640 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 0x5568c17d9ec0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4edc014040 tx=0x7f4edc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4dd160a640 1 -- 172.21.15.167:0/30531026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc020070 con 0x5568c165bac0 2024-09-18T02:07:43.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4dd160a640 1 -- 172.21.15.167:0/30531026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc011400 con 0x5568c165bac0 2024-09-18T02:07:43.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568c17da690 con 0x5568c165bac0 2024-09-18T02:07:43.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4dd160a640 1 -- 172.21.15.167:0/30531026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc016040 con 0x5568c165bac0 2024-09-18T02:07:43.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.158+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568c17dd370 con 0x5568c165bac0 2024-09-18T02:07:43.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4dd160a640 1 -- 172.21.15.167:0/30531026 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4edc023070 con 0x5568c165bac0 2024-09-18T02:07:43.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4dd160a640 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4dcc034650 0x7f4dcc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4dd160a640 1 -- 172.21.15.167:0/30531026 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4edc049020 con 0x5568c165bac0 2024-09-18T02:07:43.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee4184640 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4dcc034650 0x7f4dcc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5568c16eba90 0x5568c17e0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c17e1500 con 0x5568c16eba90 2024-09-18T02:07:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee5186640 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5568c16eba90 0x5568c17e0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee4184640 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4dcc034650 0x7f4dcc036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80ad000 tx=0x7f4ed80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee5186640 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5568c16eba90 0x5568c17e0fc0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee5186640 1 -- 172.21.15.167:0/30531026 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ed40083f0 con 0x5568c16eba90 2024-09-18T02:07:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c17de570 con 0x5568c16eba90 2024-09-18T02:07:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee5186640 1 -- 172.21.15.167:0/30531026 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ed40083f0 con 0x5568c16eba90 2024-09-18T02:07:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5568c17e3820 0x5568c17e5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:3 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c17e6300 con 0x5568c17e3820 2024-09-18T02:07:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee4985640 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5568c17e3820 0x5568c17e5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.162+0000 7f4ee4985640 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5568c17e3820 0x5568c17e5c10 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee4985640 1 -- 172.21.15.167:0/30531026 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(3 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4edc02c070 con 0x5568c17e3820 2024-09-18T02:07:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c17e2690 con 0x5568c16eba90 2024-09-18T02:07:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee5186640 1 -- 172.21.15.167:0/30531026 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ed40083f0 con 0x5568c16eba90 2024-09-18T02:07:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5568c17e7760 0x5568c17e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:5 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c17ea250 con 0x5568c17e7760 2024-09-18T02:07:43.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee4184640 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5568c17e7760 0x5568c17e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee4184640 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5568c17e7760 0x5568c17e9b50 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee4184640 1 -- 172.21.15.167:0/30531026 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(5 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ed80b3040 con 0x5568c17e7760 2024-09-18T02:07:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee6e75980 1 Processor -- start 2024-09-18T02:07:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee6e75980 1 -- start start 2024-09-18T02:07:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee6e75980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c17f7ce0 0x5568c17f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee6e75980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5568c15ee800 con 0x5568c17f7ce0 2024-09-18T02:07:43.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee4985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c17f7ce0 0x5568c17f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee4985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c17f7ce0 0x5568c17f8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:35858/0 (socket says 172.21.15.167:35858) 2024-09-18T02:07:43.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee4985640 1 -- 172.21.15.167:0/1964530395 learned_addr learned my addr 172.21.15.167:0/1964530395 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:07:43.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee4985640 1 -- 172.21.15.167:0/1964530395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568c17f8640 con 0x5568c17f7ce0 2024-09-18T02:07:43.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee4985640 1 --2- 172.21.15.167:0/1964530395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c17f7ce0 0x5568c17f8100 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4edc047520 tx=0x7f4edc024fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4dca7fc640 1 -- 172.21.15.167:0/1964530395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc03f070 con 0x5568c17f7ce0 2024-09-18T02:07:43.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4dca7fc640 1 -- 172.21.15.167:0/1964530395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc01bd50 con 0x5568c17f7ce0 2024-09-18T02:07:43.171 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1964530395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568c17f88d0 con 0x5568c17f7ce0 2024-09-18T02:07:43.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4dca7fc640 1 -- 172.21.15.167:0/1964530395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc026ac0 con 0x5568c17f7ce0 2024-09-18T02:07:43.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.166+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1964530395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568c17fb550 con 0x5568c17f7ce0 2024-09-18T02:07:43.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4dca7fc640 1 -- 172.21.15.167:0/1964530395 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4edc043040 con 0x5568c17f7ce0 2024-09-18T02:07:43.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4dca7fc640 1 --2- 172.21.15.167:0/1964530395 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4dbc034650 0x7f4dbc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4dca7fc640 1 -- 172.21.15.167:0/1964530395 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4edc04abb0 con 0x5568c17f7ce0 2024-09-18T02:07:43.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee4184640 1 --2- 172.21.15.167:0/1964530395 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4dbc034650 0x7f4dbc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee6e75980 1 Processor -- start 2024-09-18T02:07:43.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee6e75980 1 -- start start 2024-09-18T02:07:43.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee6e75980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 0x5568c16e6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee4184640 1 --2- 172.21.15.167:0/1964530395 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4dbc034650 0x7f4dbc036b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5568c17e19c0 tx=0x7f4ed8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.173 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee6e75980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5568c17d3430 con 0x5568c16e6330 2024-09-18T02:07:43.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee4985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 0x5568c16e6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee4985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 0x5568c16e6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:35866/0 (socket says 172.21.15.167:35866) 2024-09-18T02:07:43.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee4985640 1 -- 172.21.15.167:0/1065040155 learned_addr learned my addr 172.21.15.167:0/1065040155 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:07:43.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee4985640 1 -- 172.21.15.167:0/1065040155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568c16e6ce0 con 0x5568c16e6330 2024-09-18T02:07:43.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee4985640 1 --2- 172.21.15.167:0/1065040155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 0x5568c16e6710 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00c010 tx=0x7f4edc02f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef56075b34a578f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4dbbfff640 1 -- 172.21.15.167:0/1065040155 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc041070 con 0x5568c16e6330 2024-09-18T02:07:43.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4dbbfff640 1 -- 172.21.15.167:0/1065040155 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc040b50 con 0x5568c16e6330 2024-09-18T02:07:43.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4dbbfff640 1 -- 172.21.15.167:0/1065040155 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc04c120 con 0x5568c16e6330 2024-09-18T02:07:43.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1065040155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 msgr2=0x5568c16e6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/1065040155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 0x5568c16e6710 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00c010 tx=0x7f4edc02f8d0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1065040155 shutdown_connections 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/1065040155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 0x5568c16e6710 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1065040155 >> 172.21.15.167:0/1065040155 conn(0x5568c1800a10 msgr2=0x5568c17feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1065040155 shutdown_connections 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.170+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1065040155 wait complete. 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee6e75980 1 Processor -- start 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee6e75980 1 -- start start 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee6e75980 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 0x5568c180d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee6e75980 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5568c16e7330 con 0x5568c16e6330 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee4985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 0x5568c180d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee4985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 0x5568c180d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:35874/0 (socket says 172.21.15.167:35874) 2024-09-18T02:07:43.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 learned_addr learned my addr 172.21.15.167:0/3832627242 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-18T02:07:43.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568c180df00 con 0x5568c16e6330 2024-09-18T02:07:43.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee4985640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 0x5568c180d9c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4edc02f9d0 tx=0x7f4edc012090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4dba7fc640 1 -- 172.21.15.167:0/3832627242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc048610 con 0x5568c16e6330 2024-09-18T02:07:43.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4dba7fc640 1 -- 172.21.15.167:0/3832627242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc041070 con 0x5568c16e6330 2024-09-18T02:07:43.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568c180df00 con 0x5568c16e6330 2024-09-18T02:07:43.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4dba7fc640 1 -- 172.21.15.167:0/3832627242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4edc02d690 con 0x5568c16e6330 2024-09-18T02:07:43.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568c180df00 con 0x5568c16e6330 2024-09-18T02:07:43.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4dba7fc640 1 -- 172.21.15.167:0/3832627242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4edc06f030 con 0x5568c16e6330 2024-09-18T02:07:43.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4dba7fc640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4db0034650 0x7f4db0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4dba7fc640 1 -- 172.21.15.167:0/3832627242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4edc06d070 con 0x5568c16e6330 2024-09-18T02:07:43.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.174+0000 7f4ee4184640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4db0034650 0x7f4db0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 rados->read ofs=0 len=0 2024-09-18T02:07:43.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5568c1818950 0x5568c181ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c181b560 con 0x5568c1818950 2024-09-18T02:07:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee5186640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5568c1818950 0x5568c181ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee4184640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4db0034650 0x7f4db0036b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800a480 tx=0x7f4ed80b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee5186640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5568c1818950 0x5568c181ae10 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ed40083f0 con 0x5568c1818950 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 realm 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 rados->read ofs=0 len=0 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c181b970 con 0x5568c1818950 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ed40083f0 con 0x5568c1818950 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 rados->read ofs=0 len=0 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c240 con 0x5568c1818950 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ed40083f0 con 0x5568c1818950 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:07:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 rados->read ofs=0 len=0 2024-09-18T02:07:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1818950 2024-09-18T02:07:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ed40083f0 con 0x5568c1818950 2024-09-18T02:07:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:07:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 rados->read ofs=0 len=0 2024-09-18T02:07:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5568c181d340 0x5568c181f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:5 5.17 5:eb751a1b:::zone_info.c5231f36-c36e-44d5-8268-aaf52617db58:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c181fd40 con 0x5568c181d340 2024-09-18T02:07:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee4985640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5568c181d340 0x5568c181f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee4985640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5568c181d340 0x5568c181f730 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== osd_op_reply(5 zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T02:07:43.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 20 searching for the correct realm 2024-09-18T02:07:43.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5568c1821c90 0x5568c18240a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.178+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c1824770 con 0x5568c1821c90 2024-09-18T02:07:43.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee4184640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5568c1821c90 0x5568c18240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee4184640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5568c1821c90 0x5568c18240a0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.187 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee4184640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4ed80dc040 0x7f4ed80dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c1824770 con 0x7f4ed80dc040 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4ed80dc040 0x7f4ed80dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4ed80dc040 0x7f4ed80dd430 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed40083f0 con 0x7f4ed80dc040 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x7f4ed80dc040 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed40083f0 con 0x7f4ed80dc040 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1818950 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1818950 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1818950 2024-09-18T02:07:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c181d340 2024-09-18T02:07:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x7f4ed80dc040 2024-09-18T02:07:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.182+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1821c90 2024-09-18T02:07:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1818950 2024-09-18T02:07:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x7f4ed80dc040 2024-09-18T02:07:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1818950 2024-09-18T02:07:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x7f4ed80dc040 2024-09-18T02:07:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1821c90 2024-09-18T02:07:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1821c90 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c181d340 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1821c90 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1821c90 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1818950 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1818950 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.186+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c181d340 2024-09-18T02:07:43.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.194 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1821c90 2024-09-18T02:07:43.195 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x7f4ed80dc040 2024-09-18T02:07:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1818950 2024-09-18T02:07:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c181d340 2024-09-18T02:07:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=82b] v32'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1821c90 2024-09-18T02:07:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c181d340 2024-09-18T02:07:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x7f4ed80dc040 2024-09-18T02:07:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.190+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1821c90 2024-09-18T02:07:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c181d340 2024-09-18T02:07:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x5568c1818950 2024-09-18T02:07:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568c181c5e0 con 0x7f4ed80dc040 2024-09-18T02:07:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T02:07:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 RGWRados::pool_iterate: got zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc 2024-09-18T02:07:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 RGWRados::pool_iterate: got period_config.default 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 RGWRados::pool_iterate: got zone_info.c5231f36-c36e-44d5-8268-aaf52617db58 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 rados->read ofs=0 len=0 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1820600 con 0x5568c1818950 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 rados->read ofs=0 len=0 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1820600 con 0x5568c1818950 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 rados->read ofs=0 len=0 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:40 5.16 5:6bc0fa26:::zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1820600 con 0x5568c1821c90 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 10 ==== osd_op_reply(40 zonegroup_info.b6f58232-12d9-447d-8d4f-091dad0fc7cc [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 zone default found 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 4 Realm: () 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 4 ZoneGroup: default (b6f58232-12d9-447d-8d4f-091dad0fc7cc) 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 4 Zone: default (c5231f36-c36e-44d5-8268-aaf52617db58) 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 zonegroup default 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 20 rados->read ofs=0 len=0 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.194+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1820fe0 con 0x5568c181d340 2024-09-18T02:07:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 8 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 20 rados_obj.operate() r=0 bl.length=187 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 20 rados->read ofs=0 len=0 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1826a80 con 0x5568c1821c90 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 20 rados->read ofs=0 len=0 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1826e20 con 0x5568c1821c90 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 20 started sync module instance, tier type = 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 20 started zone id=c5231f36-c36e-44d5-8268-aaf52617db58 (name=default) with tier type = 2024-09-18T02:07:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1825ec0 con 0x7f4ed80dc040 2024-09-18T02:07:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 9 ==== osd_op_reply(44 notify.0 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93908411507424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1825ec0 con 0x7f4ed80dc040 2024-09-18T02:07:43.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18276b0 con 0x5568c1818950 2024-09-18T02:07:43.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.198+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93908411507424] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.202+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 16 ==== osd_op_reply(46 notify.1 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.202+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93908411511232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1825ec0 con 0x5568c1818950 2024-09-18T02:07:43.205 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.202+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18280c0 con 0x5568c1821c90 2024-09-18T02:07:43.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.202+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93908411511232] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.206 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.202+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 13 ==== osd_op_reply(48 notify.2 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.202+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93908411505168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1825e30 con 0x5568c1821c90 2024-09-18T02:07:43.207 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.202+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1828e10 con 0x7f4ed80dc040 2024-09-18T02:07:43.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.206+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 11 ==== osd_op_reply(50 notify.3 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.206+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93908411517552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1829540 con 0x7f4ed80dc040 2024-09-18T02:07:43.208 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.206+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182a060 con 0x5568c1818950 2024-09-18T02:07:43.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.206+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93908411505168] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.209 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.206+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93908411517552] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.206+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 18 ==== osd_op_reply(52 notify.4 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.206+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93908411521840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182a020 con 0x5568c1818950 2024-09-18T02:07:43.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.206+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182a450 con 0x5568c181d340 2024-09-18T02:07:43.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.210+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93908411521840] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.210+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 9 ==== osd_op_reply(54 notify.5 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.210+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93908411518864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182a840 con 0x5568c181d340 2024-09-18T02:07:43.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.210+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182b0f0 con 0x5568c181d340 2024-09-18T02:07:43.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 10 ==== osd_op_reply(56 notify.6 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93908411528336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182bd60 con 0x5568c181d340 2024-09-18T02:07:43.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182c720 con 0x5568c181d340 2024-09-18T02:07:43.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93908411518864] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93908411528336] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 13 ==== osd_op_reply(58 notify.7 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93908411516080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182c720 con 0x5568c181d340 2024-09-18T02:07:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee6e75980 20 add_watcher() i=0 2024-09-18T02:07:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee6e75980 20 add_watcher() i=1 2024-09-18T02:07:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee6e75980 20 add_watcher() i=2 2024-09-18T02:07:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee6e75980 20 add_watcher() i=3 2024-09-18T02:07:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee6e75980 20 add_watcher() i=4 2024-09-18T02:07:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee6e75980 20 add_watcher() i=5 2024-09-18T02:07:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.214+0000 7f4ee6e75980 20 add_watcher() i=6 2024-09-18T02:07:43.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.218+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93908411516080] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.218+0000 7f4ee6e75980 20 add_watcher() i=7 2024-09-18T02:07:43.220 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.218+0000 7f4ee6e75980 2 all 8 watchers are set, enabling cache 2024-09-18T02:07:43.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.218+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c182f8e0 con 0x5568c1818950 2024-09-18T02:07:43.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.218+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.218+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93908411544272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182c720 con 0x5568c1818950 2024-09-18T02:07:43.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.218+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93908411544272] v32'280 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.218+0000 7f4d9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:07:43.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.218+0000 7f4ee6e75980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T02:07:43.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.218+0000 7f4ee6e75980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T02:07:43.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.218+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1838140 con 0x5568c1818950 2024-09-18T02:07:43.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.222+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'61 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.222+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1838750 con 0x5568c181d340 2024-09-18T02:07:43.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.222+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.226 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.222+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1838750 con 0x5568c1821c90 2024-09-18T02:07:43.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.226+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.228 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.226+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1838cc0 con 0x5568c1818950 2024-09-18T02:07:43.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.226+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'281 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.229 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.226+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1839230 con 0x7f4ed80dc040 2024-09-18T02:07:43.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.226+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'89 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.230 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.226+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18396e0 con 0x5568c1821c90 2024-09-18T02:07:43.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.230+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'67 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.230+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1839c50 con 0x5568c1818950 2024-09-18T02:07:43.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.230+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.230+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1839c50 con 0x5568c181d340 2024-09-18T02:07:43.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.234+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.236 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.234+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1839c50 con 0x7f4ed80dc040 2024-09-18T02:07:43.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.234+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.234+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1839ce0 con 0x5568c1821c90 2024-09-18T02:07:43.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.238+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.238+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a270 con 0x7f4ed80dc040 2024-09-18T02:07:43.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.238+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'90 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.238+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a250 con 0x5568c181d340 2024-09-18T02:07:43.243 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.242+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'43 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.244 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.242+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x7f4ed80dc040 2024-09-18T02:07:43.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.242+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.242+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c181d340 2024-09-18T02:07:43.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.246+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'76 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.246+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1818950 2024-09-18T02:07:43.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.246+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'282 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.250 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.246+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1821c90 2024-09-18T02:07:43.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.250+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'86 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.250+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x7f4ed80dc040 2024-09-18T02:07:43.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.250+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'91 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.250+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1821c90 2024-09-18T02:07:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.254+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.254+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1818950 2024-09-18T02:07:43.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.254+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'41 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.254+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1818950 2024-09-18T02:07:43.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.258+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'283 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.258+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1821c90 2024-09-18T02:07:43.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.258+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'87 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.263 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.258+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x7f4ed80dc040 2024-09-18T02:07:43.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.262+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.262+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1821c90 2024-09-18T02:07:43.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.262+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'40 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.262+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1821c90 2024-09-18T02:07:43.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.266+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'50 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.266+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1821c90 2024-09-18T02:07:43.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.266+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.266+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1821c90 2024-09-18T02:07:43.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.270+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'68 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.272 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.270+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c181d340 2024-09-18T02:07:43.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.270+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.275 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.270+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1821c90 2024-09-18T02:07:43.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.274+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'47 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.277 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.274+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c181d340 2024-09-18T02:07:43.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.278+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.279 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.278+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c1821c90 2024-09-18T02:07:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.278+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'88 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.278+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x5568c181d340 2024-09-18T02:07:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.282+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'77 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.282+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c183a220 con 0x7f4ed80dc040 2024-09-18T02:07:43.288 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.286+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.286+0000 7f4d9a7e4640 20 reqs_thread_entry: start 2024-09-18T02:07:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.286+0000 7f4ee6e75980 20 init_complete bucket index max shards: 11 2024-09-18T02:07:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.286+0000 7f4ee6e75980 20 Filter name: none 2024-09-18T02:07:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.286+0000 7f4d937fe640 20 reqs_thread_entry: start 2024-09-18T02:07:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.286+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-18T02:07:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.286+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:94 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18365e0 con 0x5568c1821c90 2024-09-18T02:07:43.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.286+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 27 ==== osd_op_reply(94 gc.5 [call] v32'69 uv69 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.291 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.286+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:95 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18365a0 con 0x5568c1821c90 2024-09-18T02:07:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 28 ==== osd_op_reply(95 gc.5 [call out=15b] v0'0 uv69 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:96 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c1821c90 2024-09-18T02:07:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 29 ==== osd_op_reply(96 gc.5 [call out=24b] v0'0 uv69 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:97 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 30 ==== osd_op_reply(97 gc.5 [call out=15b] v0'0 uv69 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:98 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 31 ==== osd_op_reply(98 gc.5 [call out=15b] v0'0 uv69 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.293 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:99 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 32 ==== osd_op_reply(99 gc.5 [call] v32'70 uv70 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-18T02:07:43.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.290+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:100 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1818950 2024-09-18T02:07:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 28 ==== osd_op_reply(100 gc.6 [call] v32'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:101 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1818950 2024-09-18T02:07:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 29 ==== osd_op_reply(101 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:102 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c1818950 2024-09-18T02:07:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 30 ==== osd_op_reply(102 gc.6 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:103 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1818950 2024-09-18T02:07:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 31 ==== osd_op_reply(103 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:104 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1818950 2024-09-18T02:07:43.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 32 ==== osd_op_reply(104 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.294+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:105 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1818950 2024-09-18T02:07:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.298+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 33 ==== osd_op_reply(105 gc.6 [call] v32'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.298+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-18T02:07:43.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.298+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:106 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c181d340 2024-09-18T02:07:43.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.298+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 22 ==== osd_op_reply(106 gc.7 [call] v32'64 uv64 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.298+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:107 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c181d340 2024-09-18T02:07:43.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.302+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 23 ==== osd_op_reply(107 gc.7 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.302+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.302+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:108 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c181d340 2024-09-18T02:07:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.302+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 24 ==== osd_op_reply(108 gc.7 [call out=24b] v0'0 uv64 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.302+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:109 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c181d340 2024-09-18T02:07:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.302+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 25 ==== osd_op_reply(109 gc.7 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.302+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.302+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:110 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c181d340 2024-09-18T02:07:43.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.306+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 26 ==== osd_op_reply(110 gc.7 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.306+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.306+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:111 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c181d340 2024-09-18T02:07:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.306+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 27 ==== osd_op_reply(111 gc.7 [call] v32'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.306+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-18T02:07:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.306+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:112 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 20 ==== osd_op_reply(112 gc.8 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.313 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:113 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 21 ==== osd_op_reply(113 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:114 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x7f4ed80dc040 2024-09-18T02:07:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 22 ==== osd_op_reply(114 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:115 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x7f4ed80dc040 2024-09-18T02:07:43.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 23 ==== osd_op_reply(115 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:116 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x7f4ed80dc040 2024-09-18T02:07:43.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 24 ==== osd_op_reply(116 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.310+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:117 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.314+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 25 ==== osd_op_reply(117 gc.8 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.314+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-18T02:07:43.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.314+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:118 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.314+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 33 ==== osd_op_reply(118 gc.9 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.314+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:119 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.314+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 34 ==== osd_op_reply(119 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.314+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.314+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:120 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c1821c90 2024-09-18T02:07:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.314+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 35 ==== osd_op_reply(120 gc.9 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.314+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.318+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 36 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.318+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.318+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.318+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 37 ==== osd_op_reply(122 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.318+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.318+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.318+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 38 ==== osd_op_reply(123 gc.9 [call] v32'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.318+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-18T02:07:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.318+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 26 ==== osd_op_reply(124 gc.10 [call] v32'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 27 ==== osd_op_reply(125 gc.10 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 28 ==== osd_op_reply(126 gc.10 [call out=24b] v0'0 uv92 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:127 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 29 ==== osd_op_reply(127 gc.10 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:128 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 30 ==== osd_op_reply(128 gc.10 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:129 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 31 ==== osd_op_reply(129 gc.10 [call] v32'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-18T02:07:43.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.322+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:130 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c181d340 2024-09-18T02:07:43.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.326+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 28 ==== osd_op_reply(130 gc.11 [call] v32'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.326+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:131 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c181d340 2024-09-18T02:07:43.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.326+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 29 ==== osd_op_reply(131 gc.11 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.326+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.326+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:132 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c181d340 2024-09-18T02:07:43.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.326+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 30 ==== osd_op_reply(132 gc.11 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.326+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:133 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c181d340 2024-09-18T02:07:43.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.330+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 31 ==== osd_op_reply(133 gc.11 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.330+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.330+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:134 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c181d340 2024-09-18T02:07:43.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.330+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 32 ==== osd_op_reply(134 gc.11 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.330+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.330+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:135 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c181d340 2024-09-18T02:07:43.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 33 ==== osd_op_reply(135 gc.11 [call] v32'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-18T02:07:43.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:136 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 32 ==== osd_op_reply(136 gc.12 [call] v32'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:137 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 33 ==== osd_op_reply(137 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:138 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x7f4ed80dc040 2024-09-18T02:07:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 34 ==== osd_op_reply(138 gc.12 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:139 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x7f4ed80dc040 2024-09-18T02:07:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 35 ==== osd_op_reply(139 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.334+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:140 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x7f4ed80dc040 2024-09-18T02:07:43.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.338+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 36 ==== osd_op_reply(140 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.338+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.338+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:141 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x7f4ed80dc040 2024-09-18T02:07:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.338+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 37 ==== osd_op_reply(141 gc.12 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.338+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-18T02:07:43.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.338+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:142 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c181d340 2024-09-18T02:07:43.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.342+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 34 ==== osd_op_reply(142 gc.13 [call] v32'78 uv78 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.342+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:143 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c181d340 2024-09-18T02:07:43.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.342+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 35 ==== osd_op_reply(143 gc.13 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.342+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.342+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:144 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c181d340 2024-09-18T02:07:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.342+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 36 ==== osd_op_reply(144 gc.13 [call out=24b] v0'0 uv78 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.342+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:145 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c181d340 2024-09-18T02:07:43.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.346+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 37 ==== osd_op_reply(145 gc.13 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.346+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.348 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.346+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:146 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c181d340 2024-09-18T02:07:43.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.346+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 38 ==== osd_op_reply(146 gc.13 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.346+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.346+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:147 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c181d340 2024-09-18T02:07:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.346+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 39 ==== osd_op_reply(147 gc.13 [call] v32'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.346+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-18T02:07:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.346+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:148 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c1818950 2024-09-18T02:07:43.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 34 ==== osd_op_reply(148 gc.14 [call] v32'284 uv284 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:149 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c1818950 2024-09-18T02:07:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 35 ==== osd_op_reply(149 gc.14 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:150 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c1818950 2024-09-18T02:07:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 36 ==== osd_op_reply(150 gc.14 [call out=24b] v0'0 uv284 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:151 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c1818950 2024-09-18T02:07:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 37 ==== osd_op_reply(151 gc.14 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:152 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c1818950 2024-09-18T02:07:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 38 ==== osd_op_reply(152 gc.14 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.350+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:153 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c1818950 2024-09-18T02:07:43.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.354+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 39 ==== osd_op_reply(153 gc.14 [call] v32'285 uv285 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.354+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-18T02:07:43.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.354+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:154 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 39 ==== osd_op_reply(154 gc.15 [call] v32'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:155 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 40 ==== osd_op_reply(155 gc.15 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:156 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x5568c1821c90 2024-09-18T02:07:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 41 ==== osd_op_reply(156 gc.15 [call out=24b] v0'0 uv89 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.361 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:157 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 42 ==== osd_op_reply(157 gc.15 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:158 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 43 ==== osd_op_reply(158 gc.15 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.358+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:159 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x5568c1821c90 2024-09-18T02:07:43.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.362+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 44 ==== osd_op_reply(159 gc.15 [call] v32'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.362+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-18T02:07:43.365 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.362+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:160 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.362+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 38 ==== osd_op_reply(160 gc.16 [call] v32'94 uv94 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.362+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:161 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 39 ==== osd_op_reply(161 gc.16 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:162 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1835520 con 0x7f4ed80dc040 2024-09-18T02:07:43.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 40 ==== osd_op_reply(162 gc.16 [call out=24b] v0'0 uv94 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:163 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1836530 con 0x7f4ed80dc040 2024-09-18T02:07:43.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 41 ==== osd_op_reply(163 gc.16 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:164 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18569c0 con 0x7f4ed80dc040 2024-09-18T02:07:43.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 42 ==== osd_op_reply(164 gc.16 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:165 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18569c0 con 0x7f4ed80dc040 2024-09-18T02:07:43.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 43 ==== osd_op_reply(165 gc.16 [call] v32'95 uv95 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-18T02:07:43.371 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.366+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:166 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18569c0 con 0x5568c1821c90 2024-09-18T02:07:43.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.370+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 45 ==== osd_op_reply(166 gc.17 [call] v32'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.370+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:167 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18569c0 con 0x5568c1821c90 2024-09-18T02:07:43.373 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.370+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 46 ==== osd_op_reply(167 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.370+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.370+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:168 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18559b0 con 0x5568c1821c90 2024-09-18T02:07:43.374 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.370+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 47 ==== osd_op_reply(168 gc.17 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.370+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:169 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18569c0 con 0x5568c1821c90 2024-09-18T02:07:43.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.370+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 48 ==== osd_op_reply(169 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.370+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.375 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.370+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:170 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18569c0 con 0x5568c1821c90 2024-09-18T02:07:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.374+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 49 ==== osd_op_reply(170 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.374+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.374+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:171 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18569c0 con 0x5568c1821c90 2024-09-18T02:07:43.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.374+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 50 ==== osd_op_reply(171 gc.17 [call] v32'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.374+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-18T02:07:43.377 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.374+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:172 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18569c0 con 0x5568c1818950 2024-09-18T02:07:43.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 40 ==== osd_op_reply(172 gc.18 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.380 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:173 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18569c0 con 0x5568c1818950 2024-09-18T02:07:43.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 41 ==== osd_op_reply(173 gc.18 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:174 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18559b0 con 0x5568c1818950 2024-09-18T02:07:43.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 42 ==== osd_op_reply(174 gc.18 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.381 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:175 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18569c0 con 0x5568c1818950 2024-09-18T02:07:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 43 ==== osd_op_reply(175 gc.18 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:176 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18569c0 con 0x5568c1818950 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 44 ==== osd_op_reply(176 gc.18 [call out=1716b] v0'0 uv42 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 20 garbage collection: RGWGC::process iterating over entry tag='c5231f36-c36e-44d5-8268-aaf52617db58.4235.14702630667498799510', time=2024-09-18T02:07:26.645396+0000, chain.objs.size()=7 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_1 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:177 3.3e 3:7deabb6f:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1856e70 con 0x5568c181d340 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_2 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:178 3.c 3:33dbf31c:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1859a70 con 0x5568c1821c90 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_3 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:179 3.a 3:51073578:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c185c3d0 con 0x5568c1821c90 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_4 2024-09-18T02:07:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:180 3.13 3:cbfda565:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c185ed20 con 0x5568c1821c90 2024-09-18T02:07:43.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_5 2024-09-18T02:07:43.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:181 3.b 3:d0f7092d:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c185c3d0 con 0x5568c181d340 2024-09-18T02:07:43.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_6 2024-09-18T02:07:43.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:182 3.11 3:8afef2b5:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1863ac0 con 0x5568c1821c90 2024-09-18T02:07:43.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_7 2024-09-18T02:07:43.385 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.378+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:183 3.10 3:09dd8f18:::c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1866330 con 0x5568c1818950 2024-09-18T02:07:43.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.386+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 51 ==== osd_op_reply(179 c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_3 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.388 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.386+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 52 ==== osd_op_reply(180 c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_4 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.386+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 45 ==== osd_op_reply(183 c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_7 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.386+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 53 ==== osd_op_reply(182 c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_6 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.386+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 40 ==== osd_op_reply(181 c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_5 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.389 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.386+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 41 ==== osd_op_reply(177 c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_1 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.386+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 54 ==== osd_op_reply(178 c5231f36-c36e-44d5-8268-aaf52617db58.4235.11__shadow_.Knhx1eNOn1234Qtc8L3PJR-WvTtwwdb_2 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.386+0000 7f4ee6e75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-18T02:07:43.391 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.386+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:184 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18593e0 con 0x5568c1818950 2024-09-18T02:07:43.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.390+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 46 ==== osd_op_reply(184 gc.18 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.393 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.390+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:185 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18593e0 con 0x5568c1818950 2024-09-18T02:07:43.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.394+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 47 ==== osd_op_reply(185 gc.18 [call] v32'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.394+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-18T02:07:43.396 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.394+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:186 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18593e0 con 0x5568c1818950 2024-09-18T02:07:43.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.394+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 48 ==== osd_op_reply(186 gc.19 [call] v32'286 uv286 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.394+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:187 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18593e0 con 0x5568c1818950 2024-09-18T02:07:43.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.394+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 49 ==== osd_op_reply(187 gc.19 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.394+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.394+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:188 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18559b0 con 0x5568c1818950 2024-09-18T02:07:43.399 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.398+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 50 ==== osd_op_reply(188 gc.19 [call out=24b] v0'0 uv286 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.398+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:189 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18593e0 con 0x5568c1818950 2024-09-18T02:07:43.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.398+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 51 ==== osd_op_reply(189 gc.19 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.398+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.400 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.398+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:190 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c18593e0 con 0x5568c1818950 2024-09-18T02:07:43.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.398+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 52 ==== osd_op_reply(190 gc.19 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.398+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.401 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.398+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:191 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18593e0 con 0x5568c1818950 2024-09-18T02:07:43.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.402+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 53 ==== osd_op_reply(191 gc.19 [call] v32'287 uv287 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.402+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-18T02:07:43.403 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.402+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:192 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c18593e0 con 0x5568c1821c90 2024-09-18T02:07:43.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.402+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 55 ==== osd_op_reply(192 gc.20 [call] v32'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.402+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:193 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857350 con 0x5568c1821c90 2024-09-18T02:07:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.402+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 56 ==== osd_op_reply(193 gc.20 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.406+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.406+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:194 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857350 con 0x5568c1821c90 2024-09-18T02:07:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.406+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 57 ==== osd_op_reply(194 gc.20 [call out=24b] v0'0 uv91 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.406+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:195 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857350 con 0x5568c1821c90 2024-09-18T02:07:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.406+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 58 ==== osd_op_reply(195 gc.20 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.406+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.406+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:196 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857350 con 0x5568c1821c90 2024-09-18T02:07:43.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.406+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 59 ==== osd_op_reply(196 gc.20 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.406+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.410 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.406+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:197 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857350 con 0x5568c1821c90 2024-09-18T02:07:43.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.410+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 60 ==== osd_op_reply(197 gc.20 [call] v32'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.410+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-18T02:07:43.413 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.410+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:198 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857350 con 0x7f4ed80dc040 2024-09-18T02:07:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 44 ==== osd_op_reply(198 gc.21 [call] v32'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:199 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857350 con 0x7f4ed80dc040 2024-09-18T02:07:43.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 45 ==== osd_op_reply(199 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:200 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 46 ==== osd_op_reply(200 gc.21 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:201 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 47 ==== osd_op_reply(201 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:202 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 48 ==== osd_op_reply(202 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.414+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:203 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.418+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 49 ==== osd_op_reply(203 gc.21 [call] v32'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.418+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-18T02:07:43.420 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.418+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:204 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.418+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 61 ==== osd_op_reply(204 gc.22 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.418+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:205 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.418+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 62 ==== osd_op_reply(205 gc.22 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:206 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 63 ==== osd_op_reply(206 gc.22 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:207 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 64 ==== osd_op_reply(207 gc.22 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:208 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 65 ==== osd_op_reply(208 gc.22 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.425 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:209 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 66 ==== osd_op_reply(209 gc.22 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-18T02:07:43.427 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.422+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:210 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 67 ==== osd_op_reply(210 gc.23 [call] v32'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:211 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 68 ==== osd_op_reply(211 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:212 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 69 ==== osd_op_reply(212 gc.23 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:213 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.430 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 70 ==== osd_op_reply(213 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:214 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 71 ==== osd_op_reply(214 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.426+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:215 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.430+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 72 ==== osd_op_reply(215 gc.23 [call] v32'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.430+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-18T02:07:43.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.430+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:216 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.430+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 73 ==== osd_op_reply(216 gc.24 [call] v32'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.430+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:217 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.430+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 74 ==== osd_op_reply(217 gc.24 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.430+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.430+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:218 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.430+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 75 ==== osd_op_reply(218 gc.24 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.430+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:219 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.434+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 76 ==== osd_op_reply(219 gc.24 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.434+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.434+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:220 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.434+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 77 ==== osd_op_reply(220 gc.24 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.434+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.434+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:221 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.434+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 78 ==== osd_op_reply(221 gc.24 [call] v32'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.434+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-18T02:07:43.438 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.434+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:222 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 79 ==== osd_op_reply(222 gc.25 [call] v32'71 uv71 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:223 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 80 ==== osd_op_reply(223 gc.25 [call out=15b] v0'0 uv71 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:224 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 81 ==== osd_op_reply(224 gc.25 [call out=24b] v0'0 uv71 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:225 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 82 ==== osd_op_reply(225 gc.25 [call out=15b] v0'0 uv71 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:226 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 83 ==== osd_op_reply(226 gc.25 [call out=15b] v0'0 uv71 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.438+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:227 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.443 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.442+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 84 ==== osd_op_reply(227 gc.25 [call] v32'72 uv72 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.442+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-18T02:07:43.444 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.442+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:228 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.442+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 42 ==== osd_op_reply(228 gc.26 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.442+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:229 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.446+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 43 ==== osd_op_reply(229 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.446+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.446+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:230 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.446+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 44 ==== osd_op_reply(230 gc.26 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.449 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.446+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:231 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.446+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 45 ==== osd_op_reply(231 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.446+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.450 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.446+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:232 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.450+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 46 ==== osd_op_reply(232 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.450+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.450+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:233 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.450+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 47 ==== osd_op_reply(233 gc.26 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.450+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-18T02:07:43.454 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.450+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:234 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.454+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 85 ==== osd_op_reply(234 gc.27 [call] v32'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.456 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.454+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:235 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.454+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 86 ==== osd_op_reply(235 gc.27 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.454+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.454+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:236 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.454+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 87 ==== osd_op_reply(236 gc.27 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.454+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:237 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.454+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 88 ==== osd_op_reply(237 gc.27 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.454+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.454+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:238 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.458+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 89 ==== osd_op_reply(238 gc.27 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.458+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.459 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.458+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:239 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.458+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 90 ==== osd_op_reply(239 gc.27 [call] v32'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.458+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-18T02:07:43.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.458+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:240 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.462+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 48 ==== osd_op_reply(240 gc.28 [call] v32'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.462+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:241 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.462+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 49 ==== osd_op_reply(241 gc.28 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.462+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.466 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.462+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:242 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.462+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 50 ==== osd_op_reply(242 gc.28 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.462+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:243 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.466+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 51 ==== osd_op_reply(243 gc.28 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.466+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.466+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:244 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.466+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 52 ==== osd_op_reply(244 gc.28 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.466+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.466+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:245 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.470+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 53 ==== osd_op_reply(245 gc.28 [call] v32'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.470+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-18T02:07:43.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.470+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:246 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.474+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 91 ==== osd_op_reply(246 gc.29 [call] v32'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.476 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.474+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:247 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.474+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 92 ==== osd_op_reply(247 gc.29 [call out=15b] v0'0 uv93 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.474+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.477 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.474+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:248 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.474+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 93 ==== osd_op_reply(248 gc.29 [call out=24b] v0'0 uv93 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.478 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.474+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:249 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.474+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 94 ==== osd_op_reply(249 gc.29 [call out=15b] v0'0 uv93 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.474+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.474+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:250 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.478+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 95 ==== osd_op_reply(250 gc.29 [call out=15b] v0'0 uv93 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.478+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.480 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.478+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:251 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.478+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 96 ==== osd_op_reply(251 gc.29 [call] v32'94 uv94 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.478+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-18T02:07:43.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.478+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:252 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.482+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 54 ==== osd_op_reply(252 gc.30 [call] v32'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.482+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:253 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.486+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 55 ==== osd_op_reply(253 gc.30 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.486+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.486+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:254 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.486+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 56 ==== osd_op_reply(254 gc.30 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.489 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.486+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:255 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.486+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 57 ==== osd_op_reply(255 gc.30 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.486+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.490 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.486+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:256 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.486+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 58 ==== osd_op_reply(256 gc.30 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.490+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.491 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.490+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:257 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.490+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 59 ==== osd_op_reply(257 gc.30 [call] v32'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.490+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-18T02:07:43.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.490+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:258 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.494+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 50 ==== osd_op_reply(258 gc.31 [call] v32'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.494+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:259 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.494+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 51 ==== osd_op_reply(259 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.494+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.494+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:260 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1855e60 con 0x7f4ed80dc040 2024-09-18T02:07:43.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.494+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 52 ==== osd_op_reply(260 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.494+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:261 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1855e60 con 0x7f4ed80dc040 2024-09-18T02:07:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.498+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 53 ==== osd_op_reply(261 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.498+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.498+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:262 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1855e60 con 0x7f4ed80dc040 2024-09-18T02:07:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.498+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 54 ==== osd_op_reply(262 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.498+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.498+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:263 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.498+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 55 ==== osd_op_reply(263 gc.31 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.498+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-18T02:07:43.503 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.498+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:264 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1818950 2024-09-18T02:07:43.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.502+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 54 ==== osd_op_reply(264 gc.0 [call] v32'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.506 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.502+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:265 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1818950 2024-09-18T02:07:43.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.502+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 55 ==== osd_op_reply(265 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.502+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.502+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:266 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1855e60 con 0x5568c1818950 2024-09-18T02:07:43.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.502+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 56 ==== osd_op_reply(266 gc.0 [call out=24b] v0'0 uv62 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.502+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:267 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1855e60 con 0x5568c1818950 2024-09-18T02:07:43.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.506+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 57 ==== osd_op_reply(267 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.506+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.506+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:268 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1855e60 con 0x5568c1818950 2024-09-18T02:07:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.506+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 58 ==== osd_op_reply(268 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.506+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.506+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:269 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1818950 2024-09-18T02:07:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.506+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 59 ==== osd_op_reply(269 gc.0 [call] v32'63 uv63 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.506+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-18T02:07:43.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.506+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:270 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.513 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.510+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 60 ==== osd_op_reply(270 gc.1 [call] v32'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.510+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:271 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.510+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 61 ==== osd_op_reply(271 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.510+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.510+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:272 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.514+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 62 ==== osd_op_reply(272 gc.1 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.514+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:273 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.514+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 63 ==== osd_op_reply(273 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.514+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.514+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:274 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.514+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 64 ==== osd_op_reply(274 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.514+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.514+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:275 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c181d340 2024-09-18T02:07:43.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.518+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 65 ==== osd_op_reply(275 gc.1 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.518+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-18T02:07:43.522 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.518+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:276 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 97 ==== osd_op_reply(276 gc.2 [call] v32'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:277 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 98 ==== osd_op_reply(277 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:278 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 99 ==== osd_op_reply(278 gc.2 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:279 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 100 ==== osd_op_reply(279 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:280 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 101 ==== osd_op_reply(280 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.522+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:281 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1821c90 2024-09-18T02:07:43.528 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.526+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 102 ==== osd_op_reply(281 gc.2 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.526+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-18T02:07:43.529 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.526+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:282 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1818950 2024-09-18T02:07:43.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.526+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 60 ==== osd_op_reply(282 gc.3 [call] v32'288 uv288 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.526+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:283 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1818950 2024-09-18T02:07:43.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 61 ==== osd_op_reply(283 gc.3 [call out=15b] v0'0 uv288 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:284 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1855e60 con 0x5568c1818950 2024-09-18T02:07:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 62 ==== osd_op_reply(284 gc.3 [call out=24b] v0'0 uv288 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:285 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1855e60 con 0x5568c1818950 2024-09-18T02:07:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 63 ==== osd_op_reply(285 gc.3 [call out=15b] v0'0 uv288 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:286 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1855e60 con 0x5568c1818950 2024-09-18T02:07:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 64 ==== osd_op_reply(286 gc.3 [call out=15b] v0'0 uv288 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:287 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1818950 2024-09-18T02:07:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 65 ==== osd_op_reply(287 gc.3 [call] v32'289 uv289 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee6e75980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-18T02:07:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.530+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:288 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.534+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 56 ==== osd_op_reply(288 gc.4 [call] v32'96 uv96 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.534+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:289 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.534+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 57 ==== osd_op_reply(289 gc.4 [call out=15b] v0'0 uv96 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.534+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.534+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:290 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.534+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 58 ==== osd_op_reply(290 gc.4 [call out=24b] v0'0 uv96 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.534+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:291 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.534+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 59 ==== osd_op_reply(291 gc.4 [call out=15b] v0'0 uv96 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.534+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T02:07:43.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.534+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:292 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.538+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 60 ==== osd_op_reply(292 gc.4 [call out=15b] v0'0 uv96 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.538+0000 7f4ee6e75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T02:07:43.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.538+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:293 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x7f4ed80dc040 2024-09-18T02:07:43.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.538+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 61 ==== osd_op_reply(293 gc.4 [call] v32'97 uv97 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.542+0000 7f4d9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T02:07:43.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.542+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93908411544272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1857300 con 0x5568c1818950 2024-09-18T02:07:43.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.546+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93908411544272] v32'290 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.546+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93908411507424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182f2d0 con 0x7f4ed80dc040 2024-09-18T02:07:43.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.546+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93908411507424] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.546+0000 7f4ee6e75980 20 remove_watcher() i=0 2024-09-18T02:07:43.550 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.546+0000 7f4ee6e75980 2 removed watcher, disabling cache 2024-09-18T02:07:43.551 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.546+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93908411511232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182f2d0 con 0x5568c1818950 2024-09-18T02:07:43.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.550+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93908411511232] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.550+0000 7f4ee6e75980 20 remove_watcher() i=1 2024-09-18T02:07:43.552 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.550+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93908411505168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182f2d0 con 0x5568c1821c90 2024-09-18T02:07:43.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.550+0000 7f4ee4184640 1 -- 172.21.15.167:0/3832627242 <== osd.3 v2:172.21.15.167:6808/2476454287 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93908411505168] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed80c9030 con 0x5568c1821c90 2024-09-18T02:07:43.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.550+0000 7f4ee6e75980 20 remove_watcher() i=2 2024-09-18T02:07:43.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.550+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93908411517552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1825a10 con 0x7f4ed80dc040 2024-09-18T02:07:43.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.554+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.2 v2:172.21.15.167:6816/2055439504 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93908411517552] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x7f4ed80dc040 2024-09-18T02:07:43.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.554+0000 7f4ee6e75980 20 remove_watcher() i=3 2024-09-18T02:07:43.557 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.554+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93908411521840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182f2d0 con 0x5568c1818950 2024-09-18T02:07:43.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.558+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 <== osd.1 v2:172.21.15.167:6800/15864359 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93908411521840] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ed4026040 con 0x5568c1818950 2024-09-18T02:07:43.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.558+0000 7f4ee6e75980 20 remove_watcher() i=4 2024-09-18T02:07:43.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.558+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93908411518864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1825a10 con 0x5568c181d340 2024-09-18T02:07:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.558+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93908411518864] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.558+0000 7f4ee6e75980 20 remove_watcher() i=5 2024-09-18T02:07:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.558+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93908411528336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c182f2d0 con 0x5568c181d340 2024-09-18T02:07:43.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.562+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93908411528336] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.562+0000 7f4ee6e75980 20 remove_watcher() i=6 2024-09-18T02:07:43.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.562+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93908411516080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568c1825a10 con 0x5568c181d340 2024-09-18T02:07:43.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee4985640 1 -- 172.21.15.167:0/3832627242 <== osd.0 v2:172.21.15.81:6800/3087415523 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93908411516080] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4edc038070 con 0x5568c181d340 2024-09-18T02:07:43.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 20 remove_watcher() i=7 2024-09-18T02:07:43.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5568c181d340 msgr2=0x5568c181f730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5568c181d340 0x5568c181f730 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5568c1818950 msgr2=0x5568c181ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5568c1818950 0x5568c181ae10 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4ed80dc040 msgr2=0x7f4ed80dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f4ed80dc040 0x7f4ed80dd430 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5568c1821c90 msgr2=0x5568c18240a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5568c1821c90 0x5568c18240a0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4db0034650 msgr2=0x7f4db0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4db0034650 0x7f4db0036b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800a480 tx=0x7f4ed80b9040 comp rx=0 tx=0).stop 2024-09-18T02:07:43.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 msgr2=0x5568c180d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/3832627242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c16e6330 0x5568c180d9c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4edc02f9d0 tx=0x7f4edc012090 comp rx=0 tx=0).stop 2024-09-18T02:07:43.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 reap_dead start 2024-09-18T02:07:43.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee5186640 1 -- 172.21.15.167:0/3832627242 reap_dead start 2024-09-18T02:07:43.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 shutdown_connections 2024-09-18T02:07:43.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 >> 172.21.15.167:0/3832627242 conn(0x5568c1800a10 msgr2=0x5568c17feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:43.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 shutdown_connections 2024-09-18T02:07:43.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/3832627242 wait complete. 2024-09-18T02:07:43.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1964530395 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4dbc034650 msgr2=0x7f4dbc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/1964530395 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4dbc034650 0x7f4dbc036b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5568c17e19c0 tx=0x7f4ed8005a10 comp rx=0 tx=0).stop 2024-09-18T02:07:43.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1964530395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c17f7ce0 msgr2=0x5568c17f8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/1964530395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c17f7ce0 0x5568c17f8100 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4edc047520 tx=0x7f4edc024fa0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1964530395 shutdown_connections 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/1964530395 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4dbc034650 0x7f4dbc036b10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/1964530395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c17f7ce0 0x5568c17f8100 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1964530395 >> 172.21.15.167:0/1964530395 conn(0x5568c17ece30 msgr2=0x5568c17ef8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1964530395 shutdown_connections 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/1964530395 wait complete. 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5568c17e3820 msgr2=0x5568c17e5c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x5568c17e3820 0x5568c17e5c10 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5568c16eba90 msgr2=0x5568c17e0fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x5568c16eba90 0x5568c17e0fc0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5568c17e7760 msgr2=0x5568c17e9b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x5568c17e7760 0x5568c17e9b50 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4dcc034650 msgr2=0x7f4dcc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f4dcc034650 0x7f4dcc036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80ad000 tx=0x7f4ed80a5040 comp rx=0 tx=0).stop 2024-09-18T02:07:43.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 msgr2=0x5568c17d9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 --2- 172.21.15.167:0/30531026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568c165bac0 0x5568c17d9ec0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4edc014040 tx=0x7f4edc001260 comp rx=0 tx=0).stop 2024-09-18T02:07:43.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee5186640 1 -- 172.21.15.167:0/30531026 reap_dead start 2024-09-18T02:07:43.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 shutdown_connections 2024-09-18T02:07:43.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 >> 172.21.15.167:0/30531026 conn(0x5568c16e2060 msgr2=0x5568c17cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:43.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 shutdown_connections 2024-09-18T02:07:43.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T02:07:43.566+0000 7f4ee6e75980 1 -- 172.21.15.167:0/30531026 wait complete. 2024-09-18T02:07:43.586 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-18T02:07:43.600 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T02:07:43.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T02:07:43.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.729+0000 7febc4f45640 1 Processor -- start 2024-09-18T02:07:43.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.729+0000 7febc4f45640 1 -- start start 2024-09-18T02:07:43.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.729+0000 7febc4f45640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7febc006d0e0 0x7febc006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.729+0000 7febc4f45640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc0071c10 con 0x7febc006da00 2024-09-18T02:07:43.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.729+0000 7febc4f45640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7febc0072230 con 0x7febc006d0e0 2024-09-18T02:07:43.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.729+0000 7febbe59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7febc006d0e0 0x7febc006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.729+0000 7febbdd9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7febc006da00 0x7febc012ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39696/0 (socket says 172.21.15.81:39696) 2024-09-18T02:07:43.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.729+0000 7febbdd9b640 1 -- 172.21.15.81:0/590084937 learned_addr learned my addr 172.21.15.81:0/590084937 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:43.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febbe59c640 1 -- 172.21.15.81:0/590084937 >> v1:172.21.15.81:6789/0 conn(0x7febc006da00 legacy=0x7febc012ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febbe59c640 1 -- 172.21.15.81:0/590084937 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc00709e0 con 0x7febc006d0e0 2024-09-18T02:07:43.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febbd59a640 1 -- 172.21.15.81:0/590084937 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2670059216 0 0) 0x7febc0071c10 con 0x7febc006da00 2024-09-18T02:07:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febbe59c640 1 --2- 172.21.15.81:0/590084937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc006d0e0 0x7febc006d4c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7febb8009d90 tx=0x7febb801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30421a2c46810b2a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febbd59a640 1 -- 172.21.15.81:0/590084937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febb80a6560 con 0x7febc006d0e0 2024-09-18T02:07:43.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febbd59a640 1 -- 172.21.15.81:0/590084937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb80a6700 con 0x7febc006d0e0 2024-09-18T02:07:43.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febbd59a640 1 -- 172.21.15.81:0/590084937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febb80a6a00 con 0x7febc006d0e0 2024-09-18T02:07:43.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febc4f45640 1 -- 172.21.15.81:0/590084937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc006d0e0 msgr2=0x7febc006d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febc4f45640 1 --2- 172.21.15.81:0/590084937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc006d0e0 0x7febc006d4c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7febb8009d90 tx=0x7febb801c8c0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febc4f45640 1 -- 172.21.15.81:0/590084937 shutdown_connections 2024-09-18T02:07:43.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febc4f45640 1 --2- 172.21.15.81:0/590084937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc006d0e0 0x7febc006d4c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febc4f45640 1 -- 172.21.15.81:0/590084937 >> 172.21.15.81:0/590084937 conn(0x7febc0099a50 msgr2=0x7febc00972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:43.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febc4f45640 1 -- 172.21.15.81:0/590084937 shutdown_connections 2024-09-18T02:07:43.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febc4f45640 1 -- 172.21.15.81:0/590084937 wait complete. 2024-09-18T02:07:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.733+0000 7febc4f45640 1 Processor -- start 2024-09-18T02:07:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febc4f45640 1 -- start start 2024-09-18T02:07:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febc4f45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc006d0e0 0x7febc006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febc4f45640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7febc0134e80 con 0x7febc006d0e0 2024-09-18T02:07:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febbe59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc006d0e0 0x7febc006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febbe59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc006d0e0 0x7febc006e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39874/0 (socket says 172.21.15.81:39874) 2024-09-18T02:07:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febbe59c640 1 -- 172.21.15.81:0/357114232 learned_addr learned my addr 172.21.15.81:0/357114232 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febbe59c640 1 -- 172.21.15.81:0/357114232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc006fa10 con 0x7febc006d0e0 2024-09-18T02:07:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febbe59c640 1 --2- 172.21.15.81:0/357114232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc006d0e0 0x7febc006e1f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7febb8009d90 tx=0x7febb8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febb6ffd640 1 -- 172.21.15.81:0/357114232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febb80bb570 con 0x7febc006d0e0 2024-09-18T02:07:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febb6ffd640 1 -- 172.21.15.81:0/357114232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb80c0070 con 0x7febc006d0e0 2024-09-18T02:07:43.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febc4f45640 1 -- 172.21.15.81:0/357114232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc012bd90 con 0x7febc006d0e0 2024-09-18T02:07:43.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febb6ffd640 1 -- 172.21.15.81:0/357114232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febb80bb840 con 0x7febc006d0e0 2024-09-18T02:07:43.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febc4f45640 1 -- 172.21.15.81:0/357114232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc006fed0 con 0x7febc006d0e0 2024-09-18T02:07:43.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febb6ffd640 1 -- 172.21.15.81:0/357114232 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7febb80bb9e0 con 0x7febc006d0e0 2024-09-18T02:07:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febc4f45640 1 -- 172.21.15.81:0/357114232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc0070160 con 0x7febc006d0e0 2024-09-18T02:07:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febb6ffd640 1 --2- 172.21.15.81:0/357114232 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7feba0035db0 0x7feba0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febb6ffd640 1 -- 172.21.15.81:0/357114232 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7febb80e43c0 con 0x7febc006d0e0 2024-09-18T02:07:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febbdd9b640 1 --2- 172.21.15.81:0/357114232 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7feba0035db0 0x7feba0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.737+0000 7febbdd9b640 1 --2- 172.21.15.81:0/357114232 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7feba0035db0 0x7feba0038270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feba8007fd0 tx=0x7feba8007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.741+0000 7febb6ffd640 1 -- 172.21.15.81:0/357114232 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7febc006fa10 con 0x7febc006d0e0 2024-09-18T02:07:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.897+0000 7febc4f45640 1 -- 172.21.15.81:0/357114232 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7febc006d4c0 con 0x7feba0035db0 2024-09-18T02:07:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.961+0000 7febb6ffd640 1 -- 172.21.15.81:0/357114232 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665587 (secure 0 0 0) 0x7febc006d4c0 con 0x7feba0035db0 2024-09-18T02:07:43.968 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:07:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T02:07:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.973+0000 7febc4f45640 1 -- 172.21.15.81:0/357114232 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7feba0035db0 msgr2=0x7feba0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.973+0000 7febc4f45640 1 --2- 172.21.15.81:0/357114232 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7feba0035db0 0x7feba0038270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feba8007fd0 tx=0x7feba8007980 comp rx=0 tx=0).stop 2024-09-18T02:07:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.973+0000 7febc4f45640 1 -- 172.21.15.81:0/357114232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc006d0e0 msgr2=0x7febc006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.973+0000 7febc4f45640 1 --2- 172.21.15.81:0/357114232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc006d0e0 0x7febc006e1f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7febb8009d90 tx=0x7febb8019660 comp rx=0 tx=0).stop 2024-09-18T02:07:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.973+0000 7febc4f45640 1 -- 172.21.15.81:0/357114232 shutdown_connections 2024-09-18T02:07:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.973+0000 7febc4f45640 1 --2- 172.21.15.81:0/357114232 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7feba0035db0 0x7feba0038270 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.973+0000 7febc4f45640 1 --2- 172.21.15.81:0/357114232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc006d0e0 0x7febc006e1f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.973+0000 7febc4f45640 1 -- 172.21.15.81:0/357114232 >> 172.21.15.81:0/357114232 conn(0x7febc0099a50 msgr2=0x7febc0131c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.973+0000 7febc4f45640 1 -- 172.21.15.81:0/357114232 shutdown_connections 2024-09-18T02:07:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:43.973+0000 7febc4f45640 1 -- 172.21.15.81:0/357114232 wait complete. 2024-09-18T02:07:43.996 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-18T02:07:43.346813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":261,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5147,"num_read_kb":4696,"num_write":2300,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4676,"ondisk_log_size":4676,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198768,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288592,"statfs":{"total":386547056640,"available":386343518208,"internally_reserved":0,"allocated":54509568,"data_stored":53343902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005545"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.341087+0000","last_change":"2024-09-18T02:03:57.517243+0000","last_active":"2024-09-18T02:04:41.341087+0000","last_peered":"2024-09-18T02:04:41.341087+0000","last_clean":"2024-09-18T02:04:41.341087+0000","last_became_active":"2024-09-18T02:03:57.516420+0000","last_became_peered":"2024-09-18T02:03:57.516420+0000","last_unstale":"2024-09-18T02:04:41.341087+0000","last_undegraded":"2024-09-18T02:04:41.341087+0000","last_fullsized":"2024-09-18T02:04:41.341087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.868815+0000","last_change":"2024-09-18T02:03:59.549513+0000","last_active":"2024-09-18T02:07:11.868815+0000","last_peered":"2024-09-18T02:07:11.868815+0000","last_clean":"2024-09-18T02:07:11.868815+0000","last_became_active":"2024-09-18T02:03:59.545294+0000","last_became_peered":"2024-09-18T02:03:59.545294+0000","last_unstale":"2024-09-18T02:07:11.868815+0000","last_undegraded":"2024-09-18T02:07:11.868815+0000","last_fullsized":"2024-09-18T02:07:11.868815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329444+0000","last_change":"2024-09-18T02:03:57.533991+0000","last_active":"2024-09-18T02:06:06.329444+0000","last_peered":"2024-09-18T02:06:06.329444+0000","last_clean":"2024-09-18T02:06:06.329444+0000","last_became_active":"2024-09-18T02:03:57.533332+0000","last_became_peered":"2024-09-18T02:03:57.533332+0000","last_unstale":"2024-09-18T02:06:06.329444+0000","last_undegraded":"2024-09-18T02:06:06.329444+0000","last_fullsized":"2024-09-18T02:06:06.329444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:46.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:43.634720+0000","last_change":"2024-09-18T02:03:59.554008+0000","last_active":"2024-09-18T02:04:43.634720+0000","last_peered":"2024-09-18T02:04:43.634720+0000","last_clean":"2024-09-18T02:04:43.634720+0000","last_became_active":"2024-09-18T02:03:59.553641+0000","last_became_peered":"2024-09-18T02:03:59.553641+0000","last_unstale":"2024-09-18T02:04:43.634720+0000","last_undegraded":"2024-09-18T02:04:43.634720+0000","last_fullsized":"2024-09-18T02:04:43.634720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:31.703094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.355519+0000","last_change":"2024-09-18T02:03:57.532939+0000","last_active":"2024-09-18T02:04:36.355519+0000","last_peered":"2024-09-18T02:04:36.355519+0000","last_clean":"2024-09-18T02:04:36.355519+0000","last_became_active":"2024-09-18T02:03:57.532561+0000","last_became_peered":"2024-09-18T02:03:57.532561+0000","last_unstale":"2024-09-18T02:04:36.355519+0000","last_undegraded":"2024-09-18T02:04:36.355519+0000","last_fullsized":"2024-09-18T02:04:36.355519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:51.738245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069743+0000","last_change":"2024-09-18T02:03:59.552858+0000","last_active":"2024-09-18T02:07:12.069743+0000","last_peered":"2024-09-18T02:07:12.069743+0000","last_clean":"2024-09-18T02:07:12.069743+0000","last_became_active":"2024-09-18T02:03:59.551661+0000","last_became_peered":"2024-09-18T02:03:59.551661+0000","last_unstale":"2024-09-18T02:07:12.069743+0000","last_undegraded":"2024-09-18T02:07:12.069743+0000","last_fullsized":"2024-09-18T02:07:12.069743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:13:16.052288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.345587+0000","last_change":"2024-09-18T02:03:57.523513+0000","last_active":"2024-09-18T02:04:41.345587+0000","last_peered":"2024-09-18T02:04:41.345587+0000","last_clean":"2024-09-18T02:04:41.345587+0000","last_became_active":"2024-09-18T02:03:57.522751+0000","last_became_peered":"2024-09-18T02:03:57.522751+0000","last_unstale":"2024-09-18T02:04:41.345587+0000","last_undegraded":"2024-09-18T02:04:41.345587+0000","last_fullsized":"2024-09-18T02:04:41.345587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.303235+0000","last_change":"2024-09-18T02:03:59.553228+0000","last_active":"2024-09-18T02:05:26.303235+0000","last_peered":"2024-09-18T02:05:26.303235+0000","last_clean":"2024-09-18T02:05:26.303235+0000","last_became_active":"2024-09-18T02:03:59.552797+0000","last_became_peered":"2024-09-18T02:03:59.552797+0000","last_unstale":"2024-09-18T02:05:26.303235+0000","last_undegraded":"2024-09-18T02:05:26.303235+0000","last_fullsized":"2024-09-18T02:05:26.303235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:34:11.622588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.351407+0000","last_change":"2024-09-18T02:03:57.525148+0000","last_active":"2024-09-18T02:04:36.351407+0000","last_peered":"2024-09-18T02:04:36.351407+0000","last_clean":"2024-09-18T02:04:36.351407+0000","last_became_active":"2024-09-18T02:03:57.524645+0000","last_became_peered":"2024-09-18T02:03:57.524645+0000","last_unstale":"2024-09-18T02:04:36.351407+0000","last_undegraded":"2024-09-18T02:04:36.351407+0000","last_fullsized":"2024-09-18T02:04:36.351407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:25.763842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.730487+0000","last_change":"2024-09-18T02:03:59.542637+0000","last_active":"2024-09-18T02:07:11.730487+0000","last_peered":"2024-09-18T02:07:11.730487+0000","last_clean":"2024-09-18T02:07:11.730487+0000","last_became_active":"2024-09-18T02:03:59.542238+0000","last_became_peered":"2024-09-18T02:03:59.542238+0000","last_unstale":"2024-09-18T02:07:11.730487+0000","last_undegraded":"2024-09-18T02:07:11.730487+0000","last_fullsized":"2024-09-18T02:07:11.730487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:45.343721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343457+0000","last_change":"2024-09-18T02:03:57.523116+0000","last_active":"2024-09-18T02:04:36.343457+0000","last_peered":"2024-09-18T02:04:36.343457+0000","last_clean":"2024-09-18T02:04:36.343457+0000","last_became_active":"2024-09-18T02:03:57.520647+0000","last_became_peered":"2024-09-18T02:03:57.520647+0000","last_unstale":"2024-09-18T02:04:36.343457+0000","last_undegraded":"2024-09-18T02:04:36.343457+0000","last_fullsized":"2024-09-18T02:04:36.343457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'12","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153401+0000","last_change":"2024-09-18T02:03:59.560469+0000","last_active":"2024-09-18T02:07:12.153401+0000","last_peered":"2024-09-18T02:07:12.153401+0000","last_clean":"2024-09-18T02:07:12.153401+0000","last_became_active":"2024-09-18T02:03:59.559273+0000","last_became_peered":"2024-09-18T02:03:59.559273+0000","last_unstale":"2024-09-18T02:07:12.153401+0000","last_undegraded":"2024-09-18T02:07:12.153401+0000","last_fullsized":"2024-09-18T02:07:12.153401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:44.509390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.675472+0000","last_change":"2024-09-18T02:03:57.528855+0000","last_active":"2024-09-18T02:07:11.675472+0000","last_peered":"2024-09-18T02:07:11.675472+0000","last_clean":"2024-09-18T02:07:11.675472+0000","last_became_active":"2024-09-18T02:03:57.526953+0000","last_became_peered":"2024-09-18T02:03:57.526953+0000","last_unstale":"2024-09-18T02:07:11.675472+0000","last_undegraded":"2024-09-18T02:07:11.675472+0000","last_fullsized":"2024-09-18T02:07:11.675472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:28:20.024090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999282+0000","last_change":"2024-09-18T02:03:59.541576+0000","last_active":"2024-09-18T02:05:25.999282+0000","last_peered":"2024-09-18T02:05:25.999282+0000","last_clean":"2024-09-18T02:05:25.999282+0000","last_became_active":"2024-09-18T02:03:59.541086+0000","last_became_peered":"2024-09-18T02:03:59.541086+0000","last_unstale":"2024-09-18T02:05:25.999282+0000","last_undegraded":"2024-09-18T02:05:25.999282+0000","last_fullsized":"2024-09-18T02:05:25.999282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.337869+0000","last_change":"2024-09-18T02:03:57.524285+0000","last_active":"2024-09-18T02:04:36.337869+0000","last_peered":"2024-09-18T02:04:36.337869+0000","last_clean":"2024-09-18T02:04:36.337869+0000","last_became_active":"2024-09-18T02:03:57.520343+0000","last_became_peered":"2024-09-18T02:03:57.520343+0000","last_unstale":"2024-09-18T02:04:36.337869+0000","last_undegraded":"2024-09-18T02:04:36.337869+0000","last_fullsized":"2024-09-18T02:04:36.337869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069669+0000","last_change":"2024-09-18T02:03:59.534315+0000","last_active":"2024-09-18T02:07:12.069669+0000","last_peered":"2024-09-18T02:07:12.069669+0000","last_clean":"2024-09-18T02:07:12.069669+0000","last_became_active":"2024-09-18T02:03:59.533956+0000","last_became_peered":"2024-09-18T02:03:59.533956+0000","last_unstale":"2024-09-18T02:07:12.069669+0000","last_undegraded":"2024-09-18T02:07:12.069669+0000","last_fullsized":"2024-09-18T02:07:12.069669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.238202+0000","last_change":"2024-09-18T02:03:59.537124+0000","last_active":"2024-09-18T02:07:12.238202+0000","last_peered":"2024-09-18T02:07:12.238202+0000","last_clean":"2024-09-18T02:07:12.238202+0000","last_became_active":"2024-09-18T02:03:59.536739+0000","last_became_peered":"2024-09-18T02:03:59.536739+0000","last_unstale":"2024-09-18T02:07:12.238202+0000","last_undegraded":"2024-09-18T02:07:12.238202+0000","last_fullsized":"2024-09-18T02:07:12.238202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:15.010015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345192+0000","last_change":"2024-09-18T02:03:57.523985+0000","last_active":"2024-09-18T02:04:36.345192+0000","last_peered":"2024-09-18T02:04:36.345192+0000","last_clean":"2024-09-18T02:04:36.345192+0000","last_became_active":"2024-09-18T02:03:57.523437+0000","last_became_peered":"2024-09-18T02:03:57.523437+0000","last_unstale":"2024-09-18T02:04:36.345192+0000","last_undegraded":"2024-09-18T02:04:36.345192+0000","last_fullsized":"2024-09-18T02:04:36.345192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.218837+0000","last_change":"2024-09-18T02:03:59.540278+0000","last_active":"2024-09-18T02:07:12.218837+0000","last_peered":"2024-09-18T02:07:12.218837+0000","last_clean":"2024-09-18T02:07:12.218837+0000","last_became_active":"2024-09-18T02:03:59.539778+0000","last_became_peered":"2024-09-18T02:03:59.539778+0000","last_unstale":"2024-09-18T02:07:12.218837+0000","last_undegraded":"2024-09-18T02:07:12.218837+0000","last_fullsized":"2024-09-18T02:07:12.218837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.035357+0000","last_change":"2024-09-18T02:03:57.528659+0000","last_active":"2024-09-18T02:07:12.035357+0000","last_peered":"2024-09-18T02:07:12.035357+0000","last_clean":"2024-09-18T02:07:12.035357+0000","last_became_active":"2024-09-18T02:03:57.524578+0000","last_became_peered":"2024-09-18T02:03:57.524578+0000","last_unstale":"2024-09-18T02:07:12.035357+0000","last_undegraded":"2024-09-18T02:07:12.035357+0000","last_fullsized":"2024-09-18T02:07:12.035357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.595859+0000","last_change":"2024-09-18T02:03:59.546276+0000","last_active":"2024-09-18T02:04:42.595859+0000","last_peered":"2024-09-18T02:04:42.595859+0000","last_clean":"2024-09-18T02:04:42.595859+0000","last_became_active":"2024-09-18T02:03:59.545902+0000","last_became_peered":"2024-09-18T02:03:59.545902+0000","last_unstale":"2024-09-18T02:04:42.595859+0000","last_undegraded":"2024-09-18T02:04:42.595859+0000","last_fullsized":"2024-09-18T02:04:42.595859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:31.387691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348638+0000","last_change":"2024-09-18T02:03:57.523592+0000","last_active":"2024-09-18T02:04:36.348638+0000","last_peered":"2024-09-18T02:04:36.348638+0000","last_clean":"2024-09-18T02:04:36.348638+0000","last_became_active":"2024-09-18T02:03:57.523211+0000","last_became_peered":"2024-09-18T02:03:57.523211+0000","last_unstale":"2024-09-18T02:04:36.348638+0000","last_undegraded":"2024-09-18T02:04:36.348638+0000","last_fullsized":"2024-09-18T02:04:36.348638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:40.008713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.116959+0000","last_change":"2024-09-18T02:03:59.539920+0000","last_active":"2024-09-18T02:06:11.116959+0000","last_peered":"2024-09-18T02:06:11.116959+0000","last_clean":"2024-09-18T02:06:11.116959+0000","last_became_active":"2024-09-18T02:03:59.539198+0000","last_became_peered":"2024-09-18T02:03:59.539198+0000","last_unstale":"2024-09-18T02:06:11.116959+0000","last_undegraded":"2024-09-18T02:06:11.116959+0000","last_fullsized":"2024-09-18T02:06:11.116959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348389+0000","last_change":"2024-09-18T02:03:57.523263+0000","last_active":"2024-09-18T02:04:36.348389+0000","last_peered":"2024-09-18T02:04:36.348389+0000","last_clean":"2024-09-18T02:04:36.348389+0000","last_became_active":"2024-09-18T02:03:57.522924+0000","last_became_peered":"2024-09-18T02:03:57.522924+0000","last_unstale":"2024-09-18T02:04:36.348389+0000","last_undegraded":"2024-09-18T02:04:36.348389+0000","last_fullsized":"2024-09-18T02:04:36.348389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154414+0000","last_change":"2024-09-18T02:03:59.538519+0000","last_active":"2024-09-18T02:07:12.154414+0000","last_peered":"2024-09-18T02:07:12.154414+0000","last_clean":"2024-09-18T02:07:12.154414+0000","last_became_active":"2024-09-18T02:03:59.538126+0000","last_became_peered":"2024-09-18T02:03:59.538126+0000","last_unstale":"2024-09-18T02:07:12.154414+0000","last_undegraded":"2024-09-18T02:07:12.154414+0000","last_fullsized":"2024-09-18T02:07:12.154414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342676+0000","last_change":"2024-09-18T02:03:57.524373+0000","last_active":"2024-09-18T02:04:36.342676+0000","last_peered":"2024-09-18T02:04:36.342676+0000","last_clean":"2024-09-18T02:04:36.342676+0000","last_became_active":"2024-09-18T02:03:57.521019+0000","last_became_peered":"2024-09-18T02:03:57.521019+0000","last_unstale":"2024-09-18T02:04:36.342676+0000","last_undegraded":"2024-09-18T02:04:36.342676+0000","last_fullsized":"2024-09-18T02:04:36.342676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.726771+0000","last_change":"2024-09-18T02:03:59.542673+0000","last_active":"2024-09-18T02:07:11.726771+0000","last_peered":"2024-09-18T02:07:11.726771+0000","last_clean":"2024-09-18T02:07:11.726771+0000","last_became_active":"2024-09-18T02:03:59.540553+0000","last_became_peered":"2024-09-18T02:03:59.540553+0000","last_unstale":"2024-09-18T02:07:11.726771+0000","last_undegraded":"2024-09-18T02:07:11.726771+0000","last_fullsized":"2024-09-18T02:07:11.726771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:45:09.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.904198+0000","last_change":"2024-09-18T02:03:57.527852+0000","last_active":"2024-09-18T02:04:42.904198+0000","last_peered":"2024-09-18T02:04:42.904198+0000","last_clean":"2024-09-18T02:04:42.904198+0000","last_became_active":"2024-09-18T02:03:57.526917+0000","last_became_peered":"2024-09-18T02:03:57.526917+0000","last_unstale":"2024-09-18T02:04:42.904198+0000","last_undegraded":"2024-09-18T02:04:42.904198+0000","last_fullsized":"2024-09-18T02:04:42.904198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:05:25.015337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.114018+0000","last_change":"2024-09-18T02:04:07.624724+0000","last_active":"2024-09-18T02:07:12.114018+0000","last_peered":"2024-09-18T02:07:12.114018+0000","last_clean":"2024-09-18T02:07:12.114018+0000","last_became_active":"2024-09-18T02:04:07.624037+0000","last_became_peered":"2024-09-18T02:04:07.624037+0000","last_unstale":"2024-09-18T02:07:12.114018+0000","last_undegraded":"2024-09-18T02:07:12.114018+0000","last_fullsized":"2024-09-18T02:07:12.114018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:12.942917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069638+0000","last_change":"2024-09-18T02:03:59.545658+0000","last_active":"2024-09-18T02:07:12.069638+0000","last_peered":"2024-09-18T02:07:12.069638+0000","last_clean":"2024-09-18T02:07:12.069638+0000","last_became_active":"2024-09-18T02:03:59.538409+0000","last_became_peered":"2024-09-18T02:03:59.538409+0000","last_unstale":"2024-09-18T02:07:12.069638+0000","last_undegraded":"2024-09-18T02:07:12.069638+0000","last_fullsized":"2024-09-18T02:07:12.069638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:22:35.808977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336737+0000","last_change":"2024-09-18T02:03:57.533041+0000","last_active":"2024-09-18T02:06:21.336737+0000","last_peered":"2024-09-18T02:06:21.336737+0000","last_clean":"2024-09-18T02:06:21.336737+0000","last_became_active":"2024-09-18T02:03:57.532657+0000","last_became_peered":"2024-09-18T02:03:57.532657+0000","last_unstale":"2024-09-18T02:06:21.336737+0000","last_undegraded":"2024-09-18T02:06:21.336737+0000","last_fullsized":"2024-09-18T02:06:21.336737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:57.872288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353588+0000","last_change":"2024-09-18T02:04:01.562652+0000","last_active":"2024-09-18T02:04:36.353588+0000","last_peered":"2024-09-18T02:04:36.353588+0000","last_clean":"2024-09-18T02:04:36.353588+0000","last_became_active":"2024-09-18T02:04:01.562058+0000","last_became_peered":"2024-09-18T02:04:01.562058+0000","last_unstale":"2024-09-18T02:04:36.353588+0000","last_undegraded":"2024-09-18T02:04:36.353588+0000","last_fullsized":"2024-09-18T02:04:36.353588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:55.815357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'42","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.120403+0000","last_change":"2024-09-18T02:04:03.602001+0000","last_active":"2024-09-18T02:06:09.120403+0000","last_peered":"2024-09-18T02:06:09.120403+0000","last_clean":"2024-09-18T02:06:09.120403+0000","last_became_active":"2024-09-18T02:04:03.600467+0000","last_became_peered":"2024-09-18T02:04:03.600467+0000","last_unstale":"2024-09-18T02:06:09.120403+0000","last_undegraded":"2024-09-18T02:06:09.120403+0000","last_fullsized":"2024-09-18T02:06:09.120403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:57.945679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341767+0000","last_change":"2024-09-18T02:04:05.593604+0000","last_active":"2024-09-18T02:04:36.341767+0000","last_peered":"2024-09-18T02:04:36.341767+0000","last_clean":"2024-09-18T02:04:36.341767+0000","last_became_active":"2024-09-18T02:04:05.592934+0000","last_became_peered":"2024-09-18T02:04:05.592934+0000","last_unstale":"2024-09-18T02:04:36.341767+0000","last_undegraded":"2024-09-18T02:04:36.341767+0000","last_fullsized":"2024-09-18T02:04:36.341767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:04.303561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.009824+0000","last_change":"2024-09-18T02:04:07.624771+0000","last_active":"2024-09-18T02:05:26.009824+0000","last_peered":"2024-09-18T02:05:26.009824+0000","last_clean":"2024-09-18T02:05:26.009824+0000","last_became_active":"2024-09-18T02:04:07.624106+0000","last_became_peered":"2024-09-18T02:04:07.624106+0000","last_unstale":"2024-09-18T02:05:26.009824+0000","last_undegraded":"2024-09-18T02:05:26.009824+0000","last_fullsized":"2024-09-18T02:05:26.009824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:19.261922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:43.634524+0000","last_change":"2024-09-18T02:03:59.556933+0000","last_active":"2024-09-18T02:04:43.634524+0000","last_peered":"2024-09-18T02:04:43.634524+0000","last_clean":"2024-09-18T02:04:43.634524+0000","last_became_active":"2024-09-18T02:03:59.555956+0000","last_became_peered":"2024-09-18T02:03:59.555956+0000","last_unstale":"2024-09-18T02:04:43.634524+0000","last_undegraded":"2024-09-18T02:04:43.634524+0000","last_fullsized":"2024-09-18T02:04:43.634524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:14.846567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.908475+0000","last_change":"2024-09-18T02:03:57.523303+0000","last_active":"2024-09-18T02:04:42.908475+0000","last_peered":"2024-09-18T02:04:42.908475+0000","last_clean":"2024-09-18T02:04:42.908475+0000","last_became_active":"2024-09-18T02:03:57.523041+0000","last_became_peered":"2024-09-18T02:03:57.523041+0000","last_unstale":"2024-09-18T02:04:42.908475+0000","last_undegraded":"2024-09-18T02:04:42.908475+0000","last_fullsized":"2024-09-18T02:04:42.908475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.366147+0000","last_change":"2024-09-18T02:04:36.363414+0000","last_active":"2024-09-18T02:04:36.366147+0000","last_peered":"2024-09-18T02:04:36.366147+0000","last_clean":"2024-09-18T02:04:36.366147+0000","last_became_active":"2024-09-18T02:04:36.362592+0000","last_became_peered":"2024-09-18T02:04:36.362592+0000","last_unstale":"2024-09-18T02:04:36.366147+0000","last_undegraded":"2024-09-18T02:04:36.366147+0000","last_fullsized":"2024-09-18T02:04:36.366147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:35.048118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342013+0000","last_change":"2024-09-18T02:04:03.580344+0000","last_active":"2024-09-18T02:04:36.342013+0000","last_peered":"2024-09-18T02:04:36.342013+0000","last_clean":"2024-09-18T02:04:36.342013+0000","last_became_active":"2024-09-18T02:04:03.579442+0000","last_became_peered":"2024-09-18T02:04:03.579442+0000","last_unstale":"2024-09-18T02:04:36.342013+0000","last_undegraded":"2024-09-18T02:04:36.342013+0000","last_fullsized":"2024-09-18T02:04:36.342013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:24.305992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341161+0000","last_change":"2024-09-18T02:04:05.606711+0000","last_active":"2024-09-18T02:04:36.341161+0000","last_peered":"2024-09-18T02:04:36.341161+0000","last_clean":"2024-09-18T02:04:36.341161+0000","last_became_active":"2024-09-18T02:04:05.605774+0000","last_became_peered":"2024-09-18T02:04:05.605774+0000","last_unstale":"2024-09-18T02:04:36.341161+0000","last_undegraded":"2024-09-18T02:04:36.341161+0000","last_fullsized":"2024-09-18T02:04:36.341161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:09.745074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.874113+0000","last_change":"2024-09-18T02:04:07.610794+0000","last_active":"2024-09-18T02:07:11.874113+0000","last_peered":"2024-09-18T02:07:11.874113+0000","last_clean":"2024-09-18T02:07:11.874113+0000","last_became_active":"2024-09-18T02:04:07.610120+0000","last_became_peered":"2024-09-18T02:04:07.610120+0000","last_unstale":"2024-09-18T02:07:11.874113+0000","last_undegraded":"2024-09-18T02:07:11.874113+0000","last_fullsized":"2024-09-18T02:07:11.874113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:50:22.733414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'18","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.728639+0000","last_change":"2024-09-18T02:04:36.373755+0000","last_active":"2024-09-18T02:07:11.728639+0000","last_peered":"2024-09-18T02:07:11.728639+0000","last_clean":"2024-09-18T02:07:11.728639+0000","last_became_active":"2024-09-18T02:04:36.359108+0000","last_became_peered":"2024-09-18T02:04:36.359108+0000","last_unstale":"2024-09-18T02:07:11.728639+0000","last_undegraded":"2024-09-18T02:07:11.728639+0000","last_fullsized":"2024-09-18T02:07:11.728639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.476030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336598+0000","last_change":"2024-09-18T02:03:57.533341+0000","last_active":"2024-09-18T02:06:21.336598+0000","last_peered":"2024-09-18T02:06:21.336598+0000","last_clean":"2024-09-18T02:06:21.336598+0000","last_became_active":"2024-09-18T02:03:57.533037+0000","last_became_peered":"2024-09-18T02:03:57.533037+0000","last_unstale":"2024-09-18T02:06:21.336598+0000","last_undegraded":"2024-09-18T02:06:21.336598+0000","last_fullsized":"2024-09-18T02:06:21.336598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:05.427298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.573028+0000","last_change":"2024-09-18T02:04:01.568037+0000","last_active":"2024-09-18T02:06:10.573028+0000","last_peered":"2024-09-18T02:06:10.573028+0000","last_clean":"2024-09-18T02:06:10.573028+0000","last_became_active":"2024-09-18T02:04:01.567287+0000","last_became_peered":"2024-09-18T02:04:01.567287+0000","last_unstale":"2024-09-18T02:06:10.573028+0000","last_undegraded":"2024-09-18T02:06:10.573028+0000","last_fullsized":"2024-09-18T02:06:10.573028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:17.024271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'23","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.336252+0000","last_change":"2024-09-18T02:04:03.581817+0000","last_active":"2024-09-18T02:06:26.336252+0000","last_peered":"2024-09-18T02:06:26.336252+0000","last_clean":"2024-09-18T02:06:26.336252+0000","last_became_active":"2024-09-18T02:04:03.581092+0000","last_became_peered":"2024-09-18T02:04:03.581092+0000","last_unstale":"2024-09-18T02:06:26.336252+0000","last_undegraded":"2024-09-18T02:06:26.336252+0000","last_fullsized":"2024-09-18T02:06:26.336252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:22.939603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":405,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.782222+0000","last_change":"2024-09-18T02:04:05.609076+0000","last_active":"2024-09-18T02:07:11.782222+0000","last_peered":"2024-09-18T02:07:11.782222+0000","last_clean":"2024-09-18T02:07:11.782222+0000","last_became_active":"2024-09-18T02:04:05.607733+0000","last_became_peered":"2024-09-18T02:04:05.607733+0000","last_unstale":"2024-09-18T02:07:11.782222+0000","last_undegraded":"2024-09-18T02:07:11.782222+0000","last_fullsized":"2024-09-18T02:07:11.782222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:10.197583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.344569+0000","last_change":"2024-09-18T02:04:07.631363+0000","last_active":"2024-09-18T02:04:36.344569+0000","last_peered":"2024-09-18T02:04:36.344569+0000","last_clean":"2024-09-18T02:04:36.344569+0000","last_became_active":"2024-09-18T02:04:07.630721+0000","last_became_peered":"2024-09-18T02:04:07.630721+0000","last_unstale":"2024-09-18T02:04:36.344569+0000","last_undegraded":"2024-09-18T02:04:36.344569+0000","last_fullsized":"2024-09-18T02:04:36.344569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:45.912516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.725053+0000","last_change":"2024-09-18T02:03:59.550519+0000","last_active":"2024-09-18T02:07:11.725053+0000","last_peered":"2024-09-18T02:07:11.725053+0000","last_clean":"2024-09-18T02:07:11.725053+0000","last_became_active":"2024-09-18T02:03:59.548365+0000","last_became_peered":"2024-09-18T02:03:59.548365+0000","last_unstale":"2024-09-18T02:07:11.725053+0000","last_undegraded":"2024-09-18T02:07:11.725053+0000","last_fullsized":"2024-09-18T02:07:11.725053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.333397+0000","last_change":"2024-09-18T02:03:57.521018+0000","last_active":"2024-09-18T02:06:21.333397+0000","last_peered":"2024-09-18T02:06:21.333397+0000","last_clean":"2024-09-18T02:06:21.333397+0000","last_became_active":"2024-09-18T02:03:57.520706+0000","last_became_peered":"2024-09-18T02:03:57.520706+0000","last_unstale":"2024-09-18T02:06:21.333397+0000","last_undegraded":"2024-09-18T02:06:21.333397+0000","last_fullsized":"2024-09-18T02:06:21.333397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:20:27.172876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.585045+0000","last_change":"2024-09-18T02:04:01.562150+0000","last_active":"2024-09-18T02:06:10.585045+0000","last_peered":"2024-09-18T02:06:10.585045+0000","last_clean":"2024-09-18T02:06:10.585045+0000","last_became_active":"2024-09-18T02:04:01.559249+0000","last_became_peered":"2024-09-18T02:04:01.559249+0000","last_unstale":"2024-09-18T02:06:10.585045+0000","last_undegraded":"2024-09-18T02:06:10.585045+0000","last_fullsized":"2024-09-18T02:06:10.585045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:27.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'36","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.112276+0000","last_change":"2024-09-18T02:04:03.581074+0000","last_active":"2024-09-18T02:06:09.112276+0000","last_peered":"2024-09-18T02:06:09.112276+0000","last_clean":"2024-09-18T02:06:09.112276+0000","last_became_active":"2024-09-18T02:04:03.580310+0000","last_became_peered":"2024-09-18T02:04:03.580310+0000","last_unstale":"2024-09-18T02:06:09.112276+0000","last_undegraded":"2024-09-18T02:06:09.112276+0000","last_fullsized":"2024-09-18T02:06:09.112276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:35.737383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":436,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.231716+0000","last_change":"2024-09-18T02:04:05.612525+0000","last_active":"2024-09-18T02:07:12.231716+0000","last_peered":"2024-09-18T02:07:12.231716+0000","last_clean":"2024-09-18T02:07:12.231716+0000","last_became_active":"2024-09-18T02:04:05.611707+0000","last_became_peered":"2024-09-18T02:04:05.611707+0000","last_unstale":"2024-09-18T02:07:12.231716+0000","last_undegraded":"2024-09-18T02:07:12.231716+0000","last_fullsized":"2024-09-18T02:07:12.231716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:38.266386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.939685+0000","last_change":"2024-09-18T02:03:59.560537+0000","last_active":"2024-09-18T02:04:42.939685+0000","last_peered":"2024-09-18T02:04:42.939685+0000","last_clean":"2024-09-18T02:04:42.939685+0000","last_became_active":"2024-09-18T02:03:59.559585+0000","last_became_peered":"2024-09-18T02:03:59.559585+0000","last_unstale":"2024-09-18T02:04:42.939685+0000","last_undegraded":"2024-09-18T02:04:42.939685+0000","last_fullsized":"2024-09-18T02:04:42.939685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:48.966165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.028684+0000","last_change":"2024-09-18T02:03:57.528019+0000","last_active":"2024-09-18T02:07:12.028684+0000","last_peered":"2024-09-18T02:07:12.028684+0000","last_clean":"2024-09-18T02:07:12.028684+0000","last_became_active":"2024-09-18T02:03:57.527575+0000","last_became_peered":"2024-09-18T02:03:57.527575+0000","last_unstale":"2024-09-18T02:07:12.028684+0000","last_undegraded":"2024-09-18T02:07:12.028684+0000","last_fullsized":"2024-09-18T02:07:12.028684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:47.581207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339069+0000","last_change":"2024-09-18T02:04:01.569918+0000","last_active":"2024-09-18T02:04:36.339069+0000","last_peered":"2024-09-18T02:04:36.339069+0000","last_clean":"2024-09-18T02:04:36.339069+0000","last_became_active":"2024-09-18T02:04:01.569301+0000","last_became_peered":"2024-09-18T02:04:01.569301+0000","last_unstale":"2024-09-18T02:04:36.339069+0000","last_undegraded":"2024-09-18T02:04:36.339069+0000","last_fullsized":"2024-09-18T02:04:36.339069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:17.024271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'46","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.126948+0000","last_change":"2024-09-18T02:04:03.592588+0000","last_active":"2024-09-18T02:06:09.126948+0000","last_peered":"2024-09-18T02:06:09.126948+0000","last_clean":"2024-09-18T02:06:09.126948+0000","last_became_active":"2024-09-18T02:04:03.591195+0000","last_became_peered":"2024-09-18T02:04:03.591195+0000","last_unstale":"2024-09-18T02:06:09.126948+0000","last_undegraded":"2024-09-18T02:06:09.126948+0000","last_fullsized":"2024-09-18T02:06:09.126948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:35:17.659414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339248+0000","last_change":"2024-09-18T02:04:05.606379+0000","last_active":"2024-09-18T02:04:36.339248+0000","last_peered":"2024-09-18T02:04:36.339248+0000","last_clean":"2024-09-18T02:04:36.339248+0000","last_became_active":"2024-09-18T02:04:05.605611+0000","last_became_peered":"2024-09-18T02:04:05.605611+0000","last_unstale":"2024-09-18T02:04:36.339248+0000","last_undegraded":"2024-09-18T02:04:36.339248+0000","last_fullsized":"2024-09-18T02:04:36.339248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:00.566939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.013428+0000","last_change":"2024-09-18T02:04:07.630472+0000","last_active":"2024-09-18T02:05:26.013428+0000","last_peered":"2024-09-18T02:05:26.013428+0000","last_clean":"2024-09-18T02:05:26.013428+0000","last_became_active":"2024-09-18T02:04:07.628247+0000","last_became_peered":"2024-09-18T02:04:07.628247+0000","last_unstale":"2024-09-18T02:05:26.013428+0000","last_undegraded":"2024-09-18T02:05:26.013428+0000","last_fullsized":"2024-09-18T02:05:26.013428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:40.279768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.000495+0000","last_change":"2024-09-18T02:03:59.535593+0000","last_active":"2024-09-18T02:05:26.000495+0000","last_peered":"2024-09-18T02:05:26.000495+0000","last_clean":"2024-09-18T02:05:26.000495+0000","last_became_active":"2024-09-18T02:03:59.535217+0000","last_became_peered":"2024-09-18T02:03:59.535217+0000","last_unstale":"2024-09-18T02:05:26.000495+0000","last_undegraded":"2024-09-18T02:05:26.000495+0000","last_fullsized":"2024-09-18T02:05:26.000495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:38.500729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.369068+0000","last_change":"2024-09-18T02:03:57.529038+0000","last_active":"2024-09-18T02:04:36.369068+0000","last_peered":"2024-09-18T02:04:36.369068+0000","last_clean":"2024-09-18T02:04:36.369068+0000","last_became_active":"2024-09-18T02:03:57.528006+0000","last_became_peered":"2024-09-18T02:03:57.528006+0000","last_unstale":"2024-09-18T02:04:36.369068+0000","last_undegraded":"2024-09-18T02:04:36.369068+0000","last_fullsized":"2024-09-18T02:04:36.369068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:46.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361230+0000","last_change":"2024-09-18T02:04:36.358966+0000","last_active":"2024-09-18T02:04:36.361230+0000","last_peered":"2024-09-18T02:04:36.361230+0000","last_clean":"2024-09-18T02:04:36.361230+0000","last_became_active":"2024-09-18T02:04:36.357607+0000","last_became_peered":"2024-09-18T02:04:36.357607+0000","last_unstale":"2024-09-18T02:04:36.361230+0000","last_undegraded":"2024-09-18T02:04:36.361230+0000","last_fullsized":"2024-09-18T02:04:36.361230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:02:01.245576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'36","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.096724+0000","last_change":"2024-09-18T02:04:03.604260+0000","last_active":"2024-09-18T02:06:09.096724+0000","last_peered":"2024-09-18T02:06:09.096724+0000","last_clean":"2024-09-18T02:06:09.096724+0000","last_became_active":"2024-09-18T02:04:03.601783+0000","last_became_peered":"2024-09-18T02:04:03.601783+0000","last_unstale":"2024-09-18T02:06:09.096724+0000","last_undegraded":"2024-09-18T02:06:09.096724+0000","last_fullsized":"2024-09-18T02:06:09.096724+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:52.749305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338424+0000","last_change":"2024-09-18T02:04:05.578434+0000","last_active":"2024-09-18T02:04:36.338424+0000","last_peered":"2024-09-18T02:04:36.338424+0000","last_clean":"2024-09-18T02:04:36.338424+0000","last_became_active":"2024-09-18T02:04:05.577665+0000","last_became_peered":"2024-09-18T02:04:05.577665+0000","last_unstale":"2024-09-18T02:04:36.338424+0000","last_undegraded":"2024-09-18T02:04:36.338424+0000","last_fullsized":"2024-09-18T02:04:36.338424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:59.848912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.297891+0000","last_change":"2024-09-18T02:04:07.621208+0000","last_active":"2024-09-18T02:05:26.297891+0000","last_peered":"2024-09-18T02:05:26.297891+0000","last_clean":"2024-09-18T02:05:26.297891+0000","last_became_active":"2024-09-18T02:04:07.619973+0000","last_became_peered":"2024-09-18T02:04:07.619973+0000","last_unstale":"2024-09-18T02:05:26.297891+0000","last_undegraded":"2024-09-18T02:05:26.297891+0000","last_fullsized":"2024-09-18T02:05:26.297891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:04:52.210610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153629+0000","last_change":"2024-09-18T02:03:59.539493+0000","last_active":"2024-09-18T02:07:12.153629+0000","last_peered":"2024-09-18T02:07:12.153629+0000","last_clean":"2024-09-18T02:07:12.153629+0000","last_became_active":"2024-09-18T02:03:59.539105+0000","last_became_peered":"2024-09-18T02:03:59.539105+0000","last_unstale":"2024-09-18T02:07:12.153629+0000","last_undegraded":"2024-09-18T02:07:12.153629+0000","last_fullsized":"2024-09-18T02:07:12.153629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:48.841356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.985374+0000","last_change":"2024-09-18T02:03:57.530707+0000","last_active":"2024-09-18T02:05:25.985374+0000","last_peered":"2024-09-18T02:05:25.985374+0000","last_clean":"2024-09-18T02:05:25.985374+0000","last_became_active":"2024-09-18T02:03:57.526327+0000","last_became_peered":"2024-09-18T02:03:57.526327+0000","last_unstale":"2024-09-18T02:05:25.985374+0000","last_undegraded":"2024-09-18T02:05:25.985374+0000","last_fullsized":"2024-09-18T02:05:25.985374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:29.374180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343561+0000","last_change":"2024-09-18T02:04:01.562077+0000","last_active":"2024-09-18T02:04:36.343561+0000","last_peered":"2024-09-18T02:04:36.343561+0000","last_clean":"2024-09-18T02:04:36.343561+0000","last_became_active":"2024-09-18T02:04:01.561279+0000","last_became_peered":"2024-09-18T02:04:01.561279+0000","last_unstale":"2024-09-18T02:04:36.343561+0000","last_undegraded":"2024-09-18T02:04:36.343561+0000","last_fullsized":"2024-09-18T02:04:36.343561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:22.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'49","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335258+0000","last_change":"2024-09-18T02:04:03.595408+0000","last_active":"2024-09-18T02:06:16.335258+0000","last_peered":"2024-09-18T02:06:16.335258+0000","last_clean":"2024-09-18T02:06:16.335258+0000","last_became_active":"2024-09-18T02:04:03.591705+0000","last_became_peered":"2024-09-18T02:04:03.591705+0000","last_unstale":"2024-09-18T02:06:16.335258+0000","last_undegraded":"2024-09-18T02:06:16.335258+0000","last_fullsized":"2024-09-18T02:06:16.335258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:09.695750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":398,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.417043+0000","last_change":"2024-09-18T02:04:05.592469+0000","last_active":"2024-09-18T02:07:12.417043+0000","last_peered":"2024-09-18T02:07:12.417043+0000","last_clean":"2024-09-18T02:07:12.417043+0000","last_became_active":"2024-09-18T02:04:05.591652+0000","last_became_peered":"2024-09-18T02:04:05.591652+0000","last_unstale":"2024-09-18T02:07:12.417043+0000","last_undegraded":"2024-09-18T02:07:12.417043+0000","last_fullsized":"2024-09-18T02:07:12.417043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:09.745074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342503+0000","last_change":"2024-09-18T02:04:07.609950+0000","last_active":"2024-09-18T02:04:36.342503+0000","last_peered":"2024-09-18T02:04:36.342503+0000","last_clean":"2024-09-18T02:04:36.342503+0000","last_became_active":"2024-09-18T02:04:07.609050+0000","last_became_peered":"2024-09-18T02:04:07.609050+0000","last_unstale":"2024-09-18T02:04:36.342503+0000","last_undegraded":"2024-09-18T02:04:36.342503+0000","last_fullsized":"2024-09-18T02:04:36.342503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:08.651954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'14","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153098+0000","last_change":"2024-09-18T02:03:59.532107+0000","last_active":"2024-09-18T02:07:12.153098+0000","last_peered":"2024-09-18T02:07:12.153098+0000","last_clean":"2024-09-18T02:07:12.153098+0000","last_became_active":"2024-09-18T02:03:59.531445+0000","last_became_peered":"2024-09-18T02:03:59.531445+0000","last_unstale":"2024-09-18T02:07:12.153098+0000","last_undegraded":"2024-09-18T02:07:12.153098+0000","last_fullsized":"2024-09-18T02:07:12.153098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335457+0000","last_change":"2024-09-18T02:03:57.522436+0000","last_active":"2024-09-18T02:06:16.335457+0000","last_peered":"2024-09-18T02:06:16.335457+0000","last_clean":"2024-09-18T02:06:16.335457+0000","last_became_active":"2024-09-18T02:03:57.521858+0000","last_became_peered":"2024-09-18T02:03:57.521858+0000","last_unstale":"2024-09-18T02:06:16.335457+0000","last_undegraded":"2024-09-18T02:06:16.335457+0000","last_fullsized":"2024-09-18T02:06:16.335457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:52.057677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361115+0000","last_change":"2024-09-18T02:04:36.357179+0000","last_active":"2024-09-18T02:04:36.361115+0000","last_peered":"2024-09-18T02:04:36.361115+0000","last_clean":"2024-09-18T02:04:36.361115+0000","last_became_active":"2024-09-18T02:04:36.356453+0000","last_became_peered":"2024-09-18T02:04:36.356453+0000","last_unstale":"2024-09-18T02:04:36.361115+0000","last_undegraded":"2024-09-18T02:04:36.361115+0000","last_fullsized":"2024-09-18T02:04:36.361115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:27.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'66","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.131727+0000","last_change":"2024-09-18T02:04:03.596161+0000","last_active":"2024-09-18T02:06:09.131727+0000","last_peered":"2024-09-18T02:06:09.131727+0000","last_clean":"2024-09-18T02:06:09.131727+0000","last_became_active":"2024-09-18T02:04:03.595618+0000","last_became_peered":"2024-09-18T02:04:03.595618+0000","last_unstale":"2024-09-18T02:06:09.131727+0000","last_undegraded":"2024-09-18T02:06:09.131727+0000","last_fullsized":"2024-09-18T02:06:09.131727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:30.345316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338225+0000","last_change":"2024-09-18T02:04:05.585960+0000","last_active":"2024-09-18T02:04:36.338225+0000","last_peered":"2024-09-18T02:04:36.338225+0000","last_clean":"2024-09-18T02:04:36.338225+0000","last_became_active":"2024-09-18T02:04:05.585272+0000","last_became_peered":"2024-09-18T02:04:05.585272+0000","last_unstale":"2024-09-18T02:04:36.338225+0000","last_undegraded":"2024-09-18T02:04:36.338225+0000","last_fullsized":"2024-09-18T02:04:36.338225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:26.254201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.376039+0000","last_change":"2024-09-18T02:04:07.614915+0000","last_active":"2024-09-18T02:07:12.376039+0000","last_peered":"2024-09-18T02:07:12.376039+0000","last_clean":"2024-09-18T02:07:12.376039+0000","last_became_active":"2024-09-18T02:04:07.614232+0000","last_became_peered":"2024-09-18T02:04:07.614232+0000","last_unstale":"2024-09-18T02:07:12.376039+0000","last_undegraded":"2024-09-18T02:07:12.376039+0000","last_fullsized":"2024-09-18T02:07:12.376039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:34.372220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'18","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154480+0000","last_change":"2024-09-18T02:03:59.546334+0000","last_active":"2024-09-18T02:07:12.154480+0000","last_peered":"2024-09-18T02:07:12.154480+0000","last_clean":"2024-09-18T02:07:12.154480+0000","last_became_active":"2024-09-18T02:03:59.545956+0000","last_became_peered":"2024-09-18T02:03:59.545956+0000","last_unstale":"2024-09-18T02:07:12.154480+0000","last_undegraded":"2024-09-18T02:07:12.154480+0000","last_fullsized":"2024-09-18T02:07:12.154480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:12.929565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.331685+0000","last_change":"2024-09-18T02:03:57.522159+0000","last_active":"2024-09-18T02:06:16.331685+0000","last_peered":"2024-09-18T02:06:16.331685+0000","last_clean":"2024-09-18T02:06:16.331685+0000","last_became_active":"2024-09-18T02:03:57.520036+0000","last_became_peered":"2024-09-18T02:03:57.520036+0000","last_unstale":"2024-09-18T02:06:16.331685+0000","last_undegraded":"2024-09-18T02:06:16.331685+0000","last_fullsized":"2024-09-18T02:06:16.331685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:47.581207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361351+0000","last_change":"2024-09-18T02:04:01.573344+0000","last_active":"2024-09-18T02:04:36.361351+0000","last_peered":"2024-09-18T02:04:36.361351+0000","last_clean":"2024-09-18T02:04:36.361351+0000","last_became_active":"2024-09-18T02:04:01.573084+0000","last_became_peered":"2024-09-18T02:04:01.573084+0000","last_unstale":"2024-09-18T02:04:36.361351+0000","last_undegraded":"2024-09-18T02:04:36.361351+0000","last_fullsized":"2024-09-18T02:04:36.361351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:45:12.008014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.102500+0000","last_change":"2024-09-18T02:04:03.567085+0000","last_active":"2024-09-18T02:06:09.102500+0000","last_peered":"2024-09-18T02:06:09.102500+0000","last_clean":"2024-09-18T02:06:09.102500+0000","last_became_active":"2024-09-18T02:04:03.565801+0000","last_became_peered":"2024-09-18T02:04:03.565801+0000","last_unstale":"2024-09-18T02:06:09.102500+0000","last_undegraded":"2024-09-18T02:06:09.102500+0000","last_fullsized":"2024-09-18T02:06:09.102500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:33.058001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.357876+0000","last_change":"2024-09-18T02:04:05.612592+0000","last_active":"2024-09-18T02:04:36.357876+0000","last_peered":"2024-09-18T02:04:36.357876+0000","last_clean":"2024-09-18T02:04:36.357876+0000","last_became_active":"2024-09-18T02:04:05.612052+0000","last_became_peered":"2024-09-18T02:04:05.612052+0000","last_unstale":"2024-09-18T02:04:36.357876+0000","last_undegraded":"2024-09-18T02:04:36.357876+0000","last_fullsized":"2024-09-18T02:04:36.357876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:51:05.159090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.173402+0000","last_change":"2024-09-18T02:04:07.622545+0000","last_active":"2024-09-18T02:07:12.173402+0000","last_peered":"2024-09-18T02:07:12.173402+0000","last_clean":"2024-09-18T02:07:12.173402+0000","last_became_active":"2024-09-18T02:04:07.622004+0000","last_became_peered":"2024-09-18T02:04:07.622004+0000","last_unstale":"2024-09-18T02:07:12.173402+0000","last_undegraded":"2024-09-18T02:07:12.173402+0000","last_fullsized":"2024-09-18T02:07:12.173402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:53.836670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.218296+0000","last_change":"2024-09-18T02:04:36.364542+0000","last_active":"2024-09-18T02:07:12.218296+0000","last_peered":"2024-09-18T02:07:12.218296+0000","last_clean":"2024-09-18T02:07:12.218296+0000","last_became_active":"2024-09-18T02:04:36.361748+0000","last_became_peered":"2024-09-18T02:04:36.361748+0000","last_unstale":"2024-09-18T02:07:12.218296+0000","last_undegraded":"2024-09-18T02:07:12.218296+0000","last_fullsized":"2024-09-18T02:07:12.218296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:04.881724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.334238+0000","last_change":"2024-09-18T02:03:57.530747+0000","last_active":"2024-09-18T02:06:11.334238+0000","last_peered":"2024-09-18T02:06:11.334238+0000","last_clean":"2024-09-18T02:06:11.334238+0000","last_became_active":"2024-09-18T02:03:57.526977+0000","last_became_peered":"2024-09-18T02:03:57.526977+0000","last_unstale":"2024-09-18T02:06:11.334238+0000","last_undegraded":"2024-09-18T02:06:11.334238+0000","last_fullsized":"2024-09-18T02:06:11.334238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:29.938986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345881+0000","last_change":"2024-09-18T02:04:01.562995+0000","last_active":"2024-09-18T02:04:36.345881+0000","last_peered":"2024-09-18T02:04:36.345881+0000","last_clean":"2024-09-18T02:04:36.345881+0000","last_became_active":"2024-09-18T02:04:01.561913+0000","last_became_peered":"2024-09-18T02:04:01.561913+0000","last_unstale":"2024-09-18T02:04:36.345881+0000","last_undegraded":"2024-09-18T02:04:36.345881+0000","last_fullsized":"2024-09-18T02:04:36.345881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:33.717350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.143733+0000","last_change":"2024-09-18T02:04:03.581156+0000","last_active":"2024-09-18T02:06:09.143733+0000","last_peered":"2024-09-18T02:06:09.143733+0000","last_clean":"2024-09-18T02:06:09.143733+0000","last_became_active":"2024-09-18T02:04:03.580395+0000","last_became_peered":"2024-09-18T02:04:03.580395+0000","last_unstale":"2024-09-18T02:06:09.143733+0000","last_undegraded":"2024-09-18T02:06:09.143733+0000","last_fullsized":"2024-09-18T02:06:09.143733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:36.129908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.387338+0000","last_change":"2024-09-18T02:04:05.604333+0000","last_active":"2024-09-18T02:07:12.387338+0000","last_peered":"2024-09-18T02:07:12.387338+0000","last_clean":"2024-09-18T02:07:12.387338+0000","last_became_active":"2024-09-18T02:04:05.603548+0000","last_became_peered":"2024-09-18T02:04:05.603548+0000","last_unstale":"2024-09-18T02:07:12.387338+0000","last_undegraded":"2024-09-18T02:07:12.387338+0000","last_fullsized":"2024-09-18T02:07:12.387338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:24.870978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.082226+0000","last_change":"2024-09-18T02:04:07.620770+0000","last_active":"2024-09-18T02:07:12.082226+0000","last_peered":"2024-09-18T02:07:12.082226+0000","last_clean":"2024-09-18T02:07:12.082226+0000","last_became_active":"2024-09-18T02:04:07.620094+0000","last_became_peered":"2024-09-18T02:04:07.620094+0000","last_unstale":"2024-09-18T02:07:12.082226+0000","last_undegraded":"2024-09-18T02:07:12.082226+0000","last_fullsized":"2024-09-18T02:07:12.082226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:36:55.417123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'14","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069886+0000","last_change":"2024-09-18T02:03:59.535067+0000","last_active":"2024-09-18T02:07:12.069886+0000","last_peered":"2024-09-18T02:07:12.069886+0000","last_clean":"2024-09-18T02:07:12.069886+0000","last_became_active":"2024-09-18T02:03:59.534547+0000","last_became_peered":"2024-09-18T02:03:59.534547+0000","last_unstale":"2024-09-18T02:07:12.069886+0000","last_undegraded":"2024-09-18T02:07:12.069886+0000","last_fullsized":"2024-09-18T02:07:12.069886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349002+0000","last_change":"2024-09-18T02:03:57.526267+0000","last_active":"2024-09-18T02:04:36.349002+0000","last_peered":"2024-09-18T02:04:36.349002+0000","last_clean":"2024-09-18T02:04:36.349002+0000","last_became_active":"2024-09-18T02:03:57.525576+0000","last_became_peered":"2024-09-18T02:03:57.525576+0000","last_unstale":"2024-09-18T02:04:36.349002+0000","last_undegraded":"2024-09-18T02:04:36.349002+0000","last_fullsized":"2024-09-18T02:04:36.349002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:45:50.125550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.584748+0000","last_change":"2024-09-18T02:04:01.565275+0000","last_active":"2024-09-18T02:06:10.584748+0000","last_peered":"2024-09-18T02:06:10.584748+0000","last_clean":"2024-09-18T02:06:10.584748+0000","last_became_active":"2024-09-18T02:04:01.564385+0000","last_became_peered":"2024-09-18T02:04:01.564385+0000","last_unstale":"2024-09-18T02:06:10.584748+0000","last_undegraded":"2024-09-18T02:06:10.584748+0000","last_fullsized":"2024-09-18T02:06:10.584748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:50.980422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353471+0000","last_change":"2024-09-18T02:04:03.601350+0000","last_active":"2024-09-18T02:04:36.353471+0000","last_peered":"2024-09-18T02:04:36.353471+0000","last_clean":"2024-09-18T02:04:36.353471+0000","last_became_active":"2024-09-18T02:04:03.600545+0000","last_became_peered":"2024-09-18T02:04:03.600545+0000","last_unstale":"2024-09-18T02:04:36.353471+0000","last_undegraded":"2024-09-18T02:04:36.353471+0000","last_fullsized":"2024-09-18T02:04:36.353471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:51:09.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":460,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.330022+0000","last_change":"2024-09-18T02:04:05.582865+0000","last_active":"2024-09-18T02:07:12.330022+0000","last_peered":"2024-09-18T02:07:12.330022+0000","last_clean":"2024-09-18T02:07:12.330022+0000","last_became_active":"2024-09-18T02:04:05.582127+0000","last_became_peered":"2024-09-18T02:04:05.582127+0000","last_unstale":"2024-09-18T02:07:12.330022+0000","last_undegraded":"2024-09-18T02:07:12.330022+0000","last_fullsized":"2024-09-18T02:07:12.330022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:43.899135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.741734+0000","last_change":"2024-09-18T02:04:07.606525+0000","last_active":"2024-09-18T02:06:10.741734+0000","last_peered":"2024-09-18T02:06:10.741734+0000","last_clean":"2024-09-18T02:06:10.741734+0000","last_became_active":"2024-09-18T02:04:07.602985+0000","last_became_peered":"2024-09-18T02:04:07.602985+0000","last_unstale":"2024-09-18T02:06:10.741734+0000","last_undegraded":"2024-09-18T02:06:10.741734+0000","last_fullsized":"2024-09-18T02:06:10.741734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:39.005182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.135331+0000","last_change":"2024-09-18T02:03:59.555188+0000","last_active":"2024-09-18T02:04:42.135331+0000","last_peered":"2024-09-18T02:04:42.135331+0000","last_clean":"2024-09-18T02:04:42.135331+0000","last_became_active":"2024-09-18T02:03:59.554711+0000","last_became_peered":"2024-09-18T02:03:59.554711+0000","last_unstale":"2024-09-18T02:04:42.135331+0000","last_undegraded":"2024-09-18T02:04:42.135331+0000","last_fullsized":"2024-09-18T02:04:42.135331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:54:59.350305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346294+0000","last_change":"2024-09-18T02:03:57.531537+0000","last_active":"2024-09-18T02:04:36.346294+0000","last_peered":"2024-09-18T02:04:36.346294+0000","last_clean":"2024-09-18T02:04:36.346294+0000","last_became_active":"2024-09-18T02:03:57.531156+0000","last_became_peered":"2024-09-18T02:03:57.531156+0000","last_unstale":"2024-09-18T02:04:36.346294+0000","last_undegraded":"2024-09-18T02:04:36.346294+0000","last_fullsized":"2024-09-18T02:04:36.346294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:38:10.322009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358596+0000","last_change":"2024-09-18T02:04:01.566384+0000","last_active":"2024-09-18T02:04:36.358596+0000","last_peered":"2024-09-18T02:04:36.358596+0000","last_clean":"2024-09-18T02:04:36.358596+0000","last_became_active":"2024-09-18T02:04:01.565999+0000","last_became_peered":"2024-09-18T02:04:01.565999+0000","last_unstale":"2024-09-18T02:04:36.358596+0000","last_undegraded":"2024-09-18T02:04:36.358596+0000","last_fullsized":"2024-09-18T02:04:36.358596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:14.084784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'40","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.333779+0000","last_change":"2024-09-18T02:04:03.564795+0000","last_active":"2024-09-18T02:06:21.333779+0000","last_peered":"2024-09-18T02:06:21.333779+0000","last_clean":"2024-09-18T02:06:21.333779+0000","last_became_active":"2024-09-18T02:04:03.564021+0000","last_became_peered":"2024-09-18T02:04:03.564021+0000","last_unstale":"2024-09-18T02:06:21.333779+0000","last_undegraded":"2024-09-18T02:06:21.333779+0000","last_fullsized":"2024-09-18T02:06:21.333779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:32.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346074+0000","last_change":"2024-09-18T02:04:05.611095+0000","last_active":"2024-09-18T02:04:36.346074+0000","last_peered":"2024-09-18T02:04:36.346074+0000","last_clean":"2024-09-18T02:04:36.346074+0000","last_became_active":"2024-09-18T02:04:05.610024+0000","last_became_peered":"2024-09-18T02:04:05.610024+0000","last_unstale":"2024-09-18T02:04:36.346074+0000","last_undegraded":"2024-09-18T02:04:36.346074+0000","last_fullsized":"2024-09-18T02:04:36.346074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:13.378109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.289268+0000","last_change":"2024-09-18T02:04:07.619059+0000","last_active":"2024-09-18T02:07:12.289268+0000","last_peered":"2024-09-18T02:07:12.289268+0000","last_clean":"2024-09-18T02:07:12.289268+0000","last_became_active":"2024-09-18T02:04:07.618153+0000","last_became_peered":"2024-09-18T02:04:07.618153+0000","last_unstale":"2024-09-18T02:07:12.289268+0000","last_undegraded":"2024-09-18T02:07:12.289268+0000","last_fullsized":"2024-09-18T02:07:12.289268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:28.091310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'9","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.333102+0000","last_change":"2024-09-18T02:03:59.560833+0000","last_active":"2024-09-18T02:06:06.333102+0000","last_peered":"2024-09-18T02:06:06.333102+0000","last_clean":"2024-09-18T02:06:06.333102+0000","last_became_active":"2024-09-18T02:03:59.559592+0000","last_became_peered":"2024-09-18T02:03:59.559592+0000","last_unstale":"2024-09-18T02:06:06.333102+0000","last_undegraded":"2024-09-18T02:06:06.333102+0000","last_fullsized":"2024-09-18T02:06:06.333102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:07.330297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.337223+0000","last_change":"2024-09-18T02:03:43.338768+0000","last_active":"2024-09-18T02:04:36.337223+0000","last_peered":"2024-09-18T02:04:36.337223+0000","last_clean":"2024-09-18T02:04:36.337223+0000","last_became_active":"2024-09-18T02:03:43.336731+0000","last_became_peered":"2024-09-18T02:03:43.336731+0000","last_unstale":"2024-09-18T02:04:36.337223+0000","last_undegraded":"2024-09-18T02:04:36.337223+0000","last_fullsized":"2024-09-18T02:04:36.337223+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_clean_scrub_stamp":"2024-09-18T02:03:42.235832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:47:03.749921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350315+0000","last_change":"2024-09-18T02:03:50.287984+0000","last_active":"2024-09-18T02:04:36.350315+0000","last_peered":"2024-09-18T02:04:36.350315+0000","last_clean":"2024-09-18T02:04:36.350315+0000","last_became_active":"2024-09-18T02:03:48.273444+0000","last_became_peered":"2024-09-18T02:03:48.273444+0000","last_unstale":"2024-09-18T02:04:36.350315+0000","last_undegraded":"2024-09-18T02:04:36.350315+0000","last_fullsized":"2024-09-18T02:04:36.350315+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:18.121435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024299339999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.048115+0000","last_change":"2024-09-18T02:03:57.533463+0000","last_active":"2024-09-18T02:06:11.048115+0000","last_peered":"2024-09-18T02:06:11.048115+0000","last_clean":"2024-09-18T02:06:11.048115+0000","last_became_active":"2024-09-18T02:03:57.532844+0000","last_became_peered":"2024-09-18T02:03:57.532844+0000","last_unstale":"2024-09-18T02:06:11.048115+0000","last_undegraded":"2024-09-18T02:06:11.048115+0000","last_fullsized":"2024-09-18T02:06:11.048115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:09.285157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.347738+0000","last_change":"2024-09-18T02:04:01.565115+0000","last_active":"2024-09-18T02:04:36.347738+0000","last_peered":"2024-09-18T02:04:36.347738+0000","last_clean":"2024-09-18T02:04:36.347738+0000","last_became_active":"2024-09-18T02:04:01.563633+0000","last_became_peered":"2024-09-18T02:04:01.563633+0000","last_unstale":"2024-09-18T02:04:36.347738+0000","last_undegraded":"2024-09-18T02:04:36.347738+0000","last_fullsized":"2024-09-18T02:04:36.347738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:13:18.066545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":160,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.139607+0000","last_change":"2024-09-18T02:04:03.607393+0000","last_active":"2024-09-18T02:06:09.139607+0000","last_peered":"2024-09-18T02:06:09.139607+0000","last_clean":"2024-09-18T02:06:09.139607+0000","last_became_active":"2024-09-18T02:04:03.606800+0000","last_became_peered":"2024-09-18T02:04:03.606800+0000","last_unstale":"2024-09-18T02:06:09.139607+0000","last_undegraded":"2024-09-18T02:06:09.139607+0000","last_fullsized":"2024-09-18T02:06:09.139607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:02:19.651160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":84,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345601+0000","last_change":"2024-09-18T02:04:05.589275+0000","last_active":"2024-09-18T02:04:36.345601+0000","last_peered":"2024-09-18T02:04:36.345601+0000","last_clean":"2024-09-18T02:04:36.345601+0000","last_became_active":"2024-09-18T02:04:05.588568+0000","last_became_peered":"2024-09-18T02:04:05.588568+0000","last_unstale":"2024-09-18T02:04:36.345601+0000","last_undegraded":"2024-09-18T02:04:36.345601+0000","last_fullsized":"2024-09-18T02:04:36.345601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:31.240038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.245394+0000","last_change":"2024-09-18T02:04:07.628613+0000","last_active":"2024-09-18T02:07:12.245394+0000","last_peered":"2024-09-18T02:07:12.245394+0000","last_clean":"2024-09-18T02:07:12.245394+0000","last_became_active":"2024-09-18T02:04:07.613914+0000","last_became_peered":"2024-09-18T02:04:07.613914+0000","last_unstale":"2024-09-18T02:07:12.245394+0000","last_undegraded":"2024-09-18T02:07:12.245394+0000","last_fullsized":"2024-09-18T02:07:12.245394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:11.758456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.169657+0000","last_change":"2024-09-18T02:03:59.556174+0000","last_active":"2024-09-18T02:07:12.169657+0000","last_peered":"2024-09-18T02:07:12.169657+0000","last_clean":"2024-09-18T02:07:12.169657+0000","last_became_active":"2024-09-18T02:03:59.555801+0000","last_became_peered":"2024-09-18T02:03:59.555801+0000","last_unstale":"2024-09-18T02:07:12.169657+0000","last_undegraded":"2024-09-18T02:07:12.169657+0000","last_fullsized":"2024-09-18T02:07:12.169657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:28.174295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346239+0000","last_change":"2024-09-18T02:03:50.285797+0000","last_active":"2024-09-18T02:04:36.346239+0000","last_peered":"2024-09-18T02:04:36.346239+0000","last_clean":"2024-09-18T02:04:36.346239+0000","last_became_active":"2024-09-18T02:03:48.275709+0000","last_became_peered":"2024-09-18T02:03:48.275709+0000","last_unstale":"2024-09-18T02:04:36.346239+0000","last_undegraded":"2024-09-18T02:04:36.346239+0000","last_fullsized":"2024-09-18T02:04:36.346239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:53.873897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047579399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339035+0000","last_change":"2024-09-18T02:03:57.521576+0000","last_active":"2024-09-18T02:04:36.339035+0000","last_peered":"2024-09-18T02:04:36.339035+0000","last_clean":"2024-09-18T02:04:36.339035+0000","last_became_active":"2024-09-18T02:03:57.520559+0000","last_became_peered":"2024-09-18T02:03:57.520559+0000","last_unstale":"2024-09-18T02:04:36.339035+0000","last_undegraded":"2024-09-18T02:04:36.339035+0000","last_fullsized":"2024-09-18T02:04:36.339035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.363932+0000","last_change":"2024-09-18T02:04:01.561598+0000","last_active":"2024-09-18T02:04:36.363932+0000","last_peered":"2024-09-18T02:04:36.363932+0000","last_clean":"2024-09-18T02:04:36.363932+0000","last_became_active":"2024-09-18T02:04:01.561194+0000","last_became_peered":"2024-09-18T02:04:01.561194+0000","last_unstale":"2024-09-18T02:04:36.363932+0000","last_undegraded":"2024-09-18T02:04:36.363932+0000","last_fullsized":"2024-09-18T02:04:36.363932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:23.937467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'279","reported_seq":489,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.782113+0000","last_change":"2024-09-18T02:04:03.571137+0000","last_active":"2024-09-18T02:07:11.782113+0000","last_peered":"2024-09-18T02:07:11.782113+0000","last_clean":"2024-09-18T02:07:11.782113+0000","last_became_active":"2024-09-18T02:04:03.570288+0000","last_became_peered":"2024-09-18T02:04:03.570288+0000","last_unstale":"2024-09-18T02:07:11.782113+0000","last_undegraded":"2024-09-18T02:07:11.782113+0000","last_fullsized":"2024-09-18T02:07:11.782113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:22.857455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353081+0000","last_change":"2024-09-18T02:04:05.609826+0000","last_active":"2024-09-18T02:04:36.353081+0000","last_peered":"2024-09-18T02:04:36.353081+0000","last_clean":"2024-09-18T02:04:36.353081+0000","last_became_active":"2024-09-18T02:04:05.608544+0000","last_became_peered":"2024-09-18T02:04:05.608544+0000","last_unstale":"2024-09-18T02:04:36.353081+0000","last_undegraded":"2024-09-18T02:04:36.353081+0000","last_fullsized":"2024-09-18T02:04:36.353081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:32:12.009097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'7","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.130305+0000","last_change":"2024-09-18T02:04:07.624305+0000","last_active":"2024-09-18T02:07:12.130305+0000","last_peered":"2024-09-18T02:07:12.130305+0000","last_clean":"2024-09-18T02:07:12.130305+0000","last_became_active":"2024-09-18T02:04:07.622337+0000","last_became_peered":"2024-09-18T02:04:07.622337+0000","last_unstale":"2024-09-18T02:07:12.130305+0000","last_undegraded":"2024-09-18T02:07:12.130305+0000","last_fullsized":"2024-09-18T02:07:12.130305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:48.413588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153178+0000","last_change":"2024-09-18T02:03:59.549829+0000","last_active":"2024-09-18T02:07:12.153178+0000","last_peered":"2024-09-18T02:07:12.153178+0000","last_clean":"2024-09-18T02:07:12.153178+0000","last_became_active":"2024-09-18T02:03:59.548308+0000","last_became_peered":"2024-09-18T02:03:59.548308+0000","last_unstale":"2024-09-18T02:07:12.153178+0000","last_undegraded":"2024-09-18T02:07:12.153178+0000","last_fullsized":"2024-09-18T02:07:12.153178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:36.437530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341109+0000","last_change":"2024-09-18T02:03:50.338272+0000","last_active":"2024-09-18T02:04:36.341109+0000","last_peered":"2024-09-18T02:04:36.341109+0000","last_clean":"2024-09-18T02:04:36.341109+0000","last_became_active":"2024-09-18T02:03:48.275609+0000","last_became_peered":"2024-09-18T02:03:48.275609+0000","last_unstale":"2024-09-18T02:04:36.341109+0000","last_undegraded":"2024-09-18T02:04:36.341109+0000","last_fullsized":"2024-09-18T02:04:36.341109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067244799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.346475+0000","last_change":"2024-09-18T02:03:57.520998+0000","last_active":"2024-09-18T02:04:41.346475+0000","last_peered":"2024-09-18T02:04:41.346475+0000","last_clean":"2024-09-18T02:04:41.346475+0000","last_became_active":"2024-09-18T02:03:57.520103+0000","last_became_peered":"2024-09-18T02:03:57.520103+0000","last_unstale":"2024-09-18T02:04:41.346475+0000","last_undegraded":"2024-09-18T02:04:41.346475+0000","last_fullsized":"2024-09-18T02:04:41.346475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.369051+0000","last_change":"2024-09-18T02:04:01.560743+0000","last_active":"2024-09-18T02:04:36.369051+0000","last_peered":"2024-09-18T02:04:36.369051+0000","last_clean":"2024-09-18T02:04:36.369051+0000","last_became_active":"2024-09-18T02:04:01.560471+0000","last_became_peered":"2024-09-18T02:04:01.560471+0000","last_unstale":"2024-09-18T02:04:36.369051+0000","last_undegraded":"2024-09-18T02:04:36.369051+0000","last_fullsized":"2024-09-18T02:04:36.369051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:05.940301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.783060+0000","last_change":"2024-09-18T02:04:03.589654+0000","last_active":"2024-09-18T02:07:11.783060+0000","last_peered":"2024-09-18T02:07:11.783060+0000","last_clean":"2024-09-18T02:07:11.783060+0000","last_became_active":"2024-09-18T02:04:03.588913+0000","last_became_peered":"2024-09-18T02:04:03.588913+0000","last_unstale":"2024-09-18T02:07:11.783060+0000","last_undegraded":"2024-09-18T02:07:11.783060+0000","last_fullsized":"2024-09-18T02:07:11.783060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:24.835730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339832+0000","last_change":"2024-09-18T02:04:05.589310+0000","last_active":"2024-09-18T02:04:36.339832+0000","last_peered":"2024-09-18T02:04:36.339832+0000","last_clean":"2024-09-18T02:04:36.339832+0000","last_became_active":"2024-09-18T02:04:05.588457+0000","last_became_peered":"2024-09-18T02:04:05.588457+0000","last_unstale":"2024-09-18T02:04:36.339832+0000","last_undegraded":"2024-09-18T02:04:36.339832+0000","last_fullsized":"2024-09-18T02:04:36.339832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:27.971023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348229+0000","last_change":"2024-09-18T02:04:07.622460+0000","last_active":"2024-09-18T02:04:36.348229+0000","last_peered":"2024-09-18T02:04:36.348229+0000","last_clean":"2024-09-18T02:04:36.348229+0000","last_became_active":"2024-09-18T02:04:07.621651+0000","last_became_peered":"2024-09-18T02:04:07.621651+0000","last_unstale":"2024-09-18T02:04:36.348229+0000","last_undegraded":"2024-09-18T02:04:36.348229+0000","last_fullsized":"2024-09-18T02:04:36.348229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:58.105568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342749+0000","last_change":"2024-09-18T02:03:59.536526+0000","last_active":"2024-09-18T02:04:36.342749+0000","last_peered":"2024-09-18T02:04:36.342749+0000","last_clean":"2024-09-18T02:04:36.342749+0000","last_became_active":"2024-09-18T02:03:59.535693+0000","last_became_peered":"2024-09-18T02:03:59.535693+0000","last_unstale":"2024-09-18T02:04:36.342749+0000","last_undegraded":"2024-09-18T02:04:36.342749+0000","last_fullsized":"2024-09-18T02:04:36.342749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:45.343721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348980+0000","last_change":"2024-09-18T02:03:50.287790+0000","last_active":"2024-09-18T02:04:36.348980+0000","last_peered":"2024-09-18T02:04:36.348980+0000","last_clean":"2024-09-18T02:04:36.348980+0000","last_became_active":"2024-09-18T02:03:48.276543+0000","last_became_peered":"2024-09-18T02:03:48.276543+0000","last_unstale":"2024-09-18T02:04:36.348980+0000","last_undegraded":"2024-09-18T02:04:36.348980+0000","last_fullsized":"2024-09-18T02:04:36.348980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:17.356845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023330579999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.344795+0000","last_change":"2024-09-18T02:03:57.529138+0000","last_active":"2024-09-18T02:04:36.344795+0000","last_peered":"2024-09-18T02:04:36.344795+0000","last_clean":"2024-09-18T02:04:36.344795+0000","last_became_active":"2024-09-18T02:03:57.528828+0000","last_became_peered":"2024-09-18T02:03:57.528828+0000","last_unstale":"2024-09-18T02:04:36.344795+0000","last_undegraded":"2024-09-18T02:04:36.344795+0000","last_fullsized":"2024-09-18T02:04:36.344795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:40.008713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342804+0000","last_change":"2024-09-18T02:04:01.572278+0000","last_active":"2024-09-18T02:04:36.342804+0000","last_peered":"2024-09-18T02:04:36.342804+0000","last_clean":"2024-09-18T02:04:36.342804+0000","last_became_active":"2024-09-18T02:04:01.571608+0000","last_became_peered":"2024-09-18T02:04:01.571608+0000","last_unstale":"2024-09-18T02:04:36.342804+0000","last_undegraded":"2024-09-18T02:04:36.342804+0000","last_fullsized":"2024-09-18T02:04:36.342804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:01.789731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.140114+0000","last_change":"2024-09-18T02:04:03.602343+0000","last_active":"2024-09-18T02:07:11.140114+0000","last_peered":"2024-09-18T02:07:11.140114+0000","last_clean":"2024-09-18T02:07:11.140114+0000","last_became_active":"2024-09-18T02:04:03.601140+0000","last_became_peered":"2024-09-18T02:04:03.601140+0000","last_unstale":"2024-09-18T02:07:11.140114+0000","last_undegraded":"2024-09-18T02:07:11.140114+0000","last_fullsized":"2024-09-18T02:07:11.140114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:33:06.804055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358317+0000","last_change":"2024-09-18T02:04:05.612576+0000","last_active":"2024-09-18T02:04:36.358317+0000","last_peered":"2024-09-18T02:04:36.358317+0000","last_clean":"2024-09-18T02:04:36.358317+0000","last_became_active":"2024-09-18T02:04:05.612007+0000","last_became_peered":"2024-09-18T02:04:05.612007+0000","last_unstale":"2024-09-18T02:04:36.358317+0000","last_undegraded":"2024-09-18T02:04:36.358317+0000","last_fullsized":"2024-09-18T02:04:36.358317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:53:26.368935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.716259+0000","last_change":"2024-09-18T02:04:07.623097+0000","last_active":"2024-09-18T02:06:10.716259+0000","last_peered":"2024-09-18T02:06:10.716259+0000","last_clean":"2024-09-18T02:06:10.716259+0000","last_became_active":"2024-09-18T02:04:07.622247+0000","last_became_peered":"2024-09-18T02:04:07.622247+0000","last_unstale":"2024-09-18T02:06:10.716259+0000","last_undegraded":"2024-09-18T02:06:10.716259+0000","last_fullsized":"2024-09-18T02:06:10.716259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:17.300649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.954084+0000","last_change":"2024-09-18T02:03:59.560066+0000","last_active":"2024-09-18T02:06:06.954084+0000","last_peered":"2024-09-18T02:06:06.954084+0000","last_clean":"2024-09-18T02:06:06.954084+0000","last_became_active":"2024-09-18T02:03:59.559749+0000","last_became_peered":"2024-09-18T02:03:59.559749+0000","last_unstale":"2024-09-18T02:06:06.954084+0000","last_undegraded":"2024-09-18T02:06:06.954084+0000","last_fullsized":"2024-09-18T02:06:06.954084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364329+0000","last_change":"2024-09-18T02:03:57.524455+0000","last_active":"2024-09-18T02:04:36.364329+0000","last_peered":"2024-09-18T02:04:36.364329+0000","last_clean":"2024-09-18T02:04:36.364329+0000","last_became_active":"2024-09-18T02:03:57.519961+0000","last_became_peered":"2024-09-18T02:03:57.519961+0000","last_unstale":"2024-09-18T02:04:36.364329+0000","last_undegraded":"2024-09-18T02:04:36.364329+0000","last_fullsized":"2024-09-18T02:04:36.364329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:59.657833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339529+0000","last_change":"2024-09-18T02:03:50.282381+0000","last_active":"2024-09-18T02:04:36.339529+0000","last_peered":"2024-09-18T02:04:36.339529+0000","last_clean":"2024-09-18T02:04:36.339529+0000","last_became_active":"2024-09-18T02:03:48.274657+0000","last_became_peered":"2024-09-18T02:03:48.274657+0000","last_unstale":"2024-09-18T02:04:36.339529+0000","last_undegraded":"2024-09-18T02:04:36.339529+0000","last_fullsized":"2024-09-18T02:04:36.339529+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000970169,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329258+0000","last_change":"2024-09-18T02:04:01.572119+0000","last_active":"2024-09-18T02:06:06.329258+0000","last_peered":"2024-09-18T02:06:06.329258+0000","last_clean":"2024-09-18T02:06:06.329258+0000","last_became_active":"2024-09-18T02:04:01.571443+0000","last_became_peered":"2024-09-18T02:04:01.571443+0000","last_unstale":"2024-09-18T02:06:06.329258+0000","last_undegraded":"2024-09-18T02:06:06.329258+0000","last_fullsized":"2024-09-18T02:06:06.329258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:30:51.643126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'75","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.141667+0000","last_change":"2024-09-18T02:04:03.570750+0000","last_active":"2024-09-18T02:06:09.141667+0000","last_peered":"2024-09-18T02:06:09.141667+0000","last_clean":"2024-09-18T02:06:09.141667+0000","last_became_active":"2024-09-18T02:04:03.569938+0000","last_became_peered":"2024-09-18T02:04:03.569938+0000","last_unstale":"2024-09-18T02:06:09.141667+0000","last_undegraded":"2024-09-18T02:06:09.141667+0000","last_fullsized":"2024-09-18T02:06:09.141667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:24:06.892910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341836+0000","last_change":"2024-09-18T02:04:05.600403+0000","last_active":"2024-09-18T02:04:36.341836+0000","last_peered":"2024-09-18T02:04:36.341836+0000","last_clean":"2024-09-18T02:04:36.341836+0000","last_became_active":"2024-09-18T02:04:05.597181+0000","last_became_peered":"2024-09-18T02:04:05.597181+0000","last_unstale":"2024-09-18T02:04:36.341836+0000","last_undegraded":"2024-09-18T02:04:36.341836+0000","last_fullsized":"2024-09-18T02:04:36.341836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:34.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.978758+0000","last_change":"2024-09-18T02:04:07.619359+0000","last_active":"2024-09-18T02:06:10.978758+0000","last_peered":"2024-09-18T02:06:10.978758+0000","last_clean":"2024-09-18T02:06:10.978758+0000","last_became_active":"2024-09-18T02:04:07.618751+0000","last_became_peered":"2024-09-18T02:04:07.618751+0000","last_unstale":"2024-09-18T02:06:10.978758+0000","last_undegraded":"2024-09-18T02:06:10.978758+0000","last_fullsized":"2024-09-18T02:06:10.978758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:46.149767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.133793+0000","last_change":"2024-09-18T02:03:59.554002+0000","last_active":"2024-09-18T02:04:42.133793+0000","last_peered":"2024-09-18T02:04:42.133793+0000","last_clean":"2024-09-18T02:04:42.133793+0000","last_became_active":"2024-09-18T02:03:59.553619+0000","last_became_peered":"2024-09-18T02:03:59.553619+0000","last_unstale":"2024-09-18T02:04:42.133793+0000","last_undegraded":"2024-09-18T02:04:42.133793+0000","last_fullsized":"2024-09-18T02:04:42.133793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:31:07.318399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.915234+0000","last_change":"2024-09-18T02:03:57.519164+0000","last_active":"2024-09-18T02:04:42.915234+0000","last_peered":"2024-09-18T02:04:42.915234+0000","last_clean":"2024-09-18T02:04:42.915234+0000","last_became_active":"2024-09-18T02:03:57.518503+0000","last_became_peered":"2024-09-18T02:03:57.518503+0000","last_unstale":"2024-09-18T02:04:42.915234+0000","last_undegraded":"2024-09-18T02:04:42.915234+0000","last_fullsized":"2024-09-18T02:04:42.915234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:32.979432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353911+0000","last_change":"2024-09-18T02:03:50.288345+0000","last_active":"2024-09-18T02:04:36.353911+0000","last_peered":"2024-09-18T02:04:36.353911+0000","last_clean":"2024-09-18T02:04:36.353911+0000","last_became_active":"2024-09-18T02:03:48.276300+0000","last_became_peered":"2024-09-18T02:03:48.276300+0000","last_unstale":"2024-09-18T02:04:36.353911+0000","last_undegraded":"2024-09-18T02:04:36.353911+0000","last_fullsized":"2024-09-18T02:04:36.353911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:57.432759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002788245,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349422+0000","last_change":"2024-09-18T02:04:01.558361+0000","last_active":"2024-09-18T02:04:36.349422+0000","last_peered":"2024-09-18T02:04:36.349422+0000","last_clean":"2024-09-18T02:04:36.349422+0000","last_became_active":"2024-09-18T02:04:01.557570+0000","last_became_peered":"2024-09-18T02:04:01.557570+0000","last_unstale":"2024-09-18T02:04:36.349422+0000","last_undegraded":"2024-09-18T02:04:36.349422+0000","last_fullsized":"2024-09-18T02:04:36.349422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:35:33.472211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340131+0000","last_change":"2024-09-18T02:04:03.589283+0000","last_active":"2024-09-18T02:04:36.340131+0000","last_peered":"2024-09-18T02:04:36.340131+0000","last_clean":"2024-09-18T02:04:36.340131+0000","last_became_active":"2024-09-18T02:04:03.588539+0000","last_became_peered":"2024-09-18T02:04:03.588539+0000","last_unstale":"2024-09-18T02:04:36.340131+0000","last_undegraded":"2024-09-18T02:04:36.340131+0000","last_fullsized":"2024-09-18T02:04:36.340131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:11.364586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":347,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.782214+0000","last_change":"2024-09-18T02:04:05.583286+0000","last_active":"2024-09-18T02:07:11.782214+0000","last_peered":"2024-09-18T02:07:11.782214+0000","last_clean":"2024-09-18T02:07:11.782214+0000","last_became_active":"2024-09-18T02:04:05.582477+0000","last_became_peered":"2024-09-18T02:04:05.582477+0000","last_unstale":"2024-09-18T02:07:11.782214+0000","last_undegraded":"2024-09-18T02:07:11.782214+0000","last_fullsized":"2024-09-18T02:07:11.782214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:54.620838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.110007+0000","last_change":"2024-09-18T02:04:07.606623+0000","last_active":"2024-09-18T02:06:11.110007+0000","last_peered":"2024-09-18T02:06:11.110007+0000","last_clean":"2024-09-18T02:06:11.110007+0000","last_became_active":"2024-09-18T02:04:07.605591+0000","last_became_peered":"2024-09-18T02:04:07.605591+0000","last_unstale":"2024-09-18T02:06:11.110007+0000","last_undegraded":"2024-09-18T02:06:11.110007+0000","last_fullsized":"2024-09-18T02:06:11.110007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:37.470495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999320+0000","last_change":"2024-09-18T02:03:59.559409+0000","last_active":"2024-09-18T02:05:25.999320+0000","last_peered":"2024-09-18T02:05:25.999320+0000","last_clean":"2024-09-18T02:05:25.999320+0000","last_became_active":"2024-09-18T02:03:59.559044+0000","last_became_peered":"2024-09-18T02:03:59.559044+0000","last_unstale":"2024-09-18T02:05:25.999320+0000","last_undegraded":"2024-09-18T02:05:25.999320+0000","last_fullsized":"2024-09-18T02:05:25.999320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:14.041290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.362611+0000","last_change":"2024-09-18T02:03:57.522060+0000","last_active":"2024-09-18T02:04:36.362611+0000","last_peered":"2024-09-18T02:04:36.362611+0000","last_clean":"2024-09-18T02:04:36.362611+0000","last_became_active":"2024-09-18T02:03:57.521706+0000","last_became_peered":"2024-09-18T02:03:57.521706+0000","last_unstale":"2024-09-18T02:04:36.362611+0000","last_undegraded":"2024-09-18T02:04:36.362611+0000","last_fullsized":"2024-09-18T02:04:36.362611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:43.330210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342536+0000","last_change":"2024-09-18T02:03:50.282549+0000","last_active":"2024-09-18T02:04:36.342536+0000","last_peered":"2024-09-18T02:04:36.342536+0000","last_clean":"2024-09-18T02:04:36.342536+0000","last_became_active":"2024-09-18T02:03:48.274030+0000","last_became_peered":"2024-09-18T02:03:48.274030+0000","last_unstale":"2024-09-18T02:04:36.342536+0000","last_undegraded":"2024-09-18T02:04:36.342536+0000","last_fullsized":"2024-09-18T02:04:36.342536+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:21:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011092910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349976+0000","last_change":"2024-09-18T02:04:01.559241+0000","last_active":"2024-09-18T02:04:36.349976+0000","last_peered":"2024-09-18T02:04:36.349976+0000","last_clean":"2024-09-18T02:04:36.349976+0000","last_became_active":"2024-09-18T02:04:01.558915+0000","last_became_peered":"2024-09-18T02:04:01.558915+0000","last_unstale":"2024-09-18T02:04:36.349976+0000","last_undegraded":"2024-09-18T02:04:36.349976+0000","last_fullsized":"2024-09-18T02:04:36.349976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:22.220646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350138+0000","last_change":"2024-09-18T02:04:03.595150+0000","last_active":"2024-09-18T02:04:36.350138+0000","last_peered":"2024-09-18T02:04:36.350138+0000","last_clean":"2024-09-18T02:04:36.350138+0000","last_became_active":"2024-09-18T02:04:03.591378+0000","last_became_peered":"2024-09-18T02:04:03.591378+0000","last_unstale":"2024-09-18T02:04:36.350138+0000","last_undegraded":"2024-09-18T02:04:36.350138+0000","last_fullsized":"2024-09-18T02:04:36.350138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:37.068150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.377867+0000","last_change":"2024-09-18T02:04:05.605812+0000","last_active":"2024-09-18T02:07:12.377867+0000","last_peered":"2024-09-18T02:07:12.377867+0000","last_clean":"2024-09-18T02:07:12.377867+0000","last_became_active":"2024-09-18T02:04:05.605265+0000","last_became_peered":"2024-09-18T02:04:05.605265+0000","last_unstale":"2024-09-18T02:07:12.377867+0000","last_undegraded":"2024-09-18T02:07:12.377867+0000","last_fullsized":"2024-09-18T02:07:12.377867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:35:37.505766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.963901+0000","last_change":"2024-09-18T02:04:07.624755+0000","last_active":"2024-09-18T02:06:06.963901+0000","last_peered":"2024-09-18T02:06:06.963901+0000","last_clean":"2024-09-18T02:06:06.963901+0000","last_became_active":"2024-09-18T02:04:07.624085+0000","last_became_peered":"2024-09-18T02:04:07.624085+0000","last_unstale":"2024-09-18T02:06:06.963901+0000","last_undegraded":"2024-09-18T02:06:06.963901+0000","last_fullsized":"2024-09-18T02:06:06.963901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:22.537224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340548+0000","last_change":"2024-09-18T02:03:59.535655+0000","last_active":"2024-09-18T02:04:36.340548+0000","last_peered":"2024-09-18T02:04:36.340548+0000","last_clean":"2024-09-18T02:04:36.340548+0000","last_became_active":"2024-09-18T02:03:59.535266+0000","last_became_peered":"2024-09-18T02:03:59.535266+0000","last_unstale":"2024-09-18T02:04:36.340548+0000","last_undegraded":"2024-09-18T02:04:36.340548+0000","last_fullsized":"2024-09-18T02:04:36.340548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.342844+0000","last_change":"2024-09-18T02:03:57.529076+0000","last_active":"2024-09-18T02:04:41.342844+0000","last_peered":"2024-09-18T02:04:41.342844+0000","last_clean":"2024-09-18T02:04:41.342844+0000","last_became_active":"2024-09-18T02:03:57.528676+0000","last_became_peered":"2024-09-18T02:03:57.528676+0000","last_unstale":"2024-09-18T02:04:41.342844+0000","last_undegraded":"2024-09-18T02:04:41.342844+0000","last_fullsized":"2024-09-18T02:04:41.342844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358547+0000","last_change":"2024-09-18T02:03:50.288611+0000","last_active":"2024-09-18T02:04:36.358547+0000","last_peered":"2024-09-18T02:04:36.358547+0000","last_clean":"2024-09-18T02:04:36.358547+0000","last_became_active":"2024-09-18T02:03:48.396609+0000","last_became_peered":"2024-09-18T02:03:48.396609+0000","last_unstale":"2024-09-18T02:04:36.358547+0000","last_undegraded":"2024-09-18T02:04:36.358547+0000","last_fullsized":"2024-09-18T02:04:36.358547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:40:52.248589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025902970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348392+0000","last_change":"2024-09-18T02:04:01.562114+0000","last_active":"2024-09-18T02:04:36.348392+0000","last_peered":"2024-09-18T02:04:36.348392+0000","last_clean":"2024-09-18T02:04:36.348392+0000","last_became_active":"2024-09-18T02:04:01.561488+0000","last_became_peered":"2024-09-18T02:04:01.561488+0000","last_unstale":"2024-09-18T02:04:36.348392+0000","last_undegraded":"2024-09-18T02:04:36.348392+0000","last_fullsized":"2024-09-18T02:04:36.348392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:00.270005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'88","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.119183+0000","last_change":"2024-09-18T02:04:03.586693+0000","last_active":"2024-09-18T02:06:09.119183+0000","last_peered":"2024-09-18T02:06:09.119183+0000","last_clean":"2024-09-18T02:06:09.119183+0000","last_became_active":"2024-09-18T02:04:03.585879+0000","last_became_peered":"2024-09-18T02:04:03.585879+0000","last_unstale":"2024-09-18T02:06:09.119183+0000","last_undegraded":"2024-09-18T02:06:09.119183+0000","last_fullsized":"2024-09-18T02:06:09.119183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:19.044304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342766+0000","last_change":"2024-09-18T02:04:05.589374+0000","last_active":"2024-09-18T02:04:36.342766+0000","last_peered":"2024-09-18T02:04:36.342766+0000","last_clean":"2024-09-18T02:04:36.342766+0000","last_became_active":"2024-09-18T02:04:05.588676+0000","last_became_peered":"2024-09-18T02:04:05.588676+0000","last_unstale":"2024-09-18T02:04:36.342766+0000","last_undegraded":"2024-09-18T02:04:36.342766+0000","last_fullsized":"2024-09-18T02:04:36.342766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:18.118339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.995352+0000","last_change":"2024-09-18T02:04:07.620173+0000","last_active":"2024-09-18T02:05:25.995352+0000","last_peered":"2024-09-18T02:05:25.995352+0000","last_clean":"2024-09-18T02:05:25.995352+0000","last_became_active":"2024-09-18T02:04:07.619587+0000","last_became_peered":"2024-09-18T02:04:07.619587+0000","last_unstale":"2024-09-18T02:05:25.995352+0000","last_undegraded":"2024-09-18T02:05:25.995352+0000","last_fullsized":"2024-09-18T02:05:25.995352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:28.267582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.362280+0000","last_change":"2024-09-18T02:04:07.628261+0000","last_active":"2024-09-18T02:04:36.362280+0000","last_peered":"2024-09-18T02:04:36.362280+0000","last_clean":"2024-09-18T02:04:36.362280+0000","last_became_active":"2024-09-18T02:04:07.626396+0000","last_became_peered":"2024-09-18T02:04:07.626396+0000","last_unstale":"2024-09-18T02:04:36.362280+0000","last_undegraded":"2024-09-18T02:04:36.362280+0000","last_fullsized":"2024-09-18T02:04:36.362280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:06.316942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.334934+0000","last_change":"2024-09-18T02:03:59.538659+0000","last_active":"2024-09-18T02:06:21.334934+0000","last_peered":"2024-09-18T02:06:21.334934+0000","last_clean":"2024-09-18T02:06:21.334934+0000","last_became_active":"2024-09-18T02:03:59.538280+0000","last_became_peered":"2024-09-18T02:03:59.538280+0000","last_unstale":"2024-09-18T02:06:21.334934+0000","last_undegraded":"2024-09-18T02:06:21.334934+0000","last_fullsized":"2024-09-18T02:06:21.334934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353217+0000","last_change":"2024-09-18T02:03:57.531366+0000","last_active":"2024-09-18T02:04:36.353217+0000","last_peered":"2024-09-18T02:04:36.353217+0000","last_clean":"2024-09-18T02:04:36.353217+0000","last_became_active":"2024-09-18T02:03:57.530751+0000","last_became_peered":"2024-09-18T02:03:57.530751+0000","last_unstale":"2024-09-18T02:04:36.353217+0000","last_undegraded":"2024-09-18T02:04:36.353217+0000","last_fullsized":"2024-09-18T02:04:36.353217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:13.572982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339720+0000","last_change":"2024-09-18T02:04:01.561923+0000","last_active":"2024-09-18T02:04:36.339720+0000","last_peered":"2024-09-18T02:04:36.339720+0000","last_clean":"2024-09-18T02:04:36.339720+0000","last_became_active":"2024-09-18T02:04:01.561230+0000","last_became_peered":"2024-09-18T02:04:01.561230+0000","last_unstale":"2024-09-18T02:04:36.339720+0000","last_undegraded":"2024-09-18T02:04:36.339720+0000","last_fullsized":"2024-09-18T02:04:36.339720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:33.717350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.128263+0000","last_change":"2024-09-18T02:04:03.595872+0000","last_active":"2024-09-18T02:06:09.128263+0000","last_peered":"2024-09-18T02:06:09.128263+0000","last_clean":"2024-09-18T02:06:09.128263+0000","last_became_active":"2024-09-18T02:04:03.595284+0000","last_became_peered":"2024-09-18T02:04:03.595284+0000","last_unstale":"2024-09-18T02:06:09.128263+0000","last_undegraded":"2024-09-18T02:06:09.128263+0000","last_fullsized":"2024-09-18T02:06:09.128263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:04.625050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348172+0000","last_change":"2024-09-18T02:04:05.603244+0000","last_active":"2024-09-18T02:04:36.348172+0000","last_peered":"2024-09-18T02:04:36.348172+0000","last_clean":"2024-09-18T02:04:36.348172+0000","last_became_active":"2024-09-18T02:04:05.602528+0000","last_became_peered":"2024-09-18T02:04:05.602528+0000","last_unstale":"2024-09-18T02:04:36.348172+0000","last_undegraded":"2024-09-18T02:04:36.348172+0000","last_fullsized":"2024-09-18T02:04:36.348172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:08:44.924870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:08.724227+0000","last_change":"2024-09-18T02:04:07.623315+0000","last_active":"2024-09-18T02:06:08.724227+0000","last_peered":"2024-09-18T02:06:08.724227+0000","last_clean":"2024-09-18T02:06:08.724227+0000","last_became_active":"2024-09-18T02:04:07.622753+0000","last_became_peered":"2024-09-18T02:04:07.622753+0000","last_unstale":"2024-09-18T02:06:08.724227+0000","last_undegraded":"2024-09-18T02:06:08.724227+0000","last_fullsized":"2024-09-18T02:06:08.724227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:08:47.142951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'9","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.090383+0000","last_change":"2024-09-18T02:03:59.555234+0000","last_active":"2024-09-18T02:07:12.090383+0000","last_peered":"2024-09-18T02:07:12.090383+0000","last_clean":"2024-09-18T02:07:12.090383+0000","last_became_active":"2024-09-18T02:03:59.554803+0000","last_became_peered":"2024-09-18T02:03:59.554803+0000","last_unstale":"2024-09-18T02:07:12.090383+0000","last_undegraded":"2024-09-18T02:07:12.090383+0000","last_fullsized":"2024-09-18T02:07:12.090383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364065+0000","last_change":"2024-09-18T02:03:57.522614+0000","last_active":"2024-09-18T02:04:36.364065+0000","last_peered":"2024-09-18T02:04:36.364065+0000","last_clean":"2024-09-18T02:04:36.364065+0000","last_became_active":"2024-09-18T02:03:57.519403+0000","last_became_peered":"2024-09-18T02:03:57.519403+0000","last_unstale":"2024-09-18T02:04:36.364065+0000","last_undegraded":"2024-09-18T02:04:36.364065+0000","last_fullsized":"2024-09-18T02:04:36.364065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.351923+0000","last_change":"2024-09-18T02:04:01.561432+0000","last_active":"2024-09-18T02:04:36.351923+0000","last_peered":"2024-09-18T02:04:36.351923+0000","last_clean":"2024-09-18T02:04:36.351923+0000","last_became_active":"2024-09-18T02:04:01.558788+0000","last_became_peered":"2024-09-18T02:04:01.558788+0000","last_unstale":"2024-09-18T02:04:36.351923+0000","last_undegraded":"2024-09-18T02:04:36.351923+0000","last_fullsized":"2024-09-18T02:04:36.351923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:11.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.150563+0000","last_change":"2024-09-18T02:04:03.581820+0000","last_active":"2024-09-18T02:07:11.150563+0000","last_peered":"2024-09-18T02:07:11.150563+0000","last_clean":"2024-09-18T02:07:11.150563+0000","last_became_active":"2024-09-18T02:04:03.581045+0000","last_became_peered":"2024-09-18T02:04:03.581045+0000","last_unstale":"2024-09-18T02:07:11.150563+0000","last_undegraded":"2024-09-18T02:07:11.150563+0000","last_fullsized":"2024-09-18T02:07:11.150563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:58.075420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341472+0000","last_change":"2024-09-18T02:04:05.600005+0000","last_active":"2024-09-18T02:04:36.341472+0000","last_peered":"2024-09-18T02:04:36.341472+0000","last_clean":"2024-09-18T02:04:36.341472+0000","last_became_active":"2024-09-18T02:04:05.599064+0000","last_became_peered":"2024-09-18T02:04:05.599064+0000","last_unstale":"2024-09-18T02:04:36.341472+0000","last_undegraded":"2024-09-18T02:04:36.341472+0000","last_fullsized":"2024-09-18T02:04:36.341472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:24:08.906433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339501+0000","last_change":"2024-09-18T02:04:07.610644+0000","last_active":"2024-09-18T02:04:36.339501+0000","last_peered":"2024-09-18T02:04:36.339501+0000","last_clean":"2024-09-18T02:04:36.339501+0000","last_became_active":"2024-09-18T02:04:07.609954+0000","last_became_peered":"2024-09-18T02:04:07.609954+0000","last_unstale":"2024-09-18T02:04:36.339501+0000","last_undegraded":"2024-09-18T02:04:36.339501+0000","last_fullsized":"2024-09-18T02:04:36.339501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:07:58.304562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089718+0000","last_change":"2024-09-18T02:03:59.550899+0000","last_active":"2024-09-18T02:07:12.089718+0000","last_peered":"2024-09-18T02:07:12.089718+0000","last_clean":"2024-09-18T02:07:12.089718+0000","last_became_active":"2024-09-18T02:03:59.549791+0000","last_became_peered":"2024-09-18T02:03:59.549791+0000","last_unstale":"2024-09-18T02:07:12.089718+0000","last_undegraded":"2024-09-18T02:07:12.089718+0000","last_fullsized":"2024-09-18T02:07:12.089718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.372750+0000","last_change":"2024-09-18T02:04:36.371010+0000","last_active":"2024-09-18T02:04:36.372750+0000","last_peered":"2024-09-18T02:04:36.372750+0000","last_clean":"2024-09-18T02:04:36.372750+0000","last_became_active":"2024-09-18T02:04:36.370188+0000","last_became_peered":"2024-09-18T02:04:36.370188+0000","last_unstale":"2024-09-18T02:04:36.372750+0000","last_undegraded":"2024-09-18T02:04:36.372750+0000","last_fullsized":"2024-09-18T02:04:36.372750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:09.187217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339915+0000","last_change":"2024-09-18T02:04:01.563073+0000","last_active":"2024-09-18T02:04:36.339915+0000","last_peered":"2024-09-18T02:04:36.339915+0000","last_clean":"2024-09-18T02:04:36.339915+0000","last_became_active":"2024-09-18T02:04:01.562586+0000","last_became_peered":"2024-09-18T02:04:01.562586+0000","last_unstale":"2024-09-18T02:04:36.339915+0000","last_undegraded":"2024-09-18T02:04:36.339915+0000","last_fullsized":"2024-09-18T02:04:36.339915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:14.943821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'42","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.236537+0000","last_change":"2024-09-18T02:04:03.579212+0000","last_active":"2024-09-18T02:07:11.236537+0000","last_peered":"2024-09-18T02:07:11.236537+0000","last_clean":"2024-09-18T02:07:11.236537+0000","last_became_active":"2024-09-18T02:04:03.578581+0000","last_became_peered":"2024-09-18T02:04:03.578581+0000","last_unstale":"2024-09-18T02:07:11.236537+0000","last_undegraded":"2024-09-18T02:07:11.236537+0000","last_fullsized":"2024-09-18T02:07:11.236537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:17.779908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338314+0000","last_change":"2024-09-18T02:04:05.587685+0000","last_active":"2024-09-18T02:04:36.338314+0000","last_peered":"2024-09-18T02:04:36.338314+0000","last_clean":"2024-09-18T02:04:36.338314+0000","last_became_active":"2024-09-18T02:04:05.586978+0000","last_became_peered":"2024-09-18T02:04:05.586978+0000","last_unstale":"2024-09-18T02:04:36.338314+0000","last_undegraded":"2024-09-18T02:04:36.338314+0000","last_fullsized":"2024-09-18T02:04:36.338314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:36.991801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.935106+0000","last_change":"2024-09-18T02:04:07.611859+0000","last_active":"2024-09-18T02:04:42.935106+0000","last_peered":"2024-09-18T02:04:42.935106+0000","last_clean":"2024-09-18T02:04:42.935106+0000","last_became_active":"2024-09-18T02:04:07.607227+0000","last_became_peered":"2024-09-18T02:04:07.607227+0000","last_unstale":"2024-09-18T02:04:42.935106+0000","last_undegraded":"2024-09-18T02:04:42.935106+0000","last_fullsized":"2024-09-18T02:04:42.935106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:15.944064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.303117+0000","last_change":"2024-09-18T02:03:59.550610+0000","last_active":"2024-09-18T02:05:26.303117+0000","last_peered":"2024-09-18T02:05:26.303117+0000","last_clean":"2024-09-18T02:05:26.303117+0000","last_became_active":"2024-09-18T02:03:59.550221+0000","last_became_peered":"2024-09-18T02:03:59.550221+0000","last_unstale":"2024-09-18T02:05:26.303117+0000","last_undegraded":"2024-09-18T02:05:26.303117+0000","last_fullsized":"2024-09-18T02:05:26.303117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:20.801441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342516+0000","last_change":"2024-09-18T02:03:57.523727+0000","last_active":"2024-09-18T02:04:36.342516+0000","last_peered":"2024-09-18T02:04:36.342516+0000","last_clean":"2024-09-18T02:04:36.342516+0000","last_became_active":"2024-09-18T02:03:57.522590+0000","last_became_peered":"2024-09-18T02:03:57.522590+0000","last_unstale":"2024-09-18T02:04:36.342516+0000","last_undegraded":"2024-09-18T02:04:36.342516+0000","last_fullsized":"2024-09-18T02:04:36.342516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350028+0000","last_change":"2024-09-18T02:04:01.566731+0000","last_active":"2024-09-18T02:04:36.350028+0000","last_peered":"2024-09-18T02:04:36.350028+0000","last_clean":"2024-09-18T02:04:36.350028+0000","last_became_active":"2024-09-18T02:04:01.566205+0000","last_became_peered":"2024-09-18T02:04:01.566205+0000","last_unstale":"2024-09-18T02:04:36.350028+0000","last_undegraded":"2024-09-18T02:04:36.350028+0000","last_fullsized":"2024-09-18T02:04:36.350028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:56.533384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.106435+0000","last_change":"2024-09-18T02:04:03.581994+0000","last_active":"2024-09-18T02:06:09.106435+0000","last_peered":"2024-09-18T02:06:09.106435+0000","last_clean":"2024-09-18T02:06:09.106435+0000","last_became_active":"2024-09-18T02:04:03.580770+0000","last_became_peered":"2024-09-18T02:04:03.580770+0000","last_unstale":"2024-09-18T02:06:09.106435+0000","last_undegraded":"2024-09-18T02:06:09.106435+0000","last_fullsized":"2024-09-18T02:06:09.106435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:03.809763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354157+0000","last_change":"2024-09-18T02:04:05.597119+0000","last_active":"2024-09-18T02:04:36.354157+0000","last_peered":"2024-09-18T02:04:36.354157+0000","last_clean":"2024-09-18T02:04:36.354157+0000","last_became_active":"2024-09-18T02:04:05.591514+0000","last_became_peered":"2024-09-18T02:04:05.591514+0000","last_unstale":"2024-09-18T02:04:36.354157+0000","last_undegraded":"2024-09-18T02:04:36.354157+0000","last_fullsized":"2024-09-18T02:04:36.354157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:35.071524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217553+0000","last_change":"2024-09-18T02:03:59.554054+0000","last_active":"2024-09-18T02:07:12.217553+0000","last_peered":"2024-09-18T02:07:12.217553+0000","last_clean":"2024-09-18T02:07:12.217553+0000","last_became_active":"2024-09-18T02:03:59.553660+0000","last_became_peered":"2024-09-18T02:03:59.553660+0000","last_unstale":"2024-09-18T02:07:12.217553+0000","last_undegraded":"2024-09-18T02:07:12.217553+0000","last_fullsized":"2024-09-18T02:07:12.217553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:20.271703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.205809+0000","last_change":"2024-09-18T02:03:57.528505+0000","last_active":"2024-09-18T02:07:12.205809+0000","last_peered":"2024-09-18T02:07:12.205809+0000","last_clean":"2024-09-18T02:07:12.205809+0000","last_became_active":"2024-09-18T02:03:57.526941+0000","last_became_peered":"2024-09-18T02:03:57.526941+0000","last_unstale":"2024-09-18T02:07:12.205809+0000","last_undegraded":"2024-09-18T02:07:12.205809+0000","last_fullsized":"2024-09-18T02:07:12.205809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:49.524693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345450+0000","last_change":"2024-09-18T02:04:01.561664+0000","last_active":"2024-09-18T02:04:36.345450+0000","last_peered":"2024-09-18T02:04:36.345450+0000","last_clean":"2024-09-18T02:04:36.345450+0000","last_became_active":"2024-09-18T02:04:01.559839+0000","last_became_peered":"2024-09-18T02:04:01.559839+0000","last_unstale":"2024-09-18T02:04:36.345450+0000","last_undegraded":"2024-09-18T02:04:36.345450+0000","last_fullsized":"2024-09-18T02:04:36.345450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:20.919571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'61","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.137622+0000","last_change":"2024-09-18T02:04:03.582199+0000","last_active":"2024-09-18T02:06:09.137622+0000","last_peered":"2024-09-18T02:06:09.137622+0000","last_clean":"2024-09-18T02:06:09.137622+0000","last_became_active":"2024-09-18T02:04:03.581518+0000","last_became_peered":"2024-09-18T02:04:03.581518+0000","last_unstale":"2024-09-18T02:06:09.137622+0000","last_undegraded":"2024-09-18T02:06:09.137622+0000","last_fullsized":"2024-09-18T02:06:09.137622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:11.364586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.356105+0000","last_change":"2024-09-18T02:04:05.610785+0000","last_active":"2024-09-18T02:04:36.356105+0000","last_peered":"2024-09-18T02:04:36.356105+0000","last_clean":"2024-09-18T02:04:36.356105+0000","last_became_active":"2024-09-18T02:04:05.610007+0000","last_became_peered":"2024-09-18T02:04:05.610007+0000","last_unstale":"2024-09-18T02:04:36.356105+0000","last_undegraded":"2024-09-18T02:04:36.356105+0000","last_fullsized":"2024-09-18T02:04:36.356105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:20.894379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'20","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.266684+0000","last_change":"2024-09-18T02:04:07.610032+0000","last_active":"2024-09-18T02:07:11.266684+0000","last_peered":"2024-09-18T02:07:11.266684+0000","last_clean":"2024-09-18T02:07:11.266684+0000","last_became_active":"2024-09-18T02:04:07.609058+0000","last_became_peered":"2024-09-18T02:04:07.609058+0000","last_unstale":"2024-09-18T02:07:11.266684+0000","last_undegraded":"2024-09-18T02:07:11.266684+0000","last_fullsized":"2024-09-18T02:07:11.266684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:01:06.704072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069945+0000","last_change":"2024-09-18T02:03:59.541759+0000","last_active":"2024-09-18T02:07:12.069945+0000","last_peered":"2024-09-18T02:07:12.069945+0000","last_clean":"2024-09-18T02:07:12.069945+0000","last_became_active":"2024-09-18T02:03:59.540971+0000","last_became_peered":"2024-09-18T02:03:59.540971+0000","last_unstale":"2024-09-18T02:07:12.069945+0000","last_undegraded":"2024-09-18T02:07:12.069945+0000","last_fullsized":"2024-09-18T02:07:12.069945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.343543+0000","last_change":"2024-09-18T02:03:57.519487+0000","last_active":"2024-09-18T02:04:41.343543+0000","last_peered":"2024-09-18T02:04:41.343543+0000","last_clean":"2024-09-18T02:04:41.343543+0000","last_became_active":"2024-09-18T02:03:57.518311+0000","last_became_peered":"2024-09-18T02:03:57.518311+0000","last_unstale":"2024-09-18T02:04:41.343543+0000","last_undegraded":"2024-09-18T02:04:41.343543+0000","last_fullsized":"2024-09-18T02:04:41.343543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:32.993234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364616+0000","last_change":"2024-09-18T02:04:01.564100+0000","last_active":"2024-09-18T02:04:36.364616+0000","last_peered":"2024-09-18T02:04:36.364616+0000","last_clean":"2024-09-18T02:04:36.364616+0000","last_became_active":"2024-09-18T02:04:01.563285+0000","last_became_peered":"2024-09-18T02:04:01.563285+0000","last_unstale":"2024-09-18T02:04:36.364616+0000","last_undegraded":"2024-09-18T02:04:36.364616+0000","last_fullsized":"2024-09-18T02:04:36.364616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:21:50.083821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.107503+0000","last_change":"2024-09-18T02:04:03.600506+0000","last_active":"2024-09-18T02:06:09.107503+0000","last_peered":"2024-09-18T02:06:09.107503+0000","last_clean":"2024-09-18T02:06:09.107503+0000","last_became_active":"2024-09-18T02:04:03.596605+0000","last_became_peered":"2024-09-18T02:04:03.596605+0000","last_unstale":"2024-09-18T02:06:09.107503+0000","last_undegraded":"2024-09-18T02:06:09.107503+0000","last_fullsized":"2024-09-18T02:06:09.107503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:42.407656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346876+0000","last_change":"2024-09-18T02:04:05.589795+0000","last_active":"2024-09-18T02:04:36.346876+0000","last_peered":"2024-09-18T02:04:36.346876+0000","last_clean":"2024-09-18T02:04:36.346876+0000","last_became_active":"2024-09-18T02:04:05.589023+0000","last_became_peered":"2024-09-18T02:04:05.589023+0000","last_unstale":"2024-09-18T02:04:36.346876+0000","last_undegraded":"2024-09-18T02:04:36.346876+0000","last_fullsized":"2024-09-18T02:04:36.346876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:38.266386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348720+0000","last_change":"2024-09-18T02:04:07.625988+0000","last_active":"2024-09-18T02:04:36.348720+0000","last_peered":"2024-09-18T02:04:36.348720+0000","last_clean":"2024-09-18T02:04:36.348720+0000","last_became_active":"2024-09-18T02:04:07.625440+0000","last_became_peered":"2024-09-18T02:04:07.625440+0000","last_unstale":"2024-09-18T02:04:36.348720+0000","last_undegraded":"2024-09-18T02:04:36.348720+0000","last_fullsized":"2024-09-18T02:04:36.348720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:01.797534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.117682+0000","last_change":"2024-09-18T02:03:59.561521+0000","last_active":"2024-09-18T02:06:11.117682+0000","last_peered":"2024-09-18T02:06:11.117682+0000","last_clean":"2024-09-18T02:06:11.117682+0000","last_became_active":"2024-09-18T02:03:59.561208+0000","last_became_peered":"2024-09-18T02:03:59.561208+0000","last_unstale":"2024-09-18T02:06:11.117682+0000","last_undegraded":"2024-09-18T02:06:11.117682+0000","last_fullsized":"2024-09-18T02:06:11.117682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:29.023712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339261+0000","last_change":"2024-09-18T02:03:57.521151+0000","last_active":"2024-09-18T02:04:36.339261+0000","last_peered":"2024-09-18T02:04:36.339261+0000","last_clean":"2024-09-18T02:04:36.339261+0000","last_became_active":"2024-09-18T02:03:57.520569+0000","last_became_peered":"2024-09-18T02:03:57.520569+0000","last_unstale":"2024-09-18T02:04:36.339261+0000","last_undegraded":"2024-09-18T02:04:36.339261+0000","last_fullsized":"2024-09-18T02:04:36.339261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:59:24.420659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358467+0000","last_change":"2024-09-18T02:04:01.566225+0000","last_active":"2024-09-18T02:04:36.358467+0000","last_peered":"2024-09-18T02:04:36.358467+0000","last_clean":"2024-09-18T02:04:36.358467+0000","last_became_active":"2024-09-18T02:04:01.565499+0000","last_became_peered":"2024-09-18T02:04:01.565499+0000","last_unstale":"2024-09-18T02:04:36.358467+0000","last_undegraded":"2024-09-18T02:04:36.358467+0000","last_fullsized":"2024-09-18T02:04:36.358467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:55:01.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.134007+0000","last_change":"2024-09-18T02:04:03.578501+0000","last_active":"2024-09-18T02:06:09.134007+0000","last_peered":"2024-09-18T02:06:09.134007+0000","last_clean":"2024-09-18T02:06:09.134007+0000","last_became_active":"2024-09-18T02:04:03.577841+0000","last_became_peered":"2024-09-18T02:04:03.577841+0000","last_unstale":"2024-09-18T02:06:09.134007+0000","last_undegraded":"2024-09-18T02:06:09.134007+0000","last_fullsized":"2024-09-18T02:06:09.134007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:32.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342393+0000","last_change":"2024-09-18T02:04:05.606498+0000","last_active":"2024-09-18T02:04:36.342393+0000","last_peered":"2024-09-18T02:04:36.342393+0000","last_clean":"2024-09-18T02:04:36.342393+0000","last_became_active":"2024-09-18T02:04:05.605718+0000","last_became_peered":"2024-09-18T02:04:05.605718+0000","last_unstale":"2024-09-18T02:04:36.342393+0000","last_undegraded":"2024-09-18T02:04:36.342393+0000","last_fullsized":"2024-09-18T02:04:36.342393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:15.389313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.105367+0000","last_change":"2024-09-18T02:04:07.621810+0000","last_active":"2024-09-18T02:06:11.105367+0000","last_peered":"2024-09-18T02:06:11.105367+0000","last_clean":"2024-09-18T02:06:11.105367+0000","last_became_active":"2024-09-18T02:04:07.621224+0000","last_became_peered":"2024-09-18T02:04:07.621224+0000","last_unstale":"2024-09-18T02:06:11.105367+0000","last_undegraded":"2024-09-18T02:06:11.105367+0000","last_fullsized":"2024-09-18T02:06:11.105367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:29:24.351329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154739+0000","last_change":"2024-09-18T02:03:59.538977+0000","last_active":"2024-09-18T02:07:12.154739+0000","last_peered":"2024-09-18T02:07:12.154739+0000","last_clean":"2024-09-18T02:07:12.154739+0000","last_became_active":"2024-09-18T02:03:59.536701+0000","last_became_peered":"2024-09-18T02:03:59.536701+0000","last_unstale":"2024-09-18T02:07:12.154739+0000","last_undegraded":"2024-09-18T02:07:12.154739+0000","last_fullsized":"2024-09-18T02:07:12.154739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:31.387691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.950020+0000","last_change":"2024-09-18T02:03:57.528489+0000","last_active":"2024-09-18T02:06:06.950020+0000","last_peered":"2024-09-18T02:06:06.950020+0000","last_clean":"2024-09-18T02:06:06.950020+0000","last_became_active":"2024-09-18T02:03:57.527891+0000","last_became_peered":"2024-09-18T02:03:57.527891+0000","last_unstale":"2024-09-18T02:06:06.950020+0000","last_undegraded":"2024-09-18T02:06:06.950020+0000","last_fullsized":"2024-09-18T02:06:06.950020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:46.827846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346510+0000","last_change":"2024-09-18T02:04:01.565064+0000","last_active":"2024-09-18T02:04:36.346510+0000","last_peered":"2024-09-18T02:04:36.346510+0000","last_clean":"2024-09-18T02:04:36.346510+0000","last_became_active":"2024-09-18T02:04:01.564187+0000","last_became_peered":"2024-09-18T02:04:01.564187+0000","last_unstale":"2024-09-18T02:04:36.346510+0000","last_undegraded":"2024-09-18T02:04:36.346510+0000","last_fullsized":"2024-09-18T02:04:36.346510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:34.109876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.359007+0000","last_change":"2024-09-18T02:04:03.600377+0000","last_active":"2024-09-18T02:04:36.359007+0000","last_peered":"2024-09-18T02:04:36.359007+0000","last_clean":"2024-09-18T02:04:36.359007+0000","last_became_active":"2024-09-18T02:04:03.596273+0000","last_became_peered":"2024-09-18T02:04:03.596273+0000","last_unstale":"2024-09-18T02:04:36.359007+0000","last_undegraded":"2024-09-18T02:04:36.359007+0000","last_fullsized":"2024-09-18T02:04:36.359007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:10.785836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":371,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.401612+0000","last_change":"2024-09-18T02:04:05.604228+0000","last_active":"2024-09-18T02:07:12.401612+0000","last_peered":"2024-09-18T02:07:12.401612+0000","last_clean":"2024-09-18T02:07:12.401612+0000","last_became_active":"2024-09-18T02:04:05.601182+0000","last_became_peered":"2024-09-18T02:04:05.601182+0000","last_unstale":"2024-09-18T02:07:12.401612+0000","last_undegraded":"2024-09-18T02:07:12.401612+0000","last_fullsized":"2024-09-18T02:07:12.401612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:26.319515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'8","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.127197+0000","last_change":"2024-09-18T02:04:07.622167+0000","last_active":"2024-09-18T02:04:42.127197+0000","last_peered":"2024-09-18T02:04:42.127197+0000","last_clean":"2024-09-18T02:04:42.127197+0000","last_became_active":"2024-09-18T02:04:07.621240+0000","last_became_peered":"2024-09-18T02:04:07.621240+0000","last_unstale":"2024-09-18T02:04:42.127197+0000","last_undegraded":"2024-09-18T02:04:42.127197+0000","last_fullsized":"2024-09-18T02:04:42.127197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:44.681571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.866922+0000","last_change":"2024-09-18T02:03:59.536823+0000","last_active":"2024-09-18T02:07:11.866922+0000","last_peered":"2024-09-18T02:07:11.866922+0000","last_clean":"2024-09-18T02:07:11.866922+0000","last_became_active":"2024-09-18T02:03:59.536486+0000","last_became_peered":"2024-09-18T02:03:59.536486+0000","last_unstale":"2024-09-18T02:07:11.866922+0000","last_undegraded":"2024-09-18T02:07:11.866922+0000","last_fullsized":"2024-09-18T02:07:11.866922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:27.777353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348480+0000","last_change":"2024-09-18T02:03:57.520866+0000","last_active":"2024-09-18T02:04:36.348480+0000","last_peered":"2024-09-18T02:04:36.348480+0000","last_clean":"2024-09-18T02:04:36.348480+0000","last_became_active":"2024-09-18T02:03:57.520452+0000","last_became_peered":"2024-09-18T02:03:57.520452+0000","last_unstale":"2024-09-18T02:04:36.348480+0000","last_undegraded":"2024-09-18T02:04:36.348480+0000","last_fullsized":"2024-09-18T02:04:36.348480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341004+0000","last_change":"2024-09-18T02:04:01.564822+0000","last_active":"2024-09-18T02:04:36.341004+0000","last_peered":"2024-09-18T02:04:36.341004+0000","last_clean":"2024-09-18T02:04:36.341004+0000","last_became_active":"2024-09-18T02:04:01.564165+0000","last_became_peered":"2024-09-18T02:04:01.564165+0000","last_unstale":"2024-09-18T02:04:36.341004+0000","last_undegraded":"2024-09-18T02:04:36.341004+0000","last_fullsized":"2024-09-18T02:04:36.341004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:22.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'60","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.093188+0000","last_change":"2024-09-18T02:04:03.567444+0000","last_active":"2024-09-18T02:06:09.093188+0000","last_peered":"2024-09-18T02:06:09.093188+0000","last_clean":"2024-09-18T02:06:09.093188+0000","last_became_active":"2024-09-18T02:04:03.566714+0000","last_became_peered":"2024-09-18T02:04:03.566714+0000","last_unstale":"2024-09-18T02:06:09.093188+0000","last_undegraded":"2024-09-18T02:06:09.093188+0000","last_fullsized":"2024-09-18T02:06:09.093188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:18.880856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.337525+0000","last_change":"2024-09-18T02:04:05.579190+0000","last_active":"2024-09-18T02:04:36.337525+0000","last_peered":"2024-09-18T02:04:36.337525+0000","last_clean":"2024-09-18T02:04:36.337525+0000","last_became_active":"2024-09-18T02:04:05.578635+0000","last_became_peered":"2024-09-18T02:04:05.578635+0000","last_unstale":"2024-09-18T02:04:36.337525+0000","last_undegraded":"2024-09-18T02:04:36.337525+0000","last_fullsized":"2024-09-18T02:04:36.337525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:43.899135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341545+0000","last_change":"2024-09-18T02:04:07.620173+0000","last_active":"2024-09-18T02:04:36.341545+0000","last_peered":"2024-09-18T02:04:36.341545+0000","last_clean":"2024-09-18T02:04:36.341545+0000","last_became_active":"2024-09-18T02:04:07.618696+0000","last_became_peered":"2024-09-18T02:04:07.618696+0000","last_unstale":"2024-09-18T02:04:36.341545+0000","last_undegraded":"2024-09-18T02:04:36.341545+0000","last_fullsized":"2024-09-18T02:04:36.341545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:33.646308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217552+0000","last_change":"2024-09-18T02:03:59.537068+0000","last_active":"2024-09-18T02:07:12.217552+0000","last_peered":"2024-09-18T02:07:12.217552+0000","last_clean":"2024-09-18T02:07:12.217552+0000","last_became_active":"2024-09-18T02:03:59.536693+0000","last_became_peered":"2024-09-18T02:03:59.536693+0000","last_unstale":"2024-09-18T02:07:12.217552+0000","last_undegraded":"2024-09-18T02:07:12.217552+0000","last_fullsized":"2024-09-18T02:07:12.217552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354641+0000","last_change":"2024-09-18T02:03:57.533853+0000","last_active":"2024-09-18T02:04:36.354641+0000","last_peered":"2024-09-18T02:04:36.354641+0000","last_clean":"2024-09-18T02:04:36.354641+0000","last_became_active":"2024-09-18T02:03:57.532963+0000","last_became_peered":"2024-09-18T02:03:57.532963+0000","last_unstale":"2024-09-18T02:04:36.354641+0000","last_undegraded":"2024-09-18T02:04:36.354641+0000","last_fullsized":"2024-09-18T02:04:36.354641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:13.750469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353918+0000","last_change":"2024-09-18T02:04:01.572718+0000","last_active":"2024-09-18T02:04:36.353918+0000","last_peered":"2024-09-18T02:04:36.353918+0000","last_clean":"2024-09-18T02:04:36.353918+0000","last_became_active":"2024-09-18T02:04:01.572089+0000","last_became_peered":"2024-09-18T02:04:01.572089+0000","last_unstale":"2024-09-18T02:04:36.353918+0000","last_undegraded":"2024-09-18T02:04:36.353918+0000","last_fullsized":"2024-09-18T02:04:36.353918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:12.503091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.095516+0000","last_change":"2024-09-18T02:04:03.570795+0000","last_active":"2024-09-18T02:06:09.095516+0000","last_peered":"2024-09-18T02:06:09.095516+0000","last_clean":"2024-09-18T02:06:09.095516+0000","last_became_active":"2024-09-18T02:04:03.569962+0000","last_became_peered":"2024-09-18T02:04:03.569962+0000","last_unstale":"2024-09-18T02:06:09.095516+0000","last_undegraded":"2024-09-18T02:06:09.095516+0000","last_fullsized":"2024-09-18T02:06:09.095516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:48.543679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348236+0000","last_change":"2024-09-18T02:04:05.607210+0000","last_active":"2024-09-18T02:04:36.348236+0000","last_peered":"2024-09-18T02:04:36.348236+0000","last_clean":"2024-09-18T02:04:36.348236+0000","last_became_active":"2024-09-18T02:04:05.606608+0000","last_became_peered":"2024-09-18T02:04:05.606608+0000","last_unstale":"2024-09-18T02:04:36.348236+0000","last_undegraded":"2024-09-18T02:04:36.348236+0000","last_fullsized":"2024-09-18T02:04:36.348236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:24.549074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.355923+0000","last_change":"2024-09-18T02:04:07.609072+0000","last_active":"2024-09-18T02:04:36.355923+0000","last_peered":"2024-09-18T02:04:36.355923+0000","last_clean":"2024-09-18T02:04:36.355923+0000","last_became_active":"2024-09-18T02:04:07.607839+0000","last_became_peered":"2024-09-18T02:04:07.607839+0000","last_unstale":"2024-09-18T02:04:36.355923+0000","last_undegraded":"2024-09-18T02:04:36.355923+0000","last_fullsized":"2024-09-18T02:04:36.355923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:46:07.518628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.969905+0000","last_change":"2024-09-18T02:03:59.550978+0000","last_active":"2024-09-18T02:06:06.969905+0000","last_peered":"2024-09-18T02:06:06.969905+0000","last_clean":"2024-09-18T02:06:06.969905+0000","last_became_active":"2024-09-18T02:03:59.547123+0000","last_became_peered":"2024-09-18T02:03:59.547123+0000","last_unstale":"2024-09-18T02:06:06.969905+0000","last_undegraded":"2024-09-18T02:06:06.969905+0000","last_fullsized":"2024-09-18T02:06:06.969905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:32.095619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343090+0000","last_change":"2024-09-18T02:03:57.530635+0000","last_active":"2024-09-18T02:04:36.343090+0000","last_peered":"2024-09-18T02:04:36.343090+0000","last_clean":"2024-09-18T02:04:36.343090+0000","last_became_active":"2024-09-18T02:03:57.530001+0000","last_became_peered":"2024-09-18T02:03:57.530001+0000","last_unstale":"2024-09-18T02:04:36.343090+0000","last_undegraded":"2024-09-18T02:04:36.343090+0000","last_fullsized":"2024-09-18T02:04:36.343090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:59.657833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339227+0000","last_change":"2024-09-18T02:04:01.571519+0000","last_active":"2024-09-18T02:04:36.339227+0000","last_peered":"2024-09-18T02:04:36.339227+0000","last_clean":"2024-09-18T02:04:36.339227+0000","last_became_active":"2024-09-18T02:04:01.571263+0000","last_became_peered":"2024-09-18T02:04:01.571263+0000","last_unstale":"2024-09-18T02:04:36.339227+0000","last_undegraded":"2024-09-18T02:04:36.339227+0000","last_fullsized":"2024-09-18T02:04:36.339227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:01.789731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'34","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:36.340443+0000","last_change":"2024-09-18T02:04:03.604212+0000","last_active":"2024-09-18T02:06:36.340443+0000","last_peered":"2024-09-18T02:06:36.340443+0000","last_clean":"2024-09-18T02:06:36.340443+0000","last_became_active":"2024-09-18T02:04:03.601392+0000","last_became_peered":"2024-09-18T02:04:03.601392+0000","last_unstale":"2024-09-18T02:06:36.340443+0000","last_undegraded":"2024-09-18T02:06:36.340443+0000","last_fullsized":"2024-09-18T02:06:36.340443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:42.122863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348925+0000","last_change":"2024-09-18T02:04:05.600682+0000","last_active":"2024-09-18T02:04:36.348925+0000","last_peered":"2024-09-18T02:04:36.348925+0000","last_clean":"2024-09-18T02:04:36.348925+0000","last_became_active":"2024-09-18T02:04:05.599964+0000","last_became_peered":"2024-09-18T02:04:05.599964+0000","last_unstale":"2024-09-18T02:04:36.348925+0000","last_undegraded":"2024-09-18T02:04:36.348925+0000","last_fullsized":"2024-09-18T02:04:36.348925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:23.307583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.323902+0000","last_change":"2024-09-18T02:04:07.615961+0000","last_active":"2024-09-18T02:07:12.323902+0000","last_peered":"2024-09-18T02:07:12.323902+0000","last_clean":"2024-09-18T02:07:12.323902+0000","last_became_active":"2024-09-18T02:04:07.615007+0000","last_became_peered":"2024-09-18T02:04:07.615007+0000","last_unstale":"2024-09-18T02:07:12.323902+0000","last_undegraded":"2024-09-18T02:07:12.323902+0000","last_fullsized":"2024-09-18T02:07:12.323902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:14.213728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999722+0000","last_change":"2024-09-18T02:03:59.536538+0000","last_active":"2024-09-18T02:05:25.999722+0000","last_peered":"2024-09-18T02:05:25.999722+0000","last_clean":"2024-09-18T02:05:25.999722+0000","last_became_active":"2024-09-18T02:03:59.536120+0000","last_became_peered":"2024-09-18T02:03:59.536120+0000","last_unstale":"2024-09-18T02:05:25.999722+0000","last_undegraded":"2024-09-18T02:05:25.999722+0000","last_fullsized":"2024-09-18T02:05:25.999722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:31.952497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.286510+0000","last_change":"2024-09-18T02:03:57.525661+0000","last_active":"2024-09-18T02:05:26.286510+0000","last_peered":"2024-09-18T02:05:26.286510+0000","last_clean":"2024-09-18T02:05:26.286510+0000","last_became_active":"2024-09-18T02:03:57.522831+0000","last_became_peered":"2024-09-18T02:03:57.522831+0000","last_unstale":"2024-09-18T02:05:26.286510+0000","last_undegraded":"2024-09-18T02:05:26.286510+0000","last_fullsized":"2024-09-18T02:05:26.286510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:07.491696+0000","last_change":"2024-09-18T02:04:01.570141+0000","last_active":"2024-09-18T02:06:07.491696+0000","last_peered":"2024-09-18T02:06:07.491696+0000","last_clean":"2024-09-18T02:06:07.491696+0000","last_became_active":"2024-09-18T02:04:01.569649+0000","last_became_peered":"2024-09-18T02:04:01.569649+0000","last_unstale":"2024-09-18T02:06:07.491696+0000","last_undegraded":"2024-09-18T02:06:07.491696+0000","last_fullsized":"2024-09-18T02:06:07.491696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:20.919571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'46","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.152028+0000","last_change":"2024-09-18T02:04:03.591716+0000","last_active":"2024-09-18T02:07:11.152028+0000","last_peered":"2024-09-18T02:07:11.152028+0000","last_clean":"2024-09-18T02:07:11.152028+0000","last_became_active":"2024-09-18T02:04:03.591018+0000","last_became_peered":"2024-09-18T02:04:03.591018+0000","last_unstale":"2024-09-18T02:07:11.152028+0000","last_undegraded":"2024-09-18T02:07:11.152028+0000","last_fullsized":"2024-09-18T02:07:11.152028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:01:02.677167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338959+0000","last_change":"2024-09-18T02:04:05.596524+0000","last_active":"2024-09-18T02:04:36.338959+0000","last_peered":"2024-09-18T02:04:36.338959+0000","last_clean":"2024-09-18T02:04:36.338959+0000","last_became_active":"2024-09-18T02:04:05.595772+0000","last_became_peered":"2024-09-18T02:04:05.595772+0000","last_unstale":"2024-09-18T02:04:36.338959+0000","last_undegraded":"2024-09-18T02:04:36.338959+0000","last_fullsized":"2024-09-18T02:04:36.338959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:04.303561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.151093+0000","last_change":"2024-09-18T02:04:07.613362+0000","last_active":"2024-09-18T02:06:09.151093+0000","last_peered":"2024-09-18T02:06:09.151093+0000","last_clean":"2024-09-18T02:06:09.151093+0000","last_became_active":"2024-09-18T02:04:07.612610+0000","last_became_peered":"2024-09-18T02:04:07.612610+0000","last_unstale":"2024-09-18T02:06:09.151093+0000","last_undegraded":"2024-09-18T02:06:09.151093+0000","last_fullsized":"2024-09-18T02:06:09.151093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:48:04.223807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346323+0000","last_change":"2024-09-18T02:03:59.554230+0000","last_active":"2024-09-18T02:04:36.346323+0000","last_peered":"2024-09-18T02:04:36.346323+0000","last_clean":"2024-09-18T02:04:36.346323+0000","last_became_active":"2024-09-18T02:03:59.553864+0000","last_became_peered":"2024-09-18T02:03:59.553864+0000","last_unstale":"2024-09-18T02:04:36.346323+0000","last_undegraded":"2024-09-18T02:04:36.346323+0000","last_fullsized":"2024-09-18T02:04:36.346323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:03.926045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340985+0000","last_change":"2024-09-18T02:03:57.523546+0000","last_active":"2024-09-18T02:04:36.340985+0000","last_peered":"2024-09-18T02:04:36.340985+0000","last_clean":"2024-09-18T02:04:36.340985+0000","last_became_active":"2024-09-18T02:03:57.519843+0000","last_became_peered":"2024-09-18T02:03:57.519843+0000","last_unstale":"2024-09-18T02:04:36.340985+0000","last_undegraded":"2024-09-18T02:04:36.340985+0000","last_fullsized":"2024-09-18T02:04:36.340985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.969754+0000","last_change":"2024-09-18T02:03:59.536808+0000","last_active":"2024-09-18T02:06:06.969754+0000","last_peered":"2024-09-18T02:06:06.969754+0000","last_clean":"2024-09-18T02:06:06.969754+0000","last_became_active":"2024-09-18T02:03:59.535992+0000","last_became_peered":"2024-09-18T02:03:59.535992+0000","last_unstale":"2024-09-18T02:06:06.969754+0000","last_undegraded":"2024-09-18T02:06:06.969754+0000","last_fullsized":"2024-09-18T02:06:06.969754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338112+0000","last_change":"2024-09-18T02:03:57.527965+0000","last_active":"2024-09-18T02:04:36.338112+0000","last_peered":"2024-09-18T02:04:36.338112+0000","last_clean":"2024-09-18T02:04:36.338112+0000","last_became_active":"2024-09-18T02:03:57.527146+0000","last_became_peered":"2024-09-18T02:03:57.527146+0000","last_unstale":"2024-09-18T02:04:36.338112+0000","last_undegraded":"2024-09-18T02:04:36.338112+0000","last_fullsized":"2024-09-18T02:04:36.338112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217939+0000","last_change":"2024-09-18T02:03:59.558797+0000","last_active":"2024-09-18T02:07:12.217939+0000","last_peered":"2024-09-18T02:07:12.217939+0000","last_clean":"2024-09-18T02:07:12.217939+0000","last_became_active":"2024-09-18T02:03:59.556425+0000","last_became_peered":"2024-09-18T02:03:59.556425+0000","last_unstale":"2024-09-18T02:07:12.217939+0000","last_undegraded":"2024-09-18T02:07:12.217939+0000","last_fullsized":"2024-09-18T02:07:12.217939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:18.823166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.050574+0000","last_change":"2024-09-18T02:04:36.351337+0000","last_active":"2024-09-18T02:07:12.050574+0000","last_peered":"2024-09-18T02:07:12.050574+0000","last_clean":"2024-09-18T02:07:12.050574+0000","last_became_active":"2024-09-18T02:04:36.350472+0000","last_became_peered":"2024-09-18T02:04:36.350472+0000","last_unstale":"2024-09-18T02:07:12.050574+0000","last_undegraded":"2024-09-18T02:07:12.050574+0000","last_fullsized":"2024-09-18T02:07:12.050574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:46.701505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"32'18","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999570+0000","last_change":"2024-09-18T02:03:59.535727+0000","last_active":"2024-09-18T02:05:25.999570+0000","last_peered":"2024-09-18T02:05:25.999570+0000","last_clean":"2024-09-18T02:05:25.999570+0000","last_became_active":"2024-09-18T02:03:59.534584+0000","last_became_peered":"2024-09-18T02:03:59.534584+0000","last_unstale":"2024-09-18T02:05:25.999570+0000","last_undegraded":"2024-09-18T02:05:25.999570+0000","last_fullsized":"2024-09-18T02:05:25.999570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.636051+0000","last_change":"2024-09-18T02:03:57.523284+0000","last_active":"2024-09-18T02:07:11.636051+0000","last_peered":"2024-09-18T02:07:11.636051+0000","last_clean":"2024-09-18T02:07:11.636051+0000","last_became_active":"2024-09-18T02:03:57.521499+0000","last_became_peered":"2024-09-18T02:03:57.521499+0000","last_unstale":"2024-09-18T02:07:11.636051+0000","last_undegraded":"2024-09-18T02:07:11.636051+0000","last_fullsized":"2024-09-18T02:07:11.636051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329285+0000","last_change":"2024-09-18T02:03:59.555354+0000","last_active":"2024-09-18T02:06:06.329285+0000","last_peered":"2024-09-18T02:06:06.329285+0000","last_clean":"2024-09-18T02:06:06.329285+0000","last_became_active":"2024-09-18T02:03:59.554577+0000","last_became_peered":"2024-09-18T02:03:59.554577+0000","last_unstale":"2024-09-18T02:06:06.329285+0000","last_undegraded":"2024-09-18T02:06:06.329285+0000","last_fullsized":"2024-09-18T02:06:06.329285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:31:07.318399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.923838+0000","last_change":"2024-09-18T02:03:57.527483+0000","last_active":"2024-09-18T02:04:42.923838+0000","last_peered":"2024-09-18T02:04:42.923838+0000","last_clean":"2024-09-18T02:04:42.923838+0000","last_became_active":"2024-09-18T02:03:57.526774+0000","last_became_peered":"2024-09-18T02:03:57.526774+0000","last_unstale":"2024-09-18T02:04:42.923838+0000","last_undegraded":"2024-09-18T02:04:42.923838+0000","last_fullsized":"2024-09-18T02:04:42.923838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:25.305027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'13","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089661+0000","last_change":"2024-09-18T02:03:59.555131+0000","last_active":"2024-09-18T02:07:12.089661+0000","last_peered":"2024-09-18T02:07:12.089661+0000","last_clean":"2024-09-18T02:07:12.089661+0000","last_became_active":"2024-09-18T02:03:59.554672+0000","last_became_peered":"2024-09-18T02:03:59.554672+0000","last_unstale":"2024-09-18T02:07:12.089661+0000","last_undegraded":"2024-09-18T02:07:12.089661+0000","last_fullsized":"2024-09-18T02:07:12.089661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:10.488835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346001+0000","last_change":"2024-09-18T02:03:57.519989+0000","last_active":"2024-09-18T02:04:36.346001+0000","last_peered":"2024-09-18T02:04:36.346001+0000","last_clean":"2024-09-18T02:04:36.346001+0000","last_became_active":"2024-09-18T02:03:57.519691+0000","last_became_peered":"2024-09-18T02:03:57.519691+0000","last_unstale":"2024-09-18T02:04:36.346001+0000","last_undegraded":"2024-09-18T02:04:36.346001+0000","last_fullsized":"2024-09-18T02:04:36.346001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'17","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.088472+0000","last_change":"2024-09-18T02:03:59.541946+0000","last_active":"2024-09-18T02:07:12.088472+0000","last_peered":"2024-09-18T02:07:12.088472+0000","last_clean":"2024-09-18T02:07:12.088472+0000","last_became_active":"2024-09-18T02:03:59.541059+0000","last_became_peered":"2024-09-18T02:03:59.541059+0000","last_unstale":"2024-09-18T02:07:12.088472+0000","last_undegraded":"2024-09-18T02:07:12.088472+0000","last_fullsized":"2024-09-18T02:07:12.088472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.005080+0000","last_change":"2024-09-18T02:03:57.519641+0000","last_active":"2024-09-18T02:06:11.005080+0000","last_peered":"2024-09-18T02:06:11.005080+0000","last_clean":"2024-09-18T02:06:11.005080+0000","last_became_active":"2024-09-18T02:03:57.519272+0000","last_became_peered":"2024-09-18T02:03:57.519272+0000","last_unstale":"2024-09-18T02:06:11.005080+0000","last_undegraded":"2024-09-18T02:06:11.005080+0000","last_fullsized":"2024-09-18T02:06:11.005080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'5","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.235540+0000","last_change":"2024-09-18T02:03:59.545622+0000","last_active":"2024-09-18T02:07:12.235540+0000","last_peered":"2024-09-18T02:07:12.235540+0000","last_clean":"2024-09-18T02:07:12.235540+0000","last_became_active":"2024-09-18T02:03:59.539946+0000","last_became_peered":"2024-09-18T02:03:59.539946+0000","last_unstale":"2024-09-18T02:07:12.235540+0000","last_undegraded":"2024-09-18T02:07:12.235540+0000","last_fullsized":"2024-09-18T02:07:12.235540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342907+0000","last_change":"2024-09-18T02:03:57.527957+0000","last_active":"2024-09-18T02:04:36.342907+0000","last_peered":"2024-09-18T02:04:36.342907+0000","last_clean":"2024-09-18T02:04:36.342907+0000","last_became_active":"2024-09-18T02:03:57.527102+0000","last_became_peered":"2024-09-18T02:03:57.527102+0000","last_unstale":"2024-09-18T02:04:36.342907+0000","last_undegraded":"2024-09-18T02:04:36.342907+0000","last_fullsized":"2024-09-18T02:04:36.342907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:13:45.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'11","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.238904+0000","last_change":"2024-09-18T02:03:59.543494+0000","last_active":"2024-09-18T02:07:12.238904+0000","last_peered":"2024-09-18T02:07:12.238904+0000","last_clean":"2024-09-18T02:07:12.238904+0000","last_became_active":"2024-09-18T02:03:59.543160+0000","last_became_peered":"2024-09-18T02:03:59.543160+0000","last_unstale":"2024-09-18T02:07:12.238904+0000","last_undegraded":"2024-09-18T02:07:12.238904+0000","last_fullsized":"2024-09-18T02:07:12.238904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:21:48.069564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.347323+0000","last_change":"2024-09-18T02:03:57.525942+0000","last_active":"2024-09-18T02:04:36.347323+0000","last_peered":"2024-09-18T02:04:36.347323+0000","last_clean":"2024-09-18T02:04:36.347323+0000","last_became_active":"2024-09-18T02:03:57.524495+0000","last_became_peered":"2024-09-18T02:03:57.524495+0000","last_unstale":"2024-09-18T02:04:36.347323+0000","last_undegraded":"2024-09-18T02:04:36.347323+0000","last_fullsized":"2024-09-18T02:04:36.347323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:58:39.651409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217785+0000","last_change":"2024-09-18T02:04:36.361845+0000","last_active":"2024-09-18T02:07:12.217785+0000","last_peered":"2024-09-18T02:07:12.217785+0000","last_clean":"2024-09-18T02:07:12.217785+0000","last_became_active":"2024-09-18T02:04:36.354749+0000","last_became_peered":"2024-09-18T02:04:36.354749+0000","last_unstale":"2024-09-18T02:07:12.217785+0000","last_undegraded":"2024-09-18T02:07:12.217785+0000","last_fullsized":"2024-09-18T02:07:12.217785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:25:16.339405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338794+0000","last_change":"2024-09-18T02:03:57.521667+0000","last_active":"2024-09-18T02:04:36.338794+0000","last_peered":"2024-09-18T02:04:36.338794+0000","last_clean":"2024-09-18T02:04:36.338794+0000","last_became_active":"2024-09-18T02:03:57.520623+0000","last_became_peered":"2024-09-18T02:03:57.520623+0000","last_unstale":"2024-09-18T02:04:36.338794+0000","last_undegraded":"2024-09-18T02:04:36.338794+0000","last_fullsized":"2024-09-18T02:04:36.338794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217768+0000","last_change":"2024-09-18T02:03:59.555647+0000","last_active":"2024-09-18T02:07:12.217768+0000","last_peered":"2024-09-18T02:07:12.217768+0000","last_clean":"2024-09-18T02:07:12.217768+0000","last_became_active":"2024-09-18T02:03:59.555178+0000","last_became_peered":"2024-09-18T02:03:59.555178+0000","last_unstale":"2024-09-18T02:07:12.217768+0000","last_undegraded":"2024-09-18T02:07:12.217768+0000","last_fullsized":"2024-09-18T02:07:12.217768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338718+0000","last_change":"2024-09-18T02:03:57.519654+0000","last_active":"2024-09-18T02:04:36.338718+0000","last_peered":"2024-09-18T02:04:36.338718+0000","last_clean":"2024-09-18T02:04:36.338718+0000","last_became_active":"2024-09-18T02:03:57.519359+0000","last_became_peered":"2024-09-18T02:03:57.519359+0000","last_unstale":"2024-09-18T02:04:36.338718+0000","last_undegraded":"2024-09-18T02:04:36.338718+0000","last_fullsized":"2024-09-18T02:04:36.338718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:32.125649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.722270+0000","last_change":"2024-09-18T02:03:59.542345+0000","last_active":"2024-09-18T02:07:11.722270+0000","last_peered":"2024-09-18T02:07:11.722270+0000","last_clean":"2024-09-18T02:07:11.722270+0000","last_became_active":"2024-09-18T02:03:59.540444+0000","last_became_peered":"2024-09-18T02:03:59.540444+0000","last_unstale":"2024-09-18T02:07:11.722270+0000","last_undegraded":"2024-09-18T02:07:11.722270+0000","last_fullsized":"2024-09-18T02:07:11.722270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:36.437530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341283+0000","last_change":"2024-09-18T02:03:57.522898+0000","last_active":"2024-09-18T02:04:36.341283+0000","last_peered":"2024-09-18T02:04:36.341283+0000","last_clean":"2024-09-18T02:04:36.341283+0000","last_became_active":"2024-09-18T02:03:57.521148+0000","last_became_peered":"2024-09-18T02:03:57.521148+0000","last_unstale":"2024-09-18T02:04:36.341283+0000","last_undegraded":"2024-09-18T02:04:36.341283+0000","last_fullsized":"2024-09-18T02:04:36.341283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069454+0000","last_change":"2024-09-18T02:03:59.553902+0000","last_active":"2024-09-18T02:07:12.069454+0000","last_peered":"2024-09-18T02:07:12.069454+0000","last_clean":"2024-09-18T02:07:12.069454+0000","last_became_active":"2024-09-18T02:03:59.553528+0000","last_became_peered":"2024-09-18T02:03:59.553528+0000","last_unstale":"2024-09-18T02:07:12.069454+0000","last_undegraded":"2024-09-18T02:07:12.069454+0000","last_fullsized":"2024-09-18T02:07:12.069454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354140+0000","last_change":"2024-09-18T02:03:57.527928+0000","last_active":"2024-09-18T02:04:36.354140+0000","last_peered":"2024-09-18T02:04:36.354140+0000","last_clean":"2024-09-18T02:04:36.354140+0000","last_became_active":"2024-09-18T02:03:57.526972+0000","last_became_peered":"2024-09-18T02:03:57.526972+0000","last_unstale":"2024-09-18T02:04:36.354140+0000","last_undegraded":"2024-09-18T02:04:36.354140+0000","last_fullsized":"2024-09-18T02:04:36.354140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:17.513345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.729602+0000","last_change":"2024-09-18T02:03:59.546007+0000","last_active":"2024-09-18T02:07:11.729602+0000","last_peered":"2024-09-18T02:07:11.729602+0000","last_clean":"2024-09-18T02:07:11.729602+0000","last_became_active":"2024-09-18T02:03:59.545405+0000","last_became_peered":"2024-09-18T02:03:59.545405+0000","last_unstale":"2024-09-18T02:07:11.729602+0000","last_undegraded":"2024-09-18T02:07:11.729602+0000","last_fullsized":"2024-09-18T02:07:11.729602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354861+0000","last_change":"2024-09-18T02:03:57.522221+0000","last_active":"2024-09-18T02:04:36.354861+0000","last_peered":"2024-09-18T02:04:36.354861+0000","last_clean":"2024-09-18T02:04:36.354861+0000","last_became_active":"2024-09-18T02:03:57.521800+0000","last_became_peered":"2024-09-18T02:03:57.521800+0000","last_unstale":"2024-09-18T02:04:36.354861+0000","last_undegraded":"2024-09-18T02:04:36.354861+0000","last_fullsized":"2024-09-18T02:04:36.354861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:38.433048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.155206+0000","last_change":"2024-09-18T02:04:36.384511+0000","last_active":"2024-09-18T02:07:12.155206+0000","last_peered":"2024-09-18T02:07:12.155206+0000","last_clean":"2024-09-18T02:07:12.155206+0000","last_became_active":"2024-09-18T02:04:36.357213+0000","last_became_peered":"2024-09-18T02:04:36.357213+0000","last_unstale":"2024-09-18T02:07:12.155206+0000","last_undegraded":"2024-09-18T02:07:12.155206+0000","last_fullsized":"2024-09-18T02:07:12.155206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:09.239456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.368246+0000","last_change":"2024-09-18T02:03:57.531024+0000","last_active":"2024-09-18T02:04:36.368246+0000","last_peered":"2024-09-18T02:04:36.368246+0000","last_clean":"2024-09-18T02:04:36.368246+0000","last_became_active":"2024-09-18T02:03:57.528312+0000","last_became_peered":"2024-09-18T02:03:57.528312+0000","last_unstale":"2024-09-18T02:04:36.368246+0000","last_undegraded":"2024-09-18T02:04:36.368246+0000","last_fullsized":"2024-09-18T02:04:36.368246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:32.979432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153104+0000","last_change":"2024-09-18T02:03:59.546083+0000","last_active":"2024-09-18T02:07:12.153104+0000","last_peered":"2024-09-18T02:07:12.153104+0000","last_clean":"2024-09-18T02:07:12.153104+0000","last_became_active":"2024-09-18T02:03:59.540283+0000","last_became_peered":"2024-09-18T02:03:59.540283+0000","last_unstale":"2024-09-18T02:07:12.153104+0000","last_undegraded":"2024-09-18T02:07:12.153104+0000","last_fullsized":"2024-09-18T02:07:12.153104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.910994+0000","last_change":"2024-09-18T02:03:57.528934+0000","last_active":"2024-09-18T02:06:10.910994+0000","last_peered":"2024-09-18T02:06:10.910994+0000","last_clean":"2024-09-18T02:06:10.910994+0000","last_became_active":"2024-09-18T02:03:57.526363+0000","last_became_peered":"2024-09-18T02:03:57.526363+0000","last_unstale":"2024-09-18T02:06:10.910994+0000","last_undegraded":"2024-09-18T02:06:10.910994+0000","last_fullsized":"2024-09-18T02:06:10.910994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:36.487218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.058009+0000","last_change":"2024-09-18T02:03:57.516751+0000","last_active":"2024-09-18T02:07:12.058009+0000","last_peered":"2024-09-18T02:07:12.058009+0000","last_clean":"2024-09-18T02:07:12.058009+0000","last_became_active":"2024-09-18T02:03:57.516434+0000","last_became_peered":"2024-09-18T02:03:57.516434+0000","last_unstale":"2024-09-18T02:07:12.058009+0000","last_undegraded":"2024-09-18T02:07:12.058009+0000","last_fullsized":"2024-09-18T02:07:12.058009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:34.563165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334365+0000","last_change":"2024-09-18T02:03:59.551182+0000","last_active":"2024-09-18T02:06:26.334365+0000","last_peered":"2024-09-18T02:06:26.334365+0000","last_clean":"2024-09-18T02:06:26.334365+0000","last_became_active":"2024-09-18T02:03:59.550058+0000","last_became_peered":"2024-09-18T02:03:59.550058+0000","last_unstale":"2024-09-18T02:06:26.334365+0000","last_undegraded":"2024-09-18T02:06:26.334365+0000","last_fullsized":"2024-09-18T02:06:26.334365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:38.500729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338421+0000","last_change":"2024-09-18T02:03:57.533882+0000","last_active":"2024-09-18T02:04:36.338421+0000","last_peered":"2024-09-18T02:04:36.338421+0000","last_clean":"2024-09-18T02:04:36.338421+0000","last_became_active":"2024-09-18T02:03:57.533324+0000","last_became_peered":"2024-09-18T02:03:57.533324+0000","last_unstale":"2024-09-18T02:04:36.338421+0000","last_undegraded":"2024-09-18T02:04:36.338421+0000","last_fullsized":"2024-09-18T02:04:36.338421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'11","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.886960+0000","last_change":"2024-09-18T02:03:59.542840+0000","last_active":"2024-09-18T02:07:11.886960+0000","last_peered":"2024-09-18T02:07:11.886960+0000","last_clean":"2024-09-18T02:07:11.886960+0000","last_became_active":"2024-09-18T02:03:59.542356+0000","last_became_peered":"2024-09-18T02:03:59.542356+0000","last_unstale":"2024-09-18T02:07:11.886960+0000","last_undegraded":"2024-09-18T02:07:11.886960+0000","last_fullsized":"2024-09-18T02:07:11.886960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:35:21.321816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1471,"ondisk_log_size":1471,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1593,"num_read_kb":1483,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705715,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":21560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":22077440,"data_stored":21749718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48592,"kb_used_data":13248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323248,"statfs":{"total":96636764160,"available":96587005952,"internally_reserved":0,"allocated":13565952,"data_stored":13308880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705715,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41056,"kb_used_data":5712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330784,"statfs":{"total":96636764160,"available":96594722816,"internally_reserved":0,"allocated":5849088,"data_stored":5562779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52216,"kb_used_data":12712,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319624,"statfs":{"total":96636764160,"available":96583294976,"internally_reserved":0,"allocated":13017088,"data_stored":12722525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4837376,"data_stored":4834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21614592,"data_stored":21611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T02:07:44.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T02:07:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.161+0000 7fe0a519a640 1 Processor -- start 2024-09-18T02:07:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.161+0000 7fe0a519a640 1 -- start start 2024-09-18T02:07:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe0a519a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0a006dbd0 0x7fe0a0131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe0a519a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a0071c10 con 0x7fe0a006d0e0 2024-09-18T02:07:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe0a519a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a0072230 con 0x7fe0a006dbd0 2024-09-18T02:07:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe09e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0a006dbd0 0x7fe0a0131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe09ed9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe0a006d0e0 0x7fe0a006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39698/0 (socket says 172.21.15.81:39698) 2024-09-18T02:07:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe09ed9d640 1 -- 172.21.15.81:0/554204388 learned_addr learned my addr 172.21.15.81:0/554204388 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe09e59c640 1 -- 172.21.15.81:0/554204388 >> v1:172.21.15.81:6789/0 conn(0x7fe0a006d0e0 legacy=0x7fe0a006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe09e59c640 1 -- 172.21.15.81:0/554204388 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a00709e0 con 0x7fe0a006dbd0 2024-09-18T02:07:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe09dd9b640 1 -- 172.21.15.81:0/554204388 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235691934 0 0) 0x7fe0a0071c10 con 0x7fe0a006d0e0 2024-09-18T02:07:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe09e59c640 1 --2- 172.21.15.81:0/554204388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a006dbd0 0x7fe0a0131e60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe088009740 tx=0x7fe08801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c93e42110a2b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe09dd9b640 1 -- 172.21.15.81:0/554204388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0880b0070 con 0x7fe0a006dbd0 2024-09-18T02:07:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe09dd9b640 1 -- 172.21.15.81:0/554204388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0880ab530 con 0x7fe0a006dbd0 2024-09-18T02:07:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe09dd9b640 1 -- 172.21.15.81:0/554204388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0880ab830 con 0x7fe0a006dbd0 2024-09-18T02:07:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe0a519a640 1 -- 172.21.15.81:0/554204388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a006dbd0 msgr2=0x7fe0a0131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe0a519a640 1 --2- 172.21.15.81:0/554204388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a006dbd0 0x7fe0a0131e60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe088009740 tx=0x7fe08801c370 comp rx=0 tx=0).stop 2024-09-18T02:07:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe0a519a640 1 -- 172.21.15.81:0/554204388 shutdown_connections 2024-09-18T02:07:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe0a519a640 1 --2- 172.21.15.81:0/554204388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a006dbd0 0x7fe0a0131e60 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe0a519a640 1 -- 172.21.15.81:0/554204388 >> 172.21.15.81:0/554204388 conn(0x7fe0a0099a50 msgr2=0x7fe0a00972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe0a519a640 1 -- 172.21.15.81:0/554204388 shutdown_connections 2024-09-18T02:07:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.165+0000 7fe0a519a640 1 -- 172.21.15.81:0/554204388 wait complete. 2024-09-18T02:07:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0a519a640 1 Processor -- start 2024-09-18T02:07:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0a519a640 1 -- start start 2024-09-18T02:07:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0a519a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a006d0e0 0x7fe0a0126a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0a519a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a0134d40 con 0x7fe0a006d0e0 2024-09-18T02:07:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe09ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a006d0e0 0x7fe0a0126a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe09ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a006d0e0 0x7fe0a0126a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39896/0 (socket says 172.21.15.81:39896) 2024-09-18T02:07:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe09ed9d640 1 -- 172.21.15.81:0/1910885166 learned_addr learned my addr 172.21.15.81:0/1910885166 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe09ed9d640 1 -- 172.21.15.81:0/1910885166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a0128ff0 con 0x7fe0a006d0e0 2024-09-18T02:07:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe09ed9d640 1 --2- 172.21.15.81:0/1910885166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a006d0e0 0x7fe0a0126a60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe09800c840 tx=0x7fe09800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0977fe640 1 -- 172.21.15.81:0/1910885166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe098018070 con 0x7fe0a006d0e0 2024-09-18T02:07:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0977fe640 1 -- 172.21.15.81:0/1910885166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09800a660 con 0x7fe0a006d0e0 2024-09-18T02:07:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0977fe640 1 -- 172.21.15.81:0/1910885166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe09800a850 con 0x7fe0a006d0e0 2024-09-18T02:07:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0a519a640 1 -- 172.21.15.81:0/1910885166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a01296f0 con 0x7fe0a006d0e0 2024-09-18T02:07:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0a519a640 1 -- 172.21.15.81:0/1910885166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a0127170 con 0x7fe0a006d0e0 2024-09-18T02:07:44.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0a519a640 1 -- 172.21.15.81:0/1910885166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a006d4c0 con 0x7fe0a006d0e0 2024-09-18T02:07:44.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0977fe640 1 -- 172.21.15.81:0/1910885166 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe09801b070 con 0x7fe0a006d0e0 2024-09-18T02:07:44.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0977fe640 1 --2- 172.21.15.81:0/1910885166 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe080035db0 0x7fe080038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:44.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe0977fe640 1 -- 172.21.15.81:0/1910885166 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe098048700 con 0x7fe0a006d0e0 2024-09-18T02:07:44.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.169+0000 7fe09e59c640 1 --2- 172.21.15.81:0/1910885166 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe080035db0 0x7fe080038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:44.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.173+0000 7fe09e59c640 1 --2- 172.21.15.81:0/1910885166 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe080035db0 0x7fe080038270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe0880ad000 tx=0x7fe0880a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.173+0000 7fe0977fe640 1 -- 172.21.15.81:0/1910885166 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe09801c3b0 con 0x7fe0a006d0e0 2024-09-18T02:07:44.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.333+0000 7fe0a519a640 1 -- 172.21.15.81:0/1910885166 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0a0128380 con 0x7fe080035db0 2024-09-18T02:07:44.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.377+0000 7fe0977fe640 1 -- 172.21.15.81:0/1910885166 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665587 (secure 0 0 0) 0x7fe08815d810 con 0x7fe080035db0 2024-09-18T02:07:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:07:44.388 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T02:07:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.381+0000 7fe0a519a640 1 -- 172.21.15.81:0/1910885166 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe080035db0 msgr2=0x7fe080038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.381+0000 7fe0a519a640 1 --2- 172.21.15.81:0/1910885166 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe080035db0 0x7fe080038270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe0880ad000 tx=0x7fe0880a6000 comp rx=0 tx=0).stop 2024-09-18T02:07:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.381+0000 7fe0a519a640 1 -- 172.21.15.81:0/1910885166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a006d0e0 msgr2=0x7fe0a0126a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.381+0000 7fe0a519a640 1 --2- 172.21.15.81:0/1910885166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a006d0e0 0x7fe0a0126a60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe09800c840 tx=0x7fe09800cd00 comp rx=0 tx=0).stop 2024-09-18T02:07:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.381+0000 7fe0a519a640 1 -- 172.21.15.81:0/1910885166 shutdown_connections 2024-09-18T02:07:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.381+0000 7fe0a519a640 1 --2- 172.21.15.81:0/1910885166 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fe080035db0 0x7fe080038270 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.381+0000 7fe0a519a640 1 --2- 172.21.15.81:0/1910885166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a006d0e0 0x7fe0a0126a60 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.381+0000 7fe0a519a640 1 -- 172.21.15.81:0/1910885166 >> 172.21.15.81:0/1910885166 conn(0x7fe0a0099a50 msgr2=0x7fe0a009b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.381+0000 7fe0a519a640 1 -- 172.21.15.81:0/1910885166 shutdown_connections 2024-09-18T02:07:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.381+0000 7fe0a519a640 1 -- 172.21.15.81:0/1910885166 wait complete. 2024-09-18T02:07:44.400 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-18T02:07:43.346813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":261,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5147,"num_read_kb":4696,"num_write":2300,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4676,"ondisk_log_size":4676,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198768,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288592,"statfs":{"total":386547056640,"available":386343518208,"internally_reserved":0,"allocated":54509568,"data_stored":53343902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005545"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.341087+0000","last_change":"2024-09-18T02:03:57.517243+0000","last_active":"2024-09-18T02:04:41.341087+0000","last_peered":"2024-09-18T02:04:41.341087+0000","last_clean":"2024-09-18T02:04:41.341087+0000","last_became_active":"2024-09-18T02:03:57.516420+0000","last_became_peered":"2024-09-18T02:03:57.516420+0000","last_unstale":"2024-09-18T02:04:41.341087+0000","last_undegraded":"2024-09-18T02:04:41.341087+0000","last_fullsized":"2024-09-18T02:04:41.341087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.868815+0000","last_change":"2024-09-18T02:03:59.549513+0000","last_active":"2024-09-18T02:07:11.868815+0000","last_peered":"2024-09-18T02:07:11.868815+0000","last_clean":"2024-09-18T02:07:11.868815+0000","last_became_active":"2024-09-18T02:03:59.545294+0000","last_became_peered":"2024-09-18T02:03:59.545294+0000","last_unstale":"2024-09-18T02:07:11.868815+0000","last_undegraded":"2024-09-18T02:07:11.868815+0000","last_fullsized":"2024-09-18T02:07:11.868815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329444+0000","last_change":"2024-09-18T02:03:57.533991+0000","last_active":"2024-09-18T02:06:06.329444+0000","last_peered":"2024-09-18T02:06:06.329444+0000","last_clean":"2024-09-18T02:06:06.329444+0000","last_became_active":"2024-09-18T02:03:57.533332+0000","last_became_peered":"2024-09-18T02:03:57.533332+0000","last_unstale":"2024-09-18T02:06:06.329444+0000","last_undegraded":"2024-09-18T02:06:06.329444+0000","last_fullsized":"2024-09-18T02:06:06.329444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:46.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:43.634720+0000","last_change":"2024-09-18T02:03:59.554008+0000","last_active":"2024-09-18T02:04:43.634720+0000","last_peered":"2024-09-18T02:04:43.634720+0000","last_clean":"2024-09-18T02:04:43.634720+0000","last_became_active":"2024-09-18T02:03:59.553641+0000","last_became_peered":"2024-09-18T02:03:59.553641+0000","last_unstale":"2024-09-18T02:04:43.634720+0000","last_undegraded":"2024-09-18T02:04:43.634720+0000","last_fullsized":"2024-09-18T02:04:43.634720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:31.703094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.355519+0000","last_change":"2024-09-18T02:03:57.532939+0000","last_active":"2024-09-18T02:04:36.355519+0000","last_peered":"2024-09-18T02:04:36.355519+0000","last_clean":"2024-09-18T02:04:36.355519+0000","last_became_active":"2024-09-18T02:03:57.532561+0000","last_became_peered":"2024-09-18T02:03:57.532561+0000","last_unstale":"2024-09-18T02:04:36.355519+0000","last_undegraded":"2024-09-18T02:04:36.355519+0000","last_fullsized":"2024-09-18T02:04:36.355519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:51.738245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069743+0000","last_change":"2024-09-18T02:03:59.552858+0000","last_active":"2024-09-18T02:07:12.069743+0000","last_peered":"2024-09-18T02:07:12.069743+0000","last_clean":"2024-09-18T02:07:12.069743+0000","last_became_active":"2024-09-18T02:03:59.551661+0000","last_became_peered":"2024-09-18T02:03:59.551661+0000","last_unstale":"2024-09-18T02:07:12.069743+0000","last_undegraded":"2024-09-18T02:07:12.069743+0000","last_fullsized":"2024-09-18T02:07:12.069743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:13:16.052288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.345587+0000","last_change":"2024-09-18T02:03:57.523513+0000","last_active":"2024-09-18T02:04:41.345587+0000","last_peered":"2024-09-18T02:04:41.345587+0000","last_clean":"2024-09-18T02:04:41.345587+0000","last_became_active":"2024-09-18T02:03:57.522751+0000","last_became_peered":"2024-09-18T02:03:57.522751+0000","last_unstale":"2024-09-18T02:04:41.345587+0000","last_undegraded":"2024-09-18T02:04:41.345587+0000","last_fullsized":"2024-09-18T02:04:41.345587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.303235+0000","last_change":"2024-09-18T02:03:59.553228+0000","last_active":"2024-09-18T02:05:26.303235+0000","last_peered":"2024-09-18T02:05:26.303235+0000","last_clean":"2024-09-18T02:05:26.303235+0000","last_became_active":"2024-09-18T02:03:59.552797+0000","last_became_peered":"2024-09-18T02:03:59.552797+0000","last_unstale":"2024-09-18T02:05:26.303235+0000","last_undegraded":"2024-09-18T02:05:26.303235+0000","last_fullsized":"2024-09-18T02:05:26.303235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:34:11.622588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.351407+0000","last_change":"2024-09-18T02:03:57.525148+0000","last_active":"2024-09-18T02:04:36.351407+0000","last_peered":"2024-09-18T02:04:36.351407+0000","last_clean":"2024-09-18T02:04:36.351407+0000","last_became_active":"2024-09-18T02:03:57.524645+0000","last_became_peered":"2024-09-18T02:03:57.524645+0000","last_unstale":"2024-09-18T02:04:36.351407+0000","last_undegraded":"2024-09-18T02:04:36.351407+0000","last_fullsized":"2024-09-18T02:04:36.351407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:25.763842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.730487+0000","last_change":"2024-09-18T02:03:59.542637+0000","last_active":"2024-09-18T02:07:11.730487+0000","last_peered":"2024-09-18T02:07:11.730487+0000","last_clean":"2024-09-18T02:07:11.730487+0000","last_became_active":"2024-09-18T02:03:59.542238+0000","last_became_peered":"2024-09-18T02:03:59.542238+0000","last_unstale":"2024-09-18T02:07:11.730487+0000","last_undegraded":"2024-09-18T02:07:11.730487+0000","last_fullsized":"2024-09-18T02:07:11.730487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:45.343721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343457+0000","last_change":"2024-09-18T02:03:57.523116+0000","last_active":"2024-09-18T02:04:36.343457+0000","last_peered":"2024-09-18T02:04:36.343457+0000","last_clean":"2024-09-18T02:04:36.343457+0000","last_became_active":"2024-09-18T02:03:57.520647+0000","last_became_peered":"2024-09-18T02:03:57.520647+0000","last_unstale":"2024-09-18T02:04:36.343457+0000","last_undegraded":"2024-09-18T02:04:36.343457+0000","last_fullsized":"2024-09-18T02:04:36.343457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'12","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153401+0000","last_change":"2024-09-18T02:03:59.560469+0000","last_active":"2024-09-18T02:07:12.153401+0000","last_peered":"2024-09-18T02:07:12.153401+0000","last_clean":"2024-09-18T02:07:12.153401+0000","last_became_active":"2024-09-18T02:03:59.559273+0000","last_became_peered":"2024-09-18T02:03:59.559273+0000","last_unstale":"2024-09-18T02:07:12.153401+0000","last_undegraded":"2024-09-18T02:07:12.153401+0000","last_fullsized":"2024-09-18T02:07:12.153401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:44.509390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.675472+0000","last_change":"2024-09-18T02:03:57.528855+0000","last_active":"2024-09-18T02:07:11.675472+0000","last_peered":"2024-09-18T02:07:11.675472+0000","last_clean":"2024-09-18T02:07:11.675472+0000","last_became_active":"2024-09-18T02:03:57.526953+0000","last_became_peered":"2024-09-18T02:03:57.526953+0000","last_unstale":"2024-09-18T02:07:11.675472+0000","last_undegraded":"2024-09-18T02:07:11.675472+0000","last_fullsized":"2024-09-18T02:07:11.675472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:28:20.024090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999282+0000","last_change":"2024-09-18T02:03:59.541576+0000","last_active":"2024-09-18T02:05:25.999282+0000","last_peered":"2024-09-18T02:05:25.999282+0000","last_clean":"2024-09-18T02:05:25.999282+0000","last_became_active":"2024-09-18T02:03:59.541086+0000","last_became_peered":"2024-09-18T02:03:59.541086+0000","last_unstale":"2024-09-18T02:05:25.999282+0000","last_undegraded":"2024-09-18T02:05:25.999282+0000","last_fullsized":"2024-09-18T02:05:25.999282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.337869+0000","last_change":"2024-09-18T02:03:57.524285+0000","last_active":"2024-09-18T02:04:36.337869+0000","last_peered":"2024-09-18T02:04:36.337869+0000","last_clean":"2024-09-18T02:04:36.337869+0000","last_became_active":"2024-09-18T02:03:57.520343+0000","last_became_peered":"2024-09-18T02:03:57.520343+0000","last_unstale":"2024-09-18T02:04:36.337869+0000","last_undegraded":"2024-09-18T02:04:36.337869+0000","last_fullsized":"2024-09-18T02:04:36.337869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069669+0000","last_change":"2024-09-18T02:03:59.534315+0000","last_active":"2024-09-18T02:07:12.069669+0000","last_peered":"2024-09-18T02:07:12.069669+0000","last_clean":"2024-09-18T02:07:12.069669+0000","last_became_active":"2024-09-18T02:03:59.533956+0000","last_became_peered":"2024-09-18T02:03:59.533956+0000","last_unstale":"2024-09-18T02:07:12.069669+0000","last_undegraded":"2024-09-18T02:07:12.069669+0000","last_fullsized":"2024-09-18T02:07:12.069669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.238202+0000","last_change":"2024-09-18T02:03:59.537124+0000","last_active":"2024-09-18T02:07:12.238202+0000","last_peered":"2024-09-18T02:07:12.238202+0000","last_clean":"2024-09-18T02:07:12.238202+0000","last_became_active":"2024-09-18T02:03:59.536739+0000","last_became_peered":"2024-09-18T02:03:59.536739+0000","last_unstale":"2024-09-18T02:07:12.238202+0000","last_undegraded":"2024-09-18T02:07:12.238202+0000","last_fullsized":"2024-09-18T02:07:12.238202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:15.010015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345192+0000","last_change":"2024-09-18T02:03:57.523985+0000","last_active":"2024-09-18T02:04:36.345192+0000","last_peered":"2024-09-18T02:04:36.345192+0000","last_clean":"2024-09-18T02:04:36.345192+0000","last_became_active":"2024-09-18T02:03:57.523437+0000","last_became_peered":"2024-09-18T02:03:57.523437+0000","last_unstale":"2024-09-18T02:04:36.345192+0000","last_undegraded":"2024-09-18T02:04:36.345192+0000","last_fullsized":"2024-09-18T02:04:36.345192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.218837+0000","last_change":"2024-09-18T02:03:59.540278+0000","last_active":"2024-09-18T02:07:12.218837+0000","last_peered":"2024-09-18T02:07:12.218837+0000","last_clean":"2024-09-18T02:07:12.218837+0000","last_became_active":"2024-09-18T02:03:59.539778+0000","last_became_peered":"2024-09-18T02:03:59.539778+0000","last_unstale":"2024-09-18T02:07:12.218837+0000","last_undegraded":"2024-09-18T02:07:12.218837+0000","last_fullsized":"2024-09-18T02:07:12.218837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.035357+0000","last_change":"2024-09-18T02:03:57.528659+0000","last_active":"2024-09-18T02:07:12.035357+0000","last_peered":"2024-09-18T02:07:12.035357+0000","last_clean":"2024-09-18T02:07:12.035357+0000","last_became_active":"2024-09-18T02:03:57.524578+0000","last_became_peered":"2024-09-18T02:03:57.524578+0000","last_unstale":"2024-09-18T02:07:12.035357+0000","last_undegraded":"2024-09-18T02:07:12.035357+0000","last_fullsized":"2024-09-18T02:07:12.035357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.595859+0000","last_change":"2024-09-18T02:03:59.546276+0000","last_active":"2024-09-18T02:04:42.595859+0000","last_peered":"2024-09-18T02:04:42.595859+0000","last_clean":"2024-09-18T02:04:42.595859+0000","last_became_active":"2024-09-18T02:03:59.545902+0000","last_became_peered":"2024-09-18T02:03:59.545902+0000","last_unstale":"2024-09-18T02:04:42.595859+0000","last_undegraded":"2024-09-18T02:04:42.595859+0000","last_fullsized":"2024-09-18T02:04:42.595859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:31.387691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348638+0000","last_change":"2024-09-18T02:03:57.523592+0000","last_active":"2024-09-18T02:04:36.348638+0000","last_peered":"2024-09-18T02:04:36.348638+0000","last_clean":"2024-09-18T02:04:36.348638+0000","last_became_active":"2024-09-18T02:03:57.523211+0000","last_became_peered":"2024-09-18T02:03:57.523211+0000","last_unstale":"2024-09-18T02:04:36.348638+0000","last_undegraded":"2024-09-18T02:04:36.348638+0000","last_fullsized":"2024-09-18T02:04:36.348638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:40.008713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.116959+0000","last_change":"2024-09-18T02:03:59.539920+0000","last_active":"2024-09-18T02:06:11.116959+0000","last_peered":"2024-09-18T02:06:11.116959+0000","last_clean":"2024-09-18T02:06:11.116959+0000","last_became_active":"2024-09-18T02:03:59.539198+0000","last_became_peered":"2024-09-18T02:03:59.539198+0000","last_unstale":"2024-09-18T02:06:11.116959+0000","last_undegraded":"2024-09-18T02:06:11.116959+0000","last_fullsized":"2024-09-18T02:06:11.116959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348389+0000","last_change":"2024-09-18T02:03:57.523263+0000","last_active":"2024-09-18T02:04:36.348389+0000","last_peered":"2024-09-18T02:04:36.348389+0000","last_clean":"2024-09-18T02:04:36.348389+0000","last_became_active":"2024-09-18T02:03:57.522924+0000","last_became_peered":"2024-09-18T02:03:57.522924+0000","last_unstale":"2024-09-18T02:04:36.348389+0000","last_undegraded":"2024-09-18T02:04:36.348389+0000","last_fullsized":"2024-09-18T02:04:36.348389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154414+0000","last_change":"2024-09-18T02:03:59.538519+0000","last_active":"2024-09-18T02:07:12.154414+0000","last_peered":"2024-09-18T02:07:12.154414+0000","last_clean":"2024-09-18T02:07:12.154414+0000","last_became_active":"2024-09-18T02:03:59.538126+0000","last_became_peered":"2024-09-18T02:03:59.538126+0000","last_unstale":"2024-09-18T02:07:12.154414+0000","last_undegraded":"2024-09-18T02:07:12.154414+0000","last_fullsized":"2024-09-18T02:07:12.154414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342676+0000","last_change":"2024-09-18T02:03:57.524373+0000","last_active":"2024-09-18T02:04:36.342676+0000","last_peered":"2024-09-18T02:04:36.342676+0000","last_clean":"2024-09-18T02:04:36.342676+0000","last_became_active":"2024-09-18T02:03:57.521019+0000","last_became_peered":"2024-09-18T02:03:57.521019+0000","last_unstale":"2024-09-18T02:04:36.342676+0000","last_undegraded":"2024-09-18T02:04:36.342676+0000","last_fullsized":"2024-09-18T02:04:36.342676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.726771+0000","last_change":"2024-09-18T02:03:59.542673+0000","last_active":"2024-09-18T02:07:11.726771+0000","last_peered":"2024-09-18T02:07:11.726771+0000","last_clean":"2024-09-18T02:07:11.726771+0000","last_became_active":"2024-09-18T02:03:59.540553+0000","last_became_peered":"2024-09-18T02:03:59.540553+0000","last_unstale":"2024-09-18T02:07:11.726771+0000","last_undegraded":"2024-09-18T02:07:11.726771+0000","last_fullsized":"2024-09-18T02:07:11.726771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:45:09.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.904198+0000","last_change":"2024-09-18T02:03:57.527852+0000","last_active":"2024-09-18T02:04:42.904198+0000","last_peered":"2024-09-18T02:04:42.904198+0000","last_clean":"2024-09-18T02:04:42.904198+0000","last_became_active":"2024-09-18T02:03:57.526917+0000","last_became_peered":"2024-09-18T02:03:57.526917+0000","last_unstale":"2024-09-18T02:04:42.904198+0000","last_undegraded":"2024-09-18T02:04:42.904198+0000","last_fullsized":"2024-09-18T02:04:42.904198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:05:25.015337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.114018+0000","last_change":"2024-09-18T02:04:07.624724+0000","last_active":"2024-09-18T02:07:12.114018+0000","last_peered":"2024-09-18T02:07:12.114018+0000","last_clean":"2024-09-18T02:07:12.114018+0000","last_became_active":"2024-09-18T02:04:07.624037+0000","last_became_peered":"2024-09-18T02:04:07.624037+0000","last_unstale":"2024-09-18T02:07:12.114018+0000","last_undegraded":"2024-09-18T02:07:12.114018+0000","last_fullsized":"2024-09-18T02:07:12.114018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:12.942917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069638+0000","last_change":"2024-09-18T02:03:59.545658+0000","last_active":"2024-09-18T02:07:12.069638+0000","last_peered":"2024-09-18T02:07:12.069638+0000","last_clean":"2024-09-18T02:07:12.069638+0000","last_became_active":"2024-09-18T02:03:59.538409+0000","last_became_peered":"2024-09-18T02:03:59.538409+0000","last_unstale":"2024-09-18T02:07:12.069638+0000","last_undegraded":"2024-09-18T02:07:12.069638+0000","last_fullsized":"2024-09-18T02:07:12.069638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:22:35.808977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336737+0000","last_change":"2024-09-18T02:03:57.533041+0000","last_active":"2024-09-18T02:06:21.336737+0000","last_peered":"2024-09-18T02:06:21.336737+0000","last_clean":"2024-09-18T02:06:21.336737+0000","last_became_active":"2024-09-18T02:03:57.532657+0000","last_became_peered":"2024-09-18T02:03:57.532657+0000","last_unstale":"2024-09-18T02:06:21.336737+0000","last_undegraded":"2024-09-18T02:06:21.336737+0000","last_fullsized":"2024-09-18T02:06:21.336737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:57.872288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353588+0000","last_change":"2024-09-18T02:04:01.562652+0000","last_active":"2024-09-18T02:04:36.353588+0000","last_peered":"2024-09-18T02:04:36.353588+0000","last_clean":"2024-09-18T02:04:36.353588+0000","last_became_active":"2024-09-18T02:04:01.562058+0000","last_became_peered":"2024-09-18T02:04:01.562058+0000","last_unstale":"2024-09-18T02:04:36.353588+0000","last_undegraded":"2024-09-18T02:04:36.353588+0000","last_fullsized":"2024-09-18T02:04:36.353588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:55.815357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'42","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.120403+0000","last_change":"2024-09-18T02:04:03.602001+0000","last_active":"2024-09-18T02:06:09.120403+0000","last_peered":"2024-09-18T02:06:09.120403+0000","last_clean":"2024-09-18T02:06:09.120403+0000","last_became_active":"2024-09-18T02:04:03.600467+0000","last_became_peered":"2024-09-18T02:04:03.600467+0000","last_unstale":"2024-09-18T02:06:09.120403+0000","last_undegraded":"2024-09-18T02:06:09.120403+0000","last_fullsized":"2024-09-18T02:06:09.120403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:57.945679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341767+0000","last_change":"2024-09-18T02:04:05.593604+0000","last_active":"2024-09-18T02:04:36.341767+0000","last_peered":"2024-09-18T02:04:36.341767+0000","last_clean":"2024-09-18T02:04:36.341767+0000","last_became_active":"2024-09-18T02:04:05.592934+0000","last_became_peered":"2024-09-18T02:04:05.592934+0000","last_unstale":"2024-09-18T02:04:36.341767+0000","last_undegraded":"2024-09-18T02:04:36.341767+0000","last_fullsized":"2024-09-18T02:04:36.341767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:04.303561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.009824+0000","last_change":"2024-09-18T02:04:07.624771+0000","last_active":"2024-09-18T02:05:26.009824+0000","last_peered":"2024-09-18T02:05:26.009824+0000","last_clean":"2024-09-18T02:05:26.009824+0000","last_became_active":"2024-09-18T02:04:07.624106+0000","last_became_peered":"2024-09-18T02:04:07.624106+0000","last_unstale":"2024-09-18T02:05:26.009824+0000","last_undegraded":"2024-09-18T02:05:26.009824+0000","last_fullsized":"2024-09-18T02:05:26.009824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:19.261922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:43.634524+0000","last_change":"2024-09-18T02:03:59.556933+0000","last_active":"2024-09-18T02:04:43.634524+0000","last_peered":"2024-09-18T02:04:43.634524+0000","last_clean":"2024-09-18T02:04:43.634524+0000","last_became_active":"2024-09-18T02:03:59.555956+0000","last_became_peered":"2024-09-18T02:03:59.555956+0000","last_unstale":"2024-09-18T02:04:43.634524+0000","last_undegraded":"2024-09-18T02:04:43.634524+0000","last_fullsized":"2024-09-18T02:04:43.634524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:14.846567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.908475+0000","last_change":"2024-09-18T02:03:57.523303+0000","last_active":"2024-09-18T02:04:42.908475+0000","last_peered":"2024-09-18T02:04:42.908475+0000","last_clean":"2024-09-18T02:04:42.908475+0000","last_became_active":"2024-09-18T02:03:57.523041+0000","last_became_peered":"2024-09-18T02:03:57.523041+0000","last_unstale":"2024-09-18T02:04:42.908475+0000","last_undegraded":"2024-09-18T02:04:42.908475+0000","last_fullsized":"2024-09-18T02:04:42.908475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.366147+0000","last_change":"2024-09-18T02:04:36.363414+0000","last_active":"2024-09-18T02:04:36.366147+0000","last_peered":"2024-09-18T02:04:36.366147+0000","last_clean":"2024-09-18T02:04:36.366147+0000","last_became_active":"2024-09-18T02:04:36.362592+0000","last_became_peered":"2024-09-18T02:04:36.362592+0000","last_unstale":"2024-09-18T02:04:36.366147+0000","last_undegraded":"2024-09-18T02:04:36.366147+0000","last_fullsized":"2024-09-18T02:04:36.366147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:35.048118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342013+0000","last_change":"2024-09-18T02:04:03.580344+0000","last_active":"2024-09-18T02:04:36.342013+0000","last_peered":"2024-09-18T02:04:36.342013+0000","last_clean":"2024-09-18T02:04:36.342013+0000","last_became_active":"2024-09-18T02:04:03.579442+0000","last_became_peered":"2024-09-18T02:04:03.579442+0000","last_unstale":"2024-09-18T02:04:36.342013+0000","last_undegraded":"2024-09-18T02:04:36.342013+0000","last_fullsized":"2024-09-18T02:04:36.342013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:24.305992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341161+0000","last_change":"2024-09-18T02:04:05.606711+0000","last_active":"2024-09-18T02:04:36.341161+0000","last_peered":"2024-09-18T02:04:36.341161+0000","last_clean":"2024-09-18T02:04:36.341161+0000","last_became_active":"2024-09-18T02:04:05.605774+0000","last_became_peered":"2024-09-18T02:04:05.605774+0000","last_unstale":"2024-09-18T02:04:36.341161+0000","last_undegraded":"2024-09-18T02:04:36.341161+0000","last_fullsized":"2024-09-18T02:04:36.341161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:09.745074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.874113+0000","last_change":"2024-09-18T02:04:07.610794+0000","last_active":"2024-09-18T02:07:11.874113+0000","last_peered":"2024-09-18T02:07:11.874113+0000","last_clean":"2024-09-18T02:07:11.874113+0000","last_became_active":"2024-09-18T02:04:07.610120+0000","last_became_peered":"2024-09-18T02:04:07.610120+0000","last_unstale":"2024-09-18T02:07:11.874113+0000","last_undegraded":"2024-09-18T02:07:11.874113+0000","last_fullsized":"2024-09-18T02:07:11.874113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:50:22.733414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'18","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.728639+0000","last_change":"2024-09-18T02:04:36.373755+0000","last_active":"2024-09-18T02:07:11.728639+0000","last_peered":"2024-09-18T02:07:11.728639+0000","last_clean":"2024-09-18T02:07:11.728639+0000","last_became_active":"2024-09-18T02:04:36.359108+0000","last_became_peered":"2024-09-18T02:04:36.359108+0000","last_unstale":"2024-09-18T02:07:11.728639+0000","last_undegraded":"2024-09-18T02:07:11.728639+0000","last_fullsized":"2024-09-18T02:07:11.728639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.476030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336598+0000","last_change":"2024-09-18T02:03:57.533341+0000","last_active":"2024-09-18T02:06:21.336598+0000","last_peered":"2024-09-18T02:06:21.336598+0000","last_clean":"2024-09-18T02:06:21.336598+0000","last_became_active":"2024-09-18T02:03:57.533037+0000","last_became_peered":"2024-09-18T02:03:57.533037+0000","last_unstale":"2024-09-18T02:06:21.336598+0000","last_undegraded":"2024-09-18T02:06:21.336598+0000","last_fullsized":"2024-09-18T02:06:21.336598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:05.427298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.573028+0000","last_change":"2024-09-18T02:04:01.568037+0000","last_active":"2024-09-18T02:06:10.573028+0000","last_peered":"2024-09-18T02:06:10.573028+0000","last_clean":"2024-09-18T02:06:10.573028+0000","last_became_active":"2024-09-18T02:04:01.567287+0000","last_became_peered":"2024-09-18T02:04:01.567287+0000","last_unstale":"2024-09-18T02:06:10.573028+0000","last_undegraded":"2024-09-18T02:06:10.573028+0000","last_fullsized":"2024-09-18T02:06:10.573028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:17.024271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'23","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.336252+0000","last_change":"2024-09-18T02:04:03.581817+0000","last_active":"2024-09-18T02:06:26.336252+0000","last_peered":"2024-09-18T02:06:26.336252+0000","last_clean":"2024-09-18T02:06:26.336252+0000","last_became_active":"2024-09-18T02:04:03.581092+0000","last_became_peered":"2024-09-18T02:04:03.581092+0000","last_unstale":"2024-09-18T02:06:26.336252+0000","last_undegraded":"2024-09-18T02:06:26.336252+0000","last_fullsized":"2024-09-18T02:06:26.336252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:22.939603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":405,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.782222+0000","last_change":"2024-09-18T02:04:05.609076+0000","last_active":"2024-09-18T02:07:11.782222+0000","last_peered":"2024-09-18T02:07:11.782222+0000","last_clean":"2024-09-18T02:07:11.782222+0000","last_became_active":"2024-09-18T02:04:05.607733+0000","last_became_peered":"2024-09-18T02:04:05.607733+0000","last_unstale":"2024-09-18T02:07:11.782222+0000","last_undegraded":"2024-09-18T02:07:11.782222+0000","last_fullsized":"2024-09-18T02:07:11.782222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:10.197583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.344569+0000","last_change":"2024-09-18T02:04:07.631363+0000","last_active":"2024-09-18T02:04:36.344569+0000","last_peered":"2024-09-18T02:04:36.344569+0000","last_clean":"2024-09-18T02:04:36.344569+0000","last_became_active":"2024-09-18T02:04:07.630721+0000","last_became_peered":"2024-09-18T02:04:07.630721+0000","last_unstale":"2024-09-18T02:04:36.344569+0000","last_undegraded":"2024-09-18T02:04:36.344569+0000","last_fullsized":"2024-09-18T02:04:36.344569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:45.912516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.725053+0000","last_change":"2024-09-18T02:03:59.550519+0000","last_active":"2024-09-18T02:07:11.725053+0000","last_peered":"2024-09-18T02:07:11.725053+0000","last_clean":"2024-09-18T02:07:11.725053+0000","last_became_active":"2024-09-18T02:03:59.548365+0000","last_became_peered":"2024-09-18T02:03:59.548365+0000","last_unstale":"2024-09-18T02:07:11.725053+0000","last_undegraded":"2024-09-18T02:07:11.725053+0000","last_fullsized":"2024-09-18T02:07:11.725053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.333397+0000","last_change":"2024-09-18T02:03:57.521018+0000","last_active":"2024-09-18T02:06:21.333397+0000","last_peered":"2024-09-18T02:06:21.333397+0000","last_clean":"2024-09-18T02:06:21.333397+0000","last_became_active":"2024-09-18T02:03:57.520706+0000","last_became_peered":"2024-09-18T02:03:57.520706+0000","last_unstale":"2024-09-18T02:06:21.333397+0000","last_undegraded":"2024-09-18T02:06:21.333397+0000","last_fullsized":"2024-09-18T02:06:21.333397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:20:27.172876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.585045+0000","last_change":"2024-09-18T02:04:01.562150+0000","last_active":"2024-09-18T02:06:10.585045+0000","last_peered":"2024-09-18T02:06:10.585045+0000","last_clean":"2024-09-18T02:06:10.585045+0000","last_became_active":"2024-09-18T02:04:01.559249+0000","last_became_peered":"2024-09-18T02:04:01.559249+0000","last_unstale":"2024-09-18T02:06:10.585045+0000","last_undegraded":"2024-09-18T02:06:10.585045+0000","last_fullsized":"2024-09-18T02:06:10.585045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:27.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'36","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.112276+0000","last_change":"2024-09-18T02:04:03.581074+0000","last_active":"2024-09-18T02:06:09.112276+0000","last_peered":"2024-09-18T02:06:09.112276+0000","last_clean":"2024-09-18T02:06:09.112276+0000","last_became_active":"2024-09-18T02:04:03.580310+0000","last_became_peered":"2024-09-18T02:04:03.580310+0000","last_unstale":"2024-09-18T02:06:09.112276+0000","last_undegraded":"2024-09-18T02:06:09.112276+0000","last_fullsized":"2024-09-18T02:06:09.112276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:35.737383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":436,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.231716+0000","last_change":"2024-09-18T02:04:05.612525+0000","last_active":"2024-09-18T02:07:12.231716+0000","last_peered":"2024-09-18T02:07:12.231716+0000","last_clean":"2024-09-18T02:07:12.231716+0000","last_became_active":"2024-09-18T02:04:05.611707+0000","last_became_peered":"2024-09-18T02:04:05.611707+0000","last_unstale":"2024-09-18T02:07:12.231716+0000","last_undegraded":"2024-09-18T02:07:12.231716+0000","last_fullsized":"2024-09-18T02:07:12.231716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:38.266386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.939685+0000","last_change":"2024-09-18T02:03:59.560537+0000","last_active":"2024-09-18T02:04:42.939685+0000","last_peered":"2024-09-18T02:04:42.939685+0000","last_clean":"2024-09-18T02:04:42.939685+0000","last_became_active":"2024-09-18T02:03:59.559585+0000","last_became_peered":"2024-09-18T02:03:59.559585+0000","last_unstale":"2024-09-18T02:04:42.939685+0000","last_undegraded":"2024-09-18T02:04:42.939685+0000","last_fullsized":"2024-09-18T02:04:42.939685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:48.966165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.028684+0000","last_change":"2024-09-18T02:03:57.528019+0000","last_active":"2024-09-18T02:07:12.028684+0000","last_peered":"2024-09-18T02:07:12.028684+0000","last_clean":"2024-09-18T02:07:12.028684+0000","last_became_active":"2024-09-18T02:03:57.527575+0000","last_became_peered":"2024-09-18T02:03:57.527575+0000","last_unstale":"2024-09-18T02:07:12.028684+0000","last_undegraded":"2024-09-18T02:07:12.028684+0000","last_fullsized":"2024-09-18T02:07:12.028684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:47.581207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339069+0000","last_change":"2024-09-18T02:04:01.569918+0000","last_active":"2024-09-18T02:04:36.339069+0000","last_peered":"2024-09-18T02:04:36.339069+0000","last_clean":"2024-09-18T02:04:36.339069+0000","last_became_active":"2024-09-18T02:04:01.569301+0000","last_became_peered":"2024-09-18T02:04:01.569301+0000","last_unstale":"2024-09-18T02:04:36.339069+0000","last_undegraded":"2024-09-18T02:04:36.339069+0000","last_fullsized":"2024-09-18T02:04:36.339069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:17.024271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'46","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.126948+0000","last_change":"2024-09-18T02:04:03.592588+0000","last_active":"2024-09-18T02:06:09.126948+0000","last_peered":"2024-09-18T02:06:09.126948+0000","last_clean":"2024-09-18T02:06:09.126948+0000","last_became_active":"2024-09-18T02:04:03.591195+0000","last_became_peered":"2024-09-18T02:04:03.591195+0000","last_unstale":"2024-09-18T02:06:09.126948+0000","last_undegraded":"2024-09-18T02:06:09.126948+0000","last_fullsized":"2024-09-18T02:06:09.126948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:35:17.659414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339248+0000","last_change":"2024-09-18T02:04:05.606379+0000","last_active":"2024-09-18T02:04:36.339248+0000","last_peered":"2024-09-18T02:04:36.339248+0000","last_clean":"2024-09-18T02:04:36.339248+0000","last_became_active":"2024-09-18T02:04:05.605611+0000","last_became_peered":"2024-09-18T02:04:05.605611+0000","last_unstale":"2024-09-18T02:04:36.339248+0000","last_undegraded":"2024-09-18T02:04:36.339248+0000","last_fullsized":"2024-09-18T02:04:36.339248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:00.566939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.013428+0000","last_change":"2024-09-18T02:04:07.630472+0000","last_active":"2024-09-18T02:05:26.013428+0000","last_peered":"2024-09-18T02:05:26.013428+0000","last_clean":"2024-09-18T02:05:26.013428+0000","last_became_active":"2024-09-18T02:04:07.628247+0000","last_became_peered":"2024-09-18T02:04:07.628247+0000","last_unstale":"2024-09-18T02:05:26.013428+0000","last_undegraded":"2024-09-18T02:05:26.013428+0000","last_fullsized":"2024-09-18T02:05:26.013428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:40.279768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.000495+0000","last_change":"2024-09-18T02:03:59.535593+0000","last_active":"2024-09-18T02:05:26.000495+0000","last_peered":"2024-09-18T02:05:26.000495+0000","last_clean":"2024-09-18T02:05:26.000495+0000","last_became_active":"2024-09-18T02:03:59.535217+0000","last_became_peered":"2024-09-18T02:03:59.535217+0000","last_unstale":"2024-09-18T02:05:26.000495+0000","last_undegraded":"2024-09-18T02:05:26.000495+0000","last_fullsized":"2024-09-18T02:05:26.000495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:38.500729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.369068+0000","last_change":"2024-09-18T02:03:57.529038+0000","last_active":"2024-09-18T02:04:36.369068+0000","last_peered":"2024-09-18T02:04:36.369068+0000","last_clean":"2024-09-18T02:04:36.369068+0000","last_became_active":"2024-09-18T02:03:57.528006+0000","last_became_peered":"2024-09-18T02:03:57.528006+0000","last_unstale":"2024-09-18T02:04:36.369068+0000","last_undegraded":"2024-09-18T02:04:36.369068+0000","last_fullsized":"2024-09-18T02:04:36.369068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:46.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361230+0000","last_change":"2024-09-18T02:04:36.358966+0000","last_active":"2024-09-18T02:04:36.361230+0000","last_peered":"2024-09-18T02:04:36.361230+0000","last_clean":"2024-09-18T02:04:36.361230+0000","last_became_active":"2024-09-18T02:04:36.357607+0000","last_became_peered":"2024-09-18T02:04:36.357607+0000","last_unstale":"2024-09-18T02:04:36.361230+0000","last_undegraded":"2024-09-18T02:04:36.361230+0000","last_fullsized":"2024-09-18T02:04:36.361230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:02:01.245576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'36","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.096724+0000","last_change":"2024-09-18T02:04:03.604260+0000","last_active":"2024-09-18T02:06:09.096724+0000","last_peered":"2024-09-18T02:06:09.096724+0000","last_clean":"2024-09-18T02:06:09.096724+0000","last_became_active":"2024-09-18T02:04:03.601783+0000","last_became_peered":"2024-09-18T02:04:03.601783+0000","last_unstale":"2024-09-18T02:06:09.096724+0000","last_undegraded":"2024-09-18T02:06:09.096724+0000","last_fullsized":"2024-09-18T02:06:09.096724+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:52.749305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338424+0000","last_change":"2024-09-18T02:04:05.578434+0000","last_active":"2024-09-18T02:04:36.338424+0000","last_peered":"2024-09-18T02:04:36.338424+0000","last_clean":"2024-09-18T02:04:36.338424+0000","last_became_active":"2024-09-18T02:04:05.577665+0000","last_became_peered":"2024-09-18T02:04:05.577665+0000","last_unstale":"2024-09-18T02:04:36.338424+0000","last_undegraded":"2024-09-18T02:04:36.338424+0000","last_fullsized":"2024-09-18T02:04:36.338424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:59.848912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.297891+0000","last_change":"2024-09-18T02:04:07.621208+0000","last_active":"2024-09-18T02:05:26.297891+0000","last_peered":"2024-09-18T02:05:26.297891+0000","last_clean":"2024-09-18T02:05:26.297891+0000","last_became_active":"2024-09-18T02:04:07.619973+0000","last_became_peered":"2024-09-18T02:04:07.619973+0000","last_unstale":"2024-09-18T02:05:26.297891+0000","last_undegraded":"2024-09-18T02:05:26.297891+0000","last_fullsized":"2024-09-18T02:05:26.297891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:04:52.210610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153629+0000","last_change":"2024-09-18T02:03:59.539493+0000","last_active":"2024-09-18T02:07:12.153629+0000","last_peered":"2024-09-18T02:07:12.153629+0000","last_clean":"2024-09-18T02:07:12.153629+0000","last_became_active":"2024-09-18T02:03:59.539105+0000","last_became_peered":"2024-09-18T02:03:59.539105+0000","last_unstale":"2024-09-18T02:07:12.153629+0000","last_undegraded":"2024-09-18T02:07:12.153629+0000","last_fullsized":"2024-09-18T02:07:12.153629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:48.841356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.985374+0000","last_change":"2024-09-18T02:03:57.530707+0000","last_active":"2024-09-18T02:05:25.985374+0000","last_peered":"2024-09-18T02:05:25.985374+0000","last_clean":"2024-09-18T02:05:25.985374+0000","last_became_active":"2024-09-18T02:03:57.526327+0000","last_became_peered":"2024-09-18T02:03:57.526327+0000","last_unstale":"2024-09-18T02:05:25.985374+0000","last_undegraded":"2024-09-18T02:05:25.985374+0000","last_fullsized":"2024-09-18T02:05:25.985374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:29.374180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343561+0000","last_change":"2024-09-18T02:04:01.562077+0000","last_active":"2024-09-18T02:04:36.343561+0000","last_peered":"2024-09-18T02:04:36.343561+0000","last_clean":"2024-09-18T02:04:36.343561+0000","last_became_active":"2024-09-18T02:04:01.561279+0000","last_became_peered":"2024-09-18T02:04:01.561279+0000","last_unstale":"2024-09-18T02:04:36.343561+0000","last_undegraded":"2024-09-18T02:04:36.343561+0000","last_fullsized":"2024-09-18T02:04:36.343561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:22.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'49","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335258+0000","last_change":"2024-09-18T02:04:03.595408+0000","last_active":"2024-09-18T02:06:16.335258+0000","last_peered":"2024-09-18T02:06:16.335258+0000","last_clean":"2024-09-18T02:06:16.335258+0000","last_became_active":"2024-09-18T02:04:03.591705+0000","last_became_peered":"2024-09-18T02:04:03.591705+0000","last_unstale":"2024-09-18T02:06:16.335258+0000","last_undegraded":"2024-09-18T02:06:16.335258+0000","last_fullsized":"2024-09-18T02:06:16.335258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:09.695750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":398,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.417043+0000","last_change":"2024-09-18T02:04:05.592469+0000","last_active":"2024-09-18T02:07:12.417043+0000","last_peered":"2024-09-18T02:07:12.417043+0000","last_clean":"2024-09-18T02:07:12.417043+0000","last_became_active":"2024-09-18T02:04:05.591652+0000","last_became_peered":"2024-09-18T02:04:05.591652+0000","last_unstale":"2024-09-18T02:07:12.417043+0000","last_undegraded":"2024-09-18T02:07:12.417043+0000","last_fullsized":"2024-09-18T02:07:12.417043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:09.745074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342503+0000","last_change":"2024-09-18T02:04:07.609950+0000","last_active":"2024-09-18T02:04:36.342503+0000","last_peered":"2024-09-18T02:04:36.342503+0000","last_clean":"2024-09-18T02:04:36.342503+0000","last_became_active":"2024-09-18T02:04:07.609050+0000","last_became_peered":"2024-09-18T02:04:07.609050+0000","last_unstale":"2024-09-18T02:04:36.342503+0000","last_undegraded":"2024-09-18T02:04:36.342503+0000","last_fullsized":"2024-09-18T02:04:36.342503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:08.651954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'14","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153098+0000","last_change":"2024-09-18T02:03:59.532107+0000","last_active":"2024-09-18T02:07:12.153098+0000","last_peered":"2024-09-18T02:07:12.153098+0000","last_clean":"2024-09-18T02:07:12.153098+0000","last_became_active":"2024-09-18T02:03:59.531445+0000","last_became_peered":"2024-09-18T02:03:59.531445+0000","last_unstale":"2024-09-18T02:07:12.153098+0000","last_undegraded":"2024-09-18T02:07:12.153098+0000","last_fullsized":"2024-09-18T02:07:12.153098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335457+0000","last_change":"2024-09-18T02:03:57.522436+0000","last_active":"2024-09-18T02:06:16.335457+0000","last_peered":"2024-09-18T02:06:16.335457+0000","last_clean":"2024-09-18T02:06:16.335457+0000","last_became_active":"2024-09-18T02:03:57.521858+0000","last_became_peered":"2024-09-18T02:03:57.521858+0000","last_unstale":"2024-09-18T02:06:16.335457+0000","last_undegraded":"2024-09-18T02:06:16.335457+0000","last_fullsized":"2024-09-18T02:06:16.335457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:52.057677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361115+0000","last_change":"2024-09-18T02:04:36.357179+0000","last_active":"2024-09-18T02:04:36.361115+0000","last_peered":"2024-09-18T02:04:36.361115+0000","last_clean":"2024-09-18T02:04:36.361115+0000","last_became_active":"2024-09-18T02:04:36.356453+0000","last_became_peered":"2024-09-18T02:04:36.356453+0000","last_unstale":"2024-09-18T02:04:36.361115+0000","last_undegraded":"2024-09-18T02:04:36.361115+0000","last_fullsized":"2024-09-18T02:04:36.361115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:27.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'66","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.131727+0000","last_change":"2024-09-18T02:04:03.596161+0000","last_active":"2024-09-18T02:06:09.131727+0000","last_peered":"2024-09-18T02:06:09.131727+0000","last_clean":"2024-09-18T02:06:09.131727+0000","last_became_active":"2024-09-18T02:04:03.595618+0000","last_became_peered":"2024-09-18T02:04:03.595618+0000","last_unstale":"2024-09-18T02:06:09.131727+0000","last_undegraded":"2024-09-18T02:06:09.131727+0000","last_fullsized":"2024-09-18T02:06:09.131727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:30.345316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338225+0000","last_change":"2024-09-18T02:04:05.585960+0000","last_active":"2024-09-18T02:04:36.338225+0000","last_peered":"2024-09-18T02:04:36.338225+0000","last_clean":"2024-09-18T02:04:36.338225+0000","last_became_active":"2024-09-18T02:04:05.585272+0000","last_became_peered":"2024-09-18T02:04:05.585272+0000","last_unstale":"2024-09-18T02:04:36.338225+0000","last_undegraded":"2024-09-18T02:04:36.338225+0000","last_fullsized":"2024-09-18T02:04:36.338225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:26.254201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.376039+0000","last_change":"2024-09-18T02:04:07.614915+0000","last_active":"2024-09-18T02:07:12.376039+0000","last_peered":"2024-09-18T02:07:12.376039+0000","last_clean":"2024-09-18T02:07:12.376039+0000","last_became_active":"2024-09-18T02:04:07.614232+0000","last_became_peered":"2024-09-18T02:04:07.614232+0000","last_unstale":"2024-09-18T02:07:12.376039+0000","last_undegraded":"2024-09-18T02:07:12.376039+0000","last_fullsized":"2024-09-18T02:07:12.376039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:34.372220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'18","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154480+0000","last_change":"2024-09-18T02:03:59.546334+0000","last_active":"2024-09-18T02:07:12.154480+0000","last_peered":"2024-09-18T02:07:12.154480+0000","last_clean":"2024-09-18T02:07:12.154480+0000","last_became_active":"2024-09-18T02:03:59.545956+0000","last_became_peered":"2024-09-18T02:03:59.545956+0000","last_unstale":"2024-09-18T02:07:12.154480+0000","last_undegraded":"2024-09-18T02:07:12.154480+0000","last_fullsized":"2024-09-18T02:07:12.154480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:12.929565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.331685+0000","last_change":"2024-09-18T02:03:57.522159+0000","last_active":"2024-09-18T02:06:16.331685+0000","last_peered":"2024-09-18T02:06:16.331685+0000","last_clean":"2024-09-18T02:06:16.331685+0000","last_became_active":"2024-09-18T02:03:57.520036+0000","last_became_peered":"2024-09-18T02:03:57.520036+0000","last_unstale":"2024-09-18T02:06:16.331685+0000","last_undegraded":"2024-09-18T02:06:16.331685+0000","last_fullsized":"2024-09-18T02:06:16.331685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:47.581207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361351+0000","last_change":"2024-09-18T02:04:01.573344+0000","last_active":"2024-09-18T02:04:36.361351+0000","last_peered":"2024-09-18T02:04:36.361351+0000","last_clean":"2024-09-18T02:04:36.361351+0000","last_became_active":"2024-09-18T02:04:01.573084+0000","last_became_peered":"2024-09-18T02:04:01.573084+0000","last_unstale":"2024-09-18T02:04:36.361351+0000","last_undegraded":"2024-09-18T02:04:36.361351+0000","last_fullsized":"2024-09-18T02:04:36.361351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:45:12.008014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.102500+0000","last_change":"2024-09-18T02:04:03.567085+0000","last_active":"2024-09-18T02:06:09.102500+0000","last_peered":"2024-09-18T02:06:09.102500+0000","last_clean":"2024-09-18T02:06:09.102500+0000","last_became_active":"2024-09-18T02:04:03.565801+0000","last_became_peered":"2024-09-18T02:04:03.565801+0000","last_unstale":"2024-09-18T02:06:09.102500+0000","last_undegraded":"2024-09-18T02:06:09.102500+0000","last_fullsized":"2024-09-18T02:06:09.102500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:33.058001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.357876+0000","last_change":"2024-09-18T02:04:05.612592+0000","last_active":"2024-09-18T02:04:36.357876+0000","last_peered":"2024-09-18T02:04:36.357876+0000","last_clean":"2024-09-18T02:04:36.357876+0000","last_became_active":"2024-09-18T02:04:05.612052+0000","last_became_peered":"2024-09-18T02:04:05.612052+0000","last_unstale":"2024-09-18T02:04:36.357876+0000","last_undegraded":"2024-09-18T02:04:36.357876+0000","last_fullsized":"2024-09-18T02:04:36.357876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:51:05.159090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.173402+0000","last_change":"2024-09-18T02:04:07.622545+0000","last_active":"2024-09-18T02:07:12.173402+0000","last_peered":"2024-09-18T02:07:12.173402+0000","last_clean":"2024-09-18T02:07:12.173402+0000","last_became_active":"2024-09-18T02:04:07.622004+0000","last_became_peered":"2024-09-18T02:04:07.622004+0000","last_unstale":"2024-09-18T02:07:12.173402+0000","last_undegraded":"2024-09-18T02:07:12.173402+0000","last_fullsized":"2024-09-18T02:07:12.173402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:53.836670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.218296+0000","last_change":"2024-09-18T02:04:36.364542+0000","last_active":"2024-09-18T02:07:12.218296+0000","last_peered":"2024-09-18T02:07:12.218296+0000","last_clean":"2024-09-18T02:07:12.218296+0000","last_became_active":"2024-09-18T02:04:36.361748+0000","last_became_peered":"2024-09-18T02:04:36.361748+0000","last_unstale":"2024-09-18T02:07:12.218296+0000","last_undegraded":"2024-09-18T02:07:12.218296+0000","last_fullsized":"2024-09-18T02:07:12.218296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:04.881724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.334238+0000","last_change":"2024-09-18T02:03:57.530747+0000","last_active":"2024-09-18T02:06:11.334238+0000","last_peered":"2024-09-18T02:06:11.334238+0000","last_clean":"2024-09-18T02:06:11.334238+0000","last_became_active":"2024-09-18T02:03:57.526977+0000","last_became_peered":"2024-09-18T02:03:57.526977+0000","last_unstale":"2024-09-18T02:06:11.334238+0000","last_undegraded":"2024-09-18T02:06:11.334238+0000","last_fullsized":"2024-09-18T02:06:11.334238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:29.938986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345881+0000","last_change":"2024-09-18T02:04:01.562995+0000","last_active":"2024-09-18T02:04:36.345881+0000","last_peered":"2024-09-18T02:04:36.345881+0000","last_clean":"2024-09-18T02:04:36.345881+0000","last_became_active":"2024-09-18T02:04:01.561913+0000","last_became_peered":"2024-09-18T02:04:01.561913+0000","last_unstale":"2024-09-18T02:04:36.345881+0000","last_undegraded":"2024-09-18T02:04:36.345881+0000","last_fullsized":"2024-09-18T02:04:36.345881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:33.717350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.143733+0000","last_change":"2024-09-18T02:04:03.581156+0000","last_active":"2024-09-18T02:06:09.143733+0000","last_peered":"2024-09-18T02:06:09.143733+0000","last_clean":"2024-09-18T02:06:09.143733+0000","last_became_active":"2024-09-18T02:04:03.580395+0000","last_became_peered":"2024-09-18T02:04:03.580395+0000","last_unstale":"2024-09-18T02:06:09.143733+0000","last_undegraded":"2024-09-18T02:06:09.143733+0000","last_fullsized":"2024-09-18T02:06:09.143733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:36.129908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.387338+0000","last_change":"2024-09-18T02:04:05.604333+0000","last_active":"2024-09-18T02:07:12.387338+0000","last_peered":"2024-09-18T02:07:12.387338+0000","last_clean":"2024-09-18T02:07:12.387338+0000","last_became_active":"2024-09-18T02:04:05.603548+0000","last_became_peered":"2024-09-18T02:04:05.603548+0000","last_unstale":"2024-09-18T02:07:12.387338+0000","last_undegraded":"2024-09-18T02:07:12.387338+0000","last_fullsized":"2024-09-18T02:07:12.387338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:24.870978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.082226+0000","last_change":"2024-09-18T02:04:07.620770+0000","last_active":"2024-09-18T02:07:12.082226+0000","last_peered":"2024-09-18T02:07:12.082226+0000","last_clean":"2024-09-18T02:07:12.082226+0000","last_became_active":"2024-09-18T02:04:07.620094+0000","last_became_peered":"2024-09-18T02:04:07.620094+0000","last_unstale":"2024-09-18T02:07:12.082226+0000","last_undegraded":"2024-09-18T02:07:12.082226+0000","last_fullsized":"2024-09-18T02:07:12.082226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:36:55.417123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'14","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069886+0000","last_change":"2024-09-18T02:03:59.535067+0000","last_active":"2024-09-18T02:07:12.069886+0000","last_peered":"2024-09-18T02:07:12.069886+0000","last_clean":"2024-09-18T02:07:12.069886+0000","last_became_active":"2024-09-18T02:03:59.534547+0000","last_became_peered":"2024-09-18T02:03:59.534547+0000","last_unstale":"2024-09-18T02:07:12.069886+0000","last_undegraded":"2024-09-18T02:07:12.069886+0000","last_fullsized":"2024-09-18T02:07:12.069886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349002+0000","last_change":"2024-09-18T02:03:57.526267+0000","last_active":"2024-09-18T02:04:36.349002+0000","last_peered":"2024-09-18T02:04:36.349002+0000","last_clean":"2024-09-18T02:04:36.349002+0000","last_became_active":"2024-09-18T02:03:57.525576+0000","last_became_peered":"2024-09-18T02:03:57.525576+0000","last_unstale":"2024-09-18T02:04:36.349002+0000","last_undegraded":"2024-09-18T02:04:36.349002+0000","last_fullsized":"2024-09-18T02:04:36.349002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:45:50.125550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.584748+0000","last_change":"2024-09-18T02:04:01.565275+0000","last_active":"2024-09-18T02:06:10.584748+0000","last_peered":"2024-09-18T02:06:10.584748+0000","last_clean":"2024-09-18T02:06:10.584748+0000","last_became_active":"2024-09-18T02:04:01.564385+0000","last_became_peered":"2024-09-18T02:04:01.564385+0000","last_unstale":"2024-09-18T02:06:10.584748+0000","last_undegraded":"2024-09-18T02:06:10.584748+0000","last_fullsized":"2024-09-18T02:06:10.584748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:50.980422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353471+0000","last_change":"2024-09-18T02:04:03.601350+0000","last_active":"2024-09-18T02:04:36.353471+0000","last_peered":"2024-09-18T02:04:36.353471+0000","last_clean":"2024-09-18T02:04:36.353471+0000","last_became_active":"2024-09-18T02:04:03.600545+0000","last_became_peered":"2024-09-18T02:04:03.600545+0000","last_unstale":"2024-09-18T02:04:36.353471+0000","last_undegraded":"2024-09-18T02:04:36.353471+0000","last_fullsized":"2024-09-18T02:04:36.353471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:51:09.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":460,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.330022+0000","last_change":"2024-09-18T02:04:05.582865+0000","last_active":"2024-09-18T02:07:12.330022+0000","last_peered":"2024-09-18T02:07:12.330022+0000","last_clean":"2024-09-18T02:07:12.330022+0000","last_became_active":"2024-09-18T02:04:05.582127+0000","last_became_peered":"2024-09-18T02:04:05.582127+0000","last_unstale":"2024-09-18T02:07:12.330022+0000","last_undegraded":"2024-09-18T02:07:12.330022+0000","last_fullsized":"2024-09-18T02:07:12.330022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:43.899135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.741734+0000","last_change":"2024-09-18T02:04:07.606525+0000","last_active":"2024-09-18T02:06:10.741734+0000","last_peered":"2024-09-18T02:06:10.741734+0000","last_clean":"2024-09-18T02:06:10.741734+0000","last_became_active":"2024-09-18T02:04:07.602985+0000","last_became_peered":"2024-09-18T02:04:07.602985+0000","last_unstale":"2024-09-18T02:06:10.741734+0000","last_undegraded":"2024-09-18T02:06:10.741734+0000","last_fullsized":"2024-09-18T02:06:10.741734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:39.005182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.135331+0000","last_change":"2024-09-18T02:03:59.555188+0000","last_active":"2024-09-18T02:04:42.135331+0000","last_peered":"2024-09-18T02:04:42.135331+0000","last_clean":"2024-09-18T02:04:42.135331+0000","last_became_active":"2024-09-18T02:03:59.554711+0000","last_became_peered":"2024-09-18T02:03:59.554711+0000","last_unstale":"2024-09-18T02:04:42.135331+0000","last_undegraded":"2024-09-18T02:04:42.135331+0000","last_fullsized":"2024-09-18T02:04:42.135331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:54:59.350305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346294+0000","last_change":"2024-09-18T02:03:57.531537+0000","last_active":"2024-09-18T02:04:36.346294+0000","last_peered":"2024-09-18T02:04:36.346294+0000","last_clean":"2024-09-18T02:04:36.346294+0000","last_became_active":"2024-09-18T02:03:57.531156+0000","last_became_peered":"2024-09-18T02:03:57.531156+0000","last_unstale":"2024-09-18T02:04:36.346294+0000","last_undegraded":"2024-09-18T02:04:36.346294+0000","last_fullsized":"2024-09-18T02:04:36.346294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:38:10.322009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358596+0000","last_change":"2024-09-18T02:04:01.566384+0000","last_active":"2024-09-18T02:04:36.358596+0000","last_peered":"2024-09-18T02:04:36.358596+0000","last_clean":"2024-09-18T02:04:36.358596+0000","last_became_active":"2024-09-18T02:04:01.565999+0000","last_became_peered":"2024-09-18T02:04:01.565999+0000","last_unstale":"2024-09-18T02:04:36.358596+0000","last_undegraded":"2024-09-18T02:04:36.358596+0000","last_fullsized":"2024-09-18T02:04:36.358596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:14.084784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'40","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.333779+0000","last_change":"2024-09-18T02:04:03.564795+0000","last_active":"2024-09-18T02:06:21.333779+0000","last_peered":"2024-09-18T02:06:21.333779+0000","last_clean":"2024-09-18T02:06:21.333779+0000","last_became_active":"2024-09-18T02:04:03.564021+0000","last_became_peered":"2024-09-18T02:04:03.564021+0000","last_unstale":"2024-09-18T02:06:21.333779+0000","last_undegraded":"2024-09-18T02:06:21.333779+0000","last_fullsized":"2024-09-18T02:06:21.333779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:32.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346074+0000","last_change":"2024-09-18T02:04:05.611095+0000","last_active":"2024-09-18T02:04:36.346074+0000","last_peered":"2024-09-18T02:04:36.346074+0000","last_clean":"2024-09-18T02:04:36.346074+0000","last_became_active":"2024-09-18T02:04:05.610024+0000","last_became_peered":"2024-09-18T02:04:05.610024+0000","last_unstale":"2024-09-18T02:04:36.346074+0000","last_undegraded":"2024-09-18T02:04:36.346074+0000","last_fullsized":"2024-09-18T02:04:36.346074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:13.378109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.289268+0000","last_change":"2024-09-18T02:04:07.619059+0000","last_active":"2024-09-18T02:07:12.289268+0000","last_peered":"2024-09-18T02:07:12.289268+0000","last_clean":"2024-09-18T02:07:12.289268+0000","last_became_active":"2024-09-18T02:04:07.618153+0000","last_became_peered":"2024-09-18T02:04:07.618153+0000","last_unstale":"2024-09-18T02:07:12.289268+0000","last_undegraded":"2024-09-18T02:07:12.289268+0000","last_fullsized":"2024-09-18T02:07:12.289268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:28.091310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'9","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.333102+0000","last_change":"2024-09-18T02:03:59.560833+0000","last_active":"2024-09-18T02:06:06.333102+0000","last_peered":"2024-09-18T02:06:06.333102+0000","last_clean":"2024-09-18T02:06:06.333102+0000","last_became_active":"2024-09-18T02:03:59.559592+0000","last_became_peered":"2024-09-18T02:03:59.559592+0000","last_unstale":"2024-09-18T02:06:06.333102+0000","last_undegraded":"2024-09-18T02:06:06.333102+0000","last_fullsized":"2024-09-18T02:06:06.333102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:07.330297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.337223+0000","last_change":"2024-09-18T02:03:43.338768+0000","last_active":"2024-09-18T02:04:36.337223+0000","last_peered":"2024-09-18T02:04:36.337223+0000","last_clean":"2024-09-18T02:04:36.337223+0000","last_became_active":"2024-09-18T02:03:43.336731+0000","last_became_peered":"2024-09-18T02:03:43.336731+0000","last_unstale":"2024-09-18T02:04:36.337223+0000","last_undegraded":"2024-09-18T02:04:36.337223+0000","last_fullsized":"2024-09-18T02:04:36.337223+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_clean_scrub_stamp":"2024-09-18T02:03:42.235832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:47:03.749921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350315+0000","last_change":"2024-09-18T02:03:50.287984+0000","last_active":"2024-09-18T02:04:36.350315+0000","last_peered":"2024-09-18T02:04:36.350315+0000","last_clean":"2024-09-18T02:04:36.350315+0000","last_became_active":"2024-09-18T02:03:48.273444+0000","last_became_peered":"2024-09-18T02:03:48.273444+0000","last_unstale":"2024-09-18T02:04:36.350315+0000","last_undegraded":"2024-09-18T02:04:36.350315+0000","last_fullsized":"2024-09-18T02:04:36.350315+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:18.121435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024299339999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.048115+0000","last_change":"2024-09-18T02:03:57.533463+0000","last_active":"2024-09-18T02:06:11.048115+0000","last_peered":"2024-09-18T02:06:11.048115+0000","last_clean":"2024-09-18T02:06:11.048115+0000","last_became_active":"2024-09-18T02:03:57.532844+0000","last_became_peered":"2024-09-18T02:03:57.532844+0000","last_unstale":"2024-09-18T02:06:11.048115+0000","last_undegraded":"2024-09-18T02:06:11.048115+0000","last_fullsized":"2024-09-18T02:06:11.048115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:09.285157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.347738+0000","last_change":"2024-09-18T02:04:01.565115+0000","last_active":"2024-09-18T02:04:36.347738+0000","last_peered":"2024-09-18T02:04:36.347738+0000","last_clean":"2024-09-18T02:04:36.347738+0000","last_became_active":"2024-09-18T02:04:01.563633+0000","last_became_peered":"2024-09-18T02:04:01.563633+0000","last_unstale":"2024-09-18T02:04:36.347738+0000","last_undegraded":"2024-09-18T02:04:36.347738+0000","last_fullsized":"2024-09-18T02:04:36.347738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:13:18.066545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":160,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.139607+0000","last_change":"2024-09-18T02:04:03.607393+0000","last_active":"2024-09-18T02:06:09.139607+0000","last_peered":"2024-09-18T02:06:09.139607+0000","last_clean":"2024-09-18T02:06:09.139607+0000","last_became_active":"2024-09-18T02:04:03.606800+0000","last_became_peered":"2024-09-18T02:04:03.606800+0000","last_unstale":"2024-09-18T02:06:09.139607+0000","last_undegraded":"2024-09-18T02:06:09.139607+0000","last_fullsized":"2024-09-18T02:06:09.139607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:02:19.651160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":84,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345601+0000","last_change":"2024-09-18T02:04:05.589275+0000","last_active":"2024-09-18T02:04:36.345601+0000","last_peered":"2024-09-18T02:04:36.345601+0000","last_clean":"2024-09-18T02:04:36.345601+0000","last_became_active":"2024-09-18T02:04:05.588568+0000","last_became_peered":"2024-09-18T02:04:05.588568+0000","last_unstale":"2024-09-18T02:04:36.345601+0000","last_undegraded":"2024-09-18T02:04:36.345601+0000","last_fullsized":"2024-09-18T02:04:36.345601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:31.240038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.245394+0000","last_change":"2024-09-18T02:04:07.628613+0000","last_active":"2024-09-18T02:07:12.245394+0000","last_peered":"2024-09-18T02:07:12.245394+0000","last_clean":"2024-09-18T02:07:12.245394+0000","last_became_active":"2024-09-18T02:04:07.613914+0000","last_became_peered":"2024-09-18T02:04:07.613914+0000","last_unstale":"2024-09-18T02:07:12.245394+0000","last_undegraded":"2024-09-18T02:07:12.245394+0000","last_fullsized":"2024-09-18T02:07:12.245394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:11.758456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.169657+0000","last_change":"2024-09-18T02:03:59.556174+0000","last_active":"2024-09-18T02:07:12.169657+0000","last_peered":"2024-09-18T02:07:12.169657+0000","last_clean":"2024-09-18T02:07:12.169657+0000","last_became_active":"2024-09-18T02:03:59.555801+0000","last_became_peered":"2024-09-18T02:03:59.555801+0000","last_unstale":"2024-09-18T02:07:12.169657+0000","last_undegraded":"2024-09-18T02:07:12.169657+0000","last_fullsized":"2024-09-18T02:07:12.169657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:28.174295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346239+0000","last_change":"2024-09-18T02:03:50.285797+0000","last_active":"2024-09-18T02:04:36.346239+0000","last_peered":"2024-09-18T02:04:36.346239+0000","last_clean":"2024-09-18T02:04:36.346239+0000","last_became_active":"2024-09-18T02:03:48.275709+0000","last_became_peered":"2024-09-18T02:03:48.275709+0000","last_unstale":"2024-09-18T02:04:36.346239+0000","last_undegraded":"2024-09-18T02:04:36.346239+0000","last_fullsized":"2024-09-18T02:04:36.346239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:53.873897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047579399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339035+0000","last_change":"2024-09-18T02:03:57.521576+0000","last_active":"2024-09-18T02:04:36.339035+0000","last_peered":"2024-09-18T02:04:36.339035+0000","last_clean":"2024-09-18T02:04:36.339035+0000","last_became_active":"2024-09-18T02:03:57.520559+0000","last_became_peered":"2024-09-18T02:03:57.520559+0000","last_unstale":"2024-09-18T02:04:36.339035+0000","last_undegraded":"2024-09-18T02:04:36.339035+0000","last_fullsized":"2024-09-18T02:04:36.339035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.363932+0000","last_change":"2024-09-18T02:04:01.561598+0000","last_active":"2024-09-18T02:04:36.363932+0000","last_peered":"2024-09-18T02:04:36.363932+0000","last_clean":"2024-09-18T02:04:36.363932+0000","last_became_active":"2024-09-18T02:04:01.561194+0000","last_became_peered":"2024-09-18T02:04:01.561194+0000","last_unstale":"2024-09-18T02:04:36.363932+0000","last_undegraded":"2024-09-18T02:04:36.363932+0000","last_fullsized":"2024-09-18T02:04:36.363932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:23.937467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'279","reported_seq":489,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.782113+0000","last_change":"2024-09-18T02:04:03.571137+0000","last_active":"2024-09-18T02:07:11.782113+0000","last_peered":"2024-09-18T02:07:11.782113+0000","last_clean":"2024-09-18T02:07:11.782113+0000","last_became_active":"2024-09-18T02:04:03.570288+0000","last_became_peered":"2024-09-18T02:04:03.570288+0000","last_unstale":"2024-09-18T02:07:11.782113+0000","last_undegraded":"2024-09-18T02:07:11.782113+0000","last_fullsized":"2024-09-18T02:07:11.782113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:22.857455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353081+0000","last_change":"2024-09-18T02:04:05.609826+0000","last_active":"2024-09-18T02:04:36.353081+0000","last_peered":"2024-09-18T02:04:36.353081+0000","last_clean":"2024-09-18T02:04:36.353081+0000","last_became_active":"2024-09-18T02:04:05.608544+0000","last_became_peered":"2024-09-18T02:04:05.608544+0000","last_unstale":"2024-09-18T02:04:36.353081+0000","last_undegraded":"2024-09-18T02:04:36.353081+0000","last_fullsized":"2024-09-18T02:04:36.353081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:32:12.009097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'7","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.130305+0000","last_change":"2024-09-18T02:04:07.624305+0000","last_active":"2024-09-18T02:07:12.130305+0000","last_peered":"2024-09-18T02:07:12.130305+0000","last_clean":"2024-09-18T02:07:12.130305+0000","last_became_active":"2024-09-18T02:04:07.622337+0000","last_became_peered":"2024-09-18T02:04:07.622337+0000","last_unstale":"2024-09-18T02:07:12.130305+0000","last_undegraded":"2024-09-18T02:07:12.130305+0000","last_fullsized":"2024-09-18T02:07:12.130305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:48.413588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153178+0000","last_change":"2024-09-18T02:03:59.549829+0000","last_active":"2024-09-18T02:07:12.153178+0000","last_peered":"2024-09-18T02:07:12.153178+0000","last_clean":"2024-09-18T02:07:12.153178+0000","last_became_active":"2024-09-18T02:03:59.548308+0000","last_became_peered":"2024-09-18T02:03:59.548308+0000","last_unstale":"2024-09-18T02:07:12.153178+0000","last_undegraded":"2024-09-18T02:07:12.153178+0000","last_fullsized":"2024-09-18T02:07:12.153178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:36.437530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341109+0000","last_change":"2024-09-18T02:03:50.338272+0000","last_active":"2024-09-18T02:04:36.341109+0000","last_peered":"2024-09-18T02:04:36.341109+0000","last_clean":"2024-09-18T02:04:36.341109+0000","last_became_active":"2024-09-18T02:03:48.275609+0000","last_became_peered":"2024-09-18T02:03:48.275609+0000","last_unstale":"2024-09-18T02:04:36.341109+0000","last_undegraded":"2024-09-18T02:04:36.341109+0000","last_fullsized":"2024-09-18T02:04:36.341109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067244799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.346475+0000","last_change":"2024-09-18T02:03:57.520998+0000","last_active":"2024-09-18T02:04:41.346475+0000","last_peered":"2024-09-18T02:04:41.346475+0000","last_clean":"2024-09-18T02:04:41.346475+0000","last_became_active":"2024-09-18T02:03:57.520103+0000","last_became_peered":"2024-09-18T02:03:57.520103+0000","last_unstale":"2024-09-18T02:04:41.346475+0000","last_undegraded":"2024-09-18T02:04:41.346475+0000","last_fullsized":"2024-09-18T02:04:41.346475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.369051+0000","last_change":"2024-09-18T02:04:01.560743+0000","last_active":"2024-09-18T02:04:36.369051+0000","last_peered":"2024-09-18T02:04:36.369051+0000","last_clean":"2024-09-18T02:04:36.369051+0000","last_became_active":"2024-09-18T02:04:01.560471+0000","last_became_peered":"2024-09-18T02:04:01.560471+0000","last_unstale":"2024-09-18T02:04:36.369051+0000","last_undegraded":"2024-09-18T02:04:36.369051+0000","last_fullsized":"2024-09-18T02:04:36.369051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:05.940301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.783060+0000","last_change":"2024-09-18T02:04:03.589654+0000","last_active":"2024-09-18T02:07:11.783060+0000","last_peered":"2024-09-18T02:07:11.783060+0000","last_clean":"2024-09-18T02:07:11.783060+0000","last_became_active":"2024-09-18T02:04:03.588913+0000","last_became_peered":"2024-09-18T02:04:03.588913+0000","last_unstale":"2024-09-18T02:07:11.783060+0000","last_undegraded":"2024-09-18T02:07:11.783060+0000","last_fullsized":"2024-09-18T02:07:11.783060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:24.835730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339832+0000","last_change":"2024-09-18T02:04:05.589310+0000","last_active":"2024-09-18T02:04:36.339832+0000","last_peered":"2024-09-18T02:04:36.339832+0000","last_clean":"2024-09-18T02:04:36.339832+0000","last_became_active":"2024-09-18T02:04:05.588457+0000","last_became_peered":"2024-09-18T02:04:05.588457+0000","last_unstale":"2024-09-18T02:04:36.339832+0000","last_undegraded":"2024-09-18T02:04:36.339832+0000","last_fullsized":"2024-09-18T02:04:36.339832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:27.971023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348229+0000","last_change":"2024-09-18T02:04:07.622460+0000","last_active":"2024-09-18T02:04:36.348229+0000","last_peered":"2024-09-18T02:04:36.348229+0000","last_clean":"2024-09-18T02:04:36.348229+0000","last_became_active":"2024-09-18T02:04:07.621651+0000","last_became_peered":"2024-09-18T02:04:07.621651+0000","last_unstale":"2024-09-18T02:04:36.348229+0000","last_undegraded":"2024-09-18T02:04:36.348229+0000","last_fullsized":"2024-09-18T02:04:36.348229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:58.105568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342749+0000","last_change":"2024-09-18T02:03:59.536526+0000","last_active":"2024-09-18T02:04:36.342749+0000","last_peered":"2024-09-18T02:04:36.342749+0000","last_clean":"2024-09-18T02:04:36.342749+0000","last_became_active":"2024-09-18T02:03:59.535693+0000","last_became_peered":"2024-09-18T02:03:59.535693+0000","last_unstale":"2024-09-18T02:04:36.342749+0000","last_undegraded":"2024-09-18T02:04:36.342749+0000","last_fullsized":"2024-09-18T02:04:36.342749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:45.343721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348980+0000","last_change":"2024-09-18T02:03:50.287790+0000","last_active":"2024-09-18T02:04:36.348980+0000","last_peered":"2024-09-18T02:04:36.348980+0000","last_clean":"2024-09-18T02:04:36.348980+0000","last_became_active":"2024-09-18T02:03:48.276543+0000","last_became_peered":"2024-09-18T02:03:48.276543+0000","last_unstale":"2024-09-18T02:04:36.348980+0000","last_undegraded":"2024-09-18T02:04:36.348980+0000","last_fullsized":"2024-09-18T02:04:36.348980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:17.356845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023330579999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.344795+0000","last_change":"2024-09-18T02:03:57.529138+0000","last_active":"2024-09-18T02:04:36.344795+0000","last_peered":"2024-09-18T02:04:36.344795+0000","last_clean":"2024-09-18T02:04:36.344795+0000","last_became_active":"2024-09-18T02:03:57.528828+0000","last_became_peered":"2024-09-18T02:03:57.528828+0000","last_unstale":"2024-09-18T02:04:36.344795+0000","last_undegraded":"2024-09-18T02:04:36.344795+0000","last_fullsized":"2024-09-18T02:04:36.344795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:40.008713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342804+0000","last_change":"2024-09-18T02:04:01.572278+0000","last_active":"2024-09-18T02:04:36.342804+0000","last_peered":"2024-09-18T02:04:36.342804+0000","last_clean":"2024-09-18T02:04:36.342804+0000","last_became_active":"2024-09-18T02:04:01.571608+0000","last_became_peered":"2024-09-18T02:04:01.571608+0000","last_unstale":"2024-09-18T02:04:36.342804+0000","last_undegraded":"2024-09-18T02:04:36.342804+0000","last_fullsized":"2024-09-18T02:04:36.342804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:01.789731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.140114+0000","last_change":"2024-09-18T02:04:03.602343+0000","last_active":"2024-09-18T02:07:11.140114+0000","last_peered":"2024-09-18T02:07:11.140114+0000","last_clean":"2024-09-18T02:07:11.140114+0000","last_became_active":"2024-09-18T02:04:03.601140+0000","last_became_peered":"2024-09-18T02:04:03.601140+0000","last_unstale":"2024-09-18T02:07:11.140114+0000","last_undegraded":"2024-09-18T02:07:11.140114+0000","last_fullsized":"2024-09-18T02:07:11.140114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:33:06.804055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358317+0000","last_change":"2024-09-18T02:04:05.612576+0000","last_active":"2024-09-18T02:04:36.358317+0000","last_peered":"2024-09-18T02:04:36.358317+0000","last_clean":"2024-09-18T02:04:36.358317+0000","last_became_active":"2024-09-18T02:04:05.612007+0000","last_became_peered":"2024-09-18T02:04:05.612007+0000","last_unstale":"2024-09-18T02:04:36.358317+0000","last_undegraded":"2024-09-18T02:04:36.358317+0000","last_fullsized":"2024-09-18T02:04:36.358317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:53:26.368935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.716259+0000","last_change":"2024-09-18T02:04:07.623097+0000","last_active":"2024-09-18T02:06:10.716259+0000","last_peered":"2024-09-18T02:06:10.716259+0000","last_clean":"2024-09-18T02:06:10.716259+0000","last_became_active":"2024-09-18T02:04:07.622247+0000","last_became_peered":"2024-09-18T02:04:07.622247+0000","last_unstale":"2024-09-18T02:06:10.716259+0000","last_undegraded":"2024-09-18T02:06:10.716259+0000","last_fullsized":"2024-09-18T02:06:10.716259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:17.300649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.954084+0000","last_change":"2024-09-18T02:03:59.560066+0000","last_active":"2024-09-18T02:06:06.954084+0000","last_peered":"2024-09-18T02:06:06.954084+0000","last_clean":"2024-09-18T02:06:06.954084+0000","last_became_active":"2024-09-18T02:03:59.559749+0000","last_became_peered":"2024-09-18T02:03:59.559749+0000","last_unstale":"2024-09-18T02:06:06.954084+0000","last_undegraded":"2024-09-18T02:06:06.954084+0000","last_fullsized":"2024-09-18T02:06:06.954084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364329+0000","last_change":"2024-09-18T02:03:57.524455+0000","last_active":"2024-09-18T02:04:36.364329+0000","last_peered":"2024-09-18T02:04:36.364329+0000","last_clean":"2024-09-18T02:04:36.364329+0000","last_became_active":"2024-09-18T02:03:57.519961+0000","last_became_peered":"2024-09-18T02:03:57.519961+0000","last_unstale":"2024-09-18T02:04:36.364329+0000","last_undegraded":"2024-09-18T02:04:36.364329+0000","last_fullsized":"2024-09-18T02:04:36.364329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:59.657833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339529+0000","last_change":"2024-09-18T02:03:50.282381+0000","last_active":"2024-09-18T02:04:36.339529+0000","last_peered":"2024-09-18T02:04:36.339529+0000","last_clean":"2024-09-18T02:04:36.339529+0000","last_became_active":"2024-09-18T02:03:48.274657+0000","last_became_peered":"2024-09-18T02:03:48.274657+0000","last_unstale":"2024-09-18T02:04:36.339529+0000","last_undegraded":"2024-09-18T02:04:36.339529+0000","last_fullsized":"2024-09-18T02:04:36.339529+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000970169,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329258+0000","last_change":"2024-09-18T02:04:01.572119+0000","last_active":"2024-09-18T02:06:06.329258+0000","last_peered":"2024-09-18T02:06:06.329258+0000","last_clean":"2024-09-18T02:06:06.329258+0000","last_became_active":"2024-09-18T02:04:01.571443+0000","last_became_peered":"2024-09-18T02:04:01.571443+0000","last_unstale":"2024-09-18T02:06:06.329258+0000","last_undegraded":"2024-09-18T02:06:06.329258+0000","last_fullsized":"2024-09-18T02:06:06.329258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:30:51.643126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'75","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.141667+0000","last_change":"2024-09-18T02:04:03.570750+0000","last_active":"2024-09-18T02:06:09.141667+0000","last_peered":"2024-09-18T02:06:09.141667+0000","last_clean":"2024-09-18T02:06:09.141667+0000","last_became_active":"2024-09-18T02:04:03.569938+0000","last_became_peered":"2024-09-18T02:04:03.569938+0000","last_unstale":"2024-09-18T02:06:09.141667+0000","last_undegraded":"2024-09-18T02:06:09.141667+0000","last_fullsized":"2024-09-18T02:06:09.141667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:24:06.892910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341836+0000","last_change":"2024-09-18T02:04:05.600403+0000","last_active":"2024-09-18T02:04:36.341836+0000","last_peered":"2024-09-18T02:04:36.341836+0000","last_clean":"2024-09-18T02:04:36.341836+0000","last_became_active":"2024-09-18T02:04:05.597181+0000","last_became_peered":"2024-09-18T02:04:05.597181+0000","last_unstale":"2024-09-18T02:04:36.341836+0000","last_undegraded":"2024-09-18T02:04:36.341836+0000","last_fullsized":"2024-09-18T02:04:36.341836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:34.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.978758+0000","last_change":"2024-09-18T02:04:07.619359+0000","last_active":"2024-09-18T02:06:10.978758+0000","last_peered":"2024-09-18T02:06:10.978758+0000","last_clean":"2024-09-18T02:06:10.978758+0000","last_became_active":"2024-09-18T02:04:07.618751+0000","last_became_peered":"2024-09-18T02:04:07.618751+0000","last_unstale":"2024-09-18T02:06:10.978758+0000","last_undegraded":"2024-09-18T02:06:10.978758+0000","last_fullsized":"2024-09-18T02:06:10.978758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:46.149767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.133793+0000","last_change":"2024-09-18T02:03:59.554002+0000","last_active":"2024-09-18T02:04:42.133793+0000","last_peered":"2024-09-18T02:04:42.133793+0000","last_clean":"2024-09-18T02:04:42.133793+0000","last_became_active":"2024-09-18T02:03:59.553619+0000","last_became_peered":"2024-09-18T02:03:59.553619+0000","last_unstale":"2024-09-18T02:04:42.133793+0000","last_undegraded":"2024-09-18T02:04:42.133793+0000","last_fullsized":"2024-09-18T02:04:42.133793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:31:07.318399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.915234+0000","last_change":"2024-09-18T02:03:57.519164+0000","last_active":"2024-09-18T02:04:42.915234+0000","last_peered":"2024-09-18T02:04:42.915234+0000","last_clean":"2024-09-18T02:04:42.915234+0000","last_became_active":"2024-09-18T02:03:57.518503+0000","last_became_peered":"2024-09-18T02:03:57.518503+0000","last_unstale":"2024-09-18T02:04:42.915234+0000","last_undegraded":"2024-09-18T02:04:42.915234+0000","last_fullsized":"2024-09-18T02:04:42.915234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:32.979432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353911+0000","last_change":"2024-09-18T02:03:50.288345+0000","last_active":"2024-09-18T02:04:36.353911+0000","last_peered":"2024-09-18T02:04:36.353911+0000","last_clean":"2024-09-18T02:04:36.353911+0000","last_became_active":"2024-09-18T02:03:48.276300+0000","last_became_peered":"2024-09-18T02:03:48.276300+0000","last_unstale":"2024-09-18T02:04:36.353911+0000","last_undegraded":"2024-09-18T02:04:36.353911+0000","last_fullsized":"2024-09-18T02:04:36.353911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:57.432759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002788245,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349422+0000","last_change":"2024-09-18T02:04:01.558361+0000","last_active":"2024-09-18T02:04:36.349422+0000","last_peered":"2024-09-18T02:04:36.349422+0000","last_clean":"2024-09-18T02:04:36.349422+0000","last_became_active":"2024-09-18T02:04:01.557570+0000","last_became_peered":"2024-09-18T02:04:01.557570+0000","last_unstale":"2024-09-18T02:04:36.349422+0000","last_undegraded":"2024-09-18T02:04:36.349422+0000","last_fullsized":"2024-09-18T02:04:36.349422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:35:33.472211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340131+0000","last_change":"2024-09-18T02:04:03.589283+0000","last_active":"2024-09-18T02:04:36.340131+0000","last_peered":"2024-09-18T02:04:36.340131+0000","last_clean":"2024-09-18T02:04:36.340131+0000","last_became_active":"2024-09-18T02:04:03.588539+0000","last_became_peered":"2024-09-18T02:04:03.588539+0000","last_unstale":"2024-09-18T02:04:36.340131+0000","last_undegraded":"2024-09-18T02:04:36.340131+0000","last_fullsized":"2024-09-18T02:04:36.340131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:11.364586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":347,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.782214+0000","last_change":"2024-09-18T02:04:05.583286+0000","last_active":"2024-09-18T02:07:11.782214+0000","last_peered":"2024-09-18T02:07:11.782214+0000","last_clean":"2024-09-18T02:07:11.782214+0000","last_became_active":"2024-09-18T02:04:05.582477+0000","last_became_peered":"2024-09-18T02:04:05.582477+0000","last_unstale":"2024-09-18T02:07:11.782214+0000","last_undegraded":"2024-09-18T02:07:11.782214+0000","last_fullsized":"2024-09-18T02:07:11.782214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:54.620838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.110007+0000","last_change":"2024-09-18T02:04:07.606623+0000","last_active":"2024-09-18T02:06:11.110007+0000","last_peered":"2024-09-18T02:06:11.110007+0000","last_clean":"2024-09-18T02:06:11.110007+0000","last_became_active":"2024-09-18T02:04:07.605591+0000","last_became_peered":"2024-09-18T02:04:07.605591+0000","last_unstale":"2024-09-18T02:06:11.110007+0000","last_undegraded":"2024-09-18T02:06:11.110007+0000","last_fullsized":"2024-09-18T02:06:11.110007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:37.470495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999320+0000","last_change":"2024-09-18T02:03:59.559409+0000","last_active":"2024-09-18T02:05:25.999320+0000","last_peered":"2024-09-18T02:05:25.999320+0000","last_clean":"2024-09-18T02:05:25.999320+0000","last_became_active":"2024-09-18T02:03:59.559044+0000","last_became_peered":"2024-09-18T02:03:59.559044+0000","last_unstale":"2024-09-18T02:05:25.999320+0000","last_undegraded":"2024-09-18T02:05:25.999320+0000","last_fullsized":"2024-09-18T02:05:25.999320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:14.041290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.362611+0000","last_change":"2024-09-18T02:03:57.522060+0000","last_active":"2024-09-18T02:04:36.362611+0000","last_peered":"2024-09-18T02:04:36.362611+0000","last_clean":"2024-09-18T02:04:36.362611+0000","last_became_active":"2024-09-18T02:03:57.521706+0000","last_became_peered":"2024-09-18T02:03:57.521706+0000","last_unstale":"2024-09-18T02:04:36.362611+0000","last_undegraded":"2024-09-18T02:04:36.362611+0000","last_fullsized":"2024-09-18T02:04:36.362611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:43.330210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342536+0000","last_change":"2024-09-18T02:03:50.282549+0000","last_active":"2024-09-18T02:04:36.342536+0000","last_peered":"2024-09-18T02:04:36.342536+0000","last_clean":"2024-09-18T02:04:36.342536+0000","last_became_active":"2024-09-18T02:03:48.274030+0000","last_became_peered":"2024-09-18T02:03:48.274030+0000","last_unstale":"2024-09-18T02:04:36.342536+0000","last_undegraded":"2024-09-18T02:04:36.342536+0000","last_fullsized":"2024-09-18T02:04:36.342536+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:21:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011092910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349976+0000","last_change":"2024-09-18T02:04:01.559241+0000","last_active":"2024-09-18T02:04:36.349976+0000","last_peered":"2024-09-18T02:04:36.349976+0000","last_clean":"2024-09-18T02:04:36.349976+0000","last_became_active":"2024-09-18T02:04:01.558915+0000","last_became_peered":"2024-09-18T02:04:01.558915+0000","last_unstale":"2024-09-18T02:04:36.349976+0000","last_undegraded":"2024-09-18T02:04:36.349976+0000","last_fullsized":"2024-09-18T02:04:36.349976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:22.220646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350138+0000","last_change":"2024-09-18T02:04:03.595150+0000","last_active":"2024-09-18T02:04:36.350138+0000","last_peered":"2024-09-18T02:04:36.350138+0000","last_clean":"2024-09-18T02:04:36.350138+0000","last_became_active":"2024-09-18T02:04:03.591378+0000","last_became_peered":"2024-09-18T02:04:03.591378+0000","last_unstale":"2024-09-18T02:04:36.350138+0000","last_undegraded":"2024-09-18T02:04:36.350138+0000","last_fullsized":"2024-09-18T02:04:36.350138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:37.068150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.377867+0000","last_change":"2024-09-18T02:04:05.605812+0000","last_active":"2024-09-18T02:07:12.377867+0000","last_peered":"2024-09-18T02:07:12.377867+0000","last_clean":"2024-09-18T02:07:12.377867+0000","last_became_active":"2024-09-18T02:04:05.605265+0000","last_became_peered":"2024-09-18T02:04:05.605265+0000","last_unstale":"2024-09-18T02:07:12.377867+0000","last_undegraded":"2024-09-18T02:07:12.377867+0000","last_fullsized":"2024-09-18T02:07:12.377867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:35:37.505766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.963901+0000","last_change":"2024-09-18T02:04:07.624755+0000","last_active":"2024-09-18T02:06:06.963901+0000","last_peered":"2024-09-18T02:06:06.963901+0000","last_clean":"2024-09-18T02:06:06.963901+0000","last_became_active":"2024-09-18T02:04:07.624085+0000","last_became_peered":"2024-09-18T02:04:07.624085+0000","last_unstale":"2024-09-18T02:06:06.963901+0000","last_undegraded":"2024-09-18T02:06:06.963901+0000","last_fullsized":"2024-09-18T02:06:06.963901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:22.537224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340548+0000","last_change":"2024-09-18T02:03:59.535655+0000","last_active":"2024-09-18T02:04:36.340548+0000","last_peered":"2024-09-18T02:04:36.340548+0000","last_clean":"2024-09-18T02:04:36.340548+0000","last_became_active":"2024-09-18T02:03:59.535266+0000","last_became_peered":"2024-09-18T02:03:59.535266+0000","last_unstale":"2024-09-18T02:04:36.340548+0000","last_undegraded":"2024-09-18T02:04:36.340548+0000","last_fullsized":"2024-09-18T02:04:36.340548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.342844+0000","last_change":"2024-09-18T02:03:57.529076+0000","last_active":"2024-09-18T02:04:41.342844+0000","last_peered":"2024-09-18T02:04:41.342844+0000","last_clean":"2024-09-18T02:04:41.342844+0000","last_became_active":"2024-09-18T02:03:57.528676+0000","last_became_peered":"2024-09-18T02:03:57.528676+0000","last_unstale":"2024-09-18T02:04:41.342844+0000","last_undegraded":"2024-09-18T02:04:41.342844+0000","last_fullsized":"2024-09-18T02:04:41.342844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358547+0000","last_change":"2024-09-18T02:03:50.288611+0000","last_active":"2024-09-18T02:04:36.358547+0000","last_peered":"2024-09-18T02:04:36.358547+0000","last_clean":"2024-09-18T02:04:36.358547+0000","last_became_active":"2024-09-18T02:03:48.396609+0000","last_became_peered":"2024-09-18T02:03:48.396609+0000","last_unstale":"2024-09-18T02:04:36.358547+0000","last_undegraded":"2024-09-18T02:04:36.358547+0000","last_fullsized":"2024-09-18T02:04:36.358547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:40:52.248589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025902970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348392+0000","last_change":"2024-09-18T02:04:01.562114+0000","last_active":"2024-09-18T02:04:36.348392+0000","last_peered":"2024-09-18T02:04:36.348392+0000","last_clean":"2024-09-18T02:04:36.348392+0000","last_became_active":"2024-09-18T02:04:01.561488+0000","last_became_peered":"2024-09-18T02:04:01.561488+0000","last_unstale":"2024-09-18T02:04:36.348392+0000","last_undegraded":"2024-09-18T02:04:36.348392+0000","last_fullsized":"2024-09-18T02:04:36.348392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:00.270005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'88","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.119183+0000","last_change":"2024-09-18T02:04:03.586693+0000","last_active":"2024-09-18T02:06:09.119183+0000","last_peered":"2024-09-18T02:06:09.119183+0000","last_clean":"2024-09-18T02:06:09.119183+0000","last_became_active":"2024-09-18T02:04:03.585879+0000","last_became_peered":"2024-09-18T02:04:03.585879+0000","last_unstale":"2024-09-18T02:06:09.119183+0000","last_undegraded":"2024-09-18T02:06:09.119183+0000","last_fullsized":"2024-09-18T02:06:09.119183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:19.044304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342766+0000","last_change":"2024-09-18T02:04:05.589374+0000","last_active":"2024-09-18T02:04:36.342766+0000","last_peered":"2024-09-18T02:04:36.342766+0000","last_clean":"2024-09-18T02:04:36.342766+0000","last_became_active":"2024-09-18T02:04:05.588676+0000","last_became_peered":"2024-09-18T02:04:05.588676+0000","last_unstale":"2024-09-18T02:04:36.342766+0000","last_undegraded":"2024-09-18T02:04:36.342766+0000","last_fullsized":"2024-09-18T02:04:36.342766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:18.118339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.995352+0000","last_change":"2024-09-18T02:04:07.620173+0000","last_active":"2024-09-18T02:05:25.995352+0000","last_peered":"2024-09-18T02:05:25.995352+0000","last_clean":"2024-09-18T02:05:25.995352+0000","last_became_active":"2024-09-18T02:04:07.619587+0000","last_became_peered":"2024-09-18T02:04:07.619587+0000","last_unstale":"2024-09-18T02:05:25.995352+0000","last_undegraded":"2024-09-18T02:05:25.995352+0000","last_fullsized":"2024-09-18T02:05:25.995352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:28.267582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.362280+0000","last_change":"2024-09-18T02:04:07.628261+0000","last_active":"2024-09-18T02:04:36.362280+0000","last_peered":"2024-09-18T02:04:36.362280+0000","last_clean":"2024-09-18T02:04:36.362280+0000","last_became_active":"2024-09-18T02:04:07.626396+0000","last_became_peered":"2024-09-18T02:04:07.626396+0000","last_unstale":"2024-09-18T02:04:36.362280+0000","last_undegraded":"2024-09-18T02:04:36.362280+0000","last_fullsized":"2024-09-18T02:04:36.362280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:06.316942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.334934+0000","last_change":"2024-09-18T02:03:59.538659+0000","last_active":"2024-09-18T02:06:21.334934+0000","last_peered":"2024-09-18T02:06:21.334934+0000","last_clean":"2024-09-18T02:06:21.334934+0000","last_became_active":"2024-09-18T02:03:59.538280+0000","last_became_peered":"2024-09-18T02:03:59.538280+0000","last_unstale":"2024-09-18T02:06:21.334934+0000","last_undegraded":"2024-09-18T02:06:21.334934+0000","last_fullsized":"2024-09-18T02:06:21.334934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353217+0000","last_change":"2024-09-18T02:03:57.531366+0000","last_active":"2024-09-18T02:04:36.353217+0000","last_peered":"2024-09-18T02:04:36.353217+0000","last_clean":"2024-09-18T02:04:36.353217+0000","last_became_active":"2024-09-18T02:03:57.530751+0000","last_became_peered":"2024-09-18T02:03:57.530751+0000","last_unstale":"2024-09-18T02:04:36.353217+0000","last_undegraded":"2024-09-18T02:04:36.353217+0000","last_fullsized":"2024-09-18T02:04:36.353217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:13.572982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339720+0000","last_change":"2024-09-18T02:04:01.561923+0000","last_active":"2024-09-18T02:04:36.339720+0000","last_peered":"2024-09-18T02:04:36.339720+0000","last_clean":"2024-09-18T02:04:36.339720+0000","last_became_active":"2024-09-18T02:04:01.561230+0000","last_became_peered":"2024-09-18T02:04:01.561230+0000","last_unstale":"2024-09-18T02:04:36.339720+0000","last_undegraded":"2024-09-18T02:04:36.339720+0000","last_fullsized":"2024-09-18T02:04:36.339720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:33.717350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.128263+0000","last_change":"2024-09-18T02:04:03.595872+0000","last_active":"2024-09-18T02:06:09.128263+0000","last_peered":"2024-09-18T02:06:09.128263+0000","last_clean":"2024-09-18T02:06:09.128263+0000","last_became_active":"2024-09-18T02:04:03.595284+0000","last_became_peered":"2024-09-18T02:04:03.595284+0000","last_unstale":"2024-09-18T02:06:09.128263+0000","last_undegraded":"2024-09-18T02:06:09.128263+0000","last_fullsized":"2024-09-18T02:06:09.128263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:04.625050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348172+0000","last_change":"2024-09-18T02:04:05.603244+0000","last_active":"2024-09-18T02:04:36.348172+0000","last_peered":"2024-09-18T02:04:36.348172+0000","last_clean":"2024-09-18T02:04:36.348172+0000","last_became_active":"2024-09-18T02:04:05.602528+0000","last_became_peered":"2024-09-18T02:04:05.602528+0000","last_unstale":"2024-09-18T02:04:36.348172+0000","last_undegraded":"2024-09-18T02:04:36.348172+0000","last_fullsized":"2024-09-18T02:04:36.348172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:08:44.924870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:08.724227+0000","last_change":"2024-09-18T02:04:07.623315+0000","last_active":"2024-09-18T02:06:08.724227+0000","last_peered":"2024-09-18T02:06:08.724227+0000","last_clean":"2024-09-18T02:06:08.724227+0000","last_became_active":"2024-09-18T02:04:07.622753+0000","last_became_peered":"2024-09-18T02:04:07.622753+0000","last_unstale":"2024-09-18T02:06:08.724227+0000","last_undegraded":"2024-09-18T02:06:08.724227+0000","last_fullsized":"2024-09-18T02:06:08.724227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:08:47.142951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'9","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.090383+0000","last_change":"2024-09-18T02:03:59.555234+0000","last_active":"2024-09-18T02:07:12.090383+0000","last_peered":"2024-09-18T02:07:12.090383+0000","last_clean":"2024-09-18T02:07:12.090383+0000","last_became_active":"2024-09-18T02:03:59.554803+0000","last_became_peered":"2024-09-18T02:03:59.554803+0000","last_unstale":"2024-09-18T02:07:12.090383+0000","last_undegraded":"2024-09-18T02:07:12.090383+0000","last_fullsized":"2024-09-18T02:07:12.090383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364065+0000","last_change":"2024-09-18T02:03:57.522614+0000","last_active":"2024-09-18T02:04:36.364065+0000","last_peered":"2024-09-18T02:04:36.364065+0000","last_clean":"2024-09-18T02:04:36.364065+0000","last_became_active":"2024-09-18T02:03:57.519403+0000","last_became_peered":"2024-09-18T02:03:57.519403+0000","last_unstale":"2024-09-18T02:04:36.364065+0000","last_undegraded":"2024-09-18T02:04:36.364065+0000","last_fullsized":"2024-09-18T02:04:36.364065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.351923+0000","last_change":"2024-09-18T02:04:01.561432+0000","last_active":"2024-09-18T02:04:36.351923+0000","last_peered":"2024-09-18T02:04:36.351923+0000","last_clean":"2024-09-18T02:04:36.351923+0000","last_became_active":"2024-09-18T02:04:01.558788+0000","last_became_peered":"2024-09-18T02:04:01.558788+0000","last_unstale":"2024-09-18T02:04:36.351923+0000","last_undegraded":"2024-09-18T02:04:36.351923+0000","last_fullsized":"2024-09-18T02:04:36.351923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:11.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.150563+0000","last_change":"2024-09-18T02:04:03.581820+0000","last_active":"2024-09-18T02:07:11.150563+0000","last_peered":"2024-09-18T02:07:11.150563+0000","last_clean":"2024-09-18T02:07:11.150563+0000","last_became_active":"2024-09-18T02:04:03.581045+0000","last_became_peered":"2024-09-18T02:04:03.581045+0000","last_unstale":"2024-09-18T02:07:11.150563+0000","last_undegraded":"2024-09-18T02:07:11.150563+0000","last_fullsized":"2024-09-18T02:07:11.150563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:58.075420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341472+0000","last_change":"2024-09-18T02:04:05.600005+0000","last_active":"2024-09-18T02:04:36.341472+0000","last_peered":"2024-09-18T02:04:36.341472+0000","last_clean":"2024-09-18T02:04:36.341472+0000","last_became_active":"2024-09-18T02:04:05.599064+0000","last_became_peered":"2024-09-18T02:04:05.599064+0000","last_unstale":"2024-09-18T02:04:36.341472+0000","last_undegraded":"2024-09-18T02:04:36.341472+0000","last_fullsized":"2024-09-18T02:04:36.341472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:24:08.906433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339501+0000","last_change":"2024-09-18T02:04:07.610644+0000","last_active":"2024-09-18T02:04:36.339501+0000","last_peered":"2024-09-18T02:04:36.339501+0000","last_clean":"2024-09-18T02:04:36.339501+0000","last_became_active":"2024-09-18T02:04:07.609954+0000","last_became_peered":"2024-09-18T02:04:07.609954+0000","last_unstale":"2024-09-18T02:04:36.339501+0000","last_undegraded":"2024-09-18T02:04:36.339501+0000","last_fullsized":"2024-09-18T02:04:36.339501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:07:58.304562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089718+0000","last_change":"2024-09-18T02:03:59.550899+0000","last_active":"2024-09-18T02:07:12.089718+0000","last_peered":"2024-09-18T02:07:12.089718+0000","last_clean":"2024-09-18T02:07:12.089718+0000","last_became_active":"2024-09-18T02:03:59.549791+0000","last_became_peered":"2024-09-18T02:03:59.549791+0000","last_unstale":"2024-09-18T02:07:12.089718+0000","last_undegraded":"2024-09-18T02:07:12.089718+0000","last_fullsized":"2024-09-18T02:07:12.089718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.372750+0000","last_change":"2024-09-18T02:04:36.371010+0000","last_active":"2024-09-18T02:04:36.372750+0000","last_peered":"2024-09-18T02:04:36.372750+0000","last_clean":"2024-09-18T02:04:36.372750+0000","last_became_active":"2024-09-18T02:04:36.370188+0000","last_became_peered":"2024-09-18T02:04:36.370188+0000","last_unstale":"2024-09-18T02:04:36.372750+0000","last_undegraded":"2024-09-18T02:04:36.372750+0000","last_fullsized":"2024-09-18T02:04:36.372750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:09.187217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339915+0000","last_change":"2024-09-18T02:04:01.563073+0000","last_active":"2024-09-18T02:04:36.339915+0000","last_peered":"2024-09-18T02:04:36.339915+0000","last_clean":"2024-09-18T02:04:36.339915+0000","last_became_active":"2024-09-18T02:04:01.562586+0000","last_became_peered":"2024-09-18T02:04:01.562586+0000","last_unstale":"2024-09-18T02:04:36.339915+0000","last_undegraded":"2024-09-18T02:04:36.339915+0000","last_fullsized":"2024-09-18T02:04:36.339915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:14.943821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'42","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.236537+0000","last_change":"2024-09-18T02:04:03.579212+0000","last_active":"2024-09-18T02:07:11.236537+0000","last_peered":"2024-09-18T02:07:11.236537+0000","last_clean":"2024-09-18T02:07:11.236537+0000","last_became_active":"2024-09-18T02:04:03.578581+0000","last_became_peered":"2024-09-18T02:04:03.578581+0000","last_unstale":"2024-09-18T02:07:11.236537+0000","last_undegraded":"2024-09-18T02:07:11.236537+0000","last_fullsized":"2024-09-18T02:07:11.236537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:17.779908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338314+0000","last_change":"2024-09-18T02:04:05.587685+0000","last_active":"2024-09-18T02:04:36.338314+0000","last_peered":"2024-09-18T02:04:36.338314+0000","last_clean":"2024-09-18T02:04:36.338314+0000","last_became_active":"2024-09-18T02:04:05.586978+0000","last_became_peered":"2024-09-18T02:04:05.586978+0000","last_unstale":"2024-09-18T02:04:36.338314+0000","last_undegraded":"2024-09-18T02:04:36.338314+0000","last_fullsized":"2024-09-18T02:04:36.338314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:36.991801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.935106+0000","last_change":"2024-09-18T02:04:07.611859+0000","last_active":"2024-09-18T02:04:42.935106+0000","last_peered":"2024-09-18T02:04:42.935106+0000","last_clean":"2024-09-18T02:04:42.935106+0000","last_became_active":"2024-09-18T02:04:07.607227+0000","last_became_peered":"2024-09-18T02:04:07.607227+0000","last_unstale":"2024-09-18T02:04:42.935106+0000","last_undegraded":"2024-09-18T02:04:42.935106+0000","last_fullsized":"2024-09-18T02:04:42.935106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:15.944064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.303117+0000","last_change":"2024-09-18T02:03:59.550610+0000","last_active":"2024-09-18T02:05:26.303117+0000","last_peered":"2024-09-18T02:05:26.303117+0000","last_clean":"2024-09-18T02:05:26.303117+0000","last_became_active":"2024-09-18T02:03:59.550221+0000","last_became_peered":"2024-09-18T02:03:59.550221+0000","last_unstale":"2024-09-18T02:05:26.303117+0000","last_undegraded":"2024-09-18T02:05:26.303117+0000","last_fullsized":"2024-09-18T02:05:26.303117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:20.801441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342516+0000","last_change":"2024-09-18T02:03:57.523727+0000","last_active":"2024-09-18T02:04:36.342516+0000","last_peered":"2024-09-18T02:04:36.342516+0000","last_clean":"2024-09-18T02:04:36.342516+0000","last_became_active":"2024-09-18T02:03:57.522590+0000","last_became_peered":"2024-09-18T02:03:57.522590+0000","last_unstale":"2024-09-18T02:04:36.342516+0000","last_undegraded":"2024-09-18T02:04:36.342516+0000","last_fullsized":"2024-09-18T02:04:36.342516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350028+0000","last_change":"2024-09-18T02:04:01.566731+0000","last_active":"2024-09-18T02:04:36.350028+0000","last_peered":"2024-09-18T02:04:36.350028+0000","last_clean":"2024-09-18T02:04:36.350028+0000","last_became_active":"2024-09-18T02:04:01.566205+0000","last_became_peered":"2024-09-18T02:04:01.566205+0000","last_unstale":"2024-09-18T02:04:36.350028+0000","last_undegraded":"2024-09-18T02:04:36.350028+0000","last_fullsized":"2024-09-18T02:04:36.350028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:56.533384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.106435+0000","last_change":"2024-09-18T02:04:03.581994+0000","last_active":"2024-09-18T02:06:09.106435+0000","last_peered":"2024-09-18T02:06:09.106435+0000","last_clean":"2024-09-18T02:06:09.106435+0000","last_became_active":"2024-09-18T02:04:03.580770+0000","last_became_peered":"2024-09-18T02:04:03.580770+0000","last_unstale":"2024-09-18T02:06:09.106435+0000","last_undegraded":"2024-09-18T02:06:09.106435+0000","last_fullsized":"2024-09-18T02:06:09.106435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:03.809763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354157+0000","last_change":"2024-09-18T02:04:05.597119+0000","last_active":"2024-09-18T02:04:36.354157+0000","last_peered":"2024-09-18T02:04:36.354157+0000","last_clean":"2024-09-18T02:04:36.354157+0000","last_became_active":"2024-09-18T02:04:05.591514+0000","last_became_peered":"2024-09-18T02:04:05.591514+0000","last_unstale":"2024-09-18T02:04:36.354157+0000","last_undegraded":"2024-09-18T02:04:36.354157+0000","last_fullsized":"2024-09-18T02:04:36.354157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:35.071524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217553+0000","last_change":"2024-09-18T02:03:59.554054+0000","last_active":"2024-09-18T02:07:12.217553+0000","last_peered":"2024-09-18T02:07:12.217553+0000","last_clean":"2024-09-18T02:07:12.217553+0000","last_became_active":"2024-09-18T02:03:59.553660+0000","last_became_peered":"2024-09-18T02:03:59.553660+0000","last_unstale":"2024-09-18T02:07:12.217553+0000","last_undegraded":"2024-09-18T02:07:12.217553+0000","last_fullsized":"2024-09-18T02:07:12.217553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:20.271703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.205809+0000","last_change":"2024-09-18T02:03:57.528505+0000","last_active":"2024-09-18T02:07:12.205809+0000","last_peered":"2024-09-18T02:07:12.205809+0000","last_clean":"2024-09-18T02:07:12.205809+0000","last_became_active":"2024-09-18T02:03:57.526941+0000","last_became_peered":"2024-09-18T02:03:57.526941+0000","last_unstale":"2024-09-18T02:07:12.205809+0000","last_undegraded":"2024-09-18T02:07:12.205809+0000","last_fullsized":"2024-09-18T02:07:12.205809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:49.524693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345450+0000","last_change":"2024-09-18T02:04:01.561664+0000","last_active":"2024-09-18T02:04:36.345450+0000","last_peered":"2024-09-18T02:04:36.345450+0000","last_clean":"2024-09-18T02:04:36.345450+0000","last_became_active":"2024-09-18T02:04:01.559839+0000","last_became_peered":"2024-09-18T02:04:01.559839+0000","last_unstale":"2024-09-18T02:04:36.345450+0000","last_undegraded":"2024-09-18T02:04:36.345450+0000","last_fullsized":"2024-09-18T02:04:36.345450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:20.919571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'61","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.137622+0000","last_change":"2024-09-18T02:04:03.582199+0000","last_active":"2024-09-18T02:06:09.137622+0000","last_peered":"2024-09-18T02:06:09.137622+0000","last_clean":"2024-09-18T02:06:09.137622+0000","last_became_active":"2024-09-18T02:04:03.581518+0000","last_became_peered":"2024-09-18T02:04:03.581518+0000","last_unstale":"2024-09-18T02:06:09.137622+0000","last_undegraded":"2024-09-18T02:06:09.137622+0000","last_fullsized":"2024-09-18T02:06:09.137622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:11.364586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.356105+0000","last_change":"2024-09-18T02:04:05.610785+0000","last_active":"2024-09-18T02:04:36.356105+0000","last_peered":"2024-09-18T02:04:36.356105+0000","last_clean":"2024-09-18T02:04:36.356105+0000","last_became_active":"2024-09-18T02:04:05.610007+0000","last_became_peered":"2024-09-18T02:04:05.610007+0000","last_unstale":"2024-09-18T02:04:36.356105+0000","last_undegraded":"2024-09-18T02:04:36.356105+0000","last_fullsized":"2024-09-18T02:04:36.356105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:20.894379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'20","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.266684+0000","last_change":"2024-09-18T02:04:07.610032+0000","last_active":"2024-09-18T02:07:11.266684+0000","last_peered":"2024-09-18T02:07:11.266684+0000","last_clean":"2024-09-18T02:07:11.266684+0000","last_became_active":"2024-09-18T02:04:07.609058+0000","last_became_peered":"2024-09-18T02:04:07.609058+0000","last_unstale":"2024-09-18T02:07:11.266684+0000","last_undegraded":"2024-09-18T02:07:11.266684+0000","last_fullsized":"2024-09-18T02:07:11.266684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:01:06.704072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069945+0000","last_change":"2024-09-18T02:03:59.541759+0000","last_active":"2024-09-18T02:07:12.069945+0000","last_peered":"2024-09-18T02:07:12.069945+0000","last_clean":"2024-09-18T02:07:12.069945+0000","last_became_active":"2024-09-18T02:03:59.540971+0000","last_became_peered":"2024-09-18T02:03:59.540971+0000","last_unstale":"2024-09-18T02:07:12.069945+0000","last_undegraded":"2024-09-18T02:07:12.069945+0000","last_fullsized":"2024-09-18T02:07:12.069945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.343543+0000","last_change":"2024-09-18T02:03:57.519487+0000","last_active":"2024-09-18T02:04:41.343543+0000","last_peered":"2024-09-18T02:04:41.343543+0000","last_clean":"2024-09-18T02:04:41.343543+0000","last_became_active":"2024-09-18T02:03:57.518311+0000","last_became_peered":"2024-09-18T02:03:57.518311+0000","last_unstale":"2024-09-18T02:04:41.343543+0000","last_undegraded":"2024-09-18T02:04:41.343543+0000","last_fullsized":"2024-09-18T02:04:41.343543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:32.993234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364616+0000","last_change":"2024-09-18T02:04:01.564100+0000","last_active":"2024-09-18T02:04:36.364616+0000","last_peered":"2024-09-18T02:04:36.364616+0000","last_clean":"2024-09-18T02:04:36.364616+0000","last_became_active":"2024-09-18T02:04:01.563285+0000","last_became_peered":"2024-09-18T02:04:01.563285+0000","last_unstale":"2024-09-18T02:04:36.364616+0000","last_undegraded":"2024-09-18T02:04:36.364616+0000","last_fullsized":"2024-09-18T02:04:36.364616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:21:50.083821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.107503+0000","last_change":"2024-09-18T02:04:03.600506+0000","last_active":"2024-09-18T02:06:09.107503+0000","last_peered":"2024-09-18T02:06:09.107503+0000","last_clean":"2024-09-18T02:06:09.107503+0000","last_became_active":"2024-09-18T02:04:03.596605+0000","last_became_peered":"2024-09-18T02:04:03.596605+0000","last_unstale":"2024-09-18T02:06:09.107503+0000","last_undegraded":"2024-09-18T02:06:09.107503+0000","last_fullsized":"2024-09-18T02:06:09.107503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:42.407656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346876+0000","last_change":"2024-09-18T02:04:05.589795+0000","last_active":"2024-09-18T02:04:36.346876+0000","last_peered":"2024-09-18T02:04:36.346876+0000","last_clean":"2024-09-18T02:04:36.346876+0000","last_became_active":"2024-09-18T02:04:05.589023+0000","last_became_peered":"2024-09-18T02:04:05.589023+0000","last_unstale":"2024-09-18T02:04:36.346876+0000","last_undegraded":"2024-09-18T02:04:36.346876+0000","last_fullsized":"2024-09-18T02:04:36.346876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:38.266386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348720+0000","last_change":"2024-09-18T02:04:07.625988+0000","last_active":"2024-09-18T02:04:36.348720+0000","last_peered":"2024-09-18T02:04:36.348720+0000","last_clean":"2024-09-18T02:04:36.348720+0000","last_became_active":"2024-09-18T02:04:07.625440+0000","last_became_peered":"2024-09-18T02:04:07.625440+0000","last_unstale":"2024-09-18T02:04:36.348720+0000","last_undegraded":"2024-09-18T02:04:36.348720+0000","last_fullsized":"2024-09-18T02:04:36.348720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:01.797534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.117682+0000","last_change":"2024-09-18T02:03:59.561521+0000","last_active":"2024-09-18T02:06:11.117682+0000","last_peered":"2024-09-18T02:06:11.117682+0000","last_clean":"2024-09-18T02:06:11.117682+0000","last_became_active":"2024-09-18T02:03:59.561208+0000","last_became_peered":"2024-09-18T02:03:59.561208+0000","last_unstale":"2024-09-18T02:06:11.117682+0000","last_undegraded":"2024-09-18T02:06:11.117682+0000","last_fullsized":"2024-09-18T02:06:11.117682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:29.023712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339261+0000","last_change":"2024-09-18T02:03:57.521151+0000","last_active":"2024-09-18T02:04:36.339261+0000","last_peered":"2024-09-18T02:04:36.339261+0000","last_clean":"2024-09-18T02:04:36.339261+0000","last_became_active":"2024-09-18T02:03:57.520569+0000","last_became_peered":"2024-09-18T02:03:57.520569+0000","last_unstale":"2024-09-18T02:04:36.339261+0000","last_undegraded":"2024-09-18T02:04:36.339261+0000","last_fullsized":"2024-09-18T02:04:36.339261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:59:24.420659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358467+0000","last_change":"2024-09-18T02:04:01.566225+0000","last_active":"2024-09-18T02:04:36.358467+0000","last_peered":"2024-09-18T02:04:36.358467+0000","last_clean":"2024-09-18T02:04:36.358467+0000","last_became_active":"2024-09-18T02:04:01.565499+0000","last_became_peered":"2024-09-18T02:04:01.565499+0000","last_unstale":"2024-09-18T02:04:36.358467+0000","last_undegraded":"2024-09-18T02:04:36.358467+0000","last_fullsized":"2024-09-18T02:04:36.358467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:55:01.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.134007+0000","last_change":"2024-09-18T02:04:03.578501+0000","last_active":"2024-09-18T02:06:09.134007+0000","last_peered":"2024-09-18T02:06:09.134007+0000","last_clean":"2024-09-18T02:06:09.134007+0000","last_became_active":"2024-09-18T02:04:03.577841+0000","last_became_peered":"2024-09-18T02:04:03.577841+0000","last_unstale":"2024-09-18T02:06:09.134007+0000","last_undegraded":"2024-09-18T02:06:09.134007+0000","last_fullsized":"2024-09-18T02:06:09.134007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:32.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342393+0000","last_change":"2024-09-18T02:04:05.606498+0000","last_active":"2024-09-18T02:04:36.342393+0000","last_peered":"2024-09-18T02:04:36.342393+0000","last_clean":"2024-09-18T02:04:36.342393+0000","last_became_active":"2024-09-18T02:04:05.605718+0000","last_became_peered":"2024-09-18T02:04:05.605718+0000","last_unstale":"2024-09-18T02:04:36.342393+0000","last_undegraded":"2024-09-18T02:04:36.342393+0000","last_fullsized":"2024-09-18T02:04:36.342393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:15.389313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.105367+0000","last_change":"2024-09-18T02:04:07.621810+0000","last_active":"2024-09-18T02:06:11.105367+0000","last_peered":"2024-09-18T02:06:11.105367+0000","last_clean":"2024-09-18T02:06:11.105367+0000","last_became_active":"2024-09-18T02:04:07.621224+0000","last_became_peered":"2024-09-18T02:04:07.621224+0000","last_unstale":"2024-09-18T02:06:11.105367+0000","last_undegraded":"2024-09-18T02:06:11.105367+0000","last_fullsized":"2024-09-18T02:06:11.105367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:29:24.351329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154739+0000","last_change":"2024-09-18T02:03:59.538977+0000","last_active":"2024-09-18T02:07:12.154739+0000","last_peered":"2024-09-18T02:07:12.154739+0000","last_clean":"2024-09-18T02:07:12.154739+0000","last_became_active":"2024-09-18T02:03:59.536701+0000","last_became_peered":"2024-09-18T02:03:59.536701+0000","last_unstale":"2024-09-18T02:07:12.154739+0000","last_undegraded":"2024-09-18T02:07:12.154739+0000","last_fullsized":"2024-09-18T02:07:12.154739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:31.387691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.950020+0000","last_change":"2024-09-18T02:03:57.528489+0000","last_active":"2024-09-18T02:06:06.950020+0000","last_peered":"2024-09-18T02:06:06.950020+0000","last_clean":"2024-09-18T02:06:06.950020+0000","last_became_active":"2024-09-18T02:03:57.527891+0000","last_became_peered":"2024-09-18T02:03:57.527891+0000","last_unstale":"2024-09-18T02:06:06.950020+0000","last_undegraded":"2024-09-18T02:06:06.950020+0000","last_fullsized":"2024-09-18T02:06:06.950020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:46.827846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346510+0000","last_change":"2024-09-18T02:04:01.565064+0000","last_active":"2024-09-18T02:04:36.346510+0000","last_peered":"2024-09-18T02:04:36.346510+0000","last_clean":"2024-09-18T02:04:36.346510+0000","last_became_active":"2024-09-18T02:04:01.564187+0000","last_became_peered":"2024-09-18T02:04:01.564187+0000","last_unstale":"2024-09-18T02:04:36.346510+0000","last_undegraded":"2024-09-18T02:04:36.346510+0000","last_fullsized":"2024-09-18T02:04:36.346510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:34.109876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.359007+0000","last_change":"2024-09-18T02:04:03.600377+0000","last_active":"2024-09-18T02:04:36.359007+0000","last_peered":"2024-09-18T02:04:36.359007+0000","last_clean":"2024-09-18T02:04:36.359007+0000","last_became_active":"2024-09-18T02:04:03.596273+0000","last_became_peered":"2024-09-18T02:04:03.596273+0000","last_unstale":"2024-09-18T02:04:36.359007+0000","last_undegraded":"2024-09-18T02:04:36.359007+0000","last_fullsized":"2024-09-18T02:04:36.359007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:10.785836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":371,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.401612+0000","last_change":"2024-09-18T02:04:05.604228+0000","last_active":"2024-09-18T02:07:12.401612+0000","last_peered":"2024-09-18T02:07:12.401612+0000","last_clean":"2024-09-18T02:07:12.401612+0000","last_became_active":"2024-09-18T02:04:05.601182+0000","last_became_peered":"2024-09-18T02:04:05.601182+0000","last_unstale":"2024-09-18T02:07:12.401612+0000","last_undegraded":"2024-09-18T02:07:12.401612+0000","last_fullsized":"2024-09-18T02:07:12.401612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:26.319515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'8","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.127197+0000","last_change":"2024-09-18T02:04:07.622167+0000","last_active":"2024-09-18T02:04:42.127197+0000","last_peered":"2024-09-18T02:04:42.127197+0000","last_clean":"2024-09-18T02:04:42.127197+0000","last_became_active":"2024-09-18T02:04:07.621240+0000","last_became_peered":"2024-09-18T02:04:07.621240+0000","last_unstale":"2024-09-18T02:04:42.127197+0000","last_undegraded":"2024-09-18T02:04:42.127197+0000","last_fullsized":"2024-09-18T02:04:42.127197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:44.681571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.866922+0000","last_change":"2024-09-18T02:03:59.536823+0000","last_active":"2024-09-18T02:07:11.866922+0000","last_peered":"2024-09-18T02:07:11.866922+0000","last_clean":"2024-09-18T02:07:11.866922+0000","last_became_active":"2024-09-18T02:03:59.536486+0000","last_became_peered":"2024-09-18T02:03:59.536486+0000","last_unstale":"2024-09-18T02:07:11.866922+0000","last_undegraded":"2024-09-18T02:07:11.866922+0000","last_fullsized":"2024-09-18T02:07:11.866922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:27.777353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348480+0000","last_change":"2024-09-18T02:03:57.520866+0000","last_active":"2024-09-18T02:04:36.348480+0000","last_peered":"2024-09-18T02:04:36.348480+0000","last_clean":"2024-09-18T02:04:36.348480+0000","last_became_active":"2024-09-18T02:03:57.520452+0000","last_became_peered":"2024-09-18T02:03:57.520452+0000","last_unstale":"2024-09-18T02:04:36.348480+0000","last_undegraded":"2024-09-18T02:04:36.348480+0000","last_fullsized":"2024-09-18T02:04:36.348480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341004+0000","last_change":"2024-09-18T02:04:01.564822+0000","last_active":"2024-09-18T02:04:36.341004+0000","last_peered":"2024-09-18T02:04:36.341004+0000","last_clean":"2024-09-18T02:04:36.341004+0000","last_became_active":"2024-09-18T02:04:01.564165+0000","last_became_peered":"2024-09-18T02:04:01.564165+0000","last_unstale":"2024-09-18T02:04:36.341004+0000","last_undegraded":"2024-09-18T02:04:36.341004+0000","last_fullsized":"2024-09-18T02:04:36.341004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:22.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'60","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.093188+0000","last_change":"2024-09-18T02:04:03.567444+0000","last_active":"2024-09-18T02:06:09.093188+0000","last_peered":"2024-09-18T02:06:09.093188+0000","last_clean":"2024-09-18T02:06:09.093188+0000","last_became_active":"2024-09-18T02:04:03.566714+0000","last_became_peered":"2024-09-18T02:04:03.566714+0000","last_unstale":"2024-09-18T02:06:09.093188+0000","last_undegraded":"2024-09-18T02:06:09.093188+0000","last_fullsized":"2024-09-18T02:06:09.093188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:18.880856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.337525+0000","last_change":"2024-09-18T02:04:05.579190+0000","last_active":"2024-09-18T02:04:36.337525+0000","last_peered":"2024-09-18T02:04:36.337525+0000","last_clean":"2024-09-18T02:04:36.337525+0000","last_became_active":"2024-09-18T02:04:05.578635+0000","last_became_peered":"2024-09-18T02:04:05.578635+0000","last_unstale":"2024-09-18T02:04:36.337525+0000","last_undegraded":"2024-09-18T02:04:36.337525+0000","last_fullsized":"2024-09-18T02:04:36.337525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:43.899135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341545+0000","last_change":"2024-09-18T02:04:07.620173+0000","last_active":"2024-09-18T02:04:36.341545+0000","last_peered":"2024-09-18T02:04:36.341545+0000","last_clean":"2024-09-18T02:04:36.341545+0000","last_became_active":"2024-09-18T02:04:07.618696+0000","last_became_peered":"2024-09-18T02:04:07.618696+0000","last_unstale":"2024-09-18T02:04:36.341545+0000","last_undegraded":"2024-09-18T02:04:36.341545+0000","last_fullsized":"2024-09-18T02:04:36.341545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:33.646308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217552+0000","last_change":"2024-09-18T02:03:59.537068+0000","last_active":"2024-09-18T02:07:12.217552+0000","last_peered":"2024-09-18T02:07:12.217552+0000","last_clean":"2024-09-18T02:07:12.217552+0000","last_became_active":"2024-09-18T02:03:59.536693+0000","last_became_peered":"2024-09-18T02:03:59.536693+0000","last_unstale":"2024-09-18T02:07:12.217552+0000","last_undegraded":"2024-09-18T02:07:12.217552+0000","last_fullsized":"2024-09-18T02:07:12.217552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354641+0000","last_change":"2024-09-18T02:03:57.533853+0000","last_active":"2024-09-18T02:04:36.354641+0000","last_peered":"2024-09-18T02:04:36.354641+0000","last_clean":"2024-09-18T02:04:36.354641+0000","last_became_active":"2024-09-18T02:03:57.532963+0000","last_became_peered":"2024-09-18T02:03:57.532963+0000","last_unstale":"2024-09-18T02:04:36.354641+0000","last_undegraded":"2024-09-18T02:04:36.354641+0000","last_fullsized":"2024-09-18T02:04:36.354641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:13.750469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353918+0000","last_change":"2024-09-18T02:04:01.572718+0000","last_active":"2024-09-18T02:04:36.353918+0000","last_peered":"2024-09-18T02:04:36.353918+0000","last_clean":"2024-09-18T02:04:36.353918+0000","last_became_active":"2024-09-18T02:04:01.572089+0000","last_became_peered":"2024-09-18T02:04:01.572089+0000","last_unstale":"2024-09-18T02:04:36.353918+0000","last_undegraded":"2024-09-18T02:04:36.353918+0000","last_fullsized":"2024-09-18T02:04:36.353918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:12.503091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.095516+0000","last_change":"2024-09-18T02:04:03.570795+0000","last_active":"2024-09-18T02:06:09.095516+0000","last_peered":"2024-09-18T02:06:09.095516+0000","last_clean":"2024-09-18T02:06:09.095516+0000","last_became_active":"2024-09-18T02:04:03.569962+0000","last_became_peered":"2024-09-18T02:04:03.569962+0000","last_unstale":"2024-09-18T02:06:09.095516+0000","last_undegraded":"2024-09-18T02:06:09.095516+0000","last_fullsized":"2024-09-18T02:06:09.095516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:48.543679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348236+0000","last_change":"2024-09-18T02:04:05.607210+0000","last_active":"2024-09-18T02:04:36.348236+0000","last_peered":"2024-09-18T02:04:36.348236+0000","last_clean":"2024-09-18T02:04:36.348236+0000","last_became_active":"2024-09-18T02:04:05.606608+0000","last_became_peered":"2024-09-18T02:04:05.606608+0000","last_unstale":"2024-09-18T02:04:36.348236+0000","last_undegraded":"2024-09-18T02:04:36.348236+0000","last_fullsized":"2024-09-18T02:04:36.348236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:24.549074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.355923+0000","last_change":"2024-09-18T02:04:07.609072+0000","last_active":"2024-09-18T02:04:36.355923+0000","last_peered":"2024-09-18T02:04:36.355923+0000","last_clean":"2024-09-18T02:04:36.355923+0000","last_became_active":"2024-09-18T02:04:07.607839+0000","last_became_peered":"2024-09-18T02:04:07.607839+0000","last_unstale":"2024-09-18T02:04:36.355923+0000","last_undegraded":"2024-09-18T02:04:36.355923+0000","last_fullsized":"2024-09-18T02:04:36.355923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:46:07.518628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.969905+0000","last_change":"2024-09-18T02:03:59.550978+0000","last_active":"2024-09-18T02:06:06.969905+0000","last_peered":"2024-09-18T02:06:06.969905+0000","last_clean":"2024-09-18T02:06:06.969905+0000","last_became_active":"2024-09-18T02:03:59.547123+0000","last_became_peered":"2024-09-18T02:03:59.547123+0000","last_unstale":"2024-09-18T02:06:06.969905+0000","last_undegraded":"2024-09-18T02:06:06.969905+0000","last_fullsized":"2024-09-18T02:06:06.969905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:32.095619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343090+0000","last_change":"2024-09-18T02:03:57.530635+0000","last_active":"2024-09-18T02:04:36.343090+0000","last_peered":"2024-09-18T02:04:36.343090+0000","last_clean":"2024-09-18T02:04:36.343090+0000","last_became_active":"2024-09-18T02:03:57.530001+0000","last_became_peered":"2024-09-18T02:03:57.530001+0000","last_unstale":"2024-09-18T02:04:36.343090+0000","last_undegraded":"2024-09-18T02:04:36.343090+0000","last_fullsized":"2024-09-18T02:04:36.343090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:59.657833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339227+0000","last_change":"2024-09-18T02:04:01.571519+0000","last_active":"2024-09-18T02:04:36.339227+0000","last_peered":"2024-09-18T02:04:36.339227+0000","last_clean":"2024-09-18T02:04:36.339227+0000","last_became_active":"2024-09-18T02:04:01.571263+0000","last_became_peered":"2024-09-18T02:04:01.571263+0000","last_unstale":"2024-09-18T02:04:36.339227+0000","last_undegraded":"2024-09-18T02:04:36.339227+0000","last_fullsized":"2024-09-18T02:04:36.339227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:01.789731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'34","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:36.340443+0000","last_change":"2024-09-18T02:04:03.604212+0000","last_active":"2024-09-18T02:06:36.340443+0000","last_peered":"2024-09-18T02:06:36.340443+0000","last_clean":"2024-09-18T02:06:36.340443+0000","last_became_active":"2024-09-18T02:04:03.601392+0000","last_became_peered":"2024-09-18T02:04:03.601392+0000","last_unstale":"2024-09-18T02:06:36.340443+0000","last_undegraded":"2024-09-18T02:06:36.340443+0000","last_fullsized":"2024-09-18T02:06:36.340443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:42.122863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348925+0000","last_change":"2024-09-18T02:04:05.600682+0000","last_active":"2024-09-18T02:04:36.348925+0000","last_peered":"2024-09-18T02:04:36.348925+0000","last_clean":"2024-09-18T02:04:36.348925+0000","last_became_active":"2024-09-18T02:04:05.599964+0000","last_became_peered":"2024-09-18T02:04:05.599964+0000","last_unstale":"2024-09-18T02:04:36.348925+0000","last_undegraded":"2024-09-18T02:04:36.348925+0000","last_fullsized":"2024-09-18T02:04:36.348925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:23.307583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.323902+0000","last_change":"2024-09-18T02:04:07.615961+0000","last_active":"2024-09-18T02:07:12.323902+0000","last_peered":"2024-09-18T02:07:12.323902+0000","last_clean":"2024-09-18T02:07:12.323902+0000","last_became_active":"2024-09-18T02:04:07.615007+0000","last_became_peered":"2024-09-18T02:04:07.615007+0000","last_unstale":"2024-09-18T02:07:12.323902+0000","last_undegraded":"2024-09-18T02:07:12.323902+0000","last_fullsized":"2024-09-18T02:07:12.323902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:14.213728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999722+0000","last_change":"2024-09-18T02:03:59.536538+0000","last_active":"2024-09-18T02:05:25.999722+0000","last_peered":"2024-09-18T02:05:25.999722+0000","last_clean":"2024-09-18T02:05:25.999722+0000","last_became_active":"2024-09-18T02:03:59.536120+0000","last_became_peered":"2024-09-18T02:03:59.536120+0000","last_unstale":"2024-09-18T02:05:25.999722+0000","last_undegraded":"2024-09-18T02:05:25.999722+0000","last_fullsized":"2024-09-18T02:05:25.999722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:31.952497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.286510+0000","last_change":"2024-09-18T02:03:57.525661+0000","last_active":"2024-09-18T02:05:26.286510+0000","last_peered":"2024-09-18T02:05:26.286510+0000","last_clean":"2024-09-18T02:05:26.286510+0000","last_became_active":"2024-09-18T02:03:57.522831+0000","last_became_peered":"2024-09-18T02:03:57.522831+0000","last_unstale":"2024-09-18T02:05:26.286510+0000","last_undegraded":"2024-09-18T02:05:26.286510+0000","last_fullsized":"2024-09-18T02:05:26.286510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:07.491696+0000","last_change":"2024-09-18T02:04:01.570141+0000","last_active":"2024-09-18T02:06:07.491696+0000","last_peered":"2024-09-18T02:06:07.491696+0000","last_clean":"2024-09-18T02:06:07.491696+0000","last_became_active":"2024-09-18T02:04:01.569649+0000","last_became_peered":"2024-09-18T02:04:01.569649+0000","last_unstale":"2024-09-18T02:06:07.491696+0000","last_undegraded":"2024-09-18T02:06:07.491696+0000","last_fullsized":"2024-09-18T02:06:07.491696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:20.919571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'46","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.152028+0000","last_change":"2024-09-18T02:04:03.591716+0000","last_active":"2024-09-18T02:07:11.152028+0000","last_peered":"2024-09-18T02:07:11.152028+0000","last_clean":"2024-09-18T02:07:11.152028+0000","last_became_active":"2024-09-18T02:04:03.591018+0000","last_became_peered":"2024-09-18T02:04:03.591018+0000","last_unstale":"2024-09-18T02:07:11.152028+0000","last_undegraded":"2024-09-18T02:07:11.152028+0000","last_fullsized":"2024-09-18T02:07:11.152028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:01:02.677167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338959+0000","last_change":"2024-09-18T02:04:05.596524+0000","last_active":"2024-09-18T02:04:36.338959+0000","last_peered":"2024-09-18T02:04:36.338959+0000","last_clean":"2024-09-18T02:04:36.338959+0000","last_became_active":"2024-09-18T02:04:05.595772+0000","last_became_peered":"2024-09-18T02:04:05.595772+0000","last_unstale":"2024-09-18T02:04:36.338959+0000","last_undegraded":"2024-09-18T02:04:36.338959+0000","last_fullsized":"2024-09-18T02:04:36.338959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:04.303561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.151093+0000","last_change":"2024-09-18T02:04:07.613362+0000","last_active":"2024-09-18T02:06:09.151093+0000","last_peered":"2024-09-18T02:06:09.151093+0000","last_clean":"2024-09-18T02:06:09.151093+0000","last_became_active":"2024-09-18T02:04:07.612610+0000","last_became_peered":"2024-09-18T02:04:07.612610+0000","last_unstale":"2024-09-18T02:06:09.151093+0000","last_undegraded":"2024-09-18T02:06:09.151093+0000","last_fullsized":"2024-09-18T02:06:09.151093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:48:04.223807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346323+0000","last_change":"2024-09-18T02:03:59.554230+0000","last_active":"2024-09-18T02:04:36.346323+0000","last_peered":"2024-09-18T02:04:36.346323+0000","last_clean":"2024-09-18T02:04:36.346323+0000","last_became_active":"2024-09-18T02:03:59.553864+0000","last_became_peered":"2024-09-18T02:03:59.553864+0000","last_unstale":"2024-09-18T02:04:36.346323+0000","last_undegraded":"2024-09-18T02:04:36.346323+0000","last_fullsized":"2024-09-18T02:04:36.346323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:03.926045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340985+0000","last_change":"2024-09-18T02:03:57.523546+0000","last_active":"2024-09-18T02:04:36.340985+0000","last_peered":"2024-09-18T02:04:36.340985+0000","last_clean":"2024-09-18T02:04:36.340985+0000","last_became_active":"2024-09-18T02:03:57.519843+0000","last_became_peered":"2024-09-18T02:03:57.519843+0000","last_unstale":"2024-09-18T02:04:36.340985+0000","last_undegraded":"2024-09-18T02:04:36.340985+0000","last_fullsized":"2024-09-18T02:04:36.340985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.969754+0000","last_change":"2024-09-18T02:03:59.536808+0000","last_active":"2024-09-18T02:06:06.969754+0000","last_peered":"2024-09-18T02:06:06.969754+0000","last_clean":"2024-09-18T02:06:06.969754+0000","last_became_active":"2024-09-18T02:03:59.535992+0000","last_became_peered":"2024-09-18T02:03:59.535992+0000","last_unstale":"2024-09-18T02:06:06.969754+0000","last_undegraded":"2024-09-18T02:06:06.969754+0000","last_fullsized":"2024-09-18T02:06:06.969754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338112+0000","last_change":"2024-09-18T02:03:57.527965+0000","last_active":"2024-09-18T02:04:36.338112+0000","last_peered":"2024-09-18T02:04:36.338112+0000","last_clean":"2024-09-18T02:04:36.338112+0000","last_became_active":"2024-09-18T02:03:57.527146+0000","last_became_peered":"2024-09-18T02:03:57.527146+0000","last_unstale":"2024-09-18T02:04:36.338112+0000","last_undegraded":"2024-09-18T02:04:36.338112+0000","last_fullsized":"2024-09-18T02:04:36.338112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217939+0000","last_change":"2024-09-18T02:03:59.558797+0000","last_active":"2024-09-18T02:07:12.217939+0000","last_peered":"2024-09-18T02:07:12.217939+0000","last_clean":"2024-09-18T02:07:12.217939+0000","last_became_active":"2024-09-18T02:03:59.556425+0000","last_became_peered":"2024-09-18T02:03:59.556425+0000","last_unstale":"2024-09-18T02:07:12.217939+0000","last_undegraded":"2024-09-18T02:07:12.217939+0000","last_fullsized":"2024-09-18T02:07:12.217939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:18.823166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.050574+0000","last_change":"2024-09-18T02:04:36.351337+0000","last_active":"2024-09-18T02:07:12.050574+0000","last_peered":"2024-09-18T02:07:12.050574+0000","last_clean":"2024-09-18T02:07:12.050574+0000","last_became_active":"2024-09-18T02:04:36.350472+0000","last_became_peered":"2024-09-18T02:04:36.350472+0000","last_unstale":"2024-09-18T02:07:12.050574+0000","last_undegraded":"2024-09-18T02:07:12.050574+0000","last_fullsized":"2024-09-18T02:07:12.050574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:46.701505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"32'18","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999570+0000","last_change":"2024-09-18T02:03:59.535727+0000","last_active":"2024-09-18T02:05:25.999570+0000","last_peered":"2024-09-18T02:05:25.999570+0000","last_clean":"2024-09-18T02:05:25.999570+0000","last_became_active":"2024-09-18T02:03:59.534584+0000","last_became_peered":"2024-09-18T02:03:59.534584+0000","last_unstale":"2024-09-18T02:05:25.999570+0000","last_undegraded":"2024-09-18T02:05:25.999570+0000","last_fullsized":"2024-09-18T02:05:25.999570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.636051+0000","last_change":"2024-09-18T02:03:57.523284+0000","last_active":"2024-09-18T02:07:11.636051+0000","last_peered":"2024-09-18T02:07:11.636051+0000","last_clean":"2024-09-18T02:07:11.636051+0000","last_became_active":"2024-09-18T02:03:57.521499+0000","last_became_peered":"2024-09-18T02:03:57.521499+0000","last_unstale":"2024-09-18T02:07:11.636051+0000","last_undegraded":"2024-09-18T02:07:11.636051+0000","last_fullsized":"2024-09-18T02:07:11.636051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329285+0000","last_change":"2024-09-18T02:03:59.555354+0000","last_active":"2024-09-18T02:06:06.329285+0000","last_peered":"2024-09-18T02:06:06.329285+0000","last_clean":"2024-09-18T02:06:06.329285+0000","last_became_active":"2024-09-18T02:03:59.554577+0000","last_became_peered":"2024-09-18T02:03:59.554577+0000","last_unstale":"2024-09-18T02:06:06.329285+0000","last_undegraded":"2024-09-18T02:06:06.329285+0000","last_fullsized":"2024-09-18T02:06:06.329285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:31:07.318399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.923838+0000","last_change":"2024-09-18T02:03:57.527483+0000","last_active":"2024-09-18T02:04:42.923838+0000","last_peered":"2024-09-18T02:04:42.923838+0000","last_clean":"2024-09-18T02:04:42.923838+0000","last_became_active":"2024-09-18T02:03:57.526774+0000","last_became_peered":"2024-09-18T02:03:57.526774+0000","last_unstale":"2024-09-18T02:04:42.923838+0000","last_undegraded":"2024-09-18T02:04:42.923838+0000","last_fullsized":"2024-09-18T02:04:42.923838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:25.305027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'13","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089661+0000","last_change":"2024-09-18T02:03:59.555131+0000","last_active":"2024-09-18T02:07:12.089661+0000","last_peered":"2024-09-18T02:07:12.089661+0000","last_clean":"2024-09-18T02:07:12.089661+0000","last_became_active":"2024-09-18T02:03:59.554672+0000","last_became_peered":"2024-09-18T02:03:59.554672+0000","last_unstale":"2024-09-18T02:07:12.089661+0000","last_undegraded":"2024-09-18T02:07:12.089661+0000","last_fullsized":"2024-09-18T02:07:12.089661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:10.488835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346001+0000","last_change":"2024-09-18T02:03:57.519989+0000","last_active":"2024-09-18T02:04:36.346001+0000","last_peered":"2024-09-18T02:04:36.346001+0000","last_clean":"2024-09-18T02:04:36.346001+0000","last_became_active":"2024-09-18T02:03:57.519691+0000","last_became_peered":"2024-09-18T02:03:57.519691+0000","last_unstale":"2024-09-18T02:04:36.346001+0000","last_undegraded":"2024-09-18T02:04:36.346001+0000","last_fullsized":"2024-09-18T02:04:36.346001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'17","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.088472+0000","last_change":"2024-09-18T02:03:59.541946+0000","last_active":"2024-09-18T02:07:12.088472+0000","last_peered":"2024-09-18T02:07:12.088472+0000","last_clean":"2024-09-18T02:07:12.088472+0000","last_became_active":"2024-09-18T02:03:59.541059+0000","last_became_peered":"2024-09-18T02:03:59.541059+0000","last_unstale":"2024-09-18T02:07:12.088472+0000","last_undegraded":"2024-09-18T02:07:12.088472+0000","last_fullsized":"2024-09-18T02:07:12.088472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.005080+0000","last_change":"2024-09-18T02:03:57.519641+0000","last_active":"2024-09-18T02:06:11.005080+0000","last_peered":"2024-09-18T02:06:11.005080+0000","last_clean":"2024-09-18T02:06:11.005080+0000","last_became_active":"2024-09-18T02:03:57.519272+0000","last_became_peered":"2024-09-18T02:03:57.519272+0000","last_unstale":"2024-09-18T02:06:11.005080+0000","last_undegraded":"2024-09-18T02:06:11.005080+0000","last_fullsized":"2024-09-18T02:06:11.005080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'5","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.235540+0000","last_change":"2024-09-18T02:03:59.545622+0000","last_active":"2024-09-18T02:07:12.235540+0000","last_peered":"2024-09-18T02:07:12.235540+0000","last_clean":"2024-09-18T02:07:12.235540+0000","last_became_active":"2024-09-18T02:03:59.539946+0000","last_became_peered":"2024-09-18T02:03:59.539946+0000","last_unstale":"2024-09-18T02:07:12.235540+0000","last_undegraded":"2024-09-18T02:07:12.235540+0000","last_fullsized":"2024-09-18T02:07:12.235540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342907+0000","last_change":"2024-09-18T02:03:57.527957+0000","last_active":"2024-09-18T02:04:36.342907+0000","last_peered":"2024-09-18T02:04:36.342907+0000","last_clean":"2024-09-18T02:04:36.342907+0000","last_became_active":"2024-09-18T02:03:57.527102+0000","last_became_peered":"2024-09-18T02:03:57.527102+0000","last_unstale":"2024-09-18T02:04:36.342907+0000","last_undegraded":"2024-09-18T02:04:36.342907+0000","last_fullsized":"2024-09-18T02:04:36.342907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:13:45.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'11","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.238904+0000","last_change":"2024-09-18T02:03:59.543494+0000","last_active":"2024-09-18T02:07:12.238904+0000","last_peered":"2024-09-18T02:07:12.238904+0000","last_clean":"2024-09-18T02:07:12.238904+0000","last_became_active":"2024-09-18T02:03:59.543160+0000","last_became_peered":"2024-09-18T02:03:59.543160+0000","last_unstale":"2024-09-18T02:07:12.238904+0000","last_undegraded":"2024-09-18T02:07:12.238904+0000","last_fullsized":"2024-09-18T02:07:12.238904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:21:48.069564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.347323+0000","last_change":"2024-09-18T02:03:57.525942+0000","last_active":"2024-09-18T02:04:36.347323+0000","last_peered":"2024-09-18T02:04:36.347323+0000","last_clean":"2024-09-18T02:04:36.347323+0000","last_became_active":"2024-09-18T02:03:57.524495+0000","last_became_peered":"2024-09-18T02:03:57.524495+0000","last_unstale":"2024-09-18T02:04:36.347323+0000","last_undegraded":"2024-09-18T02:04:36.347323+0000","last_fullsized":"2024-09-18T02:04:36.347323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:58:39.651409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217785+0000","last_change":"2024-09-18T02:04:36.361845+0000","last_active":"2024-09-18T02:07:12.217785+0000","last_peered":"2024-09-18T02:07:12.217785+0000","last_clean":"2024-09-18T02:07:12.217785+0000","last_became_active":"2024-09-18T02:04:36.354749+0000","last_became_peered":"2024-09-18T02:04:36.354749+0000","last_unstale":"2024-09-18T02:07:12.217785+0000","last_undegraded":"2024-09-18T02:07:12.217785+0000","last_fullsized":"2024-09-18T02:07:12.217785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:25:16.339405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338794+0000","last_change":"2024-09-18T02:03:57.521667+0000","last_active":"2024-09-18T02:04:36.338794+0000","last_peered":"2024-09-18T02:04:36.338794+0000","last_clean":"2024-09-18T02:04:36.338794+0000","last_became_active":"2024-09-18T02:03:57.520623+0000","last_became_peered":"2024-09-18T02:03:57.520623+0000","last_unstale":"2024-09-18T02:04:36.338794+0000","last_undegraded":"2024-09-18T02:04:36.338794+0000","last_fullsized":"2024-09-18T02:04:36.338794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217768+0000","last_change":"2024-09-18T02:03:59.555647+0000","last_active":"2024-09-18T02:07:12.217768+0000","last_peered":"2024-09-18T02:07:12.217768+0000","last_clean":"2024-09-18T02:07:12.217768+0000","last_became_active":"2024-09-18T02:03:59.555178+0000","last_became_peered":"2024-09-18T02:03:59.555178+0000","last_unstale":"2024-09-18T02:07:12.217768+0000","last_undegraded":"2024-09-18T02:07:12.217768+0000","last_fullsized":"2024-09-18T02:07:12.217768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338718+0000","last_change":"2024-09-18T02:03:57.519654+0000","last_active":"2024-09-18T02:04:36.338718+0000","last_peered":"2024-09-18T02:04:36.338718+0000","last_clean":"2024-09-18T02:04:36.338718+0000","last_became_active":"2024-09-18T02:03:57.519359+0000","last_became_peered":"2024-09-18T02:03:57.519359+0000","last_unstale":"2024-09-18T02:04:36.338718+0000","last_undegraded":"2024-09-18T02:04:36.338718+0000","last_fullsized":"2024-09-18T02:04:36.338718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:32.125649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.722270+0000","last_change":"2024-09-18T02:03:59.542345+0000","last_active":"2024-09-18T02:07:11.722270+0000","last_peered":"2024-09-18T02:07:11.722270+0000","last_clean":"2024-09-18T02:07:11.722270+0000","last_became_active":"2024-09-18T02:03:59.540444+0000","last_became_peered":"2024-09-18T02:03:59.540444+0000","last_unstale":"2024-09-18T02:07:11.722270+0000","last_undegraded":"2024-09-18T02:07:11.722270+0000","last_fullsized":"2024-09-18T02:07:11.722270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:36.437530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341283+0000","last_change":"2024-09-18T02:03:57.522898+0000","last_active":"2024-09-18T02:04:36.341283+0000","last_peered":"2024-09-18T02:04:36.341283+0000","last_clean":"2024-09-18T02:04:36.341283+0000","last_became_active":"2024-09-18T02:03:57.521148+0000","last_became_peered":"2024-09-18T02:03:57.521148+0000","last_unstale":"2024-09-18T02:04:36.341283+0000","last_undegraded":"2024-09-18T02:04:36.341283+0000","last_fullsized":"2024-09-18T02:04:36.341283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069454+0000","last_change":"2024-09-18T02:03:59.553902+0000","last_active":"2024-09-18T02:07:12.069454+0000","last_peered":"2024-09-18T02:07:12.069454+0000","last_clean":"2024-09-18T02:07:12.069454+0000","last_became_active":"2024-09-18T02:03:59.553528+0000","last_became_peered":"2024-09-18T02:03:59.553528+0000","last_unstale":"2024-09-18T02:07:12.069454+0000","last_undegraded":"2024-09-18T02:07:12.069454+0000","last_fullsized":"2024-09-18T02:07:12.069454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354140+0000","last_change":"2024-09-18T02:03:57.527928+0000","last_active":"2024-09-18T02:04:36.354140+0000","last_peered":"2024-09-18T02:04:36.354140+0000","last_clean":"2024-09-18T02:04:36.354140+0000","last_became_active":"2024-09-18T02:03:57.526972+0000","last_became_peered":"2024-09-18T02:03:57.526972+0000","last_unstale":"2024-09-18T02:04:36.354140+0000","last_undegraded":"2024-09-18T02:04:36.354140+0000","last_fullsized":"2024-09-18T02:04:36.354140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:17.513345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.729602+0000","last_change":"2024-09-18T02:03:59.546007+0000","last_active":"2024-09-18T02:07:11.729602+0000","last_peered":"2024-09-18T02:07:11.729602+0000","last_clean":"2024-09-18T02:07:11.729602+0000","last_became_active":"2024-09-18T02:03:59.545405+0000","last_became_peered":"2024-09-18T02:03:59.545405+0000","last_unstale":"2024-09-18T02:07:11.729602+0000","last_undegraded":"2024-09-18T02:07:11.729602+0000","last_fullsized":"2024-09-18T02:07:11.729602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354861+0000","last_change":"2024-09-18T02:03:57.522221+0000","last_active":"2024-09-18T02:04:36.354861+0000","last_peered":"2024-09-18T02:04:36.354861+0000","last_clean":"2024-09-18T02:04:36.354861+0000","last_became_active":"2024-09-18T02:03:57.521800+0000","last_became_peered":"2024-09-18T02:03:57.521800+0000","last_unstale":"2024-09-18T02:04:36.354861+0000","last_undegraded":"2024-09-18T02:04:36.354861+0000","last_fullsized":"2024-09-18T02:04:36.354861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:38.433048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.155206+0000","last_change":"2024-09-18T02:04:36.384511+0000","last_active":"2024-09-18T02:07:12.155206+0000","last_peered":"2024-09-18T02:07:12.155206+0000","last_clean":"2024-09-18T02:07:12.155206+0000","last_became_active":"2024-09-18T02:04:36.357213+0000","last_became_peered":"2024-09-18T02:04:36.357213+0000","last_unstale":"2024-09-18T02:07:12.155206+0000","last_undegraded":"2024-09-18T02:07:12.155206+0000","last_fullsized":"2024-09-18T02:07:12.155206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:09.239456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.368246+0000","last_change":"2024-09-18T02:03:57.531024+0000","last_active":"2024-09-18T02:04:36.368246+0000","last_peered":"2024-09-18T02:04:36.368246+0000","last_clean":"2024-09-18T02:04:36.368246+0000","last_became_active":"2024-09-18T02:03:57.528312+0000","last_became_peered":"2024-09-18T02:03:57.528312+0000","last_unstale":"2024-09-18T02:04:36.368246+0000","last_undegraded":"2024-09-18T02:04:36.368246+0000","last_fullsized":"2024-09-18T02:04:36.368246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:32.979432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153104+0000","last_change":"2024-09-18T02:03:59.546083+0000","last_active":"2024-09-18T02:07:12.153104+0000","last_peered":"2024-09-18T02:07:12.153104+0000","last_clean":"2024-09-18T02:07:12.153104+0000","last_became_active":"2024-09-18T02:03:59.540283+0000","last_became_peered":"2024-09-18T02:03:59.540283+0000","last_unstale":"2024-09-18T02:07:12.153104+0000","last_undegraded":"2024-09-18T02:07:12.153104+0000","last_fullsized":"2024-09-18T02:07:12.153104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.910994+0000","last_change":"2024-09-18T02:03:57.528934+0000","last_active":"2024-09-18T02:06:10.910994+0000","last_peered":"2024-09-18T02:06:10.910994+0000","last_clean":"2024-09-18T02:06:10.910994+0000","last_became_active":"2024-09-18T02:03:57.526363+0000","last_became_peered":"2024-09-18T02:03:57.526363+0000","last_unstale":"2024-09-18T02:06:10.910994+0000","last_undegraded":"2024-09-18T02:06:10.910994+0000","last_fullsized":"2024-09-18T02:06:10.910994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:36.487218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.058009+0000","last_change":"2024-09-18T02:03:57.516751+0000","last_active":"2024-09-18T02:07:12.058009+0000","last_peered":"2024-09-18T02:07:12.058009+0000","last_clean":"2024-09-18T02:07:12.058009+0000","last_became_active":"2024-09-18T02:03:57.516434+0000","last_became_peered":"2024-09-18T02:03:57.516434+0000","last_unstale":"2024-09-18T02:07:12.058009+0000","last_undegraded":"2024-09-18T02:07:12.058009+0000","last_fullsized":"2024-09-18T02:07:12.058009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:34.563165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334365+0000","last_change":"2024-09-18T02:03:59.551182+0000","last_active":"2024-09-18T02:06:26.334365+0000","last_peered":"2024-09-18T02:06:26.334365+0000","last_clean":"2024-09-18T02:06:26.334365+0000","last_became_active":"2024-09-18T02:03:59.550058+0000","last_became_peered":"2024-09-18T02:03:59.550058+0000","last_unstale":"2024-09-18T02:06:26.334365+0000","last_undegraded":"2024-09-18T02:06:26.334365+0000","last_fullsized":"2024-09-18T02:06:26.334365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:38.500729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338421+0000","last_change":"2024-09-18T02:03:57.533882+0000","last_active":"2024-09-18T02:04:36.338421+0000","last_peered":"2024-09-18T02:04:36.338421+0000","last_clean":"2024-09-18T02:04:36.338421+0000","last_became_active":"2024-09-18T02:03:57.533324+0000","last_became_peered":"2024-09-18T02:03:57.533324+0000","last_unstale":"2024-09-18T02:04:36.338421+0000","last_undegraded":"2024-09-18T02:04:36.338421+0000","last_fullsized":"2024-09-18T02:04:36.338421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'11","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.886960+0000","last_change":"2024-09-18T02:03:59.542840+0000","last_active":"2024-09-18T02:07:11.886960+0000","last_peered":"2024-09-18T02:07:11.886960+0000","last_clean":"2024-09-18T02:07:11.886960+0000","last_became_active":"2024-09-18T02:03:59.542356+0000","last_became_peered":"2024-09-18T02:03:59.542356+0000","last_unstale":"2024-09-18T02:07:11.886960+0000","last_undegraded":"2024-09-18T02:07:11.886960+0000","last_fullsized":"2024-09-18T02:07:11.886960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:35:21.321816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1471,"ondisk_log_size":1471,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1593,"num_read_kb":1483,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705715,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":21560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":22077440,"data_stored":21749718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48592,"kb_used_data":13248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323248,"statfs":{"total":96636764160,"available":96587005952,"internally_reserved":0,"allocated":13565952,"data_stored":13308880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705715,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41056,"kb_used_data":5712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330784,"statfs":{"total":96636764160,"available":96594722816,"internally_reserved":0,"allocated":5849088,"data_stored":5562779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52216,"kb_used_data":12712,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319624,"statfs":{"total":96636764160,"available":96583294976,"internally_reserved":0,"allocated":13017088,"data_stored":12722525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4837376,"data_stored":4834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21614592,"data_stored":21611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T02:07:44.411 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T02:07:44.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T02:07:44.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f68965e4640 1 Processor -- start 2024-09-18T02:07:44.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f68965e4640 1 -- start start 2024-09-18T02:07:44.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f68965e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f689006d0e0 0x7f689006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:44.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f68965e4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6890071c10 con 0x7f689006da00 2024-09-18T02:07:44.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f68965e4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6890072230 con 0x7f689006d0e0 2024-09-18T02:07:44.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f688ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f689006d0e0 0x7f689006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:44.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f688f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f689006da00 0x7f689012ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39706/0 (socket says 172.21.15.81:39706) 2024-09-18T02:07:44.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f688f7fe640 1 -- 172.21.15.81:0/2602078303 learned_addr learned my addr 172.21.15.81:0/2602078303 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:44.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f688ffff640 1 -- 172.21.15.81:0/2602078303 >> v1:172.21.15.81:6789/0 conn(0x7f689006da00 legacy=0x7f689012ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:44.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f688effd640 1 -- 172.21.15.81:0/2602078303 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320782579 0 0) 0x7f6890071c10 con 0x7f689006da00 2024-09-18T02:07:44.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f688ffff640 1 -- 172.21.15.81:0/2602078303 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68900709e0 con 0x7f689006d0e0 2024-09-18T02:07:44.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.561+0000 7f688ffff640 1 --2- 172.21.15.81:0/2602078303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689006d0e0 0x7f689006d4c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6880009740 tx=0x7f688001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88e05ea661875f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:44.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688effd640 1 -- 172.21.15.81:0/2602078303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68800b0070 con 0x7f689006d0e0 2024-09-18T02:07:44.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688effd640 1 -- 172.21.15.81:0/2602078303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68800ab530 con 0x7f689006d0e0 2024-09-18T02:07:44.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688effd640 1 -- 172.21.15.81:0/2602078303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68800ab830 con 0x7f689006d0e0 2024-09-18T02:07:44.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 -- 172.21.15.81:0/2602078303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689006d0e0 msgr2=0x7f689006d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:44.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 --2- 172.21.15.81:0/2602078303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689006d0e0 0x7f689006d4c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6880009740 tx=0x7f688001c370 comp rx=0 tx=0).stop 2024-09-18T02:07:44.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 -- 172.21.15.81:0/2602078303 shutdown_connections 2024-09-18T02:07:44.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 --2- 172.21.15.81:0/2602078303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689006d0e0 0x7f689006d4c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:44.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 -- 172.21.15.81:0/2602078303 >> 172.21.15.81:0/2602078303 conn(0x7f6890099a50 msgr2=0x7f68900972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:44.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 -- 172.21.15.81:0/2602078303 shutdown_connections 2024-09-18T02:07:44.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 -- 172.21.15.81:0/2602078303 wait complete. 2024-09-18T02:07:44.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 Processor -- start 2024-09-18T02:07:44.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 -- start start 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689006d0e0 0x7f689006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6890134e80 con 0x7f689006d0e0 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689006d0e0 0x7f689006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689006d0e0 0x7f689006e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39920/0 (socket says 172.21.15.81:39920) 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688ffff640 1 -- 172.21.15.81:0/2011216759 learned_addr learned my addr 172.21.15.81:0/2011216759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688ffff640 1 -- 172.21.15.81:0/2011216759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689012bd70 con 0x7f689006d0e0 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688ffff640 1 --2- 172.21.15.81:0/2011216759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689006d0e0 0x7f689006e1f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6880019fa0 tx=0x7f688001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688cff9640 1 -- 172.21.15.81:0/2011216759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68800bb070 con 0x7f689006d0e0 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688cff9640 1 -- 172.21.15.81:0/2011216759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68800abe40 con 0x7f689006d0e0 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 -- 172.21.15.81:0/2011216759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689006fa10 con 0x7f689006d0e0 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688cff9640 1 -- 172.21.15.81:0/2011216759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68800b0040 con 0x7f689006d0e0 2024-09-18T02:07:44.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 -- 172.21.15.81:0/2011216759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f689006fed0 con 0x7f689006d0e0 2024-09-18T02:07:44.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f688cff9640 1 -- 172.21.15.81:0/2011216759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6880004150 con 0x7f689006d0e0 2024-09-18T02:07:44.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.565+0000 7f68965e4640 1 -- 172.21.15.81:0/2011216759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689006d4c0 con 0x7f689006d0e0 2024-09-18T02:07:44.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.569+0000 7f688cff9640 1 --2- 172.21.15.81:0/2011216759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f687c035db0 0x7f687c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:44.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.569+0000 7f688cff9640 1 -- 172.21.15.81:0/2011216759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f68800e3740 con 0x7f689006d0e0 2024-09-18T02:07:44.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.569+0000 7f688f7fe640 1 --2- 172.21.15.81:0/2011216759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f687c035db0 0x7f687c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:44.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.569+0000 7f688f7fe640 1 --2- 172.21.15.81:0/2011216759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f687c035db0 0x7f687c038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6884007fd0 tx=0x7f6884007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:44.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.573+0000 7f688cff9640 1 -- 172.21.15.81:0/2011216759 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6880015ff0 con 0x7f689006d0e0 2024-09-18T02:07:44.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.729+0000 7f68965e4640 1 -- 172.21.15.81:0/2011216759 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6890073790 con 0x7f687c035db0 2024-09-18T02:07:44.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.773+0000 7f688cff9640 1 -- 172.21.15.81:0/2011216759 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665587 (secure 0 0 0) 0x7f6890073790 con 0x7f687c035db0 2024-09-18T02:07:44.780 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:07:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T02:07:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.777+0000 7f68965e4640 1 -- 172.21.15.81:0/2011216759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f687c035db0 msgr2=0x7f687c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.777+0000 7f68965e4640 1 --2- 172.21.15.81:0/2011216759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f687c035db0 0x7f687c038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6884007fd0 tx=0x7f6884007980 comp rx=0 tx=0).stop 2024-09-18T02:07:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.781+0000 7f68965e4640 1 -- 172.21.15.81:0/2011216759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689006d0e0 msgr2=0x7f689006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.781+0000 7f68965e4640 1 --2- 172.21.15.81:0/2011216759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689006d0e0 0x7f689006e1f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6880019fa0 tx=0x7f688001abb0 comp rx=0 tx=0).stop 2024-09-18T02:07:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.781+0000 7f68965e4640 1 -- 172.21.15.81:0/2011216759 shutdown_connections 2024-09-18T02:07:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.781+0000 7f68965e4640 1 --2- 172.21.15.81:0/2011216759 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f687c035db0 0x7f687c038270 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.781+0000 7f68965e4640 1 --2- 172.21.15.81:0/2011216759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689006d0e0 0x7f689006e1f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.781+0000 7f68965e4640 1 -- 172.21.15.81:0/2011216759 >> 172.21.15.81:0/2011216759 conn(0x7f6890099a50 msgr2=0x7f689009b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.781+0000 7f68965e4640 1 -- 172.21.15.81:0/2011216759 shutdown_connections 2024-09-18T02:07:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.781+0000 7f68965e4640 1 -- 172.21.15.81:0/2011216759 wait complete. 2024-09-18T02:07:44.799 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-18T02:07:43.346813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":261,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5147,"num_read_kb":4696,"num_write":2300,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4676,"ondisk_log_size":4676,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198768,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288592,"statfs":{"total":386547056640,"available":386343518208,"internally_reserved":0,"allocated":54509568,"data_stored":53343902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005545"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.341087+0000","last_change":"2024-09-18T02:03:57.517243+0000","last_active":"2024-09-18T02:04:41.341087+0000","last_peered":"2024-09-18T02:04:41.341087+0000","last_clean":"2024-09-18T02:04:41.341087+0000","last_became_active":"2024-09-18T02:03:57.516420+0000","last_became_peered":"2024-09-18T02:03:57.516420+0000","last_unstale":"2024-09-18T02:04:41.341087+0000","last_undegraded":"2024-09-18T02:04:41.341087+0000","last_fullsized":"2024-09-18T02:04:41.341087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.868815+0000","last_change":"2024-09-18T02:03:59.549513+0000","last_active":"2024-09-18T02:07:11.868815+0000","last_peered":"2024-09-18T02:07:11.868815+0000","last_clean":"2024-09-18T02:07:11.868815+0000","last_became_active":"2024-09-18T02:03:59.545294+0000","last_became_peered":"2024-09-18T02:03:59.545294+0000","last_unstale":"2024-09-18T02:07:11.868815+0000","last_undegraded":"2024-09-18T02:07:11.868815+0000","last_fullsized":"2024-09-18T02:07:11.868815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329444+0000","last_change":"2024-09-18T02:03:57.533991+0000","last_active":"2024-09-18T02:06:06.329444+0000","last_peered":"2024-09-18T02:06:06.329444+0000","last_clean":"2024-09-18T02:06:06.329444+0000","last_became_active":"2024-09-18T02:03:57.533332+0000","last_became_peered":"2024-09-18T02:03:57.533332+0000","last_unstale":"2024-09-18T02:06:06.329444+0000","last_undegraded":"2024-09-18T02:06:06.329444+0000","last_fullsized":"2024-09-18T02:06:06.329444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:46.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:43.634720+0000","last_change":"2024-09-18T02:03:59.554008+0000","last_active":"2024-09-18T02:04:43.634720+0000","last_peered":"2024-09-18T02:04:43.634720+0000","last_clean":"2024-09-18T02:04:43.634720+0000","last_became_active":"2024-09-18T02:03:59.553641+0000","last_became_peered":"2024-09-18T02:03:59.553641+0000","last_unstale":"2024-09-18T02:04:43.634720+0000","last_undegraded":"2024-09-18T02:04:43.634720+0000","last_fullsized":"2024-09-18T02:04:43.634720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:31.703094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.355519+0000","last_change":"2024-09-18T02:03:57.532939+0000","last_active":"2024-09-18T02:04:36.355519+0000","last_peered":"2024-09-18T02:04:36.355519+0000","last_clean":"2024-09-18T02:04:36.355519+0000","last_became_active":"2024-09-18T02:03:57.532561+0000","last_became_peered":"2024-09-18T02:03:57.532561+0000","last_unstale":"2024-09-18T02:04:36.355519+0000","last_undegraded":"2024-09-18T02:04:36.355519+0000","last_fullsized":"2024-09-18T02:04:36.355519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:51.738245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069743+0000","last_change":"2024-09-18T02:03:59.552858+0000","last_active":"2024-09-18T02:07:12.069743+0000","last_peered":"2024-09-18T02:07:12.069743+0000","last_clean":"2024-09-18T02:07:12.069743+0000","last_became_active":"2024-09-18T02:03:59.551661+0000","last_became_peered":"2024-09-18T02:03:59.551661+0000","last_unstale":"2024-09-18T02:07:12.069743+0000","last_undegraded":"2024-09-18T02:07:12.069743+0000","last_fullsized":"2024-09-18T02:07:12.069743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:13:16.052288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.345587+0000","last_change":"2024-09-18T02:03:57.523513+0000","last_active":"2024-09-18T02:04:41.345587+0000","last_peered":"2024-09-18T02:04:41.345587+0000","last_clean":"2024-09-18T02:04:41.345587+0000","last_became_active":"2024-09-18T02:03:57.522751+0000","last_became_peered":"2024-09-18T02:03:57.522751+0000","last_unstale":"2024-09-18T02:04:41.345587+0000","last_undegraded":"2024-09-18T02:04:41.345587+0000","last_fullsized":"2024-09-18T02:04:41.345587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.303235+0000","last_change":"2024-09-18T02:03:59.553228+0000","last_active":"2024-09-18T02:05:26.303235+0000","last_peered":"2024-09-18T02:05:26.303235+0000","last_clean":"2024-09-18T02:05:26.303235+0000","last_became_active":"2024-09-18T02:03:59.552797+0000","last_became_peered":"2024-09-18T02:03:59.552797+0000","last_unstale":"2024-09-18T02:05:26.303235+0000","last_undegraded":"2024-09-18T02:05:26.303235+0000","last_fullsized":"2024-09-18T02:05:26.303235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:34:11.622588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.351407+0000","last_change":"2024-09-18T02:03:57.525148+0000","last_active":"2024-09-18T02:04:36.351407+0000","last_peered":"2024-09-18T02:04:36.351407+0000","last_clean":"2024-09-18T02:04:36.351407+0000","last_became_active":"2024-09-18T02:03:57.524645+0000","last_became_peered":"2024-09-18T02:03:57.524645+0000","last_unstale":"2024-09-18T02:04:36.351407+0000","last_undegraded":"2024-09-18T02:04:36.351407+0000","last_fullsized":"2024-09-18T02:04:36.351407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:25.763842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.730487+0000","last_change":"2024-09-18T02:03:59.542637+0000","last_active":"2024-09-18T02:07:11.730487+0000","last_peered":"2024-09-18T02:07:11.730487+0000","last_clean":"2024-09-18T02:07:11.730487+0000","last_became_active":"2024-09-18T02:03:59.542238+0000","last_became_peered":"2024-09-18T02:03:59.542238+0000","last_unstale":"2024-09-18T02:07:11.730487+0000","last_undegraded":"2024-09-18T02:07:11.730487+0000","last_fullsized":"2024-09-18T02:07:11.730487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:45.343721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343457+0000","last_change":"2024-09-18T02:03:57.523116+0000","last_active":"2024-09-18T02:04:36.343457+0000","last_peered":"2024-09-18T02:04:36.343457+0000","last_clean":"2024-09-18T02:04:36.343457+0000","last_became_active":"2024-09-18T02:03:57.520647+0000","last_became_peered":"2024-09-18T02:03:57.520647+0000","last_unstale":"2024-09-18T02:04:36.343457+0000","last_undegraded":"2024-09-18T02:04:36.343457+0000","last_fullsized":"2024-09-18T02:04:36.343457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'12","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153401+0000","last_change":"2024-09-18T02:03:59.560469+0000","last_active":"2024-09-18T02:07:12.153401+0000","last_peered":"2024-09-18T02:07:12.153401+0000","last_clean":"2024-09-18T02:07:12.153401+0000","last_became_active":"2024-09-18T02:03:59.559273+0000","last_became_peered":"2024-09-18T02:03:59.559273+0000","last_unstale":"2024-09-18T02:07:12.153401+0000","last_undegraded":"2024-09-18T02:07:12.153401+0000","last_fullsized":"2024-09-18T02:07:12.153401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:44.509390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.675472+0000","last_change":"2024-09-18T02:03:57.528855+0000","last_active":"2024-09-18T02:07:11.675472+0000","last_peered":"2024-09-18T02:07:11.675472+0000","last_clean":"2024-09-18T02:07:11.675472+0000","last_became_active":"2024-09-18T02:03:57.526953+0000","last_became_peered":"2024-09-18T02:03:57.526953+0000","last_unstale":"2024-09-18T02:07:11.675472+0000","last_undegraded":"2024-09-18T02:07:11.675472+0000","last_fullsized":"2024-09-18T02:07:11.675472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:28:20.024090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999282+0000","last_change":"2024-09-18T02:03:59.541576+0000","last_active":"2024-09-18T02:05:25.999282+0000","last_peered":"2024-09-18T02:05:25.999282+0000","last_clean":"2024-09-18T02:05:25.999282+0000","last_became_active":"2024-09-18T02:03:59.541086+0000","last_became_peered":"2024-09-18T02:03:59.541086+0000","last_unstale":"2024-09-18T02:05:25.999282+0000","last_undegraded":"2024-09-18T02:05:25.999282+0000","last_fullsized":"2024-09-18T02:05:25.999282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.337869+0000","last_change":"2024-09-18T02:03:57.524285+0000","last_active":"2024-09-18T02:04:36.337869+0000","last_peered":"2024-09-18T02:04:36.337869+0000","last_clean":"2024-09-18T02:04:36.337869+0000","last_became_active":"2024-09-18T02:03:57.520343+0000","last_became_peered":"2024-09-18T02:03:57.520343+0000","last_unstale":"2024-09-18T02:04:36.337869+0000","last_undegraded":"2024-09-18T02:04:36.337869+0000","last_fullsized":"2024-09-18T02:04:36.337869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069669+0000","last_change":"2024-09-18T02:03:59.534315+0000","last_active":"2024-09-18T02:07:12.069669+0000","last_peered":"2024-09-18T02:07:12.069669+0000","last_clean":"2024-09-18T02:07:12.069669+0000","last_became_active":"2024-09-18T02:03:59.533956+0000","last_became_peered":"2024-09-18T02:03:59.533956+0000","last_unstale":"2024-09-18T02:07:12.069669+0000","last_undegraded":"2024-09-18T02:07:12.069669+0000","last_fullsized":"2024-09-18T02:07:12.069669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.238202+0000","last_change":"2024-09-18T02:03:59.537124+0000","last_active":"2024-09-18T02:07:12.238202+0000","last_peered":"2024-09-18T02:07:12.238202+0000","last_clean":"2024-09-18T02:07:12.238202+0000","last_became_active":"2024-09-18T02:03:59.536739+0000","last_became_peered":"2024-09-18T02:03:59.536739+0000","last_unstale":"2024-09-18T02:07:12.238202+0000","last_undegraded":"2024-09-18T02:07:12.238202+0000","last_fullsized":"2024-09-18T02:07:12.238202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:15.010015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345192+0000","last_change":"2024-09-18T02:03:57.523985+0000","last_active":"2024-09-18T02:04:36.345192+0000","last_peered":"2024-09-18T02:04:36.345192+0000","last_clean":"2024-09-18T02:04:36.345192+0000","last_became_active":"2024-09-18T02:03:57.523437+0000","last_became_peered":"2024-09-18T02:03:57.523437+0000","last_unstale":"2024-09-18T02:04:36.345192+0000","last_undegraded":"2024-09-18T02:04:36.345192+0000","last_fullsized":"2024-09-18T02:04:36.345192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.218837+0000","last_change":"2024-09-18T02:03:59.540278+0000","last_active":"2024-09-18T02:07:12.218837+0000","last_peered":"2024-09-18T02:07:12.218837+0000","last_clean":"2024-09-18T02:07:12.218837+0000","last_became_active":"2024-09-18T02:03:59.539778+0000","last_became_peered":"2024-09-18T02:03:59.539778+0000","last_unstale":"2024-09-18T02:07:12.218837+0000","last_undegraded":"2024-09-18T02:07:12.218837+0000","last_fullsized":"2024-09-18T02:07:12.218837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.035357+0000","last_change":"2024-09-18T02:03:57.528659+0000","last_active":"2024-09-18T02:07:12.035357+0000","last_peered":"2024-09-18T02:07:12.035357+0000","last_clean":"2024-09-18T02:07:12.035357+0000","last_became_active":"2024-09-18T02:03:57.524578+0000","last_became_peered":"2024-09-18T02:03:57.524578+0000","last_unstale":"2024-09-18T02:07:12.035357+0000","last_undegraded":"2024-09-18T02:07:12.035357+0000","last_fullsized":"2024-09-18T02:07:12.035357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.595859+0000","last_change":"2024-09-18T02:03:59.546276+0000","last_active":"2024-09-18T02:04:42.595859+0000","last_peered":"2024-09-18T02:04:42.595859+0000","last_clean":"2024-09-18T02:04:42.595859+0000","last_became_active":"2024-09-18T02:03:59.545902+0000","last_became_peered":"2024-09-18T02:03:59.545902+0000","last_unstale":"2024-09-18T02:04:42.595859+0000","last_undegraded":"2024-09-18T02:04:42.595859+0000","last_fullsized":"2024-09-18T02:04:42.595859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:31.387691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348638+0000","last_change":"2024-09-18T02:03:57.523592+0000","last_active":"2024-09-18T02:04:36.348638+0000","last_peered":"2024-09-18T02:04:36.348638+0000","last_clean":"2024-09-18T02:04:36.348638+0000","last_became_active":"2024-09-18T02:03:57.523211+0000","last_became_peered":"2024-09-18T02:03:57.523211+0000","last_unstale":"2024-09-18T02:04:36.348638+0000","last_undegraded":"2024-09-18T02:04:36.348638+0000","last_fullsized":"2024-09-18T02:04:36.348638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:40.008713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.116959+0000","last_change":"2024-09-18T02:03:59.539920+0000","last_active":"2024-09-18T02:06:11.116959+0000","last_peered":"2024-09-18T02:06:11.116959+0000","last_clean":"2024-09-18T02:06:11.116959+0000","last_became_active":"2024-09-18T02:03:59.539198+0000","last_became_peered":"2024-09-18T02:03:59.539198+0000","last_unstale":"2024-09-18T02:06:11.116959+0000","last_undegraded":"2024-09-18T02:06:11.116959+0000","last_fullsized":"2024-09-18T02:06:11.116959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348389+0000","last_change":"2024-09-18T02:03:57.523263+0000","last_active":"2024-09-18T02:04:36.348389+0000","last_peered":"2024-09-18T02:04:36.348389+0000","last_clean":"2024-09-18T02:04:36.348389+0000","last_became_active":"2024-09-18T02:03:57.522924+0000","last_became_peered":"2024-09-18T02:03:57.522924+0000","last_unstale":"2024-09-18T02:04:36.348389+0000","last_undegraded":"2024-09-18T02:04:36.348389+0000","last_fullsized":"2024-09-18T02:04:36.348389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154414+0000","last_change":"2024-09-18T02:03:59.538519+0000","last_active":"2024-09-18T02:07:12.154414+0000","last_peered":"2024-09-18T02:07:12.154414+0000","last_clean":"2024-09-18T02:07:12.154414+0000","last_became_active":"2024-09-18T02:03:59.538126+0000","last_became_peered":"2024-09-18T02:03:59.538126+0000","last_unstale":"2024-09-18T02:07:12.154414+0000","last_undegraded":"2024-09-18T02:07:12.154414+0000","last_fullsized":"2024-09-18T02:07:12.154414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342676+0000","last_change":"2024-09-18T02:03:57.524373+0000","last_active":"2024-09-18T02:04:36.342676+0000","last_peered":"2024-09-18T02:04:36.342676+0000","last_clean":"2024-09-18T02:04:36.342676+0000","last_became_active":"2024-09-18T02:03:57.521019+0000","last_became_peered":"2024-09-18T02:03:57.521019+0000","last_unstale":"2024-09-18T02:04:36.342676+0000","last_undegraded":"2024-09-18T02:04:36.342676+0000","last_fullsized":"2024-09-18T02:04:36.342676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.726771+0000","last_change":"2024-09-18T02:03:59.542673+0000","last_active":"2024-09-18T02:07:11.726771+0000","last_peered":"2024-09-18T02:07:11.726771+0000","last_clean":"2024-09-18T02:07:11.726771+0000","last_became_active":"2024-09-18T02:03:59.540553+0000","last_became_peered":"2024-09-18T02:03:59.540553+0000","last_unstale":"2024-09-18T02:07:11.726771+0000","last_undegraded":"2024-09-18T02:07:11.726771+0000","last_fullsized":"2024-09-18T02:07:11.726771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:45:09.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.904198+0000","last_change":"2024-09-18T02:03:57.527852+0000","last_active":"2024-09-18T02:04:42.904198+0000","last_peered":"2024-09-18T02:04:42.904198+0000","last_clean":"2024-09-18T02:04:42.904198+0000","last_became_active":"2024-09-18T02:03:57.526917+0000","last_became_peered":"2024-09-18T02:03:57.526917+0000","last_unstale":"2024-09-18T02:04:42.904198+0000","last_undegraded":"2024-09-18T02:04:42.904198+0000","last_fullsized":"2024-09-18T02:04:42.904198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:05:25.015337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.114018+0000","last_change":"2024-09-18T02:04:07.624724+0000","last_active":"2024-09-18T02:07:12.114018+0000","last_peered":"2024-09-18T02:07:12.114018+0000","last_clean":"2024-09-18T02:07:12.114018+0000","last_became_active":"2024-09-18T02:04:07.624037+0000","last_became_peered":"2024-09-18T02:04:07.624037+0000","last_unstale":"2024-09-18T02:07:12.114018+0000","last_undegraded":"2024-09-18T02:07:12.114018+0000","last_fullsized":"2024-09-18T02:07:12.114018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:12.942917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069638+0000","last_change":"2024-09-18T02:03:59.545658+0000","last_active":"2024-09-18T02:07:12.069638+0000","last_peered":"2024-09-18T02:07:12.069638+0000","last_clean":"2024-09-18T02:07:12.069638+0000","last_became_active":"2024-09-18T02:03:59.538409+0000","last_became_peered":"2024-09-18T02:03:59.538409+0000","last_unstale":"2024-09-18T02:07:12.069638+0000","last_undegraded":"2024-09-18T02:07:12.069638+0000","last_fullsized":"2024-09-18T02:07:12.069638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:22:35.808977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336737+0000","last_change":"2024-09-18T02:03:57.533041+0000","last_active":"2024-09-18T02:06:21.336737+0000","last_peered":"2024-09-18T02:06:21.336737+0000","last_clean":"2024-09-18T02:06:21.336737+0000","last_became_active":"2024-09-18T02:03:57.532657+0000","last_became_peered":"2024-09-18T02:03:57.532657+0000","last_unstale":"2024-09-18T02:06:21.336737+0000","last_undegraded":"2024-09-18T02:06:21.336737+0000","last_fullsized":"2024-09-18T02:06:21.336737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:57.872288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353588+0000","last_change":"2024-09-18T02:04:01.562652+0000","last_active":"2024-09-18T02:04:36.353588+0000","last_peered":"2024-09-18T02:04:36.353588+0000","last_clean":"2024-09-18T02:04:36.353588+0000","last_became_active":"2024-09-18T02:04:01.562058+0000","last_became_peered":"2024-09-18T02:04:01.562058+0000","last_unstale":"2024-09-18T02:04:36.353588+0000","last_undegraded":"2024-09-18T02:04:36.353588+0000","last_fullsized":"2024-09-18T02:04:36.353588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:55.815357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'42","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.120403+0000","last_change":"2024-09-18T02:04:03.602001+0000","last_active":"2024-09-18T02:06:09.120403+0000","last_peered":"2024-09-18T02:06:09.120403+0000","last_clean":"2024-09-18T02:06:09.120403+0000","last_became_active":"2024-09-18T02:04:03.600467+0000","last_became_peered":"2024-09-18T02:04:03.600467+0000","last_unstale":"2024-09-18T02:06:09.120403+0000","last_undegraded":"2024-09-18T02:06:09.120403+0000","last_fullsized":"2024-09-18T02:06:09.120403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:57.945679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341767+0000","last_change":"2024-09-18T02:04:05.593604+0000","last_active":"2024-09-18T02:04:36.341767+0000","last_peered":"2024-09-18T02:04:36.341767+0000","last_clean":"2024-09-18T02:04:36.341767+0000","last_became_active":"2024-09-18T02:04:05.592934+0000","last_became_peered":"2024-09-18T02:04:05.592934+0000","last_unstale":"2024-09-18T02:04:36.341767+0000","last_undegraded":"2024-09-18T02:04:36.341767+0000","last_fullsized":"2024-09-18T02:04:36.341767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:04.303561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.009824+0000","last_change":"2024-09-18T02:04:07.624771+0000","last_active":"2024-09-18T02:05:26.009824+0000","last_peered":"2024-09-18T02:05:26.009824+0000","last_clean":"2024-09-18T02:05:26.009824+0000","last_became_active":"2024-09-18T02:04:07.624106+0000","last_became_peered":"2024-09-18T02:04:07.624106+0000","last_unstale":"2024-09-18T02:05:26.009824+0000","last_undegraded":"2024-09-18T02:05:26.009824+0000","last_fullsized":"2024-09-18T02:05:26.009824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:19.261922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:43.634524+0000","last_change":"2024-09-18T02:03:59.556933+0000","last_active":"2024-09-18T02:04:43.634524+0000","last_peered":"2024-09-18T02:04:43.634524+0000","last_clean":"2024-09-18T02:04:43.634524+0000","last_became_active":"2024-09-18T02:03:59.555956+0000","last_became_peered":"2024-09-18T02:03:59.555956+0000","last_unstale":"2024-09-18T02:04:43.634524+0000","last_undegraded":"2024-09-18T02:04:43.634524+0000","last_fullsized":"2024-09-18T02:04:43.634524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:14.846567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.908475+0000","last_change":"2024-09-18T02:03:57.523303+0000","last_active":"2024-09-18T02:04:42.908475+0000","last_peered":"2024-09-18T02:04:42.908475+0000","last_clean":"2024-09-18T02:04:42.908475+0000","last_became_active":"2024-09-18T02:03:57.523041+0000","last_became_peered":"2024-09-18T02:03:57.523041+0000","last_unstale":"2024-09-18T02:04:42.908475+0000","last_undegraded":"2024-09-18T02:04:42.908475+0000","last_fullsized":"2024-09-18T02:04:42.908475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.366147+0000","last_change":"2024-09-18T02:04:36.363414+0000","last_active":"2024-09-18T02:04:36.366147+0000","last_peered":"2024-09-18T02:04:36.366147+0000","last_clean":"2024-09-18T02:04:36.366147+0000","last_became_active":"2024-09-18T02:04:36.362592+0000","last_became_peered":"2024-09-18T02:04:36.362592+0000","last_unstale":"2024-09-18T02:04:36.366147+0000","last_undegraded":"2024-09-18T02:04:36.366147+0000","last_fullsized":"2024-09-18T02:04:36.366147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:35.048118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342013+0000","last_change":"2024-09-18T02:04:03.580344+0000","last_active":"2024-09-18T02:04:36.342013+0000","last_peered":"2024-09-18T02:04:36.342013+0000","last_clean":"2024-09-18T02:04:36.342013+0000","last_became_active":"2024-09-18T02:04:03.579442+0000","last_became_peered":"2024-09-18T02:04:03.579442+0000","last_unstale":"2024-09-18T02:04:36.342013+0000","last_undegraded":"2024-09-18T02:04:36.342013+0000","last_fullsized":"2024-09-18T02:04:36.342013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:24.305992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341161+0000","last_change":"2024-09-18T02:04:05.606711+0000","last_active":"2024-09-18T02:04:36.341161+0000","last_peered":"2024-09-18T02:04:36.341161+0000","last_clean":"2024-09-18T02:04:36.341161+0000","last_became_active":"2024-09-18T02:04:05.605774+0000","last_became_peered":"2024-09-18T02:04:05.605774+0000","last_unstale":"2024-09-18T02:04:36.341161+0000","last_undegraded":"2024-09-18T02:04:36.341161+0000","last_fullsized":"2024-09-18T02:04:36.341161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:09.745074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.874113+0000","last_change":"2024-09-18T02:04:07.610794+0000","last_active":"2024-09-18T02:07:11.874113+0000","last_peered":"2024-09-18T02:07:11.874113+0000","last_clean":"2024-09-18T02:07:11.874113+0000","last_became_active":"2024-09-18T02:04:07.610120+0000","last_became_peered":"2024-09-18T02:04:07.610120+0000","last_unstale":"2024-09-18T02:07:11.874113+0000","last_undegraded":"2024-09-18T02:07:11.874113+0000","last_fullsized":"2024-09-18T02:07:11.874113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:50:22.733414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'18","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.728639+0000","last_change":"2024-09-18T02:04:36.373755+0000","last_active":"2024-09-18T02:07:11.728639+0000","last_peered":"2024-09-18T02:07:11.728639+0000","last_clean":"2024-09-18T02:07:11.728639+0000","last_became_active":"2024-09-18T02:04:36.359108+0000","last_became_peered":"2024-09-18T02:04:36.359108+0000","last_unstale":"2024-09-18T02:07:11.728639+0000","last_undegraded":"2024-09-18T02:07:11.728639+0000","last_fullsized":"2024-09-18T02:07:11.728639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.476030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336598+0000","last_change":"2024-09-18T02:03:57.533341+0000","last_active":"2024-09-18T02:06:21.336598+0000","last_peered":"2024-09-18T02:06:21.336598+0000","last_clean":"2024-09-18T02:06:21.336598+0000","last_became_active":"2024-09-18T02:03:57.533037+0000","last_became_peered":"2024-09-18T02:03:57.533037+0000","last_unstale":"2024-09-18T02:06:21.336598+0000","last_undegraded":"2024-09-18T02:06:21.336598+0000","last_fullsized":"2024-09-18T02:06:21.336598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:05.427298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.573028+0000","last_change":"2024-09-18T02:04:01.568037+0000","last_active":"2024-09-18T02:06:10.573028+0000","last_peered":"2024-09-18T02:06:10.573028+0000","last_clean":"2024-09-18T02:06:10.573028+0000","last_became_active":"2024-09-18T02:04:01.567287+0000","last_became_peered":"2024-09-18T02:04:01.567287+0000","last_unstale":"2024-09-18T02:06:10.573028+0000","last_undegraded":"2024-09-18T02:06:10.573028+0000","last_fullsized":"2024-09-18T02:06:10.573028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:17.024271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'23","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.336252+0000","last_change":"2024-09-18T02:04:03.581817+0000","last_active":"2024-09-18T02:06:26.336252+0000","last_peered":"2024-09-18T02:06:26.336252+0000","last_clean":"2024-09-18T02:06:26.336252+0000","last_became_active":"2024-09-18T02:04:03.581092+0000","last_became_peered":"2024-09-18T02:04:03.581092+0000","last_unstale":"2024-09-18T02:06:26.336252+0000","last_undegraded":"2024-09-18T02:06:26.336252+0000","last_fullsized":"2024-09-18T02:06:26.336252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:22.939603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":405,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.782222+0000","last_change":"2024-09-18T02:04:05.609076+0000","last_active":"2024-09-18T02:07:11.782222+0000","last_peered":"2024-09-18T02:07:11.782222+0000","last_clean":"2024-09-18T02:07:11.782222+0000","last_became_active":"2024-09-18T02:04:05.607733+0000","last_became_peered":"2024-09-18T02:04:05.607733+0000","last_unstale":"2024-09-18T02:07:11.782222+0000","last_undegraded":"2024-09-18T02:07:11.782222+0000","last_fullsized":"2024-09-18T02:07:11.782222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:10.197583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.344569+0000","last_change":"2024-09-18T02:04:07.631363+0000","last_active":"2024-09-18T02:04:36.344569+0000","last_peered":"2024-09-18T02:04:36.344569+0000","last_clean":"2024-09-18T02:04:36.344569+0000","last_became_active":"2024-09-18T02:04:07.630721+0000","last_became_peered":"2024-09-18T02:04:07.630721+0000","last_unstale":"2024-09-18T02:04:36.344569+0000","last_undegraded":"2024-09-18T02:04:36.344569+0000","last_fullsized":"2024-09-18T02:04:36.344569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:45.912516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.725053+0000","last_change":"2024-09-18T02:03:59.550519+0000","last_active":"2024-09-18T02:07:11.725053+0000","last_peered":"2024-09-18T02:07:11.725053+0000","last_clean":"2024-09-18T02:07:11.725053+0000","last_became_active":"2024-09-18T02:03:59.548365+0000","last_became_peered":"2024-09-18T02:03:59.548365+0000","last_unstale":"2024-09-18T02:07:11.725053+0000","last_undegraded":"2024-09-18T02:07:11.725053+0000","last_fullsized":"2024-09-18T02:07:11.725053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.333397+0000","last_change":"2024-09-18T02:03:57.521018+0000","last_active":"2024-09-18T02:06:21.333397+0000","last_peered":"2024-09-18T02:06:21.333397+0000","last_clean":"2024-09-18T02:06:21.333397+0000","last_became_active":"2024-09-18T02:03:57.520706+0000","last_became_peered":"2024-09-18T02:03:57.520706+0000","last_unstale":"2024-09-18T02:06:21.333397+0000","last_undegraded":"2024-09-18T02:06:21.333397+0000","last_fullsized":"2024-09-18T02:06:21.333397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:20:27.172876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.585045+0000","last_change":"2024-09-18T02:04:01.562150+0000","last_active":"2024-09-18T02:06:10.585045+0000","last_peered":"2024-09-18T02:06:10.585045+0000","last_clean":"2024-09-18T02:06:10.585045+0000","last_became_active":"2024-09-18T02:04:01.559249+0000","last_became_peered":"2024-09-18T02:04:01.559249+0000","last_unstale":"2024-09-18T02:06:10.585045+0000","last_undegraded":"2024-09-18T02:06:10.585045+0000","last_fullsized":"2024-09-18T02:06:10.585045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:27.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'36","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.112276+0000","last_change":"2024-09-18T02:04:03.581074+0000","last_active":"2024-09-18T02:06:09.112276+0000","last_peered":"2024-09-18T02:06:09.112276+0000","last_clean":"2024-09-18T02:06:09.112276+0000","last_became_active":"2024-09-18T02:04:03.580310+0000","last_became_peered":"2024-09-18T02:04:03.580310+0000","last_unstale":"2024-09-18T02:06:09.112276+0000","last_undegraded":"2024-09-18T02:06:09.112276+0000","last_fullsized":"2024-09-18T02:06:09.112276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:35.737383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":436,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.231716+0000","last_change":"2024-09-18T02:04:05.612525+0000","last_active":"2024-09-18T02:07:12.231716+0000","last_peered":"2024-09-18T02:07:12.231716+0000","last_clean":"2024-09-18T02:07:12.231716+0000","last_became_active":"2024-09-18T02:04:05.611707+0000","last_became_peered":"2024-09-18T02:04:05.611707+0000","last_unstale":"2024-09-18T02:07:12.231716+0000","last_undegraded":"2024-09-18T02:07:12.231716+0000","last_fullsized":"2024-09-18T02:07:12.231716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:38.266386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.939685+0000","last_change":"2024-09-18T02:03:59.560537+0000","last_active":"2024-09-18T02:04:42.939685+0000","last_peered":"2024-09-18T02:04:42.939685+0000","last_clean":"2024-09-18T02:04:42.939685+0000","last_became_active":"2024-09-18T02:03:59.559585+0000","last_became_peered":"2024-09-18T02:03:59.559585+0000","last_unstale":"2024-09-18T02:04:42.939685+0000","last_undegraded":"2024-09-18T02:04:42.939685+0000","last_fullsized":"2024-09-18T02:04:42.939685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:48.966165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.028684+0000","last_change":"2024-09-18T02:03:57.528019+0000","last_active":"2024-09-18T02:07:12.028684+0000","last_peered":"2024-09-18T02:07:12.028684+0000","last_clean":"2024-09-18T02:07:12.028684+0000","last_became_active":"2024-09-18T02:03:57.527575+0000","last_became_peered":"2024-09-18T02:03:57.527575+0000","last_unstale":"2024-09-18T02:07:12.028684+0000","last_undegraded":"2024-09-18T02:07:12.028684+0000","last_fullsized":"2024-09-18T02:07:12.028684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:47.581207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339069+0000","last_change":"2024-09-18T02:04:01.569918+0000","last_active":"2024-09-18T02:04:36.339069+0000","last_peered":"2024-09-18T02:04:36.339069+0000","last_clean":"2024-09-18T02:04:36.339069+0000","last_became_active":"2024-09-18T02:04:01.569301+0000","last_became_peered":"2024-09-18T02:04:01.569301+0000","last_unstale":"2024-09-18T02:04:36.339069+0000","last_undegraded":"2024-09-18T02:04:36.339069+0000","last_fullsized":"2024-09-18T02:04:36.339069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:17.024271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'46","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.126948+0000","last_change":"2024-09-18T02:04:03.592588+0000","last_active":"2024-09-18T02:06:09.126948+0000","last_peered":"2024-09-18T02:06:09.126948+0000","last_clean":"2024-09-18T02:06:09.126948+0000","last_became_active":"2024-09-18T02:04:03.591195+0000","last_became_peered":"2024-09-18T02:04:03.591195+0000","last_unstale":"2024-09-18T02:06:09.126948+0000","last_undegraded":"2024-09-18T02:06:09.126948+0000","last_fullsized":"2024-09-18T02:06:09.126948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:35:17.659414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339248+0000","last_change":"2024-09-18T02:04:05.606379+0000","last_active":"2024-09-18T02:04:36.339248+0000","last_peered":"2024-09-18T02:04:36.339248+0000","last_clean":"2024-09-18T02:04:36.339248+0000","last_became_active":"2024-09-18T02:04:05.605611+0000","last_became_peered":"2024-09-18T02:04:05.605611+0000","last_unstale":"2024-09-18T02:04:36.339248+0000","last_undegraded":"2024-09-18T02:04:36.339248+0000","last_fullsized":"2024-09-18T02:04:36.339248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:00.566939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.013428+0000","last_change":"2024-09-18T02:04:07.630472+0000","last_active":"2024-09-18T02:05:26.013428+0000","last_peered":"2024-09-18T02:05:26.013428+0000","last_clean":"2024-09-18T02:05:26.013428+0000","last_became_active":"2024-09-18T02:04:07.628247+0000","last_became_peered":"2024-09-18T02:04:07.628247+0000","last_unstale":"2024-09-18T02:05:26.013428+0000","last_undegraded":"2024-09-18T02:05:26.013428+0000","last_fullsized":"2024-09-18T02:05:26.013428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:40.279768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.000495+0000","last_change":"2024-09-18T02:03:59.535593+0000","last_active":"2024-09-18T02:05:26.000495+0000","last_peered":"2024-09-18T02:05:26.000495+0000","last_clean":"2024-09-18T02:05:26.000495+0000","last_became_active":"2024-09-18T02:03:59.535217+0000","last_became_peered":"2024-09-18T02:03:59.535217+0000","last_unstale":"2024-09-18T02:05:26.000495+0000","last_undegraded":"2024-09-18T02:05:26.000495+0000","last_fullsized":"2024-09-18T02:05:26.000495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:38.500729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.369068+0000","last_change":"2024-09-18T02:03:57.529038+0000","last_active":"2024-09-18T02:04:36.369068+0000","last_peered":"2024-09-18T02:04:36.369068+0000","last_clean":"2024-09-18T02:04:36.369068+0000","last_became_active":"2024-09-18T02:03:57.528006+0000","last_became_peered":"2024-09-18T02:03:57.528006+0000","last_unstale":"2024-09-18T02:04:36.369068+0000","last_undegraded":"2024-09-18T02:04:36.369068+0000","last_fullsized":"2024-09-18T02:04:36.369068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:46.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361230+0000","last_change":"2024-09-18T02:04:36.358966+0000","last_active":"2024-09-18T02:04:36.361230+0000","last_peered":"2024-09-18T02:04:36.361230+0000","last_clean":"2024-09-18T02:04:36.361230+0000","last_became_active":"2024-09-18T02:04:36.357607+0000","last_became_peered":"2024-09-18T02:04:36.357607+0000","last_unstale":"2024-09-18T02:04:36.361230+0000","last_undegraded":"2024-09-18T02:04:36.361230+0000","last_fullsized":"2024-09-18T02:04:36.361230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:02:01.245576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'36","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.096724+0000","last_change":"2024-09-18T02:04:03.604260+0000","last_active":"2024-09-18T02:06:09.096724+0000","last_peered":"2024-09-18T02:06:09.096724+0000","last_clean":"2024-09-18T02:06:09.096724+0000","last_became_active":"2024-09-18T02:04:03.601783+0000","last_became_peered":"2024-09-18T02:04:03.601783+0000","last_unstale":"2024-09-18T02:06:09.096724+0000","last_undegraded":"2024-09-18T02:06:09.096724+0000","last_fullsized":"2024-09-18T02:06:09.096724+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:52.749305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338424+0000","last_change":"2024-09-18T02:04:05.578434+0000","last_active":"2024-09-18T02:04:36.338424+0000","last_peered":"2024-09-18T02:04:36.338424+0000","last_clean":"2024-09-18T02:04:36.338424+0000","last_became_active":"2024-09-18T02:04:05.577665+0000","last_became_peered":"2024-09-18T02:04:05.577665+0000","last_unstale":"2024-09-18T02:04:36.338424+0000","last_undegraded":"2024-09-18T02:04:36.338424+0000","last_fullsized":"2024-09-18T02:04:36.338424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:59.848912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.297891+0000","last_change":"2024-09-18T02:04:07.621208+0000","last_active":"2024-09-18T02:05:26.297891+0000","last_peered":"2024-09-18T02:05:26.297891+0000","last_clean":"2024-09-18T02:05:26.297891+0000","last_became_active":"2024-09-18T02:04:07.619973+0000","last_became_peered":"2024-09-18T02:04:07.619973+0000","last_unstale":"2024-09-18T02:05:26.297891+0000","last_undegraded":"2024-09-18T02:05:26.297891+0000","last_fullsized":"2024-09-18T02:05:26.297891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:04:52.210610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153629+0000","last_change":"2024-09-18T02:03:59.539493+0000","last_active":"2024-09-18T02:07:12.153629+0000","last_peered":"2024-09-18T02:07:12.153629+0000","last_clean":"2024-09-18T02:07:12.153629+0000","last_became_active":"2024-09-18T02:03:59.539105+0000","last_became_peered":"2024-09-18T02:03:59.539105+0000","last_unstale":"2024-09-18T02:07:12.153629+0000","last_undegraded":"2024-09-18T02:07:12.153629+0000","last_fullsized":"2024-09-18T02:07:12.153629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:48.841356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.985374+0000","last_change":"2024-09-18T02:03:57.530707+0000","last_active":"2024-09-18T02:05:25.985374+0000","last_peered":"2024-09-18T02:05:25.985374+0000","last_clean":"2024-09-18T02:05:25.985374+0000","last_became_active":"2024-09-18T02:03:57.526327+0000","last_became_peered":"2024-09-18T02:03:57.526327+0000","last_unstale":"2024-09-18T02:05:25.985374+0000","last_undegraded":"2024-09-18T02:05:25.985374+0000","last_fullsized":"2024-09-18T02:05:25.985374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:29.374180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343561+0000","last_change":"2024-09-18T02:04:01.562077+0000","last_active":"2024-09-18T02:04:36.343561+0000","last_peered":"2024-09-18T02:04:36.343561+0000","last_clean":"2024-09-18T02:04:36.343561+0000","last_became_active":"2024-09-18T02:04:01.561279+0000","last_became_peered":"2024-09-18T02:04:01.561279+0000","last_unstale":"2024-09-18T02:04:36.343561+0000","last_undegraded":"2024-09-18T02:04:36.343561+0000","last_fullsized":"2024-09-18T02:04:36.343561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:22.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'49","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335258+0000","last_change":"2024-09-18T02:04:03.595408+0000","last_active":"2024-09-18T02:06:16.335258+0000","last_peered":"2024-09-18T02:06:16.335258+0000","last_clean":"2024-09-18T02:06:16.335258+0000","last_became_active":"2024-09-18T02:04:03.591705+0000","last_became_peered":"2024-09-18T02:04:03.591705+0000","last_unstale":"2024-09-18T02:06:16.335258+0000","last_undegraded":"2024-09-18T02:06:16.335258+0000","last_fullsized":"2024-09-18T02:06:16.335258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:09.695750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":398,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.417043+0000","last_change":"2024-09-18T02:04:05.592469+0000","last_active":"2024-09-18T02:07:12.417043+0000","last_peered":"2024-09-18T02:07:12.417043+0000","last_clean":"2024-09-18T02:07:12.417043+0000","last_became_active":"2024-09-18T02:04:05.591652+0000","last_became_peered":"2024-09-18T02:04:05.591652+0000","last_unstale":"2024-09-18T02:07:12.417043+0000","last_undegraded":"2024-09-18T02:07:12.417043+0000","last_fullsized":"2024-09-18T02:07:12.417043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:09.745074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342503+0000","last_change":"2024-09-18T02:04:07.609950+0000","last_active":"2024-09-18T02:04:36.342503+0000","last_peered":"2024-09-18T02:04:36.342503+0000","last_clean":"2024-09-18T02:04:36.342503+0000","last_became_active":"2024-09-18T02:04:07.609050+0000","last_became_peered":"2024-09-18T02:04:07.609050+0000","last_unstale":"2024-09-18T02:04:36.342503+0000","last_undegraded":"2024-09-18T02:04:36.342503+0000","last_fullsized":"2024-09-18T02:04:36.342503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:08.651954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'14","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153098+0000","last_change":"2024-09-18T02:03:59.532107+0000","last_active":"2024-09-18T02:07:12.153098+0000","last_peered":"2024-09-18T02:07:12.153098+0000","last_clean":"2024-09-18T02:07:12.153098+0000","last_became_active":"2024-09-18T02:03:59.531445+0000","last_became_peered":"2024-09-18T02:03:59.531445+0000","last_unstale":"2024-09-18T02:07:12.153098+0000","last_undegraded":"2024-09-18T02:07:12.153098+0000","last_fullsized":"2024-09-18T02:07:12.153098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335457+0000","last_change":"2024-09-18T02:03:57.522436+0000","last_active":"2024-09-18T02:06:16.335457+0000","last_peered":"2024-09-18T02:06:16.335457+0000","last_clean":"2024-09-18T02:06:16.335457+0000","last_became_active":"2024-09-18T02:03:57.521858+0000","last_became_peered":"2024-09-18T02:03:57.521858+0000","last_unstale":"2024-09-18T02:06:16.335457+0000","last_undegraded":"2024-09-18T02:06:16.335457+0000","last_fullsized":"2024-09-18T02:06:16.335457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:52.057677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361115+0000","last_change":"2024-09-18T02:04:36.357179+0000","last_active":"2024-09-18T02:04:36.361115+0000","last_peered":"2024-09-18T02:04:36.361115+0000","last_clean":"2024-09-18T02:04:36.361115+0000","last_became_active":"2024-09-18T02:04:36.356453+0000","last_became_peered":"2024-09-18T02:04:36.356453+0000","last_unstale":"2024-09-18T02:04:36.361115+0000","last_undegraded":"2024-09-18T02:04:36.361115+0000","last_fullsized":"2024-09-18T02:04:36.361115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:27.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'66","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.131727+0000","last_change":"2024-09-18T02:04:03.596161+0000","last_active":"2024-09-18T02:06:09.131727+0000","last_peered":"2024-09-18T02:06:09.131727+0000","last_clean":"2024-09-18T02:06:09.131727+0000","last_became_active":"2024-09-18T02:04:03.595618+0000","last_became_peered":"2024-09-18T02:04:03.595618+0000","last_unstale":"2024-09-18T02:06:09.131727+0000","last_undegraded":"2024-09-18T02:06:09.131727+0000","last_fullsized":"2024-09-18T02:06:09.131727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:30.345316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338225+0000","last_change":"2024-09-18T02:04:05.585960+0000","last_active":"2024-09-18T02:04:36.338225+0000","last_peered":"2024-09-18T02:04:36.338225+0000","last_clean":"2024-09-18T02:04:36.338225+0000","last_became_active":"2024-09-18T02:04:05.585272+0000","last_became_peered":"2024-09-18T02:04:05.585272+0000","last_unstale":"2024-09-18T02:04:36.338225+0000","last_undegraded":"2024-09-18T02:04:36.338225+0000","last_fullsized":"2024-09-18T02:04:36.338225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:26.254201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.376039+0000","last_change":"2024-09-18T02:04:07.614915+0000","last_active":"2024-09-18T02:07:12.376039+0000","last_peered":"2024-09-18T02:07:12.376039+0000","last_clean":"2024-09-18T02:07:12.376039+0000","last_became_active":"2024-09-18T02:04:07.614232+0000","last_became_peered":"2024-09-18T02:04:07.614232+0000","last_unstale":"2024-09-18T02:07:12.376039+0000","last_undegraded":"2024-09-18T02:07:12.376039+0000","last_fullsized":"2024-09-18T02:07:12.376039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:34.372220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'18","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154480+0000","last_change":"2024-09-18T02:03:59.546334+0000","last_active":"2024-09-18T02:07:12.154480+0000","last_peered":"2024-09-18T02:07:12.154480+0000","last_clean":"2024-09-18T02:07:12.154480+0000","last_became_active":"2024-09-18T02:03:59.545956+0000","last_became_peered":"2024-09-18T02:03:59.545956+0000","last_unstale":"2024-09-18T02:07:12.154480+0000","last_undegraded":"2024-09-18T02:07:12.154480+0000","last_fullsized":"2024-09-18T02:07:12.154480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:12.929565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.331685+0000","last_change":"2024-09-18T02:03:57.522159+0000","last_active":"2024-09-18T02:06:16.331685+0000","last_peered":"2024-09-18T02:06:16.331685+0000","last_clean":"2024-09-18T02:06:16.331685+0000","last_became_active":"2024-09-18T02:03:57.520036+0000","last_became_peered":"2024-09-18T02:03:57.520036+0000","last_unstale":"2024-09-18T02:06:16.331685+0000","last_undegraded":"2024-09-18T02:06:16.331685+0000","last_fullsized":"2024-09-18T02:06:16.331685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:47.581207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361351+0000","last_change":"2024-09-18T02:04:01.573344+0000","last_active":"2024-09-18T02:04:36.361351+0000","last_peered":"2024-09-18T02:04:36.361351+0000","last_clean":"2024-09-18T02:04:36.361351+0000","last_became_active":"2024-09-18T02:04:01.573084+0000","last_became_peered":"2024-09-18T02:04:01.573084+0000","last_unstale":"2024-09-18T02:04:36.361351+0000","last_undegraded":"2024-09-18T02:04:36.361351+0000","last_fullsized":"2024-09-18T02:04:36.361351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:45:12.008014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.102500+0000","last_change":"2024-09-18T02:04:03.567085+0000","last_active":"2024-09-18T02:06:09.102500+0000","last_peered":"2024-09-18T02:06:09.102500+0000","last_clean":"2024-09-18T02:06:09.102500+0000","last_became_active":"2024-09-18T02:04:03.565801+0000","last_became_peered":"2024-09-18T02:04:03.565801+0000","last_unstale":"2024-09-18T02:06:09.102500+0000","last_undegraded":"2024-09-18T02:06:09.102500+0000","last_fullsized":"2024-09-18T02:06:09.102500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:33.058001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.357876+0000","last_change":"2024-09-18T02:04:05.612592+0000","last_active":"2024-09-18T02:04:36.357876+0000","last_peered":"2024-09-18T02:04:36.357876+0000","last_clean":"2024-09-18T02:04:36.357876+0000","last_became_active":"2024-09-18T02:04:05.612052+0000","last_became_peered":"2024-09-18T02:04:05.612052+0000","last_unstale":"2024-09-18T02:04:36.357876+0000","last_undegraded":"2024-09-18T02:04:36.357876+0000","last_fullsized":"2024-09-18T02:04:36.357876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:51:05.159090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.173402+0000","last_change":"2024-09-18T02:04:07.622545+0000","last_active":"2024-09-18T02:07:12.173402+0000","last_peered":"2024-09-18T02:07:12.173402+0000","last_clean":"2024-09-18T02:07:12.173402+0000","last_became_active":"2024-09-18T02:04:07.622004+0000","last_became_peered":"2024-09-18T02:04:07.622004+0000","last_unstale":"2024-09-18T02:07:12.173402+0000","last_undegraded":"2024-09-18T02:07:12.173402+0000","last_fullsized":"2024-09-18T02:07:12.173402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:53.836670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.218296+0000","last_change":"2024-09-18T02:04:36.364542+0000","last_active":"2024-09-18T02:07:12.218296+0000","last_peered":"2024-09-18T02:07:12.218296+0000","last_clean":"2024-09-18T02:07:12.218296+0000","last_became_active":"2024-09-18T02:04:36.361748+0000","last_became_peered":"2024-09-18T02:04:36.361748+0000","last_unstale":"2024-09-18T02:07:12.218296+0000","last_undegraded":"2024-09-18T02:07:12.218296+0000","last_fullsized":"2024-09-18T02:07:12.218296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:04.881724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.334238+0000","last_change":"2024-09-18T02:03:57.530747+0000","last_active":"2024-09-18T02:06:11.334238+0000","last_peered":"2024-09-18T02:06:11.334238+0000","last_clean":"2024-09-18T02:06:11.334238+0000","last_became_active":"2024-09-18T02:03:57.526977+0000","last_became_peered":"2024-09-18T02:03:57.526977+0000","last_unstale":"2024-09-18T02:06:11.334238+0000","last_undegraded":"2024-09-18T02:06:11.334238+0000","last_fullsized":"2024-09-18T02:06:11.334238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:29.938986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345881+0000","last_change":"2024-09-18T02:04:01.562995+0000","last_active":"2024-09-18T02:04:36.345881+0000","last_peered":"2024-09-18T02:04:36.345881+0000","last_clean":"2024-09-18T02:04:36.345881+0000","last_became_active":"2024-09-18T02:04:01.561913+0000","last_became_peered":"2024-09-18T02:04:01.561913+0000","last_unstale":"2024-09-18T02:04:36.345881+0000","last_undegraded":"2024-09-18T02:04:36.345881+0000","last_fullsized":"2024-09-18T02:04:36.345881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:33.717350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.143733+0000","last_change":"2024-09-18T02:04:03.581156+0000","last_active":"2024-09-18T02:06:09.143733+0000","last_peered":"2024-09-18T02:06:09.143733+0000","last_clean":"2024-09-18T02:06:09.143733+0000","last_became_active":"2024-09-18T02:04:03.580395+0000","last_became_peered":"2024-09-18T02:04:03.580395+0000","last_unstale":"2024-09-18T02:06:09.143733+0000","last_undegraded":"2024-09-18T02:06:09.143733+0000","last_fullsized":"2024-09-18T02:06:09.143733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:36.129908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.387338+0000","last_change":"2024-09-18T02:04:05.604333+0000","last_active":"2024-09-18T02:07:12.387338+0000","last_peered":"2024-09-18T02:07:12.387338+0000","last_clean":"2024-09-18T02:07:12.387338+0000","last_became_active":"2024-09-18T02:04:05.603548+0000","last_became_peered":"2024-09-18T02:04:05.603548+0000","last_unstale":"2024-09-18T02:07:12.387338+0000","last_undegraded":"2024-09-18T02:07:12.387338+0000","last_fullsized":"2024-09-18T02:07:12.387338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:24.870978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.082226+0000","last_change":"2024-09-18T02:04:07.620770+0000","last_active":"2024-09-18T02:07:12.082226+0000","last_peered":"2024-09-18T02:07:12.082226+0000","last_clean":"2024-09-18T02:07:12.082226+0000","last_became_active":"2024-09-18T02:04:07.620094+0000","last_became_peered":"2024-09-18T02:04:07.620094+0000","last_unstale":"2024-09-18T02:07:12.082226+0000","last_undegraded":"2024-09-18T02:07:12.082226+0000","last_fullsized":"2024-09-18T02:07:12.082226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:36:55.417123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'14","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069886+0000","last_change":"2024-09-18T02:03:59.535067+0000","last_active":"2024-09-18T02:07:12.069886+0000","last_peered":"2024-09-18T02:07:12.069886+0000","last_clean":"2024-09-18T02:07:12.069886+0000","last_became_active":"2024-09-18T02:03:59.534547+0000","last_became_peered":"2024-09-18T02:03:59.534547+0000","last_unstale":"2024-09-18T02:07:12.069886+0000","last_undegraded":"2024-09-18T02:07:12.069886+0000","last_fullsized":"2024-09-18T02:07:12.069886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349002+0000","last_change":"2024-09-18T02:03:57.526267+0000","last_active":"2024-09-18T02:04:36.349002+0000","last_peered":"2024-09-18T02:04:36.349002+0000","last_clean":"2024-09-18T02:04:36.349002+0000","last_became_active":"2024-09-18T02:03:57.525576+0000","last_became_peered":"2024-09-18T02:03:57.525576+0000","last_unstale":"2024-09-18T02:04:36.349002+0000","last_undegraded":"2024-09-18T02:04:36.349002+0000","last_fullsized":"2024-09-18T02:04:36.349002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:45:50.125550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.584748+0000","last_change":"2024-09-18T02:04:01.565275+0000","last_active":"2024-09-18T02:06:10.584748+0000","last_peered":"2024-09-18T02:06:10.584748+0000","last_clean":"2024-09-18T02:06:10.584748+0000","last_became_active":"2024-09-18T02:04:01.564385+0000","last_became_peered":"2024-09-18T02:04:01.564385+0000","last_unstale":"2024-09-18T02:06:10.584748+0000","last_undegraded":"2024-09-18T02:06:10.584748+0000","last_fullsized":"2024-09-18T02:06:10.584748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:50.980422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353471+0000","last_change":"2024-09-18T02:04:03.601350+0000","last_active":"2024-09-18T02:04:36.353471+0000","last_peered":"2024-09-18T02:04:36.353471+0000","last_clean":"2024-09-18T02:04:36.353471+0000","last_became_active":"2024-09-18T02:04:03.600545+0000","last_became_peered":"2024-09-18T02:04:03.600545+0000","last_unstale":"2024-09-18T02:04:36.353471+0000","last_undegraded":"2024-09-18T02:04:36.353471+0000","last_fullsized":"2024-09-18T02:04:36.353471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:51:09.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":460,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.330022+0000","last_change":"2024-09-18T02:04:05.582865+0000","last_active":"2024-09-18T02:07:12.330022+0000","last_peered":"2024-09-18T02:07:12.330022+0000","last_clean":"2024-09-18T02:07:12.330022+0000","last_became_active":"2024-09-18T02:04:05.582127+0000","last_became_peered":"2024-09-18T02:04:05.582127+0000","last_unstale":"2024-09-18T02:07:12.330022+0000","last_undegraded":"2024-09-18T02:07:12.330022+0000","last_fullsized":"2024-09-18T02:07:12.330022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:43.899135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.741734+0000","last_change":"2024-09-18T02:04:07.606525+0000","last_active":"2024-09-18T02:06:10.741734+0000","last_peered":"2024-09-18T02:06:10.741734+0000","last_clean":"2024-09-18T02:06:10.741734+0000","last_became_active":"2024-09-18T02:04:07.602985+0000","last_became_peered":"2024-09-18T02:04:07.602985+0000","last_unstale":"2024-09-18T02:06:10.741734+0000","last_undegraded":"2024-09-18T02:06:10.741734+0000","last_fullsized":"2024-09-18T02:06:10.741734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:39.005182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.135331+0000","last_change":"2024-09-18T02:03:59.555188+0000","last_active":"2024-09-18T02:04:42.135331+0000","last_peered":"2024-09-18T02:04:42.135331+0000","last_clean":"2024-09-18T02:04:42.135331+0000","last_became_active":"2024-09-18T02:03:59.554711+0000","last_became_peered":"2024-09-18T02:03:59.554711+0000","last_unstale":"2024-09-18T02:04:42.135331+0000","last_undegraded":"2024-09-18T02:04:42.135331+0000","last_fullsized":"2024-09-18T02:04:42.135331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:54:59.350305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346294+0000","last_change":"2024-09-18T02:03:57.531537+0000","last_active":"2024-09-18T02:04:36.346294+0000","last_peered":"2024-09-18T02:04:36.346294+0000","last_clean":"2024-09-18T02:04:36.346294+0000","last_became_active":"2024-09-18T02:03:57.531156+0000","last_became_peered":"2024-09-18T02:03:57.531156+0000","last_unstale":"2024-09-18T02:04:36.346294+0000","last_undegraded":"2024-09-18T02:04:36.346294+0000","last_fullsized":"2024-09-18T02:04:36.346294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:38:10.322009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358596+0000","last_change":"2024-09-18T02:04:01.566384+0000","last_active":"2024-09-18T02:04:36.358596+0000","last_peered":"2024-09-18T02:04:36.358596+0000","last_clean":"2024-09-18T02:04:36.358596+0000","last_became_active":"2024-09-18T02:04:01.565999+0000","last_became_peered":"2024-09-18T02:04:01.565999+0000","last_unstale":"2024-09-18T02:04:36.358596+0000","last_undegraded":"2024-09-18T02:04:36.358596+0000","last_fullsized":"2024-09-18T02:04:36.358596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:14.084784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'40","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.333779+0000","last_change":"2024-09-18T02:04:03.564795+0000","last_active":"2024-09-18T02:06:21.333779+0000","last_peered":"2024-09-18T02:06:21.333779+0000","last_clean":"2024-09-18T02:06:21.333779+0000","last_became_active":"2024-09-18T02:04:03.564021+0000","last_became_peered":"2024-09-18T02:04:03.564021+0000","last_unstale":"2024-09-18T02:06:21.333779+0000","last_undegraded":"2024-09-18T02:06:21.333779+0000","last_fullsized":"2024-09-18T02:06:21.333779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:32.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346074+0000","last_change":"2024-09-18T02:04:05.611095+0000","last_active":"2024-09-18T02:04:36.346074+0000","last_peered":"2024-09-18T02:04:36.346074+0000","last_clean":"2024-09-18T02:04:36.346074+0000","last_became_active":"2024-09-18T02:04:05.610024+0000","last_became_peered":"2024-09-18T02:04:05.610024+0000","last_unstale":"2024-09-18T02:04:36.346074+0000","last_undegraded":"2024-09-18T02:04:36.346074+0000","last_fullsized":"2024-09-18T02:04:36.346074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:13.378109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.289268+0000","last_change":"2024-09-18T02:04:07.619059+0000","last_active":"2024-09-18T02:07:12.289268+0000","last_peered":"2024-09-18T02:07:12.289268+0000","last_clean":"2024-09-18T02:07:12.289268+0000","last_became_active":"2024-09-18T02:04:07.618153+0000","last_became_peered":"2024-09-18T02:04:07.618153+0000","last_unstale":"2024-09-18T02:07:12.289268+0000","last_undegraded":"2024-09-18T02:07:12.289268+0000","last_fullsized":"2024-09-18T02:07:12.289268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:28.091310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'9","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.333102+0000","last_change":"2024-09-18T02:03:59.560833+0000","last_active":"2024-09-18T02:06:06.333102+0000","last_peered":"2024-09-18T02:06:06.333102+0000","last_clean":"2024-09-18T02:06:06.333102+0000","last_became_active":"2024-09-18T02:03:59.559592+0000","last_became_peered":"2024-09-18T02:03:59.559592+0000","last_unstale":"2024-09-18T02:06:06.333102+0000","last_undegraded":"2024-09-18T02:06:06.333102+0000","last_fullsized":"2024-09-18T02:06:06.333102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:07.330297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.337223+0000","last_change":"2024-09-18T02:03:43.338768+0000","last_active":"2024-09-18T02:04:36.337223+0000","last_peered":"2024-09-18T02:04:36.337223+0000","last_clean":"2024-09-18T02:04:36.337223+0000","last_became_active":"2024-09-18T02:03:43.336731+0000","last_became_peered":"2024-09-18T02:03:43.336731+0000","last_unstale":"2024-09-18T02:04:36.337223+0000","last_undegraded":"2024-09-18T02:04:36.337223+0000","last_fullsized":"2024-09-18T02:04:36.337223+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_clean_scrub_stamp":"2024-09-18T02:03:42.235832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:47:03.749921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350315+0000","last_change":"2024-09-18T02:03:50.287984+0000","last_active":"2024-09-18T02:04:36.350315+0000","last_peered":"2024-09-18T02:04:36.350315+0000","last_clean":"2024-09-18T02:04:36.350315+0000","last_became_active":"2024-09-18T02:03:48.273444+0000","last_became_peered":"2024-09-18T02:03:48.273444+0000","last_unstale":"2024-09-18T02:04:36.350315+0000","last_undegraded":"2024-09-18T02:04:36.350315+0000","last_fullsized":"2024-09-18T02:04:36.350315+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:18.121435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024299339999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.048115+0000","last_change":"2024-09-18T02:03:57.533463+0000","last_active":"2024-09-18T02:06:11.048115+0000","last_peered":"2024-09-18T02:06:11.048115+0000","last_clean":"2024-09-18T02:06:11.048115+0000","last_became_active":"2024-09-18T02:03:57.532844+0000","last_became_peered":"2024-09-18T02:03:57.532844+0000","last_unstale":"2024-09-18T02:06:11.048115+0000","last_undegraded":"2024-09-18T02:06:11.048115+0000","last_fullsized":"2024-09-18T02:06:11.048115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:09.285157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.347738+0000","last_change":"2024-09-18T02:04:01.565115+0000","last_active":"2024-09-18T02:04:36.347738+0000","last_peered":"2024-09-18T02:04:36.347738+0000","last_clean":"2024-09-18T02:04:36.347738+0000","last_became_active":"2024-09-18T02:04:01.563633+0000","last_became_peered":"2024-09-18T02:04:01.563633+0000","last_unstale":"2024-09-18T02:04:36.347738+0000","last_undegraded":"2024-09-18T02:04:36.347738+0000","last_fullsized":"2024-09-18T02:04:36.347738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:13:18.066545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":160,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.139607+0000","last_change":"2024-09-18T02:04:03.607393+0000","last_active":"2024-09-18T02:06:09.139607+0000","last_peered":"2024-09-18T02:06:09.139607+0000","last_clean":"2024-09-18T02:06:09.139607+0000","last_became_active":"2024-09-18T02:04:03.606800+0000","last_became_peered":"2024-09-18T02:04:03.606800+0000","last_unstale":"2024-09-18T02:06:09.139607+0000","last_undegraded":"2024-09-18T02:06:09.139607+0000","last_fullsized":"2024-09-18T02:06:09.139607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:02:19.651160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":84,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345601+0000","last_change":"2024-09-18T02:04:05.589275+0000","last_active":"2024-09-18T02:04:36.345601+0000","last_peered":"2024-09-18T02:04:36.345601+0000","last_clean":"2024-09-18T02:04:36.345601+0000","last_became_active":"2024-09-18T02:04:05.588568+0000","last_became_peered":"2024-09-18T02:04:05.588568+0000","last_unstale":"2024-09-18T02:04:36.345601+0000","last_undegraded":"2024-09-18T02:04:36.345601+0000","last_fullsized":"2024-09-18T02:04:36.345601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:31.240038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.245394+0000","last_change":"2024-09-18T02:04:07.628613+0000","last_active":"2024-09-18T02:07:12.245394+0000","last_peered":"2024-09-18T02:07:12.245394+0000","last_clean":"2024-09-18T02:07:12.245394+0000","last_became_active":"2024-09-18T02:04:07.613914+0000","last_became_peered":"2024-09-18T02:04:07.613914+0000","last_unstale":"2024-09-18T02:07:12.245394+0000","last_undegraded":"2024-09-18T02:07:12.245394+0000","last_fullsized":"2024-09-18T02:07:12.245394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:11.758456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.169657+0000","last_change":"2024-09-18T02:03:59.556174+0000","last_active":"2024-09-18T02:07:12.169657+0000","last_peered":"2024-09-18T02:07:12.169657+0000","last_clean":"2024-09-18T02:07:12.169657+0000","last_became_active":"2024-09-18T02:03:59.555801+0000","last_became_peered":"2024-09-18T02:03:59.555801+0000","last_unstale":"2024-09-18T02:07:12.169657+0000","last_undegraded":"2024-09-18T02:07:12.169657+0000","last_fullsized":"2024-09-18T02:07:12.169657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:28.174295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346239+0000","last_change":"2024-09-18T02:03:50.285797+0000","last_active":"2024-09-18T02:04:36.346239+0000","last_peered":"2024-09-18T02:04:36.346239+0000","last_clean":"2024-09-18T02:04:36.346239+0000","last_became_active":"2024-09-18T02:03:48.275709+0000","last_became_peered":"2024-09-18T02:03:48.275709+0000","last_unstale":"2024-09-18T02:04:36.346239+0000","last_undegraded":"2024-09-18T02:04:36.346239+0000","last_fullsized":"2024-09-18T02:04:36.346239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:53.873897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047579399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339035+0000","last_change":"2024-09-18T02:03:57.521576+0000","last_active":"2024-09-18T02:04:36.339035+0000","last_peered":"2024-09-18T02:04:36.339035+0000","last_clean":"2024-09-18T02:04:36.339035+0000","last_became_active":"2024-09-18T02:03:57.520559+0000","last_became_peered":"2024-09-18T02:03:57.520559+0000","last_unstale":"2024-09-18T02:04:36.339035+0000","last_undegraded":"2024-09-18T02:04:36.339035+0000","last_fullsized":"2024-09-18T02:04:36.339035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.363932+0000","last_change":"2024-09-18T02:04:01.561598+0000","last_active":"2024-09-18T02:04:36.363932+0000","last_peered":"2024-09-18T02:04:36.363932+0000","last_clean":"2024-09-18T02:04:36.363932+0000","last_became_active":"2024-09-18T02:04:01.561194+0000","last_became_peered":"2024-09-18T02:04:01.561194+0000","last_unstale":"2024-09-18T02:04:36.363932+0000","last_undegraded":"2024-09-18T02:04:36.363932+0000","last_fullsized":"2024-09-18T02:04:36.363932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:23.937467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'279","reported_seq":489,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.782113+0000","last_change":"2024-09-18T02:04:03.571137+0000","last_active":"2024-09-18T02:07:11.782113+0000","last_peered":"2024-09-18T02:07:11.782113+0000","last_clean":"2024-09-18T02:07:11.782113+0000","last_became_active":"2024-09-18T02:04:03.570288+0000","last_became_peered":"2024-09-18T02:04:03.570288+0000","last_unstale":"2024-09-18T02:07:11.782113+0000","last_undegraded":"2024-09-18T02:07:11.782113+0000","last_fullsized":"2024-09-18T02:07:11.782113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:22.857455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353081+0000","last_change":"2024-09-18T02:04:05.609826+0000","last_active":"2024-09-18T02:04:36.353081+0000","last_peered":"2024-09-18T02:04:36.353081+0000","last_clean":"2024-09-18T02:04:36.353081+0000","last_became_active":"2024-09-18T02:04:05.608544+0000","last_became_peered":"2024-09-18T02:04:05.608544+0000","last_unstale":"2024-09-18T02:04:36.353081+0000","last_undegraded":"2024-09-18T02:04:36.353081+0000","last_fullsized":"2024-09-18T02:04:36.353081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:32:12.009097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'7","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.130305+0000","last_change":"2024-09-18T02:04:07.624305+0000","last_active":"2024-09-18T02:07:12.130305+0000","last_peered":"2024-09-18T02:07:12.130305+0000","last_clean":"2024-09-18T02:07:12.130305+0000","last_became_active":"2024-09-18T02:04:07.622337+0000","last_became_peered":"2024-09-18T02:04:07.622337+0000","last_unstale":"2024-09-18T02:07:12.130305+0000","last_undegraded":"2024-09-18T02:07:12.130305+0000","last_fullsized":"2024-09-18T02:07:12.130305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:48.413588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153178+0000","last_change":"2024-09-18T02:03:59.549829+0000","last_active":"2024-09-18T02:07:12.153178+0000","last_peered":"2024-09-18T02:07:12.153178+0000","last_clean":"2024-09-18T02:07:12.153178+0000","last_became_active":"2024-09-18T02:03:59.548308+0000","last_became_peered":"2024-09-18T02:03:59.548308+0000","last_unstale":"2024-09-18T02:07:12.153178+0000","last_undegraded":"2024-09-18T02:07:12.153178+0000","last_fullsized":"2024-09-18T02:07:12.153178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:36.437530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341109+0000","last_change":"2024-09-18T02:03:50.338272+0000","last_active":"2024-09-18T02:04:36.341109+0000","last_peered":"2024-09-18T02:04:36.341109+0000","last_clean":"2024-09-18T02:04:36.341109+0000","last_became_active":"2024-09-18T02:03:48.275609+0000","last_became_peered":"2024-09-18T02:03:48.275609+0000","last_unstale":"2024-09-18T02:04:36.341109+0000","last_undegraded":"2024-09-18T02:04:36.341109+0000","last_fullsized":"2024-09-18T02:04:36.341109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067244799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.346475+0000","last_change":"2024-09-18T02:03:57.520998+0000","last_active":"2024-09-18T02:04:41.346475+0000","last_peered":"2024-09-18T02:04:41.346475+0000","last_clean":"2024-09-18T02:04:41.346475+0000","last_became_active":"2024-09-18T02:03:57.520103+0000","last_became_peered":"2024-09-18T02:03:57.520103+0000","last_unstale":"2024-09-18T02:04:41.346475+0000","last_undegraded":"2024-09-18T02:04:41.346475+0000","last_fullsized":"2024-09-18T02:04:41.346475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.369051+0000","last_change":"2024-09-18T02:04:01.560743+0000","last_active":"2024-09-18T02:04:36.369051+0000","last_peered":"2024-09-18T02:04:36.369051+0000","last_clean":"2024-09-18T02:04:36.369051+0000","last_became_active":"2024-09-18T02:04:01.560471+0000","last_became_peered":"2024-09-18T02:04:01.560471+0000","last_unstale":"2024-09-18T02:04:36.369051+0000","last_undegraded":"2024-09-18T02:04:36.369051+0000","last_fullsized":"2024-09-18T02:04:36.369051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:05.940301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.783060+0000","last_change":"2024-09-18T02:04:03.589654+0000","last_active":"2024-09-18T02:07:11.783060+0000","last_peered":"2024-09-18T02:07:11.783060+0000","last_clean":"2024-09-18T02:07:11.783060+0000","last_became_active":"2024-09-18T02:04:03.588913+0000","last_became_peered":"2024-09-18T02:04:03.588913+0000","last_unstale":"2024-09-18T02:07:11.783060+0000","last_undegraded":"2024-09-18T02:07:11.783060+0000","last_fullsized":"2024-09-18T02:07:11.783060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:24.835730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339832+0000","last_change":"2024-09-18T02:04:05.589310+0000","last_active":"2024-09-18T02:04:36.339832+0000","last_peered":"2024-09-18T02:04:36.339832+0000","last_clean":"2024-09-18T02:04:36.339832+0000","last_became_active":"2024-09-18T02:04:05.588457+0000","last_became_peered":"2024-09-18T02:04:05.588457+0000","last_unstale":"2024-09-18T02:04:36.339832+0000","last_undegraded":"2024-09-18T02:04:36.339832+0000","last_fullsized":"2024-09-18T02:04:36.339832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:27.971023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348229+0000","last_change":"2024-09-18T02:04:07.622460+0000","last_active":"2024-09-18T02:04:36.348229+0000","last_peered":"2024-09-18T02:04:36.348229+0000","last_clean":"2024-09-18T02:04:36.348229+0000","last_became_active":"2024-09-18T02:04:07.621651+0000","last_became_peered":"2024-09-18T02:04:07.621651+0000","last_unstale":"2024-09-18T02:04:36.348229+0000","last_undegraded":"2024-09-18T02:04:36.348229+0000","last_fullsized":"2024-09-18T02:04:36.348229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:58.105568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342749+0000","last_change":"2024-09-18T02:03:59.536526+0000","last_active":"2024-09-18T02:04:36.342749+0000","last_peered":"2024-09-18T02:04:36.342749+0000","last_clean":"2024-09-18T02:04:36.342749+0000","last_became_active":"2024-09-18T02:03:59.535693+0000","last_became_peered":"2024-09-18T02:03:59.535693+0000","last_unstale":"2024-09-18T02:04:36.342749+0000","last_undegraded":"2024-09-18T02:04:36.342749+0000","last_fullsized":"2024-09-18T02:04:36.342749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:45.343721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348980+0000","last_change":"2024-09-18T02:03:50.287790+0000","last_active":"2024-09-18T02:04:36.348980+0000","last_peered":"2024-09-18T02:04:36.348980+0000","last_clean":"2024-09-18T02:04:36.348980+0000","last_became_active":"2024-09-18T02:03:48.276543+0000","last_became_peered":"2024-09-18T02:03:48.276543+0000","last_unstale":"2024-09-18T02:04:36.348980+0000","last_undegraded":"2024-09-18T02:04:36.348980+0000","last_fullsized":"2024-09-18T02:04:36.348980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:17.356845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023330579999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.344795+0000","last_change":"2024-09-18T02:03:57.529138+0000","last_active":"2024-09-18T02:04:36.344795+0000","last_peered":"2024-09-18T02:04:36.344795+0000","last_clean":"2024-09-18T02:04:36.344795+0000","last_became_active":"2024-09-18T02:03:57.528828+0000","last_became_peered":"2024-09-18T02:03:57.528828+0000","last_unstale":"2024-09-18T02:04:36.344795+0000","last_undegraded":"2024-09-18T02:04:36.344795+0000","last_fullsized":"2024-09-18T02:04:36.344795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:40.008713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342804+0000","last_change":"2024-09-18T02:04:01.572278+0000","last_active":"2024-09-18T02:04:36.342804+0000","last_peered":"2024-09-18T02:04:36.342804+0000","last_clean":"2024-09-18T02:04:36.342804+0000","last_became_active":"2024-09-18T02:04:01.571608+0000","last_became_peered":"2024-09-18T02:04:01.571608+0000","last_unstale":"2024-09-18T02:04:36.342804+0000","last_undegraded":"2024-09-18T02:04:36.342804+0000","last_fullsized":"2024-09-18T02:04:36.342804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:01.789731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.140114+0000","last_change":"2024-09-18T02:04:03.602343+0000","last_active":"2024-09-18T02:07:11.140114+0000","last_peered":"2024-09-18T02:07:11.140114+0000","last_clean":"2024-09-18T02:07:11.140114+0000","last_became_active":"2024-09-18T02:04:03.601140+0000","last_became_peered":"2024-09-18T02:04:03.601140+0000","last_unstale":"2024-09-18T02:07:11.140114+0000","last_undegraded":"2024-09-18T02:07:11.140114+0000","last_fullsized":"2024-09-18T02:07:11.140114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:33:06.804055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358317+0000","last_change":"2024-09-18T02:04:05.612576+0000","last_active":"2024-09-18T02:04:36.358317+0000","last_peered":"2024-09-18T02:04:36.358317+0000","last_clean":"2024-09-18T02:04:36.358317+0000","last_became_active":"2024-09-18T02:04:05.612007+0000","last_became_peered":"2024-09-18T02:04:05.612007+0000","last_unstale":"2024-09-18T02:04:36.358317+0000","last_undegraded":"2024-09-18T02:04:36.358317+0000","last_fullsized":"2024-09-18T02:04:36.358317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:53:26.368935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.716259+0000","last_change":"2024-09-18T02:04:07.623097+0000","last_active":"2024-09-18T02:06:10.716259+0000","last_peered":"2024-09-18T02:06:10.716259+0000","last_clean":"2024-09-18T02:06:10.716259+0000","last_became_active":"2024-09-18T02:04:07.622247+0000","last_became_peered":"2024-09-18T02:04:07.622247+0000","last_unstale":"2024-09-18T02:06:10.716259+0000","last_undegraded":"2024-09-18T02:06:10.716259+0000","last_fullsized":"2024-09-18T02:06:10.716259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:17.300649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.954084+0000","last_change":"2024-09-18T02:03:59.560066+0000","last_active":"2024-09-18T02:06:06.954084+0000","last_peered":"2024-09-18T02:06:06.954084+0000","last_clean":"2024-09-18T02:06:06.954084+0000","last_became_active":"2024-09-18T02:03:59.559749+0000","last_became_peered":"2024-09-18T02:03:59.559749+0000","last_unstale":"2024-09-18T02:06:06.954084+0000","last_undegraded":"2024-09-18T02:06:06.954084+0000","last_fullsized":"2024-09-18T02:06:06.954084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364329+0000","last_change":"2024-09-18T02:03:57.524455+0000","last_active":"2024-09-18T02:04:36.364329+0000","last_peered":"2024-09-18T02:04:36.364329+0000","last_clean":"2024-09-18T02:04:36.364329+0000","last_became_active":"2024-09-18T02:03:57.519961+0000","last_became_peered":"2024-09-18T02:03:57.519961+0000","last_unstale":"2024-09-18T02:04:36.364329+0000","last_undegraded":"2024-09-18T02:04:36.364329+0000","last_fullsized":"2024-09-18T02:04:36.364329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:59.657833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339529+0000","last_change":"2024-09-18T02:03:50.282381+0000","last_active":"2024-09-18T02:04:36.339529+0000","last_peered":"2024-09-18T02:04:36.339529+0000","last_clean":"2024-09-18T02:04:36.339529+0000","last_became_active":"2024-09-18T02:03:48.274657+0000","last_became_peered":"2024-09-18T02:03:48.274657+0000","last_unstale":"2024-09-18T02:04:36.339529+0000","last_undegraded":"2024-09-18T02:04:36.339529+0000","last_fullsized":"2024-09-18T02:04:36.339529+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000970169,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329258+0000","last_change":"2024-09-18T02:04:01.572119+0000","last_active":"2024-09-18T02:06:06.329258+0000","last_peered":"2024-09-18T02:06:06.329258+0000","last_clean":"2024-09-18T02:06:06.329258+0000","last_became_active":"2024-09-18T02:04:01.571443+0000","last_became_peered":"2024-09-18T02:04:01.571443+0000","last_unstale":"2024-09-18T02:06:06.329258+0000","last_undegraded":"2024-09-18T02:06:06.329258+0000","last_fullsized":"2024-09-18T02:06:06.329258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:30:51.643126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'75","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.141667+0000","last_change":"2024-09-18T02:04:03.570750+0000","last_active":"2024-09-18T02:06:09.141667+0000","last_peered":"2024-09-18T02:06:09.141667+0000","last_clean":"2024-09-18T02:06:09.141667+0000","last_became_active":"2024-09-18T02:04:03.569938+0000","last_became_peered":"2024-09-18T02:04:03.569938+0000","last_unstale":"2024-09-18T02:06:09.141667+0000","last_undegraded":"2024-09-18T02:06:09.141667+0000","last_fullsized":"2024-09-18T02:06:09.141667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:24:06.892910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341836+0000","last_change":"2024-09-18T02:04:05.600403+0000","last_active":"2024-09-18T02:04:36.341836+0000","last_peered":"2024-09-18T02:04:36.341836+0000","last_clean":"2024-09-18T02:04:36.341836+0000","last_became_active":"2024-09-18T02:04:05.597181+0000","last_became_peered":"2024-09-18T02:04:05.597181+0000","last_unstale":"2024-09-18T02:04:36.341836+0000","last_undegraded":"2024-09-18T02:04:36.341836+0000","last_fullsized":"2024-09-18T02:04:36.341836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:34.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.978758+0000","last_change":"2024-09-18T02:04:07.619359+0000","last_active":"2024-09-18T02:06:10.978758+0000","last_peered":"2024-09-18T02:06:10.978758+0000","last_clean":"2024-09-18T02:06:10.978758+0000","last_became_active":"2024-09-18T02:04:07.618751+0000","last_became_peered":"2024-09-18T02:04:07.618751+0000","last_unstale":"2024-09-18T02:06:10.978758+0000","last_undegraded":"2024-09-18T02:06:10.978758+0000","last_fullsized":"2024-09-18T02:06:10.978758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:46.149767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.133793+0000","last_change":"2024-09-18T02:03:59.554002+0000","last_active":"2024-09-18T02:04:42.133793+0000","last_peered":"2024-09-18T02:04:42.133793+0000","last_clean":"2024-09-18T02:04:42.133793+0000","last_became_active":"2024-09-18T02:03:59.553619+0000","last_became_peered":"2024-09-18T02:03:59.553619+0000","last_unstale":"2024-09-18T02:04:42.133793+0000","last_undegraded":"2024-09-18T02:04:42.133793+0000","last_fullsized":"2024-09-18T02:04:42.133793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:31:07.318399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.915234+0000","last_change":"2024-09-18T02:03:57.519164+0000","last_active":"2024-09-18T02:04:42.915234+0000","last_peered":"2024-09-18T02:04:42.915234+0000","last_clean":"2024-09-18T02:04:42.915234+0000","last_became_active":"2024-09-18T02:03:57.518503+0000","last_became_peered":"2024-09-18T02:03:57.518503+0000","last_unstale":"2024-09-18T02:04:42.915234+0000","last_undegraded":"2024-09-18T02:04:42.915234+0000","last_fullsized":"2024-09-18T02:04:42.915234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:32.979432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353911+0000","last_change":"2024-09-18T02:03:50.288345+0000","last_active":"2024-09-18T02:04:36.353911+0000","last_peered":"2024-09-18T02:04:36.353911+0000","last_clean":"2024-09-18T02:04:36.353911+0000","last_became_active":"2024-09-18T02:03:48.276300+0000","last_became_peered":"2024-09-18T02:03:48.276300+0000","last_unstale":"2024-09-18T02:04:36.353911+0000","last_undegraded":"2024-09-18T02:04:36.353911+0000","last_fullsized":"2024-09-18T02:04:36.353911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:57.432759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002788245,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349422+0000","last_change":"2024-09-18T02:04:01.558361+0000","last_active":"2024-09-18T02:04:36.349422+0000","last_peered":"2024-09-18T02:04:36.349422+0000","last_clean":"2024-09-18T02:04:36.349422+0000","last_became_active":"2024-09-18T02:04:01.557570+0000","last_became_peered":"2024-09-18T02:04:01.557570+0000","last_unstale":"2024-09-18T02:04:36.349422+0000","last_undegraded":"2024-09-18T02:04:36.349422+0000","last_fullsized":"2024-09-18T02:04:36.349422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:35:33.472211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340131+0000","last_change":"2024-09-18T02:04:03.589283+0000","last_active":"2024-09-18T02:04:36.340131+0000","last_peered":"2024-09-18T02:04:36.340131+0000","last_clean":"2024-09-18T02:04:36.340131+0000","last_became_active":"2024-09-18T02:04:03.588539+0000","last_became_peered":"2024-09-18T02:04:03.588539+0000","last_unstale":"2024-09-18T02:04:36.340131+0000","last_undegraded":"2024-09-18T02:04:36.340131+0000","last_fullsized":"2024-09-18T02:04:36.340131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:11.364586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":347,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.782214+0000","last_change":"2024-09-18T02:04:05.583286+0000","last_active":"2024-09-18T02:07:11.782214+0000","last_peered":"2024-09-18T02:07:11.782214+0000","last_clean":"2024-09-18T02:07:11.782214+0000","last_became_active":"2024-09-18T02:04:05.582477+0000","last_became_peered":"2024-09-18T02:04:05.582477+0000","last_unstale":"2024-09-18T02:07:11.782214+0000","last_undegraded":"2024-09-18T02:07:11.782214+0000","last_fullsized":"2024-09-18T02:07:11.782214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:54.620838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.110007+0000","last_change":"2024-09-18T02:04:07.606623+0000","last_active":"2024-09-18T02:06:11.110007+0000","last_peered":"2024-09-18T02:06:11.110007+0000","last_clean":"2024-09-18T02:06:11.110007+0000","last_became_active":"2024-09-18T02:04:07.605591+0000","last_became_peered":"2024-09-18T02:04:07.605591+0000","last_unstale":"2024-09-18T02:06:11.110007+0000","last_undegraded":"2024-09-18T02:06:11.110007+0000","last_fullsized":"2024-09-18T02:06:11.110007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:37.470495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999320+0000","last_change":"2024-09-18T02:03:59.559409+0000","last_active":"2024-09-18T02:05:25.999320+0000","last_peered":"2024-09-18T02:05:25.999320+0000","last_clean":"2024-09-18T02:05:25.999320+0000","last_became_active":"2024-09-18T02:03:59.559044+0000","last_became_peered":"2024-09-18T02:03:59.559044+0000","last_unstale":"2024-09-18T02:05:25.999320+0000","last_undegraded":"2024-09-18T02:05:25.999320+0000","last_fullsized":"2024-09-18T02:05:25.999320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:14.041290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.362611+0000","last_change":"2024-09-18T02:03:57.522060+0000","last_active":"2024-09-18T02:04:36.362611+0000","last_peered":"2024-09-18T02:04:36.362611+0000","last_clean":"2024-09-18T02:04:36.362611+0000","last_became_active":"2024-09-18T02:03:57.521706+0000","last_became_peered":"2024-09-18T02:03:57.521706+0000","last_unstale":"2024-09-18T02:04:36.362611+0000","last_undegraded":"2024-09-18T02:04:36.362611+0000","last_fullsized":"2024-09-18T02:04:36.362611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:43.330210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342536+0000","last_change":"2024-09-18T02:03:50.282549+0000","last_active":"2024-09-18T02:04:36.342536+0000","last_peered":"2024-09-18T02:04:36.342536+0000","last_clean":"2024-09-18T02:04:36.342536+0000","last_became_active":"2024-09-18T02:03:48.274030+0000","last_became_peered":"2024-09-18T02:03:48.274030+0000","last_unstale":"2024-09-18T02:04:36.342536+0000","last_undegraded":"2024-09-18T02:04:36.342536+0000","last_fullsized":"2024-09-18T02:04:36.342536+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:21:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011092910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349976+0000","last_change":"2024-09-18T02:04:01.559241+0000","last_active":"2024-09-18T02:04:36.349976+0000","last_peered":"2024-09-18T02:04:36.349976+0000","last_clean":"2024-09-18T02:04:36.349976+0000","last_became_active":"2024-09-18T02:04:01.558915+0000","last_became_peered":"2024-09-18T02:04:01.558915+0000","last_unstale":"2024-09-18T02:04:36.349976+0000","last_undegraded":"2024-09-18T02:04:36.349976+0000","last_fullsized":"2024-09-18T02:04:36.349976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:22.220646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350138+0000","last_change":"2024-09-18T02:04:03.595150+0000","last_active":"2024-09-18T02:04:36.350138+0000","last_peered":"2024-09-18T02:04:36.350138+0000","last_clean":"2024-09-18T02:04:36.350138+0000","last_became_active":"2024-09-18T02:04:03.591378+0000","last_became_peered":"2024-09-18T02:04:03.591378+0000","last_unstale":"2024-09-18T02:04:36.350138+0000","last_undegraded":"2024-09-18T02:04:36.350138+0000","last_fullsized":"2024-09-18T02:04:36.350138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:37.068150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.377867+0000","last_change":"2024-09-18T02:04:05.605812+0000","last_active":"2024-09-18T02:07:12.377867+0000","last_peered":"2024-09-18T02:07:12.377867+0000","last_clean":"2024-09-18T02:07:12.377867+0000","last_became_active":"2024-09-18T02:04:05.605265+0000","last_became_peered":"2024-09-18T02:04:05.605265+0000","last_unstale":"2024-09-18T02:07:12.377867+0000","last_undegraded":"2024-09-18T02:07:12.377867+0000","last_fullsized":"2024-09-18T02:07:12.377867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:35:37.505766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.963901+0000","last_change":"2024-09-18T02:04:07.624755+0000","last_active":"2024-09-18T02:06:06.963901+0000","last_peered":"2024-09-18T02:06:06.963901+0000","last_clean":"2024-09-18T02:06:06.963901+0000","last_became_active":"2024-09-18T02:04:07.624085+0000","last_became_peered":"2024-09-18T02:04:07.624085+0000","last_unstale":"2024-09-18T02:06:06.963901+0000","last_undegraded":"2024-09-18T02:06:06.963901+0000","last_fullsized":"2024-09-18T02:06:06.963901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:22.537224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340548+0000","last_change":"2024-09-18T02:03:59.535655+0000","last_active":"2024-09-18T02:04:36.340548+0000","last_peered":"2024-09-18T02:04:36.340548+0000","last_clean":"2024-09-18T02:04:36.340548+0000","last_became_active":"2024-09-18T02:03:59.535266+0000","last_became_peered":"2024-09-18T02:03:59.535266+0000","last_unstale":"2024-09-18T02:04:36.340548+0000","last_undegraded":"2024-09-18T02:04:36.340548+0000","last_fullsized":"2024-09-18T02:04:36.340548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.342844+0000","last_change":"2024-09-18T02:03:57.529076+0000","last_active":"2024-09-18T02:04:41.342844+0000","last_peered":"2024-09-18T02:04:41.342844+0000","last_clean":"2024-09-18T02:04:41.342844+0000","last_became_active":"2024-09-18T02:03:57.528676+0000","last_became_peered":"2024-09-18T02:03:57.528676+0000","last_unstale":"2024-09-18T02:04:41.342844+0000","last_undegraded":"2024-09-18T02:04:41.342844+0000","last_fullsized":"2024-09-18T02:04:41.342844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358547+0000","last_change":"2024-09-18T02:03:50.288611+0000","last_active":"2024-09-18T02:04:36.358547+0000","last_peered":"2024-09-18T02:04:36.358547+0000","last_clean":"2024-09-18T02:04:36.358547+0000","last_became_active":"2024-09-18T02:03:48.396609+0000","last_became_peered":"2024-09-18T02:03:48.396609+0000","last_unstale":"2024-09-18T02:04:36.358547+0000","last_undegraded":"2024-09-18T02:04:36.358547+0000","last_fullsized":"2024-09-18T02:04:36.358547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:40:52.248589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025902970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348392+0000","last_change":"2024-09-18T02:04:01.562114+0000","last_active":"2024-09-18T02:04:36.348392+0000","last_peered":"2024-09-18T02:04:36.348392+0000","last_clean":"2024-09-18T02:04:36.348392+0000","last_became_active":"2024-09-18T02:04:01.561488+0000","last_became_peered":"2024-09-18T02:04:01.561488+0000","last_unstale":"2024-09-18T02:04:36.348392+0000","last_undegraded":"2024-09-18T02:04:36.348392+0000","last_fullsized":"2024-09-18T02:04:36.348392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:00.270005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'88","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.119183+0000","last_change":"2024-09-18T02:04:03.586693+0000","last_active":"2024-09-18T02:06:09.119183+0000","last_peered":"2024-09-18T02:06:09.119183+0000","last_clean":"2024-09-18T02:06:09.119183+0000","last_became_active":"2024-09-18T02:04:03.585879+0000","last_became_peered":"2024-09-18T02:04:03.585879+0000","last_unstale":"2024-09-18T02:06:09.119183+0000","last_undegraded":"2024-09-18T02:06:09.119183+0000","last_fullsized":"2024-09-18T02:06:09.119183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:19.044304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342766+0000","last_change":"2024-09-18T02:04:05.589374+0000","last_active":"2024-09-18T02:04:36.342766+0000","last_peered":"2024-09-18T02:04:36.342766+0000","last_clean":"2024-09-18T02:04:36.342766+0000","last_became_active":"2024-09-18T02:04:05.588676+0000","last_became_peered":"2024-09-18T02:04:05.588676+0000","last_unstale":"2024-09-18T02:04:36.342766+0000","last_undegraded":"2024-09-18T02:04:36.342766+0000","last_fullsized":"2024-09-18T02:04:36.342766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:18.118339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.995352+0000","last_change":"2024-09-18T02:04:07.620173+0000","last_active":"2024-09-18T02:05:25.995352+0000","last_peered":"2024-09-18T02:05:25.995352+0000","last_clean":"2024-09-18T02:05:25.995352+0000","last_became_active":"2024-09-18T02:04:07.619587+0000","last_became_peered":"2024-09-18T02:04:07.619587+0000","last_unstale":"2024-09-18T02:05:25.995352+0000","last_undegraded":"2024-09-18T02:05:25.995352+0000","last_fullsized":"2024-09-18T02:05:25.995352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:28.267582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.362280+0000","last_change":"2024-09-18T02:04:07.628261+0000","last_active":"2024-09-18T02:04:36.362280+0000","last_peered":"2024-09-18T02:04:36.362280+0000","last_clean":"2024-09-18T02:04:36.362280+0000","last_became_active":"2024-09-18T02:04:07.626396+0000","last_became_peered":"2024-09-18T02:04:07.626396+0000","last_unstale":"2024-09-18T02:04:36.362280+0000","last_undegraded":"2024-09-18T02:04:36.362280+0000","last_fullsized":"2024-09-18T02:04:36.362280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:06.316942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.334934+0000","last_change":"2024-09-18T02:03:59.538659+0000","last_active":"2024-09-18T02:06:21.334934+0000","last_peered":"2024-09-18T02:06:21.334934+0000","last_clean":"2024-09-18T02:06:21.334934+0000","last_became_active":"2024-09-18T02:03:59.538280+0000","last_became_peered":"2024-09-18T02:03:59.538280+0000","last_unstale":"2024-09-18T02:06:21.334934+0000","last_undegraded":"2024-09-18T02:06:21.334934+0000","last_fullsized":"2024-09-18T02:06:21.334934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353217+0000","last_change":"2024-09-18T02:03:57.531366+0000","last_active":"2024-09-18T02:04:36.353217+0000","last_peered":"2024-09-18T02:04:36.353217+0000","last_clean":"2024-09-18T02:04:36.353217+0000","last_became_active":"2024-09-18T02:03:57.530751+0000","last_became_peered":"2024-09-18T02:03:57.530751+0000","last_unstale":"2024-09-18T02:04:36.353217+0000","last_undegraded":"2024-09-18T02:04:36.353217+0000","last_fullsized":"2024-09-18T02:04:36.353217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:13.572982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339720+0000","last_change":"2024-09-18T02:04:01.561923+0000","last_active":"2024-09-18T02:04:36.339720+0000","last_peered":"2024-09-18T02:04:36.339720+0000","last_clean":"2024-09-18T02:04:36.339720+0000","last_became_active":"2024-09-18T02:04:01.561230+0000","last_became_peered":"2024-09-18T02:04:01.561230+0000","last_unstale":"2024-09-18T02:04:36.339720+0000","last_undegraded":"2024-09-18T02:04:36.339720+0000","last_fullsized":"2024-09-18T02:04:36.339720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:33.717350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.128263+0000","last_change":"2024-09-18T02:04:03.595872+0000","last_active":"2024-09-18T02:06:09.128263+0000","last_peered":"2024-09-18T02:06:09.128263+0000","last_clean":"2024-09-18T02:06:09.128263+0000","last_became_active":"2024-09-18T02:04:03.595284+0000","last_became_peered":"2024-09-18T02:04:03.595284+0000","last_unstale":"2024-09-18T02:06:09.128263+0000","last_undegraded":"2024-09-18T02:06:09.128263+0000","last_fullsized":"2024-09-18T02:06:09.128263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:04.625050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348172+0000","last_change":"2024-09-18T02:04:05.603244+0000","last_active":"2024-09-18T02:04:36.348172+0000","last_peered":"2024-09-18T02:04:36.348172+0000","last_clean":"2024-09-18T02:04:36.348172+0000","last_became_active":"2024-09-18T02:04:05.602528+0000","last_became_peered":"2024-09-18T02:04:05.602528+0000","last_unstale":"2024-09-18T02:04:36.348172+0000","last_undegraded":"2024-09-18T02:04:36.348172+0000","last_fullsized":"2024-09-18T02:04:36.348172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:08:44.924870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:08.724227+0000","last_change":"2024-09-18T02:04:07.623315+0000","last_active":"2024-09-18T02:06:08.724227+0000","last_peered":"2024-09-18T02:06:08.724227+0000","last_clean":"2024-09-18T02:06:08.724227+0000","last_became_active":"2024-09-18T02:04:07.622753+0000","last_became_peered":"2024-09-18T02:04:07.622753+0000","last_unstale":"2024-09-18T02:06:08.724227+0000","last_undegraded":"2024-09-18T02:06:08.724227+0000","last_fullsized":"2024-09-18T02:06:08.724227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:08:47.142951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'9","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.090383+0000","last_change":"2024-09-18T02:03:59.555234+0000","last_active":"2024-09-18T02:07:12.090383+0000","last_peered":"2024-09-18T02:07:12.090383+0000","last_clean":"2024-09-18T02:07:12.090383+0000","last_became_active":"2024-09-18T02:03:59.554803+0000","last_became_peered":"2024-09-18T02:03:59.554803+0000","last_unstale":"2024-09-18T02:07:12.090383+0000","last_undegraded":"2024-09-18T02:07:12.090383+0000","last_fullsized":"2024-09-18T02:07:12.090383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364065+0000","last_change":"2024-09-18T02:03:57.522614+0000","last_active":"2024-09-18T02:04:36.364065+0000","last_peered":"2024-09-18T02:04:36.364065+0000","last_clean":"2024-09-18T02:04:36.364065+0000","last_became_active":"2024-09-18T02:03:57.519403+0000","last_became_peered":"2024-09-18T02:03:57.519403+0000","last_unstale":"2024-09-18T02:04:36.364065+0000","last_undegraded":"2024-09-18T02:04:36.364065+0000","last_fullsized":"2024-09-18T02:04:36.364065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.351923+0000","last_change":"2024-09-18T02:04:01.561432+0000","last_active":"2024-09-18T02:04:36.351923+0000","last_peered":"2024-09-18T02:04:36.351923+0000","last_clean":"2024-09-18T02:04:36.351923+0000","last_became_active":"2024-09-18T02:04:01.558788+0000","last_became_peered":"2024-09-18T02:04:01.558788+0000","last_unstale":"2024-09-18T02:04:36.351923+0000","last_undegraded":"2024-09-18T02:04:36.351923+0000","last_fullsized":"2024-09-18T02:04:36.351923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:11.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.150563+0000","last_change":"2024-09-18T02:04:03.581820+0000","last_active":"2024-09-18T02:07:11.150563+0000","last_peered":"2024-09-18T02:07:11.150563+0000","last_clean":"2024-09-18T02:07:11.150563+0000","last_became_active":"2024-09-18T02:04:03.581045+0000","last_became_peered":"2024-09-18T02:04:03.581045+0000","last_unstale":"2024-09-18T02:07:11.150563+0000","last_undegraded":"2024-09-18T02:07:11.150563+0000","last_fullsized":"2024-09-18T02:07:11.150563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:58.075420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341472+0000","last_change":"2024-09-18T02:04:05.600005+0000","last_active":"2024-09-18T02:04:36.341472+0000","last_peered":"2024-09-18T02:04:36.341472+0000","last_clean":"2024-09-18T02:04:36.341472+0000","last_became_active":"2024-09-18T02:04:05.599064+0000","last_became_peered":"2024-09-18T02:04:05.599064+0000","last_unstale":"2024-09-18T02:04:36.341472+0000","last_undegraded":"2024-09-18T02:04:36.341472+0000","last_fullsized":"2024-09-18T02:04:36.341472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:24:08.906433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339501+0000","last_change":"2024-09-18T02:04:07.610644+0000","last_active":"2024-09-18T02:04:36.339501+0000","last_peered":"2024-09-18T02:04:36.339501+0000","last_clean":"2024-09-18T02:04:36.339501+0000","last_became_active":"2024-09-18T02:04:07.609954+0000","last_became_peered":"2024-09-18T02:04:07.609954+0000","last_unstale":"2024-09-18T02:04:36.339501+0000","last_undegraded":"2024-09-18T02:04:36.339501+0000","last_fullsized":"2024-09-18T02:04:36.339501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:07:58.304562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089718+0000","last_change":"2024-09-18T02:03:59.550899+0000","last_active":"2024-09-18T02:07:12.089718+0000","last_peered":"2024-09-18T02:07:12.089718+0000","last_clean":"2024-09-18T02:07:12.089718+0000","last_became_active":"2024-09-18T02:03:59.549791+0000","last_became_peered":"2024-09-18T02:03:59.549791+0000","last_unstale":"2024-09-18T02:07:12.089718+0000","last_undegraded":"2024-09-18T02:07:12.089718+0000","last_fullsized":"2024-09-18T02:07:12.089718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.372750+0000","last_change":"2024-09-18T02:04:36.371010+0000","last_active":"2024-09-18T02:04:36.372750+0000","last_peered":"2024-09-18T02:04:36.372750+0000","last_clean":"2024-09-18T02:04:36.372750+0000","last_became_active":"2024-09-18T02:04:36.370188+0000","last_became_peered":"2024-09-18T02:04:36.370188+0000","last_unstale":"2024-09-18T02:04:36.372750+0000","last_undegraded":"2024-09-18T02:04:36.372750+0000","last_fullsized":"2024-09-18T02:04:36.372750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:09.187217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339915+0000","last_change":"2024-09-18T02:04:01.563073+0000","last_active":"2024-09-18T02:04:36.339915+0000","last_peered":"2024-09-18T02:04:36.339915+0000","last_clean":"2024-09-18T02:04:36.339915+0000","last_became_active":"2024-09-18T02:04:01.562586+0000","last_became_peered":"2024-09-18T02:04:01.562586+0000","last_unstale":"2024-09-18T02:04:36.339915+0000","last_undegraded":"2024-09-18T02:04:36.339915+0000","last_fullsized":"2024-09-18T02:04:36.339915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:14.943821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'42","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.236537+0000","last_change":"2024-09-18T02:04:03.579212+0000","last_active":"2024-09-18T02:07:11.236537+0000","last_peered":"2024-09-18T02:07:11.236537+0000","last_clean":"2024-09-18T02:07:11.236537+0000","last_became_active":"2024-09-18T02:04:03.578581+0000","last_became_peered":"2024-09-18T02:04:03.578581+0000","last_unstale":"2024-09-18T02:07:11.236537+0000","last_undegraded":"2024-09-18T02:07:11.236537+0000","last_fullsized":"2024-09-18T02:07:11.236537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:17.779908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338314+0000","last_change":"2024-09-18T02:04:05.587685+0000","last_active":"2024-09-18T02:04:36.338314+0000","last_peered":"2024-09-18T02:04:36.338314+0000","last_clean":"2024-09-18T02:04:36.338314+0000","last_became_active":"2024-09-18T02:04:05.586978+0000","last_became_peered":"2024-09-18T02:04:05.586978+0000","last_unstale":"2024-09-18T02:04:36.338314+0000","last_undegraded":"2024-09-18T02:04:36.338314+0000","last_fullsized":"2024-09-18T02:04:36.338314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:36.991801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.935106+0000","last_change":"2024-09-18T02:04:07.611859+0000","last_active":"2024-09-18T02:04:42.935106+0000","last_peered":"2024-09-18T02:04:42.935106+0000","last_clean":"2024-09-18T02:04:42.935106+0000","last_became_active":"2024-09-18T02:04:07.607227+0000","last_became_peered":"2024-09-18T02:04:07.607227+0000","last_unstale":"2024-09-18T02:04:42.935106+0000","last_undegraded":"2024-09-18T02:04:42.935106+0000","last_fullsized":"2024-09-18T02:04:42.935106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:15.944064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.303117+0000","last_change":"2024-09-18T02:03:59.550610+0000","last_active":"2024-09-18T02:05:26.303117+0000","last_peered":"2024-09-18T02:05:26.303117+0000","last_clean":"2024-09-18T02:05:26.303117+0000","last_became_active":"2024-09-18T02:03:59.550221+0000","last_became_peered":"2024-09-18T02:03:59.550221+0000","last_unstale":"2024-09-18T02:05:26.303117+0000","last_undegraded":"2024-09-18T02:05:26.303117+0000","last_fullsized":"2024-09-18T02:05:26.303117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:20.801441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342516+0000","last_change":"2024-09-18T02:03:57.523727+0000","last_active":"2024-09-18T02:04:36.342516+0000","last_peered":"2024-09-18T02:04:36.342516+0000","last_clean":"2024-09-18T02:04:36.342516+0000","last_became_active":"2024-09-18T02:03:57.522590+0000","last_became_peered":"2024-09-18T02:03:57.522590+0000","last_unstale":"2024-09-18T02:04:36.342516+0000","last_undegraded":"2024-09-18T02:04:36.342516+0000","last_fullsized":"2024-09-18T02:04:36.342516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350028+0000","last_change":"2024-09-18T02:04:01.566731+0000","last_active":"2024-09-18T02:04:36.350028+0000","last_peered":"2024-09-18T02:04:36.350028+0000","last_clean":"2024-09-18T02:04:36.350028+0000","last_became_active":"2024-09-18T02:04:01.566205+0000","last_became_peered":"2024-09-18T02:04:01.566205+0000","last_unstale":"2024-09-18T02:04:36.350028+0000","last_undegraded":"2024-09-18T02:04:36.350028+0000","last_fullsized":"2024-09-18T02:04:36.350028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:56.533384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.106435+0000","last_change":"2024-09-18T02:04:03.581994+0000","last_active":"2024-09-18T02:06:09.106435+0000","last_peered":"2024-09-18T02:06:09.106435+0000","last_clean":"2024-09-18T02:06:09.106435+0000","last_became_active":"2024-09-18T02:04:03.580770+0000","last_became_peered":"2024-09-18T02:04:03.580770+0000","last_unstale":"2024-09-18T02:06:09.106435+0000","last_undegraded":"2024-09-18T02:06:09.106435+0000","last_fullsized":"2024-09-18T02:06:09.106435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:03.809763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354157+0000","last_change":"2024-09-18T02:04:05.597119+0000","last_active":"2024-09-18T02:04:36.354157+0000","last_peered":"2024-09-18T02:04:36.354157+0000","last_clean":"2024-09-18T02:04:36.354157+0000","last_became_active":"2024-09-18T02:04:05.591514+0000","last_became_peered":"2024-09-18T02:04:05.591514+0000","last_unstale":"2024-09-18T02:04:36.354157+0000","last_undegraded":"2024-09-18T02:04:36.354157+0000","last_fullsized":"2024-09-18T02:04:36.354157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:35.071524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217553+0000","last_change":"2024-09-18T02:03:59.554054+0000","last_active":"2024-09-18T02:07:12.217553+0000","last_peered":"2024-09-18T02:07:12.217553+0000","last_clean":"2024-09-18T02:07:12.217553+0000","last_became_active":"2024-09-18T02:03:59.553660+0000","last_became_peered":"2024-09-18T02:03:59.553660+0000","last_unstale":"2024-09-18T02:07:12.217553+0000","last_undegraded":"2024-09-18T02:07:12.217553+0000","last_fullsized":"2024-09-18T02:07:12.217553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:20.271703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.205809+0000","last_change":"2024-09-18T02:03:57.528505+0000","last_active":"2024-09-18T02:07:12.205809+0000","last_peered":"2024-09-18T02:07:12.205809+0000","last_clean":"2024-09-18T02:07:12.205809+0000","last_became_active":"2024-09-18T02:03:57.526941+0000","last_became_peered":"2024-09-18T02:03:57.526941+0000","last_unstale":"2024-09-18T02:07:12.205809+0000","last_undegraded":"2024-09-18T02:07:12.205809+0000","last_fullsized":"2024-09-18T02:07:12.205809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:49.524693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345450+0000","last_change":"2024-09-18T02:04:01.561664+0000","last_active":"2024-09-18T02:04:36.345450+0000","last_peered":"2024-09-18T02:04:36.345450+0000","last_clean":"2024-09-18T02:04:36.345450+0000","last_became_active":"2024-09-18T02:04:01.559839+0000","last_became_peered":"2024-09-18T02:04:01.559839+0000","last_unstale":"2024-09-18T02:04:36.345450+0000","last_undegraded":"2024-09-18T02:04:36.345450+0000","last_fullsized":"2024-09-18T02:04:36.345450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:20.919571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'61","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.137622+0000","last_change":"2024-09-18T02:04:03.582199+0000","last_active":"2024-09-18T02:06:09.137622+0000","last_peered":"2024-09-18T02:06:09.137622+0000","last_clean":"2024-09-18T02:06:09.137622+0000","last_became_active":"2024-09-18T02:04:03.581518+0000","last_became_peered":"2024-09-18T02:04:03.581518+0000","last_unstale":"2024-09-18T02:06:09.137622+0000","last_undegraded":"2024-09-18T02:06:09.137622+0000","last_fullsized":"2024-09-18T02:06:09.137622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:11.364586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.356105+0000","last_change":"2024-09-18T02:04:05.610785+0000","last_active":"2024-09-18T02:04:36.356105+0000","last_peered":"2024-09-18T02:04:36.356105+0000","last_clean":"2024-09-18T02:04:36.356105+0000","last_became_active":"2024-09-18T02:04:05.610007+0000","last_became_peered":"2024-09-18T02:04:05.610007+0000","last_unstale":"2024-09-18T02:04:36.356105+0000","last_undegraded":"2024-09-18T02:04:36.356105+0000","last_fullsized":"2024-09-18T02:04:36.356105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:20.894379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'20","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.266684+0000","last_change":"2024-09-18T02:04:07.610032+0000","last_active":"2024-09-18T02:07:11.266684+0000","last_peered":"2024-09-18T02:07:11.266684+0000","last_clean":"2024-09-18T02:07:11.266684+0000","last_became_active":"2024-09-18T02:04:07.609058+0000","last_became_peered":"2024-09-18T02:04:07.609058+0000","last_unstale":"2024-09-18T02:07:11.266684+0000","last_undegraded":"2024-09-18T02:07:11.266684+0000","last_fullsized":"2024-09-18T02:07:11.266684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:01:06.704072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069945+0000","last_change":"2024-09-18T02:03:59.541759+0000","last_active":"2024-09-18T02:07:12.069945+0000","last_peered":"2024-09-18T02:07:12.069945+0000","last_clean":"2024-09-18T02:07:12.069945+0000","last_became_active":"2024-09-18T02:03:59.540971+0000","last_became_peered":"2024-09-18T02:03:59.540971+0000","last_unstale":"2024-09-18T02:07:12.069945+0000","last_undegraded":"2024-09-18T02:07:12.069945+0000","last_fullsized":"2024-09-18T02:07:12.069945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.343543+0000","last_change":"2024-09-18T02:03:57.519487+0000","last_active":"2024-09-18T02:04:41.343543+0000","last_peered":"2024-09-18T02:04:41.343543+0000","last_clean":"2024-09-18T02:04:41.343543+0000","last_became_active":"2024-09-18T02:03:57.518311+0000","last_became_peered":"2024-09-18T02:03:57.518311+0000","last_unstale":"2024-09-18T02:04:41.343543+0000","last_undegraded":"2024-09-18T02:04:41.343543+0000","last_fullsized":"2024-09-18T02:04:41.343543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:32.993234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364616+0000","last_change":"2024-09-18T02:04:01.564100+0000","last_active":"2024-09-18T02:04:36.364616+0000","last_peered":"2024-09-18T02:04:36.364616+0000","last_clean":"2024-09-18T02:04:36.364616+0000","last_became_active":"2024-09-18T02:04:01.563285+0000","last_became_peered":"2024-09-18T02:04:01.563285+0000","last_unstale":"2024-09-18T02:04:36.364616+0000","last_undegraded":"2024-09-18T02:04:36.364616+0000","last_fullsized":"2024-09-18T02:04:36.364616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:21:50.083821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.107503+0000","last_change":"2024-09-18T02:04:03.600506+0000","last_active":"2024-09-18T02:06:09.107503+0000","last_peered":"2024-09-18T02:06:09.107503+0000","last_clean":"2024-09-18T02:06:09.107503+0000","last_became_active":"2024-09-18T02:04:03.596605+0000","last_became_peered":"2024-09-18T02:04:03.596605+0000","last_unstale":"2024-09-18T02:06:09.107503+0000","last_undegraded":"2024-09-18T02:06:09.107503+0000","last_fullsized":"2024-09-18T02:06:09.107503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:42.407656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346876+0000","last_change":"2024-09-18T02:04:05.589795+0000","last_active":"2024-09-18T02:04:36.346876+0000","last_peered":"2024-09-18T02:04:36.346876+0000","last_clean":"2024-09-18T02:04:36.346876+0000","last_became_active":"2024-09-18T02:04:05.589023+0000","last_became_peered":"2024-09-18T02:04:05.589023+0000","last_unstale":"2024-09-18T02:04:36.346876+0000","last_undegraded":"2024-09-18T02:04:36.346876+0000","last_fullsized":"2024-09-18T02:04:36.346876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:38.266386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348720+0000","last_change":"2024-09-18T02:04:07.625988+0000","last_active":"2024-09-18T02:04:36.348720+0000","last_peered":"2024-09-18T02:04:36.348720+0000","last_clean":"2024-09-18T02:04:36.348720+0000","last_became_active":"2024-09-18T02:04:07.625440+0000","last_became_peered":"2024-09-18T02:04:07.625440+0000","last_unstale":"2024-09-18T02:04:36.348720+0000","last_undegraded":"2024-09-18T02:04:36.348720+0000","last_fullsized":"2024-09-18T02:04:36.348720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:01.797534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.117682+0000","last_change":"2024-09-18T02:03:59.561521+0000","last_active":"2024-09-18T02:06:11.117682+0000","last_peered":"2024-09-18T02:06:11.117682+0000","last_clean":"2024-09-18T02:06:11.117682+0000","last_became_active":"2024-09-18T02:03:59.561208+0000","last_became_peered":"2024-09-18T02:03:59.561208+0000","last_unstale":"2024-09-18T02:06:11.117682+0000","last_undegraded":"2024-09-18T02:06:11.117682+0000","last_fullsized":"2024-09-18T02:06:11.117682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:29.023712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339261+0000","last_change":"2024-09-18T02:03:57.521151+0000","last_active":"2024-09-18T02:04:36.339261+0000","last_peered":"2024-09-18T02:04:36.339261+0000","last_clean":"2024-09-18T02:04:36.339261+0000","last_became_active":"2024-09-18T02:03:57.520569+0000","last_became_peered":"2024-09-18T02:03:57.520569+0000","last_unstale":"2024-09-18T02:04:36.339261+0000","last_undegraded":"2024-09-18T02:04:36.339261+0000","last_fullsized":"2024-09-18T02:04:36.339261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:59:24.420659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358467+0000","last_change":"2024-09-18T02:04:01.566225+0000","last_active":"2024-09-18T02:04:36.358467+0000","last_peered":"2024-09-18T02:04:36.358467+0000","last_clean":"2024-09-18T02:04:36.358467+0000","last_became_active":"2024-09-18T02:04:01.565499+0000","last_became_peered":"2024-09-18T02:04:01.565499+0000","last_unstale":"2024-09-18T02:04:36.358467+0000","last_undegraded":"2024-09-18T02:04:36.358467+0000","last_fullsized":"2024-09-18T02:04:36.358467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:55:01.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.134007+0000","last_change":"2024-09-18T02:04:03.578501+0000","last_active":"2024-09-18T02:06:09.134007+0000","last_peered":"2024-09-18T02:06:09.134007+0000","last_clean":"2024-09-18T02:06:09.134007+0000","last_became_active":"2024-09-18T02:04:03.577841+0000","last_became_peered":"2024-09-18T02:04:03.577841+0000","last_unstale":"2024-09-18T02:06:09.134007+0000","last_undegraded":"2024-09-18T02:06:09.134007+0000","last_fullsized":"2024-09-18T02:06:09.134007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:32.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342393+0000","last_change":"2024-09-18T02:04:05.606498+0000","last_active":"2024-09-18T02:04:36.342393+0000","last_peered":"2024-09-18T02:04:36.342393+0000","last_clean":"2024-09-18T02:04:36.342393+0000","last_became_active":"2024-09-18T02:04:05.605718+0000","last_became_peered":"2024-09-18T02:04:05.605718+0000","last_unstale":"2024-09-18T02:04:36.342393+0000","last_undegraded":"2024-09-18T02:04:36.342393+0000","last_fullsized":"2024-09-18T02:04:36.342393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:15.389313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.105367+0000","last_change":"2024-09-18T02:04:07.621810+0000","last_active":"2024-09-18T02:06:11.105367+0000","last_peered":"2024-09-18T02:06:11.105367+0000","last_clean":"2024-09-18T02:06:11.105367+0000","last_became_active":"2024-09-18T02:04:07.621224+0000","last_became_peered":"2024-09-18T02:04:07.621224+0000","last_unstale":"2024-09-18T02:06:11.105367+0000","last_undegraded":"2024-09-18T02:06:11.105367+0000","last_fullsized":"2024-09-18T02:06:11.105367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:29:24.351329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154739+0000","last_change":"2024-09-18T02:03:59.538977+0000","last_active":"2024-09-18T02:07:12.154739+0000","last_peered":"2024-09-18T02:07:12.154739+0000","last_clean":"2024-09-18T02:07:12.154739+0000","last_became_active":"2024-09-18T02:03:59.536701+0000","last_became_peered":"2024-09-18T02:03:59.536701+0000","last_unstale":"2024-09-18T02:07:12.154739+0000","last_undegraded":"2024-09-18T02:07:12.154739+0000","last_fullsized":"2024-09-18T02:07:12.154739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:31.387691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.950020+0000","last_change":"2024-09-18T02:03:57.528489+0000","last_active":"2024-09-18T02:06:06.950020+0000","last_peered":"2024-09-18T02:06:06.950020+0000","last_clean":"2024-09-18T02:06:06.950020+0000","last_became_active":"2024-09-18T02:03:57.527891+0000","last_became_peered":"2024-09-18T02:03:57.527891+0000","last_unstale":"2024-09-18T02:06:06.950020+0000","last_undegraded":"2024-09-18T02:06:06.950020+0000","last_fullsized":"2024-09-18T02:06:06.950020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:46.827846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346510+0000","last_change":"2024-09-18T02:04:01.565064+0000","last_active":"2024-09-18T02:04:36.346510+0000","last_peered":"2024-09-18T02:04:36.346510+0000","last_clean":"2024-09-18T02:04:36.346510+0000","last_became_active":"2024-09-18T02:04:01.564187+0000","last_became_peered":"2024-09-18T02:04:01.564187+0000","last_unstale":"2024-09-18T02:04:36.346510+0000","last_undegraded":"2024-09-18T02:04:36.346510+0000","last_fullsized":"2024-09-18T02:04:36.346510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:34.109876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.359007+0000","last_change":"2024-09-18T02:04:03.600377+0000","last_active":"2024-09-18T02:04:36.359007+0000","last_peered":"2024-09-18T02:04:36.359007+0000","last_clean":"2024-09-18T02:04:36.359007+0000","last_became_active":"2024-09-18T02:04:03.596273+0000","last_became_peered":"2024-09-18T02:04:03.596273+0000","last_unstale":"2024-09-18T02:04:36.359007+0000","last_undegraded":"2024-09-18T02:04:36.359007+0000","last_fullsized":"2024-09-18T02:04:36.359007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:10.785836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":371,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.401612+0000","last_change":"2024-09-18T02:04:05.604228+0000","last_active":"2024-09-18T02:07:12.401612+0000","last_peered":"2024-09-18T02:07:12.401612+0000","last_clean":"2024-09-18T02:07:12.401612+0000","last_became_active":"2024-09-18T02:04:05.601182+0000","last_became_peered":"2024-09-18T02:04:05.601182+0000","last_unstale":"2024-09-18T02:07:12.401612+0000","last_undegraded":"2024-09-18T02:07:12.401612+0000","last_fullsized":"2024-09-18T02:07:12.401612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:26.319515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'8","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.127197+0000","last_change":"2024-09-18T02:04:07.622167+0000","last_active":"2024-09-18T02:04:42.127197+0000","last_peered":"2024-09-18T02:04:42.127197+0000","last_clean":"2024-09-18T02:04:42.127197+0000","last_became_active":"2024-09-18T02:04:07.621240+0000","last_became_peered":"2024-09-18T02:04:07.621240+0000","last_unstale":"2024-09-18T02:04:42.127197+0000","last_undegraded":"2024-09-18T02:04:42.127197+0000","last_fullsized":"2024-09-18T02:04:42.127197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:44.681571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.866922+0000","last_change":"2024-09-18T02:03:59.536823+0000","last_active":"2024-09-18T02:07:11.866922+0000","last_peered":"2024-09-18T02:07:11.866922+0000","last_clean":"2024-09-18T02:07:11.866922+0000","last_became_active":"2024-09-18T02:03:59.536486+0000","last_became_peered":"2024-09-18T02:03:59.536486+0000","last_unstale":"2024-09-18T02:07:11.866922+0000","last_undegraded":"2024-09-18T02:07:11.866922+0000","last_fullsized":"2024-09-18T02:07:11.866922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:27.777353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348480+0000","last_change":"2024-09-18T02:03:57.520866+0000","last_active":"2024-09-18T02:04:36.348480+0000","last_peered":"2024-09-18T02:04:36.348480+0000","last_clean":"2024-09-18T02:04:36.348480+0000","last_became_active":"2024-09-18T02:03:57.520452+0000","last_became_peered":"2024-09-18T02:03:57.520452+0000","last_unstale":"2024-09-18T02:04:36.348480+0000","last_undegraded":"2024-09-18T02:04:36.348480+0000","last_fullsized":"2024-09-18T02:04:36.348480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341004+0000","last_change":"2024-09-18T02:04:01.564822+0000","last_active":"2024-09-18T02:04:36.341004+0000","last_peered":"2024-09-18T02:04:36.341004+0000","last_clean":"2024-09-18T02:04:36.341004+0000","last_became_active":"2024-09-18T02:04:01.564165+0000","last_became_peered":"2024-09-18T02:04:01.564165+0000","last_unstale":"2024-09-18T02:04:36.341004+0000","last_undegraded":"2024-09-18T02:04:36.341004+0000","last_fullsized":"2024-09-18T02:04:36.341004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:22.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'60","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.093188+0000","last_change":"2024-09-18T02:04:03.567444+0000","last_active":"2024-09-18T02:06:09.093188+0000","last_peered":"2024-09-18T02:06:09.093188+0000","last_clean":"2024-09-18T02:06:09.093188+0000","last_became_active":"2024-09-18T02:04:03.566714+0000","last_became_peered":"2024-09-18T02:04:03.566714+0000","last_unstale":"2024-09-18T02:06:09.093188+0000","last_undegraded":"2024-09-18T02:06:09.093188+0000","last_fullsized":"2024-09-18T02:06:09.093188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:18.880856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.337525+0000","last_change":"2024-09-18T02:04:05.579190+0000","last_active":"2024-09-18T02:04:36.337525+0000","last_peered":"2024-09-18T02:04:36.337525+0000","last_clean":"2024-09-18T02:04:36.337525+0000","last_became_active":"2024-09-18T02:04:05.578635+0000","last_became_peered":"2024-09-18T02:04:05.578635+0000","last_unstale":"2024-09-18T02:04:36.337525+0000","last_undegraded":"2024-09-18T02:04:36.337525+0000","last_fullsized":"2024-09-18T02:04:36.337525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:43.899135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341545+0000","last_change":"2024-09-18T02:04:07.620173+0000","last_active":"2024-09-18T02:04:36.341545+0000","last_peered":"2024-09-18T02:04:36.341545+0000","last_clean":"2024-09-18T02:04:36.341545+0000","last_became_active":"2024-09-18T02:04:07.618696+0000","last_became_peered":"2024-09-18T02:04:07.618696+0000","last_unstale":"2024-09-18T02:04:36.341545+0000","last_undegraded":"2024-09-18T02:04:36.341545+0000","last_fullsized":"2024-09-18T02:04:36.341545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:33.646308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217552+0000","last_change":"2024-09-18T02:03:59.537068+0000","last_active":"2024-09-18T02:07:12.217552+0000","last_peered":"2024-09-18T02:07:12.217552+0000","last_clean":"2024-09-18T02:07:12.217552+0000","last_became_active":"2024-09-18T02:03:59.536693+0000","last_became_peered":"2024-09-18T02:03:59.536693+0000","last_unstale":"2024-09-18T02:07:12.217552+0000","last_undegraded":"2024-09-18T02:07:12.217552+0000","last_fullsized":"2024-09-18T02:07:12.217552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354641+0000","last_change":"2024-09-18T02:03:57.533853+0000","last_active":"2024-09-18T02:04:36.354641+0000","last_peered":"2024-09-18T02:04:36.354641+0000","last_clean":"2024-09-18T02:04:36.354641+0000","last_became_active":"2024-09-18T02:03:57.532963+0000","last_became_peered":"2024-09-18T02:03:57.532963+0000","last_unstale":"2024-09-18T02:04:36.354641+0000","last_undegraded":"2024-09-18T02:04:36.354641+0000","last_fullsized":"2024-09-18T02:04:36.354641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:13.750469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353918+0000","last_change":"2024-09-18T02:04:01.572718+0000","last_active":"2024-09-18T02:04:36.353918+0000","last_peered":"2024-09-18T02:04:36.353918+0000","last_clean":"2024-09-18T02:04:36.353918+0000","last_became_active":"2024-09-18T02:04:01.572089+0000","last_became_peered":"2024-09-18T02:04:01.572089+0000","last_unstale":"2024-09-18T02:04:36.353918+0000","last_undegraded":"2024-09-18T02:04:36.353918+0000","last_fullsized":"2024-09-18T02:04:36.353918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:12.503091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.095516+0000","last_change":"2024-09-18T02:04:03.570795+0000","last_active":"2024-09-18T02:06:09.095516+0000","last_peered":"2024-09-18T02:06:09.095516+0000","last_clean":"2024-09-18T02:06:09.095516+0000","last_became_active":"2024-09-18T02:04:03.569962+0000","last_became_peered":"2024-09-18T02:04:03.569962+0000","last_unstale":"2024-09-18T02:06:09.095516+0000","last_undegraded":"2024-09-18T02:06:09.095516+0000","last_fullsized":"2024-09-18T02:06:09.095516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:48.543679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348236+0000","last_change":"2024-09-18T02:04:05.607210+0000","last_active":"2024-09-18T02:04:36.348236+0000","last_peered":"2024-09-18T02:04:36.348236+0000","last_clean":"2024-09-18T02:04:36.348236+0000","last_became_active":"2024-09-18T02:04:05.606608+0000","last_became_peered":"2024-09-18T02:04:05.606608+0000","last_unstale":"2024-09-18T02:04:36.348236+0000","last_undegraded":"2024-09-18T02:04:36.348236+0000","last_fullsized":"2024-09-18T02:04:36.348236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:24.549074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.355923+0000","last_change":"2024-09-18T02:04:07.609072+0000","last_active":"2024-09-18T02:04:36.355923+0000","last_peered":"2024-09-18T02:04:36.355923+0000","last_clean":"2024-09-18T02:04:36.355923+0000","last_became_active":"2024-09-18T02:04:07.607839+0000","last_became_peered":"2024-09-18T02:04:07.607839+0000","last_unstale":"2024-09-18T02:04:36.355923+0000","last_undegraded":"2024-09-18T02:04:36.355923+0000","last_fullsized":"2024-09-18T02:04:36.355923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:46:07.518628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.969905+0000","last_change":"2024-09-18T02:03:59.550978+0000","last_active":"2024-09-18T02:06:06.969905+0000","last_peered":"2024-09-18T02:06:06.969905+0000","last_clean":"2024-09-18T02:06:06.969905+0000","last_became_active":"2024-09-18T02:03:59.547123+0000","last_became_peered":"2024-09-18T02:03:59.547123+0000","last_unstale":"2024-09-18T02:06:06.969905+0000","last_undegraded":"2024-09-18T02:06:06.969905+0000","last_fullsized":"2024-09-18T02:06:06.969905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:32.095619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343090+0000","last_change":"2024-09-18T02:03:57.530635+0000","last_active":"2024-09-18T02:04:36.343090+0000","last_peered":"2024-09-18T02:04:36.343090+0000","last_clean":"2024-09-18T02:04:36.343090+0000","last_became_active":"2024-09-18T02:03:57.530001+0000","last_became_peered":"2024-09-18T02:03:57.530001+0000","last_unstale":"2024-09-18T02:04:36.343090+0000","last_undegraded":"2024-09-18T02:04:36.343090+0000","last_fullsized":"2024-09-18T02:04:36.343090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:59.657833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339227+0000","last_change":"2024-09-18T02:04:01.571519+0000","last_active":"2024-09-18T02:04:36.339227+0000","last_peered":"2024-09-18T02:04:36.339227+0000","last_clean":"2024-09-18T02:04:36.339227+0000","last_became_active":"2024-09-18T02:04:01.571263+0000","last_became_peered":"2024-09-18T02:04:01.571263+0000","last_unstale":"2024-09-18T02:04:36.339227+0000","last_undegraded":"2024-09-18T02:04:36.339227+0000","last_fullsized":"2024-09-18T02:04:36.339227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:01.789731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'34","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:36.340443+0000","last_change":"2024-09-18T02:04:03.604212+0000","last_active":"2024-09-18T02:06:36.340443+0000","last_peered":"2024-09-18T02:06:36.340443+0000","last_clean":"2024-09-18T02:06:36.340443+0000","last_became_active":"2024-09-18T02:04:03.601392+0000","last_became_peered":"2024-09-18T02:04:03.601392+0000","last_unstale":"2024-09-18T02:06:36.340443+0000","last_undegraded":"2024-09-18T02:06:36.340443+0000","last_fullsized":"2024-09-18T02:06:36.340443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:42.122863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348925+0000","last_change":"2024-09-18T02:04:05.600682+0000","last_active":"2024-09-18T02:04:36.348925+0000","last_peered":"2024-09-18T02:04:36.348925+0000","last_clean":"2024-09-18T02:04:36.348925+0000","last_became_active":"2024-09-18T02:04:05.599964+0000","last_became_peered":"2024-09-18T02:04:05.599964+0000","last_unstale":"2024-09-18T02:04:36.348925+0000","last_undegraded":"2024-09-18T02:04:36.348925+0000","last_fullsized":"2024-09-18T02:04:36.348925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:23.307583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.323902+0000","last_change":"2024-09-18T02:04:07.615961+0000","last_active":"2024-09-18T02:07:12.323902+0000","last_peered":"2024-09-18T02:07:12.323902+0000","last_clean":"2024-09-18T02:07:12.323902+0000","last_became_active":"2024-09-18T02:04:07.615007+0000","last_became_peered":"2024-09-18T02:04:07.615007+0000","last_unstale":"2024-09-18T02:07:12.323902+0000","last_undegraded":"2024-09-18T02:07:12.323902+0000","last_fullsized":"2024-09-18T02:07:12.323902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:14.213728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999722+0000","last_change":"2024-09-18T02:03:59.536538+0000","last_active":"2024-09-18T02:05:25.999722+0000","last_peered":"2024-09-18T02:05:25.999722+0000","last_clean":"2024-09-18T02:05:25.999722+0000","last_became_active":"2024-09-18T02:03:59.536120+0000","last_became_peered":"2024-09-18T02:03:59.536120+0000","last_unstale":"2024-09-18T02:05:25.999722+0000","last_undegraded":"2024-09-18T02:05:25.999722+0000","last_fullsized":"2024-09-18T02:05:25.999722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:31.952497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.286510+0000","last_change":"2024-09-18T02:03:57.525661+0000","last_active":"2024-09-18T02:05:26.286510+0000","last_peered":"2024-09-18T02:05:26.286510+0000","last_clean":"2024-09-18T02:05:26.286510+0000","last_became_active":"2024-09-18T02:03:57.522831+0000","last_became_peered":"2024-09-18T02:03:57.522831+0000","last_unstale":"2024-09-18T02:05:26.286510+0000","last_undegraded":"2024-09-18T02:05:26.286510+0000","last_fullsized":"2024-09-18T02:05:26.286510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:07.491696+0000","last_change":"2024-09-18T02:04:01.570141+0000","last_active":"2024-09-18T02:06:07.491696+0000","last_peered":"2024-09-18T02:06:07.491696+0000","last_clean":"2024-09-18T02:06:07.491696+0000","last_became_active":"2024-09-18T02:04:01.569649+0000","last_became_peered":"2024-09-18T02:04:01.569649+0000","last_unstale":"2024-09-18T02:06:07.491696+0000","last_undegraded":"2024-09-18T02:06:07.491696+0000","last_fullsized":"2024-09-18T02:06:07.491696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:20.919571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'46","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.152028+0000","last_change":"2024-09-18T02:04:03.591716+0000","last_active":"2024-09-18T02:07:11.152028+0000","last_peered":"2024-09-18T02:07:11.152028+0000","last_clean":"2024-09-18T02:07:11.152028+0000","last_became_active":"2024-09-18T02:04:03.591018+0000","last_became_peered":"2024-09-18T02:04:03.591018+0000","last_unstale":"2024-09-18T02:07:11.152028+0000","last_undegraded":"2024-09-18T02:07:11.152028+0000","last_fullsized":"2024-09-18T02:07:11.152028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:01:02.677167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338959+0000","last_change":"2024-09-18T02:04:05.596524+0000","last_active":"2024-09-18T02:04:36.338959+0000","last_peered":"2024-09-18T02:04:36.338959+0000","last_clean":"2024-09-18T02:04:36.338959+0000","last_became_active":"2024-09-18T02:04:05.595772+0000","last_became_peered":"2024-09-18T02:04:05.595772+0000","last_unstale":"2024-09-18T02:04:36.338959+0000","last_undegraded":"2024-09-18T02:04:36.338959+0000","last_fullsized":"2024-09-18T02:04:36.338959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:04.303561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.151093+0000","last_change":"2024-09-18T02:04:07.613362+0000","last_active":"2024-09-18T02:06:09.151093+0000","last_peered":"2024-09-18T02:06:09.151093+0000","last_clean":"2024-09-18T02:06:09.151093+0000","last_became_active":"2024-09-18T02:04:07.612610+0000","last_became_peered":"2024-09-18T02:04:07.612610+0000","last_unstale":"2024-09-18T02:06:09.151093+0000","last_undegraded":"2024-09-18T02:06:09.151093+0000","last_fullsized":"2024-09-18T02:06:09.151093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:48:04.223807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346323+0000","last_change":"2024-09-18T02:03:59.554230+0000","last_active":"2024-09-18T02:04:36.346323+0000","last_peered":"2024-09-18T02:04:36.346323+0000","last_clean":"2024-09-18T02:04:36.346323+0000","last_became_active":"2024-09-18T02:03:59.553864+0000","last_became_peered":"2024-09-18T02:03:59.553864+0000","last_unstale":"2024-09-18T02:04:36.346323+0000","last_undegraded":"2024-09-18T02:04:36.346323+0000","last_fullsized":"2024-09-18T02:04:36.346323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:03.926045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340985+0000","last_change":"2024-09-18T02:03:57.523546+0000","last_active":"2024-09-18T02:04:36.340985+0000","last_peered":"2024-09-18T02:04:36.340985+0000","last_clean":"2024-09-18T02:04:36.340985+0000","last_became_active":"2024-09-18T02:03:57.519843+0000","last_became_peered":"2024-09-18T02:03:57.519843+0000","last_unstale":"2024-09-18T02:04:36.340985+0000","last_undegraded":"2024-09-18T02:04:36.340985+0000","last_fullsized":"2024-09-18T02:04:36.340985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.969754+0000","last_change":"2024-09-18T02:03:59.536808+0000","last_active":"2024-09-18T02:06:06.969754+0000","last_peered":"2024-09-18T02:06:06.969754+0000","last_clean":"2024-09-18T02:06:06.969754+0000","last_became_active":"2024-09-18T02:03:59.535992+0000","last_became_peered":"2024-09-18T02:03:59.535992+0000","last_unstale":"2024-09-18T02:06:06.969754+0000","last_undegraded":"2024-09-18T02:06:06.969754+0000","last_fullsized":"2024-09-18T02:06:06.969754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338112+0000","last_change":"2024-09-18T02:03:57.527965+0000","last_active":"2024-09-18T02:04:36.338112+0000","last_peered":"2024-09-18T02:04:36.338112+0000","last_clean":"2024-09-18T02:04:36.338112+0000","last_became_active":"2024-09-18T02:03:57.527146+0000","last_became_peered":"2024-09-18T02:03:57.527146+0000","last_unstale":"2024-09-18T02:04:36.338112+0000","last_undegraded":"2024-09-18T02:04:36.338112+0000","last_fullsized":"2024-09-18T02:04:36.338112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217939+0000","last_change":"2024-09-18T02:03:59.558797+0000","last_active":"2024-09-18T02:07:12.217939+0000","last_peered":"2024-09-18T02:07:12.217939+0000","last_clean":"2024-09-18T02:07:12.217939+0000","last_became_active":"2024-09-18T02:03:59.556425+0000","last_became_peered":"2024-09-18T02:03:59.556425+0000","last_unstale":"2024-09-18T02:07:12.217939+0000","last_undegraded":"2024-09-18T02:07:12.217939+0000","last_fullsized":"2024-09-18T02:07:12.217939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:18.823166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.050574+0000","last_change":"2024-09-18T02:04:36.351337+0000","last_active":"2024-09-18T02:07:12.050574+0000","last_peered":"2024-09-18T02:07:12.050574+0000","last_clean":"2024-09-18T02:07:12.050574+0000","last_became_active":"2024-09-18T02:04:36.350472+0000","last_became_peered":"2024-09-18T02:04:36.350472+0000","last_unstale":"2024-09-18T02:07:12.050574+0000","last_undegraded":"2024-09-18T02:07:12.050574+0000","last_fullsized":"2024-09-18T02:07:12.050574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:46.701505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"32'18","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999570+0000","last_change":"2024-09-18T02:03:59.535727+0000","last_active":"2024-09-18T02:05:25.999570+0000","last_peered":"2024-09-18T02:05:25.999570+0000","last_clean":"2024-09-18T02:05:25.999570+0000","last_became_active":"2024-09-18T02:03:59.534584+0000","last_became_peered":"2024-09-18T02:03:59.534584+0000","last_unstale":"2024-09-18T02:05:25.999570+0000","last_undegraded":"2024-09-18T02:05:25.999570+0000","last_fullsized":"2024-09-18T02:05:25.999570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.636051+0000","last_change":"2024-09-18T02:03:57.523284+0000","last_active":"2024-09-18T02:07:11.636051+0000","last_peered":"2024-09-18T02:07:11.636051+0000","last_clean":"2024-09-18T02:07:11.636051+0000","last_became_active":"2024-09-18T02:03:57.521499+0000","last_became_peered":"2024-09-18T02:03:57.521499+0000","last_unstale":"2024-09-18T02:07:11.636051+0000","last_undegraded":"2024-09-18T02:07:11.636051+0000","last_fullsized":"2024-09-18T02:07:11.636051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329285+0000","last_change":"2024-09-18T02:03:59.555354+0000","last_active":"2024-09-18T02:06:06.329285+0000","last_peered":"2024-09-18T02:06:06.329285+0000","last_clean":"2024-09-18T02:06:06.329285+0000","last_became_active":"2024-09-18T02:03:59.554577+0000","last_became_peered":"2024-09-18T02:03:59.554577+0000","last_unstale":"2024-09-18T02:06:06.329285+0000","last_undegraded":"2024-09-18T02:06:06.329285+0000","last_fullsized":"2024-09-18T02:06:06.329285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:31:07.318399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.923838+0000","last_change":"2024-09-18T02:03:57.527483+0000","last_active":"2024-09-18T02:04:42.923838+0000","last_peered":"2024-09-18T02:04:42.923838+0000","last_clean":"2024-09-18T02:04:42.923838+0000","last_became_active":"2024-09-18T02:03:57.526774+0000","last_became_peered":"2024-09-18T02:03:57.526774+0000","last_unstale":"2024-09-18T02:04:42.923838+0000","last_undegraded":"2024-09-18T02:04:42.923838+0000","last_fullsized":"2024-09-18T02:04:42.923838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:25.305027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'13","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089661+0000","last_change":"2024-09-18T02:03:59.555131+0000","last_active":"2024-09-18T02:07:12.089661+0000","last_peered":"2024-09-18T02:07:12.089661+0000","last_clean":"2024-09-18T02:07:12.089661+0000","last_became_active":"2024-09-18T02:03:59.554672+0000","last_became_peered":"2024-09-18T02:03:59.554672+0000","last_unstale":"2024-09-18T02:07:12.089661+0000","last_undegraded":"2024-09-18T02:07:12.089661+0000","last_fullsized":"2024-09-18T02:07:12.089661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:10.488835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346001+0000","last_change":"2024-09-18T02:03:57.519989+0000","last_active":"2024-09-18T02:04:36.346001+0000","last_peered":"2024-09-18T02:04:36.346001+0000","last_clean":"2024-09-18T02:04:36.346001+0000","last_became_active":"2024-09-18T02:03:57.519691+0000","last_became_peered":"2024-09-18T02:03:57.519691+0000","last_unstale":"2024-09-18T02:04:36.346001+0000","last_undegraded":"2024-09-18T02:04:36.346001+0000","last_fullsized":"2024-09-18T02:04:36.346001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'17","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.088472+0000","last_change":"2024-09-18T02:03:59.541946+0000","last_active":"2024-09-18T02:07:12.088472+0000","last_peered":"2024-09-18T02:07:12.088472+0000","last_clean":"2024-09-18T02:07:12.088472+0000","last_became_active":"2024-09-18T02:03:59.541059+0000","last_became_peered":"2024-09-18T02:03:59.541059+0000","last_unstale":"2024-09-18T02:07:12.088472+0000","last_undegraded":"2024-09-18T02:07:12.088472+0000","last_fullsized":"2024-09-18T02:07:12.088472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.005080+0000","last_change":"2024-09-18T02:03:57.519641+0000","last_active":"2024-09-18T02:06:11.005080+0000","last_peered":"2024-09-18T02:06:11.005080+0000","last_clean":"2024-09-18T02:06:11.005080+0000","last_became_active":"2024-09-18T02:03:57.519272+0000","last_became_peered":"2024-09-18T02:03:57.519272+0000","last_unstale":"2024-09-18T02:06:11.005080+0000","last_undegraded":"2024-09-18T02:06:11.005080+0000","last_fullsized":"2024-09-18T02:06:11.005080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'5","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.235540+0000","last_change":"2024-09-18T02:03:59.545622+0000","last_active":"2024-09-18T02:07:12.235540+0000","last_peered":"2024-09-18T02:07:12.235540+0000","last_clean":"2024-09-18T02:07:12.235540+0000","last_became_active":"2024-09-18T02:03:59.539946+0000","last_became_peered":"2024-09-18T02:03:59.539946+0000","last_unstale":"2024-09-18T02:07:12.235540+0000","last_undegraded":"2024-09-18T02:07:12.235540+0000","last_fullsized":"2024-09-18T02:07:12.235540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342907+0000","last_change":"2024-09-18T02:03:57.527957+0000","last_active":"2024-09-18T02:04:36.342907+0000","last_peered":"2024-09-18T02:04:36.342907+0000","last_clean":"2024-09-18T02:04:36.342907+0000","last_became_active":"2024-09-18T02:03:57.527102+0000","last_became_peered":"2024-09-18T02:03:57.527102+0000","last_unstale":"2024-09-18T02:04:36.342907+0000","last_undegraded":"2024-09-18T02:04:36.342907+0000","last_fullsized":"2024-09-18T02:04:36.342907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:13:45.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'11","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.238904+0000","last_change":"2024-09-18T02:03:59.543494+0000","last_active":"2024-09-18T02:07:12.238904+0000","last_peered":"2024-09-18T02:07:12.238904+0000","last_clean":"2024-09-18T02:07:12.238904+0000","last_became_active":"2024-09-18T02:03:59.543160+0000","last_became_peered":"2024-09-18T02:03:59.543160+0000","last_unstale":"2024-09-18T02:07:12.238904+0000","last_undegraded":"2024-09-18T02:07:12.238904+0000","last_fullsized":"2024-09-18T02:07:12.238904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:21:48.069564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.347323+0000","last_change":"2024-09-18T02:03:57.525942+0000","last_active":"2024-09-18T02:04:36.347323+0000","last_peered":"2024-09-18T02:04:36.347323+0000","last_clean":"2024-09-18T02:04:36.347323+0000","last_became_active":"2024-09-18T02:03:57.524495+0000","last_became_peered":"2024-09-18T02:03:57.524495+0000","last_unstale":"2024-09-18T02:04:36.347323+0000","last_undegraded":"2024-09-18T02:04:36.347323+0000","last_fullsized":"2024-09-18T02:04:36.347323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:58:39.651409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217785+0000","last_change":"2024-09-18T02:04:36.361845+0000","last_active":"2024-09-18T02:07:12.217785+0000","last_peered":"2024-09-18T02:07:12.217785+0000","last_clean":"2024-09-18T02:07:12.217785+0000","last_became_active":"2024-09-18T02:04:36.354749+0000","last_became_peered":"2024-09-18T02:04:36.354749+0000","last_unstale":"2024-09-18T02:07:12.217785+0000","last_undegraded":"2024-09-18T02:07:12.217785+0000","last_fullsized":"2024-09-18T02:07:12.217785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:25:16.339405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338794+0000","last_change":"2024-09-18T02:03:57.521667+0000","last_active":"2024-09-18T02:04:36.338794+0000","last_peered":"2024-09-18T02:04:36.338794+0000","last_clean":"2024-09-18T02:04:36.338794+0000","last_became_active":"2024-09-18T02:03:57.520623+0000","last_became_peered":"2024-09-18T02:03:57.520623+0000","last_unstale":"2024-09-18T02:04:36.338794+0000","last_undegraded":"2024-09-18T02:04:36.338794+0000","last_fullsized":"2024-09-18T02:04:36.338794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217768+0000","last_change":"2024-09-18T02:03:59.555647+0000","last_active":"2024-09-18T02:07:12.217768+0000","last_peered":"2024-09-18T02:07:12.217768+0000","last_clean":"2024-09-18T02:07:12.217768+0000","last_became_active":"2024-09-18T02:03:59.555178+0000","last_became_peered":"2024-09-18T02:03:59.555178+0000","last_unstale":"2024-09-18T02:07:12.217768+0000","last_undegraded":"2024-09-18T02:07:12.217768+0000","last_fullsized":"2024-09-18T02:07:12.217768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338718+0000","last_change":"2024-09-18T02:03:57.519654+0000","last_active":"2024-09-18T02:04:36.338718+0000","last_peered":"2024-09-18T02:04:36.338718+0000","last_clean":"2024-09-18T02:04:36.338718+0000","last_became_active":"2024-09-18T02:03:57.519359+0000","last_became_peered":"2024-09-18T02:03:57.519359+0000","last_unstale":"2024-09-18T02:04:36.338718+0000","last_undegraded":"2024-09-18T02:04:36.338718+0000","last_fullsized":"2024-09-18T02:04:36.338718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:32.125649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.722270+0000","last_change":"2024-09-18T02:03:59.542345+0000","last_active":"2024-09-18T02:07:11.722270+0000","last_peered":"2024-09-18T02:07:11.722270+0000","last_clean":"2024-09-18T02:07:11.722270+0000","last_became_active":"2024-09-18T02:03:59.540444+0000","last_became_peered":"2024-09-18T02:03:59.540444+0000","last_unstale":"2024-09-18T02:07:11.722270+0000","last_undegraded":"2024-09-18T02:07:11.722270+0000","last_fullsized":"2024-09-18T02:07:11.722270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:36.437530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341283+0000","last_change":"2024-09-18T02:03:57.522898+0000","last_active":"2024-09-18T02:04:36.341283+0000","last_peered":"2024-09-18T02:04:36.341283+0000","last_clean":"2024-09-18T02:04:36.341283+0000","last_became_active":"2024-09-18T02:03:57.521148+0000","last_became_peered":"2024-09-18T02:03:57.521148+0000","last_unstale":"2024-09-18T02:04:36.341283+0000","last_undegraded":"2024-09-18T02:04:36.341283+0000","last_fullsized":"2024-09-18T02:04:36.341283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069454+0000","last_change":"2024-09-18T02:03:59.553902+0000","last_active":"2024-09-18T02:07:12.069454+0000","last_peered":"2024-09-18T02:07:12.069454+0000","last_clean":"2024-09-18T02:07:12.069454+0000","last_became_active":"2024-09-18T02:03:59.553528+0000","last_became_peered":"2024-09-18T02:03:59.553528+0000","last_unstale":"2024-09-18T02:07:12.069454+0000","last_undegraded":"2024-09-18T02:07:12.069454+0000","last_fullsized":"2024-09-18T02:07:12.069454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354140+0000","last_change":"2024-09-18T02:03:57.527928+0000","last_active":"2024-09-18T02:04:36.354140+0000","last_peered":"2024-09-18T02:04:36.354140+0000","last_clean":"2024-09-18T02:04:36.354140+0000","last_became_active":"2024-09-18T02:03:57.526972+0000","last_became_peered":"2024-09-18T02:03:57.526972+0000","last_unstale":"2024-09-18T02:04:36.354140+0000","last_undegraded":"2024-09-18T02:04:36.354140+0000","last_fullsized":"2024-09-18T02:04:36.354140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:17.513345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.729602+0000","last_change":"2024-09-18T02:03:59.546007+0000","last_active":"2024-09-18T02:07:11.729602+0000","last_peered":"2024-09-18T02:07:11.729602+0000","last_clean":"2024-09-18T02:07:11.729602+0000","last_became_active":"2024-09-18T02:03:59.545405+0000","last_became_peered":"2024-09-18T02:03:59.545405+0000","last_unstale":"2024-09-18T02:07:11.729602+0000","last_undegraded":"2024-09-18T02:07:11.729602+0000","last_fullsized":"2024-09-18T02:07:11.729602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354861+0000","last_change":"2024-09-18T02:03:57.522221+0000","last_active":"2024-09-18T02:04:36.354861+0000","last_peered":"2024-09-18T02:04:36.354861+0000","last_clean":"2024-09-18T02:04:36.354861+0000","last_became_active":"2024-09-18T02:03:57.521800+0000","last_became_peered":"2024-09-18T02:03:57.521800+0000","last_unstale":"2024-09-18T02:04:36.354861+0000","last_undegraded":"2024-09-18T02:04:36.354861+0000","last_fullsized":"2024-09-18T02:04:36.354861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:38.433048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.155206+0000","last_change":"2024-09-18T02:04:36.384511+0000","last_active":"2024-09-18T02:07:12.155206+0000","last_peered":"2024-09-18T02:07:12.155206+0000","last_clean":"2024-09-18T02:07:12.155206+0000","last_became_active":"2024-09-18T02:04:36.357213+0000","last_became_peered":"2024-09-18T02:04:36.357213+0000","last_unstale":"2024-09-18T02:07:12.155206+0000","last_undegraded":"2024-09-18T02:07:12.155206+0000","last_fullsized":"2024-09-18T02:07:12.155206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:09.239456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.368246+0000","last_change":"2024-09-18T02:03:57.531024+0000","last_active":"2024-09-18T02:04:36.368246+0000","last_peered":"2024-09-18T02:04:36.368246+0000","last_clean":"2024-09-18T02:04:36.368246+0000","last_became_active":"2024-09-18T02:03:57.528312+0000","last_became_peered":"2024-09-18T02:03:57.528312+0000","last_unstale":"2024-09-18T02:04:36.368246+0000","last_undegraded":"2024-09-18T02:04:36.368246+0000","last_fullsized":"2024-09-18T02:04:36.368246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:32.979432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153104+0000","last_change":"2024-09-18T02:03:59.546083+0000","last_active":"2024-09-18T02:07:12.153104+0000","last_peered":"2024-09-18T02:07:12.153104+0000","last_clean":"2024-09-18T02:07:12.153104+0000","last_became_active":"2024-09-18T02:03:59.540283+0000","last_became_peered":"2024-09-18T02:03:59.540283+0000","last_unstale":"2024-09-18T02:07:12.153104+0000","last_undegraded":"2024-09-18T02:07:12.153104+0000","last_fullsized":"2024-09-18T02:07:12.153104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.910994+0000","last_change":"2024-09-18T02:03:57.528934+0000","last_active":"2024-09-18T02:06:10.910994+0000","last_peered":"2024-09-18T02:06:10.910994+0000","last_clean":"2024-09-18T02:06:10.910994+0000","last_became_active":"2024-09-18T02:03:57.526363+0000","last_became_peered":"2024-09-18T02:03:57.526363+0000","last_unstale":"2024-09-18T02:06:10.910994+0000","last_undegraded":"2024-09-18T02:06:10.910994+0000","last_fullsized":"2024-09-18T02:06:10.910994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:36.487218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.058009+0000","last_change":"2024-09-18T02:03:57.516751+0000","last_active":"2024-09-18T02:07:12.058009+0000","last_peered":"2024-09-18T02:07:12.058009+0000","last_clean":"2024-09-18T02:07:12.058009+0000","last_became_active":"2024-09-18T02:03:57.516434+0000","last_became_peered":"2024-09-18T02:03:57.516434+0000","last_unstale":"2024-09-18T02:07:12.058009+0000","last_undegraded":"2024-09-18T02:07:12.058009+0000","last_fullsized":"2024-09-18T02:07:12.058009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:34.563165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334365+0000","last_change":"2024-09-18T02:03:59.551182+0000","last_active":"2024-09-18T02:06:26.334365+0000","last_peered":"2024-09-18T02:06:26.334365+0000","last_clean":"2024-09-18T02:06:26.334365+0000","last_became_active":"2024-09-18T02:03:59.550058+0000","last_became_peered":"2024-09-18T02:03:59.550058+0000","last_unstale":"2024-09-18T02:06:26.334365+0000","last_undegraded":"2024-09-18T02:06:26.334365+0000","last_fullsized":"2024-09-18T02:06:26.334365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:38.500729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338421+0000","last_change":"2024-09-18T02:03:57.533882+0000","last_active":"2024-09-18T02:04:36.338421+0000","last_peered":"2024-09-18T02:04:36.338421+0000","last_clean":"2024-09-18T02:04:36.338421+0000","last_became_active":"2024-09-18T02:03:57.533324+0000","last_became_peered":"2024-09-18T02:03:57.533324+0000","last_unstale":"2024-09-18T02:04:36.338421+0000","last_undegraded":"2024-09-18T02:04:36.338421+0000","last_fullsized":"2024-09-18T02:04:36.338421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'11","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.886960+0000","last_change":"2024-09-18T02:03:59.542840+0000","last_active":"2024-09-18T02:07:11.886960+0000","last_peered":"2024-09-18T02:07:11.886960+0000","last_clean":"2024-09-18T02:07:11.886960+0000","last_became_active":"2024-09-18T02:03:59.542356+0000","last_became_peered":"2024-09-18T02:03:59.542356+0000","last_unstale":"2024-09-18T02:07:11.886960+0000","last_undegraded":"2024-09-18T02:07:11.886960+0000","last_fullsized":"2024-09-18T02:07:11.886960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:35:21.321816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1471,"ondisk_log_size":1471,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1593,"num_read_kb":1483,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705715,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":21560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":22077440,"data_stored":21749718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48592,"kb_used_data":13248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323248,"statfs":{"total":96636764160,"available":96587005952,"internally_reserved":0,"allocated":13565952,"data_stored":13308880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705715,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41056,"kb_used_data":5712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330784,"statfs":{"total":96636764160,"available":96594722816,"internally_reserved":0,"allocated":5849088,"data_stored":5562779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52216,"kb_used_data":12712,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319624,"statfs":{"total":96636764160,"available":96583294976,"internally_reserved":0,"allocated":13017088,"data_stored":12722525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4837376,"data_stored":4834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21614592,"data_stored":21611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T02:07:44.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T02:07:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.965+0000 7f2ecc314640 1 Processor -- start 2024-09-18T02:07:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.965+0000 7f2ecc314640 1 -- start start 2024-09-18T02:07:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.965+0000 7f2ecc314640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ec406e1f0 0x7f2ec406e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.965+0000 7f2ecc314640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec406f750 con 0x7f2ec406eb10 2024-09-18T02:07:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.965+0000 7f2ecc314640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec4070c10 con 0x7f2ec406e1f0 2024-09-18T02:07:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.965+0000 7f2eca0b0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ec406e1f0 0x7f2ec406e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.965+0000 7f2eca0b0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ec406e1f0 0x7f2ec406e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39924/0 (socket says 172.21.15.81:39924) 2024-09-18T02:07:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.965+0000 7f2eca0b0640 1 -- 172.21.15.81:0/4022712392 learned_addr learned my addr 172.21.15.81:0/4022712392 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:44.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2eca0b0640 1 -- 172.21.15.81:0/4022712392 >> v1:172.21.15.81:6789/0 conn(0x7f2ec406eb10 legacy=0x7f2ec4096080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:44.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2eca0b0640 1 -- 172.21.15.81:0/4022712392 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec40703f0 con 0x7f2ec406e1f0 2024-09-18T02:07:44.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2eca0b0640 1 --2- 172.21.15.81:0/4022712392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec406e1f0 0x7f2ec406e5d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400d150 tx=0x7f2eb401eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff4c4437d32bc39 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2ec90ae640 1 -- 172.21.15.81:0/4022712392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eb400b200 con 0x7f2ec406e1f0 2024-09-18T02:07:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2ec90ae640 1 -- 172.21.15.81:0/4022712392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb400b3a0 con 0x7f2ec406e1f0 2024-09-18T02:07:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2ec90ae640 1 -- 172.21.15.81:0/4022712392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eb40a7950 con 0x7f2ec406e1f0 2024-09-18T02:07:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2ecc314640 1 -- 172.21.15.81:0/4022712392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec406e1f0 msgr2=0x7f2ec406e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2ecc314640 1 --2- 172.21.15.81:0/4022712392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec406e1f0 0x7f2ec406e5d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400d150 tx=0x7f2eb401eb80 comp rx=0 tx=0).stop 2024-09-18T02:07:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2ecc314640 1 -- 172.21.15.81:0/4022712392 shutdown_connections 2024-09-18T02:07:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2ecc314640 1 --2- 172.21.15.81:0/4022712392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec406e1f0 0x7f2ec406e5d0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2ecc314640 1 -- 172.21.15.81:0/4022712392 >> 172.21.15.81:0/4022712392 conn(0x7f2ec4099a50 msgr2=0x7f2ec40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2ecc314640 1 -- 172.21.15.81:0/4022712392 shutdown_connections 2024-09-18T02:07:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.969+0000 7f2ecc314640 1 -- 172.21.15.81:0/4022712392 wait complete. 2024-09-18T02:07:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ecc314640 1 Processor -- start 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ecc314640 1 -- start start 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ecc314640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec406e1f0 0x7f2ec41262b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ecc314640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec406eef0 con 0x7f2ec406e1f0 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2eca0b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec406e1f0 0x7f2ec41262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2eca0b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec406e1f0 0x7f2ec41262b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39936/0 (socket says 172.21.15.81:39936) 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2eca0b0640 1 -- 172.21.15.81:0/1548406521 learned_addr learned my addr 172.21.15.81:0/1548406521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2eca0b0640 1 -- 172.21.15.81:0/1548406521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec4128aa0 con 0x7f2ec406e1f0 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2eca0b0640 1 --2- 172.21.15.81:0/1548406521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec406e1f0 0x7f2ec41262b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2eb401c7b0 tx=0x7f2eb401b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ec2ffd640 1 -- 172.21.15.81:0/1548406521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eb40be020 con 0x7f2ec406e1f0 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ec2ffd640 1 -- 172.21.15.81:0/1548406521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb4009730 con 0x7f2ec406e1f0 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ecc314640 1 -- 172.21.15.81:0/1548406521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec412c4d0 con 0x7f2ec406e1f0 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ec2ffd640 1 -- 172.21.15.81:0/1548406521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eb4009a10 con 0x7f2ec406e1f0 2024-09-18T02:07:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ecc314640 1 -- 172.21.15.81:0/1548406521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec4129130 con 0x7f2ec406e1f0 2024-09-18T02:07:44.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ecc314640 1 -- 172.21.15.81:0/1548406521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec406e5d0 con 0x7f2ec406e1f0 2024-09-18T02:07:44.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ec2ffd640 1 -- 172.21.15.81:0/1548406521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2eb40c1020 con 0x7f2ec406e1f0 2024-09-18T02:07:44.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ec2ffd640 1 --2- 172.21.15.81:0/1548406521 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2eb0035db0 0x7f2eb0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:44.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ec2ffd640 1 -- 172.21.15.81:0/1548406521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2eb40e62a0 con 0x7f2ec406e1f0 2024-09-18T02:07:44.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ec98af640 1 --2- 172.21.15.81:0/1548406521 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2eb0035db0 0x7f2eb0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:44.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.973+0000 7f2ec98af640 1 --2- 172.21.15.81:0/1548406521 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2eb0035db0 0x7f2eb0038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8000f70 tx=0x7f2eb8007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:44.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:44.977+0000 7f2ec2ffd640 1 -- 172.21.15.81:0/1548406521 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2eb40c8030 con 0x7f2ec406e1f0 2024-09-18T02:07:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.133+0000 7f2ecc314640 1 -- 172.21.15.81:0/1548406521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ec4073790 con 0x7f2ec406e1f0 2024-09-18T02:07:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.137+0000 7f2ec2ffd640 1 -- 172.21.15.81:0/1548406521 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+21286 (secure 0 0 0) 0x7f2eb4018800 con 0x7f2ec406e1f0 2024-09-18T02:07:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:07:45.138 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"fsid":"ecc0241d-08c6-448c-b756-3dfc0b24e44a","created":"2024-09-18T02:03:30.533838+0000","modified":"2024-09-18T02:04:36.327304+0000","last_up_change":"2024-09-18T02:03:41.233979+0000","last_in_change":"2024-09-18T02:03:31.763486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T02:03:41.319245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T02:03:46.394794+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-18T02:03:55.880354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-18T02:03:57.896594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-18T02:03:59.803418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-18T02:04:01.700538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-18T02:04:03.643196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-18T02:04:05.783367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b17845b8-f230-4bb1-b552-c6d3048d5a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6801","nonce":3087415523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6803","nonce":3087415523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6807","nonce":3087415523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3087415523},{"type":"v1","addr":"172.21.15.81:6805","nonce":3087415523}]},"public_addr":"172.21.15.81:6801/3087415523","cluster_addr":"172.21.15.81:6803/3087415523","heartbeat_back_addr":"172.21.15.81:6807/3087415523","heartbeat_front_addr":"172.21.15.81:6805/3087415523","state":["exists","up"]},{"osd":1,"uuid":"85eae91e-91f0-4bbd-a025-16ef101df8d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6801","nonce":15864359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6803","nonce":15864359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6807","nonce":15864359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":15864359},{"type":"v1","addr":"172.21.15.167:6805","nonce":15864359}]},"public_addr":"172.21.15.167:6801/15864359","cluster_addr":"172.21.15.167:6803/15864359","heartbeat_back_addr":"172.21.15.167:6807/15864359","heartbeat_front_addr":"172.21.15.167:6805/15864359","state":["exists","up"]},{"osd":2,"uuid":"35bf8e14-6400-40c9-9d6c-a228b047458b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6817","nonce":2055439504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6819","nonce":2055439504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6823","nonce":2055439504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2055439504},{"type":"v1","addr":"172.21.15.167:6821","nonce":2055439504}]},"public_addr":"172.21.15.167:6817/2055439504","cluster_addr":"172.21.15.167:6819/2055439504","heartbeat_back_addr":"172.21.15.167:6823/2055439504","heartbeat_front_addr":"172.21.15.167:6821/2055439504","state":["exists","up"]},{"osd":3,"uuid":"9280ccbf-551d-432d-94c2-41fdb665034e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6809","nonce":2476454287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6811","nonce":2476454287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6815","nonce":2476454287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2476454287},{"type":"v1","addr":"172.21.15.167:6813","nonce":2476454287}]},"public_addr":"172.21.15.167:6809/2476454287","cluster_addr":"172.21.15.167:6811/2476454287","heartbeat_back_addr":"172.21.15.167:6815/2476454287","heartbeat_front_addr":"172.21.15.167:6813/2476454287","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.444853+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.997062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:39.149505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T02:03:38.755822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2e","mappings":[{"from":3,"to":0}]},{"pgid":"5.8","mappings":[{"from":0,"to":2}]},{"pgid":"5.a","mappings":[{"from":0,"to":2}]},{"pgid":"5.14","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T02:07:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.141+0000 7f2ecc314640 1 -- 172.21.15.81:0/1548406521 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2eb0035db0 msgr2=0x7f2eb0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.141+0000 7f2ecc314640 1 --2- 172.21.15.81:0/1548406521 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2eb0035db0 0x7f2eb0038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8000f70 tx=0x7f2eb8007a40 comp rx=0 tx=0).stop 2024-09-18T02:07:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.141+0000 7f2ecc314640 1 -- 172.21.15.81:0/1548406521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec406e1f0 msgr2=0x7f2ec41262b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.141+0000 7f2ecc314640 1 --2- 172.21.15.81:0/1548406521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec406e1f0 0x7f2ec41262b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2eb401c7b0 tx=0x7f2eb401b920 comp rx=0 tx=0).stop 2024-09-18T02:07:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.141+0000 7f2ecc314640 1 -- 172.21.15.81:0/1548406521 shutdown_connections 2024-09-18T02:07:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.141+0000 7f2ecc314640 1 --2- 172.21.15.81:0/1548406521 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2eb0035db0 0x7f2eb0038270 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:45.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.141+0000 7f2ecc314640 1 --2- 172.21.15.81:0/1548406521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec406e1f0 0x7f2ec41262b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:45.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.141+0000 7f2ecc314640 1 -- 172.21.15.81:0/1548406521 >> 172.21.15.81:0/1548406521 conn(0x7f2ec4099a50 msgr2=0x7f2ec409afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:45.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.141+0000 7f2ecc314640 1 -- 172.21.15.81:0/1548406521 shutdown_connections 2024-09-18T02:07:45.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:45.141+0000 7f2ecc314640 1 -- 172.21.15.81:0/1548406521 wait complete. 2024-09-18T02:07:46.215 INFO:tasks.ceph:Scrubbing osd.0 2024-09-18T02:07:46.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-18T02:07:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.349+0000 7fb82a6b1640 1 Processor -- start 2024-09-18T02:07:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.349+0000 7fb82a6b1640 1 -- start start 2024-09-18T02:07:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.349+0000 7fb82a6b1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb82406d170 0x7fb82406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.349+0000 7fb82a6b1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb824098840 con 0x7fb82406da90 2024-09-18T02:07:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.349+0000 7fb82a6b1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb8240709c0 con 0x7fb82406d170 2024-09-18T02:07:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.349+0000 7fb823fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb82406d170 0x7fb82406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.349+0000 7fb8237fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb82406da90 0x7fb824130b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39732/0 (socket says 172.21.15.81:39732) 2024-09-18T02:07:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.349+0000 7fb8237fe640 1 -- 172.21.15.81:0/3648406486 learned_addr learned my addr 172.21.15.81:0/3648406486 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.349+0000 7fb823fff640 1 -- 172.21.15.81:0/3648406486 >> v1:172.21.15.81:6789/0 conn(0x7fb82406da90 legacy=0x7fb824130b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.349+0000 7fb823fff640 1 -- 172.21.15.81:0/3648406486 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb824071e20 con 0x7fb82406d170 2024-09-18T02:07:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb823fff640 1 --2- 172.21.15.81:0/3648406486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d170 0x7fb82406d550 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb814009740 tx=0x7fb81401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bdc30a25aa2c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb822ffd640 1 -- 172.21.15.81:0/3648406486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8140b0070 con 0x7fb82406d170 2024-09-18T02:07:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb822ffd640 1 -- 172.21.15.81:0/3648406486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8140ab530 con 0x7fb82406d170 2024-09-18T02:07:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb822ffd640 1 -- 172.21.15.81:0/3648406486 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8140ab830 con 0x7fb82406d170 2024-09-18T02:07:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 -- 172.21.15.81:0/3648406486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d170 msgr2=0x7fb82406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 --2- 172.21.15.81:0/3648406486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d170 0x7fb82406d550 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb814009740 tx=0x7fb81401c370 comp rx=0 tx=0).stop 2024-09-18T02:07:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 -- 172.21.15.81:0/3648406486 shutdown_connections 2024-09-18T02:07:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 --2- 172.21.15.81:0/3648406486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d170 0x7fb82406d550 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 -- 172.21.15.81:0/3648406486 >> 172.21.15.81:0/3648406486 conn(0x7fb8240998a0 msgr2=0x7fb824099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 -- 172.21.15.81:0/3648406486 shutdown_connections 2024-09-18T02:07:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 -- 172.21.15.81:0/3648406486 wait complete. 2024-09-18T02:07:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 Processor -- start 2024-09-18T02:07:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 -- start start 2024-09-18T02:07:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d170 0x7fb82406e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb824134bf0 con 0x7fb82406d170 2024-09-18T02:07:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb823fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d170 0x7fb82406e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb823fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d170 0x7fb82406e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39956/0 (socket says 172.21.15.81:39956) 2024-09-18T02:07:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb823fff640 1 -- 172.21.15.81:0/2101493669 learned_addr learned my addr 172.21.15.81:0/2101493669 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb823fff640 1 -- 172.21.15.81:0/2101493669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82406f4d0 con 0x7fb82406d170 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb823fff640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d170 0x7fb82406e280 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb814019fa0 tx=0x7fb81401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb820ff9640 1 -- 172.21.15.81:0/2101493669 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8140b0050 con 0x7fb82406d170 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb820ff9640 1 -- 172.21.15.81:0/2101493669 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8140b1040 con 0x7fb82406d170 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 -- 172.21.15.81:0/2101493669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb824125e70 con 0x7fb82406d170 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb820ff9640 1 -- 172.21.15.81:0/2101493669 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8140b5740 con 0x7fb82406d170 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.353+0000 7fb82a6b1640 1 -- 172.21.15.81:0/2101493669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb824131920 con 0x7fb82406d170 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb820ff9640 1 -- 172.21.15.81:0/2101493669 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8140be030 con 0x7fb82406d170 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb82a6b1640 1 -- 172.21.15.81:0/2101493669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb82406d550 con 0x7fb82406d170 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb820ff9640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb810035db0 0x7fb810038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb820ff9640 1 -- 172.21.15.81:0/2101493669 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb8140bc070 con 0x7fb82406d170 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb820ff9640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7fb810041b30 0x7fb810043fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb820ff9640 1 -- 172.21.15.81:0/2101493669 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8140bde80 con 0x7fb810041b30 2024-09-18T02:07:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb820ff9640 1 -- 172.21.15.81:0/2101493669 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb8140ea050 con 0x7fb82406d170 2024-09-18T02:07:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb828c4e640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7fb810041b30 0x7fb810043fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb8237fe640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb810035db0 0x7fb810038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb828c4e640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7fb810041b30 0x7fb810043fd0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb820ff9640 1 -- 172.21.15.81:0/2101493669 <== osd.0 v2:172.21.15.81:6800/3087415523 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb8140bde80 con 0x7fb810041b30 2024-09-18T02:07:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.357+0000 7fb8237fe640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb810035db0 0x7fb810038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb818002090 tx=0x7fb818001680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 -- 172.21.15.81:0/2101493669 --> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb824126210 con 0x7fb810041b30 2024-09-18T02:07:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb820ff9640 1 -- 172.21.15.81:0/2101493669 <== osd.0 v2:172.21.15.81:6800/3087415523 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb824126210 con 0x7fb810041b30 2024-09-18T02:07:46.370 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T02:07:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T02:07:46.370 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T02:07:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 -- 172.21.15.81:0/2101493669 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7fb810041b30 msgr2=0x7fb810043fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7fb810041b30 0x7fb810043fd0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 -- 172.21.15.81:0/2101493669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb810035db0 msgr2=0x7fb810038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb810035db0 0x7fb810038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb818002090 tx=0x7fb818001680 comp rx=0 tx=0).stop 2024-09-18T02:07:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 -- 172.21.15.81:0/2101493669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d170 msgr2=0x7fb82406e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d170 0x7fb82406e280 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb814019fa0 tx=0x7fb81401abb0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 -- 172.21.15.81:0/2101493669 shutdown_connections 2024-09-18T02:07:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.81:6800/3087415523,v1:172.21.15.81:6801/3087415523] conn(0x7fb810041b30 0x7fb810043fd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb810035db0 0x7fb810038270 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 --2- 172.21.15.81:0/2101493669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d170 0x7fb82406e280 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 -- 172.21.15.81:0/2101493669 >> 172.21.15.81:0/2101493669 conn(0x7fb8240998a0 msgr2=0x7fb82409bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 -- 172.21.15.81:0/2101493669 shutdown_connections 2024-09-18T02:07:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.369+0000 7fb82a6b1640 1 -- 172.21.15.81:0/2101493669 wait complete. 2024-09-18T02:07:46.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-18T02:07:46.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.493+0000 7f1a4e649640 1 Processor -- start 2024-09-18T02:07:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.493+0000 7f1a4e649640 1 -- start start 2024-09-18T02:07:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.493+0000 7f1a4e649640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a4812ed70 0x7f1a4812f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.493+0000 7f1a4e649640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a4806f8a0 con 0x7f1a4812f690 2024-09-18T02:07:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.493+0000 7f1a4e649640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1a4806eac0 con 0x7f1a4812ed70 2024-09-18T02:07:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.493+0000 7f1a47fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a4812ed70 0x7f1a4812f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.493+0000 7f1a477fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1a4812f690 0x7f1a4806d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39738/0 (socket says 172.21.15.81:39738) 2024-09-18T02:07:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.493+0000 7f1a477fe640 1 -- 172.21.15.81:0/1196121625 learned_addr learned my addr 172.21.15.81:0/1196121625 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.493+0000 7f1a47fff640 1 -- 172.21.15.81:0/1196121625 >> v1:172.21.15.81:6789/0 conn(0x7f1a4812f690 legacy=0x7f1a4806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.493+0000 7f1a47fff640 1 -- 172.21.15.81:0/1196121625 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4806fbb0 con 0x7f1a4812ed70 2024-09-18T02:07:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.493+0000 7f1a46ffd640 1 -- 172.21.15.81:0/1196121625 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928933939 0 0) 0x7f1a4806f8a0 con 0x7f1a4812f690 2024-09-18T02:07:46.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a47fff640 1 --2- 172.21.15.81:0/1196121625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4812ed70 0x7f1a4812f150 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009740 tx=0x7f1a3801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135bb1cd847eea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a46ffd640 1 -- 172.21.15.81:0/1196121625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a380b1070 con 0x7f1a4812ed70 2024-09-18T02:07:46.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a46ffd640 1 -- 172.21.15.81:0/1196121625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a380ac570 con 0x7f1a4812ed70 2024-09-18T02:07:46.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a46ffd640 1 -- 172.21.15.81:0/1196121625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a380ac870 con 0x7f1a4812ed70 2024-09-18T02:07:46.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 -- 172.21.15.81:0/1196121625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4812ed70 msgr2=0x7f1a4812f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 --2- 172.21.15.81:0/1196121625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4812ed70 0x7f1a4812f150 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009740 tx=0x7f1a3801c400 comp rx=0 tx=0).stop 2024-09-18T02:07:46.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 -- 172.21.15.81:0/1196121625 shutdown_connections 2024-09-18T02:07:46.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 --2- 172.21.15.81:0/1196121625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4812ed70 0x7f1a4812f150 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 -- 172.21.15.81:0/1196121625 >> 172.21.15.81:0/1196121625 conn(0x7f1a4809cd30 msgr2=0x7f1a4809d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:46.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 -- 172.21.15.81:0/1196121625 shutdown_connections 2024-09-18T02:07:46.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 -- 172.21.15.81:0/1196121625 wait complete. 2024-09-18T02:07:46.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 Processor -- start 2024-09-18T02:07:46.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 -- start start 2024-09-18T02:07:46.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4812ed70 0x7f1a48092210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4806e420 con 0x7f1a4812ed70 2024-09-18T02:07:46.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4812ed70 0x7f1a48092210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4812ed70 0x7f1a48092210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39972/0 (socket says 172.21.15.81:39972) 2024-09-18T02:07:46.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a47fff640 1 -- 172.21.15.81:0/138609555 learned_addr learned my addr 172.21.15.81:0/138609555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:46.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a47fff640 1 -- 172.21.15.81:0/138609555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a48095110 con 0x7f1a4812ed70 2024-09-18T02:07:46.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a47fff640 1 --2- 172.21.15.81:0/138609555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4812ed70 0x7f1a48092210 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1a380af040 tx=0x7f1a3801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a44ff9640 1 -- 172.21.15.81:0/138609555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a380b1050 con 0x7f1a4812ed70 2024-09-18T02:07:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a44ff9640 1 -- 172.21.15.81:0/138609555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a380b2040 con 0x7f1a4812ed70 2024-09-18T02:07:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 -- 172.21.15.81:0/138609555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a48094970 con 0x7f1a4812ed70 2024-09-18T02:07:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a44ff9640 1 -- 172.21.15.81:0/138609555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a380aab20 con 0x7f1a4812ed70 2024-09-18T02:07:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 -- 172.21.15.81:0/138609555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a48092750 con 0x7f1a4812ed70 2024-09-18T02:07:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.497+0000 7f1a4e649640 1 -- 172.21.15.81:0/138609555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a4812f150 con 0x7f1a4812ed70 2024-09-18T02:07:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.501+0000 7f1a44ff9640 1 -- 172.21.15.81:0/138609555 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1a380bf030 con 0x7f1a4812ed70 2024-09-18T02:07:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.501+0000 7f1a44ff9640 1 --2- 172.21.15.81:0/138609555 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a34035db0 0x7f1a34038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.501+0000 7f1a44ff9640 1 -- 172.21.15.81:0/138609555 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1a380bd070 con 0x7f1a4812ed70 2024-09-18T02:07:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.501+0000 7f1a477fe640 1 --2- 172.21.15.81:0/138609555 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a34035db0 0x7f1a34038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.501+0000 7f1a477fe640 1 --2- 172.21.15.81:0/138609555 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a34035db0 0x7f1a34038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c007fd0 tx=0x7f1a3c007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.505+0000 7f1a44ff9640 1 -- 172.21.15.81:0/138609555 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1a380c6060 con 0x7f1a4812ed70 2024-09-18T02:07:46.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.653+0000 7f1a4e649640 1 -- 172.21.15.81:0/138609555 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f1a48093d00 con 0x7f1a34035db0 2024-09-18T02:07:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.657+0000 7f1a44ff9640 1 -- 172.21.15.81:0/138609555 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1a48093d00 con 0x7f1a34035db0 2024-09-18T02:07:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-09-18T02:07:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.657+0000 7f1a4e649640 1 -- 172.21.15.81:0/138609555 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a34035db0 msgr2=0x7f1a34038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.657+0000 7f1a4e649640 1 --2- 172.21.15.81:0/138609555 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a34035db0 0x7f1a34038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c007fd0 tx=0x7f1a3c007980 comp rx=0 tx=0).stop 2024-09-18T02:07:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.657+0000 7f1a4e649640 1 -- 172.21.15.81:0/138609555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4812ed70 msgr2=0x7f1a48092210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.657+0000 7f1a4e649640 1 --2- 172.21.15.81:0/138609555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4812ed70 0x7f1a48092210 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1a380af040 tx=0x7f1a3801ac40 comp rx=0 tx=0).stop 2024-09-18T02:07:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.657+0000 7f1a4e649640 1 -- 172.21.15.81:0/138609555 shutdown_connections 2024-09-18T02:07:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.657+0000 7f1a4e649640 1 --2- 172.21.15.81:0/138609555 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1a34035db0 0x7f1a34038270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.657+0000 7f1a4e649640 1 --2- 172.21.15.81:0/138609555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4812ed70 0x7f1a48092210 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.657+0000 7f1a4e649640 1 -- 172.21.15.81:0/138609555 >> 172.21.15.81:0/138609555 conn(0x7f1a4809cd30 msgr2=0x7f1a48099430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.657+0000 7f1a4e649640 1 -- 172.21.15.81:0/138609555 shutdown_connections 2024-09-18T02:07:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.657+0000 7f1a4e649640 1 -- 172.21.15.81:0/138609555 wait complete. 2024-09-18T02:07:46.674 INFO:tasks.ceph:Scrubbing osd.1 2024-09-18T02:07:46.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-18T02:07:46.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34ca18e640 1 Processor -- start 2024-09-18T02:07:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34ca18e640 1 -- start start 2024-09-18T02:07:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34ca18e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34c406e410 0x7f34c4133d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34ca18e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c4098840 con 0x7f34c406d170 2024-09-18T02:07:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34ca18e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f34c406fb10 con 0x7f34c406e410 2024-09-18T02:07:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34c2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34c406e410 0x7f34c4133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34c37fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f34c406d170 0x7f34c406d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39740/0 (socket says 172.21.15.81:39740) 2024-09-18T02:07:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34c37fe640 1 -- 172.21.15.81:0/3219502406 learned_addr learned my addr 172.21.15.81:0/3219502406 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34c2ffd640 1 -- 172.21.15.81:0/3219502406 >> v1:172.21.15.81:6789/0 conn(0x7f34c406d170 legacy=0x7f34c406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34c27fc640 1 -- 172.21.15.81:0/3219502406 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1536683113 0 0) 0x7f34c4098840 con 0x7f34c406d170 2024-09-18T02:07:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34c2ffd640 1 -- 172.21.15.81:0/3219502406 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c406f6d0 con 0x7f34c406e410 2024-09-18T02:07:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34c2ffd640 1 --2- 172.21.15.81:0/3219502406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c406e410 0x7f34c4133d70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f34b8009740 tx=0x7f34b801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a58c6af6b918b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34c27fc640 1 -- 172.21.15.81:0/3219502406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b80b0070 con 0x7f34c406e410 2024-09-18T02:07:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34c27fc640 1 -- 172.21.15.81:0/3219502406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b80ab530 con 0x7f34c406e410 2024-09-18T02:07:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.793+0000 7f34c27fc640 1 -- 172.21.15.81:0/3219502406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b80ab830 con 0x7f34c406e410 2024-09-18T02:07:46.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 -- 172.21.15.81:0/3219502406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c406e410 msgr2=0x7f34c4133d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 --2- 172.21.15.81:0/3219502406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c406e410 0x7f34c4133d70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f34b8009740 tx=0x7f34b801c370 comp rx=0 tx=0).stop 2024-09-18T02:07:46.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 -- 172.21.15.81:0/3219502406 shutdown_connections 2024-09-18T02:07:46.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 --2- 172.21.15.81:0/3219502406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c406e410 0x7f34c4133d70 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 -- 172.21.15.81:0/3219502406 >> 172.21.15.81:0/3219502406 conn(0x7f34c40998a0 msgr2=0x7f34c4099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:46.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 -- 172.21.15.81:0/3219502406 shutdown_connections 2024-09-18T02:07:46.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 -- 172.21.15.81:0/3219502406 wait complete. 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 Processor -- start 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 -- start start 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c406d170 0x7f34c40933e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34c4136e60 con 0x7f34c406d170 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c406d170 0x7f34c40933e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c406d170 0x7f34c40933e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39996/0 (socket says 172.21.15.81:39996) 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34c37fe640 1 -- 172.21.15.81:0/1511032900 learned_addr learned my addr 172.21.15.81:0/1511032900 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34c37fe640 1 -- 172.21.15.81:0/1511032900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c4121ba0 con 0x7f34c406d170 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34c37fe640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c406d170 0x7f34c40933e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f34b400c420 tx=0x7f34b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34abfff640 1 -- 172.21.15.81:0/1511032900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4018070 con 0x7f34c406d170 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34abfff640 1 -- 172.21.15.81:0/1511032900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b40074d0 con 0x7f34c406d170 2024-09-18T02:07:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 -- 172.21.15.81:0/1511032900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c4095960 con 0x7f34c406d170 2024-09-18T02:07:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34abfff640 1 -- 172.21.15.81:0/1511032900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4004960 con 0x7f34c406d170 2024-09-18T02:07:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 -- 172.21.15.81:0/1511032900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c4093920 con 0x7f34c406d170 2024-09-18T02:07:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34ca18e640 1 -- 172.21.15.81:0/1511032900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34c40945e0 con 0x7f34c406d170 2024-09-18T02:07:46.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34abfff640 1 -- 172.21.15.81:0/1511032900 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f34b401b070 con 0x7f34c406d170 2024-09-18T02:07:46.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34abfff640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f34b0035db0 0x7f34b0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.797+0000 7f34abfff640 1 -- 172.21.15.81:0/1511032900 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f34b4048860 con 0x7f34c406d170 2024-09-18T02:07:46.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.801+0000 7f34abfff640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f34b0041c10 0x7f34b00440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.801+0000 7f34abfff640 1 -- 172.21.15.81:0/1511032900 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34b4020eb0 con 0x7f34b0041c10 2024-09-18T02:07:46.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.801+0000 7f34abfff640 1 -- 172.21.15.81:0/1511032900 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f34b4048ca0 con 0x7f34c406d170 2024-09-18T02:07:46.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.801+0000 7f34c2ffd640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f34b0035db0 0x7f34b0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.801+0000 7f34c3fff640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f34b0041c10 0x7f34b00440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.801+0000 7f34c3fff640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f34b0041c10 0x7f34b00440b0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.801+0000 7f34c2ffd640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f34b0035db0 0x7f34b0038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f34b80ad000 tx=0x7f34b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.801+0000 7f34abfff640 1 -- 172.21.15.81:0/1511032900 <== osd.1 v2:172.21.15.167:6800/15864359 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f34b4020eb0 con 0x7f34b0041c10 2024-09-18T02:07:46.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.813+0000 7f34ca18e640 1 -- 172.21.15.81:0/1511032900 --> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f34c406d550 con 0x7f34b0041c10 2024-09-18T02:07:46.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.813+0000 7f34abfff640 1 -- 172.21.15.81:0/1511032900 <== osd.1 v2:172.21.15.167:6800/15864359 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f34c406d550 con 0x7f34b0041c10 2024-09-18T02:07:46.815 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T02:07:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T02:07:46.815 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T02:07:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 -- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f34b0041c10 msgr2=0x7f34b00440b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f34b0041c10 0x7f34b00440b0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 -- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f34b0035db0 msgr2=0x7f34b0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f34b0035db0 0x7f34b0038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f34b80ad000 tx=0x7f34b8008040 comp rx=0 tx=0).stop 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 -- 172.21.15.81:0/1511032900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c406d170 msgr2=0x7f34c40933e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c406d170 0x7f34c40933e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f34b400c420 tx=0x7f34b400c8e0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 -- 172.21.15.81:0/1511032900 shutdown_connections 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6800/15864359,v1:172.21.15.167:6801/15864359] conn(0x7f34b0041c10 0x7f34b00440b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f34b0035db0 0x7f34b0038270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 --2- 172.21.15.81:0/1511032900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c406d170 0x7f34c40933e0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 -- 172.21.15.81:0/1511032900 >> 172.21.15.81:0/1511032900 conn(0x7f34c40998a0 msgr2=0x7f34c4071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 -- 172.21.15.81:0/1511032900 shutdown_connections 2024-09-18T02:07:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.817+0000 7f34ca18e640 1 -- 172.21.15.81:0/1511032900 wait complete. 2024-09-18T02:07:46.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-18T02:07:46.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f815194b640 1 Processor -- start 2024-09-18T02:07:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f815194b640 1 -- start start 2024-09-18T02:07:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f815194b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f814c0964d0 0x7f814c0968b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f815194b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f814c0701f0 con 0x7f814c06d0e0 2024-09-18T02:07:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f815194b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f814c06ff30 con 0x7f814c0964d0 2024-09-18T02:07:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f814affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f814c0964d0 0x7f814c0968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f8143fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f814c06d0e0 0x7f814c06d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41038/0 (socket says 172.21.15.81:41038) 2024-09-18T02:07:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f8143fff640 1 -- 172.21.15.81:0/493561856 learned_addr learned my addr 172.21.15.81:0/493561856 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:46.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f814a7fc640 1 -- 172.21.15.81:0/493561856 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 190322242 0 0) 0x7f813c001120 con 0x7f814c06d0e0 2024-09-18T02:07:46.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f814a7fc640 1 -- 172.21.15.81:0/493561856 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8138003450 con 0x7f814c06d0e0 2024-09-18T02:07:46.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f814affd640 1 -- 172.21.15.81:0/493561856 >> v1:172.21.15.81:6789/0 conn(0x7f814c06d0e0 legacy=0x7f814c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f814affd640 1 -- 172.21.15.81:0/493561856 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814c06e550 con 0x7f814c0964d0 2024-09-18T02:07:46.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f814affd640 1 --2- 172.21.15.81:0/493561856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814c0964d0 0x7f814c0968b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f8134009740 tx=0x7f813401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964bbce3b38fab9e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f814a7fc640 1 -- 172.21.15.81:0/493561856 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81340b0070 con 0x7f814c0964d0 2024-09-18T02:07:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f814a7fc640 1 -- 172.21.15.81:0/493561856 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81340ab530 con 0x7f814c0964d0 2024-09-18T02:07:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.945+0000 7f814a7fc640 1 -- 172.21.15.81:0/493561856 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81340ab830 con 0x7f814c0964d0 2024-09-18T02:07:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 -- 172.21.15.81:0/493561856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814c0964d0 msgr2=0x7f814c0968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 --2- 172.21.15.81:0/493561856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814c0964d0 0x7f814c0968b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f8134009740 tx=0x7f813401c370 comp rx=0 tx=0).stop 2024-09-18T02:07:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 -- 172.21.15.81:0/493561856 shutdown_connections 2024-09-18T02:07:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 --2- 172.21.15.81:0/493561856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814c0964d0 0x7f814c0968b0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 -- 172.21.15.81:0/493561856 >> 172.21.15.81:0/493561856 conn(0x7f814c099a50 msgr2=0x7f814c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 -- 172.21.15.81:0/493561856 shutdown_connections 2024-09-18T02:07:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 -- 172.21.15.81:0/493561856 wait complete. 2024-09-18T02:07:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 Processor -- start 2024-09-18T02:07:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 -- start start 2024-09-18T02:07:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814c06d0e0 0x7f814c095010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1336b0 con 0x7f814c06d0e0 2024-09-18T02:07:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f814affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814c06d0e0 0x7f814c095010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f814affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814c06d0e0 0x7f814c095010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51114/0 (socket says 172.21.15.81:51114) 2024-09-18T02:07:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f814affd640 1 -- 172.21.15.81:0/3013326316 learned_addr learned my addr 172.21.15.81:0/3013326316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f814affd640 1 -- 172.21.15.81:0/3013326316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814c093570 con 0x7f814c06d0e0 2024-09-18T02:07:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f814affd640 1 --2- 172.21.15.81:0/3013326316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814c06d0e0 0x7f814c095010 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f81340ae040 tx=0x7f813401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f8148ff9640 1 -- 172.21.15.81:0/3013326316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81340b0050 con 0x7f814c06d0e0 2024-09-18T02:07:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f8148ff9640 1 -- 172.21.15.81:0/3013326316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81340b1040 con 0x7f814c06d0e0 2024-09-18T02:07:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f8148ff9640 1 -- 172.21.15.81:0/3013326316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81340b75c0 con 0x7f814c06d0e0 2024-09-18T02:07:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 -- 172.21.15.81:0/3013326316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f814c094bc0 con 0x7f814c06d0e0 2024-09-18T02:07:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 -- 172.21.15.81:0/3013326316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f814c094210 con 0x7f814c06d0e0 2024-09-18T02:07:46.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f815194b640 1 -- 172.21.15.81:0/3013326316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f814c0945b0 con 0x7f814c06d0e0 2024-09-18T02:07:46.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f8148ff9640 1 -- 172.21.15.81:0/3013326316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f81340be030 con 0x7f814c06d0e0 2024-09-18T02:07:46.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.949+0000 7f8148ff9640 1 --2- 172.21.15.81:0/3013326316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f812c035db0 0x7f812c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:46.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.953+0000 7f8148ff9640 1 -- 172.21.15.81:0/3013326316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f81340bc070 con 0x7f814c06d0e0 2024-09-18T02:07:46.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.953+0000 7f8143fff640 1 --2- 172.21.15.81:0/3013326316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f812c035db0 0x7f812c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:46.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.953+0000 7f8143fff640 1 --2- 172.21.15.81:0/3013326316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f812c035db0 0x7f812c038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f813c0014d0 tx=0x7f813c001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:46.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:46.957+0000 7f8148ff9640 1 -- 172.21.15.81:0/3013326316 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f81340c5060 con 0x7f814c06d0e0 2024-09-18T02:07:47.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.105+0000 7f815194b640 1 -- 172.21.15.81:0/3013326316 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f814c073790 con 0x7f812c035db0 2024-09-18T02:07:47.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.105+0000 7f8148ff9640 1 -- 172.21.15.81:0/3013326316 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f814c073790 con 0x7f812c035db0 2024-09-18T02:07:47.106 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-09-18T02:07:47.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.109+0000 7f815194b640 1 -- 172.21.15.81:0/3013326316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f812c035db0 msgr2=0x7f812c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.109+0000 7f815194b640 1 --2- 172.21.15.81:0/3013326316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f812c035db0 0x7f812c038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f813c0014d0 tx=0x7f813c001240 comp rx=0 tx=0).stop 2024-09-18T02:07:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.109+0000 7f815194b640 1 -- 172.21.15.81:0/3013326316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814c06d0e0 msgr2=0x7f814c095010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.109+0000 7f815194b640 1 --2- 172.21.15.81:0/3013326316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814c06d0e0 0x7f814c095010 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f81340ae040 tx=0x7f813401abb0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.109+0000 7f815194b640 1 -- 172.21.15.81:0/3013326316 shutdown_connections 2024-09-18T02:07:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.109+0000 7f815194b640 1 --2- 172.21.15.81:0/3013326316 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f812c035db0 0x7f812c038270 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.109+0000 7f815194b640 1 --2- 172.21.15.81:0/3013326316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814c06d0e0 0x7f814c095010 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.109+0000 7f815194b640 1 -- 172.21.15.81:0/3013326316 >> 172.21.15.81:0/3013326316 conn(0x7f814c099a50 msgr2=0x7f814c09aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.109+0000 7f815194b640 1 -- 172.21.15.81:0/3013326316 shutdown_connections 2024-09-18T02:07:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.109+0000 7f815194b640 1 -- 172.21.15.81:0/3013326316 wait complete. 2024-09-18T02:07:47.125 INFO:tasks.ceph:Scrubbing osd.2 2024-09-18T02:07:47.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-18T02:07:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447fe12640 1 Processor -- start 2024-09-18T02:07:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447fe12640 1 -- start start 2024-09-18T02:07:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447fe12640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f447806d170 0x7f447806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447fe12640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4478098840 con 0x7f447806da90 2024-09-18T02:07:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447fe12640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f44780709c0 con 0x7f447806d170 2024-09-18T02:07:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447d3ad640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f447806da90 0x7f4478130b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41042/0 (socket says 172.21.15.81:41042) 2024-09-18T02:07:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447d3ad640 1 -- 172.21.15.81:0/3932234903 learned_addr learned my addr 172.21.15.81:0/3932234903 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:47.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447dbae640 1 --2- 172.21.15.81:0/3932234903 >> v2:172.21.15.81:3300/0 conn(0x7f447806d170 0x7f447806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447cbac640 1 -- 172.21.15.81:0/3932234903 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468023408 0 0) 0x7f4478098840 con 0x7f447806da90 2024-09-18T02:07:47.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447cbac640 1 -- 172.21.15.81:0/3932234903 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4464003530 con 0x7f447806da90 2024-09-18T02:07:47.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447dbae640 1 -- 172.21.15.81:0/3932234903 >> v1:172.21.15.81:6789/0 conn(0x7f447806da90 legacy=0x7f4478130b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447dbae640 1 -- 172.21.15.81:0/3932234903 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4478071e20 con 0x7f447806d170 2024-09-18T02:07:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.245+0000 7f447dbae640 1 --2- 172.21.15.81:0/3932234903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447806d170 0x7f447806d550 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f4474009740 tx=0x7f447401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fa7ed0bd4e0613 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447cbac640 1 -- 172.21.15.81:0/3932234903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44740b0070 con 0x7f447806d170 2024-09-18T02:07:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447cbac640 1 -- 172.21.15.81:0/3932234903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44740ab530 con 0x7f447806d170 2024-09-18T02:07:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447cbac640 1 -- 172.21.15.81:0/3932234903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44740ab830 con 0x7f447806d170 2024-09-18T02:07:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 -- 172.21.15.81:0/3932234903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447806d170 msgr2=0x7f447806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 --2- 172.21.15.81:0/3932234903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447806d170 0x7f447806d550 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f4474009740 tx=0x7f447401c370 comp rx=0 tx=0).stop 2024-09-18T02:07:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 -- 172.21.15.81:0/3932234903 shutdown_connections 2024-09-18T02:07:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 --2- 172.21.15.81:0/3932234903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447806d170 0x7f447806d550 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 -- 172.21.15.81:0/3932234903 >> 172.21.15.81:0/3932234903 conn(0x7f44780998a0 msgr2=0x7f4478099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 -- 172.21.15.81:0/3932234903 shutdown_connections 2024-09-18T02:07:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 -- 172.21.15.81:0/3932234903 wait complete. 2024-09-18T02:07:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 Processor -- start 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 -- start start 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447806d170 0x7f4478122d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4478134bf0 con 0x7f447806d170 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447dbae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447806d170 0x7f4478122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447dbae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447806d170 0x7f4478122d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51130/0 (socket says 172.21.15.81:51130) 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447dbae640 1 -- 172.21.15.81:0/1633389740 learned_addr learned my addr 172.21.15.81:0/1633389740 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447dbae640 1 -- 172.21.15.81:0/1633389740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4478124c70 con 0x7f447806d170 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447dbae640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447806d170 0x7f4478122d30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4474019fa0 tx=0x7f447401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f446e7fc640 1 -- 172.21.15.81:0/1633389740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44740b0050 con 0x7f447806d170 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f446e7fc640 1 -- 172.21.15.81:0/1633389740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44740b1040 con 0x7f447806d170 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 -- 172.21.15.81:0/1633389740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4478126240 con 0x7f447806d170 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f446e7fc640 1 -- 172.21.15.81:0/1633389740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44740b7580 con 0x7f447806d170 2024-09-18T02:07:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 -- 172.21.15.81:0/1633389740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4478123270 con 0x7f447806d170 2024-09-18T02:07:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f447fe12640 1 -- 172.21.15.81:0/1633389740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44780723e0 con 0x7f447806d170 2024-09-18T02:07:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f446e7fc640 1 -- 172.21.15.81:0/1633389740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f44740be030 con 0x7f447806d170 2024-09-18T02:07:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.249+0000 7f446e7fc640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f445c035db0 0x7f445c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.253+0000 7f446e7fc640 1 -- 172.21.15.81:0/1633389740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f44740bc070 con 0x7f447806d170 2024-09-18T02:07:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.253+0000 7f446e7fc640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f445c041bb0 0x7f445c044050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.253+0000 7f446e7fc640 1 -- 172.21.15.81:0/1633389740 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f447400af30 con 0x7f445c041bb0 2024-09-18T02:07:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.253+0000 7f446e7fc640 1 -- 172.21.15.81:0/1633389740 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f44740e5520 con 0x7f447806d170 2024-09-18T02:07:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.253+0000 7f447d3ad640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f445c035db0 0x7f445c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.253+0000 7f447e3af640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f445c041bb0 0x7f445c044050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.253+0000 7f447e3af640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f445c041bb0 0x7f445c044050 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.253+0000 7f447d3ad640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f445c035db0 0x7f445c038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4468007fd0 tx=0x7f4468007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.253+0000 7f446e7fc640 1 -- 172.21.15.81:0/1633389740 <== osd.2 v2:172.21.15.167:6816/2055439504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f447400af30 con 0x7f445c041bb0 2024-09-18T02:07:47.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.265+0000 7f447fe12640 1 -- 172.21.15.81:0/1633389740 --> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f447806d550 con 0x7f445c041bb0 2024-09-18T02:07:47.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f446e7fc640 1 -- 172.21.15.81:0/1633389740 <== osd.2 v2:172.21.15.167:6816/2055439504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f447806d550 con 0x7f445c041bb0 2024-09-18T02:07:47.267 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T02:07:47.267 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T02:07:47.267 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T02:07:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 -- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f445c041bb0 msgr2=0x7f445c044050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f445c041bb0 0x7f445c044050 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 -- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f445c035db0 msgr2=0x7f445c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f445c035db0 0x7f445c038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4468007fd0 tx=0x7f4468007980 comp rx=0 tx=0).stop 2024-09-18T02:07:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 -- 172.21.15.81:0/1633389740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447806d170 msgr2=0x7f4478122d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447806d170 0x7f4478122d30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4474019fa0 tx=0x7f447401abb0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 -- 172.21.15.81:0/1633389740 shutdown_connections 2024-09-18T02:07:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6816/2055439504,v1:172.21.15.167:6817/2055439504] conn(0x7f445c041bb0 0x7f445c044050 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f445c035db0 0x7f445c038270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 --2- 172.21.15.81:0/1633389740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447806d170 0x7f4478122d30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 -- 172.21.15.81:0/1633389740 >> 172.21.15.81:0/1633389740 conn(0x7f44780998a0 msgr2=0x7f44780913f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 -- 172.21.15.81:0/1633389740 shutdown_connections 2024-09-18T02:07:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.269+0000 7f447fe12640 1 -- 172.21.15.81:0/1633389740 wait complete. 2024-09-18T02:07:47.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-18T02:07:47.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.385+0000 7f2fa6a4e640 1 Processor -- start 2024-09-18T02:07:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.385+0000 7f2fa6a4e640 1 -- start start 2024-09-18T02:07:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.385+0000 7f2fa6a4e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2fa012e760 0x7f2fa012ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.385+0000 7f2fa6a4e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa00984f0 con 0x7f2fa012f1c0 2024-09-18T02:07:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.385+0000 7f2fa6a4e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa0098dc0 con 0x7f2fa012e760 2024-09-18T02:07:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.385+0000 7f2f9ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2fa012e760 0x7f2fa012ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.385+0000 7f2f9f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2fa012f1c0 0x7f2fa012b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41050/0 (socket says 172.21.15.81:41050) 2024-09-18T02:07:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.385+0000 7f2f9f7fe640 1 -- 172.21.15.81:0/275158581 learned_addr learned my addr 172.21.15.81:0/275158581 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:47.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.385+0000 7f2f9ffff640 1 -- 172.21.15.81:0/275158581 >> v1:172.21.15.81:6789/0 conn(0x7f2fa012f1c0 legacy=0x7f2fa012b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.385+0000 7f2f9ffff640 1 -- 172.21.15.81:0/275158581 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa012f5a0 con 0x7f2fa012e760 2024-09-18T02:07:47.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9ffff640 1 --2- 172.21.15.81:0/275158581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa012e760 0x7f2fa012ec80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009740 tx=0x7f2f9801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b2b1ae36960d0a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9effd640 1 -- 172.21.15.81:0/275158581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f980b0070 con 0x7f2fa012e760 2024-09-18T02:07:47.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9effd640 1 -- 172.21.15.81:0/275158581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f980ab530 con 0x7f2fa012e760 2024-09-18T02:07:47.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9effd640 1 -- 172.21.15.81:0/275158581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f980ab830 con 0x7f2fa012e760 2024-09-18T02:07:47.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/275158581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa012e760 msgr2=0x7f2fa012ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 --2- 172.21.15.81:0/275158581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa012e760 0x7f2fa012ec80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009740 tx=0x7f2f9801c400 comp rx=0 tx=0).stop 2024-09-18T02:07:47.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/275158581 shutdown_connections 2024-09-18T02:07:47.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 --2- 172.21.15.81:0/275158581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa012e760 0x7f2fa012ec80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/275158581 >> 172.21.15.81:0/275158581 conn(0x7f2fa00a10a0 msgr2=0x7f2fa00a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:47.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/275158581 shutdown_connections 2024-09-18T02:07:47.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/275158581 wait complete. 2024-09-18T02:07:47.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 Processor -- start 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 -- start start 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa012e760 0x7f2fa00953c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa0136e30 con 0x7f2fa012e760 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa012e760 0x7f2fa00953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa012e760 0x7f2fa00953c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51140/0 (socket says 172.21.15.81:51140) 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9ffff640 1 -- 172.21.15.81:0/2065870463 learned_addr learned my addr 172.21.15.81:0/2065870463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9ffff640 1 -- 172.21.15.81:0/2065870463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa009ded0 con 0x7f2fa012e760 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9ffff640 1 --2- 172.21.15.81:0/2065870463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa012e760 0x7f2fa00953c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2f980ae040 tx=0x7f2f9801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9cff9640 1 -- 172.21.15.81:0/2065870463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f980b0050 con 0x7f2fa012e760 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9cff9640 1 -- 172.21.15.81:0/2065870463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f980b1040 con 0x7f2fa012e760 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/2065870463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa012f8d0 con 0x7f2fa012e760 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2f9cff9640 1 -- 172.21.15.81:0/2065870463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f980b5740 con 0x7f2fa012e760 2024-09-18T02:07:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.389+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/2065870463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa0131a90 con 0x7f2fa012e760 2024-09-18T02:07:47.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.393+0000 7f2f9cff9640 1 -- 172.21.15.81:0/2065870463 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2f980be030 con 0x7f2fa012e760 2024-09-18T02:07:47.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.393+0000 7f2f9cff9640 1 --2- 172.21.15.81:0/2065870463 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2f8c035db0 0x7f2f8c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.393+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/2065870463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa012ec80 con 0x7f2fa012e760 2024-09-18T02:07:47.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.393+0000 7f2f9cff9640 1 -- 172.21.15.81:0/2065870463 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2f980bc070 con 0x7f2fa012e760 2024-09-18T02:07:47.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.393+0000 7f2f9f7fe640 1 --2- 172.21.15.81:0/2065870463 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2f8c035db0 0x7f2f8c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.393+0000 7f2f9f7fe640 1 --2- 172.21.15.81:0/2065870463 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2f8c035db0 0x7f2f8c038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2f94002050 tx=0x7f2f94001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.397+0000 7f2f9cff9640 1 -- 172.21.15.81:0/2065870463 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2f980c5020 con 0x7f2fa012e760 2024-09-18T02:07:47.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.545+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/2065870463 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f2fa006e930 con 0x7f2f8c035db0 2024-09-18T02:07:47.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.545+0000 7f2f9cff9640 1 -- 172.21.15.81:0/2065870463 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2fa006e930 con 0x7f2f8c035db0 2024-09-18T02:07:47.546 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-09-18T02:07:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.549+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/2065870463 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2f8c035db0 msgr2=0x7f2f8c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.549+0000 7f2fa6a4e640 1 --2- 172.21.15.81:0/2065870463 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2f8c035db0 0x7f2f8c038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2f94002050 tx=0x7f2f94001640 comp rx=0 tx=0).stop 2024-09-18T02:07:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.549+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/2065870463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa012e760 msgr2=0x7f2fa00953c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.549+0000 7f2fa6a4e640 1 --2- 172.21.15.81:0/2065870463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa012e760 0x7f2fa00953c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2f980ae040 tx=0x7f2f9801ac40 comp rx=0 tx=0).stop 2024-09-18T02:07:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.549+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/2065870463 shutdown_connections 2024-09-18T02:07:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.549+0000 7f2fa6a4e640 1 --2- 172.21.15.81:0/2065870463 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2f8c035db0 0x7f2f8c038270 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.549+0000 7f2fa6a4e640 1 --2- 172.21.15.81:0/2065870463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa012e760 0x7f2fa00953c0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.549+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/2065870463 >> 172.21.15.81:0/2065870463 conn(0x7f2fa00a10a0 msgr2=0x7f2fa012c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.549+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/2065870463 shutdown_connections 2024-09-18T02:07:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.549+0000 7f2fa6a4e640 1 -- 172.21.15.81:0/2065870463 wait complete. 2024-09-18T02:07:47.563 INFO:tasks.ceph:Scrubbing osd.3 2024-09-18T02:07:47.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-18T02:07:47.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.677+0000 7f1ddc5f5640 1 Processor -- start 2024-09-18T02:07:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.677+0000 7f1ddc5f5640 1 -- start start 2024-09-18T02:07:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.677+0000 7f1ddc5f5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1dd409ad80 0x7f1dd406bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.677+0000 7f1ddc5f5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd406c5a0 con 0x7f1dd406c190 2024-09-18T02:07:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.677+0000 7f1ddc5f5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1dd406fb40 con 0x7f1dd409ad80 2024-09-18T02:07:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.677+0000 7f1dda391640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1dd409ad80 0x7f1dd406bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.677+0000 7f1dd9b90640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1dd406c190 0x7f1dd412ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41056/0 (socket says 172.21.15.81:41056) 2024-09-18T02:07:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.677+0000 7f1dd9b90640 1 -- 172.21.15.81:0/3075883724 learned_addr learned my addr 172.21.15.81:0/3075883724 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.677+0000 7f1dda391640 1 -- 172.21.15.81:0/3075883724 >> v1:172.21.15.81:6789/0 conn(0x7f1dd406c190 legacy=0x7f1dd412ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.677+0000 7f1dd938f640 1 -- 172.21.15.81:0/3075883724 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160369725 0 0) 0x7f1dd406c5a0 con 0x7f1dd406c190 2024-09-18T02:07:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.677+0000 7f1dda391640 1 -- 172.21.15.81:0/3075883724 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd406c770 con 0x7f1dd409ad80 2024-09-18T02:07:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1dda391640 1 --2- 172.21.15.81:0/3075883724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd409ad80 0x7f1dd406bc50 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009740 tx=0x7f1dcc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb575f825d2b5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1dd938f640 1 -- 172.21.15.81:0/3075883724 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc0b0070 con 0x7f1dd409ad80 2024-09-18T02:07:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1dd938f640 1 -- 172.21.15.81:0/3075883724 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc0ab530 con 0x7f1dd409ad80 2024-09-18T02:07:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1dd938f640 1 -- 172.21.15.81:0/3075883724 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc0ab830 con 0x7f1dd409ad80 2024-09-18T02:07:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/3075883724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd409ad80 msgr2=0x7f1dd406bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1ddc5f5640 1 --2- 172.21.15.81:0/3075883724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd409ad80 0x7f1dd406bc50 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009740 tx=0x7f1dcc01c370 comp rx=0 tx=0).stop 2024-09-18T02:07:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/3075883724 shutdown_connections 2024-09-18T02:07:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1ddc5f5640 1 --2- 172.21.15.81:0/3075883724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd409ad80 0x7f1dd406bc50 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/3075883724 >> 172.21.15.81:0/3075883724 conn(0x7f1dd409e170 msgr2=0x7f1dd409a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/3075883724 shutdown_connections 2024-09-18T02:07:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/3075883724 wait complete. 2024-09-18T02:07:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1ddc5f5640 1 Processor -- start 2024-09-18T02:07:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1ddc5f5640 1 -- start start 2024-09-18T02:07:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1ddc5f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd406c190 0x7f1dd4092880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1ddc5f5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd406f2a0 con 0x7f1dd406c190 2024-09-18T02:07:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1dda391640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd406c190 0x7f1dd4092880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1dda391640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd406c190 0x7f1dd4092880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51158/0 (socket says 172.21.15.81:51158) 2024-09-18T02:07:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.681+0000 7f1dda391640 1 -- 172.21.15.81:0/807659095 learned_addr learned my addr 172.21.15.81:0/807659095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dda391640 1 -- 172.21.15.81:0/807659095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd4095a40 con 0x7f1dd406c190 2024-09-18T02:07:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dda391640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd406c190 0x7f1dd4092880 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc019fa0 tx=0x7f1dcc01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dcaffd640 1 -- 172.21.15.81:0/807659095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc0b0040 con 0x7f1dd406c190 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dcaffd640 1 -- 172.21.15.81:0/807659095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc004030 con 0x7f1dd406c190 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dcaffd640 1 -- 172.21.15.81:0/807659095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc004350 con 0x7f1dd406c190 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/807659095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd4094a80 con 0x7f1dd406c190 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/807659095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd4095580 con 0x7f1dd406c190 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/807659095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1dd406bc50 con 0x7f1dd406c190 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dcaffd640 1 -- 172.21.15.81:0/807659095 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1dcc003620 con 0x7f1dd406c190 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dcaffd640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1db8035db0 0x7f1db8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dcaffd640 1 -- 172.21.15.81:0/807659095 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1dcc0e3d90 con 0x7f1dd406c190 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dcaffd640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f1db8041c10 0x7f1db80440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dcaffd640 1 -- 172.21.15.81:0/807659095 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1dcc0ab530 con 0x7f1db8041c10 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dcaffd640 1 -- 172.21.15.81:0/807659095 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1dcc0e6440 con 0x7f1dd406c190 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dd9b90640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1db8035db0 0x7f1db8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1ddab92640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f1db8041c10 0x7f1db80440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1dd9b90640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1db8035db0 0x7f1db8038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0000f90 tx=0x7f1dd0007dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.685+0000 7f1ddab92640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f1db8041c10 0x7f1db80440b0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.689+0000 7f1dcaffd640 1 -- 172.21.15.81:0/807659095 <== osd.3 v2:172.21.15.167:6808/2476454287 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1dcc0ab530 con 0x7f1db8041c10 2024-09-18T02:07:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/807659095 --> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1dd406fdb0 con 0x7f1db8041c10 2024-09-18T02:07:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1dcaffd640 1 -- 172.21.15.81:0/807659095 <== osd.3 v2:172.21.15.167:6808/2476454287 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1dd406fdb0 con 0x7f1db8041c10 2024-09-18T02:07:47.701 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T02:07:47.701 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T02:07:47.702 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T02:07:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f1db8041c10 msgr2=0x7f1db80440b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f1db8041c10 0x7f1db80440b0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1db8035db0 msgr2=0x7f1db8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1db8035db0 0x7f1db8038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0000f90 tx=0x7f1dd0007dd0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/807659095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd406c190 msgr2=0x7f1dd4092880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd406c190 0x7f1dd4092880 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc019fa0 tx=0x7f1dcc01abb0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/807659095 shutdown_connections 2024-09-18T02:07:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6808/2476454287,v1:172.21.15.167:6809/2476454287] conn(0x7f1db8041c10 0x7f1db80440b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1db8035db0 0x7f1db8038270 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 --2- 172.21.15.81:0/807659095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd406c190 0x7f1dd4092880 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/807659095 >> 172.21.15.81:0/807659095 conn(0x7f1dd409e170 msgr2=0x7f1dd4072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/807659095 shutdown_connections 2024-09-18T02:07:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.701+0000 7f1ddc5f5640 1 -- 172.21.15.81:0/807659095 wait complete. 2024-09-18T02:07:47.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-18T02:07:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f582bb7d640 1 Processor -- start 2024-09-18T02:07:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f582bb7d640 1 -- start start 2024-09-18T02:07:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f582bb7d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f582406ece0 0x7f5824130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f582bb7d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f582406f750 con 0x7f582406e1f0 2024-09-18T02:07:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f582bb7d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5824070c10 con 0x7f582406ece0 2024-09-18T02:07:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5829919640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f582406e1f0 0x7f582406e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41058/0 (socket says 172.21.15.81:41058) 2024-09-18T02:07:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5829919640 1 -- 172.21.15.81:0/2159120885 learned_addr learned my addr 172.21.15.81:0/2159120885 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5829118640 1 --2- 172.21.15.81:0/2159120885 >> v2:172.21.15.81:3300/0 conn(0x7f582406ece0 0x7f5824130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5828917640 1 -- 172.21.15.81:0/2159120885 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649370258 0 0) 0x7f582406f750 con 0x7f582406e1f0 2024-09-18T02:07:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5828917640 1 -- 172.21.15.81:0/2159120885 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5810003530 con 0x7f582406e1f0 2024-09-18T02:07:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5828917640 1 -- 172.21.15.81:0/2159120885 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4058920393 0 0) 0x7f5810003530 con 0x7f582406e1f0 2024-09-18T02:07:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5828917640 1 -- 172.21.15.81:0/2159120885 >> v2:172.21.15.81:3300/0 conn(0x7f582406ece0 msgr2=0x7f5824130e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-18T02:07:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5828917640 1 --2- 172.21.15.81:0/2159120885 >> v2:172.21.15.81:3300/0 conn(0x7f582406ece0 0x7f5824130e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5828917640 1 -- 172.21.15.81:0/2159120885 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58240703f0 con 0x7f582406e1f0 2024-09-18T02:07:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5828917640 1 -- 172.21.15.81:0/2159120885 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1972425487 0 0) 0x7f58200015b0 con 0x7f582406e1f0 2024-09-18T02:07:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5828917640 1 -- 172.21.15.81:0/2159120885 >> v1:172.21.15.81:6789/0 conn(0x7f582406e1f0 legacy=0x7f582406e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5828917640 1 --2- 172.21.15.81:0/2159120885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 0x7f5810003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5828917640 1 -- 172.21.15.81:0/2159120885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5824070c10 con 0x7f58100039c0 2024-09-18T02:07:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5829919640 1 --2- 172.21.15.81:0/2159120885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 0x7f5810003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5829919640 1 -- 172.21.15.81:0/2159120885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5810003530 con 0x7f58100039c0 2024-09-18T02:07:47.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.833+0000 7f5829919640 1 --2- 172.21.15.81:0/2159120885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 0x7f5810003dc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f582000c110 tx=0x7f582001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28bec6c16704f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f5828917640 1 -- 172.21.15.81:0/2159120885 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5820007cb0 con 0x7f58100039c0 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f5828917640 1 -- 172.21.15.81:0/2159120885 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58200a9070 con 0x7f58100039c0 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f5828917640 1 -- 172.21.15.81:0/2159120885 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5820005b80 con 0x7f58100039c0 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 -- 172.21.15.81:0/2159120885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 msgr2=0x7f5810003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 --2- 172.21.15.81:0/2159120885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 0x7f5810003dc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f582000c110 tx=0x7f582001ccc0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 -- 172.21.15.81:0/2159120885 shutdown_connections 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 --2- 172.21.15.81:0/2159120885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 0x7f5810003dc0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 --2- 172.21.15.81:0/2159120885 >> v2:172.21.15.81:3300/0 conn(0x7f582406ece0 0x7f5824130e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 -- 172.21.15.81:0/2159120885 >> 172.21.15.81:0/2159120885 conn(0x7f5824099a50 msgr2=0x7f58240972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 -- 172.21.15.81:0/2159120885 shutdown_connections 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 -- 172.21.15.81:0/2159120885 wait complete. 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 Processor -- start 2024-09-18T02:07:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 -- start start 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 0x7f5824127820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f582406d8f0 con 0x7f58100039c0 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f5829919640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 0x7f5824127820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f5829919640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 0x7f5824127820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51198/0 (socket says 172.21.15.81:51198) 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f5829919640 1 -- 172.21.15.81:0/4174202474 learned_addr learned my addr 172.21.15.81:0/4174202474 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f5829919640 1 -- 172.21.15.81:0/4174202474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58241296a0 con 0x7f58100039c0 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f5829919640 1 --2- 172.21.15.81:0/4174202474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 0x7f5824127820 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f58200198d0 tx=0x7f5810005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f581a7fc640 1 -- 172.21.15.81:0/4174202474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58200bc070 con 0x7f58100039c0 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f581a7fc640 1 -- 172.21.15.81:0/4174202474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5820001010 con 0x7f58100039c0 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 -- 172.21.15.81:0/4174202474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58240726e0 con 0x7f58100039c0 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f581a7fc640 1 -- 172.21.15.81:0/4174202474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5820001440 con 0x7f58100039c0 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f582bb7d640 1 -- 172.21.15.81:0/4174202474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5824127d60 con 0x7f58100039c0 2024-09-18T02:07:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.837+0000 7f581a7fc640 1 -- 172.21.15.81:0/4174202474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58200bf070 con 0x7f58100039c0 2024-09-18T02:07:47.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.841+0000 7f581a7fc640 1 --2- 172.21.15.81:0/4174202474 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5808035db0 0x7f5808038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:47.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.841+0000 7f581a7fc640 1 -- 172.21.15.81:0/4174202474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f58200b4070 con 0x7f58100039c0 2024-09-18T02:07:47.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.841+0000 7f582bb7d640 1 -- 172.21.15.81:0/4174202474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5824129bc0 con 0x7f58100039c0 2024-09-18T02:07:47.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.841+0000 7f5829118640 1 --2- 172.21.15.81:0/4174202474 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5808035db0 0x7f5808038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:47.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.841+0000 7f5829118640 1 --2- 172.21.15.81:0/4174202474 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5808035db0 0x7f5808038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f581400bbd0 tx=0x7f581400b3a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:47.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.845+0000 7f581a7fc640 1 -- 172.21.15.81:0/4174202474 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5824129bc0 con 0x7f58100039c0 2024-09-18T02:07:47.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.993+0000 7f582bb7d640 1 -- 172.21.15.81:0/4174202474 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f582406de00 con 0x7f5808035db0 2024-09-18T02:07:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.993+0000 7f581a7fc640 1 -- 172.21.15.81:0/4174202474 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f582406de00 con 0x7f5808035db0 2024-09-18T02:07:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-09-18T02:07:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.997+0000 7f582bb7d640 1 -- 172.21.15.81:0/4174202474 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5808035db0 msgr2=0x7f5808038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.997+0000 7f582bb7d640 1 --2- 172.21.15.81:0/4174202474 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5808035db0 0x7f5808038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f581400bbd0 tx=0x7f581400b3a0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.997+0000 7f582bb7d640 1 -- 172.21.15.81:0/4174202474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 msgr2=0x7f5824127820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.997+0000 7f582bb7d640 1 --2- 172.21.15.81:0/4174202474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 0x7f5824127820 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f58200198d0 tx=0x7f5810005840 comp rx=0 tx=0).stop 2024-09-18T02:07:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.997+0000 7f582bb7d640 1 -- 172.21.15.81:0/4174202474 shutdown_connections 2024-09-18T02:07:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.997+0000 7f582bb7d640 1 --2- 172.21.15.81:0/4174202474 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f5808035db0 0x7f5808038270 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.997+0000 7f582bb7d640 1 --2- 172.21.15.81:0/4174202474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58100039c0 0x7f5824127820 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.997+0000 7f582bb7d640 1 -- 172.21.15.81:0/4174202474 >> 172.21.15.81:0/4174202474 conn(0x7f5824099a50 msgr2=0x7f582412f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.997+0000 7f582bb7d640 1 -- 172.21.15.81:0/4174202474 shutdown_connections 2024-09-18T02:07:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:47.997+0000 7f582bb7d640 1 -- 172.21.15.81:0/4174202474 wait complete. 2024-09-18T02:07:48.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T02:07:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e519d0640 1 Processor -- start 2024-09-18T02:07:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e519d0640 1 -- start start 2024-09-18T02:07:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e519d0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e4c06ece0 0x7f1e4c130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e519d0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4c06f750 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e519d0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1e4c070c10 con 0x7f1e4c06ece0 2024-09-18T02:07:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e4affd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1e4c06e1f0 0x7f1e4c06e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41068/0 (socket says 172.21.15.81:41068) 2024-09-18T02:07:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e4affd640 1 -- 172.21.15.81:0/816309940 learned_addr learned my addr 172.21.15.81:0/816309940 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:07:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e427fc640 1 --2- 172.21.15.81:0/816309940 >> v2:172.21.15.81:3300/0 conn(0x7f1e4c06ece0 0x7f1e4c130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e4a7fc640 1 -- 172.21.15.81:0/816309940 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2476743480 0 0) 0x7f1e4c06f750 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e4a7fc640 1 -- 172.21.15.81:0/816309940 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e38003530 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e427fc640 1 -- 172.21.15.81:0/816309940 >> v1:172.21.15.81:6789/0 conn(0x7f1e4c06e1f0 legacy=0x7f1e4c06e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e427fc640 1 -- 172.21.15.81:0/816309940 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c0703f0 con 0x7f1e4c06ece0 2024-09-18T02:07:48.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e427fc640 1 --2- 172.21.15.81:0/816309940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c06ece0 0x7f1e4c130e50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009740 tx=0x7f1e3401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676207ca0c5450ae server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:48.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e4a7fc640 1 -- 172.21.15.81:0/816309940 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e340b0070 con 0x7f1e4c06ece0 2024-09-18T02:07:48.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e4a7fc640 1 -- 172.21.15.81:0/816309940 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e340ab530 con 0x7f1e4c06ece0 2024-09-18T02:07:48.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.121+0000 7f1e4a7fc640 1 -- 172.21.15.81:0/816309940 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e340ab810 con 0x7f1e4c06ece0 2024-09-18T02:07:48.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 -- 172.21.15.81:0/816309940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c06ece0 msgr2=0x7f1e4c130e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:48.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 --2- 172.21.15.81:0/816309940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c06ece0 0x7f1e4c130e50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009740 tx=0x7f1e3401c370 comp rx=0 tx=0).stop 2024-09-18T02:07:48.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 -- 172.21.15.81:0/816309940 shutdown_connections 2024-09-18T02:07:48.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 --2- 172.21.15.81:0/816309940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c06ece0 0x7f1e4c130e50 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:48.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 -- 172.21.15.81:0/816309940 >> 172.21.15.81:0/816309940 conn(0x7f1e4c099a50 msgr2=0x7f1e4c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:48.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 -- 172.21.15.81:0/816309940 shutdown_connections 2024-09-18T02:07:48.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 -- 172.21.15.81:0/816309940 wait complete. 2024-09-18T02:07:48.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 Processor -- start 2024-09-18T02:07:48.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 -- start start 2024-09-18T02:07:48.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c06e1f0 0x7f1e4c1ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:48.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c131d20 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e4affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c06e1f0 0x7f1e4c1ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e4affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c06e1f0 0x7f1e4c1ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51216/0 (socket says 172.21.15.81:51216) 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e4affd640 1 -- 172.21.15.81:0/2744959215 learned_addr learned my addr 172.21.15.81:0/2744959215 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e4affd640 1 -- 172.21.15.81:0/2744959215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c123d30 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e4affd640 1 --2- 172.21.15.81:0/2744959215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c06e1f0 0x7f1e4c1ca5a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c3d0 tx=0x7f1e3c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e48ff9640 1 -- 172.21.15.81:0/2744959215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3c017070 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e48ff9640 1 -- 172.21.15.81:0/2744959215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c005ce0 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 -- 172.21.15.81:0/2744959215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c1303b0 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e48ff9640 1 -- 172.21.15.81:0/2744959215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3c0070d0 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 -- 172.21.15.81:0/2744959215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c1caae0 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e519d0640 1 -- 172.21.15.81:0/2744959215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4c123860 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e48ff9640 1 -- 172.21.15.81:0/2744959215 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1e3c01a070 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e48ff9640 1 --2- 172.21.15.81:0/2744959215 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1e2c035db0 0x7f1e2c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:07:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e48ff9640 1 -- 172.21.15.81:0/2744959215 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1e3c048510 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.125+0000 7f1e427fc640 1 --2- 172.21.15.81:0/2744959215 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1e2c035db0 0x7f1e2c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:07:48.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.129+0000 7f1e427fc640 1 --2- 172.21.15.81:0/2744959215 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1e2c035db0 0x7f1e2c038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1e340ad000 tx=0x7f1e340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:07:48.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.129+0000 7f1e48ff9640 1 -- 172.21.15.81:0/2744959215 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e4c123d30 con 0x7f1e4c06e1f0 2024-09-18T02:07:48.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.285+0000 7f1e519d0640 1 -- 172.21.15.81:0/2744959215 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e4c06e5d0 con 0x7f1e2c035db0 2024-09-18T02:07:48.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.329+0000 7f1e48ff9640 1 -- 172.21.15.81:0/2744959215 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665467 (secure 0 0 0) 0x7f1e4c06e5d0 con 0x7f1e2c035db0 2024-09-18T02:07:48.337 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:07:48.343 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T02:07:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.337+0000 7f1e519d0640 1 -- 172.21.15.81:0/2744959215 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1e2c035db0 msgr2=0x7f1e2c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.337+0000 7f1e519d0640 1 --2- 172.21.15.81:0/2744959215 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1e2c035db0 0x7f1e2c038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1e340ad000 tx=0x7f1e340a6000 comp rx=0 tx=0).stop 2024-09-18T02:07:48.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.337+0000 7f1e519d0640 1 -- 172.21.15.81:0/2744959215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c06e1f0 msgr2=0x7f1e4c1ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:07:48.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.337+0000 7f1e519d0640 1 --2- 172.21.15.81:0/2744959215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c06e1f0 0x7f1e4c1ca5a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c3d0 tx=0x7f1e3c00c890 comp rx=0 tx=0).stop 2024-09-18T02:07:48.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.341+0000 7f1e519d0640 1 -- 172.21.15.81:0/2744959215 shutdown_connections 2024-09-18T02:07:48.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.341+0000 7f1e519d0640 1 --2- 172.21.15.81:0/2744959215 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f1e2c035db0 0x7f1e2c038270 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:48.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.341+0000 7f1e519d0640 1 --2- 172.21.15.81:0/2744959215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c06e1f0 0x7f1e4c1ca5a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:07:48.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.341+0000 7f1e519d0640 1 -- 172.21.15.81:0/2744959215 >> 172.21.15.81:0/2744959215 conn(0x7f1e4c099a50 msgr2=0x7f1e4c097ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:07:48.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.341+0000 7f1e519d0640 1 -- 172.21.15.81:0/2744959215 shutdown_connections 2024-09-18T02:07:48.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:07:48.341+0000 7f1e519d0640 1 -- 172.21.15.81:0/2744959215 wait complete. 2024-09-18T02:07:48.354 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-18T02:07:47.348190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5363,"num_read_kb":4916,"num_write":2373,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4806,"ondisk_log_size":4806,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156680,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330680,"statfs":{"total":386547056640,"available":386386616320,"internally_reserved":0,"allocated":2883584,"data_stored":1729088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-25807407,"num_objects":-7,"num_object_clones":0,"num_object_copies":-14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004771"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.341087+0000","last_change":"2024-09-18T02:03:57.517243+0000","last_active":"2024-09-18T02:04:41.341087+0000","last_peered":"2024-09-18T02:04:41.341087+0000","last_clean":"2024-09-18T02:04:41.341087+0000","last_became_active":"2024-09-18T02:03:57.516420+0000","last_became_peered":"2024-09-18T02:03:57.516420+0000","last_unstale":"2024-09-18T02:04:41.341087+0000","last_undegraded":"2024-09-18T02:04:41.341087+0000","last_fullsized":"2024-09-18T02:04:41.341087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.868815+0000","last_change":"2024-09-18T02:03:59.549513+0000","last_active":"2024-09-18T02:07:11.868815+0000","last_peered":"2024-09-18T02:07:11.868815+0000","last_clean":"2024-09-18T02:07:11.868815+0000","last_became_active":"2024-09-18T02:03:59.545294+0000","last_became_peered":"2024-09-18T02:03:59.545294+0000","last_unstale":"2024-09-18T02:07:11.868815+0000","last_undegraded":"2024-09-18T02:07:11.868815+0000","last_fullsized":"2024-09-18T02:07:11.868815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.486203+0000","last_change":"2024-09-18T02:03:57.533991+0000","last_active":"2024-09-18T02:07:11.486203+0000","last_peered":"2024-09-18T02:07:11.486203+0000","last_clean":"2024-09-18T02:07:11.486203+0000","last_became_active":"2024-09-18T02:03:57.533332+0000","last_became_peered":"2024-09-18T02:03:57.533332+0000","last_unstale":"2024-09-18T02:07:11.486203+0000","last_undegraded":"2024-09-18T02:07:11.486203+0000","last_fullsized":"2024-09-18T02:07:11.486203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:46.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:43.634720+0000","last_change":"2024-09-18T02:03:59.554008+0000","last_active":"2024-09-18T02:04:43.634720+0000","last_peered":"2024-09-18T02:04:43.634720+0000","last_clean":"2024-09-18T02:04:43.634720+0000","last_became_active":"2024-09-18T02:03:59.553641+0000","last_became_peered":"2024-09-18T02:03:59.553641+0000","last_unstale":"2024-09-18T02:04:43.634720+0000","last_undegraded":"2024-09-18T02:04:43.634720+0000","last_fullsized":"2024-09-18T02:04:43.634720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:31.703094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.355519+0000","last_change":"2024-09-18T02:03:57.532939+0000","last_active":"2024-09-18T02:04:36.355519+0000","last_peered":"2024-09-18T02:04:36.355519+0000","last_clean":"2024-09-18T02:04:36.355519+0000","last_became_active":"2024-09-18T02:03:57.532561+0000","last_became_peered":"2024-09-18T02:03:57.532561+0000","last_unstale":"2024-09-18T02:04:36.355519+0000","last_undegraded":"2024-09-18T02:04:36.355519+0000","last_fullsized":"2024-09-18T02:04:36.355519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:51.738245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069743+0000","last_change":"2024-09-18T02:03:59.552858+0000","last_active":"2024-09-18T02:07:12.069743+0000","last_peered":"2024-09-18T02:07:12.069743+0000","last_clean":"2024-09-18T02:07:12.069743+0000","last_became_active":"2024-09-18T02:03:59.551661+0000","last_became_peered":"2024-09-18T02:03:59.551661+0000","last_unstale":"2024-09-18T02:07:12.069743+0000","last_undegraded":"2024-09-18T02:07:12.069743+0000","last_fullsized":"2024-09-18T02:07:12.069743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:13:16.052288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.345587+0000","last_change":"2024-09-18T02:03:57.523513+0000","last_active":"2024-09-18T02:04:41.345587+0000","last_peered":"2024-09-18T02:04:41.345587+0000","last_clean":"2024-09-18T02:04:41.345587+0000","last_became_active":"2024-09-18T02:03:57.522751+0000","last_became_peered":"2024-09-18T02:03:57.522751+0000","last_unstale":"2024-09-18T02:04:41.345587+0000","last_undegraded":"2024-09-18T02:04:41.345587+0000","last_fullsized":"2024-09-18T02:04:41.345587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.303235+0000","last_change":"2024-09-18T02:03:59.553228+0000","last_active":"2024-09-18T02:05:26.303235+0000","last_peered":"2024-09-18T02:05:26.303235+0000","last_clean":"2024-09-18T02:05:26.303235+0000","last_became_active":"2024-09-18T02:03:59.552797+0000","last_became_peered":"2024-09-18T02:03:59.552797+0000","last_unstale":"2024-09-18T02:05:26.303235+0000","last_undegraded":"2024-09-18T02:05:26.303235+0000","last_fullsized":"2024-09-18T02:05:26.303235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:34:11.622588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.351407+0000","last_change":"2024-09-18T02:03:57.525148+0000","last_active":"2024-09-18T02:04:36.351407+0000","last_peered":"2024-09-18T02:04:36.351407+0000","last_clean":"2024-09-18T02:04:36.351407+0000","last_became_active":"2024-09-18T02:03:57.524645+0000","last_became_peered":"2024-09-18T02:03:57.524645+0000","last_unstale":"2024-09-18T02:04:36.351407+0000","last_undegraded":"2024-09-18T02:04:36.351407+0000","last_fullsized":"2024-09-18T02:04:36.351407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:25.763842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.730487+0000","last_change":"2024-09-18T02:03:59.542637+0000","last_active":"2024-09-18T02:07:11.730487+0000","last_peered":"2024-09-18T02:07:11.730487+0000","last_clean":"2024-09-18T02:07:11.730487+0000","last_became_active":"2024-09-18T02:03:59.542238+0000","last_became_peered":"2024-09-18T02:03:59.542238+0000","last_unstale":"2024-09-18T02:07:11.730487+0000","last_undegraded":"2024-09-18T02:07:11.730487+0000","last_fullsized":"2024-09-18T02:07:11.730487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:45.343721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343457+0000","last_change":"2024-09-18T02:03:57.523116+0000","last_active":"2024-09-18T02:04:36.343457+0000","last_peered":"2024-09-18T02:04:36.343457+0000","last_clean":"2024-09-18T02:04:36.343457+0000","last_became_active":"2024-09-18T02:03:57.520647+0000","last_became_peered":"2024-09-18T02:03:57.520647+0000","last_unstale":"2024-09-18T02:04:36.343457+0000","last_undegraded":"2024-09-18T02:04:36.343457+0000","last_fullsized":"2024-09-18T02:04:36.343457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'12","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153401+0000","last_change":"2024-09-18T02:03:59.560469+0000","last_active":"2024-09-18T02:07:12.153401+0000","last_peered":"2024-09-18T02:07:12.153401+0000","last_clean":"2024-09-18T02:07:12.153401+0000","last_became_active":"2024-09-18T02:03:59.559273+0000","last_became_peered":"2024-09-18T02:03:59.559273+0000","last_unstale":"2024-09-18T02:07:12.153401+0000","last_undegraded":"2024-09-18T02:07:12.153401+0000","last_fullsized":"2024-09-18T02:07:12.153401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:44.509390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.675472+0000","last_change":"2024-09-18T02:03:57.528855+0000","last_active":"2024-09-18T02:07:11.675472+0000","last_peered":"2024-09-18T02:07:11.675472+0000","last_clean":"2024-09-18T02:07:11.675472+0000","last_became_active":"2024-09-18T02:03:57.526953+0000","last_became_peered":"2024-09-18T02:03:57.526953+0000","last_unstale":"2024-09-18T02:07:11.675472+0000","last_undegraded":"2024-09-18T02:07:11.675472+0000","last_fullsized":"2024-09-18T02:07:11.675472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:28:20.024090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999282+0000","last_change":"2024-09-18T02:03:59.541576+0000","last_active":"2024-09-18T02:05:25.999282+0000","last_peered":"2024-09-18T02:05:25.999282+0000","last_clean":"2024-09-18T02:05:25.999282+0000","last_became_active":"2024-09-18T02:03:59.541086+0000","last_became_peered":"2024-09-18T02:03:59.541086+0000","last_unstale":"2024-09-18T02:05:25.999282+0000","last_undegraded":"2024-09-18T02:05:25.999282+0000","last_fullsized":"2024-09-18T02:05:25.999282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.337869+0000","last_change":"2024-09-18T02:03:57.524285+0000","last_active":"2024-09-18T02:04:36.337869+0000","last_peered":"2024-09-18T02:04:36.337869+0000","last_clean":"2024-09-18T02:04:36.337869+0000","last_became_active":"2024-09-18T02:03:57.520343+0000","last_became_peered":"2024-09-18T02:03:57.520343+0000","last_unstale":"2024-09-18T02:04:36.337869+0000","last_undegraded":"2024-09-18T02:04:36.337869+0000","last_fullsized":"2024-09-18T02:04:36.337869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069669+0000","last_change":"2024-09-18T02:03:59.534315+0000","last_active":"2024-09-18T02:07:12.069669+0000","last_peered":"2024-09-18T02:07:12.069669+0000","last_clean":"2024-09-18T02:07:12.069669+0000","last_became_active":"2024-09-18T02:03:59.533956+0000","last_became_peered":"2024-09-18T02:03:59.533956+0000","last_unstale":"2024-09-18T02:07:12.069669+0000","last_undegraded":"2024-09-18T02:07:12.069669+0000","last_fullsized":"2024-09-18T02:07:12.069669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.238202+0000","last_change":"2024-09-18T02:03:59.537124+0000","last_active":"2024-09-18T02:07:12.238202+0000","last_peered":"2024-09-18T02:07:12.238202+0000","last_clean":"2024-09-18T02:07:12.238202+0000","last_became_active":"2024-09-18T02:03:59.536739+0000","last_became_peered":"2024-09-18T02:03:59.536739+0000","last_unstale":"2024-09-18T02:07:12.238202+0000","last_undegraded":"2024-09-18T02:07:12.238202+0000","last_fullsized":"2024-09-18T02:07:12.238202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:15.010015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345192+0000","last_change":"2024-09-18T02:03:57.523985+0000","last_active":"2024-09-18T02:04:36.345192+0000","last_peered":"2024-09-18T02:04:36.345192+0000","last_clean":"2024-09-18T02:04:36.345192+0000","last_became_active":"2024-09-18T02:03:57.523437+0000","last_became_peered":"2024-09-18T02:03:57.523437+0000","last_unstale":"2024-09-18T02:04:36.345192+0000","last_undegraded":"2024-09-18T02:04:36.345192+0000","last_fullsized":"2024-09-18T02:04:36.345192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.218837+0000","last_change":"2024-09-18T02:03:59.540278+0000","last_active":"2024-09-18T02:07:12.218837+0000","last_peered":"2024-09-18T02:07:12.218837+0000","last_clean":"2024-09-18T02:07:12.218837+0000","last_became_active":"2024-09-18T02:03:59.539778+0000","last_became_peered":"2024-09-18T02:03:59.539778+0000","last_unstale":"2024-09-18T02:07:12.218837+0000","last_undegraded":"2024-09-18T02:07:12.218837+0000","last_fullsized":"2024-09-18T02:07:12.218837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.035357+0000","last_change":"2024-09-18T02:03:57.528659+0000","last_active":"2024-09-18T02:07:12.035357+0000","last_peered":"2024-09-18T02:07:12.035357+0000","last_clean":"2024-09-18T02:07:12.035357+0000","last_became_active":"2024-09-18T02:03:57.524578+0000","last_became_peered":"2024-09-18T02:03:57.524578+0000","last_unstale":"2024-09-18T02:07:12.035357+0000","last_undegraded":"2024-09-18T02:07:12.035357+0000","last_fullsized":"2024-09-18T02:07:12.035357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.595859+0000","last_change":"2024-09-18T02:03:59.546276+0000","last_active":"2024-09-18T02:04:42.595859+0000","last_peered":"2024-09-18T02:04:42.595859+0000","last_clean":"2024-09-18T02:04:42.595859+0000","last_became_active":"2024-09-18T02:03:59.545902+0000","last_became_peered":"2024-09-18T02:03:59.545902+0000","last_unstale":"2024-09-18T02:04:42.595859+0000","last_undegraded":"2024-09-18T02:04:42.595859+0000","last_fullsized":"2024-09-18T02:04:42.595859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:31.387691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348638+0000","last_change":"2024-09-18T02:03:57.523592+0000","last_active":"2024-09-18T02:04:36.348638+0000","last_peered":"2024-09-18T02:04:36.348638+0000","last_clean":"2024-09-18T02:04:36.348638+0000","last_became_active":"2024-09-18T02:03:57.523211+0000","last_became_peered":"2024-09-18T02:03:57.523211+0000","last_unstale":"2024-09-18T02:04:36.348638+0000","last_undegraded":"2024-09-18T02:04:36.348638+0000","last_fullsized":"2024-09-18T02:04:36.348638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:40.008713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.116959+0000","last_change":"2024-09-18T02:03:59.539920+0000","last_active":"2024-09-18T02:06:11.116959+0000","last_peered":"2024-09-18T02:06:11.116959+0000","last_clean":"2024-09-18T02:06:11.116959+0000","last_became_active":"2024-09-18T02:03:59.539198+0000","last_became_peered":"2024-09-18T02:03:59.539198+0000","last_unstale":"2024-09-18T02:06:11.116959+0000","last_undegraded":"2024-09-18T02:06:11.116959+0000","last_fullsized":"2024-09-18T02:06:11.116959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348389+0000","last_change":"2024-09-18T02:03:57.523263+0000","last_active":"2024-09-18T02:04:36.348389+0000","last_peered":"2024-09-18T02:04:36.348389+0000","last_clean":"2024-09-18T02:04:36.348389+0000","last_became_active":"2024-09-18T02:03:57.522924+0000","last_became_peered":"2024-09-18T02:03:57.522924+0000","last_unstale":"2024-09-18T02:04:36.348389+0000","last_undegraded":"2024-09-18T02:04:36.348389+0000","last_fullsized":"2024-09-18T02:04:36.348389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154414+0000","last_change":"2024-09-18T02:03:59.538519+0000","last_active":"2024-09-18T02:07:12.154414+0000","last_peered":"2024-09-18T02:07:12.154414+0000","last_clean":"2024-09-18T02:07:12.154414+0000","last_became_active":"2024-09-18T02:03:59.538126+0000","last_became_peered":"2024-09-18T02:03:59.538126+0000","last_unstale":"2024-09-18T02:07:12.154414+0000","last_undegraded":"2024-09-18T02:07:12.154414+0000","last_fullsized":"2024-09-18T02:07:12.154414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342676+0000","last_change":"2024-09-18T02:03:57.524373+0000","last_active":"2024-09-18T02:04:36.342676+0000","last_peered":"2024-09-18T02:04:36.342676+0000","last_clean":"2024-09-18T02:04:36.342676+0000","last_became_active":"2024-09-18T02:03:57.521019+0000","last_became_peered":"2024-09-18T02:03:57.521019+0000","last_unstale":"2024-09-18T02:04:36.342676+0000","last_undegraded":"2024-09-18T02:04:36.342676+0000","last_fullsized":"2024-09-18T02:04:36.342676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.726771+0000","last_change":"2024-09-18T02:03:59.542673+0000","last_active":"2024-09-18T02:07:11.726771+0000","last_peered":"2024-09-18T02:07:11.726771+0000","last_clean":"2024-09-18T02:07:11.726771+0000","last_became_active":"2024-09-18T02:03:59.540553+0000","last_became_peered":"2024-09-18T02:03:59.540553+0000","last_unstale":"2024-09-18T02:07:11.726771+0000","last_undegraded":"2024-09-18T02:07:11.726771+0000","last_fullsized":"2024-09-18T02:07:11.726771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:45:09.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.904198+0000","last_change":"2024-09-18T02:03:57.527852+0000","last_active":"2024-09-18T02:04:42.904198+0000","last_peered":"2024-09-18T02:04:42.904198+0000","last_clean":"2024-09-18T02:04:42.904198+0000","last_became_active":"2024-09-18T02:03:57.526917+0000","last_became_peered":"2024-09-18T02:03:57.526917+0000","last_unstale":"2024-09-18T02:04:42.904198+0000","last_undegraded":"2024-09-18T02:04:42.904198+0000","last_fullsized":"2024-09-18T02:04:42.904198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:05:25.015337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.114018+0000","last_change":"2024-09-18T02:04:07.624724+0000","last_active":"2024-09-18T02:07:12.114018+0000","last_peered":"2024-09-18T02:07:12.114018+0000","last_clean":"2024-09-18T02:07:12.114018+0000","last_became_active":"2024-09-18T02:04:07.624037+0000","last_became_peered":"2024-09-18T02:04:07.624037+0000","last_unstale":"2024-09-18T02:07:12.114018+0000","last_undegraded":"2024-09-18T02:07:12.114018+0000","last_fullsized":"2024-09-18T02:07:12.114018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:12.942917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069638+0000","last_change":"2024-09-18T02:03:59.545658+0000","last_active":"2024-09-18T02:07:12.069638+0000","last_peered":"2024-09-18T02:07:12.069638+0000","last_clean":"2024-09-18T02:07:12.069638+0000","last_became_active":"2024-09-18T02:03:59.538409+0000","last_became_peered":"2024-09-18T02:03:59.538409+0000","last_unstale":"2024-09-18T02:07:12.069638+0000","last_undegraded":"2024-09-18T02:07:12.069638+0000","last_fullsized":"2024-09-18T02:07:12.069638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:22:35.808977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.565850+0000","last_change":"2024-09-18T02:03:57.533041+0000","last_active":"2024-09-18T02:07:11.565850+0000","last_peered":"2024-09-18T02:07:11.565850+0000","last_clean":"2024-09-18T02:07:11.565850+0000","last_became_active":"2024-09-18T02:03:57.532657+0000","last_became_peered":"2024-09-18T02:03:57.532657+0000","last_unstale":"2024-09-18T02:07:11.565850+0000","last_undegraded":"2024-09-18T02:07:11.565850+0000","last_fullsized":"2024-09-18T02:07:11.565850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:57.872288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353588+0000","last_change":"2024-09-18T02:04:01.562652+0000","last_active":"2024-09-18T02:04:36.353588+0000","last_peered":"2024-09-18T02:04:36.353588+0000","last_clean":"2024-09-18T02:04:36.353588+0000","last_became_active":"2024-09-18T02:04:01.562058+0000","last_became_peered":"2024-09-18T02:04:01.562058+0000","last_unstale":"2024-09-18T02:04:36.353588+0000","last_undegraded":"2024-09-18T02:04:36.353588+0000","last_fullsized":"2024-09-18T02:04:36.353588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:55.815357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.376804+0000","last_change":"2024-09-18T02:04:03.602001+0000","last_active":"2024-09-18T02:07:43.376804+0000","last_peered":"2024-09-18T02:07:43.376804+0000","last_clean":"2024-09-18T02:07:43.376804+0000","last_became_active":"2024-09-18T02:04:03.600467+0000","last_became_peered":"2024-09-18T02:04:03.600467+0000","last_unstale":"2024-09-18T02:07:43.376804+0000","last_undegraded":"2024-09-18T02:07:43.376804+0000","last_fullsized":"2024-09-18T02:07:43.376804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:57.945679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341767+0000","last_change":"2024-09-18T02:04:05.593604+0000","last_active":"2024-09-18T02:04:36.341767+0000","last_peered":"2024-09-18T02:04:36.341767+0000","last_clean":"2024-09-18T02:04:36.341767+0000","last_became_active":"2024-09-18T02:04:05.592934+0000","last_became_peered":"2024-09-18T02:04:05.592934+0000","last_unstale":"2024-09-18T02:04:36.341767+0000","last_undegraded":"2024-09-18T02:04:36.341767+0000","last_fullsized":"2024-09-18T02:04:36.341767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:04.303561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.009824+0000","last_change":"2024-09-18T02:04:07.624771+0000","last_active":"2024-09-18T02:05:26.009824+0000","last_peered":"2024-09-18T02:05:26.009824+0000","last_clean":"2024-09-18T02:05:26.009824+0000","last_became_active":"2024-09-18T02:04:07.624106+0000","last_became_peered":"2024-09-18T02:04:07.624106+0000","last_unstale":"2024-09-18T02:05:26.009824+0000","last_undegraded":"2024-09-18T02:05:26.009824+0000","last_fullsized":"2024-09-18T02:05:26.009824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:19.261922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:43.634524+0000","last_change":"2024-09-18T02:03:59.556933+0000","last_active":"2024-09-18T02:04:43.634524+0000","last_peered":"2024-09-18T02:04:43.634524+0000","last_clean":"2024-09-18T02:04:43.634524+0000","last_became_active":"2024-09-18T02:03:59.555956+0000","last_became_peered":"2024-09-18T02:03:59.555956+0000","last_unstale":"2024-09-18T02:04:43.634524+0000","last_undegraded":"2024-09-18T02:04:43.634524+0000","last_fullsized":"2024-09-18T02:04:43.634524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:14.846567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.908475+0000","last_change":"2024-09-18T02:03:57.523303+0000","last_active":"2024-09-18T02:04:42.908475+0000","last_peered":"2024-09-18T02:04:42.908475+0000","last_clean":"2024-09-18T02:04:42.908475+0000","last_became_active":"2024-09-18T02:03:57.523041+0000","last_became_peered":"2024-09-18T02:03:57.523041+0000","last_unstale":"2024-09-18T02:04:42.908475+0000","last_undegraded":"2024-09-18T02:04:42.908475+0000","last_fullsized":"2024-09-18T02:04:42.908475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:30.712278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.366147+0000","last_change":"2024-09-18T02:04:36.363414+0000","last_active":"2024-09-18T02:04:36.366147+0000","last_peered":"2024-09-18T02:04:36.366147+0000","last_clean":"2024-09-18T02:04:36.366147+0000","last_became_active":"2024-09-18T02:04:36.362592+0000","last_became_peered":"2024-09-18T02:04:36.362592+0000","last_unstale":"2024-09-18T02:04:36.366147+0000","last_undegraded":"2024-09-18T02:04:36.366147+0000","last_fullsized":"2024-09-18T02:04:36.366147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:35.048118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342013+0000","last_change":"2024-09-18T02:04:03.580344+0000","last_active":"2024-09-18T02:04:36.342013+0000","last_peered":"2024-09-18T02:04:36.342013+0000","last_clean":"2024-09-18T02:04:36.342013+0000","last_became_active":"2024-09-18T02:04:03.579442+0000","last_became_peered":"2024-09-18T02:04:03.579442+0000","last_unstale":"2024-09-18T02:04:36.342013+0000","last_undegraded":"2024-09-18T02:04:36.342013+0000","last_fullsized":"2024-09-18T02:04:36.342013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:24.305992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341161+0000","last_change":"2024-09-18T02:04:05.606711+0000","last_active":"2024-09-18T02:04:36.341161+0000","last_peered":"2024-09-18T02:04:36.341161+0000","last_clean":"2024-09-18T02:04:36.341161+0000","last_became_active":"2024-09-18T02:04:05.605774+0000","last_became_peered":"2024-09-18T02:04:05.605774+0000","last_unstale":"2024-09-18T02:04:36.341161+0000","last_undegraded":"2024-09-18T02:04:36.341161+0000","last_fullsized":"2024-09-18T02:04:36.341161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:09.745074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.874113+0000","last_change":"2024-09-18T02:04:07.610794+0000","last_active":"2024-09-18T02:07:11.874113+0000","last_peered":"2024-09-18T02:07:11.874113+0000","last_clean":"2024-09-18T02:07:11.874113+0000","last_became_active":"2024-09-18T02:04:07.610120+0000","last_became_peered":"2024-09-18T02:04:07.610120+0000","last_unstale":"2024-09-18T02:07:11.874113+0000","last_undegraded":"2024-09-18T02:07:11.874113+0000","last_fullsized":"2024-09-18T02:07:11.874113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:50:22.733414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'18","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.728639+0000","last_change":"2024-09-18T02:04:36.373755+0000","last_active":"2024-09-18T02:07:11.728639+0000","last_peered":"2024-09-18T02:07:11.728639+0000","last_clean":"2024-09-18T02:07:11.728639+0000","last_became_active":"2024-09-18T02:04:36.359108+0000","last_became_peered":"2024-09-18T02:04:36.359108+0000","last_unstale":"2024-09-18T02:07:11.728639+0000","last_undegraded":"2024-09-18T02:07:11.728639+0000","last_fullsized":"2024-09-18T02:07:11.728639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:14.476030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.606401+0000","last_change":"2024-09-18T02:03:57.533341+0000","last_active":"2024-09-18T02:07:11.606401+0000","last_peered":"2024-09-18T02:07:11.606401+0000","last_clean":"2024-09-18T02:07:11.606401+0000","last_became_active":"2024-09-18T02:03:57.533037+0000","last_became_peered":"2024-09-18T02:03:57.533037+0000","last_unstale":"2024-09-18T02:07:11.606401+0000","last_undegraded":"2024-09-18T02:07:11.606401+0000","last_fullsized":"2024-09-18T02:07:11.606401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:02:05.427298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":228,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.169156+0000","last_change":"2024-09-18T02:04:01.568037+0000","last_active":"2024-09-18T02:07:43.169156+0000","last_peered":"2024-09-18T02:07:43.169156+0000","last_clean":"2024-09-18T02:07:43.169156+0000","last_became_active":"2024-09-18T02:04:01.567287+0000","last_became_peered":"2024-09-18T02:04:01.567287+0000","last_unstale":"2024-09-18T02:07:43.169156+0000","last_undegraded":"2024-09-18T02:07:43.169156+0000","last_fullsized":"2024-09-18T02:07:43.169156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:17.024271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'23","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.336252+0000","last_change":"2024-09-18T02:04:03.581817+0000","last_active":"2024-09-18T02:06:26.336252+0000","last_peered":"2024-09-18T02:06:26.336252+0000","last_clean":"2024-09-18T02:06:26.336252+0000","last_became_active":"2024-09-18T02:04:03.581092+0000","last_became_peered":"2024-09-18T02:04:03.581092+0000","last_unstale":"2024-09-18T02:06:26.336252+0000","last_undegraded":"2024-09-18T02:06:26.336252+0000","last_fullsized":"2024-09-18T02:06:26.336252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:22.939603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.210100+0000","last_change":"2024-09-18T02:04:05.609076+0000","last_active":"2024-09-18T02:07:43.210100+0000","last_peered":"2024-09-18T02:07:43.210100+0000","last_clean":"2024-09-18T02:07:43.210100+0000","last_became_active":"2024-09-18T02:04:05.607733+0000","last_became_peered":"2024-09-18T02:04:05.607733+0000","last_unstale":"2024-09-18T02:07:43.210100+0000","last_undegraded":"2024-09-18T02:07:43.210100+0000","last_fullsized":"2024-09-18T02:07:43.210100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:10.197583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.344569+0000","last_change":"2024-09-18T02:04:07.631363+0000","last_active":"2024-09-18T02:04:36.344569+0000","last_peered":"2024-09-18T02:04:36.344569+0000","last_clean":"2024-09-18T02:04:36.344569+0000","last_became_active":"2024-09-18T02:04:07.630721+0000","last_became_peered":"2024-09-18T02:04:07.630721+0000","last_unstale":"2024-09-18T02:04:36.344569+0000","last_undegraded":"2024-09-18T02:04:36.344569+0000","last_fullsized":"2024-09-18T02:04:36.344569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:45.912516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.725053+0000","last_change":"2024-09-18T02:03:59.550519+0000","last_active":"2024-09-18T02:07:11.725053+0000","last_peered":"2024-09-18T02:07:11.725053+0000","last_clean":"2024-09-18T02:07:11.725053+0000","last_became_active":"2024-09-18T02:03:59.548365+0000","last_became_peered":"2024-09-18T02:03:59.548365+0000","last_unstale":"2024-09-18T02:07:11.725053+0000","last_undegraded":"2024-09-18T02:07:11.725053+0000","last_fullsized":"2024-09-18T02:07:11.725053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.601874+0000","last_change":"2024-09-18T02:03:57.521018+0000","last_active":"2024-09-18T02:07:11.601874+0000","last_peered":"2024-09-18T02:07:11.601874+0000","last_clean":"2024-09-18T02:07:11.601874+0000","last_became_active":"2024-09-18T02:03:57.520706+0000","last_became_peered":"2024-09-18T02:03:57.520706+0000","last_unstale":"2024-09-18T02:07:11.601874+0000","last_undegraded":"2024-09-18T02:07:11.601874+0000","last_fullsized":"2024-09-18T02:07:11.601874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:20:27.172876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"23'1","reported_seq":220,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.170170+0000","last_change":"2024-09-18T02:04:01.562150+0000","last_active":"2024-09-18T02:07:43.170170+0000","last_peered":"2024-09-18T02:07:43.170170+0000","last_clean":"2024-09-18T02:07:43.170170+0000","last_became_active":"2024-09-18T02:04:01.559249+0000","last_became_peered":"2024-09-18T02:04:01.559249+0000","last_unstale":"2024-09-18T02:07:43.170170+0000","last_undegraded":"2024-09-18T02:07:43.170170+0000","last_fullsized":"2024-09-18T02:07:43.170170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:27.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'39","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.341035+0000","last_change":"2024-09-18T02:04:03.581074+0000","last_active":"2024-09-18T02:07:43.341035+0000","last_peered":"2024-09-18T02:07:43.341035+0000","last_clean":"2024-09-18T02:07:43.341035+0000","last_became_active":"2024-09-18T02:04:03.580310+0000","last_became_peered":"2024-09-18T02:04:03.580310+0000","last_unstale":"2024-09-18T02:07:43.341035+0000","last_undegraded":"2024-09-18T02:07:43.341035+0000","last_fullsized":"2024-09-18T02:07:43.341035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:35.737383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":439,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.219296+0000","last_change":"2024-09-18T02:04:05.612525+0000","last_active":"2024-09-18T02:07:43.219296+0000","last_peered":"2024-09-18T02:07:43.219296+0000","last_clean":"2024-09-18T02:07:43.219296+0000","last_became_active":"2024-09-18T02:04:05.611707+0000","last_became_peered":"2024-09-18T02:04:05.611707+0000","last_unstale":"2024-09-18T02:07:43.219296+0000","last_undegraded":"2024-09-18T02:07:43.219296+0000","last_fullsized":"2024-09-18T02:07:43.219296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:38.266386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.939685+0000","last_change":"2024-09-18T02:03:59.560537+0000","last_active":"2024-09-18T02:04:42.939685+0000","last_peered":"2024-09-18T02:04:42.939685+0000","last_clean":"2024-09-18T02:04:42.939685+0000","last_became_active":"2024-09-18T02:03:59.559585+0000","last_became_peered":"2024-09-18T02:03:59.559585+0000","last_unstale":"2024-09-18T02:04:42.939685+0000","last_undegraded":"2024-09-18T02:04:42.939685+0000","last_fullsized":"2024-09-18T02:04:42.939685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:48.966165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.028684+0000","last_change":"2024-09-18T02:03:57.528019+0000","last_active":"2024-09-18T02:07:12.028684+0000","last_peered":"2024-09-18T02:07:12.028684+0000","last_clean":"2024-09-18T02:07:12.028684+0000","last_became_active":"2024-09-18T02:03:57.527575+0000","last_became_peered":"2024-09-18T02:03:57.527575+0000","last_unstale":"2024-09-18T02:07:12.028684+0000","last_undegraded":"2024-09-18T02:07:12.028684+0000","last_fullsized":"2024-09-18T02:07:12.028684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:47.581207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339069+0000","last_change":"2024-09-18T02:04:01.569918+0000","last_active":"2024-09-18T02:04:36.339069+0000","last_peered":"2024-09-18T02:04:36.339069+0000","last_clean":"2024-09-18T02:04:36.339069+0000","last_became_active":"2024-09-18T02:04:01.569301+0000","last_became_peered":"2024-09-18T02:04:01.569301+0000","last_unstale":"2024-09-18T02:04:36.339069+0000","last_undegraded":"2024-09-18T02:04:36.339069+0000","last_fullsized":"2024-09-18T02:04:36.339069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:17.024271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.419579+0000","last_change":"2024-09-18T02:04:03.592588+0000","last_active":"2024-09-18T02:07:43.419579+0000","last_peered":"2024-09-18T02:07:43.419579+0000","last_clean":"2024-09-18T02:07:43.419579+0000","last_became_active":"2024-09-18T02:04:03.591195+0000","last_became_peered":"2024-09-18T02:04:03.591195+0000","last_unstale":"2024-09-18T02:07:43.419579+0000","last_undegraded":"2024-09-18T02:07:43.419579+0000","last_fullsized":"2024-09-18T02:07:43.419579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:35:17.659414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339248+0000","last_change":"2024-09-18T02:04:05.606379+0000","last_active":"2024-09-18T02:04:36.339248+0000","last_peered":"2024-09-18T02:04:36.339248+0000","last_clean":"2024-09-18T02:04:36.339248+0000","last_became_active":"2024-09-18T02:04:05.605611+0000","last_became_peered":"2024-09-18T02:04:05.605611+0000","last_unstale":"2024-09-18T02:04:36.339248+0000","last_undegraded":"2024-09-18T02:04:36.339248+0000","last_fullsized":"2024-09-18T02:04:36.339248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:00.566939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.013428+0000","last_change":"2024-09-18T02:04:07.630472+0000","last_active":"2024-09-18T02:05:26.013428+0000","last_peered":"2024-09-18T02:05:26.013428+0000","last_clean":"2024-09-18T02:05:26.013428+0000","last_became_active":"2024-09-18T02:04:07.628247+0000","last_became_peered":"2024-09-18T02:04:07.628247+0000","last_unstale":"2024-09-18T02:05:26.013428+0000","last_undegraded":"2024-09-18T02:05:26.013428+0000","last_fullsized":"2024-09-18T02:05:26.013428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:40.279768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.000495+0000","last_change":"2024-09-18T02:03:59.535593+0000","last_active":"2024-09-18T02:05:26.000495+0000","last_peered":"2024-09-18T02:05:26.000495+0000","last_clean":"2024-09-18T02:05:26.000495+0000","last_became_active":"2024-09-18T02:03:59.535217+0000","last_became_peered":"2024-09-18T02:03:59.535217+0000","last_unstale":"2024-09-18T02:05:26.000495+0000","last_undegraded":"2024-09-18T02:05:26.000495+0000","last_fullsized":"2024-09-18T02:05:26.000495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:38.500729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.369068+0000","last_change":"2024-09-18T02:03:57.529038+0000","last_active":"2024-09-18T02:04:36.369068+0000","last_peered":"2024-09-18T02:04:36.369068+0000","last_clean":"2024-09-18T02:04:36.369068+0000","last_became_active":"2024-09-18T02:03:57.528006+0000","last_became_peered":"2024-09-18T02:03:57.528006+0000","last_unstale":"2024-09-18T02:04:36.369068+0000","last_undegraded":"2024-09-18T02:04:36.369068+0000","last_fullsized":"2024-09-18T02:04:36.369068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:46.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361230+0000","last_change":"2024-09-18T02:04:36.358966+0000","last_active":"2024-09-18T02:04:36.361230+0000","last_peered":"2024-09-18T02:04:36.361230+0000","last_clean":"2024-09-18T02:04:36.361230+0000","last_became_active":"2024-09-18T02:04:36.357607+0000","last_became_peered":"2024-09-18T02:04:36.357607+0000","last_unstale":"2024-09-18T02:04:36.361230+0000","last_undegraded":"2024-09-18T02:04:36.361230+0000","last_fullsized":"2024-09-18T02:04:36.361230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:02:01.245576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'39","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.528025+0000","last_change":"2024-09-18T02:04:03.604260+0000","last_active":"2024-09-18T02:07:43.528025+0000","last_peered":"2024-09-18T02:07:43.528025+0000","last_clean":"2024-09-18T02:07:43.528025+0000","last_became_active":"2024-09-18T02:04:03.601783+0000","last_became_peered":"2024-09-18T02:04:03.601783+0000","last_unstale":"2024-09-18T02:07:43.528025+0000","last_undegraded":"2024-09-18T02:07:43.528025+0000","last_fullsized":"2024-09-18T02:07:43.528025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:52.749305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338424+0000","last_change":"2024-09-18T02:04:05.578434+0000","last_active":"2024-09-18T02:04:36.338424+0000","last_peered":"2024-09-18T02:04:36.338424+0000","last_clean":"2024-09-18T02:04:36.338424+0000","last_became_active":"2024-09-18T02:04:05.577665+0000","last_became_peered":"2024-09-18T02:04:05.577665+0000","last_unstale":"2024-09-18T02:04:36.338424+0000","last_undegraded":"2024-09-18T02:04:36.338424+0000","last_fullsized":"2024-09-18T02:04:36.338424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:59.848912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.297891+0000","last_change":"2024-09-18T02:04:07.621208+0000","last_active":"2024-09-18T02:05:26.297891+0000","last_peered":"2024-09-18T02:05:26.297891+0000","last_clean":"2024-09-18T02:05:26.297891+0000","last_became_active":"2024-09-18T02:04:07.619973+0000","last_became_peered":"2024-09-18T02:04:07.619973+0000","last_unstale":"2024-09-18T02:05:26.297891+0000","last_undegraded":"2024-09-18T02:05:26.297891+0000","last_fullsized":"2024-09-18T02:05:26.297891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:04:52.210610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153629+0000","last_change":"2024-09-18T02:03:59.539493+0000","last_active":"2024-09-18T02:07:12.153629+0000","last_peered":"2024-09-18T02:07:12.153629+0000","last_clean":"2024-09-18T02:07:12.153629+0000","last_became_active":"2024-09-18T02:03:59.539105+0000","last_became_peered":"2024-09-18T02:03:59.539105+0000","last_unstale":"2024-09-18T02:07:12.153629+0000","last_undegraded":"2024-09-18T02:07:12.153629+0000","last_fullsized":"2024-09-18T02:07:12.153629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:48.841356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.985374+0000","last_change":"2024-09-18T02:03:57.530707+0000","last_active":"2024-09-18T02:05:25.985374+0000","last_peered":"2024-09-18T02:05:25.985374+0000","last_clean":"2024-09-18T02:05:25.985374+0000","last_became_active":"2024-09-18T02:03:57.526327+0000","last_became_peered":"2024-09-18T02:03:57.526327+0000","last_unstale":"2024-09-18T02:05:25.985374+0000","last_undegraded":"2024-09-18T02:05:25.985374+0000","last_fullsized":"2024-09-18T02:05:25.985374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:29.374180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343561+0000","last_change":"2024-09-18T02:04:01.562077+0000","last_active":"2024-09-18T02:04:36.343561+0000","last_peered":"2024-09-18T02:04:36.343561+0000","last_clean":"2024-09-18T02:04:36.343561+0000","last_became_active":"2024-09-18T02:04:01.561279+0000","last_became_peered":"2024-09-18T02:04:01.561279+0000","last_unstale":"2024-09-18T02:04:36.343561+0000","last_undegraded":"2024-09-18T02:04:36.343561+0000","last_fullsized":"2024-09-18T02:04:36.343561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:22.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'52","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.432074+0000","last_change":"2024-09-18T02:04:03.595408+0000","last_active":"2024-09-18T02:07:43.432074+0000","last_peered":"2024-09-18T02:07:43.432074+0000","last_clean":"2024-09-18T02:07:43.432074+0000","last_became_active":"2024-09-18T02:04:03.591705+0000","last_became_peered":"2024-09-18T02:04:03.591705+0000","last_unstale":"2024-09-18T02:07:43.432074+0000","last_undegraded":"2024-09-18T02:07:43.432074+0000","last_fullsized":"2024-09-18T02:07:43.432074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:09.695750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":401,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.221680+0000","last_change":"2024-09-18T02:04:05.592469+0000","last_active":"2024-09-18T02:07:43.221680+0000","last_peered":"2024-09-18T02:07:43.221680+0000","last_clean":"2024-09-18T02:07:43.221680+0000","last_became_active":"2024-09-18T02:04:05.591652+0000","last_became_peered":"2024-09-18T02:04:05.591652+0000","last_unstale":"2024-09-18T02:07:43.221680+0000","last_undegraded":"2024-09-18T02:07:43.221680+0000","last_fullsized":"2024-09-18T02:07:43.221680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:09.745074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342503+0000","last_change":"2024-09-18T02:04:07.609950+0000","last_active":"2024-09-18T02:04:36.342503+0000","last_peered":"2024-09-18T02:04:36.342503+0000","last_clean":"2024-09-18T02:04:36.342503+0000","last_became_active":"2024-09-18T02:04:07.609050+0000","last_became_peered":"2024-09-18T02:04:07.609050+0000","last_unstale":"2024-09-18T02:04:36.342503+0000","last_undegraded":"2024-09-18T02:04:36.342503+0000","last_fullsized":"2024-09-18T02:04:36.342503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:08.651954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'14","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153098+0000","last_change":"2024-09-18T02:03:59.532107+0000","last_active":"2024-09-18T02:07:12.153098+0000","last_peered":"2024-09-18T02:07:12.153098+0000","last_clean":"2024-09-18T02:07:12.153098+0000","last_became_active":"2024-09-18T02:03:59.531445+0000","last_became_peered":"2024-09-18T02:03:59.531445+0000","last_unstale":"2024-09-18T02:07:12.153098+0000","last_undegraded":"2024-09-18T02:07:12.153098+0000","last_fullsized":"2024-09-18T02:07:12.153098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.508285+0000","last_change":"2024-09-18T02:03:57.522436+0000","last_active":"2024-09-18T02:07:11.508285+0000","last_peered":"2024-09-18T02:07:11.508285+0000","last_clean":"2024-09-18T02:07:11.508285+0000","last_became_active":"2024-09-18T02:03:57.521858+0000","last_became_peered":"2024-09-18T02:03:57.521858+0000","last_unstale":"2024-09-18T02:07:11.508285+0000","last_undegraded":"2024-09-18T02:07:11.508285+0000","last_fullsized":"2024-09-18T02:07:11.508285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:52.057677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361115+0000","last_change":"2024-09-18T02:04:36.357179+0000","last_active":"2024-09-18T02:04:36.361115+0000","last_peered":"2024-09-18T02:04:36.361115+0000","last_clean":"2024-09-18T02:04:36.361115+0000","last_became_active":"2024-09-18T02:04:36.356453+0000","last_became_peered":"2024-09-18T02:04:36.356453+0000","last_unstale":"2024-09-18T02:04:36.361115+0000","last_undegraded":"2024-09-18T02:04:36.361115+0000","last_fullsized":"2024-09-18T02:04:36.361115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:27.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'72","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.443227+0000","last_change":"2024-09-18T02:04:03.596161+0000","last_active":"2024-09-18T02:07:43.443227+0000","last_peered":"2024-09-18T02:07:43.443227+0000","last_clean":"2024-09-18T02:07:43.443227+0000","last_became_active":"2024-09-18T02:04:03.595618+0000","last_became_peered":"2024-09-18T02:04:03.595618+0000","last_unstale":"2024-09-18T02:07:43.443227+0000","last_undegraded":"2024-09-18T02:07:43.443227+0000","last_fullsized":"2024-09-18T02:07:43.443227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:30.345316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338225+0000","last_change":"2024-09-18T02:04:05.585960+0000","last_active":"2024-09-18T02:04:36.338225+0000","last_peered":"2024-09-18T02:04:36.338225+0000","last_clean":"2024-09-18T02:04:36.338225+0000","last_became_active":"2024-09-18T02:04:05.585272+0000","last_became_peered":"2024-09-18T02:04:05.585272+0000","last_unstale":"2024-09-18T02:04:36.338225+0000","last_undegraded":"2024-09-18T02:04:36.338225+0000","last_fullsized":"2024-09-18T02:04:36.338225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:26.254201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.376039+0000","last_change":"2024-09-18T02:04:07.614915+0000","last_active":"2024-09-18T02:07:12.376039+0000","last_peered":"2024-09-18T02:07:12.376039+0000","last_clean":"2024-09-18T02:07:12.376039+0000","last_became_active":"2024-09-18T02:04:07.614232+0000","last_became_peered":"2024-09-18T02:04:07.614232+0000","last_unstale":"2024-09-18T02:07:12.376039+0000","last_undegraded":"2024-09-18T02:07:12.376039+0000","last_fullsized":"2024-09-18T02:07:12.376039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:34.372220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'18","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154480+0000","last_change":"2024-09-18T02:03:59.546334+0000","last_active":"2024-09-18T02:07:12.154480+0000","last_peered":"2024-09-18T02:07:12.154480+0000","last_clean":"2024-09-18T02:07:12.154480+0000","last_became_active":"2024-09-18T02:03:59.545956+0000","last_became_peered":"2024-09-18T02:03:59.545956+0000","last_unstale":"2024-09-18T02:07:12.154480+0000","last_undegraded":"2024-09-18T02:07:12.154480+0000","last_fullsized":"2024-09-18T02:07:12.154480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:12.929565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.588997+0000","last_change":"2024-09-18T02:03:57.522159+0000","last_active":"2024-09-18T02:07:11.588997+0000","last_peered":"2024-09-18T02:07:11.588997+0000","last_clean":"2024-09-18T02:07:11.588997+0000","last_became_active":"2024-09-18T02:03:57.520036+0000","last_became_peered":"2024-09-18T02:03:57.520036+0000","last_unstale":"2024-09-18T02:07:11.588997+0000","last_undegraded":"2024-09-18T02:07:11.588997+0000","last_fullsized":"2024-09-18T02:07:11.588997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:47.581207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.361351+0000","last_change":"2024-09-18T02:04:01.573344+0000","last_active":"2024-09-18T02:04:36.361351+0000","last_peered":"2024-09-18T02:04:36.361351+0000","last_clean":"2024-09-18T02:04:36.361351+0000","last_became_active":"2024-09-18T02:04:01.573084+0000","last_became_peered":"2024-09-18T02:04:01.573084+0000","last_unstale":"2024-09-18T02:04:36.361351+0000","last_undegraded":"2024-09-18T02:04:36.361351+0000","last_fullsized":"2024-09-18T02:04:36.361351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:45:12.008014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'41","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.300062+0000","last_change":"2024-09-18T02:04:03.567085+0000","last_active":"2024-09-18T02:07:43.300062+0000","last_peered":"2024-09-18T02:07:43.300062+0000","last_clean":"2024-09-18T02:07:43.300062+0000","last_became_active":"2024-09-18T02:04:03.565801+0000","last_became_peered":"2024-09-18T02:04:03.565801+0000","last_unstale":"2024-09-18T02:07:43.300062+0000","last_undegraded":"2024-09-18T02:07:43.300062+0000","last_fullsized":"2024-09-18T02:07:43.300062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:33.058001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.357876+0000","last_change":"2024-09-18T02:04:05.612592+0000","last_active":"2024-09-18T02:04:36.357876+0000","last_peered":"2024-09-18T02:04:36.357876+0000","last_clean":"2024-09-18T02:04:36.357876+0000","last_became_active":"2024-09-18T02:04:05.612052+0000","last_became_peered":"2024-09-18T02:04:05.612052+0000","last_unstale":"2024-09-18T02:04:36.357876+0000","last_undegraded":"2024-09-18T02:04:36.357876+0000","last_fullsized":"2024-09-18T02:04:36.357876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:51:05.159090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.173402+0000","last_change":"2024-09-18T02:04:07.622545+0000","last_active":"2024-09-18T02:07:12.173402+0000","last_peered":"2024-09-18T02:07:12.173402+0000","last_clean":"2024-09-18T02:07:12.173402+0000","last_became_active":"2024-09-18T02:04:07.622004+0000","last_became_peered":"2024-09-18T02:04:07.622004+0000","last_unstale":"2024-09-18T02:07:12.173402+0000","last_undegraded":"2024-09-18T02:07:12.173402+0000","last_fullsized":"2024-09-18T02:07:12.173402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:53.836670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.218296+0000","last_change":"2024-09-18T02:04:36.364542+0000","last_active":"2024-09-18T02:07:12.218296+0000","last_peered":"2024-09-18T02:07:12.218296+0000","last_clean":"2024-09-18T02:07:12.218296+0000","last_became_active":"2024-09-18T02:04:36.361748+0000","last_became_peered":"2024-09-18T02:04:36.361748+0000","last_unstale":"2024-09-18T02:07:12.218296+0000","last_undegraded":"2024-09-18T02:07:12.218296+0000","last_fullsized":"2024-09-18T02:07:12.218296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:04.881724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.537721+0000","last_change":"2024-09-18T02:03:57.530747+0000","last_active":"2024-09-18T02:07:11.537721+0000","last_peered":"2024-09-18T02:07:11.537721+0000","last_clean":"2024-09-18T02:07:11.537721+0000","last_became_active":"2024-09-18T02:03:57.526977+0000","last_became_peered":"2024-09-18T02:03:57.526977+0000","last_unstale":"2024-09-18T02:07:11.537721+0000","last_undegraded":"2024-09-18T02:07:11.537721+0000","last_fullsized":"2024-09-18T02:07:11.537721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:29.938986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345881+0000","last_change":"2024-09-18T02:04:01.562995+0000","last_active":"2024-09-18T02:04:36.345881+0000","last_peered":"2024-09-18T02:04:36.345881+0000","last_clean":"2024-09-18T02:04:36.345881+0000","last_became_active":"2024-09-18T02:04:01.561913+0000","last_became_peered":"2024-09-18T02:04:01.561913+0000","last_unstale":"2024-09-18T02:04:36.345881+0000","last_undegraded":"2024-09-18T02:04:36.345881+0000","last_fullsized":"2024-09-18T02:04:36.345881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:33.717350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.501881+0000","last_change":"2024-09-18T02:04:03.581156+0000","last_active":"2024-09-18T02:07:43.501881+0000","last_peered":"2024-09-18T02:07:43.501881+0000","last_clean":"2024-09-18T02:07:43.501881+0000","last_became_active":"2024-09-18T02:04:03.580395+0000","last_became_peered":"2024-09-18T02:04:03.580395+0000","last_unstale":"2024-09-18T02:07:43.501881+0000","last_undegraded":"2024-09-18T02:07:43.501881+0000","last_fullsized":"2024-09-18T02:07:43.501881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:36.129908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":407,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.211113+0000","last_change":"2024-09-18T02:04:05.604333+0000","last_active":"2024-09-18T02:07:43.211113+0000","last_peered":"2024-09-18T02:07:43.211113+0000","last_clean":"2024-09-18T02:07:43.211113+0000","last_became_active":"2024-09-18T02:04:05.603548+0000","last_became_peered":"2024-09-18T02:04:05.603548+0000","last_unstale":"2024-09-18T02:07:43.211113+0000","last_undegraded":"2024-09-18T02:07:43.211113+0000","last_fullsized":"2024-09-18T02:07:43.211113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:24.870978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.082226+0000","last_change":"2024-09-18T02:04:07.620770+0000","last_active":"2024-09-18T02:07:12.082226+0000","last_peered":"2024-09-18T02:07:12.082226+0000","last_clean":"2024-09-18T02:07:12.082226+0000","last_became_active":"2024-09-18T02:04:07.620094+0000","last_became_peered":"2024-09-18T02:04:07.620094+0000","last_unstale":"2024-09-18T02:07:12.082226+0000","last_undegraded":"2024-09-18T02:07:12.082226+0000","last_fullsized":"2024-09-18T02:07:12.082226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:36:55.417123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'14","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069886+0000","last_change":"2024-09-18T02:03:59.535067+0000","last_active":"2024-09-18T02:07:12.069886+0000","last_peered":"2024-09-18T02:07:12.069886+0000","last_clean":"2024-09-18T02:07:12.069886+0000","last_became_active":"2024-09-18T02:03:59.534547+0000","last_became_peered":"2024-09-18T02:03:59.534547+0000","last_unstale":"2024-09-18T02:07:12.069886+0000","last_undegraded":"2024-09-18T02:07:12.069886+0000","last_fullsized":"2024-09-18T02:07:12.069886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349002+0000","last_change":"2024-09-18T02:03:57.526267+0000","last_active":"2024-09-18T02:04:36.349002+0000","last_peered":"2024-09-18T02:04:36.349002+0000","last_clean":"2024-09-18T02:04:36.349002+0000","last_became_active":"2024-09-18T02:03:57.525576+0000","last_became_peered":"2024-09-18T02:03:57.525576+0000","last_unstale":"2024-09-18T02:04:36.349002+0000","last_undegraded":"2024-09-18T02:04:36.349002+0000","last_fullsized":"2024-09-18T02:04:36.349002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:45:50.125550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.182796+0000","last_change":"2024-09-18T02:04:01.565275+0000","last_active":"2024-09-18T02:07:43.182796+0000","last_peered":"2024-09-18T02:07:43.182796+0000","last_clean":"2024-09-18T02:07:43.182796+0000","last_became_active":"2024-09-18T02:04:01.564385+0000","last_became_peered":"2024-09-18T02:04:01.564385+0000","last_unstale":"2024-09-18T02:07:43.182796+0000","last_undegraded":"2024-09-18T02:07:43.182796+0000","last_fullsized":"2024-09-18T02:07:43.182796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:11:50.980422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353471+0000","last_change":"2024-09-18T02:04:03.601350+0000","last_active":"2024-09-18T02:04:36.353471+0000","last_peered":"2024-09-18T02:04:36.353471+0000","last_clean":"2024-09-18T02:04:36.353471+0000","last_became_active":"2024-09-18T02:04:03.600545+0000","last_became_peered":"2024-09-18T02:04:03.600545+0000","last_unstale":"2024-09-18T02:04:36.353471+0000","last_undegraded":"2024-09-18T02:04:36.353471+0000","last_fullsized":"2024-09-18T02:04:36.353471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:51:09.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":463,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.214306+0000","last_change":"2024-09-18T02:04:05.582865+0000","last_active":"2024-09-18T02:07:43.214306+0000","last_peered":"2024-09-18T02:07:43.214306+0000","last_clean":"2024-09-18T02:07:43.214306+0000","last_became_active":"2024-09-18T02:04:05.582127+0000","last_became_peered":"2024-09-18T02:04:05.582127+0000","last_unstale":"2024-09-18T02:07:43.214306+0000","last_undegraded":"2024-09-18T02:07:43.214306+0000","last_fullsized":"2024-09-18T02:07:43.214306+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:43.899135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.741734+0000","last_change":"2024-09-18T02:04:07.606525+0000","last_active":"2024-09-18T02:06:10.741734+0000","last_peered":"2024-09-18T02:06:10.741734+0000","last_clean":"2024-09-18T02:06:10.741734+0000","last_became_active":"2024-09-18T02:04:07.602985+0000","last_became_peered":"2024-09-18T02:04:07.602985+0000","last_unstale":"2024-09-18T02:06:10.741734+0000","last_undegraded":"2024-09-18T02:06:10.741734+0000","last_fullsized":"2024-09-18T02:06:10.741734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:39.005182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.135331+0000","last_change":"2024-09-18T02:03:59.555188+0000","last_active":"2024-09-18T02:04:42.135331+0000","last_peered":"2024-09-18T02:04:42.135331+0000","last_clean":"2024-09-18T02:04:42.135331+0000","last_became_active":"2024-09-18T02:03:59.554711+0000","last_became_peered":"2024-09-18T02:03:59.554711+0000","last_unstale":"2024-09-18T02:04:42.135331+0000","last_undegraded":"2024-09-18T02:04:42.135331+0000","last_fullsized":"2024-09-18T02:04:42.135331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:54:59.350305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346294+0000","last_change":"2024-09-18T02:03:57.531537+0000","last_active":"2024-09-18T02:04:36.346294+0000","last_peered":"2024-09-18T02:04:36.346294+0000","last_clean":"2024-09-18T02:04:36.346294+0000","last_became_active":"2024-09-18T02:03:57.531156+0000","last_became_peered":"2024-09-18T02:03:57.531156+0000","last_unstale":"2024-09-18T02:04:36.346294+0000","last_undegraded":"2024-09-18T02:04:36.346294+0000","last_fullsized":"2024-09-18T02:04:36.346294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:38:10.322009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358596+0000","last_change":"2024-09-18T02:04:01.566384+0000","last_active":"2024-09-18T02:04:36.358596+0000","last_peered":"2024-09-18T02:04:36.358596+0000","last_clean":"2024-09-18T02:04:36.358596+0000","last_became_active":"2024-09-18T02:04:01.565999+0000","last_became_peered":"2024-09-18T02:04:01.565999+0000","last_unstale":"2024-09-18T02:04:36.358596+0000","last_undegraded":"2024-09-18T02:04:36.358596+0000","last_fullsized":"2024-09-18T02:04:36.358596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:14.084784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'44","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.394971+0000","last_change":"2024-09-18T02:04:03.564795+0000","last_active":"2024-09-18T02:07:43.394971+0000","last_peered":"2024-09-18T02:07:43.394971+0000","last_clean":"2024-09-18T02:07:43.394971+0000","last_became_active":"2024-09-18T02:04:03.564021+0000","last_became_peered":"2024-09-18T02:04:03.564021+0000","last_unstale":"2024-09-18T02:07:43.394971+0000","last_undegraded":"2024-09-18T02:07:43.394971+0000","last_fullsized":"2024-09-18T02:07:43.394971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:32.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346074+0000","last_change":"2024-09-18T02:04:05.611095+0000","last_active":"2024-09-18T02:04:36.346074+0000","last_peered":"2024-09-18T02:04:36.346074+0000","last_clean":"2024-09-18T02:04:36.346074+0000","last_became_active":"2024-09-18T02:04:05.610024+0000","last_became_peered":"2024-09-18T02:04:05.610024+0000","last_unstale":"2024-09-18T02:04:36.346074+0000","last_undegraded":"2024-09-18T02:04:36.346074+0000","last_fullsized":"2024-09-18T02:04:36.346074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:13.378109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.289268+0000","last_change":"2024-09-18T02:04:07.619059+0000","last_active":"2024-09-18T02:07:12.289268+0000","last_peered":"2024-09-18T02:07:12.289268+0000","last_clean":"2024-09-18T02:07:12.289268+0000","last_became_active":"2024-09-18T02:04:07.618153+0000","last_became_peered":"2024-09-18T02:04:07.618153+0000","last_unstale":"2024-09-18T02:07:12.289268+0000","last_undegraded":"2024-09-18T02:07:12.289268+0000","last_fullsized":"2024-09-18T02:07:12.289268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:28.091310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'9","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.333102+0000","last_change":"2024-09-18T02:03:59.560833+0000","last_active":"2024-09-18T02:06:06.333102+0000","last_peered":"2024-09-18T02:06:06.333102+0000","last_clean":"2024-09-18T02:06:06.333102+0000","last_became_active":"2024-09-18T02:03:59.559592+0000","last_became_peered":"2024-09-18T02:03:59.559592+0000","last_unstale":"2024-09-18T02:06:06.333102+0000","last_undegraded":"2024-09-18T02:06:06.333102+0000","last_fullsized":"2024-09-18T02:06:06.333102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:07.330297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:46.325632+0000","last_change":"2024-09-18T02:03:43.338768+0000","last_active":"2024-09-18T02:05:46.325632+0000","last_peered":"2024-09-18T02:05:46.325632+0000","last_clean":"2024-09-18T02:05:46.325632+0000","last_became_active":"2024-09-18T02:03:43.336731+0000","last_became_peered":"2024-09-18T02:03:43.336731+0000","last_unstale":"2024-09-18T02:05:46.325632+0000","last_undegraded":"2024-09-18T02:05:46.325632+0000","last_fullsized":"2024-09-18T02:05:46.325632+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_clean_scrub_stamp":"2024-09-18T02:03:42.235832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:47:03.749921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350315+0000","last_change":"2024-09-18T02:03:50.287984+0000","last_active":"2024-09-18T02:04:36.350315+0000","last_peered":"2024-09-18T02:04:36.350315+0000","last_clean":"2024-09-18T02:04:36.350315+0000","last_became_active":"2024-09-18T02:03:48.273444+0000","last_became_peered":"2024-09-18T02:03:48.273444+0000","last_unstale":"2024-09-18T02:04:36.350315+0000","last_undegraded":"2024-09-18T02:04:36.350315+0000","last_fullsized":"2024-09-18T02:04:36.350315+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:18.121435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024299339999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.048115+0000","last_change":"2024-09-18T02:03:57.533463+0000","last_active":"2024-09-18T02:06:11.048115+0000","last_peered":"2024-09-18T02:06:11.048115+0000","last_clean":"2024-09-18T02:06:11.048115+0000","last_became_active":"2024-09-18T02:03:57.532844+0000","last_became_peered":"2024-09-18T02:03:57.532844+0000","last_unstale":"2024-09-18T02:06:11.048115+0000","last_undegraded":"2024-09-18T02:06:11.048115+0000","last_fullsized":"2024-09-18T02:06:11.048115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:09.285157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.347738+0000","last_change":"2024-09-18T02:04:01.565115+0000","last_active":"2024-09-18T02:04:36.347738+0000","last_peered":"2024-09-18T02:04:36.347738+0000","last_clean":"2024-09-18T02:04:36.347738+0000","last_became_active":"2024-09-18T02:04:01.563633+0000","last_became_peered":"2024-09-18T02:04:01.563633+0000","last_unstale":"2024-09-18T02:04:36.347738+0000","last_undegraded":"2024-09-18T02:04:36.347738+0000","last_fullsized":"2024-09-18T02:04:36.347738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:13:18.066545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'94","reported_seq":181,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.481117+0000","last_change":"2024-09-18T02:04:03.607393+0000","last_active":"2024-09-18T02:07:43.481117+0000","last_peered":"2024-09-18T02:07:43.481117+0000","last_clean":"2024-09-18T02:07:43.481117+0000","last_became_active":"2024-09-18T02:04:03.606800+0000","last_became_peered":"2024-09-18T02:04:03.606800+0000","last_unstale":"2024-09-18T02:07:43.481117+0000","last_undegraded":"2024-09-18T02:07:43.481117+0000","last_fullsized":"2024-09-18T02:07:43.481117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:02:19.651160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345601+0000","last_change":"2024-09-18T02:04:05.589275+0000","last_active":"2024-09-18T02:04:36.345601+0000","last_peered":"2024-09-18T02:04:36.345601+0000","last_clean":"2024-09-18T02:04:36.345601+0000","last_became_active":"2024-09-18T02:04:05.588568+0000","last_became_peered":"2024-09-18T02:04:05.588568+0000","last_unstale":"2024-09-18T02:04:36.345601+0000","last_undegraded":"2024-09-18T02:04:36.345601+0000","last_fullsized":"2024-09-18T02:04:36.345601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:26:31.240038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.245394+0000","last_change":"2024-09-18T02:04:07.628613+0000","last_active":"2024-09-18T02:07:12.245394+0000","last_peered":"2024-09-18T02:07:12.245394+0000","last_clean":"2024-09-18T02:07:12.245394+0000","last_became_active":"2024-09-18T02:04:07.613914+0000","last_became_peered":"2024-09-18T02:04:07.613914+0000","last_unstale":"2024-09-18T02:07:12.245394+0000","last_undegraded":"2024-09-18T02:07:12.245394+0000","last_fullsized":"2024-09-18T02:07:12.245394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:39:11.758456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.169657+0000","last_change":"2024-09-18T02:03:59.556174+0000","last_active":"2024-09-18T02:07:12.169657+0000","last_peered":"2024-09-18T02:07:12.169657+0000","last_clean":"2024-09-18T02:07:12.169657+0000","last_became_active":"2024-09-18T02:03:59.555801+0000","last_became_peered":"2024-09-18T02:03:59.555801+0000","last_unstale":"2024-09-18T02:07:12.169657+0000","last_undegraded":"2024-09-18T02:07:12.169657+0000","last_fullsized":"2024-09-18T02:07:12.169657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:28.174295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346239+0000","last_change":"2024-09-18T02:03:50.285797+0000","last_active":"2024-09-18T02:04:36.346239+0000","last_peered":"2024-09-18T02:04:36.346239+0000","last_clean":"2024-09-18T02:04:36.346239+0000","last_became_active":"2024-09-18T02:03:48.275709+0000","last_became_peered":"2024-09-18T02:03:48.275709+0000","last_unstale":"2024-09-18T02:04:36.346239+0000","last_undegraded":"2024-09-18T02:04:36.346239+0000","last_fullsized":"2024-09-18T02:04:36.346239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:53.873897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047579399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339035+0000","last_change":"2024-09-18T02:03:57.521576+0000","last_active":"2024-09-18T02:04:36.339035+0000","last_peered":"2024-09-18T02:04:36.339035+0000","last_clean":"2024-09-18T02:04:36.339035+0000","last_became_active":"2024-09-18T02:03:57.520559+0000","last_became_peered":"2024-09-18T02:03:57.520559+0000","last_unstale":"2024-09-18T02:04:36.339035+0000","last_undegraded":"2024-09-18T02:04:36.339035+0000","last_fullsized":"2024-09-18T02:04:36.339035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.363932+0000","last_change":"2024-09-18T02:04:01.561598+0000","last_active":"2024-09-18T02:04:36.363932+0000","last_peered":"2024-09-18T02:04:36.363932+0000","last_clean":"2024-09-18T02:04:36.363932+0000","last_became_active":"2024-09-18T02:04:01.561194+0000","last_became_peered":"2024-09-18T02:04:01.561194+0000","last_unstale":"2024-09-18T02:04:36.363932+0000","last_undegraded":"2024-09-18T02:04:36.363932+0000","last_fullsized":"2024-09-18T02:04:36.363932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:23.937467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":513,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.536385+0000","last_change":"2024-09-18T02:04:03.571137+0000","last_active":"2024-09-18T02:07:43.536385+0000","last_peered":"2024-09-18T02:07:43.536385+0000","last_clean":"2024-09-18T02:07:43.536385+0000","last_became_active":"2024-09-18T02:04:03.570288+0000","last_became_peered":"2024-09-18T02:04:03.570288+0000","last_unstale":"2024-09-18T02:07:43.536385+0000","last_undegraded":"2024-09-18T02:07:43.536385+0000","last_fullsized":"2024-09-18T02:07:43.536385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:22.857455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353081+0000","last_change":"2024-09-18T02:04:05.609826+0000","last_active":"2024-09-18T02:04:36.353081+0000","last_peered":"2024-09-18T02:04:36.353081+0000","last_clean":"2024-09-18T02:04:36.353081+0000","last_became_active":"2024-09-18T02:04:05.608544+0000","last_became_peered":"2024-09-18T02:04:05.608544+0000","last_unstale":"2024-09-18T02:04:36.353081+0000","last_undegraded":"2024-09-18T02:04:36.353081+0000","last_fullsized":"2024-09-18T02:04:36.353081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:32:12.009097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'7","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.130305+0000","last_change":"2024-09-18T02:04:07.624305+0000","last_active":"2024-09-18T02:07:12.130305+0000","last_peered":"2024-09-18T02:07:12.130305+0000","last_clean":"2024-09-18T02:07:12.130305+0000","last_became_active":"2024-09-18T02:04:07.622337+0000","last_became_peered":"2024-09-18T02:04:07.622337+0000","last_unstale":"2024-09-18T02:07:12.130305+0000","last_undegraded":"2024-09-18T02:07:12.130305+0000","last_fullsized":"2024-09-18T02:07:12.130305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:48.413588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153178+0000","last_change":"2024-09-18T02:03:59.549829+0000","last_active":"2024-09-18T02:07:12.153178+0000","last_peered":"2024-09-18T02:07:12.153178+0000","last_clean":"2024-09-18T02:07:12.153178+0000","last_became_active":"2024-09-18T02:03:59.548308+0000","last_became_peered":"2024-09-18T02:03:59.548308+0000","last_unstale":"2024-09-18T02:07:12.153178+0000","last_undegraded":"2024-09-18T02:07:12.153178+0000","last_fullsized":"2024-09-18T02:07:12.153178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:36.437530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341109+0000","last_change":"2024-09-18T02:03:50.338272+0000","last_active":"2024-09-18T02:04:36.341109+0000","last_peered":"2024-09-18T02:04:36.341109+0000","last_clean":"2024-09-18T02:04:36.341109+0000","last_became_active":"2024-09-18T02:03:48.275609+0000","last_became_peered":"2024-09-18T02:03:48.275609+0000","last_unstale":"2024-09-18T02:04:36.341109+0000","last_undegraded":"2024-09-18T02:04:36.341109+0000","last_fullsized":"2024-09-18T02:04:36.341109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067244799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.346475+0000","last_change":"2024-09-18T02:03:57.520998+0000","last_active":"2024-09-18T02:04:41.346475+0000","last_peered":"2024-09-18T02:04:41.346475+0000","last_clean":"2024-09-18T02:04:41.346475+0000","last_became_active":"2024-09-18T02:03:57.520103+0000","last_became_peered":"2024-09-18T02:03:57.520103+0000","last_unstale":"2024-09-18T02:04:41.346475+0000","last_undegraded":"2024-09-18T02:04:41.346475+0000","last_fullsized":"2024-09-18T02:04:41.346475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.369051+0000","last_change":"2024-09-18T02:04:01.560743+0000","last_active":"2024-09-18T02:04:36.369051+0000","last_peered":"2024-09-18T02:04:36.369051+0000","last_clean":"2024-09-18T02:04:36.369051+0000","last_became_active":"2024-09-18T02:04:01.560471+0000","last_became_peered":"2024-09-18T02:04:01.560471+0000","last_unstale":"2024-09-18T02:04:36.369051+0000","last_undegraded":"2024-09-18T02:04:36.369051+0000","last_fullsized":"2024-09-18T02:04:36.369051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:05.940301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.783060+0000","last_change":"2024-09-18T02:04:03.589654+0000","last_active":"2024-09-18T02:07:11.783060+0000","last_peered":"2024-09-18T02:07:11.783060+0000","last_clean":"2024-09-18T02:07:11.783060+0000","last_became_active":"2024-09-18T02:04:03.588913+0000","last_became_peered":"2024-09-18T02:04:03.588913+0000","last_unstale":"2024-09-18T02:07:11.783060+0000","last_undegraded":"2024-09-18T02:07:11.783060+0000","last_fullsized":"2024-09-18T02:07:11.783060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:24.835730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339832+0000","last_change":"2024-09-18T02:04:05.589310+0000","last_active":"2024-09-18T02:04:36.339832+0000","last_peered":"2024-09-18T02:04:36.339832+0000","last_clean":"2024-09-18T02:04:36.339832+0000","last_became_active":"2024-09-18T02:04:05.588457+0000","last_became_peered":"2024-09-18T02:04:05.588457+0000","last_unstale":"2024-09-18T02:04:36.339832+0000","last_undegraded":"2024-09-18T02:04:36.339832+0000","last_fullsized":"2024-09-18T02:04:36.339832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:27.971023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348229+0000","last_change":"2024-09-18T02:04:07.622460+0000","last_active":"2024-09-18T02:04:36.348229+0000","last_peered":"2024-09-18T02:04:36.348229+0000","last_clean":"2024-09-18T02:04:36.348229+0000","last_became_active":"2024-09-18T02:04:07.621651+0000","last_became_peered":"2024-09-18T02:04:07.621651+0000","last_unstale":"2024-09-18T02:04:36.348229+0000","last_undegraded":"2024-09-18T02:04:36.348229+0000","last_fullsized":"2024-09-18T02:04:36.348229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:58.105568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342749+0000","last_change":"2024-09-18T02:03:59.536526+0000","last_active":"2024-09-18T02:04:36.342749+0000","last_peered":"2024-09-18T02:04:36.342749+0000","last_clean":"2024-09-18T02:04:36.342749+0000","last_became_active":"2024-09-18T02:03:59.535693+0000","last_became_peered":"2024-09-18T02:03:59.535693+0000","last_unstale":"2024-09-18T02:04:36.342749+0000","last_undegraded":"2024-09-18T02:04:36.342749+0000","last_fullsized":"2024-09-18T02:04:36.342749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:45.343721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348980+0000","last_change":"2024-09-18T02:03:50.287790+0000","last_active":"2024-09-18T02:04:36.348980+0000","last_peered":"2024-09-18T02:04:36.348980+0000","last_clean":"2024-09-18T02:04:36.348980+0000","last_became_active":"2024-09-18T02:03:48.276543+0000","last_became_peered":"2024-09-18T02:03:48.276543+0000","last_unstale":"2024-09-18T02:04:36.348980+0000","last_undegraded":"2024-09-18T02:04:36.348980+0000","last_fullsized":"2024-09-18T02:04:36.348980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:17.356845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023330579999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.344795+0000","last_change":"2024-09-18T02:03:57.529138+0000","last_active":"2024-09-18T02:04:36.344795+0000","last_peered":"2024-09-18T02:04:36.344795+0000","last_clean":"2024-09-18T02:04:36.344795+0000","last_became_active":"2024-09-18T02:03:57.528828+0000","last_became_peered":"2024-09-18T02:03:57.528828+0000","last_unstale":"2024-09-18T02:04:36.344795+0000","last_undegraded":"2024-09-18T02:04:36.344795+0000","last_fullsized":"2024-09-18T02:04:36.344795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:40.008713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342804+0000","last_change":"2024-09-18T02:04:01.572278+0000","last_active":"2024-09-18T02:04:36.342804+0000","last_peered":"2024-09-18T02:04:36.342804+0000","last_clean":"2024-09-18T02:04:36.342804+0000","last_became_active":"2024-09-18T02:04:01.571608+0000","last_became_peered":"2024-09-18T02:04:01.571608+0000","last_unstale":"2024-09-18T02:04:36.342804+0000","last_undegraded":"2024-09-18T02:04:36.342804+0000","last_fullsized":"2024-09-18T02:04:36.342804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:01.789731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.140114+0000","last_change":"2024-09-18T02:04:03.602343+0000","last_active":"2024-09-18T02:07:11.140114+0000","last_peered":"2024-09-18T02:07:11.140114+0000","last_clean":"2024-09-18T02:07:11.140114+0000","last_became_active":"2024-09-18T02:04:03.601140+0000","last_became_peered":"2024-09-18T02:04:03.601140+0000","last_unstale":"2024-09-18T02:07:11.140114+0000","last_undegraded":"2024-09-18T02:07:11.140114+0000","last_fullsized":"2024-09-18T02:07:11.140114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:33:06.804055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358317+0000","last_change":"2024-09-18T02:04:05.612576+0000","last_active":"2024-09-18T02:04:36.358317+0000","last_peered":"2024-09-18T02:04:36.358317+0000","last_clean":"2024-09-18T02:04:36.358317+0000","last_became_active":"2024-09-18T02:04:05.612007+0000","last_became_peered":"2024-09-18T02:04:05.612007+0000","last_unstale":"2024-09-18T02:04:36.358317+0000","last_undegraded":"2024-09-18T02:04:36.358317+0000","last_fullsized":"2024-09-18T02:04:36.358317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:53:26.368935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.716259+0000","last_change":"2024-09-18T02:04:07.623097+0000","last_active":"2024-09-18T02:06:10.716259+0000","last_peered":"2024-09-18T02:06:10.716259+0000","last_clean":"2024-09-18T02:06:10.716259+0000","last_became_active":"2024-09-18T02:04:07.622247+0000","last_became_peered":"2024-09-18T02:04:07.622247+0000","last_unstale":"2024-09-18T02:06:10.716259+0000","last_undegraded":"2024-09-18T02:06:10.716259+0000","last_fullsized":"2024-09-18T02:06:10.716259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:17.300649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.954084+0000","last_change":"2024-09-18T02:03:59.560066+0000","last_active":"2024-09-18T02:06:06.954084+0000","last_peered":"2024-09-18T02:06:06.954084+0000","last_clean":"2024-09-18T02:06:06.954084+0000","last_became_active":"2024-09-18T02:03:59.559749+0000","last_became_peered":"2024-09-18T02:03:59.559749+0000","last_unstale":"2024-09-18T02:06:06.954084+0000","last_undegraded":"2024-09-18T02:06:06.954084+0000","last_fullsized":"2024-09-18T02:06:06.954084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364329+0000","last_change":"2024-09-18T02:03:57.524455+0000","last_active":"2024-09-18T02:04:36.364329+0000","last_peered":"2024-09-18T02:04:36.364329+0000","last_clean":"2024-09-18T02:04:36.364329+0000","last_became_active":"2024-09-18T02:03:57.519961+0000","last_became_peered":"2024-09-18T02:03:57.519961+0000","last_unstale":"2024-09-18T02:04:36.364329+0000","last_undegraded":"2024-09-18T02:04:36.364329+0000","last_fullsized":"2024-09-18T02:04:36.364329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:59.657833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339529+0000","last_change":"2024-09-18T02:03:50.282381+0000","last_active":"2024-09-18T02:04:36.339529+0000","last_peered":"2024-09-18T02:04:36.339529+0000","last_clean":"2024-09-18T02:04:36.339529+0000","last_became_active":"2024-09-18T02:03:48.274657+0000","last_became_peered":"2024-09-18T02:03:48.274657+0000","last_unstale":"2024-09-18T02:04:36.339529+0000","last_undegraded":"2024-09-18T02:04:36.339529+0000","last_fullsized":"2024-09-18T02:04:36.339529+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:21.610128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000970169,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.415267+0000","last_change":"2024-09-18T02:04:01.572119+0000","last_active":"2024-09-18T02:07:12.415267+0000","last_peered":"2024-09-18T02:07:12.415267+0000","last_clean":"2024-09-18T02:07:12.415267+0000","last_became_active":"2024-09-18T02:04:01.571443+0000","last_became_peered":"2024-09-18T02:04:01.571443+0000","last_unstale":"2024-09-18T02:07:12.415267+0000","last_undegraded":"2024-09-18T02:07:12.415267+0000","last_fullsized":"2024-09-18T02:07:12.415267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:30:51.643126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'81","reported_seq":160,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.493076+0000","last_change":"2024-09-18T02:04:03.570750+0000","last_active":"2024-09-18T02:07:43.493076+0000","last_peered":"2024-09-18T02:07:43.493076+0000","last_clean":"2024-09-18T02:07:43.493076+0000","last_became_active":"2024-09-18T02:04:03.569938+0000","last_became_peered":"2024-09-18T02:04:03.569938+0000","last_unstale":"2024-09-18T02:07:43.493076+0000","last_undegraded":"2024-09-18T02:07:43.493076+0000","last_fullsized":"2024-09-18T02:07:43.493076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:24:06.892910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341836+0000","last_change":"2024-09-18T02:04:05.600403+0000","last_active":"2024-09-18T02:04:36.341836+0000","last_peered":"2024-09-18T02:04:36.341836+0000","last_clean":"2024-09-18T02:04:36.341836+0000","last_became_active":"2024-09-18T02:04:05.597181+0000","last_became_peered":"2024-09-18T02:04:05.597181+0000","last_unstale":"2024-09-18T02:04:36.341836+0000","last_undegraded":"2024-09-18T02:04:36.341836+0000","last_fullsized":"2024-09-18T02:04:36.341836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:34.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.978758+0000","last_change":"2024-09-18T02:04:07.619359+0000","last_active":"2024-09-18T02:06:10.978758+0000","last_peered":"2024-09-18T02:06:10.978758+0000","last_clean":"2024-09-18T02:06:10.978758+0000","last_became_active":"2024-09-18T02:04:07.618751+0000","last_became_peered":"2024-09-18T02:04:07.618751+0000","last_unstale":"2024-09-18T02:06:10.978758+0000","last_undegraded":"2024-09-18T02:06:10.978758+0000","last_fullsized":"2024-09-18T02:06:10.978758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:46.149767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.133793+0000","last_change":"2024-09-18T02:03:59.554002+0000","last_active":"2024-09-18T02:04:42.133793+0000","last_peered":"2024-09-18T02:04:42.133793+0000","last_clean":"2024-09-18T02:04:42.133793+0000","last_became_active":"2024-09-18T02:03:59.553619+0000","last_became_peered":"2024-09-18T02:03:59.553619+0000","last_unstale":"2024-09-18T02:04:42.133793+0000","last_undegraded":"2024-09-18T02:04:42.133793+0000","last_fullsized":"2024-09-18T02:04:42.133793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:31:07.318399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.915234+0000","last_change":"2024-09-18T02:03:57.519164+0000","last_active":"2024-09-18T02:04:42.915234+0000","last_peered":"2024-09-18T02:04:42.915234+0000","last_clean":"2024-09-18T02:04:42.915234+0000","last_became_active":"2024-09-18T02:03:57.518503+0000","last_became_peered":"2024-09-18T02:03:57.518503+0000","last_unstale":"2024-09-18T02:04:42.915234+0000","last_undegraded":"2024-09-18T02:04:42.915234+0000","last_fullsized":"2024-09-18T02:04:42.915234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:32.979432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353911+0000","last_change":"2024-09-18T02:03:50.288345+0000","last_active":"2024-09-18T02:04:36.353911+0000","last_peered":"2024-09-18T02:04:36.353911+0000","last_clean":"2024-09-18T02:04:36.353911+0000","last_became_active":"2024-09-18T02:03:48.276300+0000","last_became_peered":"2024-09-18T02:03:48.276300+0000","last_unstale":"2024-09-18T02:04:36.353911+0000","last_undegraded":"2024-09-18T02:04:36.353911+0000","last_fullsized":"2024-09-18T02:04:36.353911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:57.432759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002788245,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349422+0000","last_change":"2024-09-18T02:04:01.558361+0000","last_active":"2024-09-18T02:04:36.349422+0000","last_peered":"2024-09-18T02:04:36.349422+0000","last_clean":"2024-09-18T02:04:36.349422+0000","last_became_active":"2024-09-18T02:04:01.557570+0000","last_became_peered":"2024-09-18T02:04:01.557570+0000","last_unstale":"2024-09-18T02:04:36.349422+0000","last_undegraded":"2024-09-18T02:04:36.349422+0000","last_fullsized":"2024-09-18T02:04:36.349422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:35:33.472211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340131+0000","last_change":"2024-09-18T02:04:03.589283+0000","last_active":"2024-09-18T02:04:36.340131+0000","last_peered":"2024-09-18T02:04:36.340131+0000","last_clean":"2024-09-18T02:04:36.340131+0000","last_became_active":"2024-09-18T02:04:03.588539+0000","last_became_peered":"2024-09-18T02:04:03.588539+0000","last_unstale":"2024-09-18T02:04:36.340131+0000","last_undegraded":"2024-09-18T02:04:36.340131+0000","last_fullsized":"2024-09-18T02:04:36.340131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:11.364586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":350,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.207783+0000","last_change":"2024-09-18T02:04:05.583286+0000","last_active":"2024-09-18T02:07:43.207783+0000","last_peered":"2024-09-18T02:07:43.207783+0000","last_clean":"2024-09-18T02:07:43.207783+0000","last_became_active":"2024-09-18T02:04:05.582477+0000","last_became_peered":"2024-09-18T02:04:05.582477+0000","last_unstale":"2024-09-18T02:07:43.207783+0000","last_undegraded":"2024-09-18T02:07:43.207783+0000","last_fullsized":"2024-09-18T02:07:43.207783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:54.620838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.110007+0000","last_change":"2024-09-18T02:04:07.606623+0000","last_active":"2024-09-18T02:06:11.110007+0000","last_peered":"2024-09-18T02:06:11.110007+0000","last_clean":"2024-09-18T02:06:11.110007+0000","last_became_active":"2024-09-18T02:04:07.605591+0000","last_became_peered":"2024-09-18T02:04:07.605591+0000","last_unstale":"2024-09-18T02:06:11.110007+0000","last_undegraded":"2024-09-18T02:06:11.110007+0000","last_fullsized":"2024-09-18T02:06:11.110007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:37.470495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999320+0000","last_change":"2024-09-18T02:03:59.559409+0000","last_active":"2024-09-18T02:05:25.999320+0000","last_peered":"2024-09-18T02:05:25.999320+0000","last_clean":"2024-09-18T02:05:25.999320+0000","last_became_active":"2024-09-18T02:03:59.559044+0000","last_became_peered":"2024-09-18T02:03:59.559044+0000","last_unstale":"2024-09-18T02:05:25.999320+0000","last_undegraded":"2024-09-18T02:05:25.999320+0000","last_fullsized":"2024-09-18T02:05:25.999320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:14.041290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.362611+0000","last_change":"2024-09-18T02:03:57.522060+0000","last_active":"2024-09-18T02:04:36.362611+0000","last_peered":"2024-09-18T02:04:36.362611+0000","last_clean":"2024-09-18T02:04:36.362611+0000","last_became_active":"2024-09-18T02:03:57.521706+0000","last_became_peered":"2024-09-18T02:03:57.521706+0000","last_unstale":"2024-09-18T02:04:36.362611+0000","last_undegraded":"2024-09-18T02:04:36.362611+0000","last_fullsized":"2024-09-18T02:04:36.362611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:43.330210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342536+0000","last_change":"2024-09-18T02:03:50.282549+0000","last_active":"2024-09-18T02:04:36.342536+0000","last_peered":"2024-09-18T02:04:36.342536+0000","last_clean":"2024-09-18T02:04:36.342536+0000","last_became_active":"2024-09-18T02:03:48.274030+0000","last_became_peered":"2024-09-18T02:03:48.274030+0000","last_unstale":"2024-09-18T02:04:36.342536+0000","last_undegraded":"2024-09-18T02:04:36.342536+0000","last_fullsized":"2024-09-18T02:04:36.342536+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:21:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011092910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.349976+0000","last_change":"2024-09-18T02:04:01.559241+0000","last_active":"2024-09-18T02:04:36.349976+0000","last_peered":"2024-09-18T02:04:36.349976+0000","last_clean":"2024-09-18T02:04:36.349976+0000","last_became_active":"2024-09-18T02:04:01.558915+0000","last_became_peered":"2024-09-18T02:04:01.558915+0000","last_unstale":"2024-09-18T02:04:36.349976+0000","last_undegraded":"2024-09-18T02:04:36.349976+0000","last_fullsized":"2024-09-18T02:04:36.349976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:22.220646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350138+0000","last_change":"2024-09-18T02:04:03.595150+0000","last_active":"2024-09-18T02:04:36.350138+0000","last_peered":"2024-09-18T02:04:36.350138+0000","last_clean":"2024-09-18T02:04:36.350138+0000","last_became_active":"2024-09-18T02:04:03.591378+0000","last_became_peered":"2024-09-18T02:04:03.591378+0000","last_unstale":"2024-09-18T02:04:36.350138+0000","last_undegraded":"2024-09-18T02:04:36.350138+0000","last_fullsized":"2024-09-18T02:04:36.350138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:37.068150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.217793+0000","last_change":"2024-09-18T02:04:05.605812+0000","last_active":"2024-09-18T02:07:43.217793+0000","last_peered":"2024-09-18T02:07:43.217793+0000","last_clean":"2024-09-18T02:07:43.217793+0000","last_became_active":"2024-09-18T02:04:05.605265+0000","last_became_peered":"2024-09-18T02:04:05.605265+0000","last_unstale":"2024-09-18T02:07:43.217793+0000","last_undegraded":"2024-09-18T02:07:43.217793+0000","last_fullsized":"2024-09-18T02:07:43.217793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:35:37.505766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.963901+0000","last_change":"2024-09-18T02:04:07.624755+0000","last_active":"2024-09-18T02:06:06.963901+0000","last_peered":"2024-09-18T02:06:06.963901+0000","last_clean":"2024-09-18T02:06:06.963901+0000","last_became_active":"2024-09-18T02:04:07.624085+0000","last_became_peered":"2024-09-18T02:04:07.624085+0000","last_unstale":"2024-09-18T02:06:06.963901+0000","last_undegraded":"2024-09-18T02:06:06.963901+0000","last_fullsized":"2024-09-18T02:06:06.963901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:10:22.537224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340548+0000","last_change":"2024-09-18T02:03:59.535655+0000","last_active":"2024-09-18T02:04:36.340548+0000","last_peered":"2024-09-18T02:04:36.340548+0000","last_clean":"2024-09-18T02:04:36.340548+0000","last_became_active":"2024-09-18T02:03:59.535266+0000","last_became_peered":"2024-09-18T02:03:59.535266+0000","last_unstale":"2024-09-18T02:04:36.340548+0000","last_undegraded":"2024-09-18T02:04:36.340548+0000","last_fullsized":"2024-09-18T02:04:36.340548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.342844+0000","last_change":"2024-09-18T02:03:57.529076+0000","last_active":"2024-09-18T02:04:41.342844+0000","last_peered":"2024-09-18T02:04:41.342844+0000","last_clean":"2024-09-18T02:04:41.342844+0000","last_became_active":"2024-09-18T02:03:57.528676+0000","last_became_peered":"2024-09-18T02:03:57.528676+0000","last_unstale":"2024-09-18T02:04:41.342844+0000","last_undegraded":"2024-09-18T02:04:41.342844+0000","last_fullsized":"2024-09-18T02:04:41.342844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358547+0000","last_change":"2024-09-18T02:03:50.288611+0000","last_active":"2024-09-18T02:04:36.358547+0000","last_peered":"2024-09-18T02:04:36.358547+0000","last_clean":"2024-09-18T02:04:36.358547+0000","last_became_active":"2024-09-18T02:03:48.396609+0000","last_became_peered":"2024-09-18T02:03:48.396609+0000","last_unstale":"2024-09-18T02:04:36.358547+0000","last_undegraded":"2024-09-18T02:04:36.358547+0000","last_fullsized":"2024-09-18T02:04:36.358547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:40:52.248589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025902970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348392+0000","last_change":"2024-09-18T02:04:01.562114+0000","last_active":"2024-09-18T02:04:36.348392+0000","last_peered":"2024-09-18T02:04:36.348392+0000","last_clean":"2024-09-18T02:04:36.348392+0000","last_became_active":"2024-09-18T02:04:01.561488+0000","last_became_peered":"2024-09-18T02:04:01.561488+0000","last_unstale":"2024-09-18T02:04:36.348392+0000","last_undegraded":"2024-09-18T02:04:36.348392+0000","last_fullsized":"2024-09-18T02:04:36.348392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:00.270005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'97","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.540941+0000","last_change":"2024-09-18T02:04:03.586693+0000","last_active":"2024-09-18T02:07:43.540941+0000","last_peered":"2024-09-18T02:07:43.540941+0000","last_clean":"2024-09-18T02:07:43.540941+0000","last_became_active":"2024-09-18T02:04:03.585879+0000","last_became_peered":"2024-09-18T02:04:03.585879+0000","last_unstale":"2024-09-18T02:07:43.540941+0000","last_undegraded":"2024-09-18T02:07:43.540941+0000","last_fullsized":"2024-09-18T02:07:43.540941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:19.044304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342766+0000","last_change":"2024-09-18T02:04:05.589374+0000","last_active":"2024-09-18T02:04:36.342766+0000","last_peered":"2024-09-18T02:04:36.342766+0000","last_clean":"2024-09-18T02:04:36.342766+0000","last_became_active":"2024-09-18T02:04:05.588676+0000","last_became_peered":"2024-09-18T02:04:05.588676+0000","last_unstale":"2024-09-18T02:04:36.342766+0000","last_undegraded":"2024-09-18T02:04:36.342766+0000","last_fullsized":"2024-09-18T02:04:36.342766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:18.118339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.995352+0000","last_change":"2024-09-18T02:04:07.620173+0000","last_active":"2024-09-18T02:05:25.995352+0000","last_peered":"2024-09-18T02:05:25.995352+0000","last_clean":"2024-09-18T02:05:25.995352+0000","last_became_active":"2024-09-18T02:04:07.619587+0000","last_became_peered":"2024-09-18T02:04:07.619587+0000","last_unstale":"2024-09-18T02:05:25.995352+0000","last_undegraded":"2024-09-18T02:05:25.995352+0000","last_fullsized":"2024-09-18T02:05:25.995352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:26:28.267582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.362280+0000","last_change":"2024-09-18T02:04:07.628261+0000","last_active":"2024-09-18T02:04:36.362280+0000","last_peered":"2024-09-18T02:04:36.362280+0000","last_clean":"2024-09-18T02:04:36.362280+0000","last_became_active":"2024-09-18T02:04:07.626396+0000","last_became_peered":"2024-09-18T02:04:07.626396+0000","last_unstale":"2024-09-18T02:04:36.362280+0000","last_undegraded":"2024-09-18T02:04:36.362280+0000","last_fullsized":"2024-09-18T02:04:36.362280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:06.316942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.334934+0000","last_change":"2024-09-18T02:03:59.538659+0000","last_active":"2024-09-18T02:06:21.334934+0000","last_peered":"2024-09-18T02:06:21.334934+0000","last_clean":"2024-09-18T02:06:21.334934+0000","last_became_active":"2024-09-18T02:03:59.538280+0000","last_became_peered":"2024-09-18T02:03:59.538280+0000","last_unstale":"2024-09-18T02:06:21.334934+0000","last_undegraded":"2024-09-18T02:06:21.334934+0000","last_fullsized":"2024-09-18T02:06:21.334934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353217+0000","last_change":"2024-09-18T02:03:57.531366+0000","last_active":"2024-09-18T02:04:36.353217+0000","last_peered":"2024-09-18T02:04:36.353217+0000","last_clean":"2024-09-18T02:04:36.353217+0000","last_became_active":"2024-09-18T02:03:57.530751+0000","last_became_peered":"2024-09-18T02:03:57.530751+0000","last_unstale":"2024-09-18T02:04:36.353217+0000","last_undegraded":"2024-09-18T02:04:36.353217+0000","last_fullsized":"2024-09-18T02:04:36.353217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:13.572982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339720+0000","last_change":"2024-09-18T02:04:01.561923+0000","last_active":"2024-09-18T02:04:36.339720+0000","last_peered":"2024-09-18T02:04:36.339720+0000","last_clean":"2024-09-18T02:04:36.339720+0000","last_became_active":"2024-09-18T02:04:01.561230+0000","last_became_peered":"2024-09-18T02:04:01.561230+0000","last_unstale":"2024-09-18T02:04:36.339720+0000","last_undegraded":"2024-09-18T02:04:36.339720+0000","last_fullsized":"2024-09-18T02:04:36.339720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:33.717350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'42","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.426197+0000","last_change":"2024-09-18T02:04:03.595872+0000","last_active":"2024-09-18T02:07:43.426197+0000","last_peered":"2024-09-18T02:07:43.426197+0000","last_clean":"2024-09-18T02:07:43.426197+0000","last_became_active":"2024-09-18T02:04:03.595284+0000","last_became_peered":"2024-09-18T02:04:03.595284+0000","last_unstale":"2024-09-18T02:07:43.426197+0000","last_undegraded":"2024-09-18T02:07:43.426197+0000","last_fullsized":"2024-09-18T02:07:43.426197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:04.625050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348172+0000","last_change":"2024-09-18T02:04:05.603244+0000","last_active":"2024-09-18T02:04:36.348172+0000","last_peered":"2024-09-18T02:04:36.348172+0000","last_clean":"2024-09-18T02:04:36.348172+0000","last_became_active":"2024-09-18T02:04:05.602528+0000","last_became_peered":"2024-09-18T02:04:05.602528+0000","last_unstale":"2024-09-18T02:04:36.348172+0000","last_undegraded":"2024-09-18T02:04:36.348172+0000","last_fullsized":"2024-09-18T02:04:36.348172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:08:44.924870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:08.724227+0000","last_change":"2024-09-18T02:04:07.623315+0000","last_active":"2024-09-18T02:06:08.724227+0000","last_peered":"2024-09-18T02:06:08.724227+0000","last_clean":"2024-09-18T02:06:08.724227+0000","last_became_active":"2024-09-18T02:04:07.622753+0000","last_became_peered":"2024-09-18T02:04:07.622753+0000","last_unstale":"2024-09-18T02:06:08.724227+0000","last_undegraded":"2024-09-18T02:06:08.724227+0000","last_fullsized":"2024-09-18T02:06:08.724227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:08:47.142951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'9","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.090383+0000","last_change":"2024-09-18T02:03:59.555234+0000","last_active":"2024-09-18T02:07:12.090383+0000","last_peered":"2024-09-18T02:07:12.090383+0000","last_clean":"2024-09-18T02:07:12.090383+0000","last_became_active":"2024-09-18T02:03:59.554803+0000","last_became_peered":"2024-09-18T02:03:59.554803+0000","last_unstale":"2024-09-18T02:07:12.090383+0000","last_undegraded":"2024-09-18T02:07:12.090383+0000","last_fullsized":"2024-09-18T02:07:12.090383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:54.071188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364065+0000","last_change":"2024-09-18T02:03:57.522614+0000","last_active":"2024-09-18T02:04:36.364065+0000","last_peered":"2024-09-18T02:04:36.364065+0000","last_clean":"2024-09-18T02:04:36.364065+0000","last_became_active":"2024-09-18T02:03:57.519403+0000","last_became_peered":"2024-09-18T02:03:57.519403+0000","last_unstale":"2024-09-18T02:04:36.364065+0000","last_undegraded":"2024-09-18T02:04:36.364065+0000","last_fullsized":"2024-09-18T02:04:36.364065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.351923+0000","last_change":"2024-09-18T02:04:01.561432+0000","last_active":"2024-09-18T02:04:36.351923+0000","last_peered":"2024-09-18T02:04:36.351923+0000","last_clean":"2024-09-18T02:04:36.351923+0000","last_became_active":"2024-09-18T02:04:01.558788+0000","last_became_peered":"2024-09-18T02:04:01.558788+0000","last_unstale":"2024-09-18T02:04:36.351923+0000","last_undegraded":"2024-09-18T02:04:36.351923+0000","last_fullsized":"2024-09-18T02:04:36.351923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:11.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.150563+0000","last_change":"2024-09-18T02:04:03.581820+0000","last_active":"2024-09-18T02:07:11.150563+0000","last_peered":"2024-09-18T02:07:11.150563+0000","last_clean":"2024-09-18T02:07:11.150563+0000","last_became_active":"2024-09-18T02:04:03.581045+0000","last_became_peered":"2024-09-18T02:04:03.581045+0000","last_unstale":"2024-09-18T02:07:11.150563+0000","last_undegraded":"2024-09-18T02:07:11.150563+0000","last_fullsized":"2024-09-18T02:07:11.150563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:56:58.075420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341472+0000","last_change":"2024-09-18T02:04:05.600005+0000","last_active":"2024-09-18T02:04:36.341472+0000","last_peered":"2024-09-18T02:04:36.341472+0000","last_clean":"2024-09-18T02:04:36.341472+0000","last_became_active":"2024-09-18T02:04:05.599064+0000","last_became_peered":"2024-09-18T02:04:05.599064+0000","last_unstale":"2024-09-18T02:04:36.341472+0000","last_undegraded":"2024-09-18T02:04:36.341472+0000","last_fullsized":"2024-09-18T02:04:36.341472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:24:08.906433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339501+0000","last_change":"2024-09-18T02:04:07.610644+0000","last_active":"2024-09-18T02:04:36.339501+0000","last_peered":"2024-09-18T02:04:36.339501+0000","last_clean":"2024-09-18T02:04:36.339501+0000","last_became_active":"2024-09-18T02:04:07.609954+0000","last_became_peered":"2024-09-18T02:04:07.609954+0000","last_unstale":"2024-09-18T02:04:36.339501+0000","last_undegraded":"2024-09-18T02:04:36.339501+0000","last_fullsized":"2024-09-18T02:04:36.339501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:07:58.304562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089718+0000","last_change":"2024-09-18T02:03:59.550899+0000","last_active":"2024-09-18T02:07:12.089718+0000","last_peered":"2024-09-18T02:07:12.089718+0000","last_clean":"2024-09-18T02:07:12.089718+0000","last_became_active":"2024-09-18T02:03:59.549791+0000","last_became_peered":"2024-09-18T02:03:59.549791+0000","last_unstale":"2024-09-18T02:07:12.089718+0000","last_undegraded":"2024-09-18T02:07:12.089718+0000","last_fullsized":"2024-09-18T02:07:12.089718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.372750+0000","last_change":"2024-09-18T02:04:36.371010+0000","last_active":"2024-09-18T02:04:36.372750+0000","last_peered":"2024-09-18T02:04:36.372750+0000","last_clean":"2024-09-18T02:04:36.372750+0000","last_became_active":"2024-09-18T02:04:36.370188+0000","last_became_peered":"2024-09-18T02:04:36.370188+0000","last_unstale":"2024-09-18T02:04:36.372750+0000","last_undegraded":"2024-09-18T02:04:36.372750+0000","last_fullsized":"2024-09-18T02:04:36.372750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:09.187217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339915+0000","last_change":"2024-09-18T02:04:01.563073+0000","last_active":"2024-09-18T02:04:36.339915+0000","last_peered":"2024-09-18T02:04:36.339915+0000","last_clean":"2024-09-18T02:04:36.339915+0000","last_became_active":"2024-09-18T02:04:01.562586+0000","last_became_peered":"2024-09-18T02:04:01.562586+0000","last_unstale":"2024-09-18T02:04:36.339915+0000","last_undegraded":"2024-09-18T02:04:36.339915+0000","last_fullsized":"2024-09-18T02:04:36.339915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:14.943821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'45","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.334988+0000","last_change":"2024-09-18T02:04:03.579212+0000","last_active":"2024-09-18T02:07:43.334988+0000","last_peered":"2024-09-18T02:07:43.334988+0000","last_clean":"2024-09-18T02:07:43.334988+0000","last_became_active":"2024-09-18T02:04:03.578581+0000","last_became_peered":"2024-09-18T02:04:03.578581+0000","last_unstale":"2024-09-18T02:07:43.334988+0000","last_undegraded":"2024-09-18T02:07:43.334988+0000","last_fullsized":"2024-09-18T02:07:43.334988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:17.779908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338314+0000","last_change":"2024-09-18T02:04:05.587685+0000","last_active":"2024-09-18T02:04:36.338314+0000","last_peered":"2024-09-18T02:04:36.338314+0000","last_clean":"2024-09-18T02:04:36.338314+0000","last_became_active":"2024-09-18T02:04:05.586978+0000","last_became_peered":"2024-09-18T02:04:05.586978+0000","last_unstale":"2024-09-18T02:04:36.338314+0000","last_undegraded":"2024-09-18T02:04:36.338314+0000","last_fullsized":"2024-09-18T02:04:36.338314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:36.991801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.935106+0000","last_change":"2024-09-18T02:04:07.611859+0000","last_active":"2024-09-18T02:04:42.935106+0000","last_peered":"2024-09-18T02:04:42.935106+0000","last_clean":"2024-09-18T02:04:42.935106+0000","last_became_active":"2024-09-18T02:04:07.607227+0000","last_became_peered":"2024-09-18T02:04:07.607227+0000","last_unstale":"2024-09-18T02:04:42.935106+0000","last_undegraded":"2024-09-18T02:04:42.935106+0000","last_fullsized":"2024-09-18T02:04:42.935106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:09:15.944064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.303117+0000","last_change":"2024-09-18T02:03:59.550610+0000","last_active":"2024-09-18T02:05:26.303117+0000","last_peered":"2024-09-18T02:05:26.303117+0000","last_clean":"2024-09-18T02:05:26.303117+0000","last_became_active":"2024-09-18T02:03:59.550221+0000","last_became_peered":"2024-09-18T02:03:59.550221+0000","last_unstale":"2024-09-18T02:05:26.303117+0000","last_undegraded":"2024-09-18T02:05:26.303117+0000","last_fullsized":"2024-09-18T02:05:26.303117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:20.801441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342516+0000","last_change":"2024-09-18T02:03:57.523727+0000","last_active":"2024-09-18T02:04:36.342516+0000","last_peered":"2024-09-18T02:04:36.342516+0000","last_clean":"2024-09-18T02:04:36.342516+0000","last_became_active":"2024-09-18T02:03:57.522590+0000","last_became_peered":"2024-09-18T02:03:57.522590+0000","last_unstale":"2024-09-18T02:04:36.342516+0000","last_undegraded":"2024-09-18T02:04:36.342516+0000","last_fullsized":"2024-09-18T02:04:36.342516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:53:54.541547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.350028+0000","last_change":"2024-09-18T02:04:01.566731+0000","last_active":"2024-09-18T02:04:36.350028+0000","last_peered":"2024-09-18T02:04:36.350028+0000","last_clean":"2024-09-18T02:04:36.350028+0000","last_became_active":"2024-09-18T02:04:01.566205+0000","last_became_peered":"2024-09-18T02:04:01.566205+0000","last_unstale":"2024-09-18T02:04:36.350028+0000","last_undegraded":"2024-09-18T02:04:36.350028+0000","last_fullsized":"2024-09-18T02:04:36.350028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:46:56.533384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.315937+0000","last_change":"2024-09-18T02:04:03.581994+0000","last_active":"2024-09-18T02:07:43.315937+0000","last_peered":"2024-09-18T02:07:43.315937+0000","last_clean":"2024-09-18T02:07:43.315937+0000","last_became_active":"2024-09-18T02:04:03.580770+0000","last_became_peered":"2024-09-18T02:04:03.580770+0000","last_unstale":"2024-09-18T02:07:43.315937+0000","last_undegraded":"2024-09-18T02:07:43.315937+0000","last_fullsized":"2024-09-18T02:07:43.315937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:03.809763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354157+0000","last_change":"2024-09-18T02:04:05.597119+0000","last_active":"2024-09-18T02:04:36.354157+0000","last_peered":"2024-09-18T02:04:36.354157+0000","last_clean":"2024-09-18T02:04:36.354157+0000","last_became_active":"2024-09-18T02:04:05.591514+0000","last_became_peered":"2024-09-18T02:04:05.591514+0000","last_unstale":"2024-09-18T02:04:36.354157+0000","last_undegraded":"2024-09-18T02:04:36.354157+0000","last_fullsized":"2024-09-18T02:04:36.354157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:35.071524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217553+0000","last_change":"2024-09-18T02:03:59.554054+0000","last_active":"2024-09-18T02:07:12.217553+0000","last_peered":"2024-09-18T02:07:12.217553+0000","last_clean":"2024-09-18T02:07:12.217553+0000","last_became_active":"2024-09-18T02:03:59.553660+0000","last_became_peered":"2024-09-18T02:03:59.553660+0000","last_unstale":"2024-09-18T02:07:12.217553+0000","last_undegraded":"2024-09-18T02:07:12.217553+0000","last_fullsized":"2024-09-18T02:07:12.217553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:20.271703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.205809+0000","last_change":"2024-09-18T02:03:57.528505+0000","last_active":"2024-09-18T02:07:12.205809+0000","last_peered":"2024-09-18T02:07:12.205809+0000","last_clean":"2024-09-18T02:07:12.205809+0000","last_became_active":"2024-09-18T02:03:57.526941+0000","last_became_peered":"2024-09-18T02:03:57.526941+0000","last_unstale":"2024-09-18T02:07:12.205809+0000","last_undegraded":"2024-09-18T02:07:12.205809+0000","last_fullsized":"2024-09-18T02:07:12.205809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:49.524693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.345450+0000","last_change":"2024-09-18T02:04:01.561664+0000","last_active":"2024-09-18T02:04:36.345450+0000","last_peered":"2024-09-18T02:04:36.345450+0000","last_clean":"2024-09-18T02:04:36.345450+0000","last_became_active":"2024-09-18T02:04:01.559839+0000","last_became_peered":"2024-09-18T02:04:01.559839+0000","last_unstale":"2024-09-18T02:04:36.345450+0000","last_undegraded":"2024-09-18T02:04:36.345450+0000","last_fullsized":"2024-09-18T02:04:36.345450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:20.919571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'67","reported_seq":137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.471141+0000","last_change":"2024-09-18T02:04:03.582199+0000","last_active":"2024-09-18T02:07:43.471141+0000","last_peered":"2024-09-18T02:07:43.471141+0000","last_clean":"2024-09-18T02:07:43.471141+0000","last_became_active":"2024-09-18T02:04:03.581518+0000","last_became_peered":"2024-09-18T02:04:03.581518+0000","last_unstale":"2024-09-18T02:07:43.471141+0000","last_undegraded":"2024-09-18T02:07:43.471141+0000","last_fullsized":"2024-09-18T02:07:43.471141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:42:11.364586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.356105+0000","last_change":"2024-09-18T02:04:05.610785+0000","last_active":"2024-09-18T02:04:36.356105+0000","last_peered":"2024-09-18T02:04:36.356105+0000","last_clean":"2024-09-18T02:04:36.356105+0000","last_became_active":"2024-09-18T02:04:05.610007+0000","last_became_peered":"2024-09-18T02:04:05.610007+0000","last_unstale":"2024-09-18T02:04:36.356105+0000","last_undegraded":"2024-09-18T02:04:36.356105+0000","last_fullsized":"2024-09-18T02:04:36.356105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:20.894379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'20","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.266684+0000","last_change":"2024-09-18T02:04:07.610032+0000","last_active":"2024-09-18T02:07:11.266684+0000","last_peered":"2024-09-18T02:07:11.266684+0000","last_clean":"2024-09-18T02:07:11.266684+0000","last_became_active":"2024-09-18T02:04:07.609058+0000","last_became_peered":"2024-09-18T02:04:07.609058+0000","last_unstale":"2024-09-18T02:07:11.266684+0000","last_undegraded":"2024-09-18T02:07:11.266684+0000","last_fullsized":"2024-09-18T02:07:11.266684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:01:06.704072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069945+0000","last_change":"2024-09-18T02:03:59.541759+0000","last_active":"2024-09-18T02:07:12.069945+0000","last_peered":"2024-09-18T02:07:12.069945+0000","last_clean":"2024-09-18T02:07:12.069945+0000","last_became_active":"2024-09-18T02:03:59.540971+0000","last_became_peered":"2024-09-18T02:03:59.540971+0000","last_unstale":"2024-09-18T02:07:12.069945+0000","last_undegraded":"2024-09-18T02:07:12.069945+0000","last_fullsized":"2024-09-18T02:07:12.069945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:40.446559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:41.343543+0000","last_change":"2024-09-18T02:03:57.519487+0000","last_active":"2024-09-18T02:04:41.343543+0000","last_peered":"2024-09-18T02:04:41.343543+0000","last_clean":"2024-09-18T02:04:41.343543+0000","last_became_active":"2024-09-18T02:03:57.518311+0000","last_became_peered":"2024-09-18T02:03:57.518311+0000","last_unstale":"2024-09-18T02:04:41.343543+0000","last_undegraded":"2024-09-18T02:04:41.343543+0000","last_fullsized":"2024-09-18T02:04:41.343543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:39:32.993234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.364616+0000","last_change":"2024-09-18T02:04:01.564100+0000","last_active":"2024-09-18T02:04:36.364616+0000","last_peered":"2024-09-18T02:04:36.364616+0000","last_clean":"2024-09-18T02:04:36.364616+0000","last_became_active":"2024-09-18T02:04:01.563285+0000","last_became_peered":"2024-09-18T02:04:01.563285+0000","last_unstale":"2024-09-18T02:04:36.364616+0000","last_undegraded":"2024-09-18T02:04:36.364616+0000","last_fullsized":"2024-09-18T02:04:36.364616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:21:50.083821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'40","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.321671+0000","last_change":"2024-09-18T02:04:03.600506+0000","last_active":"2024-09-18T02:07:43.321671+0000","last_peered":"2024-09-18T02:07:43.321671+0000","last_clean":"2024-09-18T02:07:43.321671+0000","last_became_active":"2024-09-18T02:04:03.596605+0000","last_became_peered":"2024-09-18T02:04:03.596605+0000","last_unstale":"2024-09-18T02:07:43.321671+0000","last_undegraded":"2024-09-18T02:07:43.321671+0000","last_fullsized":"2024-09-18T02:07:43.321671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:42.407656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346876+0000","last_change":"2024-09-18T02:04:05.589795+0000","last_active":"2024-09-18T02:04:36.346876+0000","last_peered":"2024-09-18T02:04:36.346876+0000","last_clean":"2024-09-18T02:04:36.346876+0000","last_became_active":"2024-09-18T02:04:05.589023+0000","last_became_peered":"2024-09-18T02:04:05.589023+0000","last_unstale":"2024-09-18T02:04:36.346876+0000","last_undegraded":"2024-09-18T02:04:36.346876+0000","last_fullsized":"2024-09-18T02:04:36.346876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:37:38.266386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348720+0000","last_change":"2024-09-18T02:04:07.625988+0000","last_active":"2024-09-18T02:04:36.348720+0000","last_peered":"2024-09-18T02:04:36.348720+0000","last_clean":"2024-09-18T02:04:36.348720+0000","last_became_active":"2024-09-18T02:04:07.625440+0000","last_became_peered":"2024-09-18T02:04:07.625440+0000","last_unstale":"2024-09-18T02:04:36.348720+0000","last_undegraded":"2024-09-18T02:04:36.348720+0000","last_fullsized":"2024-09-18T02:04:36.348720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:01.797534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.117682+0000","last_change":"2024-09-18T02:03:59.561521+0000","last_active":"2024-09-18T02:06:11.117682+0000","last_peered":"2024-09-18T02:06:11.117682+0000","last_clean":"2024-09-18T02:06:11.117682+0000","last_became_active":"2024-09-18T02:03:59.561208+0000","last_became_peered":"2024-09-18T02:03:59.561208+0000","last_unstale":"2024-09-18T02:06:11.117682+0000","last_undegraded":"2024-09-18T02:06:11.117682+0000","last_fullsized":"2024-09-18T02:06:11.117682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:29.023712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339261+0000","last_change":"2024-09-18T02:03:57.521151+0000","last_active":"2024-09-18T02:04:36.339261+0000","last_peered":"2024-09-18T02:04:36.339261+0000","last_clean":"2024-09-18T02:04:36.339261+0000","last_became_active":"2024-09-18T02:03:57.520569+0000","last_became_peered":"2024-09-18T02:03:57.520569+0000","last_unstale":"2024-09-18T02:04:36.339261+0000","last_undegraded":"2024-09-18T02:04:36.339261+0000","last_fullsized":"2024-09-18T02:04:36.339261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:59:24.420659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.358467+0000","last_change":"2024-09-18T02:04:01.566225+0000","last_active":"2024-09-18T02:04:36.358467+0000","last_peered":"2024-09-18T02:04:36.358467+0000","last_clean":"2024-09-18T02:04:36.358467+0000","last_became_active":"2024-09-18T02:04:01.565499+0000","last_became_peered":"2024-09-18T02:04:01.565499+0000","last_unstale":"2024-09-18T02:04:36.358467+0000","last_undegraded":"2024-09-18T02:04:36.358467+0000","last_fullsized":"2024-09-18T02:04:36.358467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:55:01.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'41","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.453180+0000","last_change":"2024-09-18T02:04:03.578501+0000","last_active":"2024-09-18T02:07:43.453180+0000","last_peered":"2024-09-18T02:07:43.453180+0000","last_clean":"2024-09-18T02:07:43.453180+0000","last_became_active":"2024-09-18T02:04:03.577841+0000","last_became_peered":"2024-09-18T02:04:03.577841+0000","last_unstale":"2024-09-18T02:07:43.453180+0000","last_undegraded":"2024-09-18T02:07:43.453180+0000","last_fullsized":"2024-09-18T02:07:43.453180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:58:32.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342393+0000","last_change":"2024-09-18T02:04:05.606498+0000","last_active":"2024-09-18T02:04:36.342393+0000","last_peered":"2024-09-18T02:04:36.342393+0000","last_clean":"2024-09-18T02:04:36.342393+0000","last_became_active":"2024-09-18T02:04:05.605718+0000","last_became_peered":"2024-09-18T02:04:05.605718+0000","last_unstale":"2024-09-18T02:04:36.342393+0000","last_undegraded":"2024-09-18T02:04:36.342393+0000","last_fullsized":"2024-09-18T02:04:36.342393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:15.389313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.105367+0000","last_change":"2024-09-18T02:04:07.621810+0000","last_active":"2024-09-18T02:06:11.105367+0000","last_peered":"2024-09-18T02:06:11.105367+0000","last_clean":"2024-09-18T02:06:11.105367+0000","last_became_active":"2024-09-18T02:04:07.621224+0000","last_became_peered":"2024-09-18T02:04:07.621224+0000","last_unstale":"2024-09-18T02:06:11.105367+0000","last_undegraded":"2024-09-18T02:06:11.105367+0000","last_fullsized":"2024-09-18T02:06:11.105367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:29:24.351329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.154739+0000","last_change":"2024-09-18T02:03:59.538977+0000","last_active":"2024-09-18T02:07:12.154739+0000","last_peered":"2024-09-18T02:07:12.154739+0000","last_clean":"2024-09-18T02:07:12.154739+0000","last_became_active":"2024-09-18T02:03:59.536701+0000","last_became_peered":"2024-09-18T02:03:59.536701+0000","last_unstale":"2024-09-18T02:07:12.154739+0000","last_undegraded":"2024-09-18T02:07:12.154739+0000","last_fullsized":"2024-09-18T02:07:12.154739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:40:31.387691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.950020+0000","last_change":"2024-09-18T02:03:57.528489+0000","last_active":"2024-09-18T02:06:06.950020+0000","last_peered":"2024-09-18T02:06:06.950020+0000","last_clean":"2024-09-18T02:06:06.950020+0000","last_became_active":"2024-09-18T02:03:57.527891+0000","last_became_peered":"2024-09-18T02:03:57.527891+0000","last_unstale":"2024-09-18T02:06:06.950020+0000","last_undegraded":"2024-09-18T02:06:06.950020+0000","last_fullsized":"2024-09-18T02:06:06.950020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:46.827846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346510+0000","last_change":"2024-09-18T02:04:01.565064+0000","last_active":"2024-09-18T02:04:36.346510+0000","last_peered":"2024-09-18T02:04:36.346510+0000","last_clean":"2024-09-18T02:04:36.346510+0000","last_became_active":"2024-09-18T02:04:01.564187+0000","last_became_peered":"2024-09-18T02:04:01.564187+0000","last_unstale":"2024-09-18T02:04:36.346510+0000","last_undegraded":"2024-09-18T02:04:36.346510+0000","last_fullsized":"2024-09-18T02:04:36.346510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:34.109876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.359007+0000","last_change":"2024-09-18T02:04:03.600377+0000","last_active":"2024-09-18T02:04:36.359007+0000","last_peered":"2024-09-18T02:04:36.359007+0000","last_clean":"2024-09-18T02:04:36.359007+0000","last_became_active":"2024-09-18T02:04:03.596273+0000","last_became_peered":"2024-09-18T02:04:03.596273+0000","last_unstale":"2024-09-18T02:04:36.359007+0000","last_undegraded":"2024-09-18T02:04:36.359007+0000","last_fullsized":"2024-09-18T02:04:36.359007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:10.785836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":374,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.204508+0000","last_change":"2024-09-18T02:04:05.604228+0000","last_active":"2024-09-18T02:07:43.204508+0000","last_peered":"2024-09-18T02:07:43.204508+0000","last_clean":"2024-09-18T02:07:43.204508+0000","last_became_active":"2024-09-18T02:04:05.601182+0000","last_became_peered":"2024-09-18T02:04:05.601182+0000","last_unstale":"2024-09-18T02:07:43.204508+0000","last_undegraded":"2024-09-18T02:07:43.204508+0000","last_fullsized":"2024-09-18T02:07:43.204508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:26.319515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'8","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.127197+0000","last_change":"2024-09-18T02:04:07.622167+0000","last_active":"2024-09-18T02:04:42.127197+0000","last_peered":"2024-09-18T02:04:42.127197+0000","last_clean":"2024-09-18T02:04:42.127197+0000","last_became_active":"2024-09-18T02:04:07.621240+0000","last_became_peered":"2024-09-18T02:04:07.621240+0000","last_unstale":"2024-09-18T02:04:42.127197+0000","last_undegraded":"2024-09-18T02:04:42.127197+0000","last_fullsized":"2024-09-18T02:04:42.127197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:44.681571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.866922+0000","last_change":"2024-09-18T02:03:59.536823+0000","last_active":"2024-09-18T02:07:11.866922+0000","last_peered":"2024-09-18T02:07:11.866922+0000","last_clean":"2024-09-18T02:07:11.866922+0000","last_became_active":"2024-09-18T02:03:59.536486+0000","last_became_peered":"2024-09-18T02:03:59.536486+0000","last_unstale":"2024-09-18T02:07:11.866922+0000","last_undegraded":"2024-09-18T02:07:11.866922+0000","last_fullsized":"2024-09-18T02:07:11.866922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:27.777353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348480+0000","last_change":"2024-09-18T02:03:57.520866+0000","last_active":"2024-09-18T02:04:36.348480+0000","last_peered":"2024-09-18T02:04:36.348480+0000","last_clean":"2024-09-18T02:04:36.348480+0000","last_became_active":"2024-09-18T02:03:57.520452+0000","last_became_peered":"2024-09-18T02:03:57.520452+0000","last_unstale":"2024-09-18T02:04:36.348480+0000","last_undegraded":"2024-09-18T02:04:36.348480+0000","last_fullsized":"2024-09-18T02:04:36.348480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:24:56.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341004+0000","last_change":"2024-09-18T02:04:01.564822+0000","last_active":"2024-09-18T02:04:36.341004+0000","last_peered":"2024-09-18T02:04:36.341004+0000","last_clean":"2024-09-18T02:04:36.341004+0000","last_became_active":"2024-09-18T02:04:01.564165+0000","last_became_peered":"2024-09-18T02:04:01.564165+0000","last_unstale":"2024-09-18T02:04:36.341004+0000","last_undegraded":"2024-09-18T02:04:36.341004+0000","last_fullsized":"2024-09-18T02:04:36.341004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:22.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.509574+0000","last_change":"2024-09-18T02:04:03.567444+0000","last_active":"2024-09-18T02:07:43.509574+0000","last_peered":"2024-09-18T02:07:43.509574+0000","last_clean":"2024-09-18T02:07:43.509574+0000","last_became_active":"2024-09-18T02:04:03.566714+0000","last_became_peered":"2024-09-18T02:04:03.566714+0000","last_unstale":"2024-09-18T02:07:43.509574+0000","last_undegraded":"2024-09-18T02:07:43.509574+0000","last_fullsized":"2024-09-18T02:07:43.509574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:18.880856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.337525+0000","last_change":"2024-09-18T02:04:05.579190+0000","last_active":"2024-09-18T02:04:36.337525+0000","last_peered":"2024-09-18T02:04:36.337525+0000","last_clean":"2024-09-18T02:04:36.337525+0000","last_became_active":"2024-09-18T02:04:05.578635+0000","last_became_peered":"2024-09-18T02:04:05.578635+0000","last_unstale":"2024-09-18T02:04:36.337525+0000","last_undegraded":"2024-09-18T02:04:36.337525+0000","last_fullsized":"2024-09-18T02:04:36.337525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:43.899135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341545+0000","last_change":"2024-09-18T02:04:07.620173+0000","last_active":"2024-09-18T02:04:36.341545+0000","last_peered":"2024-09-18T02:04:36.341545+0000","last_clean":"2024-09-18T02:04:36.341545+0000","last_became_active":"2024-09-18T02:04:07.618696+0000","last_became_peered":"2024-09-18T02:04:07.618696+0000","last_unstale":"2024-09-18T02:04:36.341545+0000","last_undegraded":"2024-09-18T02:04:36.341545+0000","last_fullsized":"2024-09-18T02:04:36.341545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:33.646308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217552+0000","last_change":"2024-09-18T02:03:59.537068+0000","last_active":"2024-09-18T02:07:12.217552+0000","last_peered":"2024-09-18T02:07:12.217552+0000","last_clean":"2024-09-18T02:07:12.217552+0000","last_became_active":"2024-09-18T02:03:59.536693+0000","last_became_peered":"2024-09-18T02:03:59.536693+0000","last_unstale":"2024-09-18T02:07:12.217552+0000","last_undegraded":"2024-09-18T02:07:12.217552+0000","last_fullsized":"2024-09-18T02:07:12.217552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354641+0000","last_change":"2024-09-18T02:03:57.533853+0000","last_active":"2024-09-18T02:04:36.354641+0000","last_peered":"2024-09-18T02:04:36.354641+0000","last_clean":"2024-09-18T02:04:36.354641+0000","last_became_active":"2024-09-18T02:03:57.532963+0000","last_became_peered":"2024-09-18T02:03:57.532963+0000","last_unstale":"2024-09-18T02:04:36.354641+0000","last_undegraded":"2024-09-18T02:04:36.354641+0000","last_fullsized":"2024-09-18T02:04:36.354641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:13.750469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.353918+0000","last_change":"2024-09-18T02:04:01.572718+0000","last_active":"2024-09-18T02:04:36.353918+0000","last_peered":"2024-09-18T02:04:36.353918+0000","last_clean":"2024-09-18T02:04:36.353918+0000","last_became_active":"2024-09-18T02:04:01.572089+0000","last_became_peered":"2024-09-18T02:04:01.572089+0000","last_unstale":"2024-09-18T02:04:36.353918+0000","last_undegraded":"2024-09-18T02:04:36.353918+0000","last_fullsized":"2024-09-18T02:04:36.353918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:12.503091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'39","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.520043+0000","last_change":"2024-09-18T02:04:03.570795+0000","last_active":"2024-09-18T02:07:43.520043+0000","last_peered":"2024-09-18T02:07:43.520043+0000","last_clean":"2024-09-18T02:07:43.520043+0000","last_became_active":"2024-09-18T02:04:03.569962+0000","last_became_peered":"2024-09-18T02:04:03.569962+0000","last_unstale":"2024-09-18T02:07:43.520043+0000","last_undegraded":"2024-09-18T02:07:43.520043+0000","last_fullsized":"2024-09-18T02:07:43.520043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:48.543679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348236+0000","last_change":"2024-09-18T02:04:05.607210+0000","last_active":"2024-09-18T02:04:36.348236+0000","last_peered":"2024-09-18T02:04:36.348236+0000","last_clean":"2024-09-18T02:04:36.348236+0000","last_became_active":"2024-09-18T02:04:05.606608+0000","last_became_peered":"2024-09-18T02:04:05.606608+0000","last_unstale":"2024-09-18T02:04:36.348236+0000","last_undegraded":"2024-09-18T02:04:36.348236+0000","last_fullsized":"2024-09-18T02:04:36.348236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:24.549074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.355923+0000","last_change":"2024-09-18T02:04:07.609072+0000","last_active":"2024-09-18T02:04:36.355923+0000","last_peered":"2024-09-18T02:04:36.355923+0000","last_clean":"2024-09-18T02:04:36.355923+0000","last_became_active":"2024-09-18T02:04:07.607839+0000","last_became_peered":"2024-09-18T02:04:07.607839+0000","last_unstale":"2024-09-18T02:04:36.355923+0000","last_undegraded":"2024-09-18T02:04:36.355923+0000","last_fullsized":"2024-09-18T02:04:36.355923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:46:07.518628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.969905+0000","last_change":"2024-09-18T02:03:59.550978+0000","last_active":"2024-09-18T02:06:06.969905+0000","last_peered":"2024-09-18T02:06:06.969905+0000","last_clean":"2024-09-18T02:06:06.969905+0000","last_became_active":"2024-09-18T02:03:59.547123+0000","last_became_peered":"2024-09-18T02:03:59.547123+0000","last_unstale":"2024-09-18T02:06:06.969905+0000","last_undegraded":"2024-09-18T02:06:06.969905+0000","last_fullsized":"2024-09-18T02:06:06.969905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:41:32.095619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.343090+0000","last_change":"2024-09-18T02:03:57.530635+0000","last_active":"2024-09-18T02:04:36.343090+0000","last_peered":"2024-09-18T02:04:36.343090+0000","last_clean":"2024-09-18T02:04:36.343090+0000","last_became_active":"2024-09-18T02:03:57.530001+0000","last_became_peered":"2024-09-18T02:03:57.530001+0000","last_unstale":"2024-09-18T02:04:36.343090+0000","last_undegraded":"2024-09-18T02:04:36.343090+0000","last_fullsized":"2024-09-18T02:04:36.343090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:59.657833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.339227+0000","last_change":"2024-09-18T02:04:01.571519+0000","last_active":"2024-09-18T02:04:36.339227+0000","last_peered":"2024-09-18T02:04:36.339227+0000","last_clean":"2024-09-18T02:04:36.339227+0000","last_became_active":"2024-09-18T02:04:01.571263+0000","last_became_peered":"2024-09-18T02:04:01.571263+0000","last_unstale":"2024-09-18T02:04:36.339227+0000","last_undegraded":"2024-09-18T02:04:36.339227+0000","last_fullsized":"2024-09-18T02:04:36.339227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:01.789731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'37","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.437389+0000","last_change":"2024-09-18T02:04:03.604212+0000","last_active":"2024-09-18T02:07:43.437389+0000","last_peered":"2024-09-18T02:07:43.437389+0000","last_clean":"2024-09-18T02:07:43.437389+0000","last_became_active":"2024-09-18T02:04:03.601392+0000","last_became_peered":"2024-09-18T02:04:03.601392+0000","last_unstale":"2024-09-18T02:07:43.437389+0000","last_undegraded":"2024-09-18T02:07:43.437389+0000","last_fullsized":"2024-09-18T02:07:43.437389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:42.122863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.348925+0000","last_change":"2024-09-18T02:04:05.600682+0000","last_active":"2024-09-18T02:04:36.348925+0000","last_peered":"2024-09-18T02:04:36.348925+0000","last_clean":"2024-09-18T02:04:36.348925+0000","last_became_active":"2024-09-18T02:04:05.599964+0000","last_became_peered":"2024-09-18T02:04:05.599964+0000","last_unstale":"2024-09-18T02:04:36.348925+0000","last_undegraded":"2024-09-18T02:04:36.348925+0000","last_fullsized":"2024-09-18T02:04:36.348925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:23.307583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.323902+0000","last_change":"2024-09-18T02:04:07.615961+0000","last_active":"2024-09-18T02:07:12.323902+0000","last_peered":"2024-09-18T02:07:12.323902+0000","last_clean":"2024-09-18T02:07:12.323902+0000","last_became_active":"2024-09-18T02:04:07.615007+0000","last_became_peered":"2024-09-18T02:04:07.615007+0000","last_unstale":"2024-09-18T02:07:12.323902+0000","last_undegraded":"2024-09-18T02:07:12.323902+0000","last_fullsized":"2024-09-18T02:07:12.323902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:14.213728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999722+0000","last_change":"2024-09-18T02:03:59.536538+0000","last_active":"2024-09-18T02:05:25.999722+0000","last_peered":"2024-09-18T02:05:25.999722+0000","last_clean":"2024-09-18T02:05:25.999722+0000","last_became_active":"2024-09-18T02:03:59.536120+0000","last_became_peered":"2024-09-18T02:03:59.536120+0000","last_unstale":"2024-09-18T02:05:25.999722+0000","last_undegraded":"2024-09-18T02:05:25.999722+0000","last_fullsized":"2024-09-18T02:05:25.999722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:24:31.952497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:26.286510+0000","last_change":"2024-09-18T02:03:57.525661+0000","last_active":"2024-09-18T02:05:26.286510+0000","last_peered":"2024-09-18T02:05:26.286510+0000","last_clean":"2024-09-18T02:05:26.286510+0000","last_became_active":"2024-09-18T02:03:57.522831+0000","last_became_peered":"2024-09-18T02:03:57.522831+0000","last_unstale":"2024-09-18T02:05:26.286510+0000","last_undegraded":"2024-09-18T02:05:26.286510+0000","last_fullsized":"2024-09-18T02:05:26.286510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:07.491696+0000","last_change":"2024-09-18T02:04:01.570141+0000","last_active":"2024-09-18T02:06:07.491696+0000","last_peered":"2024-09-18T02:06:07.491696+0000","last_clean":"2024-09-18T02:06:07.491696+0000","last_became_active":"2024-09-18T02:04:01.569649+0000","last_became_peered":"2024-09-18T02:04:01.569649+0000","last_unstale":"2024-09-18T02:06:07.491696+0000","last_undegraded":"2024-09-18T02:06:07.491696+0000","last_fullsized":"2024-09-18T02:06:07.491696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:38:20.919571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.460802+0000","last_change":"2024-09-18T02:04:03.591716+0000","last_active":"2024-09-18T02:07:43.460802+0000","last_peered":"2024-09-18T02:07:43.460802+0000","last_clean":"2024-09-18T02:07:43.460802+0000","last_became_active":"2024-09-18T02:04:03.591018+0000","last_became_peered":"2024-09-18T02:04:03.591018+0000","last_unstale":"2024-09-18T02:07:43.460802+0000","last_undegraded":"2024-09-18T02:07:43.460802+0000","last_fullsized":"2024-09-18T02:07:43.460802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:01:02.677167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338959+0000","last_change":"2024-09-18T02:04:05.596524+0000","last_active":"2024-09-18T02:04:36.338959+0000","last_peered":"2024-09-18T02:04:36.338959+0000","last_clean":"2024-09-18T02:04:36.338959+0000","last_became_active":"2024-09-18T02:04:05.595772+0000","last_became_peered":"2024-09-18T02:04:05.595772+0000","last_unstale":"2024-09-18T02:04:36.338959+0000","last_undegraded":"2024-09-18T02:04:36.338959+0000","last_fullsized":"2024-09-18T02:04:36.338959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:43:04.303561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:09.151093+0000","last_change":"2024-09-18T02:04:07.613362+0000","last_active":"2024-09-18T02:06:09.151093+0000","last_peered":"2024-09-18T02:06:09.151093+0000","last_clean":"2024-09-18T02:06:09.151093+0000","last_became_active":"2024-09-18T02:04:07.612610+0000","last_became_peered":"2024-09-18T02:04:07.612610+0000","last_unstale":"2024-09-18T02:06:09.151093+0000","last_undegraded":"2024-09-18T02:06:09.151093+0000","last_fullsized":"2024-09-18T02:06:09.151093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:48:04.223807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346323+0000","last_change":"2024-09-18T02:03:59.554230+0000","last_active":"2024-09-18T02:04:36.346323+0000","last_peered":"2024-09-18T02:04:36.346323+0000","last_clean":"2024-09-18T02:04:36.346323+0000","last_became_active":"2024-09-18T02:03:59.553864+0000","last_became_peered":"2024-09-18T02:03:59.553864+0000","last_unstale":"2024-09-18T02:04:36.346323+0000","last_undegraded":"2024-09-18T02:04:36.346323+0000","last_fullsized":"2024-09-18T02:04:36.346323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:03.926045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.340985+0000","last_change":"2024-09-18T02:03:57.523546+0000","last_active":"2024-09-18T02:04:36.340985+0000","last_peered":"2024-09-18T02:04:36.340985+0000","last_clean":"2024-09-18T02:04:36.340985+0000","last_became_active":"2024-09-18T02:03:57.519843+0000","last_became_peered":"2024-09-18T02:03:57.519843+0000","last_unstale":"2024-09-18T02:04:36.340985+0000","last_undegraded":"2024-09-18T02:04:36.340985+0000","last_fullsized":"2024-09-18T02:04:36.340985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:59:26.067138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.969754+0000","last_change":"2024-09-18T02:03:59.536808+0000","last_active":"2024-09-18T02:06:06.969754+0000","last_peered":"2024-09-18T02:06:06.969754+0000","last_clean":"2024-09-18T02:06:06.969754+0000","last_became_active":"2024-09-18T02:03:59.535992+0000","last_became_peered":"2024-09-18T02:03:59.535992+0000","last_unstale":"2024-09-18T02:06:06.969754+0000","last_undegraded":"2024-09-18T02:06:06.969754+0000","last_fullsized":"2024-09-18T02:06:06.969754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338112+0000","last_change":"2024-09-18T02:03:57.527965+0000","last_active":"2024-09-18T02:04:36.338112+0000","last_peered":"2024-09-18T02:04:36.338112+0000","last_clean":"2024-09-18T02:04:36.338112+0000","last_became_active":"2024-09-18T02:03:57.527146+0000","last_became_peered":"2024-09-18T02:03:57.527146+0000","last_unstale":"2024-09-18T02:04:36.338112+0000","last_undegraded":"2024-09-18T02:04:36.338112+0000","last_fullsized":"2024-09-18T02:04:36.338112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217939+0000","last_change":"2024-09-18T02:03:59.558797+0000","last_active":"2024-09-18T02:07:12.217939+0000","last_peered":"2024-09-18T02:07:12.217939+0000","last_clean":"2024-09-18T02:07:12.217939+0000","last_became_active":"2024-09-18T02:03:59.556425+0000","last_became_peered":"2024-09-18T02:03:59.556425+0000","last_unstale":"2024-09-18T02:07:12.217939+0000","last_undegraded":"2024-09-18T02:07:12.217939+0000","last_fullsized":"2024-09-18T02:07:12.217939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:18.823166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.050574+0000","last_change":"2024-09-18T02:04:36.351337+0000","last_active":"2024-09-18T02:07:12.050574+0000","last_peered":"2024-09-18T02:07:12.050574+0000","last_clean":"2024-09-18T02:07:12.050574+0000","last_became_active":"2024-09-18T02:04:36.350472+0000","last_became_peered":"2024-09-18T02:04:36.350472+0000","last_unstale":"2024-09-18T02:07:12.050574+0000","last_undegraded":"2024-09-18T02:07:12.050574+0000","last_fullsized":"2024-09-18T02:07:12.050574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:04:46.701505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"32'18","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:05:25.999570+0000","last_change":"2024-09-18T02:03:59.535727+0000","last_active":"2024-09-18T02:05:25.999570+0000","last_peered":"2024-09-18T02:05:25.999570+0000","last_clean":"2024-09-18T02:05:25.999570+0000","last_became_active":"2024-09-18T02:03:59.534584+0000","last_became_peered":"2024-09-18T02:03:59.534584+0000","last_unstale":"2024-09-18T02:05:25.999570+0000","last_undegraded":"2024-09-18T02:05:25.999570+0000","last_fullsized":"2024-09-18T02:05:25.999570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.636051+0000","last_change":"2024-09-18T02:03:57.523284+0000","last_active":"2024-09-18T02:07:11.636051+0000","last_peered":"2024-09-18T02:07:11.636051+0000","last_clean":"2024-09-18T02:07:11.636051+0000","last_became_active":"2024-09-18T02:03:57.521499+0000","last_became_peered":"2024-09-18T02:03:57.521499+0000","last_unstale":"2024-09-18T02:07:11.636051+0000","last_undegraded":"2024-09-18T02:07:11.636051+0000","last_fullsized":"2024-09-18T02:07:11.636051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329285+0000","last_change":"2024-09-18T02:03:59.555354+0000","last_active":"2024-09-18T02:06:06.329285+0000","last_peered":"2024-09-18T02:06:06.329285+0000","last_clean":"2024-09-18T02:06:06.329285+0000","last_became_active":"2024-09-18T02:03:59.554577+0000","last_became_peered":"2024-09-18T02:03:59.554577+0000","last_unstale":"2024-09-18T02:06:06.329285+0000","last_undegraded":"2024-09-18T02:06:06.329285+0000","last_fullsized":"2024-09-18T02:06:06.329285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:31:07.318399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:42.923838+0000","last_change":"2024-09-18T02:03:57.527483+0000","last_active":"2024-09-18T02:04:42.923838+0000","last_peered":"2024-09-18T02:04:42.923838+0000","last_clean":"2024-09-18T02:04:42.923838+0000","last_became_active":"2024-09-18T02:03:57.526774+0000","last_became_peered":"2024-09-18T02:03:57.526774+0000","last_unstale":"2024-09-18T02:04:42.923838+0000","last_undegraded":"2024-09-18T02:04:42.923838+0000","last_fullsized":"2024-09-18T02:04:42.923838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:58:25.305027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'13","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089661+0000","last_change":"2024-09-18T02:03:59.555131+0000","last_active":"2024-09-18T02:07:12.089661+0000","last_peered":"2024-09-18T02:07:12.089661+0000","last_clean":"2024-09-18T02:07:12.089661+0000","last_became_active":"2024-09-18T02:03:59.554672+0000","last_became_peered":"2024-09-18T02:03:59.554672+0000","last_unstale":"2024-09-18T02:07:12.089661+0000","last_undegraded":"2024-09-18T02:07:12.089661+0000","last_fullsized":"2024-09-18T02:07:12.089661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:10.488835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.346001+0000","last_change":"2024-09-18T02:03:57.519989+0000","last_active":"2024-09-18T02:04:36.346001+0000","last_peered":"2024-09-18T02:04:36.346001+0000","last_clean":"2024-09-18T02:04:36.346001+0000","last_became_active":"2024-09-18T02:03:57.519691+0000","last_became_peered":"2024-09-18T02:03:57.519691+0000","last_unstale":"2024-09-18T02:04:36.346001+0000","last_undegraded":"2024-09-18T02:04:36.346001+0000","last_fullsized":"2024-09-18T02:04:36.346001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'17","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.088472+0000","last_change":"2024-09-18T02:03:59.541946+0000","last_active":"2024-09-18T02:07:12.088472+0000","last_peered":"2024-09-18T02:07:12.088472+0000","last_clean":"2024-09-18T02:07:12.088472+0000","last_became_active":"2024-09-18T02:03:59.541059+0000","last_became_peered":"2024-09-18T02:03:59.541059+0000","last_unstale":"2024-09-18T02:07:12.088472+0000","last_undegraded":"2024-09-18T02:07:12.088472+0000","last_fullsized":"2024-09-18T02:07:12.088472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:59.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.005080+0000","last_change":"2024-09-18T02:03:57.519641+0000","last_active":"2024-09-18T02:06:11.005080+0000","last_peered":"2024-09-18T02:06:11.005080+0000","last_clean":"2024-09-18T02:06:11.005080+0000","last_became_active":"2024-09-18T02:03:57.519272+0000","last_became_peered":"2024-09-18T02:03:57.519272+0000","last_unstale":"2024-09-18T02:06:11.005080+0000","last_undegraded":"2024-09-18T02:06:11.005080+0000","last_fullsized":"2024-09-18T02:06:11.005080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:33.803881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'5","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.235540+0000","last_change":"2024-09-18T02:03:59.545622+0000","last_active":"2024-09-18T02:07:12.235540+0000","last_peered":"2024-09-18T02:07:12.235540+0000","last_clean":"2024-09-18T02:07:12.235540+0000","last_became_active":"2024-09-18T02:03:59.539946+0000","last_became_peered":"2024-09-18T02:03:59.539946+0000","last_unstale":"2024-09-18T02:07:12.235540+0000","last_undegraded":"2024-09-18T02:07:12.235540+0000","last_fullsized":"2024-09-18T02:07:12.235540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:11.298668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.342907+0000","last_change":"2024-09-18T02:03:57.527957+0000","last_active":"2024-09-18T02:04:36.342907+0000","last_peered":"2024-09-18T02:04:36.342907+0000","last_clean":"2024-09-18T02:04:36.342907+0000","last_became_active":"2024-09-18T02:03:57.527102+0000","last_became_peered":"2024-09-18T02:03:57.527102+0000","last_unstale":"2024-09-18T02:04:36.342907+0000","last_undegraded":"2024-09-18T02:04:36.342907+0000","last_fullsized":"2024-09-18T02:04:36.342907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:13:45.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'11","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.238904+0000","last_change":"2024-09-18T02:03:59.543494+0000","last_active":"2024-09-18T02:07:12.238904+0000","last_peered":"2024-09-18T02:07:12.238904+0000","last_clean":"2024-09-18T02:07:12.238904+0000","last_became_active":"2024-09-18T02:03:59.543160+0000","last_became_peered":"2024-09-18T02:03:59.543160+0000","last_unstale":"2024-09-18T02:07:12.238904+0000","last_undegraded":"2024-09-18T02:07:12.238904+0000","last_fullsized":"2024-09-18T02:07:12.238904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:21:48.069564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.347323+0000","last_change":"2024-09-18T02:03:57.525942+0000","last_active":"2024-09-18T02:04:36.347323+0000","last_peered":"2024-09-18T02:04:36.347323+0000","last_clean":"2024-09-18T02:04:36.347323+0000","last_became_active":"2024-09-18T02:03:57.524495+0000","last_became_peered":"2024-09-18T02:03:57.524495+0000","last_unstale":"2024-09-18T02:04:36.347323+0000","last_undegraded":"2024-09-18T02:04:36.347323+0000","last_fullsized":"2024-09-18T02:04:36.347323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:58:39.651409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217785+0000","last_change":"2024-09-18T02:04:36.361845+0000","last_active":"2024-09-18T02:07:12.217785+0000","last_peered":"2024-09-18T02:07:12.217785+0000","last_clean":"2024-09-18T02:07:12.217785+0000","last_became_active":"2024-09-18T02:04:36.354749+0000","last_became_peered":"2024-09-18T02:04:36.354749+0000","last_unstale":"2024-09-18T02:07:12.217785+0000","last_undegraded":"2024-09-18T02:07:12.217785+0000","last_fullsized":"2024-09-18T02:07:12.217785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:25:16.339405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338794+0000","last_change":"2024-09-18T02:03:57.521667+0000","last_active":"2024-09-18T02:04:36.338794+0000","last_peered":"2024-09-18T02:04:36.338794+0000","last_clean":"2024-09-18T02:04:36.338794+0000","last_became_active":"2024-09-18T02:03:57.520623+0000","last_became_peered":"2024-09-18T02:03:57.520623+0000","last_unstale":"2024-09-18T02:04:36.338794+0000","last_undegraded":"2024-09-18T02:04:36.338794+0000","last_fullsized":"2024-09-18T02:04:36.338794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:56:21.347463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.217768+0000","last_change":"2024-09-18T02:03:59.555647+0000","last_active":"2024-09-18T02:07:12.217768+0000","last_peered":"2024-09-18T02:07:12.217768+0000","last_clean":"2024-09-18T02:07:12.217768+0000","last_became_active":"2024-09-18T02:03:59.555178+0000","last_became_peered":"2024-09-18T02:03:59.555178+0000","last_unstale":"2024-09-18T02:07:12.217768+0000","last_undegraded":"2024-09-18T02:07:12.217768+0000","last_fullsized":"2024-09-18T02:07:12.217768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:53.751756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338718+0000","last_change":"2024-09-18T02:03:57.519654+0000","last_active":"2024-09-18T02:04:36.338718+0000","last_peered":"2024-09-18T02:04:36.338718+0000","last_clean":"2024-09-18T02:04:36.338718+0000","last_became_active":"2024-09-18T02:03:57.519359+0000","last_became_peered":"2024-09-18T02:03:57.519359+0000","last_unstale":"2024-09-18T02:04:36.338718+0000","last_undegraded":"2024-09-18T02:04:36.338718+0000","last_fullsized":"2024-09-18T02:04:36.338718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:32.125649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.722270+0000","last_change":"2024-09-18T02:03:59.542345+0000","last_active":"2024-09-18T02:07:11.722270+0000","last_peered":"2024-09-18T02:07:11.722270+0000","last_clean":"2024-09-18T02:07:11.722270+0000","last_became_active":"2024-09-18T02:03:59.540444+0000","last_became_peered":"2024-09-18T02:03:59.540444+0000","last_unstale":"2024-09-18T02:07:11.722270+0000","last_undegraded":"2024-09-18T02:07:11.722270+0000","last_fullsized":"2024-09-18T02:07:11.722270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:36.437530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.341283+0000","last_change":"2024-09-18T02:03:57.522898+0000","last_active":"2024-09-18T02:04:36.341283+0000","last_peered":"2024-09-18T02:04:36.341283+0000","last_clean":"2024-09-18T02:04:36.341283+0000","last_became_active":"2024-09-18T02:03:57.521148+0000","last_became_peered":"2024-09-18T02:03:57.521148+0000","last_unstale":"2024-09-18T02:04:36.341283+0000","last_undegraded":"2024-09-18T02:04:36.341283+0000","last_fullsized":"2024-09-18T02:04:36.341283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:01:00.952689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.069454+0000","last_change":"2024-09-18T02:03:59.553902+0000","last_active":"2024-09-18T02:07:12.069454+0000","last_peered":"2024-09-18T02:07:12.069454+0000","last_clean":"2024-09-18T02:07:12.069454+0000","last_became_active":"2024-09-18T02:03:59.553528+0000","last_became_peered":"2024-09-18T02:03:59.553528+0000","last_unstale":"2024-09-18T02:07:12.069454+0000","last_undegraded":"2024-09-18T02:07:12.069454+0000","last_fullsized":"2024-09-18T02:07:12.069454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:19:15.763980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354140+0000","last_change":"2024-09-18T02:03:57.527928+0000","last_active":"2024-09-18T02:04:36.354140+0000","last_peered":"2024-09-18T02:04:36.354140+0000","last_clean":"2024-09-18T02:04:36.354140+0000","last_became_active":"2024-09-18T02:03:57.526972+0000","last_became_peered":"2024-09-18T02:03:57.526972+0000","last_unstale":"2024-09-18T02:04:36.354140+0000","last_undegraded":"2024-09-18T02:04:36.354140+0000","last_fullsized":"2024-09-18T02:04:36.354140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:17.513345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.729602+0000","last_change":"2024-09-18T02:03:59.546007+0000","last_active":"2024-09-18T02:07:11.729602+0000","last_peered":"2024-09-18T02:07:11.729602+0000","last_clean":"2024-09-18T02:07:11.729602+0000","last_became_active":"2024-09-18T02:03:59.545405+0000","last_became_peered":"2024-09-18T02:03:59.545405+0000","last_unstale":"2024-09-18T02:07:11.729602+0000","last_undegraded":"2024-09-18T02:07:11.729602+0000","last_fullsized":"2024-09-18T02:07:11.729602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:15.586493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.354861+0000","last_change":"2024-09-18T02:03:57.522221+0000","last_active":"2024-09-18T02:04:36.354861+0000","last_peered":"2024-09-18T02:04:36.354861+0000","last_clean":"2024-09-18T02:04:36.354861+0000","last_became_active":"2024-09-18T02:03:57.521800+0000","last_became_peered":"2024-09-18T02:03:57.521800+0000","last_unstale":"2024-09-18T02:04:36.354861+0000","last_undegraded":"2024-09-18T02:04:36.354861+0000","last_fullsized":"2024-09-18T02:04:36.354861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:38.433048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.155206+0000","last_change":"2024-09-18T02:04:36.384511+0000","last_active":"2024-09-18T02:07:12.155206+0000","last_peered":"2024-09-18T02:07:12.155206+0000","last_clean":"2024-09-18T02:07:12.155206+0000","last_became_active":"2024-09-18T02:04:36.357213+0000","last_became_peered":"2024-09-18T02:04:36.357213+0000","last_unstale":"2024-09-18T02:07:12.155206+0000","last_undegraded":"2024-09-18T02:07:12.155206+0000","last_fullsized":"2024-09-18T02:07:12.155206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:09.239456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.368246+0000","last_change":"2024-09-18T02:03:57.531024+0000","last_active":"2024-09-18T02:04:36.368246+0000","last_peered":"2024-09-18T02:04:36.368246+0000","last_clean":"2024-09-18T02:04:36.368246+0000","last_became_active":"2024-09-18T02:03:57.528312+0000","last_became_peered":"2024-09-18T02:03:57.528312+0000","last_unstale":"2024-09-18T02:04:36.368246+0000","last_undegraded":"2024-09-18T02:04:36.368246+0000","last_fullsized":"2024-09-18T02:04:36.368246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:00:32.979432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.153104+0000","last_change":"2024-09-18T02:03:59.546083+0000","last_active":"2024-09-18T02:07:12.153104+0000","last_peered":"2024-09-18T02:07:12.153104+0000","last_clean":"2024-09-18T02:07:12.153104+0000","last_became_active":"2024-09-18T02:03:59.540283+0000","last_became_peered":"2024-09-18T02:03:59.540283+0000","last_unstale":"2024-09-18T02:07:12.153104+0000","last_undegraded":"2024-09-18T02:07:12.153104+0000","last_fullsized":"2024-09-18T02:07:12.153104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:30:19.526855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:10.910994+0000","last_change":"2024-09-18T02:03:57.528934+0000","last_active":"2024-09-18T02:06:10.910994+0000","last_peered":"2024-09-18T02:06:10.910994+0000","last_clean":"2024-09-18T02:06:10.910994+0000","last_became_active":"2024-09-18T02:03:57.526363+0000","last_became_peered":"2024-09-18T02:03:57.526363+0000","last_unstale":"2024-09-18T02:06:10.910994+0000","last_undegraded":"2024-09-18T02:06:10.910994+0000","last_fullsized":"2024-09-18T02:06:10.910994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:36.487218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.058009+0000","last_change":"2024-09-18T02:03:57.516751+0000","last_active":"2024-09-18T02:07:12.058009+0000","last_peered":"2024-09-18T02:07:12.058009+0000","last_clean":"2024-09-18T02:07:12.058009+0000","last_became_active":"2024-09-18T02:03:57.516434+0000","last_became_peered":"2024-09-18T02:03:57.516434+0000","last_unstale":"2024-09-18T02:07:12.058009+0000","last_undegraded":"2024-09-18T02:07:12.058009+0000","last_fullsized":"2024-09-18T02:07:12.058009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:34.563165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334365+0000","last_change":"2024-09-18T02:03:59.551182+0000","last_active":"2024-09-18T02:06:26.334365+0000","last_peered":"2024-09-18T02:06:26.334365+0000","last_clean":"2024-09-18T02:06:26.334365+0000","last_became_active":"2024-09-18T02:03:59.550058+0000","last_became_peered":"2024-09-18T02:03:59.550058+0000","last_unstale":"2024-09-18T02:06:26.334365+0000","last_undegraded":"2024-09-18T02:06:26.334365+0000","last_fullsized":"2024-09-18T02:06:26.334365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:38.500729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:04:36.338421+0000","last_change":"2024-09-18T02:03:57.533882+0000","last_active":"2024-09-18T02:04:36.338421+0000","last_peered":"2024-09-18T02:04:36.338421+0000","last_clean":"2024-09-18T02:04:36.338421+0000","last_became_active":"2024-09-18T02:03:57.533324+0000","last_became_peered":"2024-09-18T02:03:57.533324+0000","last_unstale":"2024-09-18T02:04:36.338421+0000","last_undegraded":"2024-09-18T02:04:36.338421+0000","last_fullsized":"2024-09-18T02:04:36.338421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:12.188092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'11","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.886960+0000","last_change":"2024-09-18T02:03:59.542840+0000","last_active":"2024-09-18T02:07:11.886960+0000","last_peered":"2024-09-18T02:07:11.886960+0000","last_clean":"2024-09-18T02:07:11.886960+0000","last_became_active":"2024-09-18T02:03:59.542356+0000","last_became_peered":"2024-09-18T02:03:59.542356+0000","last_unstale":"2024-09-18T02:07:11.886960+0000","last_undegraded":"2024-09-18T02:07:11.886960+0000","last_fullsized":"2024-09-18T02:07:11.886960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:35:21.321816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1570,"ondisk_log_size":1570,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1593,"num_read_kb":1483,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705716,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":138326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705717,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":983040,"data_stored":725968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1007616,"data_stored":726892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39928,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331912,"statfs":{"total":96636764160,"available":96595877888,"internally_reserved":0,"allocated":430080,"data_stored":137902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T02:07:48.365 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.365 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.365 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.365 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.365 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.366 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.366 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.366 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.366 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.366 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.366 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.366 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.366 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.367 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.367 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.367 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.367 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.367 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.367 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.367 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.367 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.367 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.368 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.368 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.368 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.368 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.368 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.368 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.368 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.368 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.368 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.369 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.369 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.369 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.369 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.369 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.369 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.369 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.369 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.369 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.370 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.370 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.370 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.370 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.370 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.370 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.370 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.370 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.370 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.371 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.371 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.371 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.371 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.371 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.371 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.371 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.371 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.371 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.372 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.372 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.372 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.372 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.372 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.372 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.372 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.372 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.372 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.373 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.373 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.373 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.373 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.373 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.373 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.373 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.373 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.373 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.374 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.374 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.374 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.374 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.374 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.374 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.374 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.374 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.374 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.374 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.375 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.375 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.375 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.375 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.375 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.375 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.375 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.375 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.375 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.376 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.376 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.376 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.376 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.376 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.376 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.376 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T02:03:42.235832+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.376 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.377 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.377 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.377 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.377 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.377 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.377 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.377 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.377 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.378 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.378 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.378 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.378 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.378 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.378 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.378 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.378 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.378 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.379 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.379 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.379 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.379 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.379 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.379 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.379 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.379 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.379 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.380 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.380 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.380 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.380 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.380 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.380 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.380 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.380 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.381 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.381 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.381 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.381 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.381 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.381 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.381 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.381 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.381 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.382 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.382 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.382 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.382 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.382 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.382 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.382 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.382 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.382 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.382 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.383 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.383 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.383 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.383 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.383 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.383 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.383 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.383 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.383 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.383 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.384 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.384 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.384 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.384 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.384 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.384 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.384 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.384 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.385 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.385 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.385 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.385 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.385 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.385 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.385 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.385 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.385 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.386 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.386 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.386 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.386 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.386 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.386 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.386 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.386 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.386 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.387 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.387 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.387 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.387 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.387 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.387 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.387 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.387 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.387 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.388 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.388 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.388 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.388 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.388 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.388 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.388 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.388 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.388 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.389 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.389 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.389 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.389 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.389 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.389 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.389 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.389 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.389 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.390 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.390 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.390 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.390 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.390 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.390 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.390 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.390 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.390 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.391 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.391 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.391 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.391 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.391 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.391 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.391 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.391 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.391 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.392 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.392 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.392 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.392 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.392 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.392 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.392 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.392 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.392 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.393 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.393 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.393 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.393 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.393 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.393 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.393 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.393 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.394 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.394 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.394 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.394 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.394 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.394 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.394 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.394 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.394 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.395 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.395 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:07:48.395 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T02:08:08.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T02:08:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.528+0000 7fa43adbd640 1 Processor -- start 2024-09-18T02:08:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.528+0000 7fa43adbd640 1 -- start start 2024-09-18T02:08:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.528+0000 7fa43adbd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa43406d0e0 0x7fa43406d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:08:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.528+0000 7fa43adbd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa434071c10 con 0x7fa43406da00 2024-09-18T02:08:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.528+0000 7fa43adbd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa434072230 con 0x7fa43406d0e0 2024-09-18T02:08:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.528+0000 7fa438b59640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa43406d0e0 0x7fa43406d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:08:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.528+0000 7fa438b59640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa43406d0e0 0x7fa43406d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43996/0 (socket says 172.21.15.81:43996) 2024-09-18T02:08:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.528+0000 7fa438b59640 1 -- 172.21.15.81:0/1459416304 learned_addr learned my addr 172.21.15.81:0/1459416304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:08:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa438b59640 1 -- 172.21.15.81:0/1459416304 >> v1:172.21.15.81:6789/0 conn(0x7fa43406da00 legacy=0x7fa43412ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa438b59640 1 -- 172.21.15.81:0/1459416304 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4340709e0 con 0x7fa43406d0e0 2024-09-18T02:08:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa438b59640 1 --2- 172.21.15.81:0/1459416304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43406d0e0 0x7fa43406d4c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa4240097f0 tx=0x7fa42401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab460a045961efad server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:08:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa4337fe640 1 -- 172.21.15.81:0/1459416304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240b0070 con 0x7fa43406d0e0 2024-09-18T02:08:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa4337fe640 1 -- 172.21.15.81:0/1459416304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4240ab530 con 0x7fa43406d0e0 2024-09-18T02:08:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa4337fe640 1 -- 172.21.15.81:0/1459416304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240ab830 con 0x7fa43406d0e0 2024-09-18T02:08:08.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa43adbd640 1 -- 172.21.15.81:0/1459416304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43406d0e0 msgr2=0x7fa43406d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:08.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa43adbd640 1 --2- 172.21.15.81:0/1459416304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43406d0e0 0x7fa43406d4c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa4240097f0 tx=0x7fa42401c430 comp rx=0 tx=0).stop 2024-09-18T02:08:08.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa43adbd640 1 -- 172.21.15.81:0/1459416304 shutdown_connections 2024-09-18T02:08:08.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa43adbd640 1 --2- 172.21.15.81:0/1459416304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43406d0e0 0x7fa43406d4c0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:08:08.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa43adbd640 1 -- 172.21.15.81:0/1459416304 >> 172.21.15.81:0/1459416304 conn(0x7fa434099a50 msgr2=0x7fa4340972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:08:08.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa43adbd640 1 -- 172.21.15.81:0/1459416304 shutdown_connections 2024-09-18T02:08:08.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.532+0000 7fa43adbd640 1 -- 172.21.15.81:0/1459416304 wait complete. 2024-09-18T02:08:08.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa43adbd640 1 Processor -- start 2024-09-18T02:08:08.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa43adbd640 1 -- start start 2024-09-18T02:08:08.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa43adbd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43406d0e0 0x7fa4341c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:08:08.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa43adbd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa434134e80 con 0x7fa43406d0e0 2024-09-18T02:08:08.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa438b59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43406d0e0 0x7fa4341c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:08:08.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa438b59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43406d0e0 0x7fa4341c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44002/0 (socket says 172.21.15.81:44002) 2024-09-18T02:08:08.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa438b59640 1 -- 172.21.15.81:0/2243156919 learned_addr learned my addr 172.21.15.81:0/2243156919 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:08:08.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa438b59640 1 -- 172.21.15.81:0/2243156919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43412bfc0 con 0x7fa43406d0e0 2024-09-18T02:08:08.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa438b59640 1 --2- 172.21.15.81:0/2243156919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43406d0e0 0x7fa4341c6360 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa42401a060 tx=0x7fa42401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:08:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa4317fa640 1 -- 172.21.15.81:0/2243156919 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240ba020 con 0x7fa43406d0e0 2024-09-18T02:08:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa4317fa640 1 -- 172.21.15.81:0/2243156919 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4240b6420 con 0x7fa43406d0e0 2024-09-18T02:08:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa43adbd640 1 -- 172.21.15.81:0/2243156919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43406f660 con 0x7fa43406d0e0 2024-09-18T02:08:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa4317fa640 1 -- 172.21.15.81:0/2243156919 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240b0040 con 0x7fa43406d0e0 2024-09-18T02:08:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa43adbd640 1 -- 172.21.15.81:0/2243156919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4341c68a0 con 0x7fa43406d0e0 2024-09-18T02:08:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa4317fa640 1 -- 172.21.15.81:0/2243156919 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa4240bd020 con 0x7fa43406d0e0 2024-09-18T02:08:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa43adbd640 1 -- 172.21.15.81:0/2243156919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa43406d4c0 con 0x7fa43406d0e0 2024-09-18T02:08:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa4317fa640 1 --2- 172.21.15.81:0/2243156919 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa420035db0 0x7fa420038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:08:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa4317fa640 1 -- 172.21.15.81:0/2243156919 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa4240e3380 con 0x7fa43406d0e0 2024-09-18T02:08:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.536+0000 7fa433fff640 1 --2- 172.21.15.81:0/2243156919 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa420035db0 0x7fa420038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:08:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.540+0000 7fa433fff640 1 --2- 172.21.15.81:0/2243156919 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa420035db0 0x7fa420038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa428000f70 tx=0x7fa428007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:08:08.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.540+0000 7fa4317fa640 1 -- 172.21.15.81:0/2243156919 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa4240c4030 con 0x7fa43406d0e0 2024-09-18T02:08:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.700+0000 7fa43adbd640 1 -- 172.21.15.81:0/2243156919 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa434073790 con 0x7fa420035db0 2024-09-18T02:08:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.744+0000 7fa4317fa640 1 -- 172.21.15.81:0/2243156919 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658743 (secure 0 0 0) 0x7fa434073790 con 0x7fa420035db0 2024-09-18T02:08:08.752 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:08:08.758 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T02:08:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.752+0000 7fa43adbd640 1 -- 172.21.15.81:0/2243156919 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa420035db0 msgr2=0x7fa420038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.752+0000 7fa43adbd640 1 --2- 172.21.15.81:0/2243156919 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa420035db0 0x7fa420038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa428000f70 tx=0x7fa428007a40 comp rx=0 tx=0).stop 2024-09-18T02:08:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.752+0000 7fa43adbd640 1 -- 172.21.15.81:0/2243156919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43406d0e0 msgr2=0x7fa4341c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.752+0000 7fa43adbd640 1 --2- 172.21.15.81:0/2243156919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43406d0e0 0x7fa4341c6360 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa42401a060 tx=0x7fa42401ac70 comp rx=0 tx=0).stop 2024-09-18T02:08:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.752+0000 7fa43adbd640 1 -- 172.21.15.81:0/2243156919 shutdown_connections 2024-09-18T02:08:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.752+0000 7fa43adbd640 1 --2- 172.21.15.81:0/2243156919 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fa420035db0 0x7fa420038270 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:08:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.752+0000 7fa43adbd640 1 --2- 172.21.15.81:0/2243156919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43406d0e0 0x7fa4341c6360 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:08:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.752+0000 7fa43adbd640 1 -- 172.21.15.81:0/2243156919 >> 172.21.15.81:0/2243156919 conn(0x7fa434099a50 msgr2=0x7fa43409b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:08:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.752+0000 7fa43adbd640 1 -- 172.21.15.81:0/2243156919 shutdown_connections 2024-09-18T02:08:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:08.752+0000 7fa43adbd640 1 -- 172.21.15.81:0/2243156919 wait complete. 2024-09-18T02:08:08.769 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-18T02:08:07.358828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5363,"num_read_kb":4916,"num_write":2373,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4963,"ondisk_log_size":4963,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156672,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330688,"statfs":{"total":386547056640,"available":386386624512,"internally_reserved":0,"allocated":2883584,"data_stored":1729088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006175"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.331614+0000","last_change":"2024-09-18T02:03:57.517243+0000","last_active":"2024-09-18T02:06:06.331614+0000","last_peered":"2024-09-18T02:06:06.331614+0000","last_clean":"2024-09-18T02:06:06.331614+0000","last_became_active":"2024-09-18T02:03:57.516420+0000","last_became_peered":"2024-09-18T02:03:57.516420+0000","last_unstale":"2024-09-18T02:06:06.331614+0000","last_undegraded":"2024-09-18T02:06:06.331614+0000","last_fullsized":"2024-09-18T02:06:06.331614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.886708+0000","last_change":"2024-09-18T02:03:59.549513+0000","last_active":"2024-09-18T02:07:11.886708+0000","last_peered":"2024-09-18T02:07:11.886708+0000","last_clean":"2024-09-18T02:07:11.886708+0000","last_became_active":"2024-09-18T02:03:59.545294+0000","last_became_peered":"2024-09-18T02:03:59.545294+0000","last_unstale":"2024-09-18T02:07:11.886708+0000","last_undegraded":"2024-09-18T02:07:11.886708+0000","last_fullsized":"2024-09-18T02:07:11.886708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.391461+0000","last_change":"2024-09-18T02:03:57.533991+0000","last_active":"2024-09-18T02:07:43.391461+0000","last_peered":"2024-09-18T02:07:43.391461+0000","last_clean":"2024-09-18T02:07:43.391461+0000","last_became_active":"2024-09-18T02:03:57.533332+0000","last_became_peered":"2024-09-18T02:03:57.533332+0000","last_unstale":"2024-09-18T02:07:43.391461+0000","last_undegraded":"2024-09-18T02:07:43.391461+0000","last_fullsized":"2024-09-18T02:07:43.391461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339113+0000","last_change":"2024-09-18T02:03:59.554008+0000","last_active":"2024-09-18T02:06:31.339113+0000","last_peered":"2024-09-18T02:06:31.339113+0000","last_clean":"2024-09-18T02:06:31.339113+0000","last_became_active":"2024-09-18T02:03:59.553641+0000","last_became_peered":"2024-09-18T02:03:59.553641+0000","last_unstale":"2024-09-18T02:06:31.339113+0000","last_undegraded":"2024-09-18T02:06:31.339113+0000","last_fullsized":"2024-09-18T02:06:31.339113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.333136+0000","last_change":"2024-09-18T02:03:57.532939+0000","last_active":"2024-09-18T02:06:06.333136+0000","last_peered":"2024-09-18T02:06:06.333136+0000","last_clean":"2024-09-18T02:06:06.333136+0000","last_became_active":"2024-09-18T02:03:57.532561+0000","last_became_peered":"2024-09-18T02:03:57.532561+0000","last_unstale":"2024-09-18T02:06:06.333136+0000","last_undegraded":"2024-09-18T02:06:06.333136+0000","last_fullsized":"2024-09-18T02:06:06.333136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089217+0000","last_change":"2024-09-18T02:03:59.552858+0000","last_active":"2024-09-18T02:07:12.089217+0000","last_peered":"2024-09-18T02:07:12.089217+0000","last_clean":"2024-09-18T02:07:12.089217+0000","last_became_active":"2024-09-18T02:03:59.551661+0000","last_became_peered":"2024-09-18T02:03:59.551661+0000","last_unstale":"2024-09-18T02:07:12.089217+0000","last_undegraded":"2024-09-18T02:07:12.089217+0000","last_fullsized":"2024-09-18T02:07:12.089217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.548518+0000","last_change":"2024-09-18T02:03:57.523513+0000","last_active":"2024-09-18T02:07:47.548518+0000","last_peered":"2024-09-18T02:07:47.548518+0000","last_clean":"2024-09-18T02:07:47.548518+0000","last_became_active":"2024-09-18T02:03:57.522751+0000","last_became_peered":"2024-09-18T02:03:57.522751+0000","last_unstale":"2024-09-18T02:07:47.548518+0000","last_undegraded":"2024-09-18T02:07:47.548518+0000","last_fullsized":"2024-09-18T02:07:47.548518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339247+0000","last_change":"2024-09-18T02:03:59.553228+0000","last_active":"2024-09-18T02:06:31.339247+0000","last_peered":"2024-09-18T02:06:31.339247+0000","last_clean":"2024-09-18T02:06:31.339247+0000","last_became_active":"2024-09-18T02:03:59.552797+0000","last_became_peered":"2024-09-18T02:03:59.552797+0000","last_unstale":"2024-09-18T02:06:31.339247+0000","last_undegraded":"2024-09-18T02:06:31.339247+0000","last_fullsized":"2024-09-18T02:06:31.339247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339266+0000","last_change":"2024-09-18T02:03:57.525148+0000","last_active":"2024-09-18T02:06:31.339266+0000","last_peered":"2024-09-18T02:06:31.339266+0000","last_clean":"2024-09-18T02:06:31.339266+0000","last_became_active":"2024-09-18T02:03:57.524645+0000","last_became_peered":"2024-09-18T02:03:57.524645+0000","last_unstale":"2024-09-18T02:06:31.339266+0000","last_undegraded":"2024-09-18T02:06:31.339266+0000","last_fullsized":"2024-09-18T02:06:31.339266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.109014+0000","last_change":"2024-09-18T02:03:59.542637+0000","last_active":"2024-09-18T02:07:47.109014+0000","last_peered":"2024-09-18T02:07:47.109014+0000","last_clean":"2024-09-18T02:07:47.109014+0000","last_became_active":"2024-09-18T02:03:59.542238+0000","last_became_peered":"2024-09-18T02:03:59.542238+0000","last_unstale":"2024-09-18T02:07:47.109014+0000","last_undegraded":"2024-09-18T02:07:47.109014+0000","last_fullsized":"2024-09-18T02:07:47.109014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.337294+0000","last_change":"2024-09-18T02:03:57.523116+0000","last_active":"2024-09-18T02:06:31.337294+0000","last_peered":"2024-09-18T02:06:31.337294+0000","last_clean":"2024-09-18T02:06:31.337294+0000","last_became_active":"2024-09-18T02:03:57.520647+0000","last_became_peered":"2024-09-18T02:03:57.520647+0000","last_unstale":"2024-09-18T02:06:31.337294+0000","last_undegraded":"2024-09-18T02:06:31.337294+0000","last_fullsized":"2024-09-18T02:06:31.337294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'12","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.170023+0000","last_change":"2024-09-18T02:03:59.560469+0000","last_active":"2024-09-18T02:07:12.170023+0000","last_peered":"2024-09-18T02:07:12.170023+0000","last_clean":"2024-09-18T02:07:12.170023+0000","last_became_active":"2024-09-18T02:03:59.559273+0000","last_became_peered":"2024-09-18T02:03:59.559273+0000","last_unstale":"2024-09-18T02:07:12.170023+0000","last_undegraded":"2024-09-18T02:07:12.170023+0000","last_fullsized":"2024-09-18T02:07:12.170023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.682302+0000","last_change":"2024-09-18T02:03:57.528855+0000","last_active":"2024-09-18T02:07:11.682302+0000","last_peered":"2024-09-18T02:07:11.682302+0000","last_clean":"2024-09-18T02:07:11.682302+0000","last_became_active":"2024-09-18T02:03:57.526953+0000","last_became_peered":"2024-09-18T02:03:57.526953+0000","last_unstale":"2024-09-18T02:07:11.682302+0000","last_undegraded":"2024-09-18T02:07:11.682302+0000","last_fullsized":"2024-09-18T02:07:11.682302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.331534+0000","last_change":"2024-09-18T02:03:59.541576+0000","last_active":"2024-09-18T02:06:06.331534+0000","last_peered":"2024-09-18T02:06:06.331534+0000","last_clean":"2024-09-18T02:06:06.331534+0000","last_became_active":"2024-09-18T02:03:59.541086+0000","last_became_peered":"2024-09-18T02:03:59.541086+0000","last_unstale":"2024-09-18T02:06:06.331534+0000","last_undegraded":"2024-09-18T02:06:06.331534+0000","last_fullsized":"2024-09-18T02:06:06.331534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.335376+0000","last_change":"2024-09-18T02:03:57.524285+0000","last_active":"2024-09-18T02:06:31.335376+0000","last_peered":"2024-09-18T02:06:31.335376+0000","last_clean":"2024-09-18T02:06:31.335376+0000","last_became_active":"2024-09-18T02:03:57.520343+0000","last_became_peered":"2024-09-18T02:03:57.520343+0000","last_unstale":"2024-09-18T02:06:31.335376+0000","last_undegraded":"2024-09-18T02:06:31.335376+0000","last_fullsized":"2024-09-18T02:06:31.335376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'12","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089875+0000","last_change":"2024-09-18T02:03:59.534315+0000","last_active":"2024-09-18T02:07:12.089875+0000","last_peered":"2024-09-18T02:07:12.089875+0000","last_clean":"2024-09-18T02:07:12.089875+0000","last_became_active":"2024-09-18T02:03:59.533956+0000","last_became_peered":"2024-09-18T02:03:59.533956+0000","last_unstale":"2024-09-18T02:07:12.089875+0000","last_undegraded":"2024-09-18T02:07:12.089875+0000","last_fullsized":"2024-09-18T02:07:12.089875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.238532+0000","last_change":"2024-09-18T02:03:59.537124+0000","last_active":"2024-09-18T02:07:12.238532+0000","last_peered":"2024-09-18T02:07:12.238532+0000","last_clean":"2024-09-18T02:07:12.238532+0000","last_became_active":"2024-09-18T02:03:59.536739+0000","last_became_peered":"2024-09-18T02:03:59.536739+0000","last_unstale":"2024-09-18T02:07:12.238532+0000","last_undegraded":"2024-09-18T02:07:12.238532+0000","last_fullsized":"2024-09-18T02:07:12.238532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.335039+0000","last_change":"2024-09-18T02:03:57.523985+0000","last_active":"2024-09-18T02:06:26.335039+0000","last_peered":"2024-09-18T02:06:26.335039+0000","last_clean":"2024-09-18T02:06:26.335039+0000","last_became_active":"2024-09-18T02:03:57.523437+0000","last_became_peered":"2024-09-18T02:03:57.523437+0000","last_unstale":"2024-09-18T02:06:26.335039+0000","last_undegraded":"2024-09-18T02:06:26.335039+0000","last_fullsized":"2024-09-18T02:06:26.335039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.238290+0000","last_change":"2024-09-18T02:03:59.540278+0000","last_active":"2024-09-18T02:07:12.238290+0000","last_peered":"2024-09-18T02:07:12.238290+0000","last_clean":"2024-09-18T02:07:12.238290+0000","last_became_active":"2024-09-18T02:03:59.539778+0000","last_became_peered":"2024-09-18T02:03:59.539778+0000","last_unstale":"2024-09-18T02:07:12.238290+0000","last_undegraded":"2024-09-18T02:07:12.238290+0000","last_fullsized":"2024-09-18T02:07:12.238290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.042528+0000","last_change":"2024-09-18T02:03:57.528659+0000","last_active":"2024-09-18T02:07:12.042528+0000","last_peered":"2024-09-18T02:07:12.042528+0000","last_clean":"2024-09-18T02:07:12.042528+0000","last_became_active":"2024-09-18T02:03:57.524578+0000","last_became_peered":"2024-09-18T02:03:57.524578+0000","last_unstale":"2024-09-18T02:07:12.042528+0000","last_undegraded":"2024-09-18T02:07:12.042528+0000","last_fullsized":"2024-09-18T02:07:12.042528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.333593+0000","last_change":"2024-09-18T02:03:59.546276+0000","last_active":"2024-09-18T02:06:21.333593+0000","last_peered":"2024-09-18T02:06:21.333593+0000","last_clean":"2024-09-18T02:06:21.333593+0000","last_became_active":"2024-09-18T02:03:59.545902+0000","last_became_peered":"2024-09-18T02:03:59.545902+0000","last_unstale":"2024-09-18T02:06:21.333593+0000","last_undegraded":"2024-09-18T02:06:21.333593+0000","last_fullsized":"2024-09-18T02:06:21.333593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334920+0000","last_change":"2024-09-18T02:03:57.523592+0000","last_active":"2024-09-18T02:06:26.334920+0000","last_peered":"2024-09-18T02:06:26.334920+0000","last_clean":"2024-09-18T02:06:26.334920+0000","last_became_active":"2024-09-18T02:03:57.523211+0000","last_became_peered":"2024-09-18T02:03:57.523211+0000","last_unstale":"2024-09-18T02:06:26.334920+0000","last_undegraded":"2024-09-18T02:06:26.334920+0000","last_fullsized":"2024-09-18T02:06:26.334920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334085+0000","last_change":"2024-09-18T02:03:59.539920+0000","last_active":"2024-09-18T02:06:26.334085+0000","last_peered":"2024-09-18T02:06:26.334085+0000","last_clean":"2024-09-18T02:06:26.334085+0000","last_became_active":"2024-09-18T02:03:59.539198+0000","last_became_peered":"2024-09-18T02:03:59.539198+0000","last_unstale":"2024-09-18T02:06:26.334085+0000","last_undegraded":"2024-09-18T02:06:26.334085+0000","last_fullsized":"2024-09-18T02:06:26.334085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334897+0000","last_change":"2024-09-18T02:03:57.523263+0000","last_active":"2024-09-18T02:06:26.334897+0000","last_peered":"2024-09-18T02:06:26.334897+0000","last_clean":"2024-09-18T02:06:26.334897+0000","last_became_active":"2024-09-18T02:03:57.522924+0000","last_became_peered":"2024-09-18T02:03:57.522924+0000","last_unstale":"2024-09-18T02:06:26.334897+0000","last_undegraded":"2024-09-18T02:06:26.334897+0000","last_fullsized":"2024-09-18T02:06:26.334897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.170485+0000","last_change":"2024-09-18T02:03:59.538519+0000","last_active":"2024-09-18T02:07:12.170485+0000","last_peered":"2024-09-18T02:07:12.170485+0000","last_clean":"2024-09-18T02:07:12.170485+0000","last_became_active":"2024-09-18T02:03:59.538126+0000","last_became_peered":"2024-09-18T02:03:59.538126+0000","last_unstale":"2024-09-18T02:07:12.170485+0000","last_undegraded":"2024-09-18T02:07:12.170485+0000","last_fullsized":"2024-09-18T02:07:12.170485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334036+0000","last_change":"2024-09-18T02:03:57.524373+0000","last_active":"2024-09-18T02:06:26.334036+0000","last_peered":"2024-09-18T02:06:26.334036+0000","last_clean":"2024-09-18T02:06:26.334036+0000","last_became_active":"2024-09-18T02:03:57.521019+0000","last_became_peered":"2024-09-18T02:03:57.521019+0000","last_unstale":"2024-09-18T02:06:26.334036+0000","last_undegraded":"2024-09-18T02:06:26.334036+0000","last_fullsized":"2024-09-18T02:06:26.334036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.747453+0000","last_change":"2024-09-18T02:03:59.542673+0000","last_active":"2024-09-18T02:07:11.747453+0000","last_peered":"2024-09-18T02:07:11.747453+0000","last_clean":"2024-09-18T02:07:11.747453+0000","last_became_active":"2024-09-18T02:03:59.540553+0000","last_became_peered":"2024-09-18T02:03:59.540553+0000","last_unstale":"2024-09-18T02:07:11.747453+0000","last_undegraded":"2024-09-18T02:07:11.747453+0000","last_fullsized":"2024-09-18T02:07:11.747453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336674+0000","last_change":"2024-09-18T02:03:57.527852+0000","last_active":"2024-09-18T02:06:21.336674+0000","last_peered":"2024-09-18T02:06:21.336674+0000","last_clean":"2024-09-18T02:06:21.336674+0000","last_became_active":"2024-09-18T02:03:57.526917+0000","last_became_peered":"2024-09-18T02:03:57.526917+0000","last_unstale":"2024-09-18T02:06:21.336674+0000","last_undegraded":"2024-09-18T02:06:21.336674+0000","last_fullsized":"2024-09-18T02:06:21.336674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.262185+0000","last_change":"2024-09-18T02:04:07.624724+0000","last_active":"2024-09-18T02:07:12.262185+0000","last_peered":"2024-09-18T02:07:12.262185+0000","last_clean":"2024-09-18T02:07:12.262185+0000","last_became_active":"2024-09-18T02:04:07.624037+0000","last_became_peered":"2024-09-18T02:04:07.624037+0000","last_unstale":"2024-09-18T02:07:12.262185+0000","last_undegraded":"2024-09-18T02:07:12.262185+0000","last_fullsized":"2024-09-18T02:07:12.262185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.088153+0000","last_change":"2024-09-18T02:03:59.545658+0000","last_active":"2024-09-18T02:07:12.088153+0000","last_peered":"2024-09-18T02:07:12.088153+0000","last_clean":"2024-09-18T02:07:12.088153+0000","last_became_active":"2024-09-18T02:03:59.538409+0000","last_became_peered":"2024-09-18T02:03:59.538409+0000","last_unstale":"2024-09-18T02:07:12.088153+0000","last_undegraded":"2024-09-18T02:07:12.088153+0000","last_fullsized":"2024-09-18T02:07:12.088153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.389719+0000","last_change":"2024-09-18T02:03:57.533041+0000","last_active":"2024-09-18T02:07:43.389719+0000","last_peered":"2024-09-18T02:07:43.389719+0000","last_clean":"2024-09-18T02:07:43.389719+0000","last_became_active":"2024-09-18T02:03:57.532657+0000","last_became_peered":"2024-09-18T02:03:57.532657+0000","last_unstale":"2024-09-18T02:07:43.389719+0000","last_undegraded":"2024-09-18T02:07:43.389719+0000","last_fullsized":"2024-09-18T02:07:43.389719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.360622+0000","last_change":"2024-09-18T02:07:51.360784+0000","last_active":"2024-09-18T02:07:51.360622+0000","last_peered":"2024-09-18T02:07:51.360622+0000","last_clean":"2024-09-18T02:07:51.360622+0000","last_became_active":"2024-09-18T02:04:01.562058+0000","last_became_peered":"2024-09-18T02:04:01.562058+0000","last_unstale":"2024-09-18T02:07:51.360622+0000","last_undegraded":"2024-09-18T02:07:51.360622+0000","last_fullsized":"2024-09-18T02:07:51.360622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.360360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.360360+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.360360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:21:46.176795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.378920+0000","last_change":"2024-09-18T02:04:03.602001+0000","last_active":"2024-09-18T02:07:43.378920+0000","last_peered":"2024-09-18T02:07:43.378920+0000","last_clean":"2024-09-18T02:07:43.378920+0000","last_became_active":"2024-09-18T02:04:03.600467+0000","last_became_peered":"2024-09-18T02:04:03.600467+0000","last_unstale":"2024-09-18T02:07:43.378920+0000","last_undegraded":"2024-09-18T02:07:43.378920+0000","last_fullsized":"2024-09-18T02:07:43.378920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.891970+0000","last_change":"2024-09-18T02:08:00.892026+0000","last_active":"2024-09-18T02:08:00.891970+0000","last_peered":"2024-09-18T02:08:00.891970+0000","last_clean":"2024-09-18T02:08:00.891970+0000","last_became_active":"2024-09-18T02:04:05.592934+0000","last_became_peered":"2024-09-18T02:04:05.592934+0000","last_unstale":"2024-09-18T02:08:00.891970+0000","last_undegraded":"2024-09-18T02:08:00.891970+0000","last_fullsized":"2024-09-18T02:08:00.891970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:00.891781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:00.891781+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.891781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:40.385945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:36.337063+0000","last_change":"2024-09-18T02:04:07.624771+0000","last_active":"2024-09-18T02:06:36.337063+0000","last_peered":"2024-09-18T02:06:36.337063+0000","last_clean":"2024-09-18T02:06:36.337063+0000","last_became_active":"2024-09-18T02:04:07.624106+0000","last_became_peered":"2024-09-18T02:04:07.624106+0000","last_unstale":"2024-09-18T02:06:36.337063+0000","last_undegraded":"2024-09-18T02:06:36.337063+0000","last_fullsized":"2024-09-18T02:06:36.337063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.338105+0000","last_change":"2024-09-18T02:03:59.556933+0000","last_active":"2024-09-18T02:06:26.338105+0000","last_peered":"2024-09-18T02:06:26.338105+0000","last_clean":"2024-09-18T02:06:26.338105+0000","last_became_active":"2024-09-18T02:03:59.555956+0000","last_became_peered":"2024-09-18T02:03:59.555956+0000","last_unstale":"2024-09-18T02:06:26.338105+0000","last_undegraded":"2024-09-18T02:06:26.338105+0000","last_fullsized":"2024-09-18T02:06:26.338105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.334895+0000","last_change":"2024-09-18T02:03:57.523303+0000","last_active":"2024-09-18T02:06:21.334895+0000","last_peered":"2024-09-18T02:06:21.334895+0000","last_clean":"2024-09-18T02:06:21.334895+0000","last_became_active":"2024-09-18T02:03:57.523041+0000","last_became_peered":"2024-09-18T02:03:57.523041+0000","last_unstale":"2024-09-18T02:06:21.334895+0000","last_undegraded":"2024-09-18T02:06:21.334895+0000","last_fullsized":"2024-09-18T02:06:21.334895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:56.341443+0000","last_change":"2024-09-18T02:04:36.363414+0000","last_active":"2024-09-18T02:06:56.341443+0000","last_peered":"2024-09-18T02:06:56.341443+0000","last_clean":"2024-09-18T02:06:56.341443+0000","last_became_active":"2024-09-18T02:04:36.362592+0000","last_became_peered":"2024-09-18T02:04:36.362592+0000","last_unstale":"2024-09-18T02:06:56.341443+0000","last_undegraded":"2024-09-18T02:06:56.341443+0000","last_fullsized":"2024-09-18T02:06:56.341443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.117034+0000","last_change":"2024-09-18T02:07:50.117106+0000","last_active":"2024-09-18T02:07:50.117034+0000","last_peered":"2024-09-18T02:07:50.117034+0000","last_clean":"2024-09-18T02:07:50.117034+0000","last_became_active":"2024-09-18T02:04:03.579442+0000","last_became_peered":"2024-09-18T02:04:03.579442+0000","last_unstale":"2024-09-18T02:07:50.117034+0000","last_undegraded":"2024-09-18T02:07:50.117034+0000","last_fullsized":"2024-09-18T02:07:50.117034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-18T02:07:50.116825+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-18T02:07:50.116825+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.116825+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:28.484106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.808455+0000","last_change":"2024-09-18T02:08:04.808508+0000","last_active":"2024-09-18T02:08:04.808455+0000","last_peered":"2024-09-18T02:08:04.808455+0000","last_clean":"2024-09-18T02:08:04.808455+0000","last_became_active":"2024-09-18T02:04:05.605774+0000","last_became_peered":"2024-09-18T02:04:05.605774+0000","last_unstale":"2024-09-18T02:08:04.808455+0000","last_undegraded":"2024-09-18T02:08:04.808455+0000","last_fullsized":"2024-09-18T02:08:04.808455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:04.808264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:04.808264+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.808264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:41:47.654931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.890438+0000","last_change":"2024-09-18T02:04:07.610794+0000","last_active":"2024-09-18T02:07:11.890438+0000","last_peered":"2024-09-18T02:07:11.890438+0000","last_clean":"2024-09-18T02:07:11.890438+0000","last_became_active":"2024-09-18T02:04:07.610120+0000","last_became_peered":"2024-09-18T02:04:07.610120+0000","last_unstale":"2024-09-18T02:07:11.890438+0000","last_undegraded":"2024-09-18T02:07:11.890438+0000","last_fullsized":"2024-09-18T02:07:11.890438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'18","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.747536+0000","last_change":"2024-09-18T02:04:36.373755+0000","last_active":"2024-09-18T02:07:11.747536+0000","last_peered":"2024-09-18T02:07:11.747536+0000","last_clean":"2024-09-18T02:07:11.747536+0000","last_became_active":"2024-09-18T02:04:36.359108+0000","last_became_peered":"2024-09-18T02:04:36.359108+0000","last_unstale":"2024-09-18T02:07:11.747536+0000","last_undegraded":"2024-09-18T02:07:11.747536+0000","last_fullsized":"2024-09-18T02:07:11.747536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.390455+0000","last_change":"2024-09-18T02:03:57.533341+0000","last_active":"2024-09-18T02:07:43.390455+0000","last_peered":"2024-09-18T02:07:43.390455+0000","last_clean":"2024-09-18T02:07:43.390455+0000","last_became_active":"2024-09-18T02:03:57.533037+0000","last_became_peered":"2024-09-18T02:03:57.533037+0000","last_unstale":"2024-09-18T02:07:43.390455+0000","last_undegraded":"2024-09-18T02:07:43.390455+0000","last_fullsized":"2024-09-18T02:07:43.390455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.236175+0000","last_change":"2024-09-18T02:08:06.236244+0000","last_active":"2024-09-18T02:08:06.236175+0000","last_peered":"2024-09-18T02:08:06.236175+0000","last_clean":"2024-09-18T02:08:06.236175+0000","last_became_active":"2024-09-18T02:04:01.567287+0000","last_became_peered":"2024-09-18T02:04:01.567287+0000","last_unstale":"2024-09-18T02:08:06.236175+0000","last_undegraded":"2024-09-18T02:08:06.236175+0000","last_fullsized":"2024-09-18T02:08:06.236175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-18T02:08:06.235937+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-18T02:08:06.235937+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.235937+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:02.660438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'30","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.284405+0000","last_change":"2024-09-18T02:08:01.284486+0000","last_active":"2024-09-18T02:08:01.284405+0000","last_peered":"2024-09-18T02:08:01.284405+0000","last_clean":"2024-09-18T02:08:01.284405+0000","last_became_active":"2024-09-18T02:04:03.581092+0000","last_became_peered":"2024-09-18T02:04:03.581092+0000","last_unstale":"2024-09-18T02:08:01.284405+0000","last_undegraded":"2024-09-18T02:08:01.284405+0000","last_fullsized":"2024-09-18T02:08:01.284405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-09-18T02:08:01.284176+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-09-18T02:08:01.284176+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.284176+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:52.879851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.556287+0000","last_change":"2024-09-18T02:04:05.609076+0000","last_active":"2024-09-18T02:07:43.556287+0000","last_peered":"2024-09-18T02:07:43.556287+0000","last_clean":"2024-09-18T02:07:43.556287+0000","last_became_active":"2024-09-18T02:04:05.607733+0000","last_became_peered":"2024-09-18T02:04:05.607733+0000","last_unstale":"2024-09-18T02:07:43.556287+0000","last_undegraded":"2024-09-18T02:07:43.556287+0000","last_fullsized":"2024-09-18T02:07:43.556287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:41.339565+0000","last_change":"2024-09-18T02:04:07.631363+0000","last_active":"2024-09-18T02:06:41.339565+0000","last_peered":"2024-09-18T02:06:41.339565+0000","last_clean":"2024-09-18T02:06:41.339565+0000","last_became_active":"2024-09-18T02:04:07.630721+0000","last_became_peered":"2024-09-18T02:04:07.630721+0000","last_unstale":"2024-09-18T02:06:41.339565+0000","last_undegraded":"2024-09-18T02:06:41.339565+0000","last_fullsized":"2024-09-18T02:06:41.339565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.746653+0000","last_change":"2024-09-18T02:03:59.550519+0000","last_active":"2024-09-18T02:07:11.746653+0000","last_peered":"2024-09-18T02:07:11.746653+0000","last_clean":"2024-09-18T02:07:11.746653+0000","last_became_active":"2024-09-18T02:03:59.548365+0000","last_became_peered":"2024-09-18T02:03:59.548365+0000","last_unstale":"2024-09-18T02:07:11.746653+0000","last_undegraded":"2024-09-18T02:07:11.746653+0000","last_fullsized":"2024-09-18T02:07:11.746653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.390201+0000","last_change":"2024-09-18T02:03:57.521018+0000","last_active":"2024-09-18T02:07:43.390201+0000","last_peered":"2024-09-18T02:07:43.390201+0000","last_clean":"2024-09-18T02:07:43.390201+0000","last_became_active":"2024-09-18T02:03:57.520706+0000","last_became_peered":"2024-09-18T02:03:57.520706+0000","last_unstale":"2024-09-18T02:07:43.390201+0000","last_undegraded":"2024-09-18T02:07:43.390201+0000","last_fullsized":"2024-09-18T02:07:43.390201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.277690+0000","last_change":"2024-09-18T02:07:53.277755+0000","last_active":"2024-09-18T02:07:53.277690+0000","last_peered":"2024-09-18T02:07:53.277690+0000","last_clean":"2024-09-18T02:07:53.277690+0000","last_became_active":"2024-09-18T02:04:01.559249+0000","last_became_peered":"2024-09-18T02:04:01.559249+0000","last_unstale":"2024-09-18T02:07:53.277690+0000","last_undegraded":"2024-09-18T02:07:53.277690+0000","last_fullsized":"2024-09-18T02:07:53.277690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:07:53.277506+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:07:53.277506+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.277506+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:50.677514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'43","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.342497+0000","last_change":"2024-09-18T02:08:04.342570+0000","last_active":"2024-09-18T02:08:04.342497+0000","last_peered":"2024-09-18T02:08:04.342497+0000","last_clean":"2024-09-18T02:08:04.342497+0000","last_became_active":"2024-09-18T02:04:03.580310+0000","last_became_peered":"2024-09-18T02:04:03.580310+0000","last_unstale":"2024-09-18T02:08:04.342497+0000","last_undegraded":"2024-09-18T02:08:04.342497+0000","last_fullsized":"2024-09-18T02:08:04.342497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:04.342294+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:04.342294+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.342294+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:25.901859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":440,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.566731+0000","last_change":"2024-09-18T02:04:05.612525+0000","last_active":"2024-09-18T02:07:43.566731+0000","last_peered":"2024-09-18T02:07:43.566731+0000","last_clean":"2024-09-18T02:07:43.566731+0000","last_became_active":"2024-09-18T02:04:05.611707+0000","last_became_peered":"2024-09-18T02:04:05.611707+0000","last_unstale":"2024-09-18T02:07:43.566731+0000","last_undegraded":"2024-09-18T02:07:43.566731+0000","last_fullsized":"2024-09-18T02:07:43.566731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.227485+0000","last_change":"2024-09-18T02:08:05.227542+0000","last_active":"2024-09-18T02:08:05.227485+0000","last_peered":"2024-09-18T02:08:05.227485+0000","last_clean":"2024-09-18T02:08:05.227485+0000","last_became_active":"2024-09-18T02:03:59.559585+0000","last_became_peered":"2024-09-18T02:03:59.559585+0000","last_unstale":"2024-09-18T02:08:05.227485+0000","last_undegraded":"2024-09-18T02:08:05.227485+0000","last_fullsized":"2024-09-18T02:08:05.227485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:05.227308+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:05.227308+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.227308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:31.984980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.034295+0000","last_change":"2024-09-18T02:03:57.528019+0000","last_active":"2024-09-18T02:07:12.034295+0000","last_peered":"2024-09-18T02:07:12.034295+0000","last_clean":"2024-09-18T02:07:12.034295+0000","last_became_active":"2024-09-18T02:03:57.527575+0000","last_became_peered":"2024-09-18T02:03:57.527575+0000","last_unstale":"2024-09-18T02:07:12.034295+0000","last_undegraded":"2024-09-18T02:07:12.034295+0000","last_fullsized":"2024-09-18T02:07:12.034295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.936086+0000","last_change":"2024-09-18T02:07:58.936141+0000","last_active":"2024-09-18T02:07:58.936086+0000","last_peered":"2024-09-18T02:07:58.936086+0000","last_clean":"2024-09-18T02:07:58.936086+0000","last_became_active":"2024-09-18T02:04:01.569301+0000","last_became_peered":"2024-09-18T02:04:01.569301+0000","last_unstale":"2024-09-18T02:07:58.936086+0000","last_undegraded":"2024-09-18T02:07:58.936086+0000","last_fullsized":"2024-09-18T02:07:58.936086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:58.935889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:58.935889+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.935889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:18.769091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'58","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.362195+0000","last_change":"2024-09-18T02:07:56.362296+0000","last_active":"2024-09-18T02:07:56.362195+0000","last_peered":"2024-09-18T02:07:56.362195+0000","last_clean":"2024-09-18T02:07:56.362195+0000","last_became_active":"2024-09-18T02:04:03.591195+0000","last_became_peered":"2024-09-18T02:04:03.591195+0000","last_unstale":"2024-09-18T02:07:56.362195+0000","last_undegraded":"2024-09-18T02:07:56.362195+0000","last_fullsized":"2024-09-18T02:07:56.362195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'58","last_scrub_stamp":"2024-09-18T02:07:56.361976+0000","last_deep_scrub":"32'58","last_deep_scrub_stamp":"2024-09-18T02:07:56.361976+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.361976+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:50:55.705307+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.187554+0000","last_change":"2024-09-18T02:07:59.187610+0000","last_active":"2024-09-18T02:07:59.187554+0000","last_peered":"2024-09-18T02:07:59.187554+0000","last_clean":"2024-09-18T02:07:59.187554+0000","last_became_active":"2024-09-18T02:04:05.605611+0000","last_became_peered":"2024-09-18T02:04:05.605611+0000","last_unstale":"2024-09-18T02:07:59.187554+0000","last_undegraded":"2024-09-18T02:07:59.187554+0000","last_fullsized":"2024-09-18T02:07:59.187554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:59.187354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:59.187354+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.187354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:48.634059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.333804+0000","last_change":"2024-09-18T02:04:07.630472+0000","last_active":"2024-09-18T02:06:16.333804+0000","last_peered":"2024-09-18T02:06:16.333804+0000","last_clean":"2024-09-18T02:06:16.333804+0000","last_became_active":"2024-09-18T02:04:07.628247+0000","last_became_peered":"2024-09-18T02:04:07.628247+0000","last_unstale":"2024-09-18T02:06:16.333804+0000","last_undegraded":"2024-09-18T02:06:16.333804+0000","last_fullsized":"2024-09-18T02:06:16.333804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.331089+0000","last_change":"2024-09-18T02:03:59.535593+0000","last_active":"2024-09-18T02:06:11.331089+0000","last_peered":"2024-09-18T02:06:11.331089+0000","last_clean":"2024-09-18T02:06:11.331089+0000","last_became_active":"2024-09-18T02:03:59.535217+0000","last_became_peered":"2024-09-18T02:03:59.535217+0000","last_unstale":"2024-09-18T02:06:11.331089+0000","last_undegraded":"2024-09-18T02:06:11.331089+0000","last_fullsized":"2024-09-18T02:06:11.331089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.333914+0000","last_change":"2024-09-18T02:03:57.529038+0000","last_active":"2024-09-18T02:06:16.333914+0000","last_peered":"2024-09-18T02:06:16.333914+0000","last_clean":"2024-09-18T02:06:16.333914+0000","last_became_active":"2024-09-18T02:03:57.528006+0000","last_became_peered":"2024-09-18T02:03:57.528006+0000","last_unstale":"2024-09-18T02:06:16.333914+0000","last_undegraded":"2024-09-18T02:06:16.333914+0000","last_fullsized":"2024-09-18T02:06:16.333914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:46.340616+0000","last_change":"2024-09-18T02:04:36.358966+0000","last_active":"2024-09-18T02:06:46.340616+0000","last_peered":"2024-09-18T02:06:46.340616+0000","last_clean":"2024-09-18T02:06:46.340616+0000","last_became_active":"2024-09-18T02:04:36.357607+0000","last_became_peered":"2024-09-18T02:04:36.357607+0000","last_unstale":"2024-09-18T02:06:46.340616+0000","last_undegraded":"2024-09-18T02:06:46.340616+0000","last_fullsized":"2024-09-18T02:06:46.340616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'39","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.530057+0000","last_change":"2024-09-18T02:04:03.604260+0000","last_active":"2024-09-18T02:07:43.530057+0000","last_peered":"2024-09-18T02:07:43.530057+0000","last_clean":"2024-09-18T02:07:43.530057+0000","last_became_active":"2024-09-18T02:04:03.601783+0000","last_became_peered":"2024-09-18T02:04:03.601783+0000","last_unstale":"2024-09-18T02:07:43.530057+0000","last_undegraded":"2024-09-18T02:07:43.530057+0000","last_fullsized":"2024-09-18T02:07:43.530057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.235904+0000","last_change":"2024-09-18T02:07:54.235959+0000","last_active":"2024-09-18T02:07:54.235904+0000","last_peered":"2024-09-18T02:07:54.235904+0000","last_clean":"2024-09-18T02:07:54.235904+0000","last_became_active":"2024-09-18T02:04:05.577665+0000","last_became_peered":"2024-09-18T02:04:05.577665+0000","last_unstale":"2024-09-18T02:07:54.235904+0000","last_undegraded":"2024-09-18T02:07:54.235904+0000","last_fullsized":"2024-09-18T02:07:54.235904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.235697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.235697+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.235697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:59:25.686298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.332493+0000","last_change":"2024-09-18T02:04:07.621208+0000","last_active":"2024-09-18T02:06:16.332493+0000","last_peered":"2024-09-18T02:06:16.332493+0000","last_clean":"2024-09-18T02:06:16.332493+0000","last_became_active":"2024-09-18T02:04:07.619973+0000","last_became_peered":"2024-09-18T02:04:07.619973+0000","last_unstale":"2024-09-18T02:06:16.332493+0000","last_undegraded":"2024-09-18T02:06:16.332493+0000","last_fullsized":"2024-09-18T02:06:16.332493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.170650+0000","last_change":"2024-09-18T02:03:59.539493+0000","last_active":"2024-09-18T02:07:12.170650+0000","last_peered":"2024-09-18T02:07:12.170650+0000","last_clean":"2024-09-18T02:07:12.170650+0000","last_became_active":"2024-09-18T02:03:59.539105+0000","last_became_peered":"2024-09-18T02:03:59.539105+0000","last_unstale":"2024-09-18T02:07:12.170650+0000","last_undegraded":"2024-09-18T02:07:12.170650+0000","last_fullsized":"2024-09-18T02:07:12.170650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335530+0000","last_change":"2024-09-18T02:03:57.530707+0000","last_active":"2024-09-18T02:06:16.335530+0000","last_peered":"2024-09-18T02:06:16.335530+0000","last_clean":"2024-09-18T02:06:16.335530+0000","last_became_active":"2024-09-18T02:03:57.526327+0000","last_became_peered":"2024-09-18T02:03:57.526327+0000","last_unstale":"2024-09-18T02:06:16.335530+0000","last_undegraded":"2024-09-18T02:06:16.335530+0000","last_fullsized":"2024-09-18T02:06:16.335530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.331726+0000","last_change":"2024-09-18T02:04:01.562077+0000","last_active":"2024-09-18T02:06:16.331726+0000","last_peered":"2024-09-18T02:06:16.331726+0000","last_clean":"2024-09-18T02:06:16.331726+0000","last_became_active":"2024-09-18T02:04:01.561279+0000","last_became_peered":"2024-09-18T02:04:01.561279+0000","last_unstale":"2024-09-18T02:06:16.331726+0000","last_undegraded":"2024-09-18T02:06:16.331726+0000","last_fullsized":"2024-09-18T02:06:16.331726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'60","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.236352+0000","last_change":"2024-09-18T02:07:56.236436+0000","last_active":"2024-09-18T02:07:56.236352+0000","last_peered":"2024-09-18T02:07:56.236352+0000","last_clean":"2024-09-18T02:07:56.236352+0000","last_became_active":"2024-09-18T02:04:03.591705+0000","last_became_peered":"2024-09-18T02:04:03.591705+0000","last_unstale":"2024-09-18T02:07:56.236352+0000","last_undegraded":"2024-09-18T02:07:56.236352+0000","last_fullsized":"2024-09-18T02:07:56.236352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2024-09-18T02:07:56.236157+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2024-09-18T02:07:56.236157+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.236157+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:26.464832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":410,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.258443+0000","last_change":"2024-09-18T02:07:47.258507+0000","last_active":"2024-09-18T02:07:47.258443+0000","last_peered":"2024-09-18T02:07:47.258443+0000","last_clean":"2024-09-18T02:07:47.258443+0000","last_became_active":"2024-09-18T02:04:05.591652+0000","last_became_peered":"2024-09-18T02:04:05.591652+0000","last_unstale":"2024-09-18T02:07:47.258443+0000","last_undegraded":"2024-09-18T02:07:47.258443+0000","last_fullsized":"2024-09-18T02:07:47.258443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:47.258352+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:47.258352+0000","last_clean_scrub_stamp":"2024-09-18T02:07:47.258352+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:22.446528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.332946+0000","last_change":"2024-09-18T02:04:07.609950+0000","last_active":"2024-09-18T02:06:21.332946+0000","last_peered":"2024-09-18T02:06:21.332946+0000","last_clean":"2024-09-18T02:06:21.332946+0000","last_became_active":"2024-09-18T02:04:07.609050+0000","last_became_peered":"2024-09-18T02:04:07.609050+0000","last_unstale":"2024-09-18T02:06:21.332946+0000","last_undegraded":"2024-09-18T02:06:21.332946+0000","last_fullsized":"2024-09-18T02:06:21.332946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'14","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.170387+0000","last_change":"2024-09-18T02:03:59.532107+0000","last_active":"2024-09-18T02:07:12.170387+0000","last_peered":"2024-09-18T02:07:12.170387+0000","last_clean":"2024-09-18T02:07:12.170387+0000","last_became_active":"2024-09-18T02:03:59.531445+0000","last_became_peered":"2024-09-18T02:03:59.531445+0000","last_unstale":"2024-09-18T02:07:12.170387+0000","last_undegraded":"2024-09-18T02:07:12.170387+0000","last_fullsized":"2024-09-18T02:07:12.170387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.392323+0000","last_change":"2024-09-18T02:03:57.522436+0000","last_active":"2024-09-18T02:07:43.392323+0000","last_peered":"2024-09-18T02:07:43.392323+0000","last_clean":"2024-09-18T02:07:43.392323+0000","last_became_active":"2024-09-18T02:03:57.521858+0000","last_became_peered":"2024-09-18T02:03:57.521858+0000","last_unstale":"2024-09-18T02:07:43.392323+0000","last_undegraded":"2024-09-18T02:07:43.392323+0000","last_fullsized":"2024-09-18T02:07:43.392323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:46.340734+0000","last_change":"2024-09-18T02:04:36.357179+0000","last_active":"2024-09-18T02:06:46.340734+0000","last_peered":"2024-09-18T02:06:46.340734+0000","last_clean":"2024-09-18T02:06:46.340734+0000","last_became_active":"2024-09-18T02:04:36.356453+0000","last_became_peered":"2024-09-18T02:04:36.356453+0000","last_unstale":"2024-09-18T02:06:46.340734+0000","last_undegraded":"2024-09-18T02:06:46.340734+0000","last_fullsized":"2024-09-18T02:06:46.340734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'77","reported_seq":162,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.228280+0000","last_change":"2024-09-18T02:08:00.228384+0000","last_active":"2024-09-18T02:08:00.228280+0000","last_peered":"2024-09-18T02:08:00.228280+0000","last_clean":"2024-09-18T02:08:00.228280+0000","last_became_active":"2024-09-18T02:04:03.595618+0000","last_became_peered":"2024-09-18T02:04:03.595618+0000","last_unstale":"2024-09-18T02:08:00.228280+0000","last_undegraded":"2024-09-18T02:08:00.228280+0000","last_fullsized":"2024-09-18T02:08:00.228280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'77","last_scrub_stamp":"2024-09-18T02:08:00.228054+0000","last_deep_scrub":"32'77","last_deep_scrub_stamp":"2024-09-18T02:08:00.228054+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.228054+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:27.137267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.222664+0000","last_change":"2024-09-18T02:07:52.222718+0000","last_active":"2024-09-18T02:07:52.222664+0000","last_peered":"2024-09-18T02:07:52.222664+0000","last_clean":"2024-09-18T02:07:52.222664+0000","last_became_active":"2024-09-18T02:04:05.585272+0000","last_became_peered":"2024-09-18T02:04:05.585272+0000","last_unstale":"2024-09-18T02:07:52.222664+0000","last_undegraded":"2024-09-18T02:07:52.222664+0000","last_fullsized":"2024-09-18T02:07:52.222664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:52.222463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:52.222463+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.222463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:48.799896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.386126+0000","last_change":"2024-09-18T02:04:07.614915+0000","last_active":"2024-09-18T02:07:12.386126+0000","last_peered":"2024-09-18T02:07:12.386126+0000","last_clean":"2024-09-18T02:07:12.386126+0000","last_became_active":"2024-09-18T02:04:07.614232+0000","last_became_peered":"2024-09-18T02:04:07.614232+0000","last_unstale":"2024-09-18T02:07:12.386126+0000","last_undegraded":"2024-09-18T02:07:12.386126+0000","last_fullsized":"2024-09-18T02:07:12.386126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'18","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.170421+0000","last_change":"2024-09-18T02:03:59.546334+0000","last_active":"2024-09-18T02:07:12.170421+0000","last_peered":"2024-09-18T02:07:12.170421+0000","last_clean":"2024-09-18T02:07:12.170421+0000","last_became_active":"2024-09-18T02:03:59.545956+0000","last_became_peered":"2024-09-18T02:03:59.545956+0000","last_unstale":"2024-09-18T02:07:12.170421+0000","last_undegraded":"2024-09-18T02:07:12.170421+0000","last_fullsized":"2024-09-18T02:07:12.170421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.391302+0000","last_change":"2024-09-18T02:03:57.522159+0000","last_active":"2024-09-18T02:07:43.391302+0000","last_peered":"2024-09-18T02:07:43.391302+0000","last_clean":"2024-09-18T02:07:43.391302+0000","last_became_active":"2024-09-18T02:03:57.520036+0000","last_became_peered":"2024-09-18T02:03:57.520036+0000","last_unstale":"2024-09-18T02:07:43.391302+0000","last_undegraded":"2024-09-18T02:07:43.391302+0000","last_fullsized":"2024-09-18T02:07:43.391302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.295525+0000","last_change":"2024-09-18T02:08:05.295590+0000","last_active":"2024-09-18T02:08:05.295525+0000","last_peered":"2024-09-18T02:08:05.295525+0000","last_clean":"2024-09-18T02:08:05.295525+0000","last_became_active":"2024-09-18T02:04:01.573084+0000","last_became_peered":"2024-09-18T02:04:01.573084+0000","last_unstale":"2024-09-18T02:08:05.295525+0000","last_undegraded":"2024-09-18T02:08:05.295525+0000","last_fullsized":"2024-09-18T02:08:05.295525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:05.295326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:05.295326+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.295326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:26.816185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'46","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.074496+0000","last_change":"2024-09-18T02:07:54.074574+0000","last_active":"2024-09-18T02:07:54.074496+0000","last_peered":"2024-09-18T02:07:54.074496+0000","last_clean":"2024-09-18T02:07:54.074496+0000","last_became_active":"2024-09-18T02:04:03.565801+0000","last_became_peered":"2024-09-18T02:04:03.565801+0000","last_unstale":"2024-09-18T02:07:54.074496+0000","last_undegraded":"2024-09-18T02:07:54.074496+0000","last_fullsized":"2024-09-18T02:07:54.074496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-18T02:07:54.074277+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-18T02:07:54.074277+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.074277+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:23:20.641594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336955+0000","last_change":"2024-09-18T02:04:05.612592+0000","last_active":"2024-09-18T02:06:21.336955+0000","last_peered":"2024-09-18T02:06:21.336955+0000","last_clean":"2024-09-18T02:06:21.336955+0000","last_became_active":"2024-09-18T02:04:05.612052+0000","last_became_peered":"2024-09-18T02:04:05.612052+0000","last_unstale":"2024-09-18T02:06:21.336955+0000","last_undegraded":"2024-09-18T02:06:21.336955+0000","last_fullsized":"2024-09-18T02:06:21.336955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.328285+0000","last_change":"2024-09-18T02:04:07.622545+0000","last_active":"2024-09-18T02:07:12.328285+0000","last_peered":"2024-09-18T02:07:12.328285+0000","last_clean":"2024-09-18T02:07:12.328285+0000","last_became_active":"2024-09-18T02:04:07.622004+0000","last_became_peered":"2024-09-18T02:04:07.622004+0000","last_unstale":"2024-09-18T02:07:12.328285+0000","last_undegraded":"2024-09-18T02:07:12.328285+0000","last_fullsized":"2024-09-18T02:07:12.328285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.237757+0000","last_change":"2024-09-18T02:04:36.364542+0000","last_active":"2024-09-18T02:07:12.237757+0000","last_peered":"2024-09-18T02:07:12.237757+0000","last_clean":"2024-09-18T02:07:12.237757+0000","last_became_active":"2024-09-18T02:04:36.361748+0000","last_became_peered":"2024-09-18T02:04:36.361748+0000","last_unstale":"2024-09-18T02:07:12.237757+0000","last_undegraded":"2024-09-18T02:07:12.237757+0000","last_fullsized":"2024-09-18T02:07:12.237757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.389435+0000","last_change":"2024-09-18T02:03:57.530747+0000","last_active":"2024-09-18T02:07:43.389435+0000","last_peered":"2024-09-18T02:07:43.389435+0000","last_clean":"2024-09-18T02:07:43.389435+0000","last_became_active":"2024-09-18T02:03:57.526977+0000","last_became_peered":"2024-09-18T02:03:57.526977+0000","last_unstale":"2024-09-18T02:07:43.389435+0000","last_undegraded":"2024-09-18T02:07:43.389435+0000","last_fullsized":"2024-09-18T02:07:43.389435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.331773+0000","last_change":"2024-09-18T02:04:01.562995+0000","last_active":"2024-09-18T02:06:16.331773+0000","last_peered":"2024-09-18T02:06:16.331773+0000","last_clean":"2024-09-18T02:06:16.331773+0000","last_became_active":"2024-09-18T02:04:01.561913+0000","last_became_peered":"2024-09-18T02:04:01.561913+0000","last_unstale":"2024-09-18T02:06:16.331773+0000","last_undegraded":"2024-09-18T02:06:16.331773+0000","last_fullsized":"2024-09-18T02:06:16.331773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.280128+0000","last_change":"2024-09-18T02:08:02.280212+0000","last_active":"2024-09-18T02:08:02.280128+0000","last_peered":"2024-09-18T02:08:02.280128+0000","last_clean":"2024-09-18T02:08:02.280128+0000","last_became_active":"2024-09-18T02:04:03.580395+0000","last_became_peered":"2024-09-18T02:04:03.580395+0000","last_unstale":"2024-09-18T02:08:02.280128+0000","last_undegraded":"2024-09-18T02:08:02.280128+0000","last_fullsized":"2024-09-18T02:08:02.280128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-09-18T02:08:02.279903+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-09-18T02:08:02.279903+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.279903+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:12:22.758998+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":416,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.264889+0000","last_change":"2024-09-18T02:07:49.264976+0000","last_active":"2024-09-18T02:07:49.264889+0000","last_peered":"2024-09-18T02:07:49.264889+0000","last_clean":"2024-09-18T02:07:49.264889+0000","last_became_active":"2024-09-18T02:04:05.603548+0000","last_became_peered":"2024-09-18T02:04:05.603548+0000","last_unstale":"2024-09-18T02:07:49.264889+0000","last_undegraded":"2024-09-18T02:07:49.264889+0000","last_fullsized":"2024-09-18T02:07:49.264889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:49.264681+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:49.264681+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.264681+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:45:54.246439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.333472+0000","last_change":"2024-09-18T02:04:07.620770+0000","last_active":"2024-09-18T02:07:12.333472+0000","last_peered":"2024-09-18T02:07:12.333472+0000","last_clean":"2024-09-18T02:07:12.333472+0000","last_became_active":"2024-09-18T02:04:07.620094+0000","last_became_peered":"2024-09-18T02:04:07.620094+0000","last_unstale":"2024-09-18T02:07:12.333472+0000","last_undegraded":"2024-09-18T02:07:12.333472+0000","last_fullsized":"2024-09-18T02:07:12.333472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'14","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089891+0000","last_change":"2024-09-18T02:03:59.535067+0000","last_active":"2024-09-18T02:07:12.089891+0000","last_peered":"2024-09-18T02:07:12.089891+0000","last_clean":"2024-09-18T02:07:12.089891+0000","last_became_active":"2024-09-18T02:03:59.534547+0000","last_became_peered":"2024-09-18T02:03:59.534547+0000","last_unstale":"2024-09-18T02:07:12.089891+0000","last_undegraded":"2024-09-18T02:07:12.089891+0000","last_fullsized":"2024-09-18T02:07:12.089891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.334147+0000","last_change":"2024-09-18T02:03:57.526267+0000","last_active":"2024-09-18T02:06:11.334147+0000","last_peered":"2024-09-18T02:06:11.334147+0000","last_clean":"2024-09-18T02:06:11.334147+0000","last_became_active":"2024-09-18T02:03:57.525576+0000","last_became_peered":"2024-09-18T02:03:57.525576+0000","last_unstale":"2024-09-18T02:06:11.334147+0000","last_undegraded":"2024-09-18T02:06:11.334147+0000","last_fullsized":"2024-09-18T02:06:11.334147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.935978+0000","last_change":"2024-09-18T02:07:59.936130+0000","last_active":"2024-09-18T02:07:59.935978+0000","last_peered":"2024-09-18T02:07:59.935978+0000","last_clean":"2024-09-18T02:07:59.935978+0000","last_became_active":"2024-09-18T02:04:01.564385+0000","last_became_peered":"2024-09-18T02:04:01.564385+0000","last_unstale":"2024-09-18T02:07:59.935978+0000","last_undegraded":"2024-09-18T02:07:59.935978+0000","last_fullsized":"2024-09-18T02:07:59.935978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-18T02:07:59.935730+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-18T02:07:59.935730+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.935730+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:04.466951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336818+0000","last_change":"2024-09-18T02:04:03.601350+0000","last_active":"2024-09-18T02:06:21.336818+0000","last_peered":"2024-09-18T02:06:21.336818+0000","last_clean":"2024-09-18T02:06:21.336818+0000","last_became_active":"2024-09-18T02:04:03.600545+0000","last_became_peered":"2024-09-18T02:04:03.600545+0000","last_unstale":"2024-09-18T02:06:21.336818+0000","last_undegraded":"2024-09-18T02:06:21.336818+0000","last_fullsized":"2024-09-18T02:06:21.336818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":472,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.115817+0000","last_change":"2024-09-18T02:07:47.115885+0000","last_active":"2024-09-18T02:07:47.115817+0000","last_peered":"2024-09-18T02:07:47.115817+0000","last_clean":"2024-09-18T02:07:47.115817+0000","last_became_active":"2024-09-18T02:04:05.582127+0000","last_became_peered":"2024-09-18T02:04:05.582127+0000","last_unstale":"2024-09-18T02:07:47.115817+0000","last_undegraded":"2024-09-18T02:07:47.115817+0000","last_fullsized":"2024-09-18T02:07:47.115817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:47.115624+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:47.115624+0000","last_clean_scrub_stamp":"2024-09-18T02:07:47.115624+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:34:41.967979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.332641+0000","last_change":"2024-09-18T02:07:55.332802+0000","last_active":"2024-09-18T02:07:55.332641+0000","last_peered":"2024-09-18T02:07:55.332641+0000","last_clean":"2024-09-18T02:07:55.332641+0000","last_became_active":"2024-09-18T02:04:07.602985+0000","last_became_peered":"2024-09-18T02:04:07.602985+0000","last_unstale":"2024-09-18T02:07:55.332641+0000","last_undegraded":"2024-09-18T02:07:55.332641+0000","last_fullsized":"2024-09-18T02:07:55.332641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:07:55.332416+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:07:55.332416+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.332416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:19:15.933538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.332595+0000","last_change":"2024-09-18T02:03:59.555188+0000","last_active":"2024-09-18T02:06:16.332595+0000","last_peered":"2024-09-18T02:06:16.332595+0000","last_clean":"2024-09-18T02:06:16.332595+0000","last_became_active":"2024-09-18T02:03:59.554711+0000","last_became_peered":"2024-09-18T02:03:59.554711+0000","last_unstale":"2024-09-18T02:06:16.332595+0000","last_undegraded":"2024-09-18T02:06:16.332595+0000","last_fullsized":"2024-09-18T02:06:16.332595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.334035+0000","last_change":"2024-09-18T02:03:57.531537+0000","last_active":"2024-09-18T02:06:11.334035+0000","last_peered":"2024-09-18T02:06:11.334035+0000","last_clean":"2024-09-18T02:06:11.334035+0000","last_became_active":"2024-09-18T02:03:57.531156+0000","last_became_peered":"2024-09-18T02:03:57.531156+0000","last_unstale":"2024-09-18T02:06:11.334035+0000","last_undegraded":"2024-09-18T02:06:11.334035+0000","last_fullsized":"2024-09-18T02:06:11.334035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.368730+0000","last_change":"2024-09-18T02:07:49.368784+0000","last_active":"2024-09-18T02:07:49.368730+0000","last_peered":"2024-09-18T02:07:49.368730+0000","last_clean":"2024-09-18T02:07:49.368730+0000","last_became_active":"2024-09-18T02:04:01.565999+0000","last_became_peered":"2024-09-18T02:04:01.565999+0000","last_unstale":"2024-09-18T02:07:49.368730+0000","last_undegraded":"2024-09-18T02:07:49.368730+0000","last_fullsized":"2024-09-18T02:07:49.368730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:49.368530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:49.368530+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.368530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:09.588349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'51","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.029530+0000","last_change":"2024-09-18T02:07:55.029622+0000","last_active":"2024-09-18T02:07:55.029530+0000","last_peered":"2024-09-18T02:07:55.029530+0000","last_clean":"2024-09-18T02:07:55.029530+0000","last_became_active":"2024-09-18T02:04:03.564021+0000","last_became_peered":"2024-09-18T02:04:03.564021+0000","last_unstale":"2024-09-18T02:07:55.029530+0000","last_undegraded":"2024-09-18T02:07:55.029530+0000","last_fullsized":"2024-09-18T02:07:55.029530+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-18T02:07:55.029350+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-18T02:07:55.029350+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.029350+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:45.011710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.315959+0000","last_change":"2024-09-18T02:07:51.316073+0000","last_active":"2024-09-18T02:07:51.315959+0000","last_peered":"2024-09-18T02:07:51.315959+0000","last_clean":"2024-09-18T02:07:51.315959+0000","last_became_active":"2024-09-18T02:04:05.610024+0000","last_became_peered":"2024-09-18T02:04:05.610024+0000","last_unstale":"2024-09-18T02:07:51.315959+0000","last_undegraded":"2024-09-18T02:07:51.315959+0000","last_fullsized":"2024-09-18T02:07:51.315959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.315728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.315728+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.315728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:32.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.380677+0000","last_change":"2024-09-18T02:04:07.619059+0000","last_active":"2024-09-18T02:07:12.380677+0000","last_peered":"2024-09-18T02:07:12.380677+0000","last_clean":"2024-09-18T02:07:12.380677+0000","last_became_active":"2024-09-18T02:04:07.618153+0000","last_became_peered":"2024-09-18T02:04:07.618153+0000","last_unstale":"2024-09-18T02:07:12.380677+0000","last_undegraded":"2024-09-18T02:07:12.380677+0000","last_fullsized":"2024-09-18T02:07:12.380677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.208762+0000","last_change":"2024-09-18T02:08:03.208888+0000","last_active":"2024-09-18T02:08:03.208762+0000","last_peered":"2024-09-18T02:08:03.208762+0000","last_clean":"2024-09-18T02:08:03.208762+0000","last_became_active":"2024-09-18T02:03:59.559592+0000","last_became_peered":"2024-09-18T02:03:59.559592+0000","last_unstale":"2024-09-18T02:08:03.208762+0000","last_undegraded":"2024-09-18T02:08:03.208762+0000","last_fullsized":"2024-09-18T02:08:03.208762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:03.208545+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:03.208545+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.208545+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:46:49.036536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":205,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.352255+0000","last_change":"2024-09-18T02:03:43.338768+0000","last_active":"2024-09-18T02:07:46.352255+0000","last_peered":"2024-09-18T02:07:46.352255+0000","last_clean":"2024-09-18T02:07:46.352255+0000","last_became_active":"2024-09-18T02:03:43.336731+0000","last_became_peered":"2024-09-18T02:03:43.336731+0000","last_unstale":"2024-09-18T02:07:46.352255+0000","last_undegraded":"2024-09-18T02:07:46.352255+0000","last_fullsized":"2024-09-18T02:07:46.352255+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_clean_scrub_stamp":"2024-09-18T02:03:42.235832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995860+0000","last_change":"2024-09-18T02:03:50.287984+0000","last_active":"2024-09-18T02:07:47.995860+0000","last_peered":"2024-09-18T02:07:47.995860+0000","last_clean":"2024-09-18T02:07:47.995860+0000","last_became_active":"2024-09-18T02:03:48.273444+0000","last_became_peered":"2024-09-18T02:03:48.273444+0000","last_unstale":"2024-09-18T02:07:47.995860+0000","last_undegraded":"2024-09-18T02:07:47.995860+0000","last_fullsized":"2024-09-18T02:07:47.995860+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024299339999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.054556+0000","last_change":"2024-09-18T02:03:57.533463+0000","last_active":"2024-09-18T02:06:11.054556+0000","last_peered":"2024-09-18T02:06:11.054556+0000","last_clean":"2024-09-18T02:06:11.054556+0000","last_became_active":"2024-09-18T02:03:57.532844+0000","last_became_peered":"2024-09-18T02:03:57.532844+0000","last_unstale":"2024-09-18T02:06:11.054556+0000","last_undegraded":"2024-09-18T02:06:11.054556+0000","last_fullsized":"2024-09-18T02:06:11.054556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.878042+0000","last_change":"2024-09-18T02:08:01.878096+0000","last_active":"2024-09-18T02:08:01.878042+0000","last_peered":"2024-09-18T02:08:01.878042+0000","last_clean":"2024-09-18T02:08:01.878042+0000","last_became_active":"2024-09-18T02:04:01.563633+0000","last_became_peered":"2024-09-18T02:04:01.563633+0000","last_unstale":"2024-09-18T02:08:01.878042+0000","last_undegraded":"2024-09-18T02:08:01.878042+0000","last_fullsized":"2024-09-18T02:08:01.878042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:01.877846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:01.877846+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.877846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:32.131376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'94","reported_seq":182,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.484420+0000","last_change":"2024-09-18T02:04:03.607393+0000","last_active":"2024-09-18T02:07:43.484420+0000","last_peered":"2024-09-18T02:07:43.484420+0000","last_clean":"2024-09-18T02:07:43.484420+0000","last_became_active":"2024-09-18T02:04:03.606800+0000","last_became_peered":"2024-09-18T02:04:03.606800+0000","last_unstale":"2024-09-18T02:07:43.484420+0000","last_undegraded":"2024-09-18T02:07:43.484420+0000","last_fullsized":"2024-09-18T02:07:43.484420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.275891+0000","last_change":"2024-09-18T02:07:50.275953+0000","last_active":"2024-09-18T02:07:50.275891+0000","last_peered":"2024-09-18T02:07:50.275891+0000","last_clean":"2024-09-18T02:07:50.275891+0000","last_became_active":"2024-09-18T02:04:05.588568+0000","last_became_peered":"2024-09-18T02:04:05.588568+0000","last_unstale":"2024-09-18T02:07:50.275891+0000","last_undegraded":"2024-09-18T02:07:50.275891+0000","last_fullsized":"2024-09-18T02:07:50.275891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:50.275701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:50.275701+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.275701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:23:16.843019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":164,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.257193+0000","last_change":"2024-09-18T02:04:07.628613+0000","last_active":"2024-09-18T02:07:12.257193+0000","last_peered":"2024-09-18T02:07:12.257193+0000","last_clean":"2024-09-18T02:07:12.257193+0000","last_became_active":"2024-09-18T02:04:07.613914+0000","last_became_peered":"2024-09-18T02:04:07.613914+0000","last_unstale":"2024-09-18T02:07:12.257193+0000","last_undegraded":"2024-09-18T02:07:12.257193+0000","last_fullsized":"2024-09-18T02:07:12.257193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.170518+0000","last_change":"2024-09-18T02:03:59.556174+0000","last_active":"2024-09-18T02:07:12.170518+0000","last_peered":"2024-09-18T02:07:12.170518+0000","last_clean":"2024-09-18T02:07:12.170518+0000","last_became_active":"2024-09-18T02:03:59.555801+0000","last_became_peered":"2024-09-18T02:03:59.555801+0000","last_unstale":"2024-09-18T02:07:12.170518+0000","last_undegraded":"2024-09-18T02:07:12.170518+0000","last_fullsized":"2024-09-18T02:07:12.170518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995825+0000","last_change":"2024-09-18T02:03:50.285797+0000","last_active":"2024-09-18T02:07:47.995825+0000","last_peered":"2024-09-18T02:07:47.995825+0000","last_clean":"2024-09-18T02:07:47.995825+0000","last_became_active":"2024-09-18T02:03:48.275709+0000","last_became_peered":"2024-09-18T02:03:48.275709+0000","last_unstale":"2024-09-18T02:07:47.995825+0000","last_undegraded":"2024-09-18T02:07:47.995825+0000","last_fullsized":"2024-09-18T02:07:47.995825+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047579399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329165+0000","last_change":"2024-09-18T02:03:57.521576+0000","last_active":"2024-09-18T02:06:06.329165+0000","last_peered":"2024-09-18T02:06:06.329165+0000","last_clean":"2024-09-18T02:06:06.329165+0000","last_became_active":"2024-09-18T02:03:57.520559+0000","last_became_peered":"2024-09-18T02:03:57.520559+0000","last_unstale":"2024-09-18T02:06:06.329165+0000","last_undegraded":"2024-09-18T02:06:06.329165+0000","last_fullsized":"2024-09-18T02:06:06.329165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.201375+0000","last_change":"2024-09-18T02:07:55.201427+0000","last_active":"2024-09-18T02:07:55.201375+0000","last_peered":"2024-09-18T02:07:55.201375+0000","last_clean":"2024-09-18T02:07:55.201375+0000","last_became_active":"2024-09-18T02:04:01.561194+0000","last_became_peered":"2024-09-18T02:04:01.561194+0000","last_unstale":"2024-09-18T02:07:55.201375+0000","last_undegraded":"2024-09-18T02:07:55.201375+0000","last_fullsized":"2024-09-18T02:07:55.201375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:55.201180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:55.201180+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.201180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:25.554052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'297","reported_seq":529,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.127041+0000","last_change":"2024-09-18T02:07:51.127133+0000","last_active":"2024-09-18T02:07:51.127041+0000","last_peered":"2024-09-18T02:07:51.127041+0000","last_clean":"2024-09-18T02:07:51.127041+0000","last_became_active":"2024-09-18T02:04:03.570288+0000","last_became_peered":"2024-09-18T02:04:03.570288+0000","last_unstale":"2024-09-18T02:07:51.127041+0000","last_undegraded":"2024-09-18T02:07:51.127041+0000","last_fullsized":"2024-09-18T02:07:51.127041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'297","last_scrub_stamp":"2024-09-18T02:07:51.126820+0000","last_deep_scrub":"32'297","last_deep_scrub_stamp":"2024-09-18T02:07:51.126820+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.126820+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:09:07.313670+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.334316+0000","last_change":"2024-09-18T02:04:05.609826+0000","last_active":"2024-09-18T02:06:11.334316+0000","last_peered":"2024-09-18T02:06:11.334316+0000","last_clean":"2024-09-18T02:06:11.334316+0000","last_became_active":"2024-09-18T02:04:05.608544+0000","last_became_peered":"2024-09-18T02:04:05.608544+0000","last_unstale":"2024-09-18T02:06:11.334316+0000","last_undegraded":"2024-09-18T02:06:11.334316+0000","last_fullsized":"2024-09-18T02:06:11.334316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.229719+0000","last_change":"2024-09-18T02:04:07.624305+0000","last_active":"2024-09-18T02:07:12.229719+0000","last_peered":"2024-09-18T02:07:12.229719+0000","last_clean":"2024-09-18T02:07:12.229719+0000","last_became_active":"2024-09-18T02:04:07.622337+0000","last_became_peered":"2024-09-18T02:04:07.622337+0000","last_unstale":"2024-09-18T02:07:12.229719+0000","last_undegraded":"2024-09-18T02:07:12.229719+0000","last_fullsized":"2024-09-18T02:07:12.229719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.169676+0000","last_change":"2024-09-18T02:03:59.549829+0000","last_active":"2024-09-18T02:07:12.169676+0000","last_peered":"2024-09-18T02:07:12.169676+0000","last_clean":"2024-09-18T02:07:12.169676+0000","last_became_active":"2024-09-18T02:03:59.548308+0000","last_became_peered":"2024-09-18T02:03:59.548308+0000","last_unstale":"2024-09-18T02:07:12.169676+0000","last_undegraded":"2024-09-18T02:07:12.169676+0000","last_fullsized":"2024-09-18T02:07:12.169676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.548260+0000","last_change":"2024-09-18T02:03:50.338272+0000","last_active":"2024-09-18T02:07:47.548260+0000","last_peered":"2024-09-18T02:07:47.548260+0000","last_clean":"2024-09-18T02:07:47.548260+0000","last_became_active":"2024-09-18T02:03:48.275609+0000","last_became_peered":"2024-09-18T02:03:48.275609+0000","last_unstale":"2024-09-18T02:07:47.548260+0000","last_undegraded":"2024-09-18T02:07:47.548260+0000","last_fullsized":"2024-09-18T02:07:47.548260+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067244799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.658570+0000","last_change":"2024-09-18T02:03:57.520998+0000","last_active":"2024-09-18T02:07:46.658570+0000","last_peered":"2024-09-18T02:07:46.658570+0000","last_clean":"2024-09-18T02:07:46.658570+0000","last_became_active":"2024-09-18T02:03:57.520103+0000","last_became_peered":"2024-09-18T02:03:57.520103+0000","last_unstale":"2024-09-18T02:07:46.658570+0000","last_undegraded":"2024-09-18T02:07:46.658570+0000","last_fullsized":"2024-09-18T02:07:46.658570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.332769+0000","last_change":"2024-09-18T02:04:01.560743+0000","last_active":"2024-09-18T02:06:11.332769+0000","last_peered":"2024-09-18T02:06:11.332769+0000","last_clean":"2024-09-18T02:06:11.332769+0000","last_became_active":"2024-09-18T02:04:01.560471+0000","last_became_peered":"2024-09-18T02:04:01.560471+0000","last_unstale":"2024-09-18T02:06:11.332769+0000","last_undegraded":"2024-09-18T02:06:11.332769+0000","last_fullsized":"2024-09-18T02:06:11.332769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'24","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.320375+0000","last_change":"2024-09-18T02:07:57.320487+0000","last_active":"2024-09-18T02:07:57.320375+0000","last_peered":"2024-09-18T02:07:57.320375+0000","last_clean":"2024-09-18T02:07:57.320375+0000","last_became_active":"2024-09-18T02:04:03.588913+0000","last_became_peered":"2024-09-18T02:04:03.588913+0000","last_unstale":"2024-09-18T02:07:57.320375+0000","last_undegraded":"2024-09-18T02:07:57.320375+0000","last_fullsized":"2024-09-18T02:07:57.320375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-18T02:07:57.320158+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-18T02:07:57.320158+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.320158+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:35.687439+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.317557+0000","last_change":"2024-09-18T02:07:49.317671+0000","last_active":"2024-09-18T02:07:49.317557+0000","last_peered":"2024-09-18T02:07:49.317557+0000","last_clean":"2024-09-18T02:07:49.317557+0000","last_became_active":"2024-09-18T02:04:05.588457+0000","last_became_peered":"2024-09-18T02:04:05.588457+0000","last_unstale":"2024-09-18T02:07:49.317557+0000","last_undegraded":"2024-09-18T02:07:49.317557+0000","last_fullsized":"2024-09-18T02:07:49.317557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:49.317338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:49.317338+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.317338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:39.956466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.337980+0000","last_change":"2024-09-18T02:04:07.622460+0000","last_active":"2024-09-18T02:06:26.337980+0000","last_peered":"2024-09-18T02:06:26.337980+0000","last_clean":"2024-09-18T02:06:26.337980+0000","last_became_active":"2024-09-18T02:04:07.621651+0000","last_became_peered":"2024-09-18T02:04:07.621651+0000","last_unstale":"2024-09-18T02:06:26.337980+0000","last_undegraded":"2024-09-18T02:06:26.337980+0000","last_fullsized":"2024-09-18T02:06:26.337980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329349+0000","last_change":"2024-09-18T02:03:59.536526+0000","last_active":"2024-09-18T02:06:06.329349+0000","last_peered":"2024-09-18T02:06:06.329349+0000","last_clean":"2024-09-18T02:06:06.329349+0000","last_became_active":"2024-09-18T02:03:59.535693+0000","last_became_peered":"2024-09-18T02:03:59.535693+0000","last_unstale":"2024-09-18T02:06:06.329349+0000","last_undegraded":"2024-09-18T02:06:06.329349+0000","last_fullsized":"2024-09-18T02:06:06.329349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995847+0000","last_change":"2024-09-18T02:03:50.287790+0000","last_active":"2024-09-18T02:07:47.995847+0000","last_peered":"2024-09-18T02:07:47.995847+0000","last_clean":"2024-09-18T02:07:47.995847+0000","last_became_active":"2024-09-18T02:03:48.276543+0000","last_became_peered":"2024-09-18T02:03:48.276543+0000","last_unstale":"2024-09-18T02:07:47.995847+0000","last_undegraded":"2024-09-18T02:07:47.995847+0000","last_fullsized":"2024-09-18T02:07:47.995847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023330579999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.331410+0000","last_change":"2024-09-18T02:03:57.529138+0000","last_active":"2024-09-18T02:06:06.331410+0000","last_peered":"2024-09-18T02:06:06.331410+0000","last_clean":"2024-09-18T02:06:06.331410+0000","last_became_active":"2024-09-18T02:03:57.528828+0000","last_became_peered":"2024-09-18T02:03:57.528828+0000","last_unstale":"2024-09-18T02:06:06.331410+0000","last_undegraded":"2024-09-18T02:06:06.331410+0000","last_fullsized":"2024-09-18T02:06:06.331410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.216690+0000","last_change":"2024-09-18T02:08:04.216748+0000","last_active":"2024-09-18T02:08:04.216690+0000","last_peered":"2024-09-18T02:08:04.216690+0000","last_clean":"2024-09-18T02:08:04.216690+0000","last_became_active":"2024-09-18T02:04:01.571608+0000","last_became_peered":"2024-09-18T02:04:01.571608+0000","last_unstale":"2024-09-18T02:08:04.216690+0000","last_undegraded":"2024-09-18T02:08:04.216690+0000","last_fullsized":"2024-09-18T02:08:04.216690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:04.216468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:04.216468+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.216468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:07:30.815787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.170773+0000","last_change":"2024-09-18T02:04:03.602343+0000","last_active":"2024-09-18T02:07:11.170773+0000","last_peered":"2024-09-18T02:07:11.170773+0000","last_clean":"2024-09-18T02:07:11.170773+0000","last_became_active":"2024-09-18T02:04:03.601140+0000","last_became_peered":"2024-09-18T02:04:03.601140+0000","last_unstale":"2024-09-18T02:07:11.170773+0000","last_undegraded":"2024-09-18T02:07:11.170773+0000","last_fullsized":"2024-09-18T02:07:11.170773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335657+0000","last_change":"2024-09-18T02:04:05.612576+0000","last_active":"2024-09-18T02:06:16.335657+0000","last_peered":"2024-09-18T02:06:16.335657+0000","last_clean":"2024-09-18T02:06:16.335657+0000","last_became_active":"2024-09-18T02:04:05.612007+0000","last_became_peered":"2024-09-18T02:04:05.612007+0000","last_unstale":"2024-09-18T02:06:16.335657+0000","last_undegraded":"2024-09-18T02:06:16.335657+0000","last_fullsized":"2024-09-18T02:06:16.335657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.333457+0000","last_change":"2024-09-18T02:04:07.623097+0000","last_active":"2024-09-18T02:06:21.333457+0000","last_peered":"2024-09-18T02:06:21.333457+0000","last_clean":"2024-09-18T02:06:21.333457+0000","last_became_active":"2024-09-18T02:04:07.622247+0000","last_became_peered":"2024-09-18T02:04:07.622247+0000","last_unstale":"2024-09-18T02:06:21.333457+0000","last_undegraded":"2024-09-18T02:06:21.333457+0000","last_fullsized":"2024-09-18T02:06:21.333457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.969381+0000","last_change":"2024-09-18T02:03:59.560066+0000","last_active":"2024-09-18T02:06:06.969381+0000","last_peered":"2024-09-18T02:06:06.969381+0000","last_clean":"2024-09-18T02:06:06.969381+0000","last_became_active":"2024-09-18T02:03:59.559749+0000","last_became_peered":"2024-09-18T02:03:59.559749+0000","last_unstale":"2024-09-18T02:06:06.969381+0000","last_undegraded":"2024-09-18T02:06:06.969381+0000","last_fullsized":"2024-09-18T02:06:06.969381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.331493+0000","last_change":"2024-09-18T02:03:57.524455+0000","last_active":"2024-09-18T02:06:06.331493+0000","last_peered":"2024-09-18T02:06:06.331493+0000","last_clean":"2024-09-18T02:06:06.331493+0000","last_became_active":"2024-09-18T02:03:57.519961+0000","last_became_peered":"2024-09-18T02:03:57.519961+0000","last_unstale":"2024-09-18T02:06:06.331493+0000","last_undegraded":"2024-09-18T02:06:06.331493+0000","last_fullsized":"2024-09-18T02:06:06.331493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.658366+0000","last_change":"2024-09-18T02:03:50.282381+0000","last_active":"2024-09-18T02:07:46.658366+0000","last_peered":"2024-09-18T02:07:46.658366+0000","last_clean":"2024-09-18T02:07:46.658366+0000","last_became_active":"2024-09-18T02:03:48.274657+0000","last_became_peered":"2024-09-18T02:03:48.274657+0000","last_unstale":"2024-09-18T02:07:46.658366+0000","last_undegraded":"2024-09-18T02:07:46.658366+0000","last_fullsized":"2024-09-18T02:07:46.658366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000970169,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.206424+0000","last_change":"2024-09-18T02:08:05.206497+0000","last_active":"2024-09-18T02:08:05.206424+0000","last_peered":"2024-09-18T02:08:05.206424+0000","last_clean":"2024-09-18T02:08:05.206424+0000","last_became_active":"2024-09-18T02:04:01.571443+0000","last_became_peered":"2024-09-18T02:04:01.571443+0000","last_unstale":"2024-09-18T02:08:05.206424+0000","last_undegraded":"2024-09-18T02:08:05.206424+0000","last_fullsized":"2024-09-18T02:08:05.206424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:05.206220+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:05.206220+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.206220+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:45:50.192588+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'90","reported_seq":179,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.219597+0000","last_change":"2024-09-18T02:08:02.219597+0000","last_active":"2024-09-18T02:08:02.219597+0000","last_peered":"2024-09-18T02:08:02.219597+0000","last_clean":"2024-09-18T02:08:02.219597+0000","last_became_active":"2024-09-18T02:04:03.569938+0000","last_became_peered":"2024-09-18T02:04:03.569938+0000","last_unstale":"2024-09-18T02:08:02.219597+0000","last_undegraded":"2024-09-18T02:08:02.219597+0000","last_fullsized":"2024-09-18T02:08:02.219597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-09-18T02:08:02.219300+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-09-18T02:08:02.219300+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.219300+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:38.149380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.352707+0000","last_change":"2024-09-18T02:07:52.352767+0000","last_active":"2024-09-18T02:07:52.352707+0000","last_peered":"2024-09-18T02:07:52.352707+0000","last_clean":"2024-09-18T02:07:52.352707+0000","last_became_active":"2024-09-18T02:04:05.597181+0000","last_became_peered":"2024-09-18T02:04:05.597181+0000","last_unstale":"2024-09-18T02:07:52.352707+0000","last_undegraded":"2024-09-18T02:07:52.352707+0000","last_fullsized":"2024-09-18T02:07:52.352707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:52.352475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:52.352475+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.352475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:51:22.983509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334245+0000","last_change":"2024-09-18T02:04:07.619359+0000","last_active":"2024-09-18T02:06:26.334245+0000","last_peered":"2024-09-18T02:06:26.334245+0000","last_clean":"2024-09-18T02:06:26.334245+0000","last_became_active":"2024-09-18T02:04:07.618751+0000","last_became_peered":"2024-09-18T02:04:07.618751+0000","last_unstale":"2024-09-18T02:06:26.334245+0000","last_undegraded":"2024-09-18T02:06:26.334245+0000","last_fullsized":"2024-09-18T02:06:26.334245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329970+0000","last_change":"2024-09-18T02:03:59.554002+0000","last_active":"2024-09-18T02:06:06.329970+0000","last_peered":"2024-09-18T02:06:06.329970+0000","last_clean":"2024-09-18T02:06:06.329970+0000","last_became_active":"2024-09-18T02:03:59.553619+0000","last_became_peered":"2024-09-18T02:03:59.553619+0000","last_unstale":"2024-09-18T02:06:06.329970+0000","last_undegraded":"2024-09-18T02:06:06.329970+0000","last_fullsized":"2024-09-18T02:06:06.329970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329325+0000","last_change":"2024-09-18T02:03:57.519164+0000","last_active":"2024-09-18T02:06:06.329325+0000","last_peered":"2024-09-18T02:06:06.329325+0000","last_clean":"2024-09-18T02:06:06.329325+0000","last_became_active":"2024-09-18T02:03:57.518503+0000","last_became_peered":"2024-09-18T02:03:57.518503+0000","last_unstale":"2024-09-18T02:06:06.329325+0000","last_undegraded":"2024-09-18T02:06:06.329325+0000","last_fullsized":"2024-09-18T02:06:06.329325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995877+0000","last_change":"2024-09-18T02:03:50.288345+0000","last_active":"2024-09-18T02:07:47.995877+0000","last_peered":"2024-09-18T02:07:47.995877+0000","last_clean":"2024-09-18T02:07:47.995877+0000","last_became_active":"2024-09-18T02:03:48.276300+0000","last_became_peered":"2024-09-18T02:03:48.276300+0000","last_unstale":"2024-09-18T02:07:47.995877+0000","last_undegraded":"2024-09-18T02:07:47.995877+0000","last_fullsized":"2024-09-18T02:07:47.995877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002788245,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.199845+0000","last_change":"2024-09-18T02:08:01.199897+0000","last_active":"2024-09-18T02:08:01.199845+0000","last_peered":"2024-09-18T02:08:01.199845+0000","last_clean":"2024-09-18T02:08:01.199845+0000","last_became_active":"2024-09-18T02:04:01.557570+0000","last_became_peered":"2024-09-18T02:04:01.557570+0000","last_unstale":"2024-09-18T02:08:01.199845+0000","last_undegraded":"2024-09-18T02:08:01.199845+0000","last_fullsized":"2024-09-18T02:08:01.199845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:01.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:01.199648+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:22.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'28","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.127773+0000","last_change":"2024-09-18T02:07:48.127859+0000","last_active":"2024-09-18T02:07:48.127773+0000","last_peered":"2024-09-18T02:07:48.127773+0000","last_clean":"2024-09-18T02:07:48.127773+0000","last_became_active":"2024-09-18T02:04:03.588539+0000","last_became_peered":"2024-09-18T02:04:03.588539+0000","last_unstale":"2024-09-18T02:07:48.127773+0000","last_undegraded":"2024-09-18T02:07:48.127773+0000","last_fullsized":"2024-09-18T02:07:48.127773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-09-18T02:07:48.127557+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-09-18T02:07:48.127557+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.127557+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:55:43.485970+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.149355+0000","last_change":"2024-09-18T02:07:49.149355+0000","last_active":"2024-09-18T02:07:49.149355+0000","last_peered":"2024-09-18T02:07:49.149355+0000","last_clean":"2024-09-18T02:07:49.149355+0000","last_became_active":"2024-09-18T02:04:05.582477+0000","last_became_peered":"2024-09-18T02:04:05.582477+0000","last_unstale":"2024-09-18T02:07:49.149355+0000","last_undegraded":"2024-09-18T02:07:49.149355+0000","last_fullsized":"2024-09-18T02:07:49.149355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:49.149087+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:49.149087+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.149087+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:13.463449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.338178+0000","last_change":"2024-09-18T02:04:07.606623+0000","last_active":"2024-09-18T02:06:26.338178+0000","last_peered":"2024-09-18T02:06:26.338178+0000","last_clean":"2024-09-18T02:06:26.338178+0000","last_became_active":"2024-09-18T02:04:07.605591+0000","last_became_peered":"2024-09-18T02:04:07.605591+0000","last_unstale":"2024-09-18T02:06:26.338178+0000","last_undegraded":"2024-09-18T02:06:26.338178+0000","last_fullsized":"2024-09-18T02:06:26.338178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996619+0000","last_change":"2024-09-18T02:03:59.559409+0000","last_active":"2024-09-18T02:07:47.996619+0000","last_peered":"2024-09-18T02:07:47.996619+0000","last_clean":"2024-09-18T02:07:47.996619+0000","last_became_active":"2024-09-18T02:03:59.559044+0000","last_became_peered":"2024-09-18T02:03:59.559044+0000","last_unstale":"2024-09-18T02:07:47.996619+0000","last_undegraded":"2024-09-18T02:07:47.996619+0000","last_fullsized":"2024-09-18T02:07:47.996619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.334451+0000","last_change":"2024-09-18T02:03:57.522060+0000","last_active":"2024-09-18T02:06:11.334451+0000","last_peered":"2024-09-18T02:06:11.334451+0000","last_clean":"2024-09-18T02:06:11.334451+0000","last_became_active":"2024-09-18T02:03:57.521706+0000","last_became_peered":"2024-09-18T02:03:57.521706+0000","last_unstale":"2024-09-18T02:06:11.334451+0000","last_undegraded":"2024-09-18T02:06:11.334451+0000","last_fullsized":"2024-09-18T02:06:11.334451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:01.328171+0000","last_change":"2024-09-18T02:03:50.282549+0000","last_active":"2024-09-18T02:06:01.328171+0000","last_peered":"2024-09-18T02:06:01.328171+0000","last_clean":"2024-09-18T02:06:01.328171+0000","last_became_active":"2024-09-18T02:03:48.274030+0000","last_became_peered":"2024-09-18T02:03:48.274030+0000","last_unstale":"2024-09-18T02:06:01.328171+0000","last_undegraded":"2024-09-18T02:06:01.328171+0000","last_fullsized":"2024-09-18T02:06:01.328171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011092910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.183235+0000","last_change":"2024-09-18T02:07:59.183292+0000","last_active":"2024-09-18T02:07:59.183235+0000","last_peered":"2024-09-18T02:07:59.183235+0000","last_clean":"2024-09-18T02:07:59.183235+0000","last_became_active":"2024-09-18T02:04:01.558915+0000","last_became_peered":"2024-09-18T02:04:01.558915+0000","last_unstale":"2024-09-18T02:07:59.183235+0000","last_undegraded":"2024-09-18T02:07:59.183235+0000","last_fullsized":"2024-09-18T02:07:59.183235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:59.183052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:59.183052+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.183052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:35.437454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'22","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.328395+0000","last_change":"2024-09-18T02:07:52.328507+0000","last_active":"2024-09-18T02:07:52.328395+0000","last_peered":"2024-09-18T02:07:52.328395+0000","last_clean":"2024-09-18T02:07:52.328395+0000","last_became_active":"2024-09-18T02:04:03.591378+0000","last_became_peered":"2024-09-18T02:04:03.591378+0000","last_unstale":"2024-09-18T02:07:52.328395+0000","last_undegraded":"2024-09-18T02:07:52.328395+0000","last_fullsized":"2024-09-18T02:07:52.328395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-18T02:07:52.328188+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-18T02:07:52.328188+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.328188+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:26.638787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.282031+0000","last_change":"2024-09-18T02:07:55.282096+0000","last_active":"2024-09-18T02:07:55.282031+0000","last_peered":"2024-09-18T02:07:55.282031+0000","last_clean":"2024-09-18T02:07:55.282031+0000","last_became_active":"2024-09-18T02:04:05.605265+0000","last_became_peered":"2024-09-18T02:04:05.605265+0000","last_unstale":"2024-09-18T02:07:55.282031+0000","last_undegraded":"2024-09-18T02:07:55.282031+0000","last_fullsized":"2024-09-18T02:07:55.282031+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:55.281840+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:55.281840+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.281840+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:15.115042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334858+0000","last_change":"2024-09-18T02:04:07.624755+0000","last_active":"2024-09-18T02:06:26.334858+0000","last_peered":"2024-09-18T02:06:26.334858+0000","last_clean":"2024-09-18T02:06:26.334858+0000","last_became_active":"2024-09-18T02:04:07.624085+0000","last_became_peered":"2024-09-18T02:04:07.624085+0000","last_unstale":"2024-09-18T02:06:26.334858+0000","last_undegraded":"2024-09-18T02:06:26.334858+0000","last_fullsized":"2024-09-18T02:06:26.334858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.331338+0000","last_change":"2024-09-18T02:03:59.535655+0000","last_active":"2024-09-18T02:06:06.331338+0000","last_peered":"2024-09-18T02:06:06.331338+0000","last_clean":"2024-09-18T02:06:06.331338+0000","last_became_active":"2024-09-18T02:03:59.535266+0000","last_became_peered":"2024-09-18T02:03:59.535266+0000","last_unstale":"2024-09-18T02:06:06.331338+0000","last_undegraded":"2024-09-18T02:06:06.331338+0000","last_fullsized":"2024-09-18T02:06:06.331338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.331321+0000","last_change":"2024-09-18T02:03:57.529076+0000","last_active":"2024-09-18T02:06:11.331321+0000","last_peered":"2024-09-18T02:06:11.331321+0000","last_clean":"2024-09-18T02:06:11.331321+0000","last_became_active":"2024-09-18T02:03:57.528676+0000","last_became_peered":"2024-09-18T02:03:57.528676+0000","last_unstale":"2024-09-18T02:06:11.331321+0000","last_undegraded":"2024-09-18T02:06:11.331321+0000","last_fullsized":"2024-09-18T02:06:11.331321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:01.331915+0000","last_change":"2024-09-18T02:03:50.288611+0000","last_active":"2024-09-18T02:06:01.331915+0000","last_peered":"2024-09-18T02:06:01.331915+0000","last_clean":"2024-09-18T02:06:01.331915+0000","last_became_active":"2024-09-18T02:03:48.396609+0000","last_became_peered":"2024-09-18T02:03:48.396609+0000","last_unstale":"2024-09-18T02:06:01.331915+0000","last_undegraded":"2024-09-18T02:06:01.331915+0000","last_fullsized":"2024-09-18T02:06:01.331915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025902970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.230746+0000","last_change":"2024-09-18T02:07:54.230746+0000","last_active":"2024-09-18T02:07:54.230746+0000","last_peered":"2024-09-18T02:07:54.230746+0000","last_clean":"2024-09-18T02:07:54.230746+0000","last_became_active":"2024-09-18T02:04:01.561488+0000","last_became_peered":"2024-09-18T02:04:01.561488+0000","last_unstale":"2024-09-18T02:07:54.230746+0000","last_undegraded":"2024-09-18T02:07:54.230746+0000","last_fullsized":"2024-09-18T02:07:54.230746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.230358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.230358+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.230358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:40.139193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'103","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.275547+0000","last_change":"2024-09-18T02:07:58.275633+0000","last_active":"2024-09-18T02:07:58.275547+0000","last_peered":"2024-09-18T02:07:58.275547+0000","last_clean":"2024-09-18T02:07:58.275547+0000","last_became_active":"2024-09-18T02:04:03.585879+0000","last_became_peered":"2024-09-18T02:04:03.585879+0000","last_unstale":"2024-09-18T02:07:58.275547+0000","last_undegraded":"2024-09-18T02:07:58.275547+0000","last_fullsized":"2024-09-18T02:07:58.275547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'103","last_scrub_stamp":"2024-09-18T02:07:58.275354+0000","last_deep_scrub":"32'103","last_deep_scrub_stamp":"2024-09-18T02:07:58.275354+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.275354+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:34:23.917223+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.300874+0000","last_change":"2024-09-18T02:07:48.300909+0000","last_active":"2024-09-18T02:07:48.300874+0000","last_peered":"2024-09-18T02:07:48.300874+0000","last_clean":"2024-09-18T02:07:48.300874+0000","last_became_active":"2024-09-18T02:04:05.588676+0000","last_became_peered":"2024-09-18T02:04:05.588676+0000","last_unstale":"2024-09-18T02:07:48.300874+0000","last_undegraded":"2024-09-18T02:07:48.300874+0000","last_fullsized":"2024-09-18T02:07:48.300874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.300757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.300757+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.300757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:52:41.278180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.274167+0000","last_change":"2024-09-18T02:07:59.274232+0000","last_active":"2024-09-18T02:07:59.274167+0000","last_peered":"2024-09-18T02:07:59.274167+0000","last_clean":"2024-09-18T02:07:59.274167+0000","last_became_active":"2024-09-18T02:04:07.619587+0000","last_became_peered":"2024-09-18T02:04:07.619587+0000","last_unstale":"2024-09-18T02:07:59.274167+0000","last_undegraded":"2024-09-18T02:07:59.274167+0000","last_fullsized":"2024-09-18T02:07:59.274167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:07:59.273974+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:07:59.273974+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.273974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:10.696295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.299040+0000","last_change":"2024-09-18T02:08:03.299098+0000","last_active":"2024-09-18T02:08:03.299040+0000","last_peered":"2024-09-18T02:08:03.299040+0000","last_clean":"2024-09-18T02:08:03.299040+0000","last_became_active":"2024-09-18T02:04:07.626396+0000","last_became_peered":"2024-09-18T02:04:07.626396+0000","last_unstale":"2024-09-18T02:08:03.299040+0000","last_undegraded":"2024-09-18T02:08:03.299040+0000","last_fullsized":"2024-09-18T02:08:03.299040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:03.298850+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:03.298850+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.298850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:43:53.827265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.320732+0000","last_change":"2024-09-18T02:03:59.538659+0000","last_active":"2024-09-18T02:07:12.320732+0000","last_peered":"2024-09-18T02:07:12.320732+0000","last_clean":"2024-09-18T02:07:12.320732+0000","last_became_active":"2024-09-18T02:03:59.538280+0000","last_became_peered":"2024-09-18T02:03:59.538280+0000","last_unstale":"2024-09-18T02:07:12.320732+0000","last_undegraded":"2024-09-18T02:07:12.320732+0000","last_fullsized":"2024-09-18T02:07:12.320732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336799+0000","last_change":"2024-09-18T02:03:57.531366+0000","last_active":"2024-09-18T02:06:21.336799+0000","last_peered":"2024-09-18T02:06:21.336799+0000","last_clean":"2024-09-18T02:06:21.336799+0000","last_became_active":"2024-09-18T02:03:57.530751+0000","last_became_peered":"2024-09-18T02:03:57.530751+0000","last_unstale":"2024-09-18T02:06:21.336799+0000","last_undegraded":"2024-09-18T02:06:21.336799+0000","last_fullsized":"2024-09-18T02:06:21.336799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.781646+0000","last_change":"2024-09-18T02:08:05.781701+0000","last_active":"2024-09-18T02:08:05.781646+0000","last_peered":"2024-09-18T02:08:05.781646+0000","last_clean":"2024-09-18T02:08:05.781646+0000","last_became_active":"2024-09-18T02:04:01.561230+0000","last_became_peered":"2024-09-18T02:04:01.561230+0000","last_unstale":"2024-09-18T02:08:05.781646+0000","last_undegraded":"2024-09-18T02:08:05.781646+0000","last_fullsized":"2024-09-18T02:08:05.781646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:05.781451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:05.781451+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.781451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:05.813452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'47","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.175635+0000","last_change":"2024-09-18T02:07:58.175717+0000","last_active":"2024-09-18T02:07:58.175635+0000","last_peered":"2024-09-18T02:07:58.175635+0000","last_clean":"2024-09-18T02:07:58.175635+0000","last_became_active":"2024-09-18T02:04:03.595284+0000","last_became_peered":"2024-09-18T02:04:03.595284+0000","last_unstale":"2024-09-18T02:07:58.175635+0000","last_undegraded":"2024-09-18T02:07:58.175635+0000","last_fullsized":"2024-09-18T02:07:58.175635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-18T02:07:58.175442+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-18T02:07:58.175442+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.175442+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:34.582776+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.235929+0000","last_change":"2024-09-18T02:08:06.235985+0000","last_active":"2024-09-18T02:08:06.235929+0000","last_peered":"2024-09-18T02:08:06.235929+0000","last_clean":"2024-09-18T02:08:06.235929+0000","last_became_active":"2024-09-18T02:04:05.602528+0000","last_became_peered":"2024-09-18T02:04:05.602528+0000","last_unstale":"2024-09-18T02:08:06.235929+0000","last_undegraded":"2024-09-18T02:08:06.235929+0000","last_fullsized":"2024-09-18T02:08:06.235929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:06.235742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:06.235742+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.235742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:35:36.200312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.330528+0000","last_change":"2024-09-18T02:04:07.623315+0000","last_active":"2024-09-18T02:06:11.330528+0000","last_peered":"2024-09-18T02:06:11.330528+0000","last_clean":"2024-09-18T02:06:11.330528+0000","last_became_active":"2024-09-18T02:04:07.622753+0000","last_became_peered":"2024-09-18T02:04:07.622753+0000","last_unstale":"2024-09-18T02:06:11.330528+0000","last_undegraded":"2024-09-18T02:06:11.330528+0000","last_fullsized":"2024-09-18T02:06:11.330528+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'9","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.320765+0000","last_change":"2024-09-18T02:03:59.555234+0000","last_active":"2024-09-18T02:07:12.320765+0000","last_peered":"2024-09-18T02:07:12.320765+0000","last_clean":"2024-09-18T02:07:12.320765+0000","last_became_active":"2024-09-18T02:03:59.554803+0000","last_became_peered":"2024-09-18T02:03:59.554803+0000","last_unstale":"2024-09-18T02:07:12.320765+0000","last_undegraded":"2024-09-18T02:07:12.320765+0000","last_fullsized":"2024-09-18T02:07:12.320765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.336333+0000","last_change":"2024-09-18T02:03:57.522614+0000","last_active":"2024-09-18T02:06:26.336333+0000","last_peered":"2024-09-18T02:06:26.336333+0000","last_clean":"2024-09-18T02:06:26.336333+0000","last_became_active":"2024-09-18T02:03:57.519403+0000","last_became_peered":"2024-09-18T02:03:57.519403+0000","last_unstale":"2024-09-18T02:06:26.336333+0000","last_undegraded":"2024-09-18T02:06:26.336333+0000","last_fullsized":"2024-09-18T02:06:26.336333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.195595+0000","last_change":"2024-09-18T02:07:57.195649+0000","last_active":"2024-09-18T02:07:57.195595+0000","last_peered":"2024-09-18T02:07:57.195595+0000","last_clean":"2024-09-18T02:07:57.195595+0000","last_became_active":"2024-09-18T02:04:01.558788+0000","last_became_peered":"2024-09-18T02:04:01.558788+0000","last_unstale":"2024-09-18T02:07:57.195595+0000","last_undegraded":"2024-09-18T02:07:57.195595+0000","last_fullsized":"2024-09-18T02:07:57.195595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:57.195366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:57.195366+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.195366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:25.351307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.260154+0000","last_change":"2024-09-18T02:07:57.260300+0000","last_active":"2024-09-18T02:07:57.260154+0000","last_peered":"2024-09-18T02:07:57.260154+0000","last_clean":"2024-09-18T02:07:57.260154+0000","last_became_active":"2024-09-18T02:04:03.581045+0000","last_became_peered":"2024-09-18T02:04:03.581045+0000","last_unstale":"2024-09-18T02:07:57.260154+0000","last_undegraded":"2024-09-18T02:07:57.260154+0000","last_fullsized":"2024-09-18T02:07:57.260154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:07:57.259885+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:07:57.259885+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.259885+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:36.754049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.344639+0000","last_change":"2024-09-18T02:07:53.344690+0000","last_active":"2024-09-18T02:07:53.344639+0000","last_peered":"2024-09-18T02:07:53.344639+0000","last_clean":"2024-09-18T02:07:53.344639+0000","last_became_active":"2024-09-18T02:04:05.599064+0000","last_became_peered":"2024-09-18T02:04:05.599064+0000","last_unstale":"2024-09-18T02:07:53.344639+0000","last_undegraded":"2024-09-18T02:07:53.344639+0000","last_fullsized":"2024-09-18T02:07:53.344639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.344462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.344462+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.344462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:17:03.855166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:41.338031+0000","last_change":"2024-09-18T02:04:07.610644+0000","last_active":"2024-09-18T02:06:41.338031+0000","last_peered":"2024-09-18T02:06:41.338031+0000","last_clean":"2024-09-18T02:06:41.338031+0000","last_became_active":"2024-09-18T02:04:07.609954+0000","last_became_peered":"2024-09-18T02:04:07.609954+0000","last_unstale":"2024-09-18T02:06:41.338031+0000","last_undegraded":"2024-09-18T02:06:41.338031+0000","last_fullsized":"2024-09-18T02:06:41.338031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.320909+0000","last_change":"2024-09-18T02:03:59.550899+0000","last_active":"2024-09-18T02:07:12.320909+0000","last_peered":"2024-09-18T02:07:12.320909+0000","last_clean":"2024-09-18T02:07:12.320909+0000","last_became_active":"2024-09-18T02:03:59.549791+0000","last_became_peered":"2024-09-18T02:03:59.549791+0000","last_unstale":"2024-09-18T02:07:12.320909+0000","last_undegraded":"2024-09-18T02:07:12.320909+0000","last_fullsized":"2024-09-18T02:07:12.320909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.336365+0000","last_change":"2024-09-18T02:04:36.371010+0000","last_active":"2024-09-18T02:06:26.336365+0000","last_peered":"2024-09-18T02:06:26.336365+0000","last_clean":"2024-09-18T02:06:26.336365+0000","last_became_active":"2024-09-18T02:04:36.370188+0000","last_became_peered":"2024-09-18T02:04:36.370188+0000","last_unstale":"2024-09-18T02:06:26.336365+0000","last_undegraded":"2024-09-18T02:06:26.336365+0000","last_fullsized":"2024-09-18T02:06:26.336365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.334746+0000","last_change":"2024-09-18T02:04:01.563073+0000","last_active":"2024-09-18T02:06:21.334746+0000","last_peered":"2024-09-18T02:06:21.334746+0000","last_clean":"2024-09-18T02:06:21.334746+0000","last_became_active":"2024-09-18T02:04:01.562586+0000","last_became_peered":"2024-09-18T02:04:01.562586+0000","last_unstale":"2024-09-18T02:06:21.334746+0000","last_undegraded":"2024-09-18T02:06:21.334746+0000","last_fullsized":"2024-09-18T02:06:21.334746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'50","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.231506+0000","last_change":"2024-09-18T02:07:58.231588+0000","last_active":"2024-09-18T02:07:58.231506+0000","last_peered":"2024-09-18T02:07:58.231506+0000","last_clean":"2024-09-18T02:07:58.231506+0000","last_became_active":"2024-09-18T02:04:03.578581+0000","last_became_peered":"2024-09-18T02:04:03.578581+0000","last_unstale":"2024-09-18T02:07:58.231506+0000","last_undegraded":"2024-09-18T02:07:58.231506+0000","last_fullsized":"2024-09-18T02:07:58.231506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'50","last_scrub_stamp":"2024-09-18T02:07:58.231292+0000","last_deep_scrub":"32'50","last_deep_scrub_stamp":"2024-09-18T02:07:58.231292+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.231292+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:28.484821+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.089281+0000","last_change":"2024-09-18T02:07:53.089343+0000","last_active":"2024-09-18T02:07:53.089281+0000","last_peered":"2024-09-18T02:07:53.089281+0000","last_clean":"2024-09-18T02:07:53.089281+0000","last_became_active":"2024-09-18T02:04:05.586978+0000","last_became_peered":"2024-09-18T02:04:05.586978+0000","last_unstale":"2024-09-18T02:07:53.089281+0000","last_undegraded":"2024-09-18T02:07:53.089281+0000","last_fullsized":"2024-09-18T02:07:53.089281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.089086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.089086+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.089086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:43.728215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:41.341635+0000","last_change":"2024-09-18T02:04:07.611859+0000","last_active":"2024-09-18T02:06:41.341635+0000","last_peered":"2024-09-18T02:06:41.341635+0000","last_clean":"2024-09-18T02:06:41.341635+0000","last_became_active":"2024-09-18T02:04:07.607227+0000","last_became_peered":"2024-09-18T02:04:07.607227+0000","last_unstale":"2024-09-18T02:06:41.341635+0000","last_undegraded":"2024-09-18T02:06:41.341635+0000","last_fullsized":"2024-09-18T02:06:41.341635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336526+0000","last_change":"2024-09-18T02:03:59.550610+0000","last_active":"2024-09-18T02:06:21.336526+0000","last_peered":"2024-09-18T02:06:21.336526+0000","last_clean":"2024-09-18T02:06:21.336526+0000","last_became_active":"2024-09-18T02:03:59.550221+0000","last_became_peered":"2024-09-18T02:03:59.550221+0000","last_unstale":"2024-09-18T02:06:21.336526+0000","last_undegraded":"2024-09-18T02:06:21.336526+0000","last_fullsized":"2024-09-18T02:06:21.336526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.335016+0000","last_change":"2024-09-18T02:03:57.523727+0000","last_active":"2024-09-18T02:06:26.335016+0000","last_peered":"2024-09-18T02:06:26.335016+0000","last_clean":"2024-09-18T02:06:26.335016+0000","last_became_active":"2024-09-18T02:03:57.522590+0000","last_became_peered":"2024-09-18T02:03:57.522590+0000","last_unstale":"2024-09-18T02:06:26.335016+0000","last_undegraded":"2024-09-18T02:06:26.335016+0000","last_fullsized":"2024-09-18T02:06:26.335016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.399696+0000","last_change":"2024-09-18T02:07:48.399749+0000","last_active":"2024-09-18T02:07:48.399696+0000","last_peered":"2024-09-18T02:07:48.399696+0000","last_clean":"2024-09-18T02:07:48.399696+0000","last_became_active":"2024-09-18T02:04:01.566205+0000","last_became_peered":"2024-09-18T02:04:01.566205+0000","last_unstale":"2024-09-18T02:07:48.399696+0000","last_undegraded":"2024-09-18T02:07:48.399696+0000","last_fullsized":"2024-09-18T02:07:48.399696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.399488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.399488+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.399488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:47.098447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.319180+0000","last_change":"2024-09-18T02:08:00.319259+0000","last_active":"2024-09-18T02:08:00.319180+0000","last_peered":"2024-09-18T02:08:00.319180+0000","last_clean":"2024-09-18T02:08:00.319180+0000","last_became_active":"2024-09-18T02:04:03.580770+0000","last_became_peered":"2024-09-18T02:04:03.580770+0000","last_unstale":"2024-09-18T02:08:00.319180+0000","last_undegraded":"2024-09-18T02:08:00.319180+0000","last_fullsized":"2024-09-18T02:08:00.319180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-18T02:08:00.318990+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-18T02:08:00.318990+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.318990+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:50.958119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.367953+0000","last_change":"2024-09-18T02:07:54.368006+0000","last_active":"2024-09-18T02:07:54.367953+0000","last_peered":"2024-09-18T02:07:54.367953+0000","last_clean":"2024-09-18T02:07:54.367953+0000","last_became_active":"2024-09-18T02:04:05.591514+0000","last_became_peered":"2024-09-18T02:04:05.591514+0000","last_unstale":"2024-09-18T02:07:54.367953+0000","last_undegraded":"2024-09-18T02:07:54.367953+0000","last_fullsized":"2024-09-18T02:07:54.367953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.367760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.367760+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.367760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:57.231313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.236076+0000","last_change":"2024-09-18T02:03:59.554054+0000","last_active":"2024-09-18T02:07:12.236076+0000","last_peered":"2024-09-18T02:07:12.236076+0000","last_clean":"2024-09-18T02:07:12.236076+0000","last_became_active":"2024-09-18T02:03:59.553660+0000","last_became_peered":"2024-09-18T02:03:59.553660+0000","last_unstale":"2024-09-18T02:07:12.236076+0000","last_undegraded":"2024-09-18T02:07:12.236076+0000","last_fullsized":"2024-09-18T02:07:12.236076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.211967+0000","last_change":"2024-09-18T02:03:57.528505+0000","last_active":"2024-09-18T02:07:12.211967+0000","last_peered":"2024-09-18T02:07:12.211967+0000","last_clean":"2024-09-18T02:07:12.211967+0000","last_became_active":"2024-09-18T02:03:57.526941+0000","last_became_peered":"2024-09-18T02:03:57.526941+0000","last_unstale":"2024-09-18T02:07:12.211967+0000","last_undegraded":"2024-09-18T02:07:12.211967+0000","last_fullsized":"2024-09-18T02:07:12.211967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.659414+0000","last_change":"2024-09-18T02:04:01.561664+0000","last_active":"2024-09-18T02:07:46.659414+0000","last_peered":"2024-09-18T02:07:46.659414+0000","last_clean":"2024-09-18T02:07:46.659414+0000","last_became_active":"2024-09-18T02:04:01.559839+0000","last_became_peered":"2024-09-18T02:04:01.559839+0000","last_unstale":"2024-09-18T02:07:46.659414+0000","last_undegraded":"2024-09-18T02:07:46.659414+0000","last_fullsized":"2024-09-18T02:07:46.659414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'71","reported_seq":150,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.245034+0000","last_change":"2024-09-18T02:07:56.245115+0000","last_active":"2024-09-18T02:07:56.245034+0000","last_peered":"2024-09-18T02:07:56.245034+0000","last_clean":"2024-09-18T02:07:56.245034+0000","last_became_active":"2024-09-18T02:04:03.581518+0000","last_became_peered":"2024-09-18T02:04:03.581518+0000","last_unstale":"2024-09-18T02:07:56.245034+0000","last_undegraded":"2024-09-18T02:07:56.245034+0000","last_fullsized":"2024-09-18T02:07:56.245034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'71","last_scrub_stamp":"2024-09-18T02:07:56.244855+0000","last_deep_scrub":"32'71","last_deep_scrub_stamp":"2024-09-18T02:07:56.244855+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.244855+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:40.886685+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.238645+0000","last_change":"2024-09-18T02:07:48.238697+0000","last_active":"2024-09-18T02:07:48.238645+0000","last_peered":"2024-09-18T02:07:48.238645+0000","last_clean":"2024-09-18T02:07:48.238645+0000","last_became_active":"2024-09-18T02:04:05.610007+0000","last_became_peered":"2024-09-18T02:04:05.610007+0000","last_unstale":"2024-09-18T02:07:48.238645+0000","last_undegraded":"2024-09-18T02:07:48.238645+0000","last_fullsized":"2024-09-18T02:07:48.238645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.238443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.238443+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.238443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:49:49.194989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'20","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.739254+0000","last_change":"2024-09-18T02:04:07.610032+0000","last_active":"2024-09-18T02:07:11.739254+0000","last_peered":"2024-09-18T02:07:11.739254+0000","last_clean":"2024-09-18T02:07:11.739254+0000","last_became_active":"2024-09-18T02:04:07.609058+0000","last_became_peered":"2024-09-18T02:04:07.609058+0000","last_unstale":"2024-09-18T02:07:11.739254+0000","last_undegraded":"2024-09-18T02:07:11.739254+0000","last_fullsized":"2024-09-18T02:07:11.739254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.659037+0000","last_change":"2024-09-18T02:03:59.541759+0000","last_active":"2024-09-18T02:07:46.659037+0000","last_peered":"2024-09-18T02:07:46.659037+0000","last_clean":"2024-09-18T02:07:46.659037+0000","last_became_active":"2024-09-18T02:03:59.540971+0000","last_became_peered":"2024-09-18T02:03:59.540971+0000","last_unstale":"2024-09-18T02:07:46.659037+0000","last_undegraded":"2024-09-18T02:07:46.659037+0000","last_fullsized":"2024-09-18T02:07:46.659037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334725+0000","last_change":"2024-09-18T02:03:57.519487+0000","last_active":"2024-09-18T02:06:26.334725+0000","last_peered":"2024-09-18T02:06:26.334725+0000","last_clean":"2024-09-18T02:06:26.334725+0000","last_became_active":"2024-09-18T02:03:57.518311+0000","last_became_peered":"2024-09-18T02:03:57.518311+0000","last_unstale":"2024-09-18T02:06:26.334725+0000","last_undegraded":"2024-09-18T02:06:26.334725+0000","last_fullsized":"2024-09-18T02:06:26.334725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.331575+0000","last_change":"2024-09-18T02:04:01.564100+0000","last_active":"2024-09-18T02:06:06.331575+0000","last_peered":"2024-09-18T02:06:06.331575+0000","last_clean":"2024-09-18T02:06:06.331575+0000","last_became_active":"2024-09-18T02:04:01.563285+0000","last_became_peered":"2024-09-18T02:04:01.563285+0000","last_unstale":"2024-09-18T02:06:06.331575+0000","last_undegraded":"2024-09-18T02:06:06.331575+0000","last_fullsized":"2024-09-18T02:06:06.331575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'40","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.323421+0000","last_change":"2024-09-18T02:04:03.600506+0000","last_active":"2024-09-18T02:07:43.323421+0000","last_peered":"2024-09-18T02:07:43.323421+0000","last_clean":"2024-09-18T02:07:43.323421+0000","last_became_active":"2024-09-18T02:04:03.596605+0000","last_became_peered":"2024-09-18T02:04:03.596605+0000","last_unstale":"2024-09-18T02:07:43.323421+0000","last_undegraded":"2024-09-18T02:07:43.323421+0000","last_fullsized":"2024-09-18T02:07:43.323421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.941939+0000","last_change":"2024-09-18T02:07:56.941998+0000","last_active":"2024-09-18T02:07:56.941939+0000","last_peered":"2024-09-18T02:07:56.941939+0000","last_clean":"2024-09-18T02:07:56.941939+0000","last_became_active":"2024-09-18T02:04:05.589023+0000","last_became_peered":"2024-09-18T02:04:05.589023+0000","last_unstale":"2024-09-18T02:07:56.941939+0000","last_undegraded":"2024-09-18T02:07:56.941939+0000","last_fullsized":"2024-09-18T02:07:56.941939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:56.941733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:56.941733+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.941733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:18.501298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339141+0000","last_change":"2024-09-18T02:04:07.625988+0000","last_active":"2024-09-18T02:06:31.339141+0000","last_peered":"2024-09-18T02:06:31.339141+0000","last_clean":"2024-09-18T02:06:31.339141+0000","last_became_active":"2024-09-18T02:04:07.625440+0000","last_became_peered":"2024-09-18T02:04:07.625440+0000","last_unstale":"2024-09-18T02:06:31.339141+0000","last_undegraded":"2024-09-18T02:06:31.339141+0000","last_fullsized":"2024-09-18T02:06:31.339141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.216192+0000","last_change":"2024-09-18T02:08:02.216266+0000","last_active":"2024-09-18T02:08:02.216192+0000","last_peered":"2024-09-18T02:08:02.216192+0000","last_clean":"2024-09-18T02:08:02.216192+0000","last_became_active":"2024-09-18T02:03:59.561208+0000","last_became_peered":"2024-09-18T02:03:59.561208+0000","last_unstale":"2024-09-18T02:08:02.216192+0000","last_undegraded":"2024-09-18T02:08:02.216192+0000","last_fullsized":"2024-09-18T02:08:02.216192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:02.216020+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:02.216020+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.216020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:52.878948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.335961+0000","last_change":"2024-09-18T02:03:57.521151+0000","last_active":"2024-09-18T02:06:31.335961+0000","last_peered":"2024-09-18T02:06:31.335961+0000","last_clean":"2024-09-18T02:06:31.335961+0000","last_became_active":"2024-09-18T02:03:57.520569+0000","last_became_peered":"2024-09-18T02:03:57.520569+0000","last_unstale":"2024-09-18T02:06:31.335961+0000","last_undegraded":"2024-09-18T02:06:31.335961+0000","last_fullsized":"2024-09-18T02:06:31.335961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.337463+0000","last_change":"2024-09-18T02:04:01.566225+0000","last_active":"2024-09-18T02:06:31.337463+0000","last_peered":"2024-09-18T02:06:31.337463+0000","last_clean":"2024-09-18T02:06:31.337463+0000","last_became_active":"2024-09-18T02:04:01.565499+0000","last_became_peered":"2024-09-18T02:04:01.565499+0000","last_unstale":"2024-09-18T02:06:31.337463+0000","last_undegraded":"2024-09-18T02:06:31.337463+0000","last_fullsized":"2024-09-18T02:06:31.337463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'46","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.199419+0000","last_change":"2024-09-18T02:08:00.199509+0000","last_active":"2024-09-18T02:08:00.199419+0000","last_peered":"2024-09-18T02:08:00.199419+0000","last_clean":"2024-09-18T02:08:00.199419+0000","last_became_active":"2024-09-18T02:04:03.577841+0000","last_became_peered":"2024-09-18T02:04:03.577841+0000","last_unstale":"2024-09-18T02:08:00.199419+0000","last_undegraded":"2024-09-18T02:08:00.199419+0000","last_fullsized":"2024-09-18T02:08:00.199419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-18T02:08:00.199183+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-18T02:08:00.199183+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.199183+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:17.403960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.194433+0000","last_change":"2024-09-18T02:08:03.194433+0000","last_active":"2024-09-18T02:08:03.194433+0000","last_peered":"2024-09-18T02:08:03.194433+0000","last_clean":"2024-09-18T02:08:03.194433+0000","last_became_active":"2024-09-18T02:04:05.605718+0000","last_became_peered":"2024-09-18T02:04:05.605718+0000","last_unstale":"2024-09-18T02:08:03.194433+0000","last_undegraded":"2024-09-18T02:08:03.194433+0000","last_fullsized":"2024-09-18T02:08:03.194433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:03.194177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:03.194177+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.194177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:11.445570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339037+0000","last_change":"2024-09-18T02:04:07.621810+0000","last_active":"2024-09-18T02:06:31.339037+0000","last_peered":"2024-09-18T02:06:31.339037+0000","last_clean":"2024-09-18T02:06:31.339037+0000","last_became_active":"2024-09-18T02:04:07.621224+0000","last_became_peered":"2024-09-18T02:04:07.621224+0000","last_unstale":"2024-09-18T02:06:31.339037+0000","last_undegraded":"2024-09-18T02:06:31.339037+0000","last_fullsized":"2024-09-18T02:06:31.339037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.170799+0000","last_change":"2024-09-18T02:03:59.538977+0000","last_active":"2024-09-18T02:07:12.170799+0000","last_peered":"2024-09-18T02:07:12.170799+0000","last_clean":"2024-09-18T02:07:12.170799+0000","last_became_active":"2024-09-18T02:03:59.536701+0000","last_became_peered":"2024-09-18T02:03:59.536701+0000","last_unstale":"2024-09-18T02:07:12.170799+0000","last_undegraded":"2024-09-18T02:07:12.170799+0000","last_fullsized":"2024-09-18T02:07:12.170799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339226+0000","last_change":"2024-09-18T02:03:57.528489+0000","last_active":"2024-09-18T02:06:31.339226+0000","last_peered":"2024-09-18T02:06:31.339226+0000","last_clean":"2024-09-18T02:06:31.339226+0000","last_became_active":"2024-09-18T02:03:57.527891+0000","last_became_peered":"2024-09-18T02:03:57.527891+0000","last_unstale":"2024-09-18T02:06:31.339226+0000","last_undegraded":"2024-09-18T02:06:31.339226+0000","last_fullsized":"2024-09-18T02:06:31.339226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.843805+0000","last_change":"2024-09-18T02:08:02.843858+0000","last_active":"2024-09-18T02:08:02.843805+0000","last_peered":"2024-09-18T02:08:02.843805+0000","last_clean":"2024-09-18T02:08:02.843805+0000","last_became_active":"2024-09-18T02:04:01.564187+0000","last_became_peered":"2024-09-18T02:04:01.564187+0000","last_unstale":"2024-09-18T02:08:02.843805+0000","last_undegraded":"2024-09-18T02:08:02.843805+0000","last_fullsized":"2024-09-18T02:08:02.843805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:02.843618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:02.843618+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.843618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:11.164508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.203666+0000","last_change":"2024-09-18T02:08:04.203666+0000","last_active":"2024-09-18T02:08:04.203666+0000","last_peered":"2024-09-18T02:08:04.203666+0000","last_clean":"2024-09-18T02:08:04.203666+0000","last_became_active":"2024-09-18T02:04:03.596273+0000","last_became_peered":"2024-09-18T02:04:03.596273+0000","last_unstale":"2024-09-18T02:08:04.203666+0000","last_undegraded":"2024-09-18T02:08:04.203666+0000","last_fullsized":"2024-09-18T02:08:04.203666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-18T02:08:04.203351+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-18T02:08:04.203351+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.203351+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:49:59.631236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":383,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.282626+0000","last_change":"2024-09-18T02:07:50.282688+0000","last_active":"2024-09-18T02:07:50.282626+0000","last_peered":"2024-09-18T02:07:50.282626+0000","last_clean":"2024-09-18T02:07:50.282626+0000","last_became_active":"2024-09-18T02:04:05.601182+0000","last_became_peered":"2024-09-18T02:04:05.601182+0000","last_unstale":"2024-09-18T02:07:50.282626+0000","last_undegraded":"2024-09-18T02:07:50.282626+0000","last_fullsized":"2024-09-18T02:07:50.282626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:50.282455+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:50.282455+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.282455+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:09:41.423906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'8","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.338947+0000","last_change":"2024-09-18T02:04:07.622167+0000","last_active":"2024-09-18T02:06:31.338947+0000","last_peered":"2024-09-18T02:06:31.338947+0000","last_clean":"2024-09-18T02:06:31.338947+0000","last_became_active":"2024-09-18T02:04:07.621240+0000","last_became_peered":"2024-09-18T02:04:07.621240+0000","last_unstale":"2024-09-18T02:06:31.338947+0000","last_undegraded":"2024-09-18T02:06:31.338947+0000","last_fullsized":"2024-09-18T02:06:31.338947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'14","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.885159+0000","last_change":"2024-09-18T02:03:59.536823+0000","last_active":"2024-09-18T02:07:11.885159+0000","last_peered":"2024-09-18T02:07:11.885159+0000","last_clean":"2024-09-18T02:07:11.885159+0000","last_became_active":"2024-09-18T02:03:59.536486+0000","last_became_peered":"2024-09-18T02:03:59.536486+0000","last_unstale":"2024-09-18T02:07:11.885159+0000","last_undegraded":"2024-09-18T02:07:11.885159+0000","last_fullsized":"2024-09-18T02:07:11.885159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.336063+0000","last_change":"2024-09-18T02:03:57.520866+0000","last_active":"2024-09-18T02:06:31.336063+0000","last_peered":"2024-09-18T02:06:31.336063+0000","last_clean":"2024-09-18T02:06:31.336063+0000","last_became_active":"2024-09-18T02:03:57.520452+0000","last_became_peered":"2024-09-18T02:03:57.520452+0000","last_unstale":"2024-09-18T02:06:31.336063+0000","last_undegraded":"2024-09-18T02:06:31.336063+0000","last_fullsized":"2024-09-18T02:06:31.336063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.832584+0000","last_change":"2024-09-18T02:08:03.832649+0000","last_active":"2024-09-18T02:08:03.832584+0000","last_peered":"2024-09-18T02:08:03.832584+0000","last_clean":"2024-09-18T02:08:03.832584+0000","last_became_active":"2024-09-18T02:04:01.564165+0000","last_became_peered":"2024-09-18T02:04:01.564165+0000","last_unstale":"2024-09-18T02:08:03.832584+0000","last_undegraded":"2024-09-18T02:08:03.832584+0000","last_fullsized":"2024-09-18T02:08:03.832584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:03.832329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:03.832329+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.832329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:28.467191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'73","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.093299+0000","last_change":"2024-09-18T02:07:52.093377+0000","last_active":"2024-09-18T02:07:52.093299+0000","last_peered":"2024-09-18T02:07:52.093299+0000","last_clean":"2024-09-18T02:07:52.093299+0000","last_became_active":"2024-09-18T02:04:03.566714+0000","last_became_peered":"2024-09-18T02:04:03.566714+0000","last_unstale":"2024-09-18T02:07:52.093299+0000","last_undegraded":"2024-09-18T02:07:52.093299+0000","last_fullsized":"2024-09-18T02:07:52.093299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-09-18T02:07:52.093206+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-09-18T02:07:52.093206+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.093206+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:03.515528+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.212884+0000","last_change":"2024-09-18T02:07:53.213015+0000","last_active":"2024-09-18T02:07:53.212884+0000","last_peered":"2024-09-18T02:07:53.212884+0000","last_clean":"2024-09-18T02:07:53.212884+0000","last_became_active":"2024-09-18T02:04:05.578635+0000","last_became_peered":"2024-09-18T02:04:05.578635+0000","last_unstale":"2024-09-18T02:07:53.212884+0000","last_undegraded":"2024-09-18T02:07:53.212884+0000","last_fullsized":"2024-09-18T02:07:53.212884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.212658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.212658+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.212658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:04.833203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:36.337253+0000","last_change":"2024-09-18T02:04:07.620173+0000","last_active":"2024-09-18T02:06:36.337253+0000","last_peered":"2024-09-18T02:06:36.337253+0000","last_clean":"2024-09-18T02:06:36.337253+0000","last_became_active":"2024-09-18T02:04:07.618696+0000","last_became_peered":"2024-09-18T02:04:07.618696+0000","last_unstale":"2024-09-18T02:06:36.337253+0000","last_undegraded":"2024-09-18T02:06:36.337253+0000","last_fullsized":"2024-09-18T02:06:36.337253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.235975+0000","last_change":"2024-09-18T02:03:59.537068+0000","last_active":"2024-09-18T02:07:12.235975+0000","last_peered":"2024-09-18T02:07:12.235975+0000","last_clean":"2024-09-18T02:07:12.235975+0000","last_became_active":"2024-09-18T02:03:59.536693+0000","last_became_peered":"2024-09-18T02:03:59.536693+0000","last_unstale":"2024-09-18T02:07:12.235975+0000","last_undegraded":"2024-09-18T02:07:12.235975+0000","last_fullsized":"2024-09-18T02:07:12.235975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339376+0000","last_change":"2024-09-18T02:03:57.533853+0000","last_active":"2024-09-18T02:06:31.339376+0000","last_peered":"2024-09-18T02:06:31.339376+0000","last_clean":"2024-09-18T02:06:31.339376+0000","last_became_active":"2024-09-18T02:03:57.532963+0000","last_became_peered":"2024-09-18T02:03:57.532963+0000","last_unstale":"2024-09-18T02:06:31.339376+0000","last_undegraded":"2024-09-18T02:06:31.339376+0000","last_fullsized":"2024-09-18T02:06:31.339376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.290629+0000","last_change":"2024-09-18T02:08:06.290687+0000","last_active":"2024-09-18T02:08:06.290629+0000","last_peered":"2024-09-18T02:08:06.290629+0000","last_clean":"2024-09-18T02:08:06.290629+0000","last_became_active":"2024-09-18T02:04:01.572089+0000","last_became_peered":"2024-09-18T02:04:01.572089+0000","last_unstale":"2024-09-18T02:08:06.290629+0000","last_undegraded":"2024-09-18T02:08:06.290629+0000","last_fullsized":"2024-09-18T02:08:06.290629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:06.290419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:06.290419+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.290419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:26.123621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'43","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.233899+0000","last_change":"2024-09-18T02:08:01.233976+0000","last_active":"2024-09-18T02:08:01.233899+0000","last_peered":"2024-09-18T02:08:01.233899+0000","last_clean":"2024-09-18T02:08:01.233899+0000","last_became_active":"2024-09-18T02:04:03.569962+0000","last_became_peered":"2024-09-18T02:04:03.569962+0000","last_unstale":"2024-09-18T02:08:01.233899+0000","last_undegraded":"2024-09-18T02:08:01.233899+0000","last_fullsized":"2024-09-18T02:08:01.233899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:01.233724+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:01.233724+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.233724+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:11:25.741483+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339061+0000","last_change":"2024-09-18T02:04:05.607210+0000","last_active":"2024-09-18T02:06:31.339061+0000","last_peered":"2024-09-18T02:06:31.339061+0000","last_clean":"2024-09-18T02:06:31.339061+0000","last_became_active":"2024-09-18T02:04:05.606608+0000","last_became_peered":"2024-09-18T02:04:05.606608+0000","last_unstale":"2024-09-18T02:06:31.339061+0000","last_undegraded":"2024-09-18T02:06:31.339061+0000","last_fullsized":"2024-09-18T02:06:31.339061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"30'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:36.340645+0000","last_change":"2024-09-18T02:04:07.609072+0000","last_active":"2024-09-18T02:06:36.340645+0000","last_peered":"2024-09-18T02:06:36.340645+0000","last_clean":"2024-09-18T02:06:36.340645+0000","last_became_active":"2024-09-18T02:04:07.607839+0000","last_became_peered":"2024-09-18T02:04:07.607839+0000","last_unstale":"2024-09-18T02:06:36.340645+0000","last_undegraded":"2024-09-18T02:06:36.340645+0000","last_fullsized":"2024-09-18T02:06:36.340645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.337914+0000","last_change":"2024-09-18T02:03:59.550978+0000","last_active":"2024-09-18T02:06:26.337914+0000","last_peered":"2024-09-18T02:06:26.337914+0000","last_clean":"2024-09-18T02:06:26.337914+0000","last_became_active":"2024-09-18T02:03:59.547123+0000","last_became_peered":"2024-09-18T02:03:59.547123+0000","last_unstale":"2024-09-18T02:06:26.337914+0000","last_undegraded":"2024-09-18T02:06:26.337914+0000","last_fullsized":"2024-09-18T02:06:26.337914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.658506+0000","last_change":"2024-09-18T02:03:57.530635+0000","last_active":"2024-09-18T02:07:46.658506+0000","last_peered":"2024-09-18T02:07:46.658506+0000","last_clean":"2024-09-18T02:07:46.658506+0000","last_became_active":"2024-09-18T02:03:57.530001+0000","last_became_peered":"2024-09-18T02:03:57.530001+0000","last_unstale":"2024-09-18T02:07:46.658506+0000","last_undegraded":"2024-09-18T02:07:46.658506+0000","last_fullsized":"2024-09-18T02:07:46.658506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.978250+0000","last_change":"2024-09-18T02:07:55.978327+0000","last_active":"2024-09-18T02:07:55.978250+0000","last_peered":"2024-09-18T02:07:55.978250+0000","last_clean":"2024-09-18T02:07:55.978250+0000","last_became_active":"2024-09-18T02:04:01.571263+0000","last_became_peered":"2024-09-18T02:04:01.571263+0000","last_unstale":"2024-09-18T02:07:55.978250+0000","last_undegraded":"2024-09-18T02:07:55.978250+0000","last_fullsized":"2024-09-18T02:07:55.978250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:55.978062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:55.978062+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.978062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:43:46.506478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'37","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.439356+0000","last_change":"2024-09-18T02:04:03.604212+0000","last_active":"2024-09-18T02:07:43.439356+0000","last_peered":"2024-09-18T02:07:43.439356+0000","last_clean":"2024-09-18T02:07:43.439356+0000","last_became_active":"2024-09-18T02:04:03.601392+0000","last_became_peered":"2024-09-18T02:04:03.601392+0000","last_unstale":"2024-09-18T02:07:43.439356+0000","last_undegraded":"2024-09-18T02:07:43.439356+0000","last_fullsized":"2024-09-18T02:07:43.439356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:02.535177+0000","last_clean_scrub_stamp":"2024-09-18T02:04:02.535177+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:36.340397+0000","last_change":"2024-09-18T02:04:05.600682+0000","last_active":"2024-09-18T02:06:36.340397+0000","last_peered":"2024-09-18T02:06:36.340397+0000","last_clean":"2024-09-18T02:06:36.340397+0000","last_became_active":"2024-09-18T02:04:05.599964+0000","last_became_peered":"2024-09-18T02:04:05.599964+0000","last_unstale":"2024-09-18T02:06:36.340397+0000","last_undegraded":"2024-09-18T02:06:36.340397+0000","last_fullsized":"2024-09-18T02:06:36.340397+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:04.548700+0000","last_clean_scrub_stamp":"2024-09-18T02:04:04.548700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.400039+0000","last_change":"2024-09-18T02:04:07.615961+0000","last_active":"2024-09-18T02:07:12.400039+0000","last_peered":"2024-09-18T02:07:12.400039+0000","last_clean":"2024-09-18T02:07:12.400039+0000","last_became_active":"2024-09-18T02:04:07.615007+0000","last_became_peered":"2024-09-18T02:04:07.615007+0000","last_unstale":"2024-09-18T02:07:12.400039+0000","last_undegraded":"2024-09-18T02:07:12.400039+0000","last_fullsized":"2024-09-18T02:07:12.400039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.335900+0000","last_change":"2024-09-18T02:03:59.536538+0000","last_active":"2024-09-18T02:06:26.335900+0000","last_peered":"2024-09-18T02:06:26.335900+0000","last_clean":"2024-09-18T02:06:26.335900+0000","last_became_active":"2024-09-18T02:03:59.536120+0000","last_became_peered":"2024-09-18T02:03:59.536120+0000","last_unstale":"2024-09-18T02:06:26.335900+0000","last_undegraded":"2024-09-18T02:06:26.335900+0000","last_fullsized":"2024-09-18T02:06:26.335900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.330131+0000","last_change":"2024-09-18T02:03:57.525661+0000","last_active":"2024-09-18T02:06:06.330131+0000","last_peered":"2024-09-18T02:06:06.330131+0000","last_clean":"2024-09-18T02:06:06.330131+0000","last_became_active":"2024-09-18T02:03:57.522831+0000","last_became_peered":"2024-09-18T02:03:57.522831+0000","last_unstale":"2024-09-18T02:06:06.330131+0000","last_undegraded":"2024-09-18T02:06:06.330131+0000","last_fullsized":"2024-09-18T02:06:06.330131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.904402+0000","last_change":"2024-09-18T02:07:57.904470+0000","last_active":"2024-09-18T02:07:57.904402+0000","last_peered":"2024-09-18T02:07:57.904402+0000","last_clean":"2024-09-18T02:07:57.904402+0000","last_became_active":"2024-09-18T02:04:01.569649+0000","last_became_peered":"2024-09-18T02:04:01.569649+0000","last_unstale":"2024-09-18T02:07:57.904402+0000","last_undegraded":"2024-09-18T02:07:57.904402+0000","last_fullsized":"2024-09-18T02:07:57.904402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:07:57.904196+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:07:57.904196+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.904196+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:19.425055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'55","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.404741+0000","last_change":"2024-09-18T02:07:50.404774+0000","last_active":"2024-09-18T02:07:50.404741+0000","last_peered":"2024-09-18T02:07:50.404741+0000","last_clean":"2024-09-18T02:07:50.404741+0000","last_became_active":"2024-09-18T02:04:03.591018+0000","last_became_peered":"2024-09-18T02:04:03.591018+0000","last_unstale":"2024-09-18T02:07:50.404741+0000","last_undegraded":"2024-09-18T02:07:50.404741+0000","last_fullsized":"2024-09-18T02:07:50.404741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'55","last_scrub_stamp":"2024-09-18T02:07:50.404668+0000","last_deep_scrub":"32'55","last_deep_scrub_stamp":"2024-09-18T02:07:50.404668+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.404668+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:48:17.203254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.262526+0000","last_change":"2024-09-18T02:07:51.262610+0000","last_active":"2024-09-18T02:07:51.262526+0000","last_peered":"2024-09-18T02:07:51.262526+0000","last_clean":"2024-09-18T02:07:51.262526+0000","last_became_active":"2024-09-18T02:04:05.595772+0000","last_became_peered":"2024-09-18T02:04:05.595772+0000","last_unstale":"2024-09-18T02:07:51.262526+0000","last_undegraded":"2024-09-18T02:07:51.262526+0000","last_fullsized":"2024-09-18T02:07:51.262526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.262332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.262332+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.262332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:41.244692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339293+0000","last_change":"2024-09-18T02:04:07.613362+0000","last_active":"2024-09-18T02:06:31.339293+0000","last_peered":"2024-09-18T02:06:31.339293+0000","last_clean":"2024-09-18T02:06:31.339293+0000","last_became_active":"2024-09-18T02:04:07.612610+0000","last_became_peered":"2024-09-18T02:04:07.612610+0000","last_unstale":"2024-09-18T02:06:31.339293+0000","last_undegraded":"2024-09-18T02:06:31.339293+0000","last_fullsized":"2024-09-18T02:06:31.339293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.331369+0000","last_change":"2024-09-18T02:03:59.554230+0000","last_active":"2024-09-18T02:06:11.331369+0000","last_peered":"2024-09-18T02:06:11.331369+0000","last_clean":"2024-09-18T02:06:11.331369+0000","last_became_active":"2024-09-18T02:03:59.553864+0000","last_became_peered":"2024-09-18T02:03:59.553864+0000","last_unstale":"2024-09-18T02:06:11.331369+0000","last_undegraded":"2024-09-18T02:06:11.331369+0000","last_fullsized":"2024-09-18T02:06:11.331369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.331299+0000","last_change":"2024-09-18T02:03:57.523546+0000","last_active":"2024-09-18T02:06:06.331299+0000","last_peered":"2024-09-18T02:06:06.331299+0000","last_clean":"2024-09-18T02:06:06.331299+0000","last_became_active":"2024-09-18T02:03:57.519843+0000","last_became_peered":"2024-09-18T02:03:57.519843+0000","last_unstale":"2024-09-18T02:06:06.331299+0000","last_undegraded":"2024-09-18T02:06:06.331299+0000","last_fullsized":"2024-09-18T02:06:06.331299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.330573+0000","last_change":"2024-09-18T02:03:59.536808+0000","last_active":"2024-09-18T02:06:11.330573+0000","last_peered":"2024-09-18T02:06:11.330573+0000","last_clean":"2024-09-18T02:06:11.330573+0000","last_became_active":"2024-09-18T02:03:59.535992+0000","last_became_peered":"2024-09-18T02:03:59.535992+0000","last_unstale":"2024-09-18T02:06:11.330573+0000","last_undegraded":"2024-09-18T02:06:11.330573+0000","last_fullsized":"2024-09-18T02:06:11.330573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:06.329112+0000","last_change":"2024-09-18T02:03:57.527965+0000","last_active":"2024-09-18T02:06:06.329112+0000","last_peered":"2024-09-18T02:06:06.329112+0000","last_clean":"2024-09-18T02:06:06.329112+0000","last_became_active":"2024-09-18T02:03:57.527146+0000","last_became_peered":"2024-09-18T02:03:57.527146+0000","last_unstale":"2024-09-18T02:06:06.329112+0000","last_undegraded":"2024-09-18T02:06:06.329112+0000","last_fullsized":"2024-09-18T02:06:06.329112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.237176+0000","last_change":"2024-09-18T02:03:59.558797+0000","last_active":"2024-09-18T02:07:12.237176+0000","last_peered":"2024-09-18T02:07:12.237176+0000","last_clean":"2024-09-18T02:07:12.237176+0000","last_became_active":"2024-09-18T02:03:59.556425+0000","last_became_peered":"2024-09-18T02:03:59.556425+0000","last_unstale":"2024-09-18T02:07:12.237176+0000","last_undegraded":"2024-09-18T02:07:12.237176+0000","last_fullsized":"2024-09-18T02:07:12.237176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.057061+0000","last_change":"2024-09-18T02:04:36.351337+0000","last_active":"2024-09-18T02:07:12.057061+0000","last_peered":"2024-09-18T02:07:12.057061+0000","last_clean":"2024-09-18T02:07:12.057061+0000","last_became_active":"2024-09-18T02:04:36.350472+0000","last_became_peered":"2024-09-18T02:04:36.350472+0000","last_unstale":"2024-09-18T02:07:12.057061+0000","last_undegraded":"2024-09-18T02:07:12.057061+0000","last_fullsized":"2024-09-18T02:07:12.057061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"32'18","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.330458+0000","last_change":"2024-09-18T02:03:59.535727+0000","last_active":"2024-09-18T02:06:11.330458+0000","last_peered":"2024-09-18T02:06:11.330458+0000","last_clean":"2024-09-18T02:06:11.330458+0000","last_became_active":"2024-09-18T02:03:59.534584+0000","last_became_peered":"2024-09-18T02:03:59.534584+0000","last_unstale":"2024-09-18T02:06:11.330458+0000","last_undegraded":"2024-09-18T02:06:11.330458+0000","last_fullsized":"2024-09-18T02:06:11.330458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.644699+0000","last_change":"2024-09-18T02:03:57.523284+0000","last_active":"2024-09-18T02:07:11.644699+0000","last_peered":"2024-09-18T02:07:11.644699+0000","last_clean":"2024-09-18T02:07:11.644699+0000","last_became_active":"2024-09-18T02:03:57.521499+0000","last_became_peered":"2024-09-18T02:03:57.521499+0000","last_unstale":"2024-09-18T02:07:11.644699+0000","last_undegraded":"2024-09-18T02:07:11.644699+0000","last_fullsized":"2024-09-18T02:07:11.644699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'1","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.319583+0000","last_change":"2024-09-18T02:03:59.555354+0000","last_active":"2024-09-18T02:07:12.319583+0000","last_peered":"2024-09-18T02:07:12.319583+0000","last_clean":"2024-09-18T02:07:12.319583+0000","last_became_active":"2024-09-18T02:03:59.554577+0000","last_became_peered":"2024-09-18T02:03:59.554577+0000","last_unstale":"2024-09-18T02:07:12.319583+0000","last_undegraded":"2024-09-18T02:07:12.319583+0000","last_fullsized":"2024-09-18T02:07:12.319583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.330481+0000","last_change":"2024-09-18T02:03:57.527483+0000","last_active":"2024-09-18T02:06:11.330481+0000","last_peered":"2024-09-18T02:06:11.330481+0000","last_clean":"2024-09-18T02:06:11.330481+0000","last_became_active":"2024-09-18T02:03:57.526774+0000","last_became_peered":"2024-09-18T02:03:57.526774+0000","last_unstale":"2024-09-18T02:06:11.330481+0000","last_undegraded":"2024-09-18T02:06:11.330481+0000","last_fullsized":"2024-09-18T02:06:11.330481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'13","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.320750+0000","last_change":"2024-09-18T02:03:59.555131+0000","last_active":"2024-09-18T02:07:12.320750+0000","last_peered":"2024-09-18T02:07:12.320750+0000","last_clean":"2024-09-18T02:07:12.320750+0000","last_became_active":"2024-09-18T02:03:59.554672+0000","last_became_peered":"2024-09-18T02:03:59.554672+0000","last_unstale":"2024-09-18T02:07:12.320750+0000","last_undegraded":"2024-09-18T02:07:12.320750+0000","last_fullsized":"2024-09-18T02:07:12.320750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.331281+0000","last_change":"2024-09-18T02:03:57.519989+0000","last_active":"2024-09-18T02:06:11.331281+0000","last_peered":"2024-09-18T02:06:11.331281+0000","last_clean":"2024-09-18T02:06:11.331281+0000","last_became_active":"2024-09-18T02:03:57.519691+0000","last_became_peered":"2024-09-18T02:03:57.519691+0000","last_unstale":"2024-09-18T02:06:11.331281+0000","last_undegraded":"2024-09-18T02:06:11.331281+0000","last_fullsized":"2024-09-18T02:06:11.331281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'17","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.320103+0000","last_change":"2024-09-18T02:03:59.541946+0000","last_active":"2024-09-18T02:07:12.320103+0000","last_peered":"2024-09-18T02:07:12.320103+0000","last_clean":"2024-09-18T02:07:12.320103+0000","last_became_active":"2024-09-18T02:03:59.541059+0000","last_became_peered":"2024-09-18T02:03:59.541059+0000","last_unstale":"2024-09-18T02:07:12.320103+0000","last_undegraded":"2024-09-18T02:07:12.320103+0000","last_fullsized":"2024-09-18T02:07:12.320103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.332733+0000","last_change":"2024-09-18T02:03:57.519641+0000","last_active":"2024-09-18T02:06:11.332733+0000","last_peered":"2024-09-18T02:06:11.332733+0000","last_clean":"2024-09-18T02:06:11.332733+0000","last_became_active":"2024-09-18T02:03:57.519272+0000","last_became_peered":"2024-09-18T02:03:57.519272+0000","last_unstale":"2024-09-18T02:06:11.332733+0000","last_undegraded":"2024-09-18T02:06:11.332733+0000","last_fullsized":"2024-09-18T02:06:11.332733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'5","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.319607+0000","last_change":"2024-09-18T02:03:59.545622+0000","last_active":"2024-09-18T02:07:12.319607+0000","last_peered":"2024-09-18T02:07:12.319607+0000","last_clean":"2024-09-18T02:07:12.319607+0000","last_became_active":"2024-09-18T02:03:59.539946+0000","last_became_peered":"2024-09-18T02:03:59.539946+0000","last_unstale":"2024-09-18T02:07:12.319607+0000","last_undegraded":"2024-09-18T02:07:12.319607+0000","last_fullsized":"2024-09-18T02:07:12.319607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.330606+0000","last_change":"2024-09-18T02:03:57.527957+0000","last_active":"2024-09-18T02:06:11.330606+0000","last_peered":"2024-09-18T02:06:11.330606+0000","last_clean":"2024-09-18T02:06:11.330606+0000","last_became_active":"2024-09-18T02:03:57.527102+0000","last_became_peered":"2024-09-18T02:03:57.527102+0000","last_unstale":"2024-09-18T02:06:11.330606+0000","last_undegraded":"2024-09-18T02:06:11.330606+0000","last_fullsized":"2024-09-18T02:06:11.330606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'11","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.318769+0000","last_change":"2024-09-18T02:03:59.543494+0000","last_active":"2024-09-18T02:07:12.318769+0000","last_peered":"2024-09-18T02:07:12.318769+0000","last_clean":"2024-09-18T02:07:12.318769+0000","last_became_active":"2024-09-18T02:03:59.543160+0000","last_became_peered":"2024-09-18T02:03:59.543160+0000","last_unstale":"2024-09-18T02:07:12.318769+0000","last_undegraded":"2024-09-18T02:07:12.318769+0000","last_fullsized":"2024-09-18T02:07:12.318769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:11.334065+0000","last_change":"2024-09-18T02:03:57.525942+0000","last_active":"2024-09-18T02:06:11.334065+0000","last_peered":"2024-09-18T02:06:11.334065+0000","last_clean":"2024-09-18T02:06:11.334065+0000","last_became_active":"2024-09-18T02:03:57.524495+0000","last_became_peered":"2024-09-18T02:03:57.524495+0000","last_unstale":"2024-09-18T02:06:11.334065+0000","last_undegraded":"2024-09-18T02:06:11.334065+0000","last_fullsized":"2024-09-18T02:06:11.334065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.236886+0000","last_change":"2024-09-18T02:04:36.361845+0000","last_active":"2024-09-18T02:07:12.236886+0000","last_peered":"2024-09-18T02:07:12.236886+0000","last_clean":"2024-09-18T02:07:12.236886+0000","last_became_active":"2024-09-18T02:04:36.354749+0000","last_became_peered":"2024-09-18T02:04:36.354749+0000","last_unstale":"2024-09-18T02:07:12.236886+0000","last_undegraded":"2024-09-18T02:07:12.236886+0000","last_fullsized":"2024-09-18T02:07:12.236886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.331573+0000","last_change":"2024-09-18T02:03:57.521667+0000","last_active":"2024-09-18T02:06:16.331573+0000","last_peered":"2024-09-18T02:06:16.331573+0000","last_clean":"2024-09-18T02:06:16.331573+0000","last_became_active":"2024-09-18T02:03:57.520623+0000","last_became_peered":"2024-09-18T02:03:57.520623+0000","last_unstale":"2024-09-18T02:06:16.331573+0000","last_undegraded":"2024-09-18T02:06:16.331573+0000","last_fullsized":"2024-09-18T02:06:16.331573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.237812+0000","last_change":"2024-09-18T02:03:59.555647+0000","last_active":"2024-09-18T02:07:12.237812+0000","last_peered":"2024-09-18T02:07:12.237812+0000","last_clean":"2024-09-18T02:07:12.237812+0000","last_became_active":"2024-09-18T02:03:59.555178+0000","last_became_peered":"2024-09-18T02:03:59.555178+0000","last_unstale":"2024-09-18T02:07:12.237812+0000","last_undegraded":"2024-09-18T02:07:12.237812+0000","last_fullsized":"2024-09-18T02:07:12.237812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.332225+0000","last_change":"2024-09-18T02:03:57.519654+0000","last_active":"2024-09-18T02:06:16.332225+0000","last_peered":"2024-09-18T02:06:16.332225+0000","last_clean":"2024-09-18T02:06:16.332225+0000","last_became_active":"2024-09-18T02:03:57.519359+0000","last_became_peered":"2024-09-18T02:03:57.519359+0000","last_unstale":"2024-09-18T02:06:16.332225+0000","last_undegraded":"2024-09-18T02:06:16.332225+0000","last_fullsized":"2024-09-18T02:06:16.332225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.745820+0000","last_change":"2024-09-18T02:03:59.542345+0000","last_active":"2024-09-18T02:07:11.745820+0000","last_peered":"2024-09-18T02:07:11.745820+0000","last_clean":"2024-09-18T02:07:11.745820+0000","last_became_active":"2024-09-18T02:03:59.540444+0000","last_became_peered":"2024-09-18T02:03:59.540444+0000","last_unstale":"2024-09-18T02:07:11.745820+0000","last_undegraded":"2024-09-18T02:07:11.745820+0000","last_fullsized":"2024-09-18T02:07:11.745820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.332414+0000","last_change":"2024-09-18T02:03:57.522898+0000","last_active":"2024-09-18T02:06:16.332414+0000","last_peered":"2024-09-18T02:06:16.332414+0000","last_clean":"2024-09-18T02:06:16.332414+0000","last_became_active":"2024-09-18T02:03:57.521148+0000","last_became_peered":"2024-09-18T02:03:57.521148+0000","last_unstale":"2024-09-18T02:06:16.332414+0000","last_undegraded":"2024-09-18T02:06:16.332414+0000","last_fullsized":"2024-09-18T02:06:16.332414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089536+0000","last_change":"2024-09-18T02:03:59.553902+0000","last_active":"2024-09-18T02:07:12.089536+0000","last_peered":"2024-09-18T02:07:12.089536+0000","last_clean":"2024-09-18T02:07:12.089536+0000","last_became_active":"2024-09-18T02:03:59.553528+0000","last_became_peered":"2024-09-18T02:03:59.553528+0000","last_unstale":"2024-09-18T02:07:12.089536+0000","last_undegraded":"2024-09-18T02:07:12.089536+0000","last_fullsized":"2024-09-18T02:07:12.089536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335487+0000","last_change":"2024-09-18T02:03:57.527928+0000","last_active":"2024-09-18T02:06:16.335487+0000","last_peered":"2024-09-18T02:06:16.335487+0000","last_clean":"2024-09-18T02:06:16.335487+0000","last_became_active":"2024-09-18T02:03:57.526972+0000","last_became_peered":"2024-09-18T02:03:57.526972+0000","last_unstale":"2024-09-18T02:06:16.335487+0000","last_undegraded":"2024-09-18T02:06:16.335487+0000","last_fullsized":"2024-09-18T02:06:16.335487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.748451+0000","last_change":"2024-09-18T02:03:59.546007+0000","last_active":"2024-09-18T02:07:11.748451+0000","last_peered":"2024-09-18T02:07:11.748451+0000","last_clean":"2024-09-18T02:07:11.748451+0000","last_became_active":"2024-09-18T02:03:59.545405+0000","last_became_peered":"2024-09-18T02:03:59.545405+0000","last_unstale":"2024-09-18T02:07:11.748451+0000","last_undegraded":"2024-09-18T02:07:11.748451+0000","last_fullsized":"2024-09-18T02:07:11.748451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335559+0000","last_change":"2024-09-18T02:03:57.522221+0000","last_active":"2024-09-18T02:06:16.335559+0000","last_peered":"2024-09-18T02:06:16.335559+0000","last_clean":"2024-09-18T02:06:16.335559+0000","last_became_active":"2024-09-18T02:03:57.521800+0000","last_became_peered":"2024-09-18T02:03:57.521800+0000","last_unstale":"2024-09-18T02:06:16.335559+0000","last_undegraded":"2024-09-18T02:06:16.335559+0000","last_fullsized":"2024-09-18T02:06:16.335559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'12","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.169531+0000","last_change":"2024-09-18T02:04:36.384511+0000","last_active":"2024-09-18T02:07:12.169531+0000","last_peered":"2024-09-18T02:07:12.169531+0000","last_clean":"2024-09-18T02:07:12.169531+0000","last_became_active":"2024-09-18T02:04:36.357213+0000","last_became_peered":"2024-09-18T02:04:36.357213+0000","last_unstale":"2024-09-18T02:07:12.169531+0000","last_undegraded":"2024-09-18T02:07:12.169531+0000","last_fullsized":"2024-09-18T02:07:12.169531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.335063+0000","last_change":"2024-09-18T02:03:57.531024+0000","last_active":"2024-09-18T02:06:21.335063+0000","last_peered":"2024-09-18T02:06:21.335063+0000","last_clean":"2024-09-18T02:06:21.335063+0000","last_became_active":"2024-09-18T02:03:57.528312+0000","last_became_peered":"2024-09-18T02:03:57.528312+0000","last_unstale":"2024-09-18T02:06:21.335063+0000","last_undegraded":"2024-09-18T02:06:21.335063+0000","last_fullsized":"2024-09-18T02:06:21.335063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.168321+0000","last_change":"2024-09-18T02:03:59.546083+0000","last_active":"2024-09-18T02:07:12.168321+0000","last_peered":"2024-09-18T02:07:12.168321+0000","last_clean":"2024-09-18T02:07:12.168321+0000","last_became_active":"2024-09-18T02:03:59.540283+0000","last_became_peered":"2024-09-18T02:03:59.540283+0000","last_unstale":"2024-09-18T02:07:12.168321+0000","last_undegraded":"2024-09-18T02:07:12.168321+0000","last_fullsized":"2024-09-18T02:07:12.168321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336982+0000","last_change":"2024-09-18T02:03:57.528934+0000","last_active":"2024-09-18T02:06:21.336982+0000","last_peered":"2024-09-18T02:06:21.336982+0000","last_clean":"2024-09-18T02:06:21.336982+0000","last_became_active":"2024-09-18T02:03:57.526363+0000","last_became_peered":"2024-09-18T02:03:57.526363+0000","last_unstale":"2024-09-18T02:06:21.336982+0000","last_undegraded":"2024-09-18T02:06:21.336982+0000","last_fullsized":"2024-09-18T02:06:21.336982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.063992+0000","last_change":"2024-09-18T02:03:57.516751+0000","last_active":"2024-09-18T02:07:12.063992+0000","last_peered":"2024-09-18T02:07:12.063992+0000","last_clean":"2024-09-18T02:07:12.063992+0000","last_became_active":"2024-09-18T02:03:57.516434+0000","last_became_peered":"2024-09-18T02:03:57.516434+0000","last_unstale":"2024-09-18T02:07:12.063992+0000","last_undegraded":"2024-09-18T02:07:12.063992+0000","last_fullsized":"2024-09-18T02:07:12.063992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.320080+0000","last_change":"2024-09-18T02:03:59.551182+0000","last_active":"2024-09-18T02:07:12.320080+0000","last_peered":"2024-09-18T02:07:12.320080+0000","last_clean":"2024-09-18T02:07:12.320080+0000","last_became_active":"2024-09-18T02:03:59.550058+0000","last_became_peered":"2024-09-18T02:03:59.550058+0000","last_unstale":"2024-09-18T02:07:12.320080+0000","last_undegraded":"2024-09-18T02:07:12.320080+0000","last_fullsized":"2024-09-18T02:07:12.320080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.332784+0000","last_change":"2024-09-18T02:03:57.533882+0000","last_active":"2024-09-18T02:06:21.332784+0000","last_peered":"2024-09-18T02:06:21.332784+0000","last_clean":"2024-09-18T02:06:21.332784+0000","last_became_active":"2024-09-18T02:03:57.533324+0000","last_became_peered":"2024-09-18T02:03:57.533324+0000","last_unstale":"2024-09-18T02:06:21.332784+0000","last_undegraded":"2024-09-18T02:06:21.332784+0000","last_fullsized":"2024-09-18T02:06:21.332784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'11","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.320692+0000","last_change":"2024-09-18T02:03:59.542840+0000","last_active":"2024-09-18T02:07:12.320692+0000","last_peered":"2024-09-18T02:07:12.320692+0000","last_clean":"2024-09-18T02:07:12.320692+0000","last_became_active":"2024-09-18T02:03:59.542356+0000","last_became_peered":"2024-09-18T02:03:59.542356+0000","last_unstale":"2024-09-18T02:07:12.320692+0000","last_undegraded":"2024-09-18T02:07:12.320692+0000","last_fullsized":"2024-09-18T02:07:12.320692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1720,"ondisk_log_size":1720,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1593,"num_read_kb":1483,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":474,"ondisk_log_size":474,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705720,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":138326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705721,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":983040,"data_stored":725968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705720,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335512,"statfs":{"total":96636764160,"available":96599564288,"internally_reserved":0,"allocated":1007616,"data_stored":726892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":430080,"data_stored":137902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T02:08:08.780 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.780 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.780 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.781 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.781 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.781 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.781 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.781 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.781 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.781 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.781 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.782 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.782 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.782 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.782 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.782 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.782 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.782 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.782 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.783 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.783 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.783 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.783 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.783 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.783 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.783 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.783 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.784 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.784 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.784 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.784 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.784 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.784 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.784 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.785 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.785 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.785 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.785 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.785 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.785 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.785 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.786 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.786 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.786 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.786 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.786 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.786 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.786 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.786 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.787 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.787 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.787 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.787 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.787 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.787 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.787 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.787 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.788 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.788 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.788 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.788 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.788 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.788 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.788 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.789 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.789 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.789 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.789 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.789 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.789 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.789 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.789 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.790 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.790 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T02:03:42.235832+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.790 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.790 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.790 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.790 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.790 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.790 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.791 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.791 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.791 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.791 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.791 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.791 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.791 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.792 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.792 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.792 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.792 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.792 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.792 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.792 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.792 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.793 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.793 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.793 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.793 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.793 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.793 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.793 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.794 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.794 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.794 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.794 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.794 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.794 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.794 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.795 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.795 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.795 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.795 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.795 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.795 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.795 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.796 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.796 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.796 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.796 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.796 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.796 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.796 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.797 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.797 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.797 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.797 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.797 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.797 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.797 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.798 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.798 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.798 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.798 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.798 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.798 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.798 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.798 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.799 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.799 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.799 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.799 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.799 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.799 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.799 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.800 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-18T02:04:02.535177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=2, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.800 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-18T02:04:04.548700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.800 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.800 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.800 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.800 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.800 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.800 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.801 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.801 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.801 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.801 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.801 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.801 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.801 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.802 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.802 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.802 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.802 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.802 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.802 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.802 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.802 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.802 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.803 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.803 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.803 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.803 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.803 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.803 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.803 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.804 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.804 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.804 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.804 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.804 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.804 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.804 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.804 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.805 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.805 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.805 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:08.805 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T02:08:28.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T02:08:28.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.932+0000 7f8002498640 1 Processor -- start 2024-09-18T02:08:28.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.932+0000 7f8002498640 1 -- start start 2024-09-18T02:08:28.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.932+0000 7f8002498640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ffc12e760 0x7f7ffc12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:08:28.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.932+0000 7f8002498640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ffc0984f0 con 0x7f7ffc12f1c0 2024-09-18T02:08:28.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.932+0000 7f8002498640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7ffc098dc0 con 0x7f7ffc12e760 2024-09-18T02:08:28.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f7ffbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ffc12e760 0x7f7ffc12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:08:28.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f7ffb7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7ffc12f1c0 0x7f7ffc12b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40906/0 (socket says 172.21.15.81:40906) 2024-09-18T02:08:28.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f7ffb7fe640 1 -- 172.21.15.81:0/2629175067 learned_addr learned my addr 172.21.15.81:0/2629175067 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:08:28.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f7ffbfff640 1 -- 172.21.15.81:0/2629175067 >> v1:172.21.15.81:6789/0 conn(0x7f7ffc12f1c0 legacy=0x7f7ffc12b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:28.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f7ffaffd640 1 -- 172.21.15.81:0/2629175067 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050145964 0 0) 0x7f7ffc0984f0 con 0x7f7ffc12f1c0 2024-09-18T02:08:28.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f7ffbfff640 1 -- 172.21.15.81:0/2629175067 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc12f5a0 con 0x7f7ffc12e760 2024-09-18T02:08:28.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f7ffbfff640 1 --2- 172.21.15.81:0/2629175067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc12e760 0x7f7ffc12ec80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009d90 tx=0x7f7ff401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347c80ebe1f6c15b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:08:28.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f7ffaffd640 1 -- 172.21.15.81:0/2629175067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff40b2070 con 0x7f7ffc12e760 2024-09-18T02:08:28.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f7ffaffd640 1 -- 172.21.15.81:0/2629175067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff40a56f0 con 0x7f7ffc12e760 2024-09-18T02:08:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f7ffaffd640 1 -- 172.21.15.81:0/2629175067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff40a59f0 con 0x7f7ffc12e760 2024-09-18T02:08:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f8002498640 1 -- 172.21.15.81:0/2629175067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc12e760 msgr2=0x7f7ffc12ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f8002498640 1 --2- 172.21.15.81:0/2629175067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc12e760 0x7f7ffc12ec80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009d90 tx=0x7f7ff401c950 comp rx=0 tx=0).stop 2024-09-18T02:08:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f8002498640 1 -- 172.21.15.81:0/2629175067 shutdown_connections 2024-09-18T02:08:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f8002498640 1 --2- 172.21.15.81:0/2629175067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc12e760 0x7f7ffc12ec80 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:08:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f8002498640 1 -- 172.21.15.81:0/2629175067 >> 172.21.15.81:0/2629175067 conn(0x7f7ffc0a10a0 msgr2=0x7f7ffc0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:08:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f8002498640 1 -- 172.21.15.81:0/2629175067 shutdown_connections 2024-09-18T02:08:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.936+0000 7f8002498640 1 -- 172.21.15.81:0/2629175067 wait complete. 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f8002498640 1 Processor -- start 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f8002498640 1 -- start start 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f8002498640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc12e760 0x7f7ffc1309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f8002498640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc136e30 con 0x7f7ffc12e760 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc12e760 0x7f7ffc1309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc12e760 0x7f7ffc1309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33396/0 (socket says 172.21.15.81:33396) 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ffbfff640 1 -- 172.21.15.81:0/732006540 learned_addr learned my addr 172.21.15.81:0/732006540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ffbfff640 1 -- 172.21.15.81:0/732006540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc132f70 con 0x7f7ffc12e760 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ffbfff640 1 --2- 172.21.15.81:0/732006540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc12e760 0x7f7ffc1309e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7ff401a580 tx=0x7f7ff40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ff8ff9640 1 -- 172.21.15.81:0/732006540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff40bd030 con 0x7f7ffc12e760 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ff8ff9640 1 -- 172.21.15.81:0/732006540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff40b8470 con 0x7f7ffc12e760 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ff8ff9640 1 -- 172.21.15.81:0/732006540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff40b2040 con 0x7f7ffc12e760 2024-09-18T02:08:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f8002498640 1 -- 172.21.15.81:0/732006540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ffc133430 con 0x7f7ffc12e760 2024-09-18T02:08:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f8002498640 1 -- 172.21.15.81:0/732006540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ffc130f20 con 0x7f7ffc12e760 2024-09-18T02:08:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ff8ff9640 1 -- 172.21.15.81:0/732006540 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ff40c0070 con 0x7f7ffc12e760 2024-09-18T02:08:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f8002498640 1 -- 172.21.15.81:0/732006540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ffc132300 con 0x7f7ffc12e760 2024-09-18T02:08:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ff8ff9640 1 --2- 172.21.15.81:0/732006540 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7fdc035db0 0x7f7fdc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:08:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ff8ff9640 1 -- 172.21.15.81:0/732006540 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7ff40be070 con 0x7f7ffc12e760 2024-09-18T02:08:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.940+0000 7f7ffb7fe640 1 --2- 172.21.15.81:0/732006540 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7fdc035db0 0x7f7fdc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:08:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.944+0000 7f7ffb7fe640 1 --2- 172.21.15.81:0/732006540 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7fdc035db0 0x7f7fdc038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4007fd0 tx=0x7f7fe4007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:08:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:28.948+0000 7f7ff8ff9640 1 -- 172.21.15.81:0/732006540 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ff40c7070 con 0x7f7ffc12e760 2024-09-18T02:08:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.104+0000 7f8002498640 1 -- 172.21.15.81:0/732006540 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ffc12ec80 con 0x7f7fdc035db0 2024-09-18T02:08:29.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.148+0000 7f7ff8ff9640 1 -- 172.21.15.81:0/732006540 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661889 (secure 0 0 0) 0x7f7ffc12ec80 con 0x7f7fdc035db0 2024-09-18T02:08:29.155 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:08:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T02:08:29.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.156+0000 7f8002498640 1 -- 172.21.15.81:0/732006540 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7fdc035db0 msgr2=0x7f7fdc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:29.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.156+0000 7f8002498640 1 --2- 172.21.15.81:0/732006540 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7fdc035db0 0x7f7fdc038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4007fd0 tx=0x7f7fe4007980 comp rx=0 tx=0).stop 2024-09-18T02:08:29.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.156+0000 7f8002498640 1 -- 172.21.15.81:0/732006540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc12e760 msgr2=0x7f7ffc1309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.156+0000 7f8002498640 1 --2- 172.21.15.81:0/732006540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc12e760 0x7f7ffc1309e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7ff401a580 tx=0x7f7ff40196f0 comp rx=0 tx=0).stop 2024-09-18T02:08:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.156+0000 7f8002498640 1 -- 172.21.15.81:0/732006540 shutdown_connections 2024-09-18T02:08:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.156+0000 7f8002498640 1 --2- 172.21.15.81:0/732006540 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f7fdc035db0 0x7f7fdc038270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:08:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.156+0000 7f8002498640 1 --2- 172.21.15.81:0/732006540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc12e760 0x7f7ffc1309e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:08:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.156+0000 7f8002498640 1 -- 172.21.15.81:0/732006540 >> 172.21.15.81:0/732006540 conn(0x7f7ffc0a10a0 msgr2=0x7f7ffc12c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:08:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.156+0000 7f8002498640 1 -- 172.21.15.81:0/732006540 shutdown_connections 2024-09-18T02:08:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:29.156+0000 7f8002498640 1 -- 172.21.15.81:0/732006540 wait complete. 2024-09-18T02:08:29.172 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-18T02:08:27.369539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5363,"num_read_kb":4916,"num_write":2373,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5007,"ondisk_log_size":5007,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160832,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326528,"statfs":{"total":386547056640,"available":386382364672,"internally_reserved":0,"allocated":2883584,"data_stored":1729088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":519,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005993"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.548545+0000","last_change":"2024-09-18T02:03:57.517243+0000","last_active":"2024-09-18T02:07:47.548545+0000","last_peered":"2024-09-18T02:07:47.548545+0000","last_clean":"2024-09-18T02:07:47.548545+0000","last_became_active":"2024-09-18T02:03:57.516420+0000","last_became_peered":"2024-09-18T02:03:57.516420+0000","last_unstale":"2024-09-18T02:07:47.548545+0000","last_undegraded":"2024-09-18T02:07:47.548545+0000","last_fullsized":"2024-09-18T02:07:47.548545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.725117+0000","last_change":"2024-09-18T02:08:15.725179+0000","last_active":"2024-09-18T02:08:15.725117+0000","last_peered":"2024-09-18T02:08:15.725117+0000","last_clean":"2024-09-18T02:08:15.725117+0000","last_became_active":"2024-09-18T02:03:59.545294+0000","last_became_peered":"2024-09-18T02:03:59.545294+0000","last_unstale":"2024-09-18T02:08:15.725117+0000","last_undegraded":"2024-09-18T02:08:15.725117+0000","last_fullsized":"2024-09-18T02:08:15.725117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:15.724888+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:15.724888+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.724888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:28.872984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.140060+0000","last_change":"2024-09-18T02:08:18.140213+0000","last_active":"2024-09-18T02:08:18.140060+0000","last_peered":"2024-09-18T02:08:18.140060+0000","last_clean":"2024-09-18T02:08:18.140060+0000","last_became_active":"2024-09-18T02:03:57.533332+0000","last_became_peered":"2024-09-18T02:03:57.533332+0000","last_unstale":"2024-09-18T02:08:18.140060+0000","last_undegraded":"2024-09-18T02:08:18.140060+0000","last_fullsized":"2024-09-18T02:08:18.140060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:18.139828+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:18.139828+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.139828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:54.394230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.270228+0000","last_change":"2024-09-18T02:08:26.270290+0000","last_active":"2024-09-18T02:08:26.270228+0000","last_peered":"2024-09-18T02:08:26.270228+0000","last_clean":"2024-09-18T02:08:26.270228+0000","last_became_active":"2024-09-18T02:03:59.553641+0000","last_became_peered":"2024-09-18T02:03:59.553641+0000","last_unstale":"2024-09-18T02:08:26.270228+0000","last_undegraded":"2024-09-18T02:08:26.270228+0000","last_fullsized":"2024-09-18T02:08:26.270228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:26.270034+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:26.270034+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.270034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:39.424938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996642+0000","last_change":"2024-09-18T02:03:57.532939+0000","last_active":"2024-09-18T02:07:47.996642+0000","last_peered":"2024-09-18T02:07:47.996642+0000","last_clean":"2024-09-18T02:07:47.996642+0000","last_became_active":"2024-09-18T02:03:57.532561+0000","last_became_peered":"2024-09-18T02:03:57.532561+0000","last_unstale":"2024-09-18T02:07:47.996642+0000","last_undegraded":"2024-09-18T02:07:47.996642+0000","last_fullsized":"2024-09-18T02:07:47.996642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.089217+0000","last_change":"2024-09-18T02:03:59.552858+0000","last_active":"2024-09-18T02:07:12.089217+0000","last_peered":"2024-09-18T02:07:12.089217+0000","last_clean":"2024-09-18T02:07:12.089217+0000","last_became_active":"2024-09-18T02:03:59.551661+0000","last_became_peered":"2024-09-18T02:03:59.551661+0000","last_unstale":"2024-09-18T02:07:12.089217+0000","last_undegraded":"2024-09-18T02:07:12.089217+0000","last_fullsized":"2024-09-18T02:07:12.089217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.548518+0000","last_change":"2024-09-18T02:03:57.523513+0000","last_active":"2024-09-18T02:07:47.548518+0000","last_peered":"2024-09-18T02:07:47.548518+0000","last_clean":"2024-09-18T02:07:47.548518+0000","last_became_active":"2024-09-18T02:03:57.522751+0000","last_became_peered":"2024-09-18T02:03:57.522751+0000","last_unstale":"2024-09-18T02:07:47.548518+0000","last_undegraded":"2024-09-18T02:07:47.548518+0000","last_fullsized":"2024-09-18T02:07:47.548518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339247+0000","last_change":"2024-09-18T02:03:59.553228+0000","last_active":"2024-09-18T02:06:31.339247+0000","last_peered":"2024-09-18T02:06:31.339247+0000","last_clean":"2024-09-18T02:06:31.339247+0000","last_became_active":"2024-09-18T02:03:59.552797+0000","last_became_peered":"2024-09-18T02:03:59.552797+0000","last_unstale":"2024-09-18T02:06:31.339247+0000","last_undegraded":"2024-09-18T02:06:31.339247+0000","last_fullsized":"2024-09-18T02:06:31.339247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339266+0000","last_change":"2024-09-18T02:03:57.525148+0000","last_active":"2024-09-18T02:06:31.339266+0000","last_peered":"2024-09-18T02:06:31.339266+0000","last_clean":"2024-09-18T02:06:31.339266+0000","last_became_active":"2024-09-18T02:03:57.524645+0000","last_became_peered":"2024-09-18T02:03:57.524645+0000","last_unstale":"2024-09-18T02:06:31.339266+0000","last_undegraded":"2024-09-18T02:06:31.339266+0000","last_fullsized":"2024-09-18T02:06:31.339266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.702905+0000","last_change":"2024-09-18T02:08:20.702972+0000","last_active":"2024-09-18T02:08:20.702905+0000","last_peered":"2024-09-18T02:08:20.702905+0000","last_clean":"2024-09-18T02:08:20.702905+0000","last_became_active":"2024-09-18T02:03:59.542238+0000","last_became_peered":"2024-09-18T02:03:59.542238+0000","last_unstale":"2024-09-18T02:08:20.702905+0000","last_undegraded":"2024-09-18T02:08:20.702905+0000","last_fullsized":"2024-09-18T02:08:20.702905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:20.702716+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:20.702716+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.702716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:13:21.865480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.337294+0000","last_change":"2024-09-18T02:03:57.523116+0000","last_active":"2024-09-18T02:06:31.337294+0000","last_peered":"2024-09-18T02:06:31.337294+0000","last_clean":"2024-09-18T02:06:31.337294+0000","last_became_active":"2024-09-18T02:03:57.520647+0000","last_became_peered":"2024-09-18T02:03:57.520647+0000","last_unstale":"2024-09-18T02:06:31.337294+0000","last_undegraded":"2024-09-18T02:06:31.337294+0000","last_fullsized":"2024-09-18T02:06:31.337294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.302996+0000","last_change":"2024-09-18T02:08:18.303055+0000","last_active":"2024-09-18T02:08:18.302996+0000","last_peered":"2024-09-18T02:08:18.302996+0000","last_clean":"2024-09-18T02:08:18.302996+0000","last_became_active":"2024-09-18T02:03:59.559273+0000","last_became_peered":"2024-09-18T02:03:59.559273+0000","last_unstale":"2024-09-18T02:08:18.302996+0000","last_undegraded":"2024-09-18T02:08:18.302996+0000","last_fullsized":"2024-09-18T02:08:18.302996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:18.302810+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:18.302810+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.302810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:28:54.454876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.682302+0000","last_change":"2024-09-18T02:03:57.528855+0000","last_active":"2024-09-18T02:07:11.682302+0000","last_peered":"2024-09-18T02:07:11.682302+0000","last_clean":"2024-09-18T02:07:11.682302+0000","last_became_active":"2024-09-18T02:03:57.526953+0000","last_became_peered":"2024-09-18T02:03:57.526953+0000","last_unstale":"2024-09-18T02:07:11.682302+0000","last_undegraded":"2024-09-18T02:07:11.682302+0000","last_fullsized":"2024-09-18T02:07:11.682302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.549091+0000","last_change":"2024-09-18T02:03:59.541576+0000","last_active":"2024-09-18T02:07:47.549091+0000","last_peered":"2024-09-18T02:07:47.549091+0000","last_clean":"2024-09-18T02:07:47.549091+0000","last_became_active":"2024-09-18T02:03:59.541086+0000","last_became_peered":"2024-09-18T02:03:59.541086+0000","last_unstale":"2024-09-18T02:07:47.549091+0000","last_undegraded":"2024-09-18T02:07:47.549091+0000","last_fullsized":"2024-09-18T02:07:47.549091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.335376+0000","last_change":"2024-09-18T02:03:57.524285+0000","last_active":"2024-09-18T02:06:31.335376+0000","last_peered":"2024-09-18T02:06:31.335376+0000","last_clean":"2024-09-18T02:06:31.335376+0000","last_became_active":"2024-09-18T02:03:57.520343+0000","last_became_peered":"2024-09-18T02:03:57.520343+0000","last_unstale":"2024-09-18T02:06:31.335376+0000","last_undegraded":"2024-09-18T02:06:31.335376+0000","last_fullsized":"2024-09-18T02:06:31.335376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'12","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.258142+0000","last_change":"2024-09-18T02:08:14.258205+0000","last_active":"2024-09-18T02:08:14.258142+0000","last_peered":"2024-09-18T02:08:14.258142+0000","last_clean":"2024-09-18T02:08:14.258142+0000","last_became_active":"2024-09-18T02:03:59.533956+0000","last_became_peered":"2024-09-18T02:03:59.533956+0000","last_unstale":"2024-09-18T02:08:14.258142+0000","last_undegraded":"2024-09-18T02:08:14.258142+0000","last_fullsized":"2024-09-18T02:08:14.258142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:14.257948+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:14.257948+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.257948+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:21:09.261976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.238532+0000","last_change":"2024-09-18T02:03:59.537124+0000","last_active":"2024-09-18T02:07:12.238532+0000","last_peered":"2024-09-18T02:07:12.238532+0000","last_clean":"2024-09-18T02:07:12.238532+0000","last_became_active":"2024-09-18T02:03:59.536739+0000","last_became_peered":"2024-09-18T02:03:59.536739+0000","last_unstale":"2024-09-18T02:07:12.238532+0000","last_undegraded":"2024-09-18T02:07:12.238532+0000","last_fullsized":"2024-09-18T02:07:12.238532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.335039+0000","last_change":"2024-09-18T02:03:57.523985+0000","last_active":"2024-09-18T02:06:26.335039+0000","last_peered":"2024-09-18T02:06:26.335039+0000","last_clean":"2024-09-18T02:06:26.335039+0000","last_became_active":"2024-09-18T02:03:57.523437+0000","last_became_peered":"2024-09-18T02:03:57.523437+0000","last_unstale":"2024-09-18T02:06:26.335039+0000","last_undegraded":"2024-09-18T02:06:26.335039+0000","last_fullsized":"2024-09-18T02:06:26.335039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.685034+0000","last_change":"2024-09-18T02:08:19.685100+0000","last_active":"2024-09-18T02:08:19.685034+0000","last_peered":"2024-09-18T02:08:19.685034+0000","last_clean":"2024-09-18T02:08:19.685034+0000","last_became_active":"2024-09-18T02:03:59.539778+0000","last_became_peered":"2024-09-18T02:03:59.539778+0000","last_unstale":"2024-09-18T02:08:19.685034+0000","last_undegraded":"2024-09-18T02:08:19.685034+0000","last_fullsized":"2024-09-18T02:08:19.685034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:19.684812+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:19.684812+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.684812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:00:25.843568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.246553+0000","last_change":"2024-09-18T02:08:24.246624+0000","last_active":"2024-09-18T02:08:24.246553+0000","last_peered":"2024-09-18T02:08:24.246553+0000","last_clean":"2024-09-18T02:08:24.246553+0000","last_became_active":"2024-09-18T02:03:57.524578+0000","last_became_peered":"2024-09-18T02:03:57.524578+0000","last_unstale":"2024-09-18T02:08:24.246553+0000","last_undegraded":"2024-09-18T02:08:24.246553+0000","last_fullsized":"2024-09-18T02:08:24.246553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:24.246331+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:24.246331+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.246331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:29.967247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.333593+0000","last_change":"2024-09-18T02:03:59.546276+0000","last_active":"2024-09-18T02:06:21.333593+0000","last_peered":"2024-09-18T02:06:21.333593+0000","last_clean":"2024-09-18T02:06:21.333593+0000","last_became_active":"2024-09-18T02:03:59.545902+0000","last_became_peered":"2024-09-18T02:03:59.545902+0000","last_unstale":"2024-09-18T02:06:21.333593+0000","last_undegraded":"2024-09-18T02:06:21.333593+0000","last_fullsized":"2024-09-18T02:06:21.333593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334920+0000","last_change":"2024-09-18T02:03:57.523592+0000","last_active":"2024-09-18T02:06:26.334920+0000","last_peered":"2024-09-18T02:06:26.334920+0000","last_clean":"2024-09-18T02:06:26.334920+0000","last_became_active":"2024-09-18T02:03:57.523211+0000","last_became_peered":"2024-09-18T02:03:57.523211+0000","last_unstale":"2024-09-18T02:06:26.334920+0000","last_undegraded":"2024-09-18T02:06:26.334920+0000","last_fullsized":"2024-09-18T02:06:26.334920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.051190+0000","last_change":"2024-09-18T02:08:25.051257+0000","last_active":"2024-09-18T02:08:25.051190+0000","last_peered":"2024-09-18T02:08:25.051190+0000","last_clean":"2024-09-18T02:08:25.051190+0000","last_became_active":"2024-09-18T02:03:59.539198+0000","last_became_peered":"2024-09-18T02:03:59.539198+0000","last_unstale":"2024-09-18T02:08:25.051190+0000","last_undegraded":"2024-09-18T02:08:25.051190+0000","last_fullsized":"2024-09-18T02:08:25.051190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:25.050963+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:25.050963+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.050963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:35:55.015533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334897+0000","last_change":"2024-09-18T02:03:57.523263+0000","last_active":"2024-09-18T02:06:26.334897+0000","last_peered":"2024-09-18T02:06:26.334897+0000","last_clean":"2024-09-18T02:06:26.334897+0000","last_became_active":"2024-09-18T02:03:57.522924+0000","last_became_peered":"2024-09-18T02:03:57.522924+0000","last_unstale":"2024-09-18T02:06:26.334897+0000","last_undegraded":"2024-09-18T02:06:26.334897+0000","last_fullsized":"2024-09-18T02:06:26.334897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.214173+0000","last_change":"2024-09-18T02:08:21.214261+0000","last_active":"2024-09-18T02:08:21.214173+0000","last_peered":"2024-09-18T02:08:21.214173+0000","last_clean":"2024-09-18T02:08:21.214173+0000","last_became_active":"2024-09-18T02:03:59.538126+0000","last_became_peered":"2024-09-18T02:03:59.538126+0000","last_unstale":"2024-09-18T02:08:21.214173+0000","last_undegraded":"2024-09-18T02:08:21.214173+0000","last_fullsized":"2024-09-18T02:08:21.214173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:21.213960+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:21.213960+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.213960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:52.543767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334036+0000","last_change":"2024-09-18T02:03:57.524373+0000","last_active":"2024-09-18T02:06:26.334036+0000","last_peered":"2024-09-18T02:06:26.334036+0000","last_clean":"2024-09-18T02:06:26.334036+0000","last_became_active":"2024-09-18T02:03:57.521019+0000","last_became_peered":"2024-09-18T02:03:57.521019+0000","last_unstale":"2024-09-18T02:06:26.334036+0000","last_undegraded":"2024-09-18T02:06:26.334036+0000","last_fullsized":"2024-09-18T02:06:26.334036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.739233+0000","last_change":"2024-09-18T02:08:22.739297+0000","last_active":"2024-09-18T02:08:22.739233+0000","last_peered":"2024-09-18T02:08:22.739233+0000","last_clean":"2024-09-18T02:08:22.739233+0000","last_became_active":"2024-09-18T02:03:59.540553+0000","last_became_peered":"2024-09-18T02:03:59.540553+0000","last_unstale":"2024-09-18T02:08:22.739233+0000","last_undegraded":"2024-09-18T02:08:22.739233+0000","last_fullsized":"2024-09-18T02:08:22.739233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:22.739006+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:22.739006+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.739006+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:49.648220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336674+0000","last_change":"2024-09-18T02:03:57.527852+0000","last_active":"2024-09-18T02:06:21.336674+0000","last_peered":"2024-09-18T02:06:21.336674+0000","last_clean":"2024-09-18T02:06:21.336674+0000","last_became_active":"2024-09-18T02:03:57.526917+0000","last_became_peered":"2024-09-18T02:03:57.526917+0000","last_unstale":"2024-09-18T02:06:21.336674+0000","last_undegraded":"2024-09-18T02:06:21.336674+0000","last_fullsized":"2024-09-18T02:06:21.336674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.262185+0000","last_change":"2024-09-18T02:04:07.624724+0000","last_active":"2024-09-18T02:07:12.262185+0000","last_peered":"2024-09-18T02:07:12.262185+0000","last_clean":"2024-09-18T02:07:12.262185+0000","last_became_active":"2024-09-18T02:04:07.624037+0000","last_became_peered":"2024-09-18T02:04:07.624037+0000","last_unstale":"2024-09-18T02:07:12.262185+0000","last_undegraded":"2024-09-18T02:07:12.262185+0000","last_fullsized":"2024-09-18T02:07:12.262185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.088153+0000","last_change":"2024-09-18T02:03:59.545658+0000","last_active":"2024-09-18T02:07:12.088153+0000","last_peered":"2024-09-18T02:07:12.088153+0000","last_clean":"2024-09-18T02:07:12.088153+0000","last_became_active":"2024-09-18T02:03:59.538409+0000","last_became_peered":"2024-09-18T02:03:59.538409+0000","last_unstale":"2024-09-18T02:07:12.088153+0000","last_undegraded":"2024-09-18T02:07:12.088153+0000","last_fullsized":"2024-09-18T02:07:12.088153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.389719+0000","last_change":"2024-09-18T02:03:57.533041+0000","last_active":"2024-09-18T02:07:43.389719+0000","last_peered":"2024-09-18T02:07:43.389719+0000","last_clean":"2024-09-18T02:07:43.389719+0000","last_became_active":"2024-09-18T02:03:57.532657+0000","last_became_peered":"2024-09-18T02:03:57.532657+0000","last_unstale":"2024-09-18T02:07:43.389719+0000","last_undegraded":"2024-09-18T02:07:43.389719+0000","last_fullsized":"2024-09-18T02:07:43.389719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.360622+0000","last_change":"2024-09-18T02:07:51.360784+0000","last_active":"2024-09-18T02:07:51.360622+0000","last_peered":"2024-09-18T02:07:51.360622+0000","last_clean":"2024-09-18T02:07:51.360622+0000","last_became_active":"2024-09-18T02:04:01.562058+0000","last_became_peered":"2024-09-18T02:04:01.562058+0000","last_unstale":"2024-09-18T02:07:51.360622+0000","last_undegraded":"2024-09-18T02:07:51.360622+0000","last_fullsized":"2024-09-18T02:07:51.360622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.360360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.360360+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.360360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:21:46.176795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'51","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.267009+0000","last_change":"2024-09-18T02:08:14.267100+0000","last_active":"2024-09-18T02:08:14.267009+0000","last_peered":"2024-09-18T02:08:14.267009+0000","last_clean":"2024-09-18T02:08:14.267009+0000","last_became_active":"2024-09-18T02:04:03.600467+0000","last_became_peered":"2024-09-18T02:04:03.600467+0000","last_unstale":"2024-09-18T02:08:14.267009+0000","last_undegraded":"2024-09-18T02:08:14.267009+0000","last_fullsized":"2024-09-18T02:08:14.267009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-18T02:08:14.266804+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-18T02:08:14.266804+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.266804+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:00.903374+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.891970+0000","last_change":"2024-09-18T02:08:00.892026+0000","last_active":"2024-09-18T02:08:00.891970+0000","last_peered":"2024-09-18T02:08:00.891970+0000","last_clean":"2024-09-18T02:08:00.891970+0000","last_became_active":"2024-09-18T02:04:05.592934+0000","last_became_peered":"2024-09-18T02:04:05.592934+0000","last_unstale":"2024-09-18T02:08:00.891970+0000","last_undegraded":"2024-09-18T02:08:00.891970+0000","last_fullsized":"2024-09-18T02:08:00.891970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:00.891781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:00.891781+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.891781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:40.385945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:36.337063+0000","last_change":"2024-09-18T02:04:07.624771+0000","last_active":"2024-09-18T02:06:36.337063+0000","last_peered":"2024-09-18T02:06:36.337063+0000","last_clean":"2024-09-18T02:06:36.337063+0000","last_became_active":"2024-09-18T02:04:07.624106+0000","last_became_peered":"2024-09-18T02:04:07.624106+0000","last_unstale":"2024-09-18T02:06:36.337063+0000","last_undegraded":"2024-09-18T02:06:36.337063+0000","last_fullsized":"2024-09-18T02:06:36.337063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.231143+0000","last_change":"2024-09-18T02:08:22.231205+0000","last_active":"2024-09-18T02:08:22.231143+0000","last_peered":"2024-09-18T02:08:22.231143+0000","last_clean":"2024-09-18T02:08:22.231143+0000","last_became_active":"2024-09-18T02:03:59.555956+0000","last_became_peered":"2024-09-18T02:03:59.555956+0000","last_unstale":"2024-09-18T02:08:22.231143+0000","last_undegraded":"2024-09-18T02:08:22.231143+0000","last_fullsized":"2024-09-18T02:08:22.231143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:22.230956+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:22.230956+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.230956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:14.581546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.334895+0000","last_change":"2024-09-18T02:03:57.523303+0000","last_active":"2024-09-18T02:06:21.334895+0000","last_peered":"2024-09-18T02:06:21.334895+0000","last_clean":"2024-09-18T02:06:21.334895+0000","last_became_active":"2024-09-18T02:03:57.523041+0000","last_became_peered":"2024-09-18T02:03:57.523041+0000","last_unstale":"2024-09-18T02:06:21.334895+0000","last_undegraded":"2024-09-18T02:06:21.334895+0000","last_fullsized":"2024-09-18T02:06:21.334895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:56.341443+0000","last_change":"2024-09-18T02:04:36.363414+0000","last_active":"2024-09-18T02:06:56.341443+0000","last_peered":"2024-09-18T02:06:56.341443+0000","last_clean":"2024-09-18T02:06:56.341443+0000","last_became_active":"2024-09-18T02:04:36.362592+0000","last_became_peered":"2024-09-18T02:04:36.362592+0000","last_unstale":"2024-09-18T02:06:56.341443+0000","last_undegraded":"2024-09-18T02:06:56.341443+0000","last_fullsized":"2024-09-18T02:06:56.341443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.117034+0000","last_change":"2024-09-18T02:07:50.117106+0000","last_active":"2024-09-18T02:07:50.117034+0000","last_peered":"2024-09-18T02:07:50.117034+0000","last_clean":"2024-09-18T02:07:50.117034+0000","last_became_active":"2024-09-18T02:04:03.579442+0000","last_became_peered":"2024-09-18T02:04:03.579442+0000","last_unstale":"2024-09-18T02:07:50.117034+0000","last_undegraded":"2024-09-18T02:07:50.117034+0000","last_fullsized":"2024-09-18T02:07:50.117034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-18T02:07:50.116825+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-18T02:07:50.116825+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.116825+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:28.484106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.808455+0000","last_change":"2024-09-18T02:08:04.808508+0000","last_active":"2024-09-18T02:08:04.808455+0000","last_peered":"2024-09-18T02:08:04.808455+0000","last_clean":"2024-09-18T02:08:04.808455+0000","last_became_active":"2024-09-18T02:04:05.605774+0000","last_became_peered":"2024-09-18T02:04:05.605774+0000","last_unstale":"2024-09-18T02:08:04.808455+0000","last_undegraded":"2024-09-18T02:08:04.808455+0000","last_fullsized":"2024-09-18T02:08:04.808455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:04.808264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:04.808264+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.808264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:41:47.654931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.890438+0000","last_change":"2024-09-18T02:04:07.610794+0000","last_active":"2024-09-18T02:07:11.890438+0000","last_peered":"2024-09-18T02:07:11.890438+0000","last_clean":"2024-09-18T02:07:11.890438+0000","last_became_active":"2024-09-18T02:04:07.610120+0000","last_became_peered":"2024-09-18T02:04:07.610120+0000","last_unstale":"2024-09-18T02:07:11.890438+0000","last_undegraded":"2024-09-18T02:07:11.890438+0000","last_fullsized":"2024-09-18T02:07:11.890438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'18","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.747536+0000","last_change":"2024-09-18T02:04:36.373755+0000","last_active":"2024-09-18T02:07:11.747536+0000","last_peered":"2024-09-18T02:07:11.747536+0000","last_clean":"2024-09-18T02:07:11.747536+0000","last_became_active":"2024-09-18T02:04:36.359108+0000","last_became_peered":"2024-09-18T02:04:36.359108+0000","last_unstale":"2024-09-18T02:07:11.747536+0000","last_undegraded":"2024-09-18T02:07:11.747536+0000","last_fullsized":"2024-09-18T02:07:11.747536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.390455+0000","last_change":"2024-09-18T02:03:57.533341+0000","last_active":"2024-09-18T02:07:43.390455+0000","last_peered":"2024-09-18T02:07:43.390455+0000","last_clean":"2024-09-18T02:07:43.390455+0000","last_became_active":"2024-09-18T02:03:57.533037+0000","last_became_peered":"2024-09-18T02:03:57.533037+0000","last_unstale":"2024-09-18T02:07:43.390455+0000","last_undegraded":"2024-09-18T02:07:43.390455+0000","last_fullsized":"2024-09-18T02:07:43.390455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.236175+0000","last_change":"2024-09-18T02:08:06.236244+0000","last_active":"2024-09-18T02:08:06.236175+0000","last_peered":"2024-09-18T02:08:06.236175+0000","last_clean":"2024-09-18T02:08:06.236175+0000","last_became_active":"2024-09-18T02:04:01.567287+0000","last_became_peered":"2024-09-18T02:04:01.567287+0000","last_unstale":"2024-09-18T02:08:06.236175+0000","last_undegraded":"2024-09-18T02:08:06.236175+0000","last_fullsized":"2024-09-18T02:08:06.236175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-18T02:08:06.235937+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-18T02:08:06.235937+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.235937+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:02.660438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'30","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.284405+0000","last_change":"2024-09-18T02:08:01.284486+0000","last_active":"2024-09-18T02:08:01.284405+0000","last_peered":"2024-09-18T02:08:01.284405+0000","last_clean":"2024-09-18T02:08:01.284405+0000","last_became_active":"2024-09-18T02:04:03.581092+0000","last_became_peered":"2024-09-18T02:04:03.581092+0000","last_unstale":"2024-09-18T02:08:01.284405+0000","last_undegraded":"2024-09-18T02:08:01.284405+0000","last_fullsized":"2024-09-18T02:08:01.284405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-09-18T02:08:01.284176+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-09-18T02:08:01.284176+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.284176+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:52.879851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.250032+0000","last_change":"2024-09-18T02:08:12.250165+0000","last_active":"2024-09-18T02:08:12.250032+0000","last_peered":"2024-09-18T02:08:12.250032+0000","last_clean":"2024-09-18T02:08:12.250032+0000","last_became_active":"2024-09-18T02:04:05.607733+0000","last_became_peered":"2024-09-18T02:04:05.607733+0000","last_unstale":"2024-09-18T02:08:12.250032+0000","last_undegraded":"2024-09-18T02:08:12.250032+0000","last_fullsized":"2024-09-18T02:08:12.250032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:08:12.249802+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:08:12.249802+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.249802+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:58.146750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:41.339565+0000","last_change":"2024-09-18T02:04:07.631363+0000","last_active":"2024-09-18T02:06:41.339565+0000","last_peered":"2024-09-18T02:06:41.339565+0000","last_clean":"2024-09-18T02:06:41.339565+0000","last_became_active":"2024-09-18T02:04:07.630721+0000","last_became_peered":"2024-09-18T02:04:07.630721+0000","last_unstale":"2024-09-18T02:06:41.339565+0000","last_undegraded":"2024-09-18T02:06:41.339565+0000","last_fullsized":"2024-09-18T02:06:41.339565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.746653+0000","last_change":"2024-09-18T02:03:59.550519+0000","last_active":"2024-09-18T02:07:11.746653+0000","last_peered":"2024-09-18T02:07:11.746653+0000","last_clean":"2024-09-18T02:07:11.746653+0000","last_became_active":"2024-09-18T02:03:59.548365+0000","last_became_peered":"2024-09-18T02:03:59.548365+0000","last_unstale":"2024-09-18T02:07:11.746653+0000","last_undegraded":"2024-09-18T02:07:11.746653+0000","last_fullsized":"2024-09-18T02:07:11.746653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.390201+0000","last_change":"2024-09-18T02:03:57.521018+0000","last_active":"2024-09-18T02:07:43.390201+0000","last_peered":"2024-09-18T02:07:43.390201+0000","last_clean":"2024-09-18T02:07:43.390201+0000","last_became_active":"2024-09-18T02:03:57.520706+0000","last_became_peered":"2024-09-18T02:03:57.520706+0000","last_unstale":"2024-09-18T02:07:43.390201+0000","last_undegraded":"2024-09-18T02:07:43.390201+0000","last_fullsized":"2024-09-18T02:07:43.390201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.277690+0000","last_change":"2024-09-18T02:07:53.277755+0000","last_active":"2024-09-18T02:07:53.277690+0000","last_peered":"2024-09-18T02:07:53.277690+0000","last_clean":"2024-09-18T02:07:53.277690+0000","last_became_active":"2024-09-18T02:04:01.559249+0000","last_became_peered":"2024-09-18T02:04:01.559249+0000","last_unstale":"2024-09-18T02:07:53.277690+0000","last_undegraded":"2024-09-18T02:07:53.277690+0000","last_fullsized":"2024-09-18T02:07:53.277690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:07:53.277506+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:07:53.277506+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.277506+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:50.677514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'43","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.342497+0000","last_change":"2024-09-18T02:08:04.342570+0000","last_active":"2024-09-18T02:08:04.342497+0000","last_peered":"2024-09-18T02:08:04.342497+0000","last_clean":"2024-09-18T02:08:04.342497+0000","last_became_active":"2024-09-18T02:04:03.580310+0000","last_became_peered":"2024-09-18T02:04:03.580310+0000","last_unstale":"2024-09-18T02:08:04.342497+0000","last_undegraded":"2024-09-18T02:08:04.342497+0000","last_fullsized":"2024-09-18T02:08:04.342497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:04.342294+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:04.342294+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.342294+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:25.901859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":448,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.219290+0000","last_change":"2024-09-18T02:08:07.219458+0000","last_active":"2024-09-18T02:08:07.219290+0000","last_peered":"2024-09-18T02:08:07.219290+0000","last_clean":"2024-09-18T02:08:07.219290+0000","last_became_active":"2024-09-18T02:04:05.611707+0000","last_became_peered":"2024-09-18T02:04:05.611707+0000","last_unstale":"2024-09-18T02:08:07.219290+0000","last_undegraded":"2024-09-18T02:08:07.219290+0000","last_fullsized":"2024-09-18T02:08:07.219290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:08:07.219074+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:08:07.219074+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.219074+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:05.918033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.227542+0000","last_change":"2024-09-18T02:08:05.227542+0000","last_active":"2024-09-18T02:08:05.227542+0000","last_peered":"2024-09-18T02:08:05.227542+0000","last_clean":"2024-09-18T02:08:05.227542+0000","last_became_active":"2024-09-18T02:03:59.559585+0000","last_became_peered":"2024-09-18T02:03:59.559585+0000","last_unstale":"2024-09-18T02:08:05.227542+0000","last_undegraded":"2024-09-18T02:08:05.227542+0000","last_fullsized":"2024-09-18T02:08:05.227542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:05.227308+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:05.227308+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.227308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:31.984980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.235001+0000","last_change":"2024-09-18T02:08:26.235058+0000","last_active":"2024-09-18T02:08:26.235001+0000","last_peered":"2024-09-18T02:08:26.235001+0000","last_clean":"2024-09-18T02:08:26.235001+0000","last_became_active":"2024-09-18T02:03:57.527575+0000","last_became_peered":"2024-09-18T02:03:57.527575+0000","last_unstale":"2024-09-18T02:08:26.235001+0000","last_undegraded":"2024-09-18T02:08:26.235001+0000","last_fullsized":"2024-09-18T02:08:26.235001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:26.234826+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:26.234826+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.234826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:39.434344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.936141+0000","last_change":"2024-09-18T02:07:58.936141+0000","last_active":"2024-09-18T02:07:58.936141+0000","last_peered":"2024-09-18T02:07:58.936141+0000","last_clean":"2024-09-18T02:07:58.936141+0000","last_became_active":"2024-09-18T02:04:01.569301+0000","last_became_peered":"2024-09-18T02:04:01.569301+0000","last_unstale":"2024-09-18T02:07:58.936141+0000","last_undegraded":"2024-09-18T02:07:58.936141+0000","last_fullsized":"2024-09-18T02:07:58.936141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:58.935889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:58.935889+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.935889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:18.769091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'58","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.362195+0000","last_change":"2024-09-18T02:07:56.362296+0000","last_active":"2024-09-18T02:07:56.362195+0000","last_peered":"2024-09-18T02:07:56.362195+0000","last_clean":"2024-09-18T02:07:56.362195+0000","last_became_active":"2024-09-18T02:04:03.591195+0000","last_became_peered":"2024-09-18T02:04:03.591195+0000","last_unstale":"2024-09-18T02:07:56.362195+0000","last_undegraded":"2024-09-18T02:07:56.362195+0000","last_fullsized":"2024-09-18T02:07:56.362195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'58","last_scrub_stamp":"2024-09-18T02:07:56.361976+0000","last_deep_scrub":"32'58","last_deep_scrub_stamp":"2024-09-18T02:07:56.361976+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.361976+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:50:55.705307+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.187554+0000","last_change":"2024-09-18T02:07:59.187610+0000","last_active":"2024-09-18T02:07:59.187554+0000","last_peered":"2024-09-18T02:07:59.187554+0000","last_clean":"2024-09-18T02:07:59.187554+0000","last_became_active":"2024-09-18T02:04:05.605611+0000","last_became_peered":"2024-09-18T02:04:05.605611+0000","last_unstale":"2024-09-18T02:07:59.187554+0000","last_undegraded":"2024-09-18T02:07:59.187554+0000","last_fullsized":"2024-09-18T02:07:59.187554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:59.187354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:59.187354+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.187354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:48.634059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.286144+0000","last_change":"2024-09-18T02:08:11.286144+0000","last_active":"2024-09-18T02:08:11.286144+0000","last_peered":"2024-09-18T02:08:11.286144+0000","last_clean":"2024-09-18T02:08:11.286144+0000","last_became_active":"2024-09-18T02:04:07.628247+0000","last_became_peered":"2024-09-18T02:04:07.628247+0000","last_unstale":"2024-09-18T02:08:11.286144+0000","last_undegraded":"2024-09-18T02:08:11.286144+0000","last_fullsized":"2024-09-18T02:08:11.286144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:08:11.285863+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:08:11.285863+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.285863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:35.920724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.703080+0000","last_change":"2024-09-18T02:08:21.703212+0000","last_active":"2024-09-18T02:08:21.703080+0000","last_peered":"2024-09-18T02:08:21.703080+0000","last_clean":"2024-09-18T02:08:21.703080+0000","last_became_active":"2024-09-18T02:03:59.535217+0000","last_became_peered":"2024-09-18T02:03:59.535217+0000","last_unstale":"2024-09-18T02:08:21.703080+0000","last_undegraded":"2024-09-18T02:08:21.703080+0000","last_fullsized":"2024-09-18T02:08:21.703080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:21.702848+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:21.702848+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.702848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:57.957250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.207563+0000","last_change":"2024-09-18T02:08:22.207623+0000","last_active":"2024-09-18T02:08:22.207563+0000","last_peered":"2024-09-18T02:08:22.207563+0000","last_clean":"2024-09-18T02:08:22.207563+0000","last_became_active":"2024-09-18T02:03:57.528006+0000","last_became_peered":"2024-09-18T02:03:57.528006+0000","last_unstale":"2024-09-18T02:08:22.207563+0000","last_undegraded":"2024-09-18T02:08:22.207563+0000","last_fullsized":"2024-09-18T02:08:22.207563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:22.207330+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:22.207330+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.207330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:56.517929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:46.340616+0000","last_change":"2024-09-18T02:04:36.358966+0000","last_active":"2024-09-18T02:06:46.340616+0000","last_peered":"2024-09-18T02:06:46.340616+0000","last_clean":"2024-09-18T02:06:46.340616+0000","last_became_active":"2024-09-18T02:04:36.357607+0000","last_became_peered":"2024-09-18T02:04:36.357607+0000","last_unstale":"2024-09-18T02:06:46.340616+0000","last_undegraded":"2024-09-18T02:06:46.340616+0000","last_fullsized":"2024-09-18T02:06:46.340616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'43","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.242680+0000","last_change":"2024-09-18T02:08:10.242764+0000","last_active":"2024-09-18T02:08:10.242680+0000","last_peered":"2024-09-18T02:08:10.242680+0000","last_clean":"2024-09-18T02:08:10.242680+0000","last_became_active":"2024-09-18T02:04:03.601783+0000","last_became_peered":"2024-09-18T02:04:03.601783+0000","last_unstale":"2024-09-18T02:08:10.242680+0000","last_undegraded":"2024-09-18T02:08:10.242680+0000","last_fullsized":"2024-09-18T02:08:10.242680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:10.242501+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:10.242501+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.242501+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:48.817971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.235959+0000","last_change":"2024-09-18T02:07:54.235959+0000","last_active":"2024-09-18T02:07:54.235959+0000","last_peered":"2024-09-18T02:07:54.235959+0000","last_clean":"2024-09-18T02:07:54.235959+0000","last_became_active":"2024-09-18T02:04:05.577665+0000","last_became_peered":"2024-09-18T02:04:05.577665+0000","last_unstale":"2024-09-18T02:07:54.235959+0000","last_undegraded":"2024-09-18T02:07:54.235959+0000","last_fullsized":"2024-09-18T02:07:54.235959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.235697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.235697+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.235697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:59:25.686298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.704604+0000","last_change":"2024-09-18T02:08:16.704604+0000","last_active":"2024-09-18T02:08:16.704604+0000","last_peered":"2024-09-18T02:08:16.704604+0000","last_clean":"2024-09-18T02:08:16.704604+0000","last_became_active":"2024-09-18T02:04:07.619973+0000","last_became_peered":"2024-09-18T02:04:07.619973+0000","last_unstale":"2024-09-18T02:08:16.704604+0000","last_undegraded":"2024-09-18T02:08:16.704604+0000","last_fullsized":"2024-09-18T02:08:16.704604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:16.704356+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:16.704356+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.704356+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:22.425273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.283438+0000","last_change":"2024-09-18T02:08:25.283505+0000","last_active":"2024-09-18T02:08:25.283438+0000","last_peered":"2024-09-18T02:08:25.283438+0000","last_clean":"2024-09-18T02:08:25.283438+0000","last_became_active":"2024-09-18T02:03:59.539105+0000","last_became_peered":"2024-09-18T02:03:59.539105+0000","last_unstale":"2024-09-18T02:08:25.283438+0000","last_undegraded":"2024-09-18T02:08:25.283438+0000","last_fullsized":"2024-09-18T02:08:25.283438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:25.283204+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:25.283204+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.283204+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:35.826881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335530+0000","last_change":"2024-09-18T02:03:57.530707+0000","last_active":"2024-09-18T02:06:16.335530+0000","last_peered":"2024-09-18T02:06:16.335530+0000","last_clean":"2024-09-18T02:06:16.335530+0000","last_became_active":"2024-09-18T02:03:57.526327+0000","last_became_peered":"2024-09-18T02:03:57.526327+0000","last_unstale":"2024-09-18T02:06:16.335530+0000","last_undegraded":"2024-09-18T02:06:16.335530+0000","last_fullsized":"2024-09-18T02:06:16.335530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.210402+0000","last_change":"2024-09-18T02:08:09.210456+0000","last_active":"2024-09-18T02:08:09.210402+0000","last_peered":"2024-09-18T02:08:09.210402+0000","last_clean":"2024-09-18T02:08:09.210402+0000","last_became_active":"2024-09-18T02:04:01.561279+0000","last_became_peered":"2024-09-18T02:04:01.561279+0000","last_unstale":"2024-09-18T02:08:09.210402+0000","last_undegraded":"2024-09-18T02:08:09.210402+0000","last_fullsized":"2024-09-18T02:08:09.210402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:09.210167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:09.210167+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.210167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:48:36.008753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'60","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.236436+0000","last_change":"2024-09-18T02:07:56.236436+0000","last_active":"2024-09-18T02:07:56.236436+0000","last_peered":"2024-09-18T02:07:56.236436+0000","last_clean":"2024-09-18T02:07:56.236436+0000","last_became_active":"2024-09-18T02:04:03.591705+0000","last_became_peered":"2024-09-18T02:04:03.591705+0000","last_unstale":"2024-09-18T02:07:56.236436+0000","last_undegraded":"2024-09-18T02:07:56.236436+0000","last_fullsized":"2024-09-18T02:07:56.236436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2024-09-18T02:07:56.236157+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2024-09-18T02:07:56.236157+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.236157+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:26.464832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":411,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.258507+0000","last_change":"2024-09-18T02:07:47.258507+0000","last_active":"2024-09-18T02:07:47.258507+0000","last_peered":"2024-09-18T02:07:47.258507+0000","last_clean":"2024-09-18T02:07:47.258507+0000","last_became_active":"2024-09-18T02:04:05.591652+0000","last_became_peered":"2024-09-18T02:04:05.591652+0000","last_unstale":"2024-09-18T02:07:47.258507+0000","last_undegraded":"2024-09-18T02:07:47.258507+0000","last_fullsized":"2024-09-18T02:07:47.258507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:47.258352+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:47.258352+0000","last_clean_scrub_stamp":"2024-09-18T02:07:47.258352+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:22.446528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.194279+0000","last_change":"2024-09-18T02:08:11.194435+0000","last_active":"2024-09-18T02:08:11.194279+0000","last_peered":"2024-09-18T02:08:11.194279+0000","last_clean":"2024-09-18T02:08:11.194279+0000","last_became_active":"2024-09-18T02:04:07.609050+0000","last_became_peered":"2024-09-18T02:04:07.609050+0000","last_unstale":"2024-09-18T02:08:11.194279+0000","last_undegraded":"2024-09-18T02:08:11.194279+0000","last_fullsized":"2024-09-18T02:08:11.194279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:11.194052+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:11.194052+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.194052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:45.504652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.282532+0000","last_change":"2024-09-18T02:08:16.282593+0000","last_active":"2024-09-18T02:08:16.282532+0000","last_peered":"2024-09-18T02:08:16.282532+0000","last_clean":"2024-09-18T02:08:16.282532+0000","last_became_active":"2024-09-18T02:03:59.531445+0000","last_became_peered":"2024-09-18T02:03:59.531445+0000","last_unstale":"2024-09-18T02:08:16.282532+0000","last_undegraded":"2024-09-18T02:08:16.282532+0000","last_fullsized":"2024-09-18T02:08:16.282532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:16.282341+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:16.282341+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.282341+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:03.360755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.392323+0000","last_change":"2024-09-18T02:03:57.522436+0000","last_active":"2024-09-18T02:07:43.392323+0000","last_peered":"2024-09-18T02:07:43.392323+0000","last_clean":"2024-09-18T02:07:43.392323+0000","last_became_active":"2024-09-18T02:03:57.521858+0000","last_became_peered":"2024-09-18T02:03:57.521858+0000","last_unstale":"2024-09-18T02:07:43.392323+0000","last_undegraded":"2024-09-18T02:07:43.392323+0000","last_fullsized":"2024-09-18T02:07:43.392323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:46.340734+0000","last_change":"2024-09-18T02:04:36.357179+0000","last_active":"2024-09-18T02:06:46.340734+0000","last_peered":"2024-09-18T02:06:46.340734+0000","last_clean":"2024-09-18T02:06:46.340734+0000","last_became_active":"2024-09-18T02:04:36.356453+0000","last_became_peered":"2024-09-18T02:04:36.356453+0000","last_unstale":"2024-09-18T02:06:46.340734+0000","last_undegraded":"2024-09-18T02:06:46.340734+0000","last_fullsized":"2024-09-18T02:06:46.340734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'77","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.228384+0000","last_change":"2024-09-18T02:08:00.228384+0000","last_active":"2024-09-18T02:08:00.228384+0000","last_peered":"2024-09-18T02:08:00.228384+0000","last_clean":"2024-09-18T02:08:00.228384+0000","last_became_active":"2024-09-18T02:04:03.595618+0000","last_became_peered":"2024-09-18T02:04:03.595618+0000","last_unstale":"2024-09-18T02:08:00.228384+0000","last_undegraded":"2024-09-18T02:08:00.228384+0000","last_fullsized":"2024-09-18T02:08:00.228384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'77","last_scrub_stamp":"2024-09-18T02:08:00.228054+0000","last_deep_scrub":"32'77","last_deep_scrub_stamp":"2024-09-18T02:08:00.228054+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.228054+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:27.137267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.222718+0000","last_change":"2024-09-18T02:07:52.222718+0000","last_active":"2024-09-18T02:07:52.222718+0000","last_peered":"2024-09-18T02:07:52.222718+0000","last_clean":"2024-09-18T02:07:52.222718+0000","last_became_active":"2024-09-18T02:04:05.585272+0000","last_became_peered":"2024-09-18T02:04:05.585272+0000","last_unstale":"2024-09-18T02:07:52.222718+0000","last_undegraded":"2024-09-18T02:07:52.222718+0000","last_fullsized":"2024-09-18T02:07:52.222718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:52.222463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:52.222463+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.222463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:48.799896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.386126+0000","last_change":"2024-09-18T02:04:07.614915+0000","last_active":"2024-09-18T02:07:12.386126+0000","last_peered":"2024-09-18T02:07:12.386126+0000","last_clean":"2024-09-18T02:07:12.386126+0000","last_became_active":"2024-09-18T02:04:07.614232+0000","last_became_peered":"2024-09-18T02:04:07.614232+0000","last_unstale":"2024-09-18T02:07:12.386126+0000","last_undegraded":"2024-09-18T02:07:12.386126+0000","last_fullsized":"2024-09-18T02:07:12.386126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'18","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.689086+0000","last_change":"2024-09-18T02:08:17.689240+0000","last_active":"2024-09-18T02:08:17.689086+0000","last_peered":"2024-09-18T02:08:17.689086+0000","last_clean":"2024-09-18T02:08:17.689086+0000","last_became_active":"2024-09-18T02:03:59.545956+0000","last_became_peered":"2024-09-18T02:03:59.545956+0000","last_unstale":"2024-09-18T02:08:17.689086+0000","last_undegraded":"2024-09-18T02:08:17.689086+0000","last_fullsized":"2024-09-18T02:08:17.689086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:17.688836+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:17.688836+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.688836+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:28.232512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:43.391302+0000","last_change":"2024-09-18T02:03:57.522159+0000","last_active":"2024-09-18T02:07:43.391302+0000","last_peered":"2024-09-18T02:07:43.391302+0000","last_clean":"2024-09-18T02:07:43.391302+0000","last_became_active":"2024-09-18T02:03:57.520036+0000","last_became_peered":"2024-09-18T02:03:57.520036+0000","last_unstale":"2024-09-18T02:07:43.391302+0000","last_undegraded":"2024-09-18T02:07:43.391302+0000","last_fullsized":"2024-09-18T02:07:43.391302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.295525+0000","last_change":"2024-09-18T02:08:05.295590+0000","last_active":"2024-09-18T02:08:05.295525+0000","last_peered":"2024-09-18T02:08:05.295525+0000","last_clean":"2024-09-18T02:08:05.295525+0000","last_became_active":"2024-09-18T02:04:01.573084+0000","last_became_peered":"2024-09-18T02:04:01.573084+0000","last_unstale":"2024-09-18T02:08:05.295525+0000","last_undegraded":"2024-09-18T02:08:05.295525+0000","last_fullsized":"2024-09-18T02:08:05.295525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:05.295326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:05.295326+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.295326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:26.816185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'46","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.074496+0000","last_change":"2024-09-18T02:07:54.074574+0000","last_active":"2024-09-18T02:07:54.074496+0000","last_peered":"2024-09-18T02:07:54.074496+0000","last_clean":"2024-09-18T02:07:54.074496+0000","last_became_active":"2024-09-18T02:04:03.565801+0000","last_became_peered":"2024-09-18T02:04:03.565801+0000","last_unstale":"2024-09-18T02:07:54.074496+0000","last_undegraded":"2024-09-18T02:07:54.074496+0000","last_fullsized":"2024-09-18T02:07:54.074496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-18T02:07:54.074277+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-18T02:07:54.074277+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.074277+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:23:20.641594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.263707+0000","last_change":"2024-09-18T02:08:24.263760+0000","last_active":"2024-09-18T02:08:24.263707+0000","last_peered":"2024-09-18T02:08:24.263707+0000","last_clean":"2024-09-18T02:08:24.263707+0000","last_became_active":"2024-09-18T02:04:05.612052+0000","last_became_peered":"2024-09-18T02:04:05.612052+0000","last_unstale":"2024-09-18T02:08:24.263707+0000","last_undegraded":"2024-09-18T02:08:24.263707+0000","last_fullsized":"2024-09-18T02:08:24.263707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:24.263524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:24.263524+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.263524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:46:37.794556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.998718+0000","last_change":"2024-09-18T02:04:07.622545+0000","last_active":"2024-09-18T02:07:47.998718+0000","last_peered":"2024-09-18T02:07:47.998718+0000","last_clean":"2024-09-18T02:07:47.998718+0000","last_became_active":"2024-09-18T02:04:07.622004+0000","last_became_peered":"2024-09-18T02:04:07.622004+0000","last_unstale":"2024-09-18T02:07:47.998718+0000","last_undegraded":"2024-09-18T02:07:47.998718+0000","last_fullsized":"2024-09-18T02:07:47.998718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.237757+0000","last_change":"2024-09-18T02:04:36.364542+0000","last_active":"2024-09-18T02:07:12.237757+0000","last_peered":"2024-09-18T02:07:12.237757+0000","last_clean":"2024-09-18T02:07:12.237757+0000","last_became_active":"2024-09-18T02:04:36.361748+0000","last_became_peered":"2024-09-18T02:04:36.361748+0000","last_unstale":"2024-09-18T02:07:12.237757+0000","last_undegraded":"2024-09-18T02:07:12.237757+0000","last_fullsized":"2024-09-18T02:07:12.237757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996134+0000","last_change":"2024-09-18T02:03:57.530747+0000","last_active":"2024-09-18T02:07:47.996134+0000","last_peered":"2024-09-18T02:07:47.996134+0000","last_clean":"2024-09-18T02:07:47.996134+0000","last_became_active":"2024-09-18T02:03:57.526977+0000","last_became_peered":"2024-09-18T02:03:57.526977+0000","last_unstale":"2024-09-18T02:07:47.996134+0000","last_undegraded":"2024-09-18T02:07:47.996134+0000","last_fullsized":"2024-09-18T02:07:47.996134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.203195+0000","last_change":"2024-09-18T02:08:08.203249+0000","last_active":"2024-09-18T02:08:08.203195+0000","last_peered":"2024-09-18T02:08:08.203195+0000","last_clean":"2024-09-18T02:08:08.203195+0000","last_became_active":"2024-09-18T02:04:01.561913+0000","last_became_peered":"2024-09-18T02:04:01.561913+0000","last_unstale":"2024-09-18T02:08:08.203195+0000","last_undegraded":"2024-09-18T02:08:08.203195+0000","last_fullsized":"2024-09-18T02:08:08.203195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.203008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.203008+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.203008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:28.422827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.280128+0000","last_change":"2024-09-18T02:08:02.280212+0000","last_active":"2024-09-18T02:08:02.280128+0000","last_peered":"2024-09-18T02:08:02.280128+0000","last_clean":"2024-09-18T02:08:02.280128+0000","last_became_active":"2024-09-18T02:04:03.580395+0000","last_became_peered":"2024-09-18T02:04:03.580395+0000","last_unstale":"2024-09-18T02:08:02.280128+0000","last_undegraded":"2024-09-18T02:08:02.280128+0000","last_fullsized":"2024-09-18T02:08:02.280128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-09-18T02:08:02.279903+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-09-18T02:08:02.279903+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.279903+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:12:22.758998+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":416,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.264889+0000","last_change":"2024-09-18T02:07:49.264976+0000","last_active":"2024-09-18T02:07:49.264889+0000","last_peered":"2024-09-18T02:07:49.264889+0000","last_clean":"2024-09-18T02:07:49.264889+0000","last_became_active":"2024-09-18T02:04:05.603548+0000","last_became_peered":"2024-09-18T02:04:05.603548+0000","last_unstale":"2024-09-18T02:07:49.264889+0000","last_undegraded":"2024-09-18T02:07:49.264889+0000","last_fullsized":"2024-09-18T02:07:49.264889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:49.264681+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:49.264681+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.264681+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:45:54.246439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.660003+0000","last_change":"2024-09-18T02:04:07.620770+0000","last_active":"2024-09-18T02:07:46.660003+0000","last_peered":"2024-09-18T02:07:46.660003+0000","last_clean":"2024-09-18T02:07:46.660003+0000","last_became_active":"2024-09-18T02:04:07.620094+0000","last_became_peered":"2024-09-18T02:04:07.620094+0000","last_unstale":"2024-09-18T02:07:46.660003+0000","last_undegraded":"2024-09-18T02:07:46.660003+0000","last_fullsized":"2024-09-18T02:07:46.660003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.261848+0000","last_change":"2024-09-18T02:08:13.261906+0000","last_active":"2024-09-18T02:08:13.261848+0000","last_peered":"2024-09-18T02:08:13.261848+0000","last_clean":"2024-09-18T02:08:13.261848+0000","last_became_active":"2024-09-18T02:03:59.534547+0000","last_became_peered":"2024-09-18T02:03:59.534547+0000","last_unstale":"2024-09-18T02:08:13.261848+0000","last_undegraded":"2024-09-18T02:08:13.261848+0000","last_fullsized":"2024-09-18T02:08:13.261848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:13.261662+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:13.261662+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.261662+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:13.293664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996097+0000","last_change":"2024-09-18T02:03:57.526267+0000","last_active":"2024-09-18T02:07:47.996097+0000","last_peered":"2024-09-18T02:07:47.996097+0000","last_clean":"2024-09-18T02:07:47.996097+0000","last_became_active":"2024-09-18T02:03:57.525576+0000","last_became_peered":"2024-09-18T02:03:57.525576+0000","last_unstale":"2024-09-18T02:07:47.996097+0000","last_undegraded":"2024-09-18T02:07:47.996097+0000","last_fullsized":"2024-09-18T02:07:47.996097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.935978+0000","last_change":"2024-09-18T02:07:59.936130+0000","last_active":"2024-09-18T02:07:59.935978+0000","last_peered":"2024-09-18T02:07:59.935978+0000","last_clean":"2024-09-18T02:07:59.935978+0000","last_became_active":"2024-09-18T02:04:01.564385+0000","last_became_peered":"2024-09-18T02:04:01.564385+0000","last_unstale":"2024-09-18T02:07:59.935978+0000","last_undegraded":"2024-09-18T02:07:59.935978+0000","last_fullsized":"2024-09-18T02:07:59.935978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-18T02:07:59.935730+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-18T02:07:59.935730+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.935730+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:04.466951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.305844+0000","last_change":"2024-09-18T02:08:15.305924+0000","last_active":"2024-09-18T02:08:15.305844+0000","last_peered":"2024-09-18T02:08:15.305844+0000","last_clean":"2024-09-18T02:08:15.305844+0000","last_became_active":"2024-09-18T02:04:03.600545+0000","last_became_peered":"2024-09-18T02:04:03.600545+0000","last_unstale":"2024-09-18T02:08:15.305844+0000","last_undegraded":"2024-09-18T02:08:15.305844+0000","last_fullsized":"2024-09-18T02:08:15.305844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-18T02:08:15.305656+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-18T02:08:15.305656+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.305656+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:37:09.015631+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":472,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.115817+0000","last_change":"2024-09-18T02:07:47.115885+0000","last_active":"2024-09-18T02:07:47.115817+0000","last_peered":"2024-09-18T02:07:47.115817+0000","last_clean":"2024-09-18T02:07:47.115817+0000","last_became_active":"2024-09-18T02:04:05.582127+0000","last_became_peered":"2024-09-18T02:04:05.582127+0000","last_unstale":"2024-09-18T02:07:47.115817+0000","last_undegraded":"2024-09-18T02:07:47.115817+0000","last_fullsized":"2024-09-18T02:07:47.115817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:47.115624+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:47.115624+0000","last_clean_scrub_stamp":"2024-09-18T02:07:47.115624+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:34:41.967979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.332802+0000","last_change":"2024-09-18T02:07:55.332802+0000","last_active":"2024-09-18T02:07:55.332802+0000","last_peered":"2024-09-18T02:07:55.332802+0000","last_clean":"2024-09-18T02:07:55.332802+0000","last_became_active":"2024-09-18T02:04:07.602985+0000","last_became_peered":"2024-09-18T02:04:07.602985+0000","last_unstale":"2024-09-18T02:07:55.332802+0000","last_undegraded":"2024-09-18T02:07:55.332802+0000","last_fullsized":"2024-09-18T02:07:55.332802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:07:55.332416+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:07:55.332416+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.332416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:19:15.933538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.726461+0000","last_change":"2024-09-18T02:08:09.726524+0000","last_active":"2024-09-18T02:08:09.726461+0000","last_peered":"2024-09-18T02:08:09.726461+0000","last_clean":"2024-09-18T02:08:09.726461+0000","last_became_active":"2024-09-18T02:03:59.554711+0000","last_became_peered":"2024-09-18T02:03:59.554711+0000","last_unstale":"2024-09-18T02:08:09.726461+0000","last_undegraded":"2024-09-18T02:08:09.726461+0000","last_fullsized":"2024-09-18T02:08:09.726461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:09.726257+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:09.726257+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.726257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:21:45.241040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996016+0000","last_change":"2024-09-18T02:03:57.531537+0000","last_active":"2024-09-18T02:07:47.996016+0000","last_peered":"2024-09-18T02:07:47.996016+0000","last_clean":"2024-09-18T02:07:47.996016+0000","last_became_active":"2024-09-18T02:03:57.531156+0000","last_became_peered":"2024-09-18T02:03:57.531156+0000","last_unstale":"2024-09-18T02:07:47.996016+0000","last_undegraded":"2024-09-18T02:07:47.996016+0000","last_fullsized":"2024-09-18T02:07:47.996016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.368730+0000","last_change":"2024-09-18T02:07:49.368784+0000","last_active":"2024-09-18T02:07:49.368730+0000","last_peered":"2024-09-18T02:07:49.368730+0000","last_clean":"2024-09-18T02:07:49.368730+0000","last_became_active":"2024-09-18T02:04:01.565999+0000","last_became_peered":"2024-09-18T02:04:01.565999+0000","last_unstale":"2024-09-18T02:07:49.368730+0000","last_undegraded":"2024-09-18T02:07:49.368730+0000","last_fullsized":"2024-09-18T02:07:49.368730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:49.368530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:49.368530+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.368530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:09.588349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'51","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.029530+0000","last_change":"2024-09-18T02:07:55.029622+0000","last_active":"2024-09-18T02:07:55.029530+0000","last_peered":"2024-09-18T02:07:55.029530+0000","last_clean":"2024-09-18T02:07:55.029530+0000","last_became_active":"2024-09-18T02:04:03.564021+0000","last_became_peered":"2024-09-18T02:04:03.564021+0000","last_unstale":"2024-09-18T02:07:55.029530+0000","last_undegraded":"2024-09-18T02:07:55.029530+0000","last_fullsized":"2024-09-18T02:07:55.029530+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-18T02:07:55.029350+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-18T02:07:55.029350+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.029350+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:45.011710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.315959+0000","last_change":"2024-09-18T02:07:51.316073+0000","last_active":"2024-09-18T02:07:51.315959+0000","last_peered":"2024-09-18T02:07:51.315959+0000","last_clean":"2024-09-18T02:07:51.315959+0000","last_became_active":"2024-09-18T02:04:05.610024+0000","last_became_peered":"2024-09-18T02:04:05.610024+0000","last_unstale":"2024-09-18T02:07:51.315959+0000","last_undegraded":"2024-09-18T02:07:51.315959+0000","last_fullsized":"2024-09-18T02:07:51.315959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.315728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.315728+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.315728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:32.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.762277+0000","last_change":"2024-09-18T02:08:08.762277+0000","last_active":"2024-09-18T02:08:08.762277+0000","last_peered":"2024-09-18T02:08:08.762277+0000","last_clean":"2024-09-18T02:08:08.762277+0000","last_became_active":"2024-09-18T02:04:07.618153+0000","last_became_peered":"2024-09-18T02:04:07.618153+0000","last_unstale":"2024-09-18T02:08:08.762277+0000","last_undegraded":"2024-09-18T02:08:08.762277+0000","last_fullsized":"2024-09-18T02:08:08.762277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:08:08.762008+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:08:08.762008+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.762008+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:55.840421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.208888+0000","last_change":"2024-09-18T02:08:03.208888+0000","last_active":"2024-09-18T02:08:03.208888+0000","last_peered":"2024-09-18T02:08:03.208888+0000","last_clean":"2024-09-18T02:08:03.208888+0000","last_became_active":"2024-09-18T02:03:59.559592+0000","last_became_peered":"2024-09-18T02:03:59.559592+0000","last_unstale":"2024-09-18T02:08:03.208888+0000","last_undegraded":"2024-09-18T02:08:03.208888+0000","last_fullsized":"2024-09-18T02:08:03.208888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:03.208545+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:03.208545+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.208545+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:46:49.036536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":205,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.352255+0000","last_change":"2024-09-18T02:03:43.338768+0000","last_active":"2024-09-18T02:07:46.352255+0000","last_peered":"2024-09-18T02:07:46.352255+0000","last_clean":"2024-09-18T02:07:46.352255+0000","last_became_active":"2024-09-18T02:03:43.336731+0000","last_became_peered":"2024-09-18T02:03:43.336731+0000","last_unstale":"2024-09-18T02:07:46.352255+0000","last_undegraded":"2024-09-18T02:07:46.352255+0000","last_fullsized":"2024-09-18T02:07:46.352255+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:42.235832+0000","last_clean_scrub_stamp":"2024-09-18T02:03:42.235832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995860+0000","last_change":"2024-09-18T02:03:50.287984+0000","last_active":"2024-09-18T02:07:47.995860+0000","last_peered":"2024-09-18T02:07:47.995860+0000","last_clean":"2024-09-18T02:07:47.995860+0000","last_became_active":"2024-09-18T02:03:48.273444+0000","last_became_peered":"2024-09-18T02:03:48.273444+0000","last_unstale":"2024-09-18T02:07:47.995860+0000","last_undegraded":"2024-09-18T02:07:47.995860+0000","last_fullsized":"2024-09-18T02:07:47.995860+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024299339999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995926+0000","last_change":"2024-09-18T02:03:57.533463+0000","last_active":"2024-09-18T02:07:47.995926+0000","last_peered":"2024-09-18T02:07:47.995926+0000","last_clean":"2024-09-18T02:07:47.995926+0000","last_became_active":"2024-09-18T02:03:57.532844+0000","last_became_peered":"2024-09-18T02:03:57.532844+0000","last_unstale":"2024-09-18T02:07:47.995926+0000","last_undegraded":"2024-09-18T02:07:47.995926+0000","last_fullsized":"2024-09-18T02:07:47.995926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.878096+0000","last_change":"2024-09-18T02:08:01.878096+0000","last_active":"2024-09-18T02:08:01.878096+0000","last_peered":"2024-09-18T02:08:01.878096+0000","last_clean":"2024-09-18T02:08:01.878096+0000","last_became_active":"2024-09-18T02:04:01.563633+0000","last_became_peered":"2024-09-18T02:04:01.563633+0000","last_unstale":"2024-09-18T02:08:01.878096+0000","last_undegraded":"2024-09-18T02:08:01.878096+0000","last_fullsized":"2024-09-18T02:08:01.878096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:01.877846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:01.877846+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.877846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:32.131376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'97","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.212941+0000","last_change":"2024-09-18T02:08:09.212941+0000","last_active":"2024-09-18T02:08:09.212941+0000","last_peered":"2024-09-18T02:08:09.212941+0000","last_clean":"2024-09-18T02:08:09.212941+0000","last_became_active":"2024-09-18T02:04:03.606800+0000","last_became_peered":"2024-09-18T02:04:03.606800+0000","last_unstale":"2024-09-18T02:08:09.212941+0000","last_undegraded":"2024-09-18T02:08:09.212941+0000","last_fullsized":"2024-09-18T02:08:09.212941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-09-18T02:08:09.212628+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-09-18T02:08:09.212628+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.212628+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:27:22.678145+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.275953+0000","last_change":"2024-09-18T02:07:50.275953+0000","last_active":"2024-09-18T02:07:50.275953+0000","last_peered":"2024-09-18T02:07:50.275953+0000","last_clean":"2024-09-18T02:07:50.275953+0000","last_became_active":"2024-09-18T02:04:05.588568+0000","last_became_peered":"2024-09-18T02:04:05.588568+0000","last_unstale":"2024-09-18T02:07:50.275953+0000","last_undegraded":"2024-09-18T02:07:50.275953+0000","last_fullsized":"2024-09-18T02:07:50.275953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:50.275701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:50.275701+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.275701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:23:16.843019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.289734+0000","last_change":"2024-09-18T02:08:07.289795+0000","last_active":"2024-09-18T02:08:07.289734+0000","last_peered":"2024-09-18T02:08:07.289734+0000","last_clean":"2024-09-18T02:08:07.289734+0000","last_became_active":"2024-09-18T02:04:07.613914+0000","last_became_peered":"2024-09-18T02:04:07.613914+0000","last_unstale":"2024-09-18T02:08:07.289734+0000","last_undegraded":"2024-09-18T02:08:07.289734+0000","last_fullsized":"2024-09-18T02:08:07.289734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-09-18T02:08:07.289548+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-09-18T02:08:07.289548+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.289548+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:11.820769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.239750+0000","last_change":"2024-09-18T02:08:23.239813+0000","last_active":"2024-09-18T02:08:23.239750+0000","last_peered":"2024-09-18T02:08:23.239750+0000","last_clean":"2024-09-18T02:08:23.239750+0000","last_became_active":"2024-09-18T02:03:59.555801+0000","last_became_peered":"2024-09-18T02:03:59.555801+0000","last_unstale":"2024-09-18T02:08:23.239750+0000","last_undegraded":"2024-09-18T02:08:23.239750+0000","last_fullsized":"2024-09-18T02:08:23.239750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.239523+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.239523+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.239523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:59.785045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995825+0000","last_change":"2024-09-18T02:03:50.285797+0000","last_active":"2024-09-18T02:07:47.995825+0000","last_peered":"2024-09-18T02:07:47.995825+0000","last_clean":"2024-09-18T02:07:47.995825+0000","last_became_active":"2024-09-18T02:03:48.275709+0000","last_became_peered":"2024-09-18T02:03:48.275709+0000","last_unstale":"2024-09-18T02:07:47.995825+0000","last_undegraded":"2024-09-18T02:07:47.995825+0000","last_fullsized":"2024-09-18T02:07:47.995825+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047579399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.658425+0000","last_change":"2024-09-18T02:03:57.521576+0000","last_active":"2024-09-18T02:07:46.658425+0000","last_peered":"2024-09-18T02:07:46.658425+0000","last_clean":"2024-09-18T02:07:46.658425+0000","last_became_active":"2024-09-18T02:03:57.520559+0000","last_became_peered":"2024-09-18T02:03:57.520559+0000","last_unstale":"2024-09-18T02:07:46.658425+0000","last_undegraded":"2024-09-18T02:07:46.658425+0000","last_fullsized":"2024-09-18T02:07:46.658425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.201427+0000","last_change":"2024-09-18T02:07:55.201427+0000","last_active":"2024-09-18T02:07:55.201427+0000","last_peered":"2024-09-18T02:07:55.201427+0000","last_clean":"2024-09-18T02:07:55.201427+0000","last_became_active":"2024-09-18T02:04:01.561194+0000","last_became_peered":"2024-09-18T02:04:01.561194+0000","last_unstale":"2024-09-18T02:07:55.201427+0000","last_undegraded":"2024-09-18T02:07:55.201427+0000","last_fullsized":"2024-09-18T02:07:55.201427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:55.201180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:55.201180+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.201180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:25.554052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'297","reported_seq":530,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.127133+0000","last_change":"2024-09-18T02:07:51.127133+0000","last_active":"2024-09-18T02:07:51.127133+0000","last_peered":"2024-09-18T02:07:51.127133+0000","last_clean":"2024-09-18T02:07:51.127133+0000","last_became_active":"2024-09-18T02:04:03.570288+0000","last_became_peered":"2024-09-18T02:04:03.570288+0000","last_unstale":"2024-09-18T02:07:51.127133+0000","last_undegraded":"2024-09-18T02:07:51.127133+0000","last_fullsized":"2024-09-18T02:07:51.127133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'297","last_scrub_stamp":"2024-09-18T02:07:51.126820+0000","last_deep_scrub":"32'297","last_deep_scrub_stamp":"2024-09-18T02:07:51.126820+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.126820+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:09:07.313670+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.342738+0000","last_change":"2024-09-18T02:08:16.342738+0000","last_active":"2024-09-18T02:08:16.342738+0000","last_peered":"2024-09-18T02:08:16.342738+0000","last_clean":"2024-09-18T02:08:16.342738+0000","last_became_active":"2024-09-18T02:04:05.608544+0000","last_became_peered":"2024-09-18T02:04:05.608544+0000","last_unstale":"2024-09-18T02:08:16.342738+0000","last_undegraded":"2024-09-18T02:08:16.342738+0000","last_fullsized":"2024-09-18T02:08:16.342738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:16.342502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:16.342502+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.342502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:40.174283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.229719+0000","last_change":"2024-09-18T02:04:07.624305+0000","last_active":"2024-09-18T02:07:12.229719+0000","last_peered":"2024-09-18T02:07:12.229719+0000","last_clean":"2024-09-18T02:07:12.229719+0000","last_became_active":"2024-09-18T02:04:07.622337+0000","last_became_peered":"2024-09-18T02:04:07.622337+0000","last_unstale":"2024-09-18T02:07:12.229719+0000","last_undegraded":"2024-09-18T02:07:12.229719+0000","last_fullsized":"2024-09-18T02:07:12.229719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.658903+0000","last_change":"2024-09-18T02:03:59.549829+0000","last_active":"2024-09-18T02:07:46.658903+0000","last_peered":"2024-09-18T02:07:46.658903+0000","last_clean":"2024-09-18T02:07:46.658903+0000","last_became_active":"2024-09-18T02:03:59.548308+0000","last_became_peered":"2024-09-18T02:03:59.548308+0000","last_unstale":"2024-09-18T02:07:46.658903+0000","last_undegraded":"2024-09-18T02:07:46.658903+0000","last_fullsized":"2024-09-18T02:07:46.658903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.548260+0000","last_change":"2024-09-18T02:03:50.338272+0000","last_active":"2024-09-18T02:07:47.548260+0000","last_peered":"2024-09-18T02:07:47.548260+0000","last_clean":"2024-09-18T02:07:47.548260+0000","last_became_active":"2024-09-18T02:03:48.275609+0000","last_became_peered":"2024-09-18T02:03:48.275609+0000","last_unstale":"2024-09-18T02:07:47.548260+0000","last_undegraded":"2024-09-18T02:07:47.548260+0000","last_fullsized":"2024-09-18T02:07:47.548260+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067244799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.658570+0000","last_change":"2024-09-18T02:03:57.520998+0000","last_active":"2024-09-18T02:07:46.658570+0000","last_peered":"2024-09-18T02:07:46.658570+0000","last_clean":"2024-09-18T02:07:46.658570+0000","last_became_active":"2024-09-18T02:03:57.520103+0000","last_became_peered":"2024-09-18T02:03:57.520103+0000","last_unstale":"2024-09-18T02:07:46.658570+0000","last_undegraded":"2024-09-18T02:07:46.658570+0000","last_fullsized":"2024-09-18T02:07:46.658570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.304457+0000","last_change":"2024-09-18T02:08:12.304457+0000","last_active":"2024-09-18T02:08:12.304457+0000","last_peered":"2024-09-18T02:08:12.304457+0000","last_clean":"2024-09-18T02:08:12.304457+0000","last_became_active":"2024-09-18T02:04:01.560471+0000","last_became_peered":"2024-09-18T02:04:01.560471+0000","last_unstale":"2024-09-18T02:08:12.304457+0000","last_undegraded":"2024-09-18T02:08:12.304457+0000","last_fullsized":"2024-09-18T02:08:12.304457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:12.304176+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:12.304176+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.304176+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:41:55.150843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'24","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.320487+0000","last_change":"2024-09-18T02:07:57.320487+0000","last_active":"2024-09-18T02:07:57.320487+0000","last_peered":"2024-09-18T02:07:57.320487+0000","last_clean":"2024-09-18T02:07:57.320487+0000","last_became_active":"2024-09-18T02:04:03.588913+0000","last_became_peered":"2024-09-18T02:04:03.588913+0000","last_unstale":"2024-09-18T02:07:57.320487+0000","last_undegraded":"2024-09-18T02:07:57.320487+0000","last_fullsized":"2024-09-18T02:07:57.320487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-18T02:07:57.320158+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-18T02:07:57.320158+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.320158+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:35.687439+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.317671+0000","last_change":"2024-09-18T02:07:49.317671+0000","last_active":"2024-09-18T02:07:49.317671+0000","last_peered":"2024-09-18T02:07:49.317671+0000","last_clean":"2024-09-18T02:07:49.317671+0000","last_became_active":"2024-09-18T02:04:05.588457+0000","last_became_peered":"2024-09-18T02:04:05.588457+0000","last_unstale":"2024-09-18T02:07:49.317671+0000","last_undegraded":"2024-09-18T02:07:49.317671+0000","last_fullsized":"2024-09-18T02:07:49.317671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:49.317338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:49.317338+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.317338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:39.956466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.337980+0000","last_change":"2024-09-18T02:04:07.622460+0000","last_active":"2024-09-18T02:06:26.337980+0000","last_peered":"2024-09-18T02:06:26.337980+0000","last_clean":"2024-09-18T02:06:26.337980+0000","last_became_active":"2024-09-18T02:04:07.621651+0000","last_became_peered":"2024-09-18T02:04:07.621651+0000","last_unstale":"2024-09-18T02:06:26.337980+0000","last_undegraded":"2024-09-18T02:06:26.337980+0000","last_fullsized":"2024-09-18T02:06:26.337980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.115264+0000","last_change":"2024-09-18T02:08:19.115318+0000","last_active":"2024-09-18T02:08:19.115264+0000","last_peered":"2024-09-18T02:08:19.115264+0000","last_clean":"2024-09-18T02:08:19.115264+0000","last_became_active":"2024-09-18T02:03:59.535693+0000","last_became_peered":"2024-09-18T02:03:59.535693+0000","last_unstale":"2024-09-18T02:08:19.115264+0000","last_undegraded":"2024-09-18T02:08:19.115264+0000","last_fullsized":"2024-09-18T02:08:19.115264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:19.115076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:19.115076+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.115076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:46.024290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995847+0000","last_change":"2024-09-18T02:03:50.287790+0000","last_active":"2024-09-18T02:07:47.995847+0000","last_peered":"2024-09-18T02:07:47.995847+0000","last_clean":"2024-09-18T02:07:47.995847+0000","last_became_active":"2024-09-18T02:03:48.276543+0000","last_became_peered":"2024-09-18T02:03:48.276543+0000","last_unstale":"2024-09-18T02:07:47.995847+0000","last_undegraded":"2024-09-18T02:07:47.995847+0000","last_fullsized":"2024-09-18T02:07:47.995847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023330579999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.200087+0000","last_change":"2024-09-18T02:08:20.200139+0000","last_active":"2024-09-18T02:08:20.200087+0000","last_peered":"2024-09-18T02:08:20.200087+0000","last_clean":"2024-09-18T02:08:20.200087+0000","last_became_active":"2024-09-18T02:03:57.528828+0000","last_became_peered":"2024-09-18T02:03:57.528828+0000","last_unstale":"2024-09-18T02:08:20.200087+0000","last_undegraded":"2024-09-18T02:08:20.200087+0000","last_fullsized":"2024-09-18T02:08:20.200087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.199864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.199864+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.199864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:12.451245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.216748+0000","last_change":"2024-09-18T02:08:04.216748+0000","last_active":"2024-09-18T02:08:04.216748+0000","last_peered":"2024-09-18T02:08:04.216748+0000","last_clean":"2024-09-18T02:08:04.216748+0000","last_became_active":"2024-09-18T02:04:01.571608+0000","last_became_peered":"2024-09-18T02:04:01.571608+0000","last_unstale":"2024-09-18T02:08:04.216748+0000","last_undegraded":"2024-09-18T02:08:04.216748+0000","last_fullsized":"2024-09-18T02:08:04.216748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:04.216468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:04.216468+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.216468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:07:30.815787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.228198+0000","last_change":"2024-09-18T02:08:13.228198+0000","last_active":"2024-09-18T02:08:13.228198+0000","last_peered":"2024-09-18T02:08:13.228198+0000","last_clean":"2024-09-18T02:08:13.228198+0000","last_became_active":"2024-09-18T02:04:03.601140+0000","last_became_peered":"2024-09-18T02:04:03.601140+0000","last_unstale":"2024-09-18T02:08:13.228198+0000","last_undegraded":"2024-09-18T02:08:13.228198+0000","last_fullsized":"2024-09-18T02:08:13.228198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-18T02:08:13.227917+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-18T02:08:13.227917+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.227917+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:13.717888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.268741+0000","last_change":"2024-09-18T02:08:20.268741+0000","last_active":"2024-09-18T02:08:20.268741+0000","last_peered":"2024-09-18T02:08:20.268741+0000","last_clean":"2024-09-18T02:08:20.268741+0000","last_became_active":"2024-09-18T02:04:05.612007+0000","last_became_peered":"2024-09-18T02:04:05.612007+0000","last_unstale":"2024-09-18T02:08:20.268741+0000","last_undegraded":"2024-09-18T02:08:20.268741+0000","last_fullsized":"2024-09-18T02:08:20.268741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.268474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.268474+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.268474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:28.013086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.333457+0000","last_change":"2024-09-18T02:04:07.623097+0000","last_active":"2024-09-18T02:06:21.333457+0000","last_peered":"2024-09-18T02:06:21.333457+0000","last_clean":"2024-09-18T02:06:21.333457+0000","last_became_active":"2024-09-18T02:04:07.622247+0000","last_became_peered":"2024-09-18T02:04:07.622247+0000","last_unstale":"2024-09-18T02:06:21.333457+0000","last_undegraded":"2024-09-18T02:06:21.333457+0000","last_fullsized":"2024-09-18T02:06:21.333457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.783157+0000","last_change":"2024-09-18T02:08:06.783157+0000","last_active":"2024-09-18T02:08:06.783157+0000","last_peered":"2024-09-18T02:08:06.783157+0000","last_clean":"2024-09-18T02:08:06.783157+0000","last_became_active":"2024-09-18T02:03:59.559749+0000","last_became_peered":"2024-09-18T02:03:59.559749+0000","last_unstale":"2024-09-18T02:08:06.783157+0000","last_undegraded":"2024-09-18T02:08:06.783157+0000","last_fullsized":"2024-09-18T02:08:06.783157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:06.782905+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:06.782905+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.782905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:21:01.786933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.548118+0000","last_change":"2024-09-18T02:03:57.524455+0000","last_active":"2024-09-18T02:07:47.548118+0000","last_peered":"2024-09-18T02:07:47.548118+0000","last_clean":"2024-09-18T02:07:47.548118+0000","last_became_active":"2024-09-18T02:03:57.519961+0000","last_became_peered":"2024-09-18T02:03:57.519961+0000","last_unstale":"2024-09-18T02:07:47.548118+0000","last_undegraded":"2024-09-18T02:07:47.548118+0000","last_fullsized":"2024-09-18T02:07:47.548118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.658366+0000","last_change":"2024-09-18T02:03:50.282381+0000","last_active":"2024-09-18T02:07:46.658366+0000","last_peered":"2024-09-18T02:07:46.658366+0000","last_clean":"2024-09-18T02:07:46.658366+0000","last_became_active":"2024-09-18T02:03:48.274657+0000","last_became_peered":"2024-09-18T02:03:48.274657+0000","last_unstale":"2024-09-18T02:07:46.658366+0000","last_undegraded":"2024-09-18T02:07:46.658366+0000","last_fullsized":"2024-09-18T02:07:46.658366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000970169,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.206497+0000","last_change":"2024-09-18T02:08:05.206497+0000","last_active":"2024-09-18T02:08:05.206497+0000","last_peered":"2024-09-18T02:08:05.206497+0000","last_clean":"2024-09-18T02:08:05.206497+0000","last_became_active":"2024-09-18T02:04:01.571443+0000","last_became_peered":"2024-09-18T02:04:01.571443+0000","last_unstale":"2024-09-18T02:08:05.206497+0000","last_undegraded":"2024-09-18T02:08:05.206497+0000","last_fullsized":"2024-09-18T02:08:05.206497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:05.206220+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:05.206220+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.206220+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:45:50.192588+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'90","reported_seq":179,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.219597+0000","last_change":"2024-09-18T02:08:02.219597+0000","last_active":"2024-09-18T02:08:02.219597+0000","last_peered":"2024-09-18T02:08:02.219597+0000","last_clean":"2024-09-18T02:08:02.219597+0000","last_became_active":"2024-09-18T02:04:03.569938+0000","last_became_peered":"2024-09-18T02:04:03.569938+0000","last_unstale":"2024-09-18T02:08:02.219597+0000","last_undegraded":"2024-09-18T02:08:02.219597+0000","last_fullsized":"2024-09-18T02:08:02.219597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-09-18T02:08:02.219300+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-09-18T02:08:02.219300+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.219300+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:38.149380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.352767+0000","last_change":"2024-09-18T02:07:52.352767+0000","last_active":"2024-09-18T02:07:52.352767+0000","last_peered":"2024-09-18T02:07:52.352767+0000","last_clean":"2024-09-18T02:07:52.352767+0000","last_became_active":"2024-09-18T02:04:05.597181+0000","last_became_peered":"2024-09-18T02:04:05.597181+0000","last_unstale":"2024-09-18T02:07:52.352767+0000","last_undegraded":"2024-09-18T02:07:52.352767+0000","last_fullsized":"2024-09-18T02:07:52.352767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:52.352475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:52.352475+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.352475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:51:22.983509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334245+0000","last_change":"2024-09-18T02:04:07.619359+0000","last_active":"2024-09-18T02:06:26.334245+0000","last_peered":"2024-09-18T02:06:26.334245+0000","last_clean":"2024-09-18T02:06:26.334245+0000","last_became_active":"2024-09-18T02:04:07.618751+0000","last_became_peered":"2024-09-18T02:04:07.618751+0000","last_unstale":"2024-09-18T02:06:26.334245+0000","last_undegraded":"2024-09-18T02:06:26.334245+0000","last_fullsized":"2024-09-18T02:06:26.334245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.681556+0000","last_change":"2024-09-18T02:08:14.681691+0000","last_active":"2024-09-18T02:08:14.681556+0000","last_peered":"2024-09-18T02:08:14.681556+0000","last_clean":"2024-09-18T02:08:14.681556+0000","last_became_active":"2024-09-18T02:03:59.553619+0000","last_became_peered":"2024-09-18T02:03:59.553619+0000","last_unstale":"2024-09-18T02:08:14.681556+0000","last_undegraded":"2024-09-18T02:08:14.681556+0000","last_fullsized":"2024-09-18T02:08:14.681556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:14.681214+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:14.681214+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.681214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:48.991814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.658429+0000","last_change":"2024-09-18T02:03:57.519164+0000","last_active":"2024-09-18T02:07:46.658429+0000","last_peered":"2024-09-18T02:07:46.658429+0000","last_clean":"2024-09-18T02:07:46.658429+0000","last_became_active":"2024-09-18T02:03:57.518503+0000","last_became_peered":"2024-09-18T02:03:57.518503+0000","last_unstale":"2024-09-18T02:07:46.658429+0000","last_undegraded":"2024-09-18T02:07:46.658429+0000","last_fullsized":"2024-09-18T02:07:46.658429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995877+0000","last_change":"2024-09-18T02:03:50.288345+0000","last_active":"2024-09-18T02:07:47.995877+0000","last_peered":"2024-09-18T02:07:47.995877+0000","last_clean":"2024-09-18T02:07:47.995877+0000","last_became_active":"2024-09-18T02:03:48.276300+0000","last_became_peered":"2024-09-18T02:03:48.276300+0000","last_unstale":"2024-09-18T02:07:47.995877+0000","last_undegraded":"2024-09-18T02:07:47.995877+0000","last_fullsized":"2024-09-18T02:07:47.995877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002788245,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.199897+0000","last_change":"2024-09-18T02:08:01.199897+0000","last_active":"2024-09-18T02:08:01.199897+0000","last_peered":"2024-09-18T02:08:01.199897+0000","last_clean":"2024-09-18T02:08:01.199897+0000","last_became_active":"2024-09-18T02:04:01.557570+0000","last_became_peered":"2024-09-18T02:04:01.557570+0000","last_unstale":"2024-09-18T02:08:01.199897+0000","last_undegraded":"2024-09-18T02:08:01.199897+0000","last_fullsized":"2024-09-18T02:08:01.199897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:01.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:01.199648+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:22.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'28","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.127859+0000","last_change":"2024-09-18T02:07:48.127859+0000","last_active":"2024-09-18T02:07:48.127859+0000","last_peered":"2024-09-18T02:07:48.127859+0000","last_clean":"2024-09-18T02:07:48.127859+0000","last_became_active":"2024-09-18T02:04:03.588539+0000","last_became_peered":"2024-09-18T02:04:03.588539+0000","last_unstale":"2024-09-18T02:07:48.127859+0000","last_undegraded":"2024-09-18T02:07:48.127859+0000","last_fullsized":"2024-09-18T02:07:48.127859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-09-18T02:07:48.127557+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-09-18T02:07:48.127557+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.127557+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:55:43.485970+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.149355+0000","last_change":"2024-09-18T02:07:49.149355+0000","last_active":"2024-09-18T02:07:49.149355+0000","last_peered":"2024-09-18T02:07:49.149355+0000","last_clean":"2024-09-18T02:07:49.149355+0000","last_became_active":"2024-09-18T02:04:05.582477+0000","last_became_peered":"2024-09-18T02:04:05.582477+0000","last_unstale":"2024-09-18T02:07:49.149355+0000","last_undegraded":"2024-09-18T02:07:49.149355+0000","last_fullsized":"2024-09-18T02:07:49.149355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:49.149087+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:49.149087+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.149087+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:13.463449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.338178+0000","last_change":"2024-09-18T02:04:07.606623+0000","last_active":"2024-09-18T02:06:26.338178+0000","last_peered":"2024-09-18T02:06:26.338178+0000","last_clean":"2024-09-18T02:06:26.338178+0000","last_became_active":"2024-09-18T02:04:07.605591+0000","last_became_peered":"2024-09-18T02:04:07.605591+0000","last_unstale":"2024-09-18T02:06:26.338178+0000","last_undegraded":"2024-09-18T02:06:26.338178+0000","last_fullsized":"2024-09-18T02:06:26.338178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.280299+0000","last_change":"2024-09-18T02:08:19.280466+0000","last_active":"2024-09-18T02:08:19.280299+0000","last_peered":"2024-09-18T02:08:19.280299+0000","last_clean":"2024-09-18T02:08:19.280299+0000","last_became_active":"2024-09-18T02:03:59.559044+0000","last_became_peered":"2024-09-18T02:03:59.559044+0000","last_unstale":"2024-09-18T02:08:19.280299+0000","last_undegraded":"2024-09-18T02:08:19.280299+0000","last_fullsized":"2024-09-18T02:08:19.280299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:19.280064+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:19.280064+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.280064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:03.804854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996083+0000","last_change":"2024-09-18T02:03:57.522060+0000","last_active":"2024-09-18T02:07:47.996083+0000","last_peered":"2024-09-18T02:07:47.996083+0000","last_clean":"2024-09-18T02:07:47.996083+0000","last_became_active":"2024-09-18T02:03:57.521706+0000","last_became_peered":"2024-09-18T02:03:57.521706+0000","last_unstale":"2024-09-18T02:07:47.996083+0000","last_undegraded":"2024-09-18T02:07:47.996083+0000","last_fullsized":"2024-09-18T02:07:47.996083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.658369+0000","last_change":"2024-09-18T02:03:50.282549+0000","last_active":"2024-09-18T02:07:46.658369+0000","last_peered":"2024-09-18T02:07:46.658369+0000","last_clean":"2024-09-18T02:07:46.658369+0000","last_became_active":"2024-09-18T02:03:48.274030+0000","last_became_peered":"2024-09-18T02:03:48.274030+0000","last_unstale":"2024-09-18T02:07:46.658369+0000","last_undegraded":"2024-09-18T02:07:46.658369+0000","last_fullsized":"2024-09-18T02:07:46.658369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011092910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.183292+0000","last_change":"2024-09-18T02:07:59.183292+0000","last_active":"2024-09-18T02:07:59.183292+0000","last_peered":"2024-09-18T02:07:59.183292+0000","last_clean":"2024-09-18T02:07:59.183292+0000","last_became_active":"2024-09-18T02:04:01.558915+0000","last_became_peered":"2024-09-18T02:04:01.558915+0000","last_unstale":"2024-09-18T02:07:59.183292+0000","last_undegraded":"2024-09-18T02:07:59.183292+0000","last_fullsized":"2024-09-18T02:07:59.183292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:59.183052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:59.183052+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.183052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:35.437454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.328507+0000","last_change":"2024-09-18T02:07:52.328507+0000","last_active":"2024-09-18T02:07:52.328507+0000","last_peered":"2024-09-18T02:07:52.328507+0000","last_clean":"2024-09-18T02:07:52.328507+0000","last_became_active":"2024-09-18T02:04:03.591378+0000","last_became_peered":"2024-09-18T02:04:03.591378+0000","last_unstale":"2024-09-18T02:07:52.328507+0000","last_undegraded":"2024-09-18T02:07:52.328507+0000","last_fullsized":"2024-09-18T02:07:52.328507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-18T02:07:52.328188+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-18T02:07:52.328188+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.328188+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:26.638787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.282096+0000","last_change":"2024-09-18T02:07:55.282096+0000","last_active":"2024-09-18T02:07:55.282096+0000","last_peered":"2024-09-18T02:07:55.282096+0000","last_clean":"2024-09-18T02:07:55.282096+0000","last_became_active":"2024-09-18T02:04:05.605265+0000","last_became_peered":"2024-09-18T02:04:05.605265+0000","last_unstale":"2024-09-18T02:07:55.282096+0000","last_undegraded":"2024-09-18T02:07:55.282096+0000","last_fullsized":"2024-09-18T02:07:55.282096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:55.281840+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:55.281840+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.281840+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:15.115042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334858+0000","last_change":"2024-09-18T02:04:07.624755+0000","last_active":"2024-09-18T02:06:26.334858+0000","last_peered":"2024-09-18T02:06:26.334858+0000","last_clean":"2024-09-18T02:06:26.334858+0000","last_became_active":"2024-09-18T02:04:07.624085+0000","last_became_peered":"2024-09-18T02:04:07.624085+0000","last_unstale":"2024-09-18T02:06:26.334858+0000","last_undegraded":"2024-09-18T02:06:26.334858+0000","last_fullsized":"2024-09-18T02:06:26.334858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.250825+0000","last_change":"2024-09-18T02:08:15.250887+0000","last_active":"2024-09-18T02:08:15.250825+0000","last_peered":"2024-09-18T02:08:15.250825+0000","last_clean":"2024-09-18T02:08:15.250825+0000","last_became_active":"2024-09-18T02:03:59.535266+0000","last_became_peered":"2024-09-18T02:03:59.535266+0000","last_unstale":"2024-09-18T02:08:15.250825+0000","last_undegraded":"2024-09-18T02:08:15.250825+0000","last_fullsized":"2024-09-18T02:08:15.250825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:15.250637+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:15.250637+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.250637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:15.097705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.764764+0000","last_change":"2024-09-18T02:08:23.764827+0000","last_active":"2024-09-18T02:08:23.764764+0000","last_peered":"2024-09-18T02:08:23.764764+0000","last_clean":"2024-09-18T02:08:23.764764+0000","last_became_active":"2024-09-18T02:03:57.528676+0000","last_became_peered":"2024-09-18T02:03:57.528676+0000","last_unstale":"2024-09-18T02:08:23.764764+0000","last_undegraded":"2024-09-18T02:08:23.764764+0000","last_fullsized":"2024-09-18T02:08:23.764764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:23.764549+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:23.764549+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.764549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:45.428464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995958+0000","last_change":"2024-09-18T02:03:50.288611+0000","last_active":"2024-09-18T02:07:47.995958+0000","last_peered":"2024-09-18T02:07:47.995958+0000","last_clean":"2024-09-18T02:07:47.995958+0000","last_became_active":"2024-09-18T02:03:48.396609+0000","last_became_peered":"2024-09-18T02:03:48.396609+0000","last_unstale":"2024-09-18T02:07:47.995958+0000","last_undegraded":"2024-09-18T02:07:47.995958+0000","last_fullsized":"2024-09-18T02:07:47.995958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025902970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.230746+0000","last_change":"2024-09-18T02:07:54.230746+0000","last_active":"2024-09-18T02:07:54.230746+0000","last_peered":"2024-09-18T02:07:54.230746+0000","last_clean":"2024-09-18T02:07:54.230746+0000","last_became_active":"2024-09-18T02:04:01.561488+0000","last_became_peered":"2024-09-18T02:04:01.561488+0000","last_unstale":"2024-09-18T02:07:54.230746+0000","last_undegraded":"2024-09-18T02:07:54.230746+0000","last_fullsized":"2024-09-18T02:07:54.230746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.230358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.230358+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.230358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:40.139193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'103","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.275633+0000","last_change":"2024-09-18T02:07:58.275633+0000","last_active":"2024-09-18T02:07:58.275633+0000","last_peered":"2024-09-18T02:07:58.275633+0000","last_clean":"2024-09-18T02:07:58.275633+0000","last_became_active":"2024-09-18T02:04:03.585879+0000","last_became_peered":"2024-09-18T02:04:03.585879+0000","last_unstale":"2024-09-18T02:07:58.275633+0000","last_undegraded":"2024-09-18T02:07:58.275633+0000","last_fullsized":"2024-09-18T02:07:58.275633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'103","last_scrub_stamp":"2024-09-18T02:07:58.275354+0000","last_deep_scrub":"32'103","last_deep_scrub_stamp":"2024-09-18T02:07:58.275354+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.275354+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:34:23.917223+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.300909+0000","last_change":"2024-09-18T02:07:48.300909+0000","last_active":"2024-09-18T02:07:48.300909+0000","last_peered":"2024-09-18T02:07:48.300909+0000","last_clean":"2024-09-18T02:07:48.300909+0000","last_became_active":"2024-09-18T02:04:05.588676+0000","last_became_peered":"2024-09-18T02:04:05.588676+0000","last_unstale":"2024-09-18T02:07:48.300909+0000","last_undegraded":"2024-09-18T02:07:48.300909+0000","last_fullsized":"2024-09-18T02:07:48.300909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.300757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.300757+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.300757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:52:41.278180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.274167+0000","last_change":"2024-09-18T02:07:59.274232+0000","last_active":"2024-09-18T02:07:59.274167+0000","last_peered":"2024-09-18T02:07:59.274167+0000","last_clean":"2024-09-18T02:07:59.274167+0000","last_became_active":"2024-09-18T02:04:07.619587+0000","last_became_peered":"2024-09-18T02:04:07.619587+0000","last_unstale":"2024-09-18T02:07:59.274167+0000","last_undegraded":"2024-09-18T02:07:59.274167+0000","last_fullsized":"2024-09-18T02:07:59.274167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:07:59.273974+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:07:59.273974+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.273974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:10.696295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.299098+0000","last_change":"2024-09-18T02:08:03.299098+0000","last_active":"2024-09-18T02:08:03.299098+0000","last_peered":"2024-09-18T02:08:03.299098+0000","last_clean":"2024-09-18T02:08:03.299098+0000","last_became_active":"2024-09-18T02:04:07.626396+0000","last_became_peered":"2024-09-18T02:04:07.626396+0000","last_unstale":"2024-09-18T02:08:03.299098+0000","last_undegraded":"2024-09-18T02:08:03.299098+0000","last_fullsized":"2024-09-18T02:08:03.299098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:03.298850+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:03.298850+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.298850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:43:53.827265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.214336+0000","last_change":"2024-09-18T02:08:23.214400+0000","last_active":"2024-09-18T02:08:23.214336+0000","last_peered":"2024-09-18T02:08:23.214336+0000","last_clean":"2024-09-18T02:08:23.214336+0000","last_became_active":"2024-09-18T02:03:59.538280+0000","last_became_peered":"2024-09-18T02:03:59.538280+0000","last_unstale":"2024-09-18T02:08:23.214336+0000","last_undegraded":"2024-09-18T02:08:23.214336+0000","last_fullsized":"2024-09-18T02:08:23.214336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.214126+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.214126+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.214126+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:36.362222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336799+0000","last_change":"2024-09-18T02:03:57.531366+0000","last_active":"2024-09-18T02:06:21.336799+0000","last_peered":"2024-09-18T02:06:21.336799+0000","last_clean":"2024-09-18T02:06:21.336799+0000","last_became_active":"2024-09-18T02:03:57.530751+0000","last_became_peered":"2024-09-18T02:03:57.530751+0000","last_unstale":"2024-09-18T02:06:21.336799+0000","last_undegraded":"2024-09-18T02:06:21.336799+0000","last_fullsized":"2024-09-18T02:06:21.336799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.781646+0000","last_change":"2024-09-18T02:08:05.781701+0000","last_active":"2024-09-18T02:08:05.781646+0000","last_peered":"2024-09-18T02:08:05.781646+0000","last_clean":"2024-09-18T02:08:05.781646+0000","last_became_active":"2024-09-18T02:04:01.561230+0000","last_became_peered":"2024-09-18T02:04:01.561230+0000","last_unstale":"2024-09-18T02:08:05.781646+0000","last_undegraded":"2024-09-18T02:08:05.781646+0000","last_fullsized":"2024-09-18T02:08:05.781646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:05.781451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:05.781451+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.781451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:05.813452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'47","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.175635+0000","last_change":"2024-09-18T02:07:58.175717+0000","last_active":"2024-09-18T02:07:58.175635+0000","last_peered":"2024-09-18T02:07:58.175635+0000","last_clean":"2024-09-18T02:07:58.175635+0000","last_became_active":"2024-09-18T02:04:03.595284+0000","last_became_peered":"2024-09-18T02:04:03.595284+0000","last_unstale":"2024-09-18T02:07:58.175635+0000","last_undegraded":"2024-09-18T02:07:58.175635+0000","last_fullsized":"2024-09-18T02:07:58.175635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-18T02:07:58.175442+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-18T02:07:58.175442+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.175442+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:34.582776+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.235929+0000","last_change":"2024-09-18T02:08:06.235985+0000","last_active":"2024-09-18T02:08:06.235929+0000","last_peered":"2024-09-18T02:08:06.235929+0000","last_clean":"2024-09-18T02:08:06.235929+0000","last_became_active":"2024-09-18T02:04:05.602528+0000","last_became_peered":"2024-09-18T02:04:05.602528+0000","last_unstale":"2024-09-18T02:08:06.235929+0000","last_undegraded":"2024-09-18T02:08:06.235929+0000","last_fullsized":"2024-09-18T02:08:06.235929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:06.235742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:06.235742+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.235742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:35:36.200312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.660172+0000","last_change":"2024-09-18T02:04:07.623315+0000","last_active":"2024-09-18T02:07:46.660172+0000","last_peered":"2024-09-18T02:07:46.660172+0000","last_clean":"2024-09-18T02:07:46.660172+0000","last_became_active":"2024-09-18T02:04:07.622753+0000","last_became_peered":"2024-09-18T02:04:07.622753+0000","last_unstale":"2024-09-18T02:07:46.660172+0000","last_undegraded":"2024-09-18T02:07:46.660172+0000","last_fullsized":"2024-09-18T02:07:46.660172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.791286+0000","last_change":"2024-09-18T02:08:07.791428+0000","last_active":"2024-09-18T02:08:07.791286+0000","last_peered":"2024-09-18T02:08:07.791286+0000","last_clean":"2024-09-18T02:08:07.791286+0000","last_became_active":"2024-09-18T02:03:59.554803+0000","last_became_peered":"2024-09-18T02:03:59.554803+0000","last_unstale":"2024-09-18T02:08:07.791286+0000","last_undegraded":"2024-09-18T02:08:07.791286+0000","last_fullsized":"2024-09-18T02:08:07.791286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:07.791070+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:07.791070+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.791070+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:07.638138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.336333+0000","last_change":"2024-09-18T02:03:57.522614+0000","last_active":"2024-09-18T02:06:26.336333+0000","last_peered":"2024-09-18T02:06:26.336333+0000","last_clean":"2024-09-18T02:06:26.336333+0000","last_became_active":"2024-09-18T02:03:57.519403+0000","last_became_peered":"2024-09-18T02:03:57.519403+0000","last_unstale":"2024-09-18T02:06:26.336333+0000","last_undegraded":"2024-09-18T02:06:26.336333+0000","last_fullsized":"2024-09-18T02:06:26.336333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.195595+0000","last_change":"2024-09-18T02:07:57.195649+0000","last_active":"2024-09-18T02:07:57.195595+0000","last_peered":"2024-09-18T02:07:57.195595+0000","last_clean":"2024-09-18T02:07:57.195595+0000","last_became_active":"2024-09-18T02:04:01.558788+0000","last_became_peered":"2024-09-18T02:04:01.558788+0000","last_unstale":"2024-09-18T02:07:57.195595+0000","last_undegraded":"2024-09-18T02:07:57.195595+0000","last_fullsized":"2024-09-18T02:07:57.195595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:57.195366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:57.195366+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.195366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:25.351307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.260154+0000","last_change":"2024-09-18T02:07:57.260300+0000","last_active":"2024-09-18T02:07:57.260154+0000","last_peered":"2024-09-18T02:07:57.260154+0000","last_clean":"2024-09-18T02:07:57.260154+0000","last_became_active":"2024-09-18T02:04:03.581045+0000","last_became_peered":"2024-09-18T02:04:03.581045+0000","last_unstale":"2024-09-18T02:07:57.260154+0000","last_undegraded":"2024-09-18T02:07:57.260154+0000","last_fullsized":"2024-09-18T02:07:57.260154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:07:57.259885+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:07:57.259885+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.259885+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:36.754049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.344639+0000","last_change":"2024-09-18T02:07:53.344690+0000","last_active":"2024-09-18T02:07:53.344639+0000","last_peered":"2024-09-18T02:07:53.344639+0000","last_clean":"2024-09-18T02:07:53.344639+0000","last_became_active":"2024-09-18T02:04:05.599064+0000","last_became_peered":"2024-09-18T02:04:05.599064+0000","last_unstale":"2024-09-18T02:07:53.344639+0000","last_undegraded":"2024-09-18T02:07:53.344639+0000","last_fullsized":"2024-09-18T02:07:53.344639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.344462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.344462+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.344462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:17:03.855166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:41.338031+0000","last_change":"2024-09-18T02:04:07.610644+0000","last_active":"2024-09-18T02:06:41.338031+0000","last_peered":"2024-09-18T02:06:41.338031+0000","last_clean":"2024-09-18T02:06:41.338031+0000","last_became_active":"2024-09-18T02:04:07.609954+0000","last_became_peered":"2024-09-18T02:04:07.609954+0000","last_unstale":"2024-09-18T02:06:41.338031+0000","last_undegraded":"2024-09-18T02:06:41.338031+0000","last_fullsized":"2024-09-18T02:06:41.338031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.117702+0000","last_change":"2024-09-18T02:08:16.117771+0000","last_active":"2024-09-18T02:08:16.117702+0000","last_peered":"2024-09-18T02:08:16.117702+0000","last_clean":"2024-09-18T02:08:16.117702+0000","last_became_active":"2024-09-18T02:03:59.549791+0000","last_became_peered":"2024-09-18T02:03:59.549791+0000","last_unstale":"2024-09-18T02:08:16.117702+0000","last_undegraded":"2024-09-18T02:08:16.117702+0000","last_fullsized":"2024-09-18T02:08:16.117702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:16.117501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:16.117501+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.117501+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:44.273442+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.336365+0000","last_change":"2024-09-18T02:04:36.371010+0000","last_active":"2024-09-18T02:06:26.336365+0000","last_peered":"2024-09-18T02:06:26.336365+0000","last_clean":"2024-09-18T02:06:26.336365+0000","last_became_active":"2024-09-18T02:04:36.370188+0000","last_became_peered":"2024-09-18T02:04:36.370188+0000","last_unstale":"2024-09-18T02:06:26.336365+0000","last_undegraded":"2024-09-18T02:06:26.336365+0000","last_fullsized":"2024-09-18T02:06:26.336365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.309301+0000","last_change":"2024-09-18T02:08:10.309363+0000","last_active":"2024-09-18T02:08:10.309301+0000","last_peered":"2024-09-18T02:08:10.309301+0000","last_clean":"2024-09-18T02:08:10.309301+0000","last_became_active":"2024-09-18T02:04:01.562586+0000","last_became_peered":"2024-09-18T02:04:01.562586+0000","last_unstale":"2024-09-18T02:08:10.309301+0000","last_undegraded":"2024-09-18T02:08:10.309301+0000","last_fullsized":"2024-09-18T02:08:10.309301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:10.309081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:10.309081+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.309081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:18.629970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'50","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.231506+0000","last_change":"2024-09-18T02:07:58.231588+0000","last_active":"2024-09-18T02:07:58.231506+0000","last_peered":"2024-09-18T02:07:58.231506+0000","last_clean":"2024-09-18T02:07:58.231506+0000","last_became_active":"2024-09-18T02:04:03.578581+0000","last_became_peered":"2024-09-18T02:04:03.578581+0000","last_unstale":"2024-09-18T02:07:58.231506+0000","last_undegraded":"2024-09-18T02:07:58.231506+0000","last_fullsized":"2024-09-18T02:07:58.231506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'50","last_scrub_stamp":"2024-09-18T02:07:58.231292+0000","last_deep_scrub":"32'50","last_deep_scrub_stamp":"2024-09-18T02:07:58.231292+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.231292+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:28.484821+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.089281+0000","last_change":"2024-09-18T02:07:53.089343+0000","last_active":"2024-09-18T02:07:53.089281+0000","last_peered":"2024-09-18T02:07:53.089281+0000","last_clean":"2024-09-18T02:07:53.089281+0000","last_became_active":"2024-09-18T02:04:05.586978+0000","last_became_peered":"2024-09-18T02:04:05.586978+0000","last_unstale":"2024-09-18T02:07:53.089281+0000","last_undegraded":"2024-09-18T02:07:53.089281+0000","last_fullsized":"2024-09-18T02:07:53.089281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.089086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.089086+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.089086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:43.728215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:41.341635+0000","last_change":"2024-09-18T02:04:07.611859+0000","last_active":"2024-09-18T02:06:41.341635+0000","last_peered":"2024-09-18T02:06:41.341635+0000","last_clean":"2024-09-18T02:06:41.341635+0000","last_became_active":"2024-09-18T02:04:07.607227+0000","last_became_peered":"2024-09-18T02:04:07.607227+0000","last_unstale":"2024-09-18T02:06:41.341635+0000","last_undegraded":"2024-09-18T02:06:41.341635+0000","last_fullsized":"2024-09-18T02:06:41.341635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336526+0000","last_change":"2024-09-18T02:03:59.550610+0000","last_active":"2024-09-18T02:06:21.336526+0000","last_peered":"2024-09-18T02:06:21.336526+0000","last_clean":"2024-09-18T02:06:21.336526+0000","last_became_active":"2024-09-18T02:03:59.550221+0000","last_became_peered":"2024-09-18T02:03:59.550221+0000","last_unstale":"2024-09-18T02:06:21.336526+0000","last_undegraded":"2024-09-18T02:06:21.336526+0000","last_fullsized":"2024-09-18T02:06:21.336526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.335016+0000","last_change":"2024-09-18T02:03:57.523727+0000","last_active":"2024-09-18T02:06:26.335016+0000","last_peered":"2024-09-18T02:06:26.335016+0000","last_clean":"2024-09-18T02:06:26.335016+0000","last_became_active":"2024-09-18T02:03:57.522590+0000","last_became_peered":"2024-09-18T02:03:57.522590+0000","last_unstale":"2024-09-18T02:06:26.335016+0000","last_undegraded":"2024-09-18T02:06:26.335016+0000","last_fullsized":"2024-09-18T02:06:26.335016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.399696+0000","last_change":"2024-09-18T02:07:48.399749+0000","last_active":"2024-09-18T02:07:48.399696+0000","last_peered":"2024-09-18T02:07:48.399696+0000","last_clean":"2024-09-18T02:07:48.399696+0000","last_became_active":"2024-09-18T02:04:01.566205+0000","last_became_peered":"2024-09-18T02:04:01.566205+0000","last_unstale":"2024-09-18T02:07:48.399696+0000","last_undegraded":"2024-09-18T02:07:48.399696+0000","last_fullsized":"2024-09-18T02:07:48.399696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.399488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.399488+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.399488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:47.098447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.319180+0000","last_change":"2024-09-18T02:08:00.319259+0000","last_active":"2024-09-18T02:08:00.319180+0000","last_peered":"2024-09-18T02:08:00.319180+0000","last_clean":"2024-09-18T02:08:00.319180+0000","last_became_active":"2024-09-18T02:04:03.580770+0000","last_became_peered":"2024-09-18T02:04:03.580770+0000","last_unstale":"2024-09-18T02:08:00.319180+0000","last_undegraded":"2024-09-18T02:08:00.319180+0000","last_fullsized":"2024-09-18T02:08:00.319180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-18T02:08:00.318990+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-18T02:08:00.318990+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.318990+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:50.958119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.367953+0000","last_change":"2024-09-18T02:07:54.368006+0000","last_active":"2024-09-18T02:07:54.367953+0000","last_peered":"2024-09-18T02:07:54.367953+0000","last_clean":"2024-09-18T02:07:54.367953+0000","last_became_active":"2024-09-18T02:04:05.591514+0000","last_became_peered":"2024-09-18T02:04:05.591514+0000","last_unstale":"2024-09-18T02:07:54.367953+0000","last_undegraded":"2024-09-18T02:07:54.367953+0000","last_fullsized":"2024-09-18T02:07:54.367953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.367760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.367760+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.367760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:57.231313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.224665+0000","last_change":"2024-09-18T02:08:25.224723+0000","last_active":"2024-09-18T02:08:25.224665+0000","last_peered":"2024-09-18T02:08:25.224665+0000","last_clean":"2024-09-18T02:08:25.224665+0000","last_became_active":"2024-09-18T02:03:59.553660+0000","last_became_peered":"2024-09-18T02:03:59.553660+0000","last_unstale":"2024-09-18T02:08:25.224665+0000","last_undegraded":"2024-09-18T02:08:25.224665+0000","last_fullsized":"2024-09-18T02:08:25.224665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:25.224477+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:25.224477+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.224477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:18.652044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.211967+0000","last_change":"2024-09-18T02:03:57.528505+0000","last_active":"2024-09-18T02:07:12.211967+0000","last_peered":"2024-09-18T02:07:12.211967+0000","last_clean":"2024-09-18T02:07:12.211967+0000","last_became_active":"2024-09-18T02:03:57.526941+0000","last_became_peered":"2024-09-18T02:03:57.526941+0000","last_unstale":"2024-09-18T02:07:12.211967+0000","last_undegraded":"2024-09-18T02:07:12.211967+0000","last_fullsized":"2024-09-18T02:07:12.211967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.188438+0000","last_change":"2024-09-18T02:08:10.188544+0000","last_active":"2024-09-18T02:08:10.188438+0000","last_peered":"2024-09-18T02:08:10.188438+0000","last_clean":"2024-09-18T02:08:10.188438+0000","last_became_active":"2024-09-18T02:04:01.559839+0000","last_became_peered":"2024-09-18T02:04:01.559839+0000","last_unstale":"2024-09-18T02:08:10.188438+0000","last_undegraded":"2024-09-18T02:08:10.188438+0000","last_fullsized":"2024-09-18T02:08:10.188438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:10.188213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:10.188213+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.188213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:22:05.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'71","reported_seq":150,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.245034+0000","last_change":"2024-09-18T02:07:56.245115+0000","last_active":"2024-09-18T02:07:56.245034+0000","last_peered":"2024-09-18T02:07:56.245034+0000","last_clean":"2024-09-18T02:07:56.245034+0000","last_became_active":"2024-09-18T02:04:03.581518+0000","last_became_peered":"2024-09-18T02:04:03.581518+0000","last_unstale":"2024-09-18T02:07:56.245034+0000","last_undegraded":"2024-09-18T02:07:56.245034+0000","last_fullsized":"2024-09-18T02:07:56.245034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'71","last_scrub_stamp":"2024-09-18T02:07:56.244855+0000","last_deep_scrub":"32'71","last_deep_scrub_stamp":"2024-09-18T02:07:56.244855+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.244855+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:40.886685+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.238645+0000","last_change":"2024-09-18T02:07:48.238697+0000","last_active":"2024-09-18T02:07:48.238645+0000","last_peered":"2024-09-18T02:07:48.238645+0000","last_clean":"2024-09-18T02:07:48.238645+0000","last_became_active":"2024-09-18T02:04:05.610007+0000","last_became_peered":"2024-09-18T02:04:05.610007+0000","last_unstale":"2024-09-18T02:07:48.238645+0000","last_undegraded":"2024-09-18T02:07:48.238645+0000","last_fullsized":"2024-09-18T02:07:48.238645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.238443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.238443+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.238443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:49:49.194989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'20","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.091638+0000","last_change":"2024-09-18T02:08:15.091700+0000","last_active":"2024-09-18T02:08:15.091638+0000","last_peered":"2024-09-18T02:08:15.091638+0000","last_clean":"2024-09-18T02:08:15.091638+0000","last_became_active":"2024-09-18T02:04:07.609058+0000","last_became_peered":"2024-09-18T02:04:07.609058+0000","last_unstale":"2024-09-18T02:08:15.091638+0000","last_undegraded":"2024-09-18T02:08:15.091638+0000","last_fullsized":"2024-09-18T02:08:15.091638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-18T02:08:15.091443+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-18T02:08:15.091443+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.091443+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:45.320119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.659037+0000","last_change":"2024-09-18T02:03:59.541759+0000","last_active":"2024-09-18T02:07:46.659037+0000","last_peered":"2024-09-18T02:07:46.659037+0000","last_clean":"2024-09-18T02:07:46.659037+0000","last_became_active":"2024-09-18T02:03:59.540971+0000","last_became_peered":"2024-09-18T02:03:59.540971+0000","last_unstale":"2024-09-18T02:07:46.659037+0000","last_undegraded":"2024-09-18T02:07:46.659037+0000","last_fullsized":"2024-09-18T02:07:46.659037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.334725+0000","last_change":"2024-09-18T02:03:57.519487+0000","last_active":"2024-09-18T02:06:26.334725+0000","last_peered":"2024-09-18T02:06:26.334725+0000","last_clean":"2024-09-18T02:06:26.334725+0000","last_became_active":"2024-09-18T02:03:57.518311+0000","last_became_peered":"2024-09-18T02:03:57.518311+0000","last_unstale":"2024-09-18T02:06:26.334725+0000","last_undegraded":"2024-09-18T02:06:26.334725+0000","last_fullsized":"2024-09-18T02:06:26.334725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.276033+0000","last_change":"2024-09-18T02:08:09.276033+0000","last_active":"2024-09-18T02:08:09.276033+0000","last_peered":"2024-09-18T02:08:09.276033+0000","last_clean":"2024-09-18T02:08:09.276033+0000","last_became_active":"2024-09-18T02:04:01.563285+0000","last_became_peered":"2024-09-18T02:04:01.563285+0000","last_unstale":"2024-09-18T02:08:09.276033+0000","last_undegraded":"2024-09-18T02:08:09.276033+0000","last_fullsized":"2024-09-18T02:08:09.276033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:09.275778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:09.275778+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.275778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:39.529307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'47","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.348316+0000","last_change":"2024-09-18T02:08:17.348431+0000","last_active":"2024-09-18T02:08:17.348316+0000","last_peered":"2024-09-18T02:08:17.348316+0000","last_clean":"2024-09-18T02:08:17.348316+0000","last_became_active":"2024-09-18T02:04:03.596605+0000","last_became_peered":"2024-09-18T02:04:03.596605+0000","last_unstale":"2024-09-18T02:08:17.348316+0000","last_undegraded":"2024-09-18T02:08:17.348316+0000","last_fullsized":"2024-09-18T02:08:17.348316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-18T02:08:17.348103+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-18T02:08:17.348103+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.348103+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:15.420796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.941939+0000","last_change":"2024-09-18T02:07:56.941998+0000","last_active":"2024-09-18T02:07:56.941939+0000","last_peered":"2024-09-18T02:07:56.941939+0000","last_clean":"2024-09-18T02:07:56.941939+0000","last_became_active":"2024-09-18T02:04:05.589023+0000","last_became_peered":"2024-09-18T02:04:05.589023+0000","last_unstale":"2024-09-18T02:07:56.941939+0000","last_undegraded":"2024-09-18T02:07:56.941939+0000","last_fullsized":"2024-09-18T02:07:56.941939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:56.941733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:56.941733+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.941733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:18.501298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339141+0000","last_change":"2024-09-18T02:04:07.625988+0000","last_active":"2024-09-18T02:06:31.339141+0000","last_peered":"2024-09-18T02:06:31.339141+0000","last_clean":"2024-09-18T02:06:31.339141+0000","last_became_active":"2024-09-18T02:04:07.625440+0000","last_became_peered":"2024-09-18T02:04:07.625440+0000","last_unstale":"2024-09-18T02:06:31.339141+0000","last_undegraded":"2024-09-18T02:06:31.339141+0000","last_fullsized":"2024-09-18T02:06:31.339141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.216192+0000","last_change":"2024-09-18T02:08:02.216266+0000","last_active":"2024-09-18T02:08:02.216192+0000","last_peered":"2024-09-18T02:08:02.216192+0000","last_clean":"2024-09-18T02:08:02.216192+0000","last_became_active":"2024-09-18T02:03:59.561208+0000","last_became_peered":"2024-09-18T02:03:59.561208+0000","last_unstale":"2024-09-18T02:08:02.216192+0000","last_undegraded":"2024-09-18T02:08:02.216192+0000","last_fullsized":"2024-09-18T02:08:02.216192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:02.216020+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:02.216020+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.216020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:52.878948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.335961+0000","last_change":"2024-09-18T02:03:57.521151+0000","last_active":"2024-09-18T02:06:31.335961+0000","last_peered":"2024-09-18T02:06:31.335961+0000","last_clean":"2024-09-18T02:06:31.335961+0000","last_became_active":"2024-09-18T02:03:57.520569+0000","last_became_peered":"2024-09-18T02:03:57.520569+0000","last_unstale":"2024-09-18T02:06:31.335961+0000","last_undegraded":"2024-09-18T02:06:31.335961+0000","last_fullsized":"2024-09-18T02:06:31.335961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.257322+0000","last_change":"2024-09-18T02:08:08.257373+0000","last_active":"2024-09-18T02:08:08.257322+0000","last_peered":"2024-09-18T02:08:08.257322+0000","last_clean":"2024-09-18T02:08:08.257322+0000","last_became_active":"2024-09-18T02:04:01.565499+0000","last_became_peered":"2024-09-18T02:04:01.565499+0000","last_unstale":"2024-09-18T02:08:08.257322+0000","last_undegraded":"2024-09-18T02:08:08.257322+0000","last_fullsized":"2024-09-18T02:08:08.257322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.257120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.257120+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.257120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:47.751284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.199509+0000","last_change":"2024-09-18T02:08:00.199509+0000","last_active":"2024-09-18T02:08:00.199509+0000","last_peered":"2024-09-18T02:08:00.199509+0000","last_clean":"2024-09-18T02:08:00.199509+0000","last_became_active":"2024-09-18T02:04:03.577841+0000","last_became_peered":"2024-09-18T02:04:03.577841+0000","last_unstale":"2024-09-18T02:08:00.199509+0000","last_undegraded":"2024-09-18T02:08:00.199509+0000","last_fullsized":"2024-09-18T02:08:00.199509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-18T02:08:00.199183+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-18T02:08:00.199183+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.199183+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:17.403960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.194433+0000","last_change":"2024-09-18T02:08:03.194433+0000","last_active":"2024-09-18T02:08:03.194433+0000","last_peered":"2024-09-18T02:08:03.194433+0000","last_clean":"2024-09-18T02:08:03.194433+0000","last_became_active":"2024-09-18T02:04:05.605718+0000","last_became_peered":"2024-09-18T02:04:05.605718+0000","last_unstale":"2024-09-18T02:08:03.194433+0000","last_undegraded":"2024-09-18T02:08:03.194433+0000","last_fullsized":"2024-09-18T02:08:03.194433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:03.194177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:03.194177+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.194177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:11.445570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339037+0000","last_change":"2024-09-18T02:04:07.621810+0000","last_active":"2024-09-18T02:06:31.339037+0000","last_peered":"2024-09-18T02:06:31.339037+0000","last_clean":"2024-09-18T02:06:31.339037+0000","last_became_active":"2024-09-18T02:04:07.621224+0000","last_became_peered":"2024-09-18T02:04:07.621224+0000","last_unstale":"2024-09-18T02:06:31.339037+0000","last_undegraded":"2024-09-18T02:06:31.339037+0000","last_fullsized":"2024-09-18T02:06:31.339037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.086273+0000","last_change":"2024-09-18T02:08:23.086336+0000","last_active":"2024-09-18T02:08:23.086273+0000","last_peered":"2024-09-18T02:08:23.086273+0000","last_clean":"2024-09-18T02:08:23.086273+0000","last_became_active":"2024-09-18T02:03:59.536701+0000","last_became_peered":"2024-09-18T02:03:59.536701+0000","last_unstale":"2024-09-18T02:08:23.086273+0000","last_undegraded":"2024-09-18T02:08:23.086273+0000","last_fullsized":"2024-09-18T02:08:23.086273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.086080+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.086080+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.086080+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:18.513965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339226+0000","last_change":"2024-09-18T02:03:57.528489+0000","last_active":"2024-09-18T02:06:31.339226+0000","last_peered":"2024-09-18T02:06:31.339226+0000","last_clean":"2024-09-18T02:06:31.339226+0000","last_became_active":"2024-09-18T02:03:57.527891+0000","last_became_peered":"2024-09-18T02:03:57.527891+0000","last_unstale":"2024-09-18T02:06:31.339226+0000","last_undegraded":"2024-09-18T02:06:31.339226+0000","last_fullsized":"2024-09-18T02:06:31.339226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.843805+0000","last_change":"2024-09-18T02:08:02.843858+0000","last_active":"2024-09-18T02:08:02.843805+0000","last_peered":"2024-09-18T02:08:02.843805+0000","last_clean":"2024-09-18T02:08:02.843805+0000","last_became_active":"2024-09-18T02:04:01.564187+0000","last_became_peered":"2024-09-18T02:04:01.564187+0000","last_unstale":"2024-09-18T02:08:02.843805+0000","last_undegraded":"2024-09-18T02:08:02.843805+0000","last_fullsized":"2024-09-18T02:08:02.843805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:02.843618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:02.843618+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.843618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:11.164508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.203666+0000","last_change":"2024-09-18T02:08:04.203666+0000","last_active":"2024-09-18T02:08:04.203666+0000","last_peered":"2024-09-18T02:08:04.203666+0000","last_clean":"2024-09-18T02:08:04.203666+0000","last_became_active":"2024-09-18T02:04:03.596273+0000","last_became_peered":"2024-09-18T02:04:03.596273+0000","last_unstale":"2024-09-18T02:08:04.203666+0000","last_undegraded":"2024-09-18T02:08:04.203666+0000","last_fullsized":"2024-09-18T02:08:04.203666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-18T02:08:04.203351+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-18T02:08:04.203351+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.203351+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:49:59.631236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":384,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.282688+0000","last_change":"2024-09-18T02:07:50.282688+0000","last_active":"2024-09-18T02:07:50.282688+0000","last_peered":"2024-09-18T02:07:50.282688+0000","last_clean":"2024-09-18T02:07:50.282688+0000","last_became_active":"2024-09-18T02:04:05.601182+0000","last_became_peered":"2024-09-18T02:04:05.601182+0000","last_unstale":"2024-09-18T02:07:50.282688+0000","last_undegraded":"2024-09-18T02:07:50.282688+0000","last_fullsized":"2024-09-18T02:07:50.282688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:50.282455+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:50.282455+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.282455+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:09:41.423906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'8","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.338947+0000","last_change":"2024-09-18T02:04:07.622167+0000","last_active":"2024-09-18T02:06:31.338947+0000","last_peered":"2024-09-18T02:06:31.338947+0000","last_clean":"2024-09-18T02:06:31.338947+0000","last_became_active":"2024-09-18T02:04:07.621240+0000","last_became_peered":"2024-09-18T02:04:07.621240+0000","last_unstale":"2024-09-18T02:06:31.338947+0000","last_undegraded":"2024-09-18T02:06:31.338947+0000","last_fullsized":"2024-09-18T02:06:31.338947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'14","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.227272+0000","last_change":"2024-09-18T02:08:19.227333+0000","last_active":"2024-09-18T02:08:19.227272+0000","last_peered":"2024-09-18T02:08:19.227272+0000","last_clean":"2024-09-18T02:08:19.227272+0000","last_became_active":"2024-09-18T02:03:59.536486+0000","last_became_peered":"2024-09-18T02:03:59.536486+0000","last_unstale":"2024-09-18T02:08:19.227272+0000","last_undegraded":"2024-09-18T02:08:19.227272+0000","last_fullsized":"2024-09-18T02:08:19.227272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:19.227080+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:19.227080+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.227080+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:29.401705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.336063+0000","last_change":"2024-09-18T02:03:57.520866+0000","last_active":"2024-09-18T02:06:31.336063+0000","last_peered":"2024-09-18T02:06:31.336063+0000","last_clean":"2024-09-18T02:06:31.336063+0000","last_became_active":"2024-09-18T02:03:57.520452+0000","last_became_peered":"2024-09-18T02:03:57.520452+0000","last_unstale":"2024-09-18T02:06:31.336063+0000","last_undegraded":"2024-09-18T02:06:31.336063+0000","last_fullsized":"2024-09-18T02:06:31.336063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.832584+0000","last_change":"2024-09-18T02:08:03.832649+0000","last_active":"2024-09-18T02:08:03.832584+0000","last_peered":"2024-09-18T02:08:03.832584+0000","last_clean":"2024-09-18T02:08:03.832584+0000","last_became_active":"2024-09-18T02:04:01.564165+0000","last_became_peered":"2024-09-18T02:04:01.564165+0000","last_unstale":"2024-09-18T02:08:03.832584+0000","last_undegraded":"2024-09-18T02:08:03.832584+0000","last_fullsized":"2024-09-18T02:08:03.832584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:03.832329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:03.832329+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.832329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:28.467191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'73","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.093299+0000","last_change":"2024-09-18T02:07:52.093377+0000","last_active":"2024-09-18T02:07:52.093299+0000","last_peered":"2024-09-18T02:07:52.093299+0000","last_clean":"2024-09-18T02:07:52.093299+0000","last_became_active":"2024-09-18T02:04:03.566714+0000","last_became_peered":"2024-09-18T02:04:03.566714+0000","last_unstale":"2024-09-18T02:07:52.093299+0000","last_undegraded":"2024-09-18T02:07:52.093299+0000","last_fullsized":"2024-09-18T02:07:52.093299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-09-18T02:07:52.093206+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-09-18T02:07:52.093206+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.093206+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:03.515528+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.212884+0000","last_change":"2024-09-18T02:07:53.213015+0000","last_active":"2024-09-18T02:07:53.212884+0000","last_peered":"2024-09-18T02:07:53.212884+0000","last_clean":"2024-09-18T02:07:53.212884+0000","last_became_active":"2024-09-18T02:04:05.578635+0000","last_became_peered":"2024-09-18T02:04:05.578635+0000","last_unstale":"2024-09-18T02:07:53.212884+0000","last_undegraded":"2024-09-18T02:07:53.212884+0000","last_fullsized":"2024-09-18T02:07:53.212884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.212658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.212658+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.212658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:04.833203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.712876+0000","last_change":"2024-09-18T02:08:12.712953+0000","last_active":"2024-09-18T02:08:12.712876+0000","last_peered":"2024-09-18T02:08:12.712876+0000","last_clean":"2024-09-18T02:08:12.712876+0000","last_became_active":"2024-09-18T02:04:07.618696+0000","last_became_peered":"2024-09-18T02:04:07.618696+0000","last_unstale":"2024-09-18T02:08:12.712876+0000","last_undegraded":"2024-09-18T02:08:12.712876+0000","last_fullsized":"2024-09-18T02:08:12.712876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:12.712689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:12.712689+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.712689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:04.964071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.235975+0000","last_change":"2024-09-18T02:03:59.537068+0000","last_active":"2024-09-18T02:07:12.235975+0000","last_peered":"2024-09-18T02:07:12.235975+0000","last_clean":"2024-09-18T02:07:12.235975+0000","last_became_active":"2024-09-18T02:03:59.536693+0000","last_became_peered":"2024-09-18T02:03:59.536693+0000","last_unstale":"2024-09-18T02:07:12.235975+0000","last_undegraded":"2024-09-18T02:07:12.235975+0000","last_fullsized":"2024-09-18T02:07:12.235975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339376+0000","last_change":"2024-09-18T02:03:57.533853+0000","last_active":"2024-09-18T02:06:31.339376+0000","last_peered":"2024-09-18T02:06:31.339376+0000","last_clean":"2024-09-18T02:06:31.339376+0000","last_became_active":"2024-09-18T02:03:57.532963+0000","last_became_peered":"2024-09-18T02:03:57.532963+0000","last_unstale":"2024-09-18T02:06:31.339376+0000","last_undegraded":"2024-09-18T02:06:31.339376+0000","last_fullsized":"2024-09-18T02:06:31.339376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.290629+0000","last_change":"2024-09-18T02:08:06.290687+0000","last_active":"2024-09-18T02:08:06.290629+0000","last_peered":"2024-09-18T02:08:06.290629+0000","last_clean":"2024-09-18T02:08:06.290629+0000","last_became_active":"2024-09-18T02:04:01.572089+0000","last_became_peered":"2024-09-18T02:04:01.572089+0000","last_unstale":"2024-09-18T02:08:06.290629+0000","last_undegraded":"2024-09-18T02:08:06.290629+0000","last_fullsized":"2024-09-18T02:08:06.290629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:06.290419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:06.290419+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.290419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:26.123621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'43","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.233899+0000","last_change":"2024-09-18T02:08:01.233976+0000","last_active":"2024-09-18T02:08:01.233899+0000","last_peered":"2024-09-18T02:08:01.233899+0000","last_clean":"2024-09-18T02:08:01.233899+0000","last_became_active":"2024-09-18T02:04:03.569962+0000","last_became_peered":"2024-09-18T02:04:03.569962+0000","last_unstale":"2024-09-18T02:08:01.233899+0000","last_undegraded":"2024-09-18T02:08:01.233899+0000","last_fullsized":"2024-09-18T02:08:01.233899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:01.233724+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:01.233724+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.233724+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:11:25.741483+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.213865+0000","last_change":"2024-09-18T02:08:08.213922+0000","last_active":"2024-09-18T02:08:08.213865+0000","last_peered":"2024-09-18T02:08:08.213865+0000","last_clean":"2024-09-18T02:08:08.213865+0000","last_became_active":"2024-09-18T02:04:05.606608+0000","last_became_peered":"2024-09-18T02:04:05.606608+0000","last_unstale":"2024-09-18T02:08:08.213865+0000","last_undegraded":"2024-09-18T02:08:08.213865+0000","last_fullsized":"2024-09-18T02:08:08.213865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.213681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.213681+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.213681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:07:17.342298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"30'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:36.340645+0000","last_change":"2024-09-18T02:04:07.609072+0000","last_active":"2024-09-18T02:06:36.340645+0000","last_peered":"2024-09-18T02:06:36.340645+0000","last_clean":"2024-09-18T02:06:36.340645+0000","last_became_active":"2024-09-18T02:04:07.607839+0000","last_became_peered":"2024-09-18T02:04:07.607839+0000","last_unstale":"2024-09-18T02:06:36.340645+0000","last_undegraded":"2024-09-18T02:06:36.340645+0000","last_fullsized":"2024-09-18T02:06:36.340645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:26.337914+0000","last_change":"2024-09-18T02:03:59.550978+0000","last_active":"2024-09-18T02:06:26.337914+0000","last_peered":"2024-09-18T02:06:26.337914+0000","last_clean":"2024-09-18T02:06:26.337914+0000","last_became_active":"2024-09-18T02:03:59.547123+0000","last_became_peered":"2024-09-18T02:03:59.547123+0000","last_unstale":"2024-09-18T02:06:26.337914+0000","last_undegraded":"2024-09-18T02:06:26.337914+0000","last_fullsized":"2024-09-18T02:06:26.337914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.040922+0000","last_change":"2024-09-18T02:08:22.040978+0000","last_active":"2024-09-18T02:08:22.040922+0000","last_peered":"2024-09-18T02:08:22.040922+0000","last_clean":"2024-09-18T02:08:22.040922+0000","last_became_active":"2024-09-18T02:03:57.530001+0000","last_became_peered":"2024-09-18T02:03:57.530001+0000","last_unstale":"2024-09-18T02:08:22.040922+0000","last_undegraded":"2024-09-18T02:08:22.040922+0000","last_fullsized":"2024-09-18T02:08:22.040922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:22.040728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:22.040728+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.040728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:07.868719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.978250+0000","last_change":"2024-09-18T02:07:55.978327+0000","last_active":"2024-09-18T02:07:55.978250+0000","last_peered":"2024-09-18T02:07:55.978250+0000","last_clean":"2024-09-18T02:07:55.978250+0000","last_became_active":"2024-09-18T02:04:01.571263+0000","last_became_peered":"2024-09-18T02:04:01.571263+0000","last_unstale":"2024-09-18T02:07:55.978250+0000","last_undegraded":"2024-09-18T02:07:55.978250+0000","last_fullsized":"2024-09-18T02:07:55.978250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:55.978062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:55.978062+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.978062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:43:46.506478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'39","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.239184+0000","last_change":"2024-09-18T02:08:11.239265+0000","last_active":"2024-09-18T02:08:11.239184+0000","last_peered":"2024-09-18T02:08:11.239184+0000","last_clean":"2024-09-18T02:08:11.239184+0000","last_became_active":"2024-09-18T02:04:03.601392+0000","last_became_peered":"2024-09-18T02:04:03.601392+0000","last_unstale":"2024-09-18T02:08:11.239184+0000","last_undegraded":"2024-09-18T02:08:11.239184+0000","last_fullsized":"2024-09-18T02:08:11.239184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-18T02:08:11.238968+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-18T02:08:11.238968+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.238968+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:52:55.973173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.202655+0000","last_change":"2024-09-18T02:08:07.202713+0000","last_active":"2024-09-18T02:08:07.202655+0000","last_peered":"2024-09-18T02:08:07.202655+0000","last_clean":"2024-09-18T02:08:07.202655+0000","last_became_active":"2024-09-18T02:04:05.599964+0000","last_became_peered":"2024-09-18T02:04:05.599964+0000","last_unstale":"2024-09-18T02:08:07.202655+0000","last_undegraded":"2024-09-18T02:08:07.202655+0000","last_fullsized":"2024-09-18T02:08:07.202655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:07.202464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:07.202464+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.202464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:09.828342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.400039+0000","last_change":"2024-09-18T02:04:07.615961+0000","last_active":"2024-09-18T02:07:12.400039+0000","last_peered":"2024-09-18T02:07:12.400039+0000","last_clean":"2024-09-18T02:07:12.400039+0000","last_became_active":"2024-09-18T02:04:07.615007+0000","last_became_peered":"2024-09-18T02:04:07.615007+0000","last_unstale":"2024-09-18T02:07:12.400039+0000","last_undegraded":"2024-09-18T02:07:12.400039+0000","last_fullsized":"2024-09-18T02:07:12.400039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.310530+0000","last_change":"2024-09-18T02:08:17.310594+0000","last_active":"2024-09-18T02:08:17.310530+0000","last_peered":"2024-09-18T02:08:17.310530+0000","last_clean":"2024-09-18T02:08:17.310530+0000","last_became_active":"2024-09-18T02:03:59.536120+0000","last_became_peered":"2024-09-18T02:03:59.536120+0000","last_unstale":"2024-09-18T02:08:17.310530+0000","last_undegraded":"2024-09-18T02:08:17.310530+0000","last_fullsized":"2024-09-18T02:08:17.310530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:17.310348+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:17.310348+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.310348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:16.009307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.748348+0000","last_change":"2024-09-18T02:08:25.748413+0000","last_active":"2024-09-18T02:08:25.748348+0000","last_peered":"2024-09-18T02:08:25.748348+0000","last_clean":"2024-09-18T02:08:25.748348+0000","last_became_active":"2024-09-18T02:03:57.522831+0000","last_became_peered":"2024-09-18T02:03:57.522831+0000","last_unstale":"2024-09-18T02:08:25.748348+0000","last_undegraded":"2024-09-18T02:08:25.748348+0000","last_fullsized":"2024-09-18T02:08:25.748348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:25.748144+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:25.748144+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.748144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:26.585698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.904402+0000","last_change":"2024-09-18T02:07:57.904470+0000","last_active":"2024-09-18T02:07:57.904402+0000","last_peered":"2024-09-18T02:07:57.904402+0000","last_clean":"2024-09-18T02:07:57.904402+0000","last_became_active":"2024-09-18T02:04:01.569649+0000","last_became_peered":"2024-09-18T02:04:01.569649+0000","last_unstale":"2024-09-18T02:07:57.904402+0000","last_undegraded":"2024-09-18T02:07:57.904402+0000","last_fullsized":"2024-09-18T02:07:57.904402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:07:57.904196+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:07:57.904196+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.904196+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:19.425055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'55","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.404741+0000","last_change":"2024-09-18T02:07:50.404774+0000","last_active":"2024-09-18T02:07:50.404741+0000","last_peered":"2024-09-18T02:07:50.404741+0000","last_clean":"2024-09-18T02:07:50.404741+0000","last_became_active":"2024-09-18T02:04:03.591018+0000","last_became_peered":"2024-09-18T02:04:03.591018+0000","last_unstale":"2024-09-18T02:07:50.404741+0000","last_undegraded":"2024-09-18T02:07:50.404741+0000","last_fullsized":"2024-09-18T02:07:50.404741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'55","last_scrub_stamp":"2024-09-18T02:07:50.404668+0000","last_deep_scrub":"32'55","last_deep_scrub_stamp":"2024-09-18T02:07:50.404668+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.404668+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:48:17.203254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.262526+0000","last_change":"2024-09-18T02:07:51.262610+0000","last_active":"2024-09-18T02:07:51.262526+0000","last_peered":"2024-09-18T02:07:51.262526+0000","last_clean":"2024-09-18T02:07:51.262526+0000","last_became_active":"2024-09-18T02:04:05.595772+0000","last_became_peered":"2024-09-18T02:04:05.595772+0000","last_unstale":"2024-09-18T02:07:51.262526+0000","last_undegraded":"2024-09-18T02:07:51.262526+0000","last_fullsized":"2024-09-18T02:07:51.262526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.262332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.262332+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.262332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:41.244692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339293+0000","last_change":"2024-09-18T02:04:07.613362+0000","last_active":"2024-09-18T02:06:31.339293+0000","last_peered":"2024-09-18T02:06:31.339293+0000","last_clean":"2024-09-18T02:06:31.339293+0000","last_became_active":"2024-09-18T02:04:07.612610+0000","last_became_peered":"2024-09-18T02:04:07.612610+0000","last_unstale":"2024-09-18T02:06:31.339293+0000","last_undegraded":"2024-09-18T02:06:31.339293+0000","last_fullsized":"2024-09-18T02:06:31.339293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.697508+0000","last_change":"2024-09-18T02:08:13.697508+0000","last_active":"2024-09-18T02:08:13.697508+0000","last_peered":"2024-09-18T02:08:13.697508+0000","last_clean":"2024-09-18T02:08:13.697508+0000","last_became_active":"2024-09-18T02:03:59.553864+0000","last_became_peered":"2024-09-18T02:03:59.553864+0000","last_unstale":"2024-09-18T02:08:13.697508+0000","last_undegraded":"2024-09-18T02:08:13.697508+0000","last_fullsized":"2024-09-18T02:08:13.697508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:13.697246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:13.697246+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.697246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:45.027054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.548369+0000","last_change":"2024-09-18T02:03:57.523546+0000","last_active":"2024-09-18T02:07:47.548369+0000","last_peered":"2024-09-18T02:07:47.548369+0000","last_clean":"2024-09-18T02:07:47.548369+0000","last_became_active":"2024-09-18T02:03:57.519843+0000","last_became_peered":"2024-09-18T02:03:57.519843+0000","last_unstale":"2024-09-18T02:07:47.548369+0000","last_undegraded":"2024-09-18T02:07:47.548369+0000","last_fullsized":"2024-09-18T02:07:47.548369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.057689+0000","last_change":"2024-09-18T02:08:21.057689+0000","last_active":"2024-09-18T02:08:21.057689+0000","last_peered":"2024-09-18T02:08:21.057689+0000","last_clean":"2024-09-18T02:08:21.057689+0000","last_became_active":"2024-09-18T02:03:59.535992+0000","last_became_peered":"2024-09-18T02:03:59.535992+0000","last_unstale":"2024-09-18T02:08:21.057689+0000","last_undegraded":"2024-09-18T02:08:21.057689+0000","last_fullsized":"2024-09-18T02:08:21.057689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:21.057430+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:21.057430+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.057430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:11.720358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.091868+0000","last_change":"2024-09-18T02:08:24.091925+0000","last_active":"2024-09-18T02:08:24.091868+0000","last_peered":"2024-09-18T02:08:24.091868+0000","last_clean":"2024-09-18T02:08:24.091868+0000","last_became_active":"2024-09-18T02:03:57.527146+0000","last_became_peered":"2024-09-18T02:03:57.527146+0000","last_unstale":"2024-09-18T02:08:24.091868+0000","last_undegraded":"2024-09-18T02:08:24.091868+0000","last_fullsized":"2024-09-18T02:08:24.091868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:24.091664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:24.091664+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.091664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:50.849336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.229209+0000","last_change":"2024-09-18T02:08:21.229209+0000","last_active":"2024-09-18T02:08:21.229209+0000","last_peered":"2024-09-18T02:08:21.229209+0000","last_clean":"2024-09-18T02:08:21.229209+0000","last_became_active":"2024-09-18T02:03:59.556425+0000","last_became_peered":"2024-09-18T02:03:59.556425+0000","last_unstale":"2024-09-18T02:08:21.229209+0000","last_undegraded":"2024-09-18T02:08:21.229209+0000","last_fullsized":"2024-09-18T02:08:21.229209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:21.228959+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:21.228959+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.228959+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:54.629458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.057061+0000","last_change":"2024-09-18T02:04:36.351337+0000","last_active":"2024-09-18T02:07:12.057061+0000","last_peered":"2024-09-18T02:07:12.057061+0000","last_clean":"2024-09-18T02:07:12.057061+0000","last_became_active":"2024-09-18T02:04:36.350472+0000","last_became_peered":"2024-09-18T02:04:36.350472+0000","last_unstale":"2024-09-18T02:07:12.057061+0000","last_undegraded":"2024-09-18T02:07:12.057061+0000","last_fullsized":"2024-09-18T02:07:12.057061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"32'18","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.102690+0000","last_change":"2024-09-18T02:08:17.102690+0000","last_active":"2024-09-18T02:08:17.102690+0000","last_peered":"2024-09-18T02:08:17.102690+0000","last_clean":"2024-09-18T02:08:17.102690+0000","last_became_active":"2024-09-18T02:03:59.534584+0000","last_became_peered":"2024-09-18T02:03:59.534584+0000","last_unstale":"2024-09-18T02:08:17.102690+0000","last_undegraded":"2024-09-18T02:08:17.102690+0000","last_fullsized":"2024-09-18T02:08:17.102690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:17.102427+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:17.102427+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.102427+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:53.509761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.658604+0000","last_change":"2024-09-18T02:03:57.523284+0000","last_active":"2024-09-18T02:07:46.658604+0000","last_peered":"2024-09-18T02:07:46.658604+0000","last_clean":"2024-09-18T02:07:46.658604+0000","last_became_active":"2024-09-18T02:03:57.521499+0000","last_became_peered":"2024-09-18T02:03:57.521499+0000","last_unstale":"2024-09-18T02:07:46.658604+0000","last_undegraded":"2024-09-18T02:07:46.658604+0000","last_fullsized":"2024-09-18T02:07:46.658604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.152140+0000","last_change":"2024-09-18T02:08:13.152277+0000","last_active":"2024-09-18T02:08:13.152140+0000","last_peered":"2024-09-18T02:08:13.152140+0000","last_clean":"2024-09-18T02:08:13.152140+0000","last_became_active":"2024-09-18T02:03:59.554577+0000","last_became_peered":"2024-09-18T02:03:59.554577+0000","last_unstale":"2024-09-18T02:08:13.152140+0000","last_undegraded":"2024-09-18T02:08:13.152140+0000","last_fullsized":"2024-09-18T02:08:13.152140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:13.151916+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:13.151916+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.151916+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:59.060752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.658618+0000","last_change":"2024-09-18T02:03:57.527483+0000","last_active":"2024-09-18T02:07:46.658618+0000","last_peered":"2024-09-18T02:07:46.658618+0000","last_clean":"2024-09-18T02:07:46.658618+0000","last_became_active":"2024-09-18T02:03:57.526774+0000","last_became_peered":"2024-09-18T02:03:57.526774+0000","last_unstale":"2024-09-18T02:07:46.658618+0000","last_undegraded":"2024-09-18T02:07:46.658618+0000","last_fullsized":"2024-09-18T02:07:46.658618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.713808+0000","last_change":"2024-09-18T02:08:10.713808+0000","last_active":"2024-09-18T02:08:10.713808+0000","last_peered":"2024-09-18T02:08:10.713808+0000","last_clean":"2024-09-18T02:08:10.713808+0000","last_became_active":"2024-09-18T02:03:59.554672+0000","last_became_peered":"2024-09-18T02:03:59.554672+0000","last_unstale":"2024-09-18T02:08:10.713808+0000","last_undegraded":"2024-09-18T02:08:10.713808+0000","last_fullsized":"2024-09-18T02:08:10.713808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:10.713551+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:10.713551+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.713551+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:17.678935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.107972+0000","last_change":"2024-09-18T02:03:57.519989+0000","last_active":"2024-09-18T02:07:47.107972+0000","last_peered":"2024-09-18T02:07:47.107972+0000","last_clean":"2024-09-18T02:07:47.107972+0000","last_became_active":"2024-09-18T02:03:57.519691+0000","last_became_peered":"2024-09-18T02:03:57.519691+0000","last_unstale":"2024-09-18T02:07:47.107972+0000","last_undegraded":"2024-09-18T02:07:47.107972+0000","last_fullsized":"2024-09-18T02:07:47.107972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'17","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.659047+0000","last_change":"2024-09-18T02:03:59.541946+0000","last_active":"2024-09-18T02:07:46.659047+0000","last_peered":"2024-09-18T02:07:46.659047+0000","last_clean":"2024-09-18T02:07:46.659047+0000","last_became_active":"2024-09-18T02:03:59.541059+0000","last_became_peered":"2024-09-18T02:03:59.541059+0000","last_unstale":"2024-09-18T02:07:46.659047+0000","last_undegraded":"2024-09-18T02:07:46.659047+0000","last_fullsized":"2024-09-18T02:07:46.659047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.548470+0000","last_change":"2024-09-18T02:03:57.519641+0000","last_active":"2024-09-18T02:07:47.548470+0000","last_peered":"2024-09-18T02:07:47.548470+0000","last_clean":"2024-09-18T02:07:47.548470+0000","last_became_active":"2024-09-18T02:03:57.519272+0000","last_became_peered":"2024-09-18T02:03:57.519272+0000","last_unstale":"2024-09-18T02:07:47.548470+0000","last_undegraded":"2024-09-18T02:07:47.548470+0000","last_fullsized":"2024-09-18T02:07:47.548470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'5","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.108236+0000","last_change":"2024-09-18T02:03:59.545622+0000","last_active":"2024-09-18T02:07:47.108236+0000","last_peered":"2024-09-18T02:07:47.108236+0000","last_clean":"2024-09-18T02:07:47.108236+0000","last_became_active":"2024-09-18T02:03:59.539946+0000","last_became_peered":"2024-09-18T02:03:59.539946+0000","last_unstale":"2024-09-18T02:07:47.108236+0000","last_undegraded":"2024-09-18T02:07:47.108236+0000","last_fullsized":"2024-09-18T02:07:47.108236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.052740+0000","last_change":"2024-09-18T02:08:26.052861+0000","last_active":"2024-09-18T02:08:26.052740+0000","last_peered":"2024-09-18T02:08:26.052740+0000","last_clean":"2024-09-18T02:08:26.052740+0000","last_became_active":"2024-09-18T02:03:57.527102+0000","last_became_peered":"2024-09-18T02:03:57.527102+0000","last_unstale":"2024-09-18T02:08:26.052740+0000","last_undegraded":"2024-09-18T02:08:26.052740+0000","last_fullsized":"2024-09-18T02:08:26.052740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:26.052497+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:26.052497+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.052497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:28.678375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'11","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.318769+0000","last_change":"2024-09-18T02:03:59.543494+0000","last_active":"2024-09-18T02:07:12.318769+0000","last_peered":"2024-09-18T02:07:12.318769+0000","last_clean":"2024-09-18T02:07:12.318769+0000","last_became_active":"2024-09-18T02:03:59.543160+0000","last_became_peered":"2024-09-18T02:03:59.543160+0000","last_unstale":"2024-09-18T02:07:12.318769+0000","last_undegraded":"2024-09-18T02:07:12.318769+0000","last_fullsized":"2024-09-18T02:07:12.318769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996381+0000","last_change":"2024-09-18T02:03:57.525942+0000","last_active":"2024-09-18T02:07:47.996381+0000","last_peered":"2024-09-18T02:07:47.996381+0000","last_clean":"2024-09-18T02:07:47.996381+0000","last_became_active":"2024-09-18T02:03:57.524495+0000","last_became_peered":"2024-09-18T02:03:57.524495+0000","last_unstale":"2024-09-18T02:07:47.996381+0000","last_undegraded":"2024-09-18T02:07:47.996381+0000","last_fullsized":"2024-09-18T02:07:47.996381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.236886+0000","last_change":"2024-09-18T02:04:36.361845+0000","last_active":"2024-09-18T02:07:12.236886+0000","last_peered":"2024-09-18T02:07:12.236886+0000","last_clean":"2024-09-18T02:07:12.236886+0000","last_became_active":"2024-09-18T02:04:36.354749+0000","last_became_peered":"2024-09-18T02:04:36.354749+0000","last_unstale":"2024-09-18T02:07:12.236886+0000","last_undegraded":"2024-09-18T02:07:12.236886+0000","last_fullsized":"2024-09-18T02:07:12.236886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.331573+0000","last_change":"2024-09-18T02:03:57.521667+0000","last_active":"2024-09-18T02:06:16.331573+0000","last_peered":"2024-09-18T02:06:16.331573+0000","last_clean":"2024-09-18T02:06:16.331573+0000","last_became_active":"2024-09-18T02:03:57.520623+0000","last_became_peered":"2024-09-18T02:03:57.520623+0000","last_unstale":"2024-09-18T02:06:16.331573+0000","last_undegraded":"2024-09-18T02:06:16.331573+0000","last_fullsized":"2024-09-18T02:06:16.331573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.172580+0000","last_change":"2024-09-18T02:08:12.172727+0000","last_active":"2024-09-18T02:08:12.172580+0000","last_peered":"2024-09-18T02:08:12.172580+0000","last_clean":"2024-09-18T02:08:12.172580+0000","last_became_active":"2024-09-18T02:03:59.555178+0000","last_became_peered":"2024-09-18T02:03:59.555178+0000","last_unstale":"2024-09-18T02:08:12.172580+0000","last_undegraded":"2024-09-18T02:08:12.172580+0000","last_fullsized":"2024-09-18T02:08:12.172580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:12.172263+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:12.172263+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.172263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:09.572270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.332225+0000","last_change":"2024-09-18T02:03:57.519654+0000","last_active":"2024-09-18T02:06:16.332225+0000","last_peered":"2024-09-18T02:06:16.332225+0000","last_clean":"2024-09-18T02:06:16.332225+0000","last_became_active":"2024-09-18T02:03:57.519359+0000","last_became_peered":"2024-09-18T02:03:57.519359+0000","last_unstale":"2024-09-18T02:06:16.332225+0000","last_undegraded":"2024-09-18T02:06:16.332225+0000","last_fullsized":"2024-09-18T02:06:16.332225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.642666+0000","last_change":"2024-09-18T02:08:18.642832+0000","last_active":"2024-09-18T02:08:18.642666+0000","last_peered":"2024-09-18T02:08:18.642666+0000","last_clean":"2024-09-18T02:08:18.642666+0000","last_became_active":"2024-09-18T02:03:59.540444+0000","last_became_peered":"2024-09-18T02:03:59.540444+0000","last_unstale":"2024-09-18T02:08:18.642666+0000","last_undegraded":"2024-09-18T02:08:18.642666+0000","last_fullsized":"2024-09-18T02:08:18.642666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:18.642438+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:18.642438+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.642438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:31.841957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.332414+0000","last_change":"2024-09-18T02:03:57.522898+0000","last_active":"2024-09-18T02:06:16.332414+0000","last_peered":"2024-09-18T02:06:16.332414+0000","last_clean":"2024-09-18T02:06:16.332414+0000","last_became_active":"2024-09-18T02:03:57.521148+0000","last_became_peered":"2024-09-18T02:03:57.521148+0000","last_unstale":"2024-09-18T02:06:16.332414+0000","last_undegraded":"2024-09-18T02:06:16.332414+0000","last_fullsized":"2024-09-18T02:06:16.332414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.744816+0000","last_change":"2024-09-18T02:08:11.744876+0000","last_active":"2024-09-18T02:08:11.744816+0000","last_peered":"2024-09-18T02:08:11.744816+0000","last_clean":"2024-09-18T02:08:11.744816+0000","last_became_active":"2024-09-18T02:03:59.553528+0000","last_became_peered":"2024-09-18T02:03:59.553528+0000","last_unstale":"2024-09-18T02:08:11.744816+0000","last_undegraded":"2024-09-18T02:08:11.744816+0000","last_fullsized":"2024-09-18T02:08:11.744816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:11.744618+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:11.744618+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.744618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:21.919244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335487+0000","last_change":"2024-09-18T02:03:57.527928+0000","last_active":"2024-09-18T02:06:16.335487+0000","last_peered":"2024-09-18T02:06:16.335487+0000","last_clean":"2024-09-18T02:06:16.335487+0000","last_became_active":"2024-09-18T02:03:57.526972+0000","last_became_peered":"2024-09-18T02:03:57.526972+0000","last_unstale":"2024-09-18T02:06:16.335487+0000","last_undegraded":"2024-09-18T02:06:16.335487+0000","last_fullsized":"2024-09-18T02:06:16.335487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:11.748451+0000","last_change":"2024-09-18T02:03:59.546007+0000","last_active":"2024-09-18T02:07:11.748451+0000","last_peered":"2024-09-18T02:07:11.748451+0000","last_clean":"2024-09-18T02:07:11.748451+0000","last_became_active":"2024-09-18T02:03:59.545405+0000","last_became_peered":"2024-09-18T02:03:59.545405+0000","last_unstale":"2024-09-18T02:07:11.748451+0000","last_undegraded":"2024-09-18T02:07:11.748451+0000","last_fullsized":"2024-09-18T02:07:11.748451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:16.335559+0000","last_change":"2024-09-18T02:03:57.522221+0000","last_active":"2024-09-18T02:06:16.335559+0000","last_peered":"2024-09-18T02:06:16.335559+0000","last_clean":"2024-09-18T02:06:16.335559+0000","last_became_active":"2024-09-18T02:03:57.521800+0000","last_became_peered":"2024-09-18T02:03:57.521800+0000","last_unstale":"2024-09-18T02:06:16.335559+0000","last_undegraded":"2024-09-18T02:06:16.335559+0000","last_fullsized":"2024-09-18T02:06:16.335559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'12","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.169531+0000","last_change":"2024-09-18T02:04:36.384511+0000","last_active":"2024-09-18T02:07:12.169531+0000","last_peered":"2024-09-18T02:07:12.169531+0000","last_clean":"2024-09-18T02:07:12.169531+0000","last_became_active":"2024-09-18T02:04:36.357213+0000","last_became_peered":"2024-09-18T02:04:36.357213+0000","last_unstale":"2024-09-18T02:07:12.169531+0000","last_undegraded":"2024-09-18T02:07:12.169531+0000","last_fullsized":"2024-09-18T02:07:12.169531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.271997+0000","last_change":"2024-09-18T02:08:18.272049+0000","last_active":"2024-09-18T02:08:18.271997+0000","last_peered":"2024-09-18T02:08:18.271997+0000","last_clean":"2024-09-18T02:08:18.271997+0000","last_became_active":"2024-09-18T02:03:57.528312+0000","last_became_peered":"2024-09-18T02:03:57.528312+0000","last_unstale":"2024-09-18T02:08:18.271997+0000","last_undegraded":"2024-09-18T02:08:18.271997+0000","last_fullsized":"2024-09-18T02:08:18.271997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:18.271805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:18.271805+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.271805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:25.237189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.108482+0000","last_change":"2024-09-18T02:03:59.546083+0000","last_active":"2024-09-18T02:07:47.108482+0000","last_peered":"2024-09-18T02:07:47.108482+0000","last_clean":"2024-09-18T02:07:47.108482+0000","last_became_active":"2024-09-18T02:03:59.540283+0000","last_became_peered":"2024-09-18T02:03:59.540283+0000","last_unstale":"2024-09-18T02:07:47.108482+0000","last_undegraded":"2024-09-18T02:07:47.108482+0000","last_fullsized":"2024-09-18T02:07:47.108482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:21.336982+0000","last_change":"2024-09-18T02:03:57.528934+0000","last_active":"2024-09-18T02:06:21.336982+0000","last_peered":"2024-09-18T02:06:21.336982+0000","last_clean":"2024-09-18T02:06:21.336982+0000","last_became_active":"2024-09-18T02:03:57.526363+0000","last_became_peered":"2024-09-18T02:03:57.526363+0000","last_unstale":"2024-09-18T02:06:21.336982+0000","last_undegraded":"2024-09-18T02:06:21.336982+0000","last_fullsized":"2024-09-18T02:06:21.336982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.063992+0000","last_change":"2024-09-18T02:03:57.516751+0000","last_active":"2024-09-18T02:07:12.063992+0000","last_peered":"2024-09-18T02:07:12.063992+0000","last_clean":"2024-09-18T02:07:12.063992+0000","last_became_active":"2024-09-18T02:03:57.516434+0000","last_became_peered":"2024-09-18T02:03:57.516434+0000","last_unstale":"2024-09-18T02:07:12.063992+0000","last_undegraded":"2024-09-18T02:07:12.063992+0000","last_fullsized":"2024-09-18T02:07:12.063992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.112746+0000","last_change":"2024-09-18T02:08:14.112809+0000","last_active":"2024-09-18T02:08:14.112746+0000","last_peered":"2024-09-18T02:08:14.112746+0000","last_clean":"2024-09-18T02:08:14.112746+0000","last_became_active":"2024-09-18T02:03:59.550058+0000","last_became_peered":"2024-09-18T02:03:59.550058+0000","last_unstale":"2024-09-18T02:08:14.112746+0000","last_undegraded":"2024-09-18T02:08:14.112746+0000","last_fullsized":"2024-09-18T02:08:14.112746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:14.112520+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:14.112520+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.112520+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:44.465392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.072674+0000","last_change":"2024-09-18T02:08:20.072731+0000","last_active":"2024-09-18T02:08:20.072674+0000","last_peered":"2024-09-18T02:08:20.072674+0000","last_clean":"2024-09-18T02:08:20.072674+0000","last_became_active":"2024-09-18T02:03:57.533324+0000","last_became_peered":"2024-09-18T02:03:57.533324+0000","last_unstale":"2024-09-18T02:08:20.072674+0000","last_undegraded":"2024-09-18T02:08:20.072674+0000","last_fullsized":"2024-09-18T02:08:20.072674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.072475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.072475+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.072475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:41.736390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.753750+0000","last_change":"2024-09-18T02:08:24.753846+0000","last_active":"2024-09-18T02:08:24.753750+0000","last_peered":"2024-09-18T02:08:24.753750+0000","last_clean":"2024-09-18T02:08:24.753750+0000","last_became_active":"2024-09-18T02:03:59.542356+0000","last_became_peered":"2024-09-18T02:03:59.542356+0000","last_unstale":"2024-09-18T02:08:24.753750+0000","last_undegraded":"2024-09-18T02:08:24.753750+0000","last_fullsized":"2024-09-18T02:08:24.753750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:24.753484+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:24.753484+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.753484+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:15.416413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1754,"ondisk_log_size":1754,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1593,"num_read_kb":1483,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705724,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":138326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":983040,"data_stored":725968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705724,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":726892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":430080,"data_stored":137902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T02:08:29.182 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.182 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.183 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.183 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.183 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.183 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.183 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.183 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.183 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.183 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.184 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.184 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.184 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.184 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.184 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.184 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.184 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.184 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.185 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.185 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.185 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.185 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.185 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.185 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.185 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.185 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.186 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.186 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.186 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.186 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.186 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.188 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.188 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.188 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.188 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.188 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.188 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.188 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.189 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.189 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.189 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.189 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T02:03:42.235832+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.189 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.189 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.189 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.190 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.190 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.190 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.190 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.190 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.190 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.190 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.190 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.191 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.191 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.191 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.191 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.191 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.191 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.191 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.191 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.192 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.192 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.192 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.192 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.192 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.192 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.192 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.193 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.193 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.193 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.193 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.193 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.193 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.193 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.194 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.194 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.194 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.194 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.194 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.194 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.194 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.195 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.195 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.195 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.195 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.195 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.195 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.195 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.195 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.196 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.196 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.196 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.196 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.196 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.196 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.196 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.196 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.197 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.197 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.197 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.197 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.197 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.197 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.197 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.197 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.197 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:29.198 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T02:08:49.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T02:08:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b3b89640 1 Processor -- start 2024-09-18T02:08:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b3b89640 1 -- start start 2024-09-18T02:08:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b3b89640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9ac06d0e0 0x7fb9ac06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:08:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b3b89640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ac071c10 con 0x7fb9ac06da00 2024-09-18T02:08:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b3b89640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ac072230 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b1925640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9ac06d0e0 0x7fb9ac06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:08:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b1124640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb9ac06da00 0x7fb9ac12ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41554/0 (socket says 172.21.15.81:41554) 2024-09-18T02:08:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b1124640 1 -- 172.21.15.81:0/2135292357 learned_addr learned my addr 172.21.15.81:0/2135292357 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:08:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b0923640 1 -- 172.21.15.81:0/2135292357 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723278115 0 0) 0x7fb9ac071c10 con 0x7fb9ac06da00 2024-09-18T02:08:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b0923640 1 -- 172.21.15.81:0/2135292357 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb998003530 con 0x7fb9ac06da00 2024-09-18T02:08:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b1925640 1 -- 172.21.15.81:0/2135292357 >> v1:172.21.15.81:6789/0 conn(0x7fb9ac06da00 legacy=0x7fb9ac12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.328+0000 7fb9b1925640 1 -- 172.21.15.81:0/2135292357 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac0709e0 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b1925640 1 --2- 172.21.15.81:0/2135292357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ac06d0e0 0x7fb9ac06d4c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009740 tx=0x7fb99c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8f22f3ca466a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:08:49.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b0923640 1 -- 172.21.15.81:0/2135292357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb99c0b0070 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b0923640 1 -- 172.21.15.81:0/2135292357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99c0ab530 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b0923640 1 -- 172.21.15.81:0/2135292357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb99c0ab830 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 -- 172.21.15.81:0/2135292357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ac06d0e0 msgr2=0x7fb9ac06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:49.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 --2- 172.21.15.81:0/2135292357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ac06d0e0 0x7fb9ac06d4c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009740 tx=0x7fb99c01c370 comp rx=0 tx=0).stop 2024-09-18T02:08:49.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 -- 172.21.15.81:0/2135292357 shutdown_connections 2024-09-18T02:08:49.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 --2- 172.21.15.81:0/2135292357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ac06d0e0 0x7fb9ac06d4c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:08:49.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 -- 172.21.15.81:0/2135292357 >> 172.21.15.81:0/2135292357 conn(0x7fb9ac099a50 msgr2=0x7fb9ac0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:08:49.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 -- 172.21.15.81:0/2135292357 shutdown_connections 2024-09-18T02:08:49.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 -- 172.21.15.81:0/2135292357 wait complete. 2024-09-18T02:08:49.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 Processor -- start 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 -- start start 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ac06d0e0 0x7fb9ac127980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac134e80 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b1925640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ac06d0e0 0x7fb9ac127980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b1925640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ac06d0e0 0x7fb9ac127980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52828/0 (socket says 172.21.15.81:52828) 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b1925640 1 -- 172.21.15.81:0/87348736 learned_addr learned my addr 172.21.15.81:0/87348736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b1925640 1 -- 172.21.15.81:0/87348736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac072710 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b1925640 1 --2- 172.21.15.81:0/87348736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ac06d0e0 0x7fb9ac127980 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0ae040 tx=0x7fb99c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9a27fc640 1 -- 172.21.15.81:0/87348736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb99c0b0050 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9a27fc640 1 -- 172.21.15.81:0/87348736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99c0b1040 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 -- 172.21.15.81:0/87348736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ac129ed0 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9a27fc640 1 -- 172.21.15.81:0/87348736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb99c0b75a0 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.332+0000 7fb9b3b89640 1 -- 172.21.15.81:0/87348736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ac12a560 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.336+0000 7fb9b3b89640 1 -- 172.21.15.81:0/87348736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ac06d4c0 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.336+0000 7fb9a27fc640 1 -- 172.21.15.81:0/87348736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb99c0be030 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.336+0000 7fb9a27fc640 1 --2- 172.21.15.81:0/87348736 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb990035db0 0x7fb990038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:08:49.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.336+0000 7fb9a27fc640 1 -- 172.21.15.81:0/87348736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb99c0bc070 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.336+0000 7fb9b1124640 1 --2- 172.21.15.81:0/87348736 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb990035db0 0x7fb990038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:08:49.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.336+0000 7fb9b1124640 1 --2- 172.21.15.81:0/87348736 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb990035db0 0x7fb990038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8007fd0 tx=0x7fb9a8007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:08:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.340+0000 7fb9a27fc640 1 -- 172.21.15.81:0/87348736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb99c0c5060 con 0x7fb9ac06d0e0 2024-09-18T02:08:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.488+0000 7fb9b3b89640 1 -- 172.21.15.81:0/87348736 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9ac129260 con 0x7fb990035db0 2024-09-18T02:08:49.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.536+0000 7fb9a27fc640 1 -- 172.21.15.81:0/87348736 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664892 (secure 0 0 0) 0x7fb9ac129260 con 0x7fb990035db0 2024-09-18T02:08:49.540 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:08:49.549 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T02:08:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.544+0000 7fb9b3b89640 1 -- 172.21.15.81:0/87348736 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb990035db0 msgr2=0x7fb990038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.544+0000 7fb9b3b89640 1 --2- 172.21.15.81:0/87348736 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb990035db0 0x7fb990038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8007fd0 tx=0x7fb9a8007980 comp rx=0 tx=0).stop 2024-09-18T02:08:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.544+0000 7fb9b3b89640 1 -- 172.21.15.81:0/87348736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ac06d0e0 msgr2=0x7fb9ac127980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:08:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.544+0000 7fb9b3b89640 1 --2- 172.21.15.81:0/87348736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ac06d0e0 0x7fb9ac127980 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0ae040 tx=0x7fb99c01abb0 comp rx=0 tx=0).stop 2024-09-18T02:08:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.544+0000 7fb9b3b89640 1 -- 172.21.15.81:0/87348736 shutdown_connections 2024-09-18T02:08:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.544+0000 7fb9b3b89640 1 --2- 172.21.15.81:0/87348736 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb990035db0 0x7fb990038270 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:08:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.544+0000 7fb9b3b89640 1 --2- 172.21.15.81:0/87348736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ac06d0e0 0x7fb9ac127980 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:08:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.544+0000 7fb9b3b89640 1 -- 172.21.15.81:0/87348736 >> 172.21.15.81:0/87348736 conn(0x7fb9ac099a50 msgr2=0x7fb9ac131c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:08:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.544+0000 7fb9b3b89640 1 -- 172.21.15.81:0/87348736 shutdown_connections 2024-09-18T02:08:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:08:49.544+0000 7fb9b3b89640 1 -- 172.21.15.81:0/87348736 wait complete. 2024-09-18T02:08:49.565 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-18T02:08:49.381380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5363,"num_read_kb":4916,"num_write":2373,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5017,"ondisk_log_size":5017,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160832,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326528,"statfs":{"total":386547056640,"available":386382364672,"internally_reserved":0,"allocated":2883584,"data_stored":1729088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006597"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.275817+0000","last_change":"2024-09-18T02:08:30.275886+0000","last_active":"2024-09-18T02:08:30.275817+0000","last_peered":"2024-09-18T02:08:30.275817+0000","last_clean":"2024-09-18T02:08:30.275817+0000","last_became_active":"2024-09-18T02:03:57.516420+0000","last_became_peered":"2024-09-18T02:03:57.516420+0000","last_unstale":"2024-09-18T02:08:30.275817+0000","last_undegraded":"2024-09-18T02:08:30.275817+0000","last_fullsized":"2024-09-18T02:08:30.275817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:30.275625+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:30.275625+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.275625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:51.939540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.725117+0000","last_change":"2024-09-18T02:08:15.725179+0000","last_active":"2024-09-18T02:08:15.725117+0000","last_peered":"2024-09-18T02:08:15.725117+0000","last_clean":"2024-09-18T02:08:15.725117+0000","last_became_active":"2024-09-18T02:03:59.545294+0000","last_became_peered":"2024-09-18T02:03:59.545294+0000","last_unstale":"2024-09-18T02:08:15.725117+0000","last_undegraded":"2024-09-18T02:08:15.725117+0000","last_fullsized":"2024-09-18T02:08:15.725117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:15.724888+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:15.724888+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.724888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:28.872984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.140060+0000","last_change":"2024-09-18T02:08:18.140213+0000","last_active":"2024-09-18T02:08:18.140060+0000","last_peered":"2024-09-18T02:08:18.140060+0000","last_clean":"2024-09-18T02:08:18.140060+0000","last_became_active":"2024-09-18T02:03:57.533332+0000","last_became_peered":"2024-09-18T02:03:57.533332+0000","last_unstale":"2024-09-18T02:08:18.140060+0000","last_undegraded":"2024-09-18T02:08:18.140060+0000","last_fullsized":"2024-09-18T02:08:18.140060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:18.139828+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:18.139828+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.139828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:54.394230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.270228+0000","last_change":"2024-09-18T02:08:26.270290+0000","last_active":"2024-09-18T02:08:26.270228+0000","last_peered":"2024-09-18T02:08:26.270228+0000","last_clean":"2024-09-18T02:08:26.270228+0000","last_became_active":"2024-09-18T02:03:59.553641+0000","last_became_peered":"2024-09-18T02:03:59.553641+0000","last_unstale":"2024-09-18T02:08:26.270228+0000","last_undegraded":"2024-09-18T02:08:26.270228+0000","last_fullsized":"2024-09-18T02:08:26.270228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:26.270034+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:26.270034+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.270034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:39.424938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996642+0000","last_change":"2024-09-18T02:03:57.532939+0000","last_active":"2024-09-18T02:07:47.996642+0000","last_peered":"2024-09-18T02:07:47.996642+0000","last_clean":"2024-09-18T02:07:47.996642+0000","last_became_active":"2024-09-18T02:03:57.532561+0000","last_became_peered":"2024-09-18T02:03:57.532561+0000","last_unstale":"2024-09-18T02:07:47.996642+0000","last_undegraded":"2024-09-18T02:07:47.996642+0000","last_fullsized":"2024-09-18T02:07:47.996642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.345416+0000","last_change":"2024-09-18T02:08:29.345485+0000","last_active":"2024-09-18T02:08:29.345416+0000","last_peered":"2024-09-18T02:08:29.345416+0000","last_clean":"2024-09-18T02:08:29.345416+0000","last_became_active":"2024-09-18T02:03:59.551661+0000","last_became_peered":"2024-09-18T02:03:59.551661+0000","last_unstale":"2024-09-18T02:08:29.345416+0000","last_undegraded":"2024-09-18T02:08:29.345416+0000","last_fullsized":"2024-09-18T02:08:29.345416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:29.345217+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:29.345217+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.345217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:26:41.381394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.294995+0000","last_change":"2024-09-18T02:08:35.295053+0000","last_active":"2024-09-18T02:08:35.294995+0000","last_peered":"2024-09-18T02:08:35.294995+0000","last_clean":"2024-09-18T02:08:35.294995+0000","last_became_active":"2024-09-18T02:03:57.522751+0000","last_became_peered":"2024-09-18T02:03:57.522751+0000","last_unstale":"2024-09-18T02:08:35.294995+0000","last_undegraded":"2024-09-18T02:08:35.294995+0000","last_fullsized":"2024-09-18T02:08:35.294995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:35.294810+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:35.294810+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.294810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:22:58.514611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.282158+0000","last_change":"2024-09-18T02:08:27.282221+0000","last_active":"2024-09-18T02:08:27.282158+0000","last_peered":"2024-09-18T02:08:27.282158+0000","last_clean":"2024-09-18T02:08:27.282158+0000","last_became_active":"2024-09-18T02:03:59.552797+0000","last_became_peered":"2024-09-18T02:03:59.552797+0000","last_unstale":"2024-09-18T02:08:27.282158+0000","last_undegraded":"2024-09-18T02:08:27.282158+0000","last_fullsized":"2024-09-18T02:08:27.282158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:27.281926+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:27.281926+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.281926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:00.885178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339266+0000","last_change":"2024-09-18T02:03:57.525148+0000","last_active":"2024-09-18T02:06:31.339266+0000","last_peered":"2024-09-18T02:06:31.339266+0000","last_clean":"2024-09-18T02:06:31.339266+0000","last_became_active":"2024-09-18T02:03:57.524645+0000","last_became_peered":"2024-09-18T02:03:57.524645+0000","last_unstale":"2024-09-18T02:06:31.339266+0000","last_undegraded":"2024-09-18T02:06:31.339266+0000","last_fullsized":"2024-09-18T02:06:31.339266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.702905+0000","last_change":"2024-09-18T02:08:20.702972+0000","last_active":"2024-09-18T02:08:20.702905+0000","last_peered":"2024-09-18T02:08:20.702905+0000","last_clean":"2024-09-18T02:08:20.702905+0000","last_became_active":"2024-09-18T02:03:59.542238+0000","last_became_peered":"2024-09-18T02:03:59.542238+0000","last_unstale":"2024-09-18T02:08:20.702905+0000","last_undegraded":"2024-09-18T02:08:20.702905+0000","last_fullsized":"2024-09-18T02:08:20.702905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:20.702716+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:20.702716+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.702716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:13:21.865480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.285276+0000","last_change":"2024-09-18T02:08:33.285404+0000","last_active":"2024-09-18T02:08:33.285276+0000","last_peered":"2024-09-18T02:08:33.285276+0000","last_clean":"2024-09-18T02:08:33.285276+0000","last_became_active":"2024-09-18T02:03:57.520647+0000","last_became_peered":"2024-09-18T02:03:57.520647+0000","last_unstale":"2024-09-18T02:08:33.285276+0000","last_undegraded":"2024-09-18T02:08:33.285276+0000","last_fullsized":"2024-09-18T02:08:33.285276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:33.285048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:33.285048+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.285048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:11.364401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.302996+0000","last_change":"2024-09-18T02:08:18.303055+0000","last_active":"2024-09-18T02:08:18.302996+0000","last_peered":"2024-09-18T02:08:18.302996+0000","last_clean":"2024-09-18T02:08:18.302996+0000","last_became_active":"2024-09-18T02:03:59.559273+0000","last_became_peered":"2024-09-18T02:03:59.559273+0000","last_unstale":"2024-09-18T02:08:18.302996+0000","last_undegraded":"2024-09-18T02:08:18.302996+0000","last_fullsized":"2024-09-18T02:08:18.302996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:18.302810+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:18.302810+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.302810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:28:54.454876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.547756+0000","last_change":"2024-09-18T02:08:38.547909+0000","last_active":"2024-09-18T02:08:38.547756+0000","last_peered":"2024-09-18T02:08:38.547756+0000","last_clean":"2024-09-18T02:08:38.547756+0000","last_became_active":"2024-09-18T02:03:57.526953+0000","last_became_peered":"2024-09-18T02:03:57.526953+0000","last_unstale":"2024-09-18T02:08:38.547756+0000","last_undegraded":"2024-09-18T02:08:38.547756+0000","last_fullsized":"2024-09-18T02:08:38.547756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:38.547507+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:38.547507+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.547507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:19:29.126969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.254769+0000","last_change":"2024-09-18T02:08:37.254900+0000","last_active":"2024-09-18T02:08:37.254769+0000","last_peered":"2024-09-18T02:08:37.254769+0000","last_clean":"2024-09-18T02:08:37.254769+0000","last_became_active":"2024-09-18T02:03:59.541086+0000","last_became_peered":"2024-09-18T02:03:59.541086+0000","last_unstale":"2024-09-18T02:08:37.254769+0000","last_undegraded":"2024-09-18T02:08:37.254769+0000","last_fullsized":"2024-09-18T02:08:37.254769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:37.254513+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:37.254513+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.254513+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:27:50.720030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.935498+0000","last_change":"2024-09-18T02:08:31.935552+0000","last_active":"2024-09-18T02:08:31.935498+0000","last_peered":"2024-09-18T02:08:31.935498+0000","last_clean":"2024-09-18T02:08:31.935498+0000","last_became_active":"2024-09-18T02:03:57.520343+0000","last_became_peered":"2024-09-18T02:03:57.520343+0000","last_unstale":"2024-09-18T02:08:31.935498+0000","last_undegraded":"2024-09-18T02:08:31.935498+0000","last_fullsized":"2024-09-18T02:08:31.935498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:31.935306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:31.935306+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.935306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:32.425276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'12","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.258142+0000","last_change":"2024-09-18T02:08:14.258205+0000","last_active":"2024-09-18T02:08:14.258142+0000","last_peered":"2024-09-18T02:08:14.258142+0000","last_clean":"2024-09-18T02:08:14.258142+0000","last_became_active":"2024-09-18T02:03:59.533956+0000","last_became_peered":"2024-09-18T02:03:59.533956+0000","last_unstale":"2024-09-18T02:08:14.258142+0000","last_undegraded":"2024-09-18T02:08:14.258142+0000","last_fullsized":"2024-09-18T02:08:14.258142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:14.257948+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:14.257948+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.257948+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:21:09.261976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.466803+0000","last_change":"2024-09-18T02:08:34.466803+0000","last_active":"2024-09-18T02:08:34.466803+0000","last_peered":"2024-09-18T02:08:34.466803+0000","last_clean":"2024-09-18T02:08:34.466803+0000","last_became_active":"2024-09-18T02:03:59.536739+0000","last_became_peered":"2024-09-18T02:03:59.536739+0000","last_unstale":"2024-09-18T02:08:34.466803+0000","last_undegraded":"2024-09-18T02:08:34.466803+0000","last_fullsized":"2024-09-18T02:08:34.466803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:34.466519+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:34.466519+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.466519+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:07:34.155518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.728401+0000","last_change":"2024-09-18T02:08:27.728454+0000","last_active":"2024-09-18T02:08:27.728401+0000","last_peered":"2024-09-18T02:08:27.728401+0000","last_clean":"2024-09-18T02:08:27.728401+0000","last_became_active":"2024-09-18T02:03:57.523437+0000","last_became_peered":"2024-09-18T02:03:57.523437+0000","last_unstale":"2024-09-18T02:08:27.728401+0000","last_undegraded":"2024-09-18T02:08:27.728401+0000","last_fullsized":"2024-09-18T02:08:27.728401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:27.728216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:27.728216+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.728216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:32.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.685100+0000","last_change":"2024-09-18T02:08:19.685100+0000","last_active":"2024-09-18T02:08:19.685100+0000","last_peered":"2024-09-18T02:08:19.685100+0000","last_clean":"2024-09-18T02:08:19.685100+0000","last_became_active":"2024-09-18T02:03:59.539778+0000","last_became_peered":"2024-09-18T02:03:59.539778+0000","last_unstale":"2024-09-18T02:08:19.685100+0000","last_undegraded":"2024-09-18T02:08:19.685100+0000","last_fullsized":"2024-09-18T02:08:19.685100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:19.684812+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:19.684812+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.684812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:00:25.843568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.246553+0000","last_change":"2024-09-18T02:08:24.246624+0000","last_active":"2024-09-18T02:08:24.246553+0000","last_peered":"2024-09-18T02:08:24.246553+0000","last_clean":"2024-09-18T02:08:24.246553+0000","last_became_active":"2024-09-18T02:03:57.524578+0000","last_became_peered":"2024-09-18T02:03:57.524578+0000","last_unstale":"2024-09-18T02:08:24.246553+0000","last_undegraded":"2024-09-18T02:08:24.246553+0000","last_fullsized":"2024-09-18T02:08:24.246553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:24.246331+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:24.246331+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.246331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:29.967247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.846043+0000","last_change":"2024-09-18T02:08:42.846110+0000","last_active":"2024-09-18T02:08:42.846043+0000","last_peered":"2024-09-18T02:08:42.846043+0000","last_clean":"2024-09-18T02:08:42.846043+0000","last_became_active":"2024-09-18T02:03:59.545902+0000","last_became_peered":"2024-09-18T02:03:59.545902+0000","last_unstale":"2024-09-18T02:08:42.846043+0000","last_undegraded":"2024-09-18T02:08:42.846043+0000","last_fullsized":"2024-09-18T02:08:42.846043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:42.845854+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:42.845854+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.845854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:16:59.719082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.823315+0000","last_change":"2024-09-18T02:08:31.823369+0000","last_active":"2024-09-18T02:08:31.823315+0000","last_peered":"2024-09-18T02:08:31.823315+0000","last_clean":"2024-09-18T02:08:31.823315+0000","last_became_active":"2024-09-18T02:03:57.523211+0000","last_became_peered":"2024-09-18T02:03:57.523211+0000","last_unstale":"2024-09-18T02:08:31.823315+0000","last_undegraded":"2024-09-18T02:08:31.823315+0000","last_fullsized":"2024-09-18T02:08:31.823315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:31.823114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:31.823114+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.823114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:30:58.488129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.051190+0000","last_change":"2024-09-18T02:08:25.051257+0000","last_active":"2024-09-18T02:08:25.051190+0000","last_peered":"2024-09-18T02:08:25.051190+0000","last_clean":"2024-09-18T02:08:25.051190+0000","last_became_active":"2024-09-18T02:03:59.539198+0000","last_became_peered":"2024-09-18T02:03:59.539198+0000","last_unstale":"2024-09-18T02:08:25.051190+0000","last_undegraded":"2024-09-18T02:08:25.051190+0000","last_fullsized":"2024-09-18T02:08:25.051190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:25.050963+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:25.050963+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.050963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:35:55.015533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.802976+0000","last_change":"2024-09-18T02:08:33.803078+0000","last_active":"2024-09-18T02:08:33.802976+0000","last_peered":"2024-09-18T02:08:33.802976+0000","last_clean":"2024-09-18T02:08:33.802976+0000","last_became_active":"2024-09-18T02:03:57.522924+0000","last_became_peered":"2024-09-18T02:03:57.522924+0000","last_unstale":"2024-09-18T02:08:33.802976+0000","last_undegraded":"2024-09-18T02:08:33.802976+0000","last_fullsized":"2024-09-18T02:08:33.802976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:33.802752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:33.802752+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.802752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:19.699701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.214173+0000","last_change":"2024-09-18T02:08:21.214261+0000","last_active":"2024-09-18T02:08:21.214173+0000","last_peered":"2024-09-18T02:08:21.214173+0000","last_clean":"2024-09-18T02:08:21.214173+0000","last_became_active":"2024-09-18T02:03:59.538126+0000","last_became_peered":"2024-09-18T02:03:59.538126+0000","last_unstale":"2024-09-18T02:08:21.214173+0000","last_undegraded":"2024-09-18T02:08:21.214173+0000","last_fullsized":"2024-09-18T02:08:21.214173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:21.213960+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:21.213960+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.213960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:52.543767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.975347+0000","last_change":"2024-09-18T02:08:29.975405+0000","last_active":"2024-09-18T02:08:29.975347+0000","last_peered":"2024-09-18T02:08:29.975347+0000","last_clean":"2024-09-18T02:08:29.975347+0000","last_became_active":"2024-09-18T02:03:57.521019+0000","last_became_peered":"2024-09-18T02:03:57.521019+0000","last_unstale":"2024-09-18T02:08:29.975347+0000","last_undegraded":"2024-09-18T02:08:29.975347+0000","last_fullsized":"2024-09-18T02:08:29.975347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:29.975122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:29.975122+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.975122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:53:14.709327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.739233+0000","last_change":"2024-09-18T02:08:22.739297+0000","last_active":"2024-09-18T02:08:22.739233+0000","last_peered":"2024-09-18T02:08:22.739233+0000","last_clean":"2024-09-18T02:08:22.739233+0000","last_became_active":"2024-09-18T02:03:59.540553+0000","last_became_peered":"2024-09-18T02:03:59.540553+0000","last_unstale":"2024-09-18T02:08:22.739233+0000","last_undegraded":"2024-09-18T02:08:22.739233+0000","last_fullsized":"2024-09-18T02:08:22.739233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:22.739006+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:22.739006+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.739006+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:49.648220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:45.543385+0000","last_change":"2024-09-18T02:08:45.543498+0000","last_active":"2024-09-18T02:08:45.543385+0000","last_peered":"2024-09-18T02:08:45.543385+0000","last_clean":"2024-09-18T02:08:45.543385+0000","last_became_active":"2024-09-18T02:03:57.526917+0000","last_became_peered":"2024-09-18T02:03:57.526917+0000","last_unstale":"2024-09-18T02:08:45.543385+0000","last_undegraded":"2024-09-18T02:08:45.543385+0000","last_fullsized":"2024-09-18T02:08:45.543385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:45.543171+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:45.543171+0000","last_clean_scrub_stamp":"2024-09-18T02:08:45.543171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:42:30.963088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:45.742986+0000","last_change":"2024-09-18T02:08:45.743048+0000","last_active":"2024-09-18T02:08:45.742986+0000","last_peered":"2024-09-18T02:08:45.742986+0000","last_clean":"2024-09-18T02:08:45.742986+0000","last_became_active":"2024-09-18T02:04:07.624037+0000","last_became_peered":"2024-09-18T02:04:07.624037+0000","last_unstale":"2024-09-18T02:08:45.742986+0000","last_undegraded":"2024-09-18T02:08:45.742986+0000","last_fullsized":"2024-09-18T02:08:45.742986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-18T02:08:45.742798+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-18T02:08:45.742798+0000","last_clean_scrub_stamp":"2024-09-18T02:08:45.742798+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:39.170365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.457336+0000","last_change":"2024-09-18T02:08:33.457336+0000","last_active":"2024-09-18T02:08:33.457336+0000","last_peered":"2024-09-18T02:08:33.457336+0000","last_clean":"2024-09-18T02:08:33.457336+0000","last_became_active":"2024-09-18T02:03:59.538409+0000","last_became_peered":"2024-09-18T02:03:59.538409+0000","last_unstale":"2024-09-18T02:08:33.457336+0000","last_undegraded":"2024-09-18T02:08:33.457336+0000","last_fullsized":"2024-09-18T02:08:33.457336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:33.456927+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:33.456927+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.456927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:01.095761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996317+0000","last_change":"2024-09-18T02:03:57.533041+0000","last_active":"2024-09-18T02:07:47.996317+0000","last_peered":"2024-09-18T02:07:47.996317+0000","last_clean":"2024-09-18T02:07:47.996317+0000","last_became_active":"2024-09-18T02:03:57.532657+0000","last_became_peered":"2024-09-18T02:03:57.532657+0000","last_unstale":"2024-09-18T02:07:47.996317+0000","last_undegraded":"2024-09-18T02:07:47.996317+0000","last_fullsized":"2024-09-18T02:07:47.996317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.360622+0000","last_change":"2024-09-18T02:07:51.360784+0000","last_active":"2024-09-18T02:07:51.360622+0000","last_peered":"2024-09-18T02:07:51.360622+0000","last_clean":"2024-09-18T02:07:51.360622+0000","last_became_active":"2024-09-18T02:04:01.562058+0000","last_became_peered":"2024-09-18T02:04:01.562058+0000","last_unstale":"2024-09-18T02:07:51.360622+0000","last_undegraded":"2024-09-18T02:07:51.360622+0000","last_fullsized":"2024-09-18T02:07:51.360622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.360360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.360360+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.360360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:21:46.176795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'51","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.267009+0000","last_change":"2024-09-18T02:08:14.267100+0000","last_active":"2024-09-18T02:08:14.267009+0000","last_peered":"2024-09-18T02:08:14.267009+0000","last_clean":"2024-09-18T02:08:14.267009+0000","last_became_active":"2024-09-18T02:04:03.600467+0000","last_became_peered":"2024-09-18T02:04:03.600467+0000","last_unstale":"2024-09-18T02:08:14.267009+0000","last_undegraded":"2024-09-18T02:08:14.267009+0000","last_fullsized":"2024-09-18T02:08:14.267009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-18T02:08:14.266804+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-18T02:08:14.266804+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.266804+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:00.903374+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.891970+0000","last_change":"2024-09-18T02:08:00.892026+0000","last_active":"2024-09-18T02:08:00.891970+0000","last_peered":"2024-09-18T02:08:00.891970+0000","last_clean":"2024-09-18T02:08:00.891970+0000","last_became_active":"2024-09-18T02:04:05.592934+0000","last_became_peered":"2024-09-18T02:04:05.592934+0000","last_unstale":"2024-09-18T02:08:00.891970+0000","last_undegraded":"2024-09-18T02:08:00.891970+0000","last_fullsized":"2024-09-18T02:08:00.891970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:00.891781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:00.891781+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.891781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:40.385945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:36.337063+0000","last_change":"2024-09-18T02:04:07.624771+0000","last_active":"2024-09-18T02:06:36.337063+0000","last_peered":"2024-09-18T02:06:36.337063+0000","last_clean":"2024-09-18T02:06:36.337063+0000","last_became_active":"2024-09-18T02:04:07.624106+0000","last_became_peered":"2024-09-18T02:04:07.624106+0000","last_unstale":"2024-09-18T02:06:36.337063+0000","last_undegraded":"2024-09-18T02:06:36.337063+0000","last_fullsized":"2024-09-18T02:06:36.337063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.231143+0000","last_change":"2024-09-18T02:08:22.231205+0000","last_active":"2024-09-18T02:08:22.231143+0000","last_peered":"2024-09-18T02:08:22.231143+0000","last_clean":"2024-09-18T02:08:22.231143+0000","last_became_active":"2024-09-18T02:03:59.555956+0000","last_became_peered":"2024-09-18T02:03:59.555956+0000","last_unstale":"2024-09-18T02:08:22.231143+0000","last_undegraded":"2024-09-18T02:08:22.231143+0000","last_fullsized":"2024-09-18T02:08:22.231143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:22.230956+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:22.230956+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.230956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:14.581546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.259379+0000","last_change":"2024-09-18T02:08:34.259379+0000","last_active":"2024-09-18T02:08:34.259379+0000","last_peered":"2024-09-18T02:08:34.259379+0000","last_clean":"2024-09-18T02:08:34.259379+0000","last_became_active":"2024-09-18T02:03:57.523041+0000","last_became_peered":"2024-09-18T02:03:57.523041+0000","last_unstale":"2024-09-18T02:08:34.259379+0000","last_undegraded":"2024-09-18T02:08:34.259379+0000","last_fullsized":"2024-09-18T02:08:34.259379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:34.259136+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:34.259136+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.259136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:39.485007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:56.341443+0000","last_change":"2024-09-18T02:04:36.363414+0000","last_active":"2024-09-18T02:06:56.341443+0000","last_peered":"2024-09-18T02:06:56.341443+0000","last_clean":"2024-09-18T02:06:56.341443+0000","last_became_active":"2024-09-18T02:04:36.362592+0000","last_became_peered":"2024-09-18T02:04:36.362592+0000","last_unstale":"2024-09-18T02:06:56.341443+0000","last_undegraded":"2024-09-18T02:06:56.341443+0000","last_fullsized":"2024-09-18T02:06:56.341443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:00.515145+0000","last_clean_scrub_stamp":"2024-09-18T02:04:00.515145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.117034+0000","last_change":"2024-09-18T02:07:50.117106+0000","last_active":"2024-09-18T02:07:50.117034+0000","last_peered":"2024-09-18T02:07:50.117034+0000","last_clean":"2024-09-18T02:07:50.117034+0000","last_became_active":"2024-09-18T02:04:03.579442+0000","last_became_peered":"2024-09-18T02:04:03.579442+0000","last_unstale":"2024-09-18T02:07:50.117034+0000","last_undegraded":"2024-09-18T02:07:50.117034+0000","last_fullsized":"2024-09-18T02:07:50.117034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-18T02:07:50.116825+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-18T02:07:50.116825+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.116825+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:28.484106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.808455+0000","last_change":"2024-09-18T02:08:04.808508+0000","last_active":"2024-09-18T02:08:04.808455+0000","last_peered":"2024-09-18T02:08:04.808455+0000","last_clean":"2024-09-18T02:08:04.808455+0000","last_became_active":"2024-09-18T02:04:05.605774+0000","last_became_peered":"2024-09-18T02:04:05.605774+0000","last_unstale":"2024-09-18T02:08:04.808455+0000","last_undegraded":"2024-09-18T02:08:04.808455+0000","last_fullsized":"2024-09-18T02:08:04.808455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:04.808264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:04.808264+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.808264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:41:47.654931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.798511+0000","last_change":"2024-09-18T02:08:42.798632+0000","last_active":"2024-09-18T02:08:42.798511+0000","last_peered":"2024-09-18T02:08:42.798511+0000","last_clean":"2024-09-18T02:08:42.798511+0000","last_became_active":"2024-09-18T02:04:07.610120+0000","last_became_peered":"2024-09-18T02:04:07.610120+0000","last_unstale":"2024-09-18T02:08:42.798511+0000","last_undegraded":"2024-09-18T02:08:42.798511+0000","last_fullsized":"2024-09-18T02:08:42.798511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:42.798222+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:42.798222+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.798222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:46:56.329254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.108000+0000","last_change":"2024-09-18T02:08:43.108061+0000","last_active":"2024-09-18T02:08:43.108000+0000","last_peered":"2024-09-18T02:08:43.108000+0000","last_clean":"2024-09-18T02:08:43.108000+0000","last_became_active":"2024-09-18T02:04:36.359108+0000","last_became_peered":"2024-09-18T02:04:36.359108+0000","last_unstale":"2024-09-18T02:08:43.108000+0000","last_undegraded":"2024-09-18T02:08:43.108000+0000","last_fullsized":"2024-09-18T02:08:43.108000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:43.107809+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:43.107809+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.107809+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:37:36.817784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996232+0000","last_change":"2024-09-18T02:03:57.533341+0000","last_active":"2024-09-18T02:07:47.996232+0000","last_peered":"2024-09-18T02:07:47.996232+0000","last_clean":"2024-09-18T02:07:47.996232+0000","last_became_active":"2024-09-18T02:03:57.533037+0000","last_became_peered":"2024-09-18T02:03:57.533037+0000","last_unstale":"2024-09-18T02:07:47.996232+0000","last_undegraded":"2024-09-18T02:07:47.996232+0000","last_fullsized":"2024-09-18T02:07:47.996232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.236175+0000","last_change":"2024-09-18T02:08:06.236244+0000","last_active":"2024-09-18T02:08:06.236175+0000","last_peered":"2024-09-18T02:08:06.236175+0000","last_clean":"2024-09-18T02:08:06.236175+0000","last_became_active":"2024-09-18T02:04:01.567287+0000","last_became_peered":"2024-09-18T02:04:01.567287+0000","last_unstale":"2024-09-18T02:08:06.236175+0000","last_undegraded":"2024-09-18T02:08:06.236175+0000","last_fullsized":"2024-09-18T02:08:06.236175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-18T02:08:06.235937+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-18T02:08:06.235937+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.235937+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:02.660438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'30","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.284486+0000","last_change":"2024-09-18T02:08:01.284486+0000","last_active":"2024-09-18T02:08:01.284486+0000","last_peered":"2024-09-18T02:08:01.284486+0000","last_clean":"2024-09-18T02:08:01.284486+0000","last_became_active":"2024-09-18T02:04:03.581092+0000","last_became_peered":"2024-09-18T02:04:03.581092+0000","last_unstale":"2024-09-18T02:08:01.284486+0000","last_undegraded":"2024-09-18T02:08:01.284486+0000","last_fullsized":"2024-09-18T02:08:01.284486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-09-18T02:08:01.284176+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-09-18T02:08:01.284176+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.284176+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:52.879851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.250032+0000","last_change":"2024-09-18T02:08:12.250165+0000","last_active":"2024-09-18T02:08:12.250032+0000","last_peered":"2024-09-18T02:08:12.250032+0000","last_clean":"2024-09-18T02:08:12.250032+0000","last_became_active":"2024-09-18T02:04:05.607733+0000","last_became_peered":"2024-09-18T02:04:05.607733+0000","last_unstale":"2024-09-18T02:08:12.250032+0000","last_undegraded":"2024-09-18T02:08:12.250032+0000","last_fullsized":"2024-09-18T02:08:12.250032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:08:12.249802+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:08:12.249802+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.249802+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:58.146750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.226098+0000","last_change":"2024-09-18T02:08:38.226162+0000","last_active":"2024-09-18T02:08:38.226098+0000","last_peered":"2024-09-18T02:08:38.226098+0000","last_clean":"2024-09-18T02:08:38.226098+0000","last_became_active":"2024-09-18T02:04:07.630721+0000","last_became_peered":"2024-09-18T02:04:07.630721+0000","last_unstale":"2024-09-18T02:08:38.226098+0000","last_undegraded":"2024-09-18T02:08:38.226098+0000","last_fullsized":"2024-09-18T02:08:38.226098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:38.225897+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:38.225897+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.225897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:01:16.801367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.853732+0000","last_change":"2024-09-18T02:08:40.853795+0000","last_active":"2024-09-18T02:08:40.853732+0000","last_peered":"2024-09-18T02:08:40.853732+0000","last_clean":"2024-09-18T02:08:40.853732+0000","last_became_active":"2024-09-18T02:03:59.548365+0000","last_became_peered":"2024-09-18T02:03:59.548365+0000","last_unstale":"2024-09-18T02:08:40.853732+0000","last_undegraded":"2024-09-18T02:08:40.853732+0000","last_fullsized":"2024-09-18T02:08:40.853732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:40.853546+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:40.853546+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.853546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:33.204136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.775867+0000","last_change":"2024-09-18T02:08:39.775867+0000","last_active":"2024-09-18T02:08:39.775867+0000","last_peered":"2024-09-18T02:08:39.775867+0000","last_clean":"2024-09-18T02:08:39.775867+0000","last_became_active":"2024-09-18T02:03:57.520706+0000","last_became_peered":"2024-09-18T02:03:57.520706+0000","last_unstale":"2024-09-18T02:08:39.775867+0000","last_undegraded":"2024-09-18T02:08:39.775867+0000","last_fullsized":"2024-09-18T02:08:39.775867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:39.775602+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:39.775602+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.775602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:24.300392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.277690+0000","last_change":"2024-09-18T02:07:53.277755+0000","last_active":"2024-09-18T02:07:53.277690+0000","last_peered":"2024-09-18T02:07:53.277690+0000","last_clean":"2024-09-18T02:07:53.277690+0000","last_became_active":"2024-09-18T02:04:01.559249+0000","last_became_peered":"2024-09-18T02:04:01.559249+0000","last_unstale":"2024-09-18T02:07:53.277690+0000","last_undegraded":"2024-09-18T02:07:53.277690+0000","last_fullsized":"2024-09-18T02:07:53.277690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:07:53.277506+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:07:53.277506+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.277506+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:50.677514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'43","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.342497+0000","last_change":"2024-09-18T02:08:04.342570+0000","last_active":"2024-09-18T02:08:04.342497+0000","last_peered":"2024-09-18T02:08:04.342497+0000","last_clean":"2024-09-18T02:08:04.342497+0000","last_became_active":"2024-09-18T02:04:03.580310+0000","last_became_peered":"2024-09-18T02:04:03.580310+0000","last_unstale":"2024-09-18T02:08:04.342497+0000","last_undegraded":"2024-09-18T02:08:04.342497+0000","last_fullsized":"2024-09-18T02:08:04.342497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:04.342294+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:04.342294+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.342294+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:25.901859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":449,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.219458+0000","last_change":"2024-09-18T02:08:07.219458+0000","last_active":"2024-09-18T02:08:07.219458+0000","last_peered":"2024-09-18T02:08:07.219458+0000","last_clean":"2024-09-18T02:08:07.219458+0000","last_became_active":"2024-09-18T02:04:05.611707+0000","last_became_peered":"2024-09-18T02:04:05.611707+0000","last_unstale":"2024-09-18T02:08:07.219458+0000","last_undegraded":"2024-09-18T02:08:07.219458+0000","last_fullsized":"2024-09-18T02:08:07.219458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:08:07.219074+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:08:07.219074+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.219074+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:05.918033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.227542+0000","last_change":"2024-09-18T02:08:05.227542+0000","last_active":"2024-09-18T02:08:05.227542+0000","last_peered":"2024-09-18T02:08:05.227542+0000","last_clean":"2024-09-18T02:08:05.227542+0000","last_became_active":"2024-09-18T02:03:59.559585+0000","last_became_peered":"2024-09-18T02:03:59.559585+0000","last_unstale":"2024-09-18T02:08:05.227542+0000","last_undegraded":"2024-09-18T02:08:05.227542+0000","last_fullsized":"2024-09-18T02:08:05.227542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:05.227308+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:05.227308+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.227308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:31.984980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.235058+0000","last_change":"2024-09-18T02:08:26.235058+0000","last_active":"2024-09-18T02:08:26.235058+0000","last_peered":"2024-09-18T02:08:26.235058+0000","last_clean":"2024-09-18T02:08:26.235058+0000","last_became_active":"2024-09-18T02:03:57.527575+0000","last_became_peered":"2024-09-18T02:03:57.527575+0000","last_unstale":"2024-09-18T02:08:26.235058+0000","last_undegraded":"2024-09-18T02:08:26.235058+0000","last_fullsized":"2024-09-18T02:08:26.235058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:26.234826+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:26.234826+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.234826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:39.434344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.936141+0000","last_change":"2024-09-18T02:07:58.936141+0000","last_active":"2024-09-18T02:07:58.936141+0000","last_peered":"2024-09-18T02:07:58.936141+0000","last_clean":"2024-09-18T02:07:58.936141+0000","last_became_active":"2024-09-18T02:04:01.569301+0000","last_became_peered":"2024-09-18T02:04:01.569301+0000","last_unstale":"2024-09-18T02:07:58.936141+0000","last_undegraded":"2024-09-18T02:07:58.936141+0000","last_fullsized":"2024-09-18T02:07:58.936141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:58.935889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:58.935889+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.935889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:18.769091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'58","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.362195+0000","last_change":"2024-09-18T02:07:56.362296+0000","last_active":"2024-09-18T02:07:56.362195+0000","last_peered":"2024-09-18T02:07:56.362195+0000","last_clean":"2024-09-18T02:07:56.362195+0000","last_became_active":"2024-09-18T02:04:03.591195+0000","last_became_peered":"2024-09-18T02:04:03.591195+0000","last_unstale":"2024-09-18T02:07:56.362195+0000","last_undegraded":"2024-09-18T02:07:56.362195+0000","last_fullsized":"2024-09-18T02:07:56.362195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'58","last_scrub_stamp":"2024-09-18T02:07:56.361976+0000","last_deep_scrub":"32'58","last_deep_scrub_stamp":"2024-09-18T02:07:56.361976+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.361976+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:50:55.705307+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.187610+0000","last_change":"2024-09-18T02:07:59.187610+0000","last_active":"2024-09-18T02:07:59.187610+0000","last_peered":"2024-09-18T02:07:59.187610+0000","last_clean":"2024-09-18T02:07:59.187610+0000","last_became_active":"2024-09-18T02:04:05.605611+0000","last_became_peered":"2024-09-18T02:04:05.605611+0000","last_unstale":"2024-09-18T02:07:59.187610+0000","last_undegraded":"2024-09-18T02:07:59.187610+0000","last_fullsized":"2024-09-18T02:07:59.187610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:59.187354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:59.187354+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.187354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:48.634059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.286144+0000","last_change":"2024-09-18T02:08:11.286144+0000","last_active":"2024-09-18T02:08:11.286144+0000","last_peered":"2024-09-18T02:08:11.286144+0000","last_clean":"2024-09-18T02:08:11.286144+0000","last_became_active":"2024-09-18T02:04:07.628247+0000","last_became_peered":"2024-09-18T02:04:07.628247+0000","last_unstale":"2024-09-18T02:08:11.286144+0000","last_undegraded":"2024-09-18T02:08:11.286144+0000","last_fullsized":"2024-09-18T02:08:11.286144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:08:11.285863+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:08:11.285863+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.285863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:35.920724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.703080+0000","last_change":"2024-09-18T02:08:21.703212+0000","last_active":"2024-09-18T02:08:21.703080+0000","last_peered":"2024-09-18T02:08:21.703080+0000","last_clean":"2024-09-18T02:08:21.703080+0000","last_became_active":"2024-09-18T02:03:59.535217+0000","last_became_peered":"2024-09-18T02:03:59.535217+0000","last_unstale":"2024-09-18T02:08:21.703080+0000","last_undegraded":"2024-09-18T02:08:21.703080+0000","last_fullsized":"2024-09-18T02:08:21.703080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:21.702848+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:21.702848+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.702848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:57.957250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.207623+0000","last_change":"2024-09-18T02:08:22.207623+0000","last_active":"2024-09-18T02:08:22.207623+0000","last_peered":"2024-09-18T02:08:22.207623+0000","last_clean":"2024-09-18T02:08:22.207623+0000","last_became_active":"2024-09-18T02:03:57.528006+0000","last_became_peered":"2024-09-18T02:03:57.528006+0000","last_unstale":"2024-09-18T02:08:22.207623+0000","last_undegraded":"2024-09-18T02:08:22.207623+0000","last_fullsized":"2024-09-18T02:08:22.207623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:22.207330+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:22.207330+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.207330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:56.517929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.197984+0000","last_change":"2024-09-18T02:08:40.198039+0000","last_active":"2024-09-18T02:08:40.197984+0000","last_peered":"2024-09-18T02:08:40.197984+0000","last_clean":"2024-09-18T02:08:40.197984+0000","last_became_active":"2024-09-18T02:04:36.357607+0000","last_became_peered":"2024-09-18T02:04:36.357607+0000","last_unstale":"2024-09-18T02:08:40.197984+0000","last_undegraded":"2024-09-18T02:08:40.197984+0000","last_fullsized":"2024-09-18T02:08:40.197984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:40.197796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:40.197796+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.197796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:26.094745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'43","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.242764+0000","last_change":"2024-09-18T02:08:10.242764+0000","last_active":"2024-09-18T02:08:10.242764+0000","last_peered":"2024-09-18T02:08:10.242764+0000","last_clean":"2024-09-18T02:08:10.242764+0000","last_became_active":"2024-09-18T02:04:03.601783+0000","last_became_peered":"2024-09-18T02:04:03.601783+0000","last_unstale":"2024-09-18T02:08:10.242764+0000","last_undegraded":"2024-09-18T02:08:10.242764+0000","last_fullsized":"2024-09-18T02:08:10.242764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:10.242501+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:10.242501+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.242501+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:48.817971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.235959+0000","last_change":"2024-09-18T02:07:54.235959+0000","last_active":"2024-09-18T02:07:54.235959+0000","last_peered":"2024-09-18T02:07:54.235959+0000","last_clean":"2024-09-18T02:07:54.235959+0000","last_became_active":"2024-09-18T02:04:05.577665+0000","last_became_peered":"2024-09-18T02:04:05.577665+0000","last_unstale":"2024-09-18T02:07:54.235959+0000","last_undegraded":"2024-09-18T02:07:54.235959+0000","last_fullsized":"2024-09-18T02:07:54.235959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.235697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.235697+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.235697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:59:25.686298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.704604+0000","last_change":"2024-09-18T02:08:16.704604+0000","last_active":"2024-09-18T02:08:16.704604+0000","last_peered":"2024-09-18T02:08:16.704604+0000","last_clean":"2024-09-18T02:08:16.704604+0000","last_became_active":"2024-09-18T02:04:07.619973+0000","last_became_peered":"2024-09-18T02:04:07.619973+0000","last_unstale":"2024-09-18T02:08:16.704604+0000","last_undegraded":"2024-09-18T02:08:16.704604+0000","last_fullsized":"2024-09-18T02:08:16.704604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:16.704356+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:16.704356+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.704356+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:22.425273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.283438+0000","last_change":"2024-09-18T02:08:25.283505+0000","last_active":"2024-09-18T02:08:25.283438+0000","last_peered":"2024-09-18T02:08:25.283438+0000","last_clean":"2024-09-18T02:08:25.283438+0000","last_became_active":"2024-09-18T02:03:59.539105+0000","last_became_peered":"2024-09-18T02:03:59.539105+0000","last_unstale":"2024-09-18T02:08:25.283438+0000","last_undegraded":"2024-09-18T02:08:25.283438+0000","last_fullsized":"2024-09-18T02:08:25.283438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:25.283204+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:25.283204+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.283204+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:35.826881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'3","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.563954+0000","last_change":"2024-09-18T02:08:42.564020+0000","last_active":"2024-09-18T02:08:42.563954+0000","last_peered":"2024-09-18T02:08:42.563954+0000","last_clean":"2024-09-18T02:08:42.563954+0000","last_became_active":"2024-09-18T02:03:57.526327+0000","last_became_peered":"2024-09-18T02:03:57.526327+0000","last_unstale":"2024-09-18T02:08:42.563954+0000","last_undegraded":"2024-09-18T02:08:42.563954+0000","last_fullsized":"2024-09-18T02:08:42.563954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:08:42.563748+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:08:42.563748+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.563748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:04:56.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.210456+0000","last_change":"2024-09-18T02:08:09.210456+0000","last_active":"2024-09-18T02:08:09.210456+0000","last_peered":"2024-09-18T02:08:09.210456+0000","last_clean":"2024-09-18T02:08:09.210456+0000","last_became_active":"2024-09-18T02:04:01.561279+0000","last_became_peered":"2024-09-18T02:04:01.561279+0000","last_unstale":"2024-09-18T02:08:09.210456+0000","last_undegraded":"2024-09-18T02:08:09.210456+0000","last_fullsized":"2024-09-18T02:08:09.210456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:09.210167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:09.210167+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.210167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:48:36.008753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'60","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.236436+0000","last_change":"2024-09-18T02:07:56.236436+0000","last_active":"2024-09-18T02:07:56.236436+0000","last_peered":"2024-09-18T02:07:56.236436+0000","last_clean":"2024-09-18T02:07:56.236436+0000","last_became_active":"2024-09-18T02:04:03.591705+0000","last_became_peered":"2024-09-18T02:04:03.591705+0000","last_unstale":"2024-09-18T02:07:56.236436+0000","last_undegraded":"2024-09-18T02:07:56.236436+0000","last_fullsized":"2024-09-18T02:07:56.236436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2024-09-18T02:07:56.236157+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2024-09-18T02:07:56.236157+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.236157+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:26.464832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":411,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.258507+0000","last_change":"2024-09-18T02:07:47.258507+0000","last_active":"2024-09-18T02:07:47.258507+0000","last_peered":"2024-09-18T02:07:47.258507+0000","last_clean":"2024-09-18T02:07:47.258507+0000","last_became_active":"2024-09-18T02:04:05.591652+0000","last_became_peered":"2024-09-18T02:04:05.591652+0000","last_unstale":"2024-09-18T02:07:47.258507+0000","last_undegraded":"2024-09-18T02:07:47.258507+0000","last_fullsized":"2024-09-18T02:07:47.258507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:47.258352+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:47.258352+0000","last_clean_scrub_stamp":"2024-09-18T02:07:47.258352+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:22.446528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.194435+0000","last_change":"2024-09-18T02:08:11.194435+0000","last_active":"2024-09-18T02:08:11.194435+0000","last_peered":"2024-09-18T02:08:11.194435+0000","last_clean":"2024-09-18T02:08:11.194435+0000","last_became_active":"2024-09-18T02:04:07.609050+0000","last_became_peered":"2024-09-18T02:04:07.609050+0000","last_unstale":"2024-09-18T02:08:11.194435+0000","last_undegraded":"2024-09-18T02:08:11.194435+0000","last_fullsized":"2024-09-18T02:08:11.194435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:11.194052+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:11.194052+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.194052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:45.504652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'14","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.282593+0000","last_change":"2024-09-18T02:08:16.282593+0000","last_active":"2024-09-18T02:08:16.282593+0000","last_peered":"2024-09-18T02:08:16.282593+0000","last_clean":"2024-09-18T02:08:16.282593+0000","last_became_active":"2024-09-18T02:03:59.531445+0000","last_became_peered":"2024-09-18T02:03:59.531445+0000","last_unstale":"2024-09-18T02:08:16.282593+0000","last_undegraded":"2024-09-18T02:08:16.282593+0000","last_fullsized":"2024-09-18T02:08:16.282593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:16.282341+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:16.282341+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.282341+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:03.360755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996162+0000","last_change":"2024-09-18T02:03:57.522436+0000","last_active":"2024-09-18T02:07:47.996162+0000","last_peered":"2024-09-18T02:07:47.996162+0000","last_clean":"2024-09-18T02:07:47.996162+0000","last_became_active":"2024-09-18T02:03:57.521858+0000","last_became_peered":"2024-09-18T02:03:57.521858+0000","last_unstale":"2024-09-18T02:07:47.996162+0000","last_undegraded":"2024-09-18T02:07:47.996162+0000","last_fullsized":"2024-09-18T02:07:47.996162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.223208+0000","last_change":"2024-09-18T02:08:39.223261+0000","last_active":"2024-09-18T02:08:39.223208+0000","last_peered":"2024-09-18T02:08:39.223208+0000","last_clean":"2024-09-18T02:08:39.223208+0000","last_became_active":"2024-09-18T02:04:36.356453+0000","last_became_peered":"2024-09-18T02:04:36.356453+0000","last_unstale":"2024-09-18T02:08:39.223208+0000","last_undegraded":"2024-09-18T02:08:39.223208+0000","last_fullsized":"2024-09-18T02:08:39.223208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:39.223019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:39.223019+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.223019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:53:23.957224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'77","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.228384+0000","last_change":"2024-09-18T02:08:00.228384+0000","last_active":"2024-09-18T02:08:00.228384+0000","last_peered":"2024-09-18T02:08:00.228384+0000","last_clean":"2024-09-18T02:08:00.228384+0000","last_became_active":"2024-09-18T02:04:03.595618+0000","last_became_peered":"2024-09-18T02:04:03.595618+0000","last_unstale":"2024-09-18T02:08:00.228384+0000","last_undegraded":"2024-09-18T02:08:00.228384+0000","last_fullsized":"2024-09-18T02:08:00.228384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'77","last_scrub_stamp":"2024-09-18T02:08:00.228054+0000","last_deep_scrub":"32'77","last_deep_scrub_stamp":"2024-09-18T02:08:00.228054+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.228054+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:27.137267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.222718+0000","last_change":"2024-09-18T02:07:52.222718+0000","last_active":"2024-09-18T02:07:52.222718+0000","last_peered":"2024-09-18T02:07:52.222718+0000","last_clean":"2024-09-18T02:07:52.222718+0000","last_became_active":"2024-09-18T02:04:05.585272+0000","last_became_peered":"2024-09-18T02:04:05.585272+0000","last_unstale":"2024-09-18T02:07:52.222718+0000","last_undegraded":"2024-09-18T02:07:52.222718+0000","last_fullsized":"2024-09-18T02:07:52.222718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:52.222463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:52.222463+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.222463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:48.799896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.759993+0000","last_change":"2024-09-18T02:08:43.760169+0000","last_active":"2024-09-18T02:08:43.759993+0000","last_peered":"2024-09-18T02:08:43.759993+0000","last_clean":"2024-09-18T02:08:43.759993+0000","last_became_active":"2024-09-18T02:04:07.614232+0000","last_became_peered":"2024-09-18T02:04:07.614232+0000","last_unstale":"2024-09-18T02:08:43.759993+0000","last_undegraded":"2024-09-18T02:08:43.759993+0000","last_fullsized":"2024-09-18T02:08:43.759993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-18T02:08:43.759763+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-18T02:08:43.759763+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.759763+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:37.187330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.689240+0000","last_change":"2024-09-18T02:08:17.689240+0000","last_active":"2024-09-18T02:08:17.689240+0000","last_peered":"2024-09-18T02:08:17.689240+0000","last_clean":"2024-09-18T02:08:17.689240+0000","last_became_active":"2024-09-18T02:03:59.545956+0000","last_became_peered":"2024-09-18T02:03:59.545956+0000","last_unstale":"2024-09-18T02:08:17.689240+0000","last_undegraded":"2024-09-18T02:08:17.689240+0000","last_fullsized":"2024-09-18T02:08:17.689240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:17.688836+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:17.688836+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.688836+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:28.232512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.815803+0000","last_change":"2024-09-18T02:08:38.815930+0000","last_active":"2024-09-18T02:08:38.815803+0000","last_peered":"2024-09-18T02:08:38.815803+0000","last_clean":"2024-09-18T02:08:38.815803+0000","last_became_active":"2024-09-18T02:03:57.520036+0000","last_became_peered":"2024-09-18T02:03:57.520036+0000","last_unstale":"2024-09-18T02:08:38.815803+0000","last_undegraded":"2024-09-18T02:08:38.815803+0000","last_fullsized":"2024-09-18T02:08:38.815803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:38.815568+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:38.815568+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.815568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:46.560180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.295590+0000","last_change":"2024-09-18T02:08:05.295590+0000","last_active":"2024-09-18T02:08:05.295590+0000","last_peered":"2024-09-18T02:08:05.295590+0000","last_clean":"2024-09-18T02:08:05.295590+0000","last_became_active":"2024-09-18T02:04:01.573084+0000","last_became_peered":"2024-09-18T02:04:01.573084+0000","last_unstale":"2024-09-18T02:08:05.295590+0000","last_undegraded":"2024-09-18T02:08:05.295590+0000","last_fullsized":"2024-09-18T02:08:05.295590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:05.295326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:05.295326+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.295326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:26.816185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.074574+0000","last_change":"2024-09-18T02:07:54.074574+0000","last_active":"2024-09-18T02:07:54.074574+0000","last_peered":"2024-09-18T02:07:54.074574+0000","last_clean":"2024-09-18T02:07:54.074574+0000","last_became_active":"2024-09-18T02:04:03.565801+0000","last_became_peered":"2024-09-18T02:04:03.565801+0000","last_unstale":"2024-09-18T02:07:54.074574+0000","last_undegraded":"2024-09-18T02:07:54.074574+0000","last_fullsized":"2024-09-18T02:07:54.074574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-18T02:07:54.074277+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-18T02:07:54.074277+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.074277+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:23:20.641594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.263760+0000","last_change":"2024-09-18T02:08:24.263760+0000","last_active":"2024-09-18T02:08:24.263760+0000","last_peered":"2024-09-18T02:08:24.263760+0000","last_clean":"2024-09-18T02:08:24.263760+0000","last_became_active":"2024-09-18T02:04:05.612052+0000","last_became_peered":"2024-09-18T02:04:05.612052+0000","last_unstale":"2024-09-18T02:08:24.263760+0000","last_undegraded":"2024-09-18T02:08:24.263760+0000","last_fullsized":"2024-09-18T02:08:24.263760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:24.263524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:24.263524+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.263524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:46:37.794556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.998718+0000","last_change":"2024-09-18T02:04:07.622545+0000","last_active":"2024-09-18T02:07:47.998718+0000","last_peered":"2024-09-18T02:07:47.998718+0000","last_clean":"2024-09-18T02:07:47.998718+0000","last_became_active":"2024-09-18T02:04:07.622004+0000","last_became_peered":"2024-09-18T02:04:07.622004+0000","last_unstale":"2024-09-18T02:07:47.998718+0000","last_undegraded":"2024-09-18T02:07:47.998718+0000","last_fullsized":"2024-09-18T02:07:47.998718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.196700+0000","last_change":"2024-09-18T02:08:41.196851+0000","last_active":"2024-09-18T02:08:41.196700+0000","last_peered":"2024-09-18T02:08:41.196700+0000","last_clean":"2024-09-18T02:08:41.196700+0000","last_became_active":"2024-09-18T02:04:36.361748+0000","last_became_peered":"2024-09-18T02:04:36.361748+0000","last_unstale":"2024-09-18T02:08:41.196700+0000","last_undegraded":"2024-09-18T02:08:41.196700+0000","last_fullsized":"2024-09-18T02:08:41.196700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:41.196483+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:41.196483+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.196483+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:41.686454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.566044+0000","last_change":"2024-09-18T02:08:44.566101+0000","last_active":"2024-09-18T02:08:44.566044+0000","last_peered":"2024-09-18T02:08:44.566044+0000","last_clean":"2024-09-18T02:08:44.566044+0000","last_became_active":"2024-09-18T02:03:57.526977+0000","last_became_peered":"2024-09-18T02:03:57.526977+0000","last_unstale":"2024-09-18T02:08:44.566044+0000","last_undegraded":"2024-09-18T02:08:44.566044+0000","last_fullsized":"2024-09-18T02:08:44.566044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:44.565851+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:44.565851+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.565851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:04:34.691043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.203249+0000","last_change":"2024-09-18T02:08:08.203249+0000","last_active":"2024-09-18T02:08:08.203249+0000","last_peered":"2024-09-18T02:08:08.203249+0000","last_clean":"2024-09-18T02:08:08.203249+0000","last_became_active":"2024-09-18T02:04:01.561913+0000","last_became_peered":"2024-09-18T02:04:01.561913+0000","last_unstale":"2024-09-18T02:08:08.203249+0000","last_undegraded":"2024-09-18T02:08:08.203249+0000","last_fullsized":"2024-09-18T02:08:08.203249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.203008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.203008+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.203008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:28.422827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.280212+0000","last_change":"2024-09-18T02:08:02.280212+0000","last_active":"2024-09-18T02:08:02.280212+0000","last_peered":"2024-09-18T02:08:02.280212+0000","last_clean":"2024-09-18T02:08:02.280212+0000","last_became_active":"2024-09-18T02:04:03.580395+0000","last_became_peered":"2024-09-18T02:04:03.580395+0000","last_unstale":"2024-09-18T02:08:02.280212+0000","last_undegraded":"2024-09-18T02:08:02.280212+0000","last_fullsized":"2024-09-18T02:08:02.280212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-09-18T02:08:02.279903+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-09-18T02:08:02.279903+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.279903+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:12:22.758998+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.264976+0000","last_change":"2024-09-18T02:07:49.264976+0000","last_active":"2024-09-18T02:07:49.264976+0000","last_peered":"2024-09-18T02:07:49.264976+0000","last_clean":"2024-09-18T02:07:49.264976+0000","last_became_active":"2024-09-18T02:04:05.603548+0000","last_became_peered":"2024-09-18T02:04:05.603548+0000","last_unstale":"2024-09-18T02:07:49.264976+0000","last_undegraded":"2024-09-18T02:07:49.264976+0000","last_fullsized":"2024-09-18T02:07:49.264976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:49.264681+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:49.264681+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.264681+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:45:54.246439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'15","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:45.785014+0000","last_change":"2024-09-18T02:08:45.785089+0000","last_active":"2024-09-18T02:08:45.785014+0000","last_peered":"2024-09-18T02:08:45.785014+0000","last_clean":"2024-09-18T02:08:45.785014+0000","last_became_active":"2024-09-18T02:04:07.620094+0000","last_became_peered":"2024-09-18T02:04:07.620094+0000","last_unstale":"2024-09-18T02:08:45.785014+0000","last_undegraded":"2024-09-18T02:08:45.785014+0000","last_fullsized":"2024-09-18T02:08:45.785014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-18T02:08:45.784817+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-18T02:08:45.784817+0000","last_clean_scrub_stamp":"2024-09-18T02:08:45.784817+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:19.388070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'14","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.261906+0000","last_change":"2024-09-18T02:08:13.261906+0000","last_active":"2024-09-18T02:08:13.261906+0000","last_peered":"2024-09-18T02:08:13.261906+0000","last_clean":"2024-09-18T02:08:13.261906+0000","last_became_active":"2024-09-18T02:03:59.534547+0000","last_became_peered":"2024-09-18T02:03:59.534547+0000","last_unstale":"2024-09-18T02:08:13.261906+0000","last_undegraded":"2024-09-18T02:08:13.261906+0000","last_fullsized":"2024-09-18T02:08:13.261906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:13.261662+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:13.261662+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.261662+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:13.293664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996097+0000","last_change":"2024-09-18T02:03:57.526267+0000","last_active":"2024-09-18T02:07:47.996097+0000","last_peered":"2024-09-18T02:07:47.996097+0000","last_clean":"2024-09-18T02:07:47.996097+0000","last_became_active":"2024-09-18T02:03:57.525576+0000","last_became_peered":"2024-09-18T02:03:57.525576+0000","last_unstale":"2024-09-18T02:07:47.996097+0000","last_undegraded":"2024-09-18T02:07:47.996097+0000","last_fullsized":"2024-09-18T02:07:47.996097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.936130+0000","last_change":"2024-09-18T02:07:59.936130+0000","last_active":"2024-09-18T02:07:59.936130+0000","last_peered":"2024-09-18T02:07:59.936130+0000","last_clean":"2024-09-18T02:07:59.936130+0000","last_became_active":"2024-09-18T02:04:01.564385+0000","last_became_peered":"2024-09-18T02:04:01.564385+0000","last_unstale":"2024-09-18T02:07:59.936130+0000","last_undegraded":"2024-09-18T02:07:59.936130+0000","last_fullsized":"2024-09-18T02:07:59.936130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-18T02:07:59.935730+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-18T02:07:59.935730+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.935730+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:04.466951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.305924+0000","last_change":"2024-09-18T02:08:15.305924+0000","last_active":"2024-09-18T02:08:15.305924+0000","last_peered":"2024-09-18T02:08:15.305924+0000","last_clean":"2024-09-18T02:08:15.305924+0000","last_became_active":"2024-09-18T02:04:03.600545+0000","last_became_peered":"2024-09-18T02:04:03.600545+0000","last_unstale":"2024-09-18T02:08:15.305924+0000","last_undegraded":"2024-09-18T02:08:15.305924+0000","last_fullsized":"2024-09-18T02:08:15.305924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-18T02:08:15.305656+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-18T02:08:15.305656+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.305656+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:37:09.015631+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":473,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.115885+0000","last_change":"2024-09-18T02:07:47.115885+0000","last_active":"2024-09-18T02:07:47.115885+0000","last_peered":"2024-09-18T02:07:47.115885+0000","last_clean":"2024-09-18T02:07:47.115885+0000","last_became_active":"2024-09-18T02:04:05.582127+0000","last_became_peered":"2024-09-18T02:04:05.582127+0000","last_unstale":"2024-09-18T02:07:47.115885+0000","last_undegraded":"2024-09-18T02:07:47.115885+0000","last_fullsized":"2024-09-18T02:07:47.115885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:47.115624+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:47.115624+0000","last_clean_scrub_stamp":"2024-09-18T02:07:47.115624+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:34:41.967979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.332802+0000","last_change":"2024-09-18T02:07:55.332802+0000","last_active":"2024-09-18T02:07:55.332802+0000","last_peered":"2024-09-18T02:07:55.332802+0000","last_clean":"2024-09-18T02:07:55.332802+0000","last_became_active":"2024-09-18T02:04:07.602985+0000","last_became_peered":"2024-09-18T02:04:07.602985+0000","last_unstale":"2024-09-18T02:07:55.332802+0000","last_undegraded":"2024-09-18T02:07:55.332802+0000","last_fullsized":"2024-09-18T02:07:55.332802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:07:55.332416+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:07:55.332416+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.332416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:19:15.933538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.726524+0000","last_change":"2024-09-18T02:08:09.726524+0000","last_active":"2024-09-18T02:08:09.726524+0000","last_peered":"2024-09-18T02:08:09.726524+0000","last_clean":"2024-09-18T02:08:09.726524+0000","last_became_active":"2024-09-18T02:03:59.554711+0000","last_became_peered":"2024-09-18T02:03:59.554711+0000","last_unstale":"2024-09-18T02:08:09.726524+0000","last_undegraded":"2024-09-18T02:08:09.726524+0000","last_fullsized":"2024-09-18T02:08:09.726524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:09.726257+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:09.726257+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.726257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:21:45.241040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996016+0000","last_change":"2024-09-18T02:03:57.531537+0000","last_active":"2024-09-18T02:07:47.996016+0000","last_peered":"2024-09-18T02:07:47.996016+0000","last_clean":"2024-09-18T02:07:47.996016+0000","last_became_active":"2024-09-18T02:03:57.531156+0000","last_became_peered":"2024-09-18T02:03:57.531156+0000","last_unstale":"2024-09-18T02:07:47.996016+0000","last_undegraded":"2024-09-18T02:07:47.996016+0000","last_fullsized":"2024-09-18T02:07:47.996016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.368784+0000","last_change":"2024-09-18T02:07:49.368784+0000","last_active":"2024-09-18T02:07:49.368784+0000","last_peered":"2024-09-18T02:07:49.368784+0000","last_clean":"2024-09-18T02:07:49.368784+0000","last_became_active":"2024-09-18T02:04:01.565999+0000","last_became_peered":"2024-09-18T02:04:01.565999+0000","last_unstale":"2024-09-18T02:07:49.368784+0000","last_undegraded":"2024-09-18T02:07:49.368784+0000","last_fullsized":"2024-09-18T02:07:49.368784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:49.368530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:49.368530+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.368530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:09.588349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'51","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.029622+0000","last_change":"2024-09-18T02:07:55.029622+0000","last_active":"2024-09-18T02:07:55.029622+0000","last_peered":"2024-09-18T02:07:55.029622+0000","last_clean":"2024-09-18T02:07:55.029622+0000","last_became_active":"2024-09-18T02:04:03.564021+0000","last_became_peered":"2024-09-18T02:04:03.564021+0000","last_unstale":"2024-09-18T02:07:55.029622+0000","last_undegraded":"2024-09-18T02:07:55.029622+0000","last_fullsized":"2024-09-18T02:07:55.029622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-18T02:07:55.029350+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-18T02:07:55.029350+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.029350+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:45.011710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.316073+0000","last_change":"2024-09-18T02:07:51.316073+0000","last_active":"2024-09-18T02:07:51.316073+0000","last_peered":"2024-09-18T02:07:51.316073+0000","last_clean":"2024-09-18T02:07:51.316073+0000","last_became_active":"2024-09-18T02:04:05.610024+0000","last_became_peered":"2024-09-18T02:04:05.610024+0000","last_unstale":"2024-09-18T02:07:51.316073+0000","last_undegraded":"2024-09-18T02:07:51.316073+0000","last_fullsized":"2024-09-18T02:07:51.316073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.315728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.315728+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.315728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:32.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.762277+0000","last_change":"2024-09-18T02:08:08.762277+0000","last_active":"2024-09-18T02:08:08.762277+0000","last_peered":"2024-09-18T02:08:08.762277+0000","last_clean":"2024-09-18T02:08:08.762277+0000","last_became_active":"2024-09-18T02:04:07.618153+0000","last_became_peered":"2024-09-18T02:04:07.618153+0000","last_unstale":"2024-09-18T02:08:08.762277+0000","last_undegraded":"2024-09-18T02:08:08.762277+0000","last_fullsized":"2024-09-18T02:08:08.762277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:08:08.762008+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:08:08.762008+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.762008+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:55.840421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.208888+0000","last_change":"2024-09-18T02:08:03.208888+0000","last_active":"2024-09-18T02:08:03.208888+0000","last_peered":"2024-09-18T02:08:03.208888+0000","last_clean":"2024-09-18T02:08:03.208888+0000","last_became_active":"2024-09-18T02:03:59.559592+0000","last_became_peered":"2024-09-18T02:03:59.559592+0000","last_unstale":"2024-09-18T02:08:03.208888+0000","last_undegraded":"2024-09-18T02:08:03.208888+0000","last_fullsized":"2024-09-18T02:08:03.208888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:03.208545+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:03.208545+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.208545+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:46:49.036536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":215,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.851810+0000","last_change":"2024-09-18T02:08:34.851896+0000","last_active":"2024-09-18T02:08:34.851810+0000","last_peered":"2024-09-18T02:08:34.851810+0000","last_clean":"2024-09-18T02:08:34.851810+0000","last_became_active":"2024-09-18T02:03:43.336731+0000","last_became_peered":"2024-09-18T02:03:43.336731+0000","last_unstale":"2024-09-18T02:08:34.851810+0000","last_undegraded":"2024-09-18T02:08:34.851810+0000","last_fullsized":"2024-09-18T02:08:34.851810+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-09-18T02:08:34.851600+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-09-18T02:08:34.851600+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.851600+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:35.341570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995860+0000","last_change":"2024-09-18T02:03:50.287984+0000","last_active":"2024-09-18T02:07:47.995860+0000","last_peered":"2024-09-18T02:07:47.995860+0000","last_clean":"2024-09-18T02:07:47.995860+0000","last_became_active":"2024-09-18T02:03:48.273444+0000","last_became_peered":"2024-09-18T02:03:48.273444+0000","last_unstale":"2024-09-18T02:07:47.995860+0000","last_undegraded":"2024-09-18T02:07:47.995860+0000","last_fullsized":"2024-09-18T02:07:47.995860+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024299339999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.543032+0000","last_change":"2024-09-18T02:08:37.543094+0000","last_active":"2024-09-18T02:08:37.543032+0000","last_peered":"2024-09-18T02:08:37.543032+0000","last_clean":"2024-09-18T02:08:37.543032+0000","last_became_active":"2024-09-18T02:03:57.532844+0000","last_became_peered":"2024-09-18T02:03:57.532844+0000","last_unstale":"2024-09-18T02:08:37.543032+0000","last_undegraded":"2024-09-18T02:08:37.543032+0000","last_fullsized":"2024-09-18T02:08:37.543032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:37.542821+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:37.542821+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.542821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:32.720689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.878096+0000","last_change":"2024-09-18T02:08:01.878096+0000","last_active":"2024-09-18T02:08:01.878096+0000","last_peered":"2024-09-18T02:08:01.878096+0000","last_clean":"2024-09-18T02:08:01.878096+0000","last_became_active":"2024-09-18T02:04:01.563633+0000","last_became_peered":"2024-09-18T02:04:01.563633+0000","last_unstale":"2024-09-18T02:08:01.878096+0000","last_undegraded":"2024-09-18T02:08:01.878096+0000","last_fullsized":"2024-09-18T02:08:01.878096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:01.877846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:01.877846+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.877846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:32.131376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'97","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.212941+0000","last_change":"2024-09-18T02:08:09.212941+0000","last_active":"2024-09-18T02:08:09.212941+0000","last_peered":"2024-09-18T02:08:09.212941+0000","last_clean":"2024-09-18T02:08:09.212941+0000","last_became_active":"2024-09-18T02:04:03.606800+0000","last_became_peered":"2024-09-18T02:04:03.606800+0000","last_unstale":"2024-09-18T02:08:09.212941+0000","last_undegraded":"2024-09-18T02:08:09.212941+0000","last_fullsized":"2024-09-18T02:08:09.212941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-09-18T02:08:09.212628+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-09-18T02:08:09.212628+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.212628+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:27:22.678145+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.275953+0000","last_change":"2024-09-18T02:07:50.275953+0000","last_active":"2024-09-18T02:07:50.275953+0000","last_peered":"2024-09-18T02:07:50.275953+0000","last_clean":"2024-09-18T02:07:50.275953+0000","last_became_active":"2024-09-18T02:04:05.588568+0000","last_became_peered":"2024-09-18T02:04:05.588568+0000","last_unstale":"2024-09-18T02:07:50.275953+0000","last_undegraded":"2024-09-18T02:07:50.275953+0000","last_fullsized":"2024-09-18T02:07:50.275953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:50.275701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:50.275701+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.275701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:23:16.843019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.289795+0000","last_change":"2024-09-18T02:08:07.289795+0000","last_active":"2024-09-18T02:08:07.289795+0000","last_peered":"2024-09-18T02:08:07.289795+0000","last_clean":"2024-09-18T02:08:07.289795+0000","last_became_active":"2024-09-18T02:04:07.613914+0000","last_became_peered":"2024-09-18T02:04:07.613914+0000","last_unstale":"2024-09-18T02:08:07.289795+0000","last_undegraded":"2024-09-18T02:08:07.289795+0000","last_fullsized":"2024-09-18T02:08:07.289795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-09-18T02:08:07.289548+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-09-18T02:08:07.289548+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.289548+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:11.820769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.239750+0000","last_change":"2024-09-18T02:08:23.239813+0000","last_active":"2024-09-18T02:08:23.239750+0000","last_peered":"2024-09-18T02:08:23.239750+0000","last_clean":"2024-09-18T02:08:23.239750+0000","last_became_active":"2024-09-18T02:03:59.555801+0000","last_became_peered":"2024-09-18T02:03:59.555801+0000","last_unstale":"2024-09-18T02:08:23.239750+0000","last_undegraded":"2024-09-18T02:08:23.239750+0000","last_fullsized":"2024-09-18T02:08:23.239750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.239523+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.239523+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.239523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:59.785045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995825+0000","last_change":"2024-09-18T02:03:50.285797+0000","last_active":"2024-09-18T02:07:47.995825+0000","last_peered":"2024-09-18T02:07:47.995825+0000","last_clean":"2024-09-18T02:07:47.995825+0000","last_became_active":"2024-09-18T02:03:48.275709+0000","last_became_peered":"2024-09-18T02:03:48.275709+0000","last_unstale":"2024-09-18T02:07:47.995825+0000","last_undegraded":"2024-09-18T02:07:47.995825+0000","last_fullsized":"2024-09-18T02:07:47.995825+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047579399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.852392+0000","last_change":"2024-09-18T02:08:36.852449+0000","last_active":"2024-09-18T02:08:36.852392+0000","last_peered":"2024-09-18T02:08:36.852392+0000","last_clean":"2024-09-18T02:08:36.852392+0000","last_became_active":"2024-09-18T02:03:57.520559+0000","last_became_peered":"2024-09-18T02:03:57.520559+0000","last_unstale":"2024-09-18T02:08:36.852392+0000","last_undegraded":"2024-09-18T02:08:36.852392+0000","last_fullsized":"2024-09-18T02:08:36.852392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:36.852193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:36.852193+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.852193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:13.004259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.201427+0000","last_change":"2024-09-18T02:07:55.201427+0000","last_active":"2024-09-18T02:07:55.201427+0000","last_peered":"2024-09-18T02:07:55.201427+0000","last_clean":"2024-09-18T02:07:55.201427+0000","last_became_active":"2024-09-18T02:04:01.561194+0000","last_became_peered":"2024-09-18T02:04:01.561194+0000","last_unstale":"2024-09-18T02:07:55.201427+0000","last_undegraded":"2024-09-18T02:07:55.201427+0000","last_fullsized":"2024-09-18T02:07:55.201427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:55.201180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:55.201180+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.201180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:25.554052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'297","reported_seq":530,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.127133+0000","last_change":"2024-09-18T02:07:51.127133+0000","last_active":"2024-09-18T02:07:51.127133+0000","last_peered":"2024-09-18T02:07:51.127133+0000","last_clean":"2024-09-18T02:07:51.127133+0000","last_became_active":"2024-09-18T02:04:03.570288+0000","last_became_peered":"2024-09-18T02:04:03.570288+0000","last_unstale":"2024-09-18T02:07:51.127133+0000","last_undegraded":"2024-09-18T02:07:51.127133+0000","last_fullsized":"2024-09-18T02:07:51.127133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'297","last_scrub_stamp":"2024-09-18T02:07:51.126820+0000","last_deep_scrub":"32'297","last_deep_scrub_stamp":"2024-09-18T02:07:51.126820+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.126820+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:09:07.313670+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.342738+0000","last_change":"2024-09-18T02:08:16.342738+0000","last_active":"2024-09-18T02:08:16.342738+0000","last_peered":"2024-09-18T02:08:16.342738+0000","last_clean":"2024-09-18T02:08:16.342738+0000","last_became_active":"2024-09-18T02:04:05.608544+0000","last_became_peered":"2024-09-18T02:04:05.608544+0000","last_unstale":"2024-09-18T02:08:16.342738+0000","last_undegraded":"2024-09-18T02:08:16.342738+0000","last_fullsized":"2024-09-18T02:08:16.342738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:16.342502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:16.342502+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.342502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:40.174283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.759186+0000","last_change":"2024-09-18T02:08:44.759249+0000","last_active":"2024-09-18T02:08:44.759186+0000","last_peered":"2024-09-18T02:08:44.759186+0000","last_clean":"2024-09-18T02:08:44.759186+0000","last_became_active":"2024-09-18T02:04:07.622337+0000","last_became_peered":"2024-09-18T02:04:07.622337+0000","last_unstale":"2024-09-18T02:08:44.759186+0000","last_undegraded":"2024-09-18T02:08:44.759186+0000","last_fullsized":"2024-09-18T02:08:44.759186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:08:44.758988+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:08:44.758988+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.758988+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:09.132745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.960512+0000","last_change":"2024-09-18T02:08:30.960574+0000","last_active":"2024-09-18T02:08:30.960512+0000","last_peered":"2024-09-18T02:08:30.960512+0000","last_clean":"2024-09-18T02:08:30.960512+0000","last_became_active":"2024-09-18T02:03:59.548308+0000","last_became_peered":"2024-09-18T02:03:59.548308+0000","last_unstale":"2024-09-18T02:08:30.960512+0000","last_undegraded":"2024-09-18T02:08:30.960512+0000","last_fullsized":"2024-09-18T02:08:30.960512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:30.960318+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:30.960318+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.960318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:16.857267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.300930+0000","last_change":"2024-09-18T02:08:29.300994+0000","last_active":"2024-09-18T02:08:29.300930+0000","last_peered":"2024-09-18T02:08:29.300930+0000","last_clean":"2024-09-18T02:08:29.300930+0000","last_became_active":"2024-09-18T02:03:48.275609+0000","last_became_peered":"2024-09-18T02:03:48.275609+0000","last_unstale":"2024-09-18T02:08:29.300930+0000","last_undegraded":"2024-09-18T02:08:29.300930+0000","last_fullsized":"2024-09-18T02:08:29.300930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:29.300685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:29.300685+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.300685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:56.209898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067244799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.874727+0000","last_change":"2024-09-18T02:08:35.874800+0000","last_active":"2024-09-18T02:08:35.874727+0000","last_peered":"2024-09-18T02:08:35.874727+0000","last_clean":"2024-09-18T02:08:35.874727+0000","last_became_active":"2024-09-18T02:03:57.520103+0000","last_became_peered":"2024-09-18T02:03:57.520103+0000","last_unstale":"2024-09-18T02:08:35.874727+0000","last_undegraded":"2024-09-18T02:08:35.874727+0000","last_fullsized":"2024-09-18T02:08:35.874727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:35.874487+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:35.874487+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.874487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:33.947180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.304457+0000","last_change":"2024-09-18T02:08:12.304457+0000","last_active":"2024-09-18T02:08:12.304457+0000","last_peered":"2024-09-18T02:08:12.304457+0000","last_clean":"2024-09-18T02:08:12.304457+0000","last_became_active":"2024-09-18T02:04:01.560471+0000","last_became_peered":"2024-09-18T02:04:01.560471+0000","last_unstale":"2024-09-18T02:08:12.304457+0000","last_undegraded":"2024-09-18T02:08:12.304457+0000","last_fullsized":"2024-09-18T02:08:12.304457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:12.304176+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:12.304176+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.304176+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:41:55.150843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'24","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.320487+0000","last_change":"2024-09-18T02:07:57.320487+0000","last_active":"2024-09-18T02:07:57.320487+0000","last_peered":"2024-09-18T02:07:57.320487+0000","last_clean":"2024-09-18T02:07:57.320487+0000","last_became_active":"2024-09-18T02:04:03.588913+0000","last_became_peered":"2024-09-18T02:04:03.588913+0000","last_unstale":"2024-09-18T02:07:57.320487+0000","last_undegraded":"2024-09-18T02:07:57.320487+0000","last_fullsized":"2024-09-18T02:07:57.320487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-18T02:07:57.320158+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-18T02:07:57.320158+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.320158+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:35.687439+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.317671+0000","last_change":"2024-09-18T02:07:49.317671+0000","last_active":"2024-09-18T02:07:49.317671+0000","last_peered":"2024-09-18T02:07:49.317671+0000","last_clean":"2024-09-18T02:07:49.317671+0000","last_became_active":"2024-09-18T02:04:05.588457+0000","last_became_peered":"2024-09-18T02:04:05.588457+0000","last_unstale":"2024-09-18T02:07:49.317671+0000","last_undegraded":"2024-09-18T02:07:49.317671+0000","last_fullsized":"2024-09-18T02:07:49.317671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:49.317338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:49.317338+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.317338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:39.956466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.998699+0000","last_change":"2024-09-18T02:04:07.622460+0000","last_active":"2024-09-18T02:07:47.998699+0000","last_peered":"2024-09-18T02:07:47.998699+0000","last_clean":"2024-09-18T02:07:47.998699+0000","last_became_active":"2024-09-18T02:04:07.621651+0000","last_became_peered":"2024-09-18T02:04:07.621651+0000","last_unstale":"2024-09-18T02:07:47.998699+0000","last_undegraded":"2024-09-18T02:07:47.998699+0000","last_fullsized":"2024-09-18T02:07:47.998699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.115264+0000","last_change":"2024-09-18T02:08:19.115318+0000","last_active":"2024-09-18T02:08:19.115264+0000","last_peered":"2024-09-18T02:08:19.115264+0000","last_clean":"2024-09-18T02:08:19.115264+0000","last_became_active":"2024-09-18T02:03:59.535693+0000","last_became_peered":"2024-09-18T02:03:59.535693+0000","last_unstale":"2024-09-18T02:08:19.115264+0000","last_undegraded":"2024-09-18T02:08:19.115264+0000","last_fullsized":"2024-09-18T02:08:19.115264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:19.115076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:19.115076+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.115076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:46.024290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995847+0000","last_change":"2024-09-18T02:03:50.287790+0000","last_active":"2024-09-18T02:07:47.995847+0000","last_peered":"2024-09-18T02:07:47.995847+0000","last_clean":"2024-09-18T02:07:47.995847+0000","last_became_active":"2024-09-18T02:03:48.276543+0000","last_became_peered":"2024-09-18T02:03:48.276543+0000","last_unstale":"2024-09-18T02:07:47.995847+0000","last_undegraded":"2024-09-18T02:07:47.995847+0000","last_fullsized":"2024-09-18T02:07:47.995847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023330579999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.200087+0000","last_change":"2024-09-18T02:08:20.200139+0000","last_active":"2024-09-18T02:08:20.200087+0000","last_peered":"2024-09-18T02:08:20.200087+0000","last_clean":"2024-09-18T02:08:20.200087+0000","last_became_active":"2024-09-18T02:03:57.528828+0000","last_became_peered":"2024-09-18T02:03:57.528828+0000","last_unstale":"2024-09-18T02:08:20.200087+0000","last_undegraded":"2024-09-18T02:08:20.200087+0000","last_fullsized":"2024-09-18T02:08:20.200087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.199864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.199864+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.199864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:12.451245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.216748+0000","last_change":"2024-09-18T02:08:04.216748+0000","last_active":"2024-09-18T02:08:04.216748+0000","last_peered":"2024-09-18T02:08:04.216748+0000","last_clean":"2024-09-18T02:08:04.216748+0000","last_became_active":"2024-09-18T02:04:01.571608+0000","last_became_peered":"2024-09-18T02:04:01.571608+0000","last_unstale":"2024-09-18T02:08:04.216748+0000","last_undegraded":"2024-09-18T02:08:04.216748+0000","last_fullsized":"2024-09-18T02:08:04.216748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:04.216468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:04.216468+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.216468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:07:30.815787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.228198+0000","last_change":"2024-09-18T02:08:13.228198+0000","last_active":"2024-09-18T02:08:13.228198+0000","last_peered":"2024-09-18T02:08:13.228198+0000","last_clean":"2024-09-18T02:08:13.228198+0000","last_became_active":"2024-09-18T02:04:03.601140+0000","last_became_peered":"2024-09-18T02:04:03.601140+0000","last_unstale":"2024-09-18T02:08:13.228198+0000","last_undegraded":"2024-09-18T02:08:13.228198+0000","last_fullsized":"2024-09-18T02:08:13.228198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-18T02:08:13.227917+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-18T02:08:13.227917+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.227917+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:13.717888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.268741+0000","last_change":"2024-09-18T02:08:20.268741+0000","last_active":"2024-09-18T02:08:20.268741+0000","last_peered":"2024-09-18T02:08:20.268741+0000","last_clean":"2024-09-18T02:08:20.268741+0000","last_became_active":"2024-09-18T02:04:05.612007+0000","last_became_peered":"2024-09-18T02:04:05.612007+0000","last_unstale":"2024-09-18T02:08:20.268741+0000","last_undegraded":"2024-09-18T02:08:20.268741+0000","last_fullsized":"2024-09-18T02:08:20.268741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.268474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.268474+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.268474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:28.013086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.802920+0000","last_change":"2024-09-18T02:08:43.802986+0000","last_active":"2024-09-18T02:08:43.802920+0000","last_peered":"2024-09-18T02:08:43.802920+0000","last_clean":"2024-09-18T02:08:43.802920+0000","last_became_active":"2024-09-18T02:04:07.622247+0000","last_became_peered":"2024-09-18T02:04:07.622247+0000","last_unstale":"2024-09-18T02:08:43.802920+0000","last_undegraded":"2024-09-18T02:08:43.802920+0000","last_fullsized":"2024-09-18T02:08:43.802920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:43.802726+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:43.802726+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.802726+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:20.348248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.783157+0000","last_change":"2024-09-18T02:08:06.783157+0000","last_active":"2024-09-18T02:08:06.783157+0000","last_peered":"2024-09-18T02:08:06.783157+0000","last_clean":"2024-09-18T02:08:06.783157+0000","last_became_active":"2024-09-18T02:03:59.559749+0000","last_became_peered":"2024-09-18T02:03:59.559749+0000","last_unstale":"2024-09-18T02:08:06.783157+0000","last_undegraded":"2024-09-18T02:08:06.783157+0000","last_fullsized":"2024-09-18T02:08:06.783157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:06.782905+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:06.782905+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.782905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:21:01.786933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.329691+0000","last_change":"2024-09-18T02:08:28.329750+0000","last_active":"2024-09-18T02:08:28.329691+0000","last_peered":"2024-09-18T02:08:28.329691+0000","last_clean":"2024-09-18T02:08:28.329691+0000","last_became_active":"2024-09-18T02:03:57.519961+0000","last_became_peered":"2024-09-18T02:03:57.519961+0000","last_unstale":"2024-09-18T02:08:28.329691+0000","last_undegraded":"2024-09-18T02:08:28.329691+0000","last_fullsized":"2024-09-18T02:08:28.329691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:28.329487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:28.329487+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.329487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:04.583889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.904522+0000","last_change":"2024-09-18T02:08:33.904577+0000","last_active":"2024-09-18T02:08:33.904522+0000","last_peered":"2024-09-18T02:08:33.904522+0000","last_clean":"2024-09-18T02:08:33.904522+0000","last_became_active":"2024-09-18T02:03:48.274657+0000","last_became_peered":"2024-09-18T02:03:48.274657+0000","last_unstale":"2024-09-18T02:08:33.904522+0000","last_undegraded":"2024-09-18T02:08:33.904522+0000","last_fullsized":"2024-09-18T02:08:33.904522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:33.904329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:33.904329+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.904329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:37:27.614303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000970169,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.206497+0000","last_change":"2024-09-18T02:08:05.206497+0000","last_active":"2024-09-18T02:08:05.206497+0000","last_peered":"2024-09-18T02:08:05.206497+0000","last_clean":"2024-09-18T02:08:05.206497+0000","last_became_active":"2024-09-18T02:04:01.571443+0000","last_became_peered":"2024-09-18T02:04:01.571443+0000","last_unstale":"2024-09-18T02:08:05.206497+0000","last_undegraded":"2024-09-18T02:08:05.206497+0000","last_fullsized":"2024-09-18T02:08:05.206497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:05.206220+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:05.206220+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.206220+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:45:50.192588+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'90","reported_seq":179,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.219597+0000","last_change":"2024-09-18T02:08:02.219597+0000","last_active":"2024-09-18T02:08:02.219597+0000","last_peered":"2024-09-18T02:08:02.219597+0000","last_clean":"2024-09-18T02:08:02.219597+0000","last_became_active":"2024-09-18T02:04:03.569938+0000","last_became_peered":"2024-09-18T02:04:03.569938+0000","last_unstale":"2024-09-18T02:08:02.219597+0000","last_undegraded":"2024-09-18T02:08:02.219597+0000","last_fullsized":"2024-09-18T02:08:02.219597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-09-18T02:08:02.219300+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-09-18T02:08:02.219300+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.219300+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:38.149380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.352767+0000","last_change":"2024-09-18T02:07:52.352767+0000","last_active":"2024-09-18T02:07:52.352767+0000","last_peered":"2024-09-18T02:07:52.352767+0000","last_clean":"2024-09-18T02:07:52.352767+0000","last_became_active":"2024-09-18T02:04:05.597181+0000","last_became_peered":"2024-09-18T02:04:05.597181+0000","last_unstale":"2024-09-18T02:07:52.352767+0000","last_undegraded":"2024-09-18T02:07:52.352767+0000","last_fullsized":"2024-09-18T02:07:52.352767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:52.352475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:52.352475+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.352475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:51:22.983509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.732465+0000","last_change":"2024-09-18T02:08:44.732531+0000","last_active":"2024-09-18T02:08:44.732465+0000","last_peered":"2024-09-18T02:08:44.732465+0000","last_clean":"2024-09-18T02:08:44.732465+0000","last_became_active":"2024-09-18T02:04:07.618751+0000","last_became_peered":"2024-09-18T02:04:07.618751+0000","last_unstale":"2024-09-18T02:08:44.732465+0000","last_undegraded":"2024-09-18T02:08:44.732465+0000","last_fullsized":"2024-09-18T02:08:44.732465+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-18T02:08:44.732277+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-18T02:08:44.732277+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.732277+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:19:46.289450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.681556+0000","last_change":"2024-09-18T02:08:14.681691+0000","last_active":"2024-09-18T02:08:14.681556+0000","last_peered":"2024-09-18T02:08:14.681556+0000","last_clean":"2024-09-18T02:08:14.681556+0000","last_became_active":"2024-09-18T02:03:59.553619+0000","last_became_peered":"2024-09-18T02:03:59.553619+0000","last_unstale":"2024-09-18T02:08:14.681556+0000","last_undegraded":"2024-09-18T02:08:14.681556+0000","last_fullsized":"2024-09-18T02:08:14.681556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:14.681214+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:14.681214+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.681214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:48.991814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.895974+0000","last_change":"2024-09-18T02:08:34.896041+0000","last_active":"2024-09-18T02:08:34.895974+0000","last_peered":"2024-09-18T02:08:34.895974+0000","last_clean":"2024-09-18T02:08:34.895974+0000","last_became_active":"2024-09-18T02:03:57.518503+0000","last_became_peered":"2024-09-18T02:03:57.518503+0000","last_unstale":"2024-09-18T02:08:34.895974+0000","last_undegraded":"2024-09-18T02:08:34.895974+0000","last_fullsized":"2024-09-18T02:08:34.895974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:34.895751+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:34.895751+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.895751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:58.727532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995877+0000","last_change":"2024-09-18T02:03:50.288345+0000","last_active":"2024-09-18T02:07:47.995877+0000","last_peered":"2024-09-18T02:07:47.995877+0000","last_clean":"2024-09-18T02:07:47.995877+0000","last_became_active":"2024-09-18T02:03:48.276300+0000","last_became_peered":"2024-09-18T02:03:48.276300+0000","last_unstale":"2024-09-18T02:07:47.995877+0000","last_undegraded":"2024-09-18T02:07:47.995877+0000","last_fullsized":"2024-09-18T02:07:47.995877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002788245,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.199897+0000","last_change":"2024-09-18T02:08:01.199897+0000","last_active":"2024-09-18T02:08:01.199897+0000","last_peered":"2024-09-18T02:08:01.199897+0000","last_clean":"2024-09-18T02:08:01.199897+0000","last_became_active":"2024-09-18T02:04:01.557570+0000","last_became_peered":"2024-09-18T02:04:01.557570+0000","last_unstale":"2024-09-18T02:08:01.199897+0000","last_undegraded":"2024-09-18T02:08:01.199897+0000","last_fullsized":"2024-09-18T02:08:01.199897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:01.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:01.199648+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:22.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'28","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.127859+0000","last_change":"2024-09-18T02:07:48.127859+0000","last_active":"2024-09-18T02:07:48.127859+0000","last_peered":"2024-09-18T02:07:48.127859+0000","last_clean":"2024-09-18T02:07:48.127859+0000","last_became_active":"2024-09-18T02:04:03.588539+0000","last_became_peered":"2024-09-18T02:04:03.588539+0000","last_unstale":"2024-09-18T02:07:48.127859+0000","last_undegraded":"2024-09-18T02:07:48.127859+0000","last_fullsized":"2024-09-18T02:07:48.127859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-09-18T02:07:48.127557+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-09-18T02:07:48.127557+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.127557+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:55:43.485970+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.149355+0000","last_change":"2024-09-18T02:07:49.149355+0000","last_active":"2024-09-18T02:07:49.149355+0000","last_peered":"2024-09-18T02:07:49.149355+0000","last_clean":"2024-09-18T02:07:49.149355+0000","last_became_active":"2024-09-18T02:04:05.582477+0000","last_became_peered":"2024-09-18T02:04:05.582477+0000","last_unstale":"2024-09-18T02:07:49.149355+0000","last_undegraded":"2024-09-18T02:07:49.149355+0000","last_fullsized":"2024-09-18T02:07:49.149355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:49.149087+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:49.149087+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.149087+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:13.463449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.295297+0000","last_change":"2024-09-18T02:08:28.295297+0000","last_active":"2024-09-18T02:08:28.295297+0000","last_peered":"2024-09-18T02:08:28.295297+0000","last_clean":"2024-09-18T02:08:28.295297+0000","last_became_active":"2024-09-18T02:04:07.605591+0000","last_became_peered":"2024-09-18T02:04:07.605591+0000","last_unstale":"2024-09-18T02:08:28.295297+0000","last_undegraded":"2024-09-18T02:08:28.295297+0000","last_fullsized":"2024-09-18T02:08:28.295297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:28.295047+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:28.295047+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.295047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:36:50.563195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.280299+0000","last_change":"2024-09-18T02:08:19.280466+0000","last_active":"2024-09-18T02:08:19.280299+0000","last_peered":"2024-09-18T02:08:19.280299+0000","last_clean":"2024-09-18T02:08:19.280299+0000","last_became_active":"2024-09-18T02:03:59.559044+0000","last_became_peered":"2024-09-18T02:03:59.559044+0000","last_unstale":"2024-09-18T02:08:19.280299+0000","last_undegraded":"2024-09-18T02:08:19.280299+0000","last_fullsized":"2024-09-18T02:08:19.280299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:19.280064+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:19.280064+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.280064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:03.804854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996083+0000","last_change":"2024-09-18T02:03:57.522060+0000","last_active":"2024-09-18T02:07:47.996083+0000","last_peered":"2024-09-18T02:07:47.996083+0000","last_clean":"2024-09-18T02:07:47.996083+0000","last_became_active":"2024-09-18T02:03:57.521706+0000","last_became_peered":"2024-09-18T02:03:57.521706+0000","last_unstale":"2024-09-18T02:07:47.996083+0000","last_undegraded":"2024-09-18T02:07:47.996083+0000","last_fullsized":"2024-09-18T02:07:47.996083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.924188+0000","last_change":"2024-09-18T02:08:32.924244+0000","last_active":"2024-09-18T02:08:32.924188+0000","last_peered":"2024-09-18T02:08:32.924188+0000","last_clean":"2024-09-18T02:08:32.924188+0000","last_became_active":"2024-09-18T02:03:48.274030+0000","last_became_peered":"2024-09-18T02:03:48.274030+0000","last_unstale":"2024-09-18T02:08:32.924188+0000","last_undegraded":"2024-09-18T02:08:32.924188+0000","last_fullsized":"2024-09-18T02:08:32.924188+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:32.923996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:32.923996+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.923996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:19.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011092910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.183292+0000","last_change":"2024-09-18T02:07:59.183292+0000","last_active":"2024-09-18T02:07:59.183292+0000","last_peered":"2024-09-18T02:07:59.183292+0000","last_clean":"2024-09-18T02:07:59.183292+0000","last_became_active":"2024-09-18T02:04:01.558915+0000","last_became_peered":"2024-09-18T02:04:01.558915+0000","last_unstale":"2024-09-18T02:07:59.183292+0000","last_undegraded":"2024-09-18T02:07:59.183292+0000","last_fullsized":"2024-09-18T02:07:59.183292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:59.183052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:59.183052+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.183052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:35.437454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.328507+0000","last_change":"2024-09-18T02:07:52.328507+0000","last_active":"2024-09-18T02:07:52.328507+0000","last_peered":"2024-09-18T02:07:52.328507+0000","last_clean":"2024-09-18T02:07:52.328507+0000","last_became_active":"2024-09-18T02:04:03.591378+0000","last_became_peered":"2024-09-18T02:04:03.591378+0000","last_unstale":"2024-09-18T02:07:52.328507+0000","last_undegraded":"2024-09-18T02:07:52.328507+0000","last_fullsized":"2024-09-18T02:07:52.328507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-18T02:07:52.328188+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-18T02:07:52.328188+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.328188+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:26.638787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.282096+0000","last_change":"2024-09-18T02:07:55.282096+0000","last_active":"2024-09-18T02:07:55.282096+0000","last_peered":"2024-09-18T02:07:55.282096+0000","last_clean":"2024-09-18T02:07:55.282096+0000","last_became_active":"2024-09-18T02:04:05.605265+0000","last_became_peered":"2024-09-18T02:04:05.605265+0000","last_unstale":"2024-09-18T02:07:55.282096+0000","last_undegraded":"2024-09-18T02:07:55.282096+0000","last_fullsized":"2024-09-18T02:07:55.282096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:55.281840+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:55.281840+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.281840+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:15.115042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.109871+0000","last_change":"2024-09-18T02:04:07.624755+0000","last_active":"2024-09-18T02:07:47.109871+0000","last_peered":"2024-09-18T02:07:47.109871+0000","last_clean":"2024-09-18T02:07:47.109871+0000","last_became_active":"2024-09-18T02:04:07.624085+0000","last_became_peered":"2024-09-18T02:04:07.624085+0000","last_unstale":"2024-09-18T02:07:47.109871+0000","last_undegraded":"2024-09-18T02:07:47.109871+0000","last_fullsized":"2024-09-18T02:07:47.109871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.250825+0000","last_change":"2024-09-18T02:08:15.250887+0000","last_active":"2024-09-18T02:08:15.250825+0000","last_peered":"2024-09-18T02:08:15.250825+0000","last_clean":"2024-09-18T02:08:15.250825+0000","last_became_active":"2024-09-18T02:03:59.535266+0000","last_became_peered":"2024-09-18T02:03:59.535266+0000","last_unstale":"2024-09-18T02:08:15.250825+0000","last_undegraded":"2024-09-18T02:08:15.250825+0000","last_fullsized":"2024-09-18T02:08:15.250825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:15.250637+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:15.250637+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.250637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:15.097705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.764764+0000","last_change":"2024-09-18T02:08:23.764827+0000","last_active":"2024-09-18T02:08:23.764764+0000","last_peered":"2024-09-18T02:08:23.764764+0000","last_clean":"2024-09-18T02:08:23.764764+0000","last_became_active":"2024-09-18T02:03:57.528676+0000","last_became_peered":"2024-09-18T02:03:57.528676+0000","last_unstale":"2024-09-18T02:08:23.764764+0000","last_undegraded":"2024-09-18T02:08:23.764764+0000","last_fullsized":"2024-09-18T02:08:23.764764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:23.764549+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:23.764549+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.764549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:45.428464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.995958+0000","last_change":"2024-09-18T02:03:50.288611+0000","last_active":"2024-09-18T02:07:47.995958+0000","last_peered":"2024-09-18T02:07:47.995958+0000","last_clean":"2024-09-18T02:07:47.995958+0000","last_became_active":"2024-09-18T02:03:48.396609+0000","last_became_peered":"2024-09-18T02:03:48.396609+0000","last_unstale":"2024-09-18T02:07:47.995958+0000","last_undegraded":"2024-09-18T02:07:47.995958+0000","last_fullsized":"2024-09-18T02:07:47.995958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:47.257322+0000","last_clean_scrub_stamp":"2024-09-18T02:03:47.257322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025902970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.230746+0000","last_change":"2024-09-18T02:07:54.230746+0000","last_active":"2024-09-18T02:07:54.230746+0000","last_peered":"2024-09-18T02:07:54.230746+0000","last_clean":"2024-09-18T02:07:54.230746+0000","last_became_active":"2024-09-18T02:04:01.561488+0000","last_became_peered":"2024-09-18T02:04:01.561488+0000","last_unstale":"2024-09-18T02:07:54.230746+0000","last_undegraded":"2024-09-18T02:07:54.230746+0000","last_fullsized":"2024-09-18T02:07:54.230746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.230358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.230358+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.230358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:40.139193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'103","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.275633+0000","last_change":"2024-09-18T02:07:58.275633+0000","last_active":"2024-09-18T02:07:58.275633+0000","last_peered":"2024-09-18T02:07:58.275633+0000","last_clean":"2024-09-18T02:07:58.275633+0000","last_became_active":"2024-09-18T02:04:03.585879+0000","last_became_peered":"2024-09-18T02:04:03.585879+0000","last_unstale":"2024-09-18T02:07:58.275633+0000","last_undegraded":"2024-09-18T02:07:58.275633+0000","last_fullsized":"2024-09-18T02:07:58.275633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'103","last_scrub_stamp":"2024-09-18T02:07:58.275354+0000","last_deep_scrub":"32'103","last_deep_scrub_stamp":"2024-09-18T02:07:58.275354+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.275354+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:34:23.917223+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.300909+0000","last_change":"2024-09-18T02:07:48.300909+0000","last_active":"2024-09-18T02:07:48.300909+0000","last_peered":"2024-09-18T02:07:48.300909+0000","last_clean":"2024-09-18T02:07:48.300909+0000","last_became_active":"2024-09-18T02:04:05.588676+0000","last_became_peered":"2024-09-18T02:04:05.588676+0000","last_unstale":"2024-09-18T02:07:48.300909+0000","last_undegraded":"2024-09-18T02:07:48.300909+0000","last_fullsized":"2024-09-18T02:07:48.300909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.300757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.300757+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.300757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:52:41.278180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.274232+0000","last_change":"2024-09-18T02:07:59.274232+0000","last_active":"2024-09-18T02:07:59.274232+0000","last_peered":"2024-09-18T02:07:59.274232+0000","last_clean":"2024-09-18T02:07:59.274232+0000","last_became_active":"2024-09-18T02:04:07.619587+0000","last_became_peered":"2024-09-18T02:04:07.619587+0000","last_unstale":"2024-09-18T02:07:59.274232+0000","last_undegraded":"2024-09-18T02:07:59.274232+0000","last_fullsized":"2024-09-18T02:07:59.274232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:07:59.273974+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:07:59.273974+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.273974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:10.696295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.299098+0000","last_change":"2024-09-18T02:08:03.299098+0000","last_active":"2024-09-18T02:08:03.299098+0000","last_peered":"2024-09-18T02:08:03.299098+0000","last_clean":"2024-09-18T02:08:03.299098+0000","last_became_active":"2024-09-18T02:04:07.626396+0000","last_became_peered":"2024-09-18T02:04:07.626396+0000","last_unstale":"2024-09-18T02:08:03.299098+0000","last_undegraded":"2024-09-18T02:08:03.299098+0000","last_fullsized":"2024-09-18T02:08:03.299098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:03.298850+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:03.298850+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.298850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:43:53.827265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.214400+0000","last_change":"2024-09-18T02:08:23.214400+0000","last_active":"2024-09-18T02:08:23.214400+0000","last_peered":"2024-09-18T02:08:23.214400+0000","last_clean":"2024-09-18T02:08:23.214400+0000","last_became_active":"2024-09-18T02:03:59.538280+0000","last_became_peered":"2024-09-18T02:03:59.538280+0000","last_unstale":"2024-09-18T02:08:23.214400+0000","last_undegraded":"2024-09-18T02:08:23.214400+0000","last_fullsized":"2024-09-18T02:08:23.214400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.214126+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.214126+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.214126+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:36.362222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996335+0000","last_change":"2024-09-18T02:03:57.531366+0000","last_active":"2024-09-18T02:07:47.996335+0000","last_peered":"2024-09-18T02:07:47.996335+0000","last_clean":"2024-09-18T02:07:47.996335+0000","last_became_active":"2024-09-18T02:03:57.530751+0000","last_became_peered":"2024-09-18T02:03:57.530751+0000","last_unstale":"2024-09-18T02:07:47.996335+0000","last_undegraded":"2024-09-18T02:07:47.996335+0000","last_fullsized":"2024-09-18T02:07:47.996335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.781701+0000","last_change":"2024-09-18T02:08:05.781701+0000","last_active":"2024-09-18T02:08:05.781701+0000","last_peered":"2024-09-18T02:08:05.781701+0000","last_clean":"2024-09-18T02:08:05.781701+0000","last_became_active":"2024-09-18T02:04:01.561230+0000","last_became_peered":"2024-09-18T02:04:01.561230+0000","last_unstale":"2024-09-18T02:08:05.781701+0000","last_undegraded":"2024-09-18T02:08:05.781701+0000","last_fullsized":"2024-09-18T02:08:05.781701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:05.781451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:05.781451+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.781451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:05.813452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'47","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.175717+0000","last_change":"2024-09-18T02:07:58.175717+0000","last_active":"2024-09-18T02:07:58.175717+0000","last_peered":"2024-09-18T02:07:58.175717+0000","last_clean":"2024-09-18T02:07:58.175717+0000","last_became_active":"2024-09-18T02:04:03.595284+0000","last_became_peered":"2024-09-18T02:04:03.595284+0000","last_unstale":"2024-09-18T02:07:58.175717+0000","last_undegraded":"2024-09-18T02:07:58.175717+0000","last_fullsized":"2024-09-18T02:07:58.175717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-18T02:07:58.175442+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-18T02:07:58.175442+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.175442+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:34.582776+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.235985+0000","last_change":"2024-09-18T02:08:06.235985+0000","last_active":"2024-09-18T02:08:06.235985+0000","last_peered":"2024-09-18T02:08:06.235985+0000","last_clean":"2024-09-18T02:08:06.235985+0000","last_became_active":"2024-09-18T02:04:05.602528+0000","last_became_peered":"2024-09-18T02:04:05.602528+0000","last_unstale":"2024-09-18T02:08:06.235985+0000","last_undegraded":"2024-09-18T02:08:06.235985+0000","last_fullsized":"2024-09-18T02:08:06.235985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:06.235742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:06.235742+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.235742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:35:36.200312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:46.660172+0000","last_change":"2024-09-18T02:04:07.623315+0000","last_active":"2024-09-18T02:07:46.660172+0000","last_peered":"2024-09-18T02:07:46.660172+0000","last_clean":"2024-09-18T02:07:46.660172+0000","last_became_active":"2024-09-18T02:04:07.622753+0000","last_became_peered":"2024-09-18T02:04:07.622753+0000","last_unstale":"2024-09-18T02:07:46.660172+0000","last_undegraded":"2024-09-18T02:07:46.660172+0000","last_fullsized":"2024-09-18T02:07:46.660172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.791428+0000","last_change":"2024-09-18T02:08:07.791428+0000","last_active":"2024-09-18T02:08:07.791428+0000","last_peered":"2024-09-18T02:08:07.791428+0000","last_clean":"2024-09-18T02:08:07.791428+0000","last_became_active":"2024-09-18T02:03:59.554803+0000","last_became_peered":"2024-09-18T02:03:59.554803+0000","last_unstale":"2024-09-18T02:08:07.791428+0000","last_undegraded":"2024-09-18T02:08:07.791428+0000","last_fullsized":"2024-09-18T02:08:07.791428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:07.791070+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:07.791070+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.791070+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:07.638138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.306572+0000","last_change":"2024-09-18T02:08:32.306675+0000","last_active":"2024-09-18T02:08:32.306572+0000","last_peered":"2024-09-18T02:08:32.306572+0000","last_clean":"2024-09-18T02:08:32.306572+0000","last_became_active":"2024-09-18T02:03:57.519403+0000","last_became_peered":"2024-09-18T02:03:57.519403+0000","last_unstale":"2024-09-18T02:08:32.306572+0000","last_undegraded":"2024-09-18T02:08:32.306572+0000","last_fullsized":"2024-09-18T02:08:32.306572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:32.306349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:32.306349+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.306349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:18.134340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.195649+0000","last_change":"2024-09-18T02:07:57.195649+0000","last_active":"2024-09-18T02:07:57.195649+0000","last_peered":"2024-09-18T02:07:57.195649+0000","last_clean":"2024-09-18T02:07:57.195649+0000","last_became_active":"2024-09-18T02:04:01.558788+0000","last_became_peered":"2024-09-18T02:04:01.558788+0000","last_unstale":"2024-09-18T02:07:57.195649+0000","last_undegraded":"2024-09-18T02:07:57.195649+0000","last_fullsized":"2024-09-18T02:07:57.195649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:57.195366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:57.195366+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.195366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:25.351307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.260300+0000","last_change":"2024-09-18T02:07:57.260300+0000","last_active":"2024-09-18T02:07:57.260300+0000","last_peered":"2024-09-18T02:07:57.260300+0000","last_clean":"2024-09-18T02:07:57.260300+0000","last_became_active":"2024-09-18T02:04:03.581045+0000","last_became_peered":"2024-09-18T02:04:03.581045+0000","last_unstale":"2024-09-18T02:07:57.260300+0000","last_undegraded":"2024-09-18T02:07:57.260300+0000","last_fullsized":"2024-09-18T02:07:57.260300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:07:57.259885+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:07:57.259885+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.259885+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:36.754049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.344690+0000","last_change":"2024-09-18T02:07:53.344690+0000","last_active":"2024-09-18T02:07:53.344690+0000","last_peered":"2024-09-18T02:07:53.344690+0000","last_clean":"2024-09-18T02:07:53.344690+0000","last_became_active":"2024-09-18T02:04:05.599064+0000","last_became_peered":"2024-09-18T02:04:05.599064+0000","last_unstale":"2024-09-18T02:07:53.344690+0000","last_undegraded":"2024-09-18T02:07:53.344690+0000","last_fullsized":"2024-09-18T02:07:53.344690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.344462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.344462+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.344462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:17:03.855166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.828168+0000","last_change":"2024-09-18T02:08:41.828227+0000","last_active":"2024-09-18T02:08:41.828168+0000","last_peered":"2024-09-18T02:08:41.828168+0000","last_clean":"2024-09-18T02:08:41.828168+0000","last_became_active":"2024-09-18T02:04:07.609954+0000","last_became_peered":"2024-09-18T02:04:07.609954+0000","last_unstale":"2024-09-18T02:08:41.828168+0000","last_undegraded":"2024-09-18T02:08:41.828168+0000","last_fullsized":"2024-09-18T02:08:41.828168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:41.827965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:41.827965+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.827965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:18.373487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.117771+0000","last_change":"2024-09-18T02:08:16.117771+0000","last_active":"2024-09-18T02:08:16.117771+0000","last_peered":"2024-09-18T02:08:16.117771+0000","last_clean":"2024-09-18T02:08:16.117771+0000","last_became_active":"2024-09-18T02:03:59.549791+0000","last_became_peered":"2024-09-18T02:03:59.549791+0000","last_unstale":"2024-09-18T02:08:16.117771+0000","last_undegraded":"2024-09-18T02:08:16.117771+0000","last_fullsized":"2024-09-18T02:08:16.117771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:16.117501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:16.117501+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.117501+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:44.273442+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.148243+0000","last_change":"2024-09-18T02:08:42.148371+0000","last_active":"2024-09-18T02:08:42.148243+0000","last_peered":"2024-09-18T02:08:42.148243+0000","last_clean":"2024-09-18T02:08:42.148243+0000","last_became_active":"2024-09-18T02:04:36.370188+0000","last_became_peered":"2024-09-18T02:04:36.370188+0000","last_unstale":"2024-09-18T02:08:42.148243+0000","last_undegraded":"2024-09-18T02:08:42.148243+0000","last_fullsized":"2024-09-18T02:08:42.148243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:42.148035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:42.148035+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.148035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:28.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.309363+0000","last_change":"2024-09-18T02:08:10.309363+0000","last_active":"2024-09-18T02:08:10.309363+0000","last_peered":"2024-09-18T02:08:10.309363+0000","last_clean":"2024-09-18T02:08:10.309363+0000","last_became_active":"2024-09-18T02:04:01.562586+0000","last_became_peered":"2024-09-18T02:04:01.562586+0000","last_unstale":"2024-09-18T02:08:10.309363+0000","last_undegraded":"2024-09-18T02:08:10.309363+0000","last_fullsized":"2024-09-18T02:08:10.309363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:10.309081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:10.309081+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.309081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:18.629970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'50","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.231588+0000","last_change":"2024-09-18T02:07:58.231588+0000","last_active":"2024-09-18T02:07:58.231588+0000","last_peered":"2024-09-18T02:07:58.231588+0000","last_clean":"2024-09-18T02:07:58.231588+0000","last_became_active":"2024-09-18T02:04:03.578581+0000","last_became_peered":"2024-09-18T02:04:03.578581+0000","last_unstale":"2024-09-18T02:07:58.231588+0000","last_undegraded":"2024-09-18T02:07:58.231588+0000","last_fullsized":"2024-09-18T02:07:58.231588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'50","last_scrub_stamp":"2024-09-18T02:07:58.231292+0000","last_deep_scrub":"32'50","last_deep_scrub_stamp":"2024-09-18T02:07:58.231292+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.231292+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:28.484821+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.089343+0000","last_change":"2024-09-18T02:07:53.089343+0000","last_active":"2024-09-18T02:07:53.089343+0000","last_peered":"2024-09-18T02:07:53.089343+0000","last_clean":"2024-09-18T02:07:53.089343+0000","last_became_active":"2024-09-18T02:04:05.586978+0000","last_became_peered":"2024-09-18T02:04:05.586978+0000","last_unstale":"2024-09-18T02:07:53.089343+0000","last_undegraded":"2024-09-18T02:07:53.089343+0000","last_fullsized":"2024-09-18T02:07:53.089343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.089086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.089086+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.089086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:43.728215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.510661+0000","last_change":"2024-09-18T02:08:36.510782+0000","last_active":"2024-09-18T02:08:36.510661+0000","last_peered":"2024-09-18T02:08:36.510661+0000","last_clean":"2024-09-18T02:08:36.510661+0000","last_became_active":"2024-09-18T02:04:07.607227+0000","last_became_peered":"2024-09-18T02:04:07.607227+0000","last_unstale":"2024-09-18T02:08:36.510661+0000","last_undegraded":"2024-09-18T02:08:36.510661+0000","last_fullsized":"2024-09-18T02:08:36.510661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:36.510432+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:36.510432+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.510432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:05:18.157288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.418342+0000","last_change":"2024-09-18T02:08:31.418342+0000","last_active":"2024-09-18T02:08:31.418342+0000","last_peered":"2024-09-18T02:08:31.418342+0000","last_clean":"2024-09-18T02:08:31.418342+0000","last_became_active":"2024-09-18T02:03:59.550221+0000","last_became_peered":"2024-09-18T02:03:59.550221+0000","last_unstale":"2024-09-18T02:08:31.418342+0000","last_undegraded":"2024-09-18T02:08:31.418342+0000","last_fullsized":"2024-09-18T02:08:31.418342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:31.418082+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:31.418082+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.418082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:38.837680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.766121+0000","last_change":"2024-09-18T02:08:29.766183+0000","last_active":"2024-09-18T02:08:29.766121+0000","last_peered":"2024-09-18T02:08:29.766121+0000","last_clean":"2024-09-18T02:08:29.766121+0000","last_became_active":"2024-09-18T02:03:57.522590+0000","last_became_peered":"2024-09-18T02:03:57.522590+0000","last_unstale":"2024-09-18T02:08:29.766121+0000","last_undegraded":"2024-09-18T02:08:29.766121+0000","last_fullsized":"2024-09-18T02:08:29.766121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:29.765913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:29.765913+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.765913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:38.112707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.399749+0000","last_change":"2024-09-18T02:07:48.399749+0000","last_active":"2024-09-18T02:07:48.399749+0000","last_peered":"2024-09-18T02:07:48.399749+0000","last_clean":"2024-09-18T02:07:48.399749+0000","last_became_active":"2024-09-18T02:04:01.566205+0000","last_became_peered":"2024-09-18T02:04:01.566205+0000","last_unstale":"2024-09-18T02:07:48.399749+0000","last_undegraded":"2024-09-18T02:07:48.399749+0000","last_fullsized":"2024-09-18T02:07:48.399749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.399488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.399488+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.399488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:47.098447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.319259+0000","last_change":"2024-09-18T02:08:00.319259+0000","last_active":"2024-09-18T02:08:00.319259+0000","last_peered":"2024-09-18T02:08:00.319259+0000","last_clean":"2024-09-18T02:08:00.319259+0000","last_became_active":"2024-09-18T02:04:03.580770+0000","last_became_peered":"2024-09-18T02:04:03.580770+0000","last_unstale":"2024-09-18T02:08:00.319259+0000","last_undegraded":"2024-09-18T02:08:00.319259+0000","last_fullsized":"2024-09-18T02:08:00.319259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-18T02:08:00.318990+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-18T02:08:00.318990+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.318990+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:50.958119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.368006+0000","last_change":"2024-09-18T02:07:54.368006+0000","last_active":"2024-09-18T02:07:54.368006+0000","last_peered":"2024-09-18T02:07:54.368006+0000","last_clean":"2024-09-18T02:07:54.368006+0000","last_became_active":"2024-09-18T02:04:05.591514+0000","last_became_peered":"2024-09-18T02:04:05.591514+0000","last_unstale":"2024-09-18T02:07:54.368006+0000","last_undegraded":"2024-09-18T02:07:54.368006+0000","last_fullsized":"2024-09-18T02:07:54.368006+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.367760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.367760+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.367760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:57.231313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.224665+0000","last_change":"2024-09-18T02:08:25.224723+0000","last_active":"2024-09-18T02:08:25.224665+0000","last_peered":"2024-09-18T02:08:25.224665+0000","last_clean":"2024-09-18T02:08:25.224665+0000","last_became_active":"2024-09-18T02:03:59.553660+0000","last_became_peered":"2024-09-18T02:03:59.553660+0000","last_unstale":"2024-09-18T02:08:25.224665+0000","last_undegraded":"2024-09-18T02:08:25.224665+0000","last_fullsized":"2024-09-18T02:08:25.224665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:25.224477+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:25.224477+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.224477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:18.652044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.542192+0000","last_change":"2024-09-18T02:08:39.542257+0000","last_active":"2024-09-18T02:08:39.542192+0000","last_peered":"2024-09-18T02:08:39.542192+0000","last_clean":"2024-09-18T02:08:39.542192+0000","last_became_active":"2024-09-18T02:03:57.526941+0000","last_became_peered":"2024-09-18T02:03:57.526941+0000","last_unstale":"2024-09-18T02:08:39.542192+0000","last_undegraded":"2024-09-18T02:08:39.542192+0000","last_fullsized":"2024-09-18T02:08:39.542192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:39.541993+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:39.541993+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.541993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:31.678647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.188438+0000","last_change":"2024-09-18T02:08:10.188544+0000","last_active":"2024-09-18T02:08:10.188438+0000","last_peered":"2024-09-18T02:08:10.188438+0000","last_clean":"2024-09-18T02:08:10.188438+0000","last_became_active":"2024-09-18T02:04:01.559839+0000","last_became_peered":"2024-09-18T02:04:01.559839+0000","last_unstale":"2024-09-18T02:08:10.188438+0000","last_undegraded":"2024-09-18T02:08:10.188438+0000","last_fullsized":"2024-09-18T02:08:10.188438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:10.188213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:10.188213+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.188213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:22:05.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'71","reported_seq":150,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.245034+0000","last_change":"2024-09-18T02:07:56.245115+0000","last_active":"2024-09-18T02:07:56.245034+0000","last_peered":"2024-09-18T02:07:56.245034+0000","last_clean":"2024-09-18T02:07:56.245034+0000","last_became_active":"2024-09-18T02:04:03.581518+0000","last_became_peered":"2024-09-18T02:04:03.581518+0000","last_unstale":"2024-09-18T02:07:56.245034+0000","last_undegraded":"2024-09-18T02:07:56.245034+0000","last_fullsized":"2024-09-18T02:07:56.245034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'71","last_scrub_stamp":"2024-09-18T02:07:56.244855+0000","last_deep_scrub":"32'71","last_deep_scrub_stamp":"2024-09-18T02:07:56.244855+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.244855+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:40.886685+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.238645+0000","last_change":"2024-09-18T02:07:48.238697+0000","last_active":"2024-09-18T02:07:48.238645+0000","last_peered":"2024-09-18T02:07:48.238645+0000","last_clean":"2024-09-18T02:07:48.238645+0000","last_became_active":"2024-09-18T02:04:05.610007+0000","last_became_peered":"2024-09-18T02:04:05.610007+0000","last_unstale":"2024-09-18T02:07:48.238645+0000","last_undegraded":"2024-09-18T02:07:48.238645+0000","last_fullsized":"2024-09-18T02:07:48.238645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.238443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.238443+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.238443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:49:49.194989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'20","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.091638+0000","last_change":"2024-09-18T02:08:15.091700+0000","last_active":"2024-09-18T02:08:15.091638+0000","last_peered":"2024-09-18T02:08:15.091638+0000","last_clean":"2024-09-18T02:08:15.091638+0000","last_became_active":"2024-09-18T02:04:07.609058+0000","last_became_peered":"2024-09-18T02:04:07.609058+0000","last_unstale":"2024-09-18T02:08:15.091638+0000","last_undegraded":"2024-09-18T02:08:15.091638+0000","last_fullsized":"2024-09-18T02:08:15.091638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-18T02:08:15.091443+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-18T02:08:15.091443+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.091443+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:45.320119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.012222+0000","last_change":"2024-09-18T02:08:27.012287+0000","last_active":"2024-09-18T02:08:27.012222+0000","last_peered":"2024-09-18T02:08:27.012222+0000","last_clean":"2024-09-18T02:08:27.012222+0000","last_became_active":"2024-09-18T02:03:59.540971+0000","last_became_peered":"2024-09-18T02:03:59.540971+0000","last_unstale":"2024-09-18T02:08:27.012222+0000","last_undegraded":"2024-09-18T02:08:27.012222+0000","last_fullsized":"2024-09-18T02:08:27.012222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:27.012027+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:27.012027+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.012027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:07:36.140644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.865643+0000","last_change":"2024-09-18T02:08:35.865777+0000","last_active":"2024-09-18T02:08:35.865643+0000","last_peered":"2024-09-18T02:08:35.865643+0000","last_clean":"2024-09-18T02:08:35.865643+0000","last_became_active":"2024-09-18T02:03:57.518311+0000","last_became_peered":"2024-09-18T02:03:57.518311+0000","last_unstale":"2024-09-18T02:08:35.865643+0000","last_undegraded":"2024-09-18T02:08:35.865643+0000","last_fullsized":"2024-09-18T02:08:35.865643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:35.865415+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:35.865415+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.865415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:22.501985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.276033+0000","last_change":"2024-09-18T02:08:09.276033+0000","last_active":"2024-09-18T02:08:09.276033+0000","last_peered":"2024-09-18T02:08:09.276033+0000","last_clean":"2024-09-18T02:08:09.276033+0000","last_became_active":"2024-09-18T02:04:01.563285+0000","last_became_peered":"2024-09-18T02:04:01.563285+0000","last_unstale":"2024-09-18T02:08:09.276033+0000","last_undegraded":"2024-09-18T02:08:09.276033+0000","last_fullsized":"2024-09-18T02:08:09.276033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:09.275778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:09.275778+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.275778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:39.529307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'47","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.348316+0000","last_change":"2024-09-18T02:08:17.348431+0000","last_active":"2024-09-18T02:08:17.348316+0000","last_peered":"2024-09-18T02:08:17.348316+0000","last_clean":"2024-09-18T02:08:17.348316+0000","last_became_active":"2024-09-18T02:04:03.596605+0000","last_became_peered":"2024-09-18T02:04:03.596605+0000","last_unstale":"2024-09-18T02:08:17.348316+0000","last_undegraded":"2024-09-18T02:08:17.348316+0000","last_fullsized":"2024-09-18T02:08:17.348316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-18T02:08:17.348103+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-18T02:08:17.348103+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.348103+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:15.420796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.941939+0000","last_change":"2024-09-18T02:07:56.941998+0000","last_active":"2024-09-18T02:07:56.941939+0000","last_peered":"2024-09-18T02:07:56.941939+0000","last_clean":"2024-09-18T02:07:56.941939+0000","last_became_active":"2024-09-18T02:04:05.589023+0000","last_became_peered":"2024-09-18T02:04:05.589023+0000","last_unstale":"2024-09-18T02:07:56.941939+0000","last_undegraded":"2024-09-18T02:07:56.941939+0000","last_fullsized":"2024-09-18T02:07:56.941939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:56.941733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:56.941733+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.941733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:18.501298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339141+0000","last_change":"2024-09-18T02:04:07.625988+0000","last_active":"2024-09-18T02:06:31.339141+0000","last_peered":"2024-09-18T02:06:31.339141+0000","last_clean":"2024-09-18T02:06:31.339141+0000","last_became_active":"2024-09-18T02:04:07.625440+0000","last_became_peered":"2024-09-18T02:04:07.625440+0000","last_unstale":"2024-09-18T02:06:31.339141+0000","last_undegraded":"2024-09-18T02:06:31.339141+0000","last_fullsized":"2024-09-18T02:06:31.339141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.216192+0000","last_change":"2024-09-18T02:08:02.216266+0000","last_active":"2024-09-18T02:08:02.216192+0000","last_peered":"2024-09-18T02:08:02.216192+0000","last_clean":"2024-09-18T02:08:02.216192+0000","last_became_active":"2024-09-18T02:03:59.561208+0000","last_became_peered":"2024-09-18T02:03:59.561208+0000","last_unstale":"2024-09-18T02:08:02.216192+0000","last_undegraded":"2024-09-18T02:08:02.216192+0000","last_fullsized":"2024-09-18T02:08:02.216192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:02.216020+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:02.216020+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.216020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:52.878948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.792412+0000","last_change":"2024-09-18T02:08:40.792480+0000","last_active":"2024-09-18T02:08:40.792412+0000","last_peered":"2024-09-18T02:08:40.792412+0000","last_clean":"2024-09-18T02:08:40.792412+0000","last_became_active":"2024-09-18T02:03:57.520569+0000","last_became_peered":"2024-09-18T02:03:57.520569+0000","last_unstale":"2024-09-18T02:08:40.792412+0000","last_undegraded":"2024-09-18T02:08:40.792412+0000","last_fullsized":"2024-09-18T02:08:40.792412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:40.792207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:40.792207+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.792207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:31.080041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.257322+0000","last_change":"2024-09-18T02:08:08.257373+0000","last_active":"2024-09-18T02:08:08.257322+0000","last_peered":"2024-09-18T02:08:08.257322+0000","last_clean":"2024-09-18T02:08:08.257322+0000","last_became_active":"2024-09-18T02:04:01.565499+0000","last_became_peered":"2024-09-18T02:04:01.565499+0000","last_unstale":"2024-09-18T02:08:08.257322+0000","last_undegraded":"2024-09-18T02:08:08.257322+0000","last_fullsized":"2024-09-18T02:08:08.257322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.257120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.257120+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.257120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:47.751284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.199509+0000","last_change":"2024-09-18T02:08:00.199509+0000","last_active":"2024-09-18T02:08:00.199509+0000","last_peered":"2024-09-18T02:08:00.199509+0000","last_clean":"2024-09-18T02:08:00.199509+0000","last_became_active":"2024-09-18T02:04:03.577841+0000","last_became_peered":"2024-09-18T02:04:03.577841+0000","last_unstale":"2024-09-18T02:08:00.199509+0000","last_undegraded":"2024-09-18T02:08:00.199509+0000","last_fullsized":"2024-09-18T02:08:00.199509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-18T02:08:00.199183+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-18T02:08:00.199183+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.199183+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:17.403960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.194433+0000","last_change":"2024-09-18T02:08:03.194433+0000","last_active":"2024-09-18T02:08:03.194433+0000","last_peered":"2024-09-18T02:08:03.194433+0000","last_clean":"2024-09-18T02:08:03.194433+0000","last_became_active":"2024-09-18T02:04:05.605718+0000","last_became_peered":"2024-09-18T02:04:05.605718+0000","last_unstale":"2024-09-18T02:08:03.194433+0000","last_undegraded":"2024-09-18T02:08:03.194433+0000","last_fullsized":"2024-09-18T02:08:03.194433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:03.194177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:03.194177+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.194177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:11.445570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339037+0000","last_change":"2024-09-18T02:04:07.621810+0000","last_active":"2024-09-18T02:06:31.339037+0000","last_peered":"2024-09-18T02:06:31.339037+0000","last_clean":"2024-09-18T02:06:31.339037+0000","last_became_active":"2024-09-18T02:04:07.621224+0000","last_became_peered":"2024-09-18T02:04:07.621224+0000","last_unstale":"2024-09-18T02:06:31.339037+0000","last_undegraded":"2024-09-18T02:06:31.339037+0000","last_fullsized":"2024-09-18T02:06:31.339037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.086273+0000","last_change":"2024-09-18T02:08:23.086336+0000","last_active":"2024-09-18T02:08:23.086273+0000","last_peered":"2024-09-18T02:08:23.086273+0000","last_clean":"2024-09-18T02:08:23.086273+0000","last_became_active":"2024-09-18T02:03:59.536701+0000","last_became_peered":"2024-09-18T02:03:59.536701+0000","last_unstale":"2024-09-18T02:08:23.086273+0000","last_undegraded":"2024-09-18T02:08:23.086273+0000","last_fullsized":"2024-09-18T02:08:23.086273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.086080+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.086080+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.086080+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:18.513965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.578344+0000","last_change":"2024-09-18T02:08:41.578484+0000","last_active":"2024-09-18T02:08:41.578344+0000","last_peered":"2024-09-18T02:08:41.578344+0000","last_clean":"2024-09-18T02:08:41.578344+0000","last_became_active":"2024-09-18T02:03:57.527891+0000","last_became_peered":"2024-09-18T02:03:57.527891+0000","last_unstale":"2024-09-18T02:08:41.578344+0000","last_undegraded":"2024-09-18T02:08:41.578344+0000","last_fullsized":"2024-09-18T02:08:41.578344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:41.578103+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:41.578103+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.578103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:59.036359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.843805+0000","last_change":"2024-09-18T02:08:02.843858+0000","last_active":"2024-09-18T02:08:02.843805+0000","last_peered":"2024-09-18T02:08:02.843805+0000","last_clean":"2024-09-18T02:08:02.843805+0000","last_became_active":"2024-09-18T02:04:01.564187+0000","last_became_peered":"2024-09-18T02:04:01.564187+0000","last_unstale":"2024-09-18T02:08:02.843805+0000","last_undegraded":"2024-09-18T02:08:02.843805+0000","last_fullsized":"2024-09-18T02:08:02.843805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:02.843618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:02.843618+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.843618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:11.164508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.203666+0000","last_change":"2024-09-18T02:08:04.203666+0000","last_active":"2024-09-18T02:08:04.203666+0000","last_peered":"2024-09-18T02:08:04.203666+0000","last_clean":"2024-09-18T02:08:04.203666+0000","last_became_active":"2024-09-18T02:04:03.596273+0000","last_became_peered":"2024-09-18T02:04:03.596273+0000","last_unstale":"2024-09-18T02:08:04.203666+0000","last_undegraded":"2024-09-18T02:08:04.203666+0000","last_fullsized":"2024-09-18T02:08:04.203666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-18T02:08:04.203351+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-18T02:08:04.203351+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.203351+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:49:59.631236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":384,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.282688+0000","last_change":"2024-09-18T02:07:50.282688+0000","last_active":"2024-09-18T02:07:50.282688+0000","last_peered":"2024-09-18T02:07:50.282688+0000","last_clean":"2024-09-18T02:07:50.282688+0000","last_became_active":"2024-09-18T02:04:05.601182+0000","last_became_peered":"2024-09-18T02:04:05.601182+0000","last_unstale":"2024-09-18T02:07:50.282688+0000","last_undegraded":"2024-09-18T02:07:50.282688+0000","last_fullsized":"2024-09-18T02:07:50.282688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:50.282455+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:50.282455+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.282455+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:09:41.423906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'8","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.338947+0000","last_change":"2024-09-18T02:04:07.622167+0000","last_active":"2024-09-18T02:06:31.338947+0000","last_peered":"2024-09-18T02:06:31.338947+0000","last_clean":"2024-09-18T02:06:31.338947+0000","last_became_active":"2024-09-18T02:04:07.621240+0000","last_became_peered":"2024-09-18T02:04:07.621240+0000","last_unstale":"2024-09-18T02:06:31.338947+0000","last_undegraded":"2024-09-18T02:06:31.338947+0000","last_fullsized":"2024-09-18T02:06:31.338947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'14","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.227272+0000","last_change":"2024-09-18T02:08:19.227333+0000","last_active":"2024-09-18T02:08:19.227272+0000","last_peered":"2024-09-18T02:08:19.227272+0000","last_clean":"2024-09-18T02:08:19.227272+0000","last_became_active":"2024-09-18T02:03:59.536486+0000","last_became_peered":"2024-09-18T02:03:59.536486+0000","last_unstale":"2024-09-18T02:08:19.227272+0000","last_undegraded":"2024-09-18T02:08:19.227272+0000","last_fullsized":"2024-09-18T02:08:19.227272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:19.227080+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:19.227080+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.227080+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:29.401705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.815225+0000","last_change":"2024-09-18T02:08:38.815282+0000","last_active":"2024-09-18T02:08:38.815225+0000","last_peered":"2024-09-18T02:08:38.815225+0000","last_clean":"2024-09-18T02:08:38.815225+0000","last_became_active":"2024-09-18T02:03:57.520452+0000","last_became_peered":"2024-09-18T02:03:57.520452+0000","last_unstale":"2024-09-18T02:08:38.815225+0000","last_undegraded":"2024-09-18T02:08:38.815225+0000","last_fullsized":"2024-09-18T02:08:38.815225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:38.815046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:38.815046+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.815046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:20:56.582184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.832584+0000","last_change":"2024-09-18T02:08:03.832649+0000","last_active":"2024-09-18T02:08:03.832584+0000","last_peered":"2024-09-18T02:08:03.832584+0000","last_clean":"2024-09-18T02:08:03.832584+0000","last_became_active":"2024-09-18T02:04:01.564165+0000","last_became_peered":"2024-09-18T02:04:01.564165+0000","last_unstale":"2024-09-18T02:08:03.832584+0000","last_undegraded":"2024-09-18T02:08:03.832584+0000","last_fullsized":"2024-09-18T02:08:03.832584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:03.832329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:03.832329+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.832329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:28.467191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'73","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.093299+0000","last_change":"2024-09-18T02:07:52.093377+0000","last_active":"2024-09-18T02:07:52.093299+0000","last_peered":"2024-09-18T02:07:52.093299+0000","last_clean":"2024-09-18T02:07:52.093299+0000","last_became_active":"2024-09-18T02:04:03.566714+0000","last_became_peered":"2024-09-18T02:04:03.566714+0000","last_unstale":"2024-09-18T02:07:52.093299+0000","last_undegraded":"2024-09-18T02:07:52.093299+0000","last_fullsized":"2024-09-18T02:07:52.093299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-09-18T02:07:52.093206+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-09-18T02:07:52.093206+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.093206+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:03.515528+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.212884+0000","last_change":"2024-09-18T02:07:53.213015+0000","last_active":"2024-09-18T02:07:53.212884+0000","last_peered":"2024-09-18T02:07:53.212884+0000","last_clean":"2024-09-18T02:07:53.212884+0000","last_became_active":"2024-09-18T02:04:05.578635+0000","last_became_peered":"2024-09-18T02:04:05.578635+0000","last_unstale":"2024-09-18T02:07:53.212884+0000","last_undegraded":"2024-09-18T02:07:53.212884+0000","last_fullsized":"2024-09-18T02:07:53.212884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.212658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.212658+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.212658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:04.833203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.712876+0000","last_change":"2024-09-18T02:08:12.712953+0000","last_active":"2024-09-18T02:08:12.712876+0000","last_peered":"2024-09-18T02:08:12.712876+0000","last_clean":"2024-09-18T02:08:12.712876+0000","last_became_active":"2024-09-18T02:04:07.618696+0000","last_became_peered":"2024-09-18T02:04:07.618696+0000","last_unstale":"2024-09-18T02:08:12.712876+0000","last_undegraded":"2024-09-18T02:08:12.712876+0000","last_fullsized":"2024-09-18T02:08:12.712876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:12.712689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:12.712689+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.712689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:04.964071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.284012+0000","last_change":"2024-09-18T02:08:27.284073+0000","last_active":"2024-09-18T02:08:27.284012+0000","last_peered":"2024-09-18T02:08:27.284012+0000","last_clean":"2024-09-18T02:08:27.284012+0000","last_became_active":"2024-09-18T02:03:59.536693+0000","last_became_peered":"2024-09-18T02:03:59.536693+0000","last_unstale":"2024-09-18T02:08:27.284012+0000","last_undegraded":"2024-09-18T02:08:27.284012+0000","last_fullsized":"2024-09-18T02:08:27.284012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:27.283820+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:27.283820+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.283820+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:03.691154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.511390+0000","last_change":"2024-09-18T02:08:35.511447+0000","last_active":"2024-09-18T02:08:35.511390+0000","last_peered":"2024-09-18T02:08:35.511390+0000","last_clean":"2024-09-18T02:08:35.511390+0000","last_became_active":"2024-09-18T02:03:57.532963+0000","last_became_peered":"2024-09-18T02:03:57.532963+0000","last_unstale":"2024-09-18T02:08:35.511390+0000","last_undegraded":"2024-09-18T02:08:35.511390+0000","last_fullsized":"2024-09-18T02:08:35.511390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:35.511195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:35.511195+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.511195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:52.073403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.290629+0000","last_change":"2024-09-18T02:08:06.290687+0000","last_active":"2024-09-18T02:08:06.290629+0000","last_peered":"2024-09-18T02:08:06.290629+0000","last_clean":"2024-09-18T02:08:06.290629+0000","last_became_active":"2024-09-18T02:04:01.572089+0000","last_became_peered":"2024-09-18T02:04:01.572089+0000","last_unstale":"2024-09-18T02:08:06.290629+0000","last_undegraded":"2024-09-18T02:08:06.290629+0000","last_fullsized":"2024-09-18T02:08:06.290629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:06.290419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:06.290419+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.290419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:26.123621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'43","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.233899+0000","last_change":"2024-09-18T02:08:01.233976+0000","last_active":"2024-09-18T02:08:01.233899+0000","last_peered":"2024-09-18T02:08:01.233899+0000","last_clean":"2024-09-18T02:08:01.233899+0000","last_became_active":"2024-09-18T02:04:03.569962+0000","last_became_peered":"2024-09-18T02:04:03.569962+0000","last_unstale":"2024-09-18T02:08:01.233899+0000","last_undegraded":"2024-09-18T02:08:01.233899+0000","last_fullsized":"2024-09-18T02:08:01.233899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:01.233724+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:01.233724+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.233724+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:11:25.741483+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.213865+0000","last_change":"2024-09-18T02:08:08.213922+0000","last_active":"2024-09-18T02:08:08.213865+0000","last_peered":"2024-09-18T02:08:08.213865+0000","last_clean":"2024-09-18T02:08:08.213865+0000","last_became_active":"2024-09-18T02:04:05.606608+0000","last_became_peered":"2024-09-18T02:04:05.606608+0000","last_unstale":"2024-09-18T02:08:08.213865+0000","last_undegraded":"2024-09-18T02:08:08.213865+0000","last_fullsized":"2024-09-18T02:08:08.213865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.213681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.213681+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.213681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:07:17.342298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.463244+0000","last_change":"2024-09-18T02:08:32.463401+0000","last_active":"2024-09-18T02:08:32.463244+0000","last_peered":"2024-09-18T02:08:32.463244+0000","last_clean":"2024-09-18T02:08:32.463244+0000","last_became_active":"2024-09-18T02:04:07.607839+0000","last_became_peered":"2024-09-18T02:04:07.607839+0000","last_unstale":"2024-09-18T02:08:32.463244+0000","last_undegraded":"2024-09-18T02:08:32.463244+0000","last_fullsized":"2024-09-18T02:08:32.463244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:32.463017+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:32.463017+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.463017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:46:03.555526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.392172+0000","last_change":"2024-09-18T02:08:30.392230+0000","last_active":"2024-09-18T02:08:30.392172+0000","last_peered":"2024-09-18T02:08:30.392172+0000","last_clean":"2024-09-18T02:08:30.392172+0000","last_became_active":"2024-09-18T02:03:59.547123+0000","last_became_peered":"2024-09-18T02:03:59.547123+0000","last_unstale":"2024-09-18T02:08:30.392172+0000","last_undegraded":"2024-09-18T02:08:30.392172+0000","last_fullsized":"2024-09-18T02:08:30.392172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:30.391969+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:30.391969+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.391969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:40.500818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.040922+0000","last_change":"2024-09-18T02:08:22.040978+0000","last_active":"2024-09-18T02:08:22.040922+0000","last_peered":"2024-09-18T02:08:22.040922+0000","last_clean":"2024-09-18T02:08:22.040922+0000","last_became_active":"2024-09-18T02:03:57.530001+0000","last_became_peered":"2024-09-18T02:03:57.530001+0000","last_unstale":"2024-09-18T02:08:22.040922+0000","last_undegraded":"2024-09-18T02:08:22.040922+0000","last_fullsized":"2024-09-18T02:08:22.040922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:22.040728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:22.040728+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.040728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:07.868719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.978250+0000","last_change":"2024-09-18T02:07:55.978327+0000","last_active":"2024-09-18T02:07:55.978250+0000","last_peered":"2024-09-18T02:07:55.978250+0000","last_clean":"2024-09-18T02:07:55.978250+0000","last_became_active":"2024-09-18T02:04:01.571263+0000","last_became_peered":"2024-09-18T02:04:01.571263+0000","last_unstale":"2024-09-18T02:07:55.978250+0000","last_undegraded":"2024-09-18T02:07:55.978250+0000","last_fullsized":"2024-09-18T02:07:55.978250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:55.978062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:55.978062+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.978062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:43:46.506478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'39","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.239184+0000","last_change":"2024-09-18T02:08:11.239265+0000","last_active":"2024-09-18T02:08:11.239184+0000","last_peered":"2024-09-18T02:08:11.239184+0000","last_clean":"2024-09-18T02:08:11.239184+0000","last_became_active":"2024-09-18T02:04:03.601392+0000","last_became_peered":"2024-09-18T02:04:03.601392+0000","last_unstale":"2024-09-18T02:08:11.239184+0000","last_undegraded":"2024-09-18T02:08:11.239184+0000","last_fullsized":"2024-09-18T02:08:11.239184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-18T02:08:11.238968+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-18T02:08:11.238968+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.238968+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:52:55.973173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.202655+0000","last_change":"2024-09-18T02:08:07.202713+0000","last_active":"2024-09-18T02:08:07.202655+0000","last_peered":"2024-09-18T02:08:07.202655+0000","last_clean":"2024-09-18T02:08:07.202655+0000","last_became_active":"2024-09-18T02:04:05.599964+0000","last_became_peered":"2024-09-18T02:04:05.599964+0000","last_unstale":"2024-09-18T02:08:07.202655+0000","last_undegraded":"2024-09-18T02:08:07.202655+0000","last_fullsized":"2024-09-18T02:08:07.202655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:07.202464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:07.202464+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.202464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:09.828342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.400039+0000","last_change":"2024-09-18T02:04:07.615961+0000","last_active":"2024-09-18T02:07:12.400039+0000","last_peered":"2024-09-18T02:07:12.400039+0000","last_clean":"2024-09-18T02:07:12.400039+0000","last_became_active":"2024-09-18T02:04:07.615007+0000","last_became_peered":"2024-09-18T02:04:07.615007+0000","last_unstale":"2024-09-18T02:07:12.400039+0000","last_undegraded":"2024-09-18T02:07:12.400039+0000","last_fullsized":"2024-09-18T02:07:12.400039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.310530+0000","last_change":"2024-09-18T02:08:17.310594+0000","last_active":"2024-09-18T02:08:17.310530+0000","last_peered":"2024-09-18T02:08:17.310530+0000","last_clean":"2024-09-18T02:08:17.310530+0000","last_became_active":"2024-09-18T02:03:59.536120+0000","last_became_peered":"2024-09-18T02:03:59.536120+0000","last_unstale":"2024-09-18T02:08:17.310530+0000","last_undegraded":"2024-09-18T02:08:17.310530+0000","last_fullsized":"2024-09-18T02:08:17.310530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:17.310348+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:17.310348+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.310348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:16.009307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.748348+0000","last_change":"2024-09-18T02:08:25.748413+0000","last_active":"2024-09-18T02:08:25.748348+0000","last_peered":"2024-09-18T02:08:25.748348+0000","last_clean":"2024-09-18T02:08:25.748348+0000","last_became_active":"2024-09-18T02:03:57.522831+0000","last_became_peered":"2024-09-18T02:03:57.522831+0000","last_unstale":"2024-09-18T02:08:25.748348+0000","last_undegraded":"2024-09-18T02:08:25.748348+0000","last_fullsized":"2024-09-18T02:08:25.748348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:25.748144+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:25.748144+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.748144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:26.585698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.904402+0000","last_change":"2024-09-18T02:07:57.904470+0000","last_active":"2024-09-18T02:07:57.904402+0000","last_peered":"2024-09-18T02:07:57.904402+0000","last_clean":"2024-09-18T02:07:57.904402+0000","last_became_active":"2024-09-18T02:04:01.569649+0000","last_became_peered":"2024-09-18T02:04:01.569649+0000","last_unstale":"2024-09-18T02:07:57.904402+0000","last_undegraded":"2024-09-18T02:07:57.904402+0000","last_fullsized":"2024-09-18T02:07:57.904402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:07:57.904196+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:07:57.904196+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.904196+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:19.425055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'55","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.404741+0000","last_change":"2024-09-18T02:07:50.404774+0000","last_active":"2024-09-18T02:07:50.404741+0000","last_peered":"2024-09-18T02:07:50.404741+0000","last_clean":"2024-09-18T02:07:50.404741+0000","last_became_active":"2024-09-18T02:04:03.591018+0000","last_became_peered":"2024-09-18T02:04:03.591018+0000","last_unstale":"2024-09-18T02:07:50.404741+0000","last_undegraded":"2024-09-18T02:07:50.404741+0000","last_fullsized":"2024-09-18T02:07:50.404741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'55","last_scrub_stamp":"2024-09-18T02:07:50.404668+0000","last_deep_scrub":"32'55","last_deep_scrub_stamp":"2024-09-18T02:07:50.404668+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.404668+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:48:17.203254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.262526+0000","last_change":"2024-09-18T02:07:51.262610+0000","last_active":"2024-09-18T02:07:51.262526+0000","last_peered":"2024-09-18T02:07:51.262526+0000","last_clean":"2024-09-18T02:07:51.262526+0000","last_became_active":"2024-09-18T02:04:05.595772+0000","last_became_peered":"2024-09-18T02:04:05.595772+0000","last_unstale":"2024-09-18T02:07:51.262526+0000","last_undegraded":"2024-09-18T02:07:51.262526+0000","last_fullsized":"2024-09-18T02:07:51.262526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.262332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.262332+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.262332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:41.244692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:06:31.339293+0000","last_change":"2024-09-18T02:04:07.613362+0000","last_active":"2024-09-18T02:06:31.339293+0000","last_peered":"2024-09-18T02:06:31.339293+0000","last_clean":"2024-09-18T02:06:31.339293+0000","last_became_active":"2024-09-18T02:04:07.612610+0000","last_became_peered":"2024-09-18T02:04:07.612610+0000","last_unstale":"2024-09-18T02:06:31.339293+0000","last_undegraded":"2024-09-18T02:06:31.339293+0000","last_fullsized":"2024-09-18T02:06:31.339293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.697508+0000","last_change":"2024-09-18T02:08:13.697508+0000","last_active":"2024-09-18T02:08:13.697508+0000","last_peered":"2024-09-18T02:08:13.697508+0000","last_clean":"2024-09-18T02:08:13.697508+0000","last_became_active":"2024-09-18T02:03:59.553864+0000","last_became_peered":"2024-09-18T02:03:59.553864+0000","last_unstale":"2024-09-18T02:08:13.697508+0000","last_undegraded":"2024-09-18T02:08:13.697508+0000","last_fullsized":"2024-09-18T02:08:13.697508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:13.697246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:13.697246+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.697246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:45.027054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.277121+0000","last_change":"2024-09-18T02:08:36.277174+0000","last_active":"2024-09-18T02:08:36.277121+0000","last_peered":"2024-09-18T02:08:36.277121+0000","last_clean":"2024-09-18T02:08:36.277121+0000","last_became_active":"2024-09-18T02:03:57.519843+0000","last_became_peered":"2024-09-18T02:03:57.519843+0000","last_unstale":"2024-09-18T02:08:36.277121+0000","last_undegraded":"2024-09-18T02:08:36.277121+0000","last_fullsized":"2024-09-18T02:08:36.277121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:36.276924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:36.276924+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.276924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:19.389568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.057689+0000","last_change":"2024-09-18T02:08:21.057689+0000","last_active":"2024-09-18T02:08:21.057689+0000","last_peered":"2024-09-18T02:08:21.057689+0000","last_clean":"2024-09-18T02:08:21.057689+0000","last_became_active":"2024-09-18T02:03:59.535992+0000","last_became_peered":"2024-09-18T02:03:59.535992+0000","last_unstale":"2024-09-18T02:08:21.057689+0000","last_undegraded":"2024-09-18T02:08:21.057689+0000","last_fullsized":"2024-09-18T02:08:21.057689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:21.057430+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:21.057430+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.057430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:11.720358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.091868+0000","last_change":"2024-09-18T02:08:24.091925+0000","last_active":"2024-09-18T02:08:24.091868+0000","last_peered":"2024-09-18T02:08:24.091868+0000","last_clean":"2024-09-18T02:08:24.091868+0000","last_became_active":"2024-09-18T02:03:57.527146+0000","last_became_peered":"2024-09-18T02:03:57.527146+0000","last_unstale":"2024-09-18T02:08:24.091868+0000","last_undegraded":"2024-09-18T02:08:24.091868+0000","last_fullsized":"2024-09-18T02:08:24.091868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:24.091664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:24.091664+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.091664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:50.849336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.229209+0000","last_change":"2024-09-18T02:08:21.229209+0000","last_active":"2024-09-18T02:08:21.229209+0000","last_peered":"2024-09-18T02:08:21.229209+0000","last_clean":"2024-09-18T02:08:21.229209+0000","last_became_active":"2024-09-18T02:03:59.556425+0000","last_became_peered":"2024-09-18T02:03:59.556425+0000","last_unstale":"2024-09-18T02:08:21.229209+0000","last_undegraded":"2024-09-18T02:08:21.229209+0000","last_fullsized":"2024-09-18T02:08:21.229209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:21.228959+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:21.228959+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.228959+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:54.629458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.107978+0000","last_change":"2024-09-18T02:04:36.351337+0000","last_active":"2024-09-18T02:07:47.107978+0000","last_peered":"2024-09-18T02:07:47.107978+0000","last_clean":"2024-09-18T02:07:47.107978+0000","last_became_active":"2024-09-18T02:04:36.350472+0000","last_became_peered":"2024-09-18T02:04:36.350472+0000","last_unstale":"2024-09-18T02:07:47.107978+0000","last_undegraded":"2024-09-18T02:07:47.107978+0000","last_fullsized":"2024-09-18T02:07:47.107978+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"32'18","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.102690+0000","last_change":"2024-09-18T02:08:17.102690+0000","last_active":"2024-09-18T02:08:17.102690+0000","last_peered":"2024-09-18T02:08:17.102690+0000","last_clean":"2024-09-18T02:08:17.102690+0000","last_became_active":"2024-09-18T02:03:59.534584+0000","last_became_peered":"2024-09-18T02:03:59.534584+0000","last_unstale":"2024-09-18T02:08:17.102690+0000","last_undegraded":"2024-09-18T02:08:17.102690+0000","last_fullsized":"2024-09-18T02:08:17.102690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:17.102427+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:17.102427+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.102427+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:53.509761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.863394+0000","last_change":"2024-09-18T02:08:39.863457+0000","last_active":"2024-09-18T02:08:39.863394+0000","last_peered":"2024-09-18T02:08:39.863394+0000","last_clean":"2024-09-18T02:08:39.863394+0000","last_became_active":"2024-09-18T02:03:57.521499+0000","last_became_peered":"2024-09-18T02:03:57.521499+0000","last_unstale":"2024-09-18T02:08:39.863394+0000","last_undegraded":"2024-09-18T02:08:39.863394+0000","last_fullsized":"2024-09-18T02:08:39.863394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:39.863198+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:39.863198+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.863198+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:05:13.263696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.152140+0000","last_change":"2024-09-18T02:08:13.152277+0000","last_active":"2024-09-18T02:08:13.152140+0000","last_peered":"2024-09-18T02:08:13.152140+0000","last_clean":"2024-09-18T02:08:13.152140+0000","last_became_active":"2024-09-18T02:03:59.554577+0000","last_became_peered":"2024-09-18T02:03:59.554577+0000","last_unstale":"2024-09-18T02:08:13.152140+0000","last_undegraded":"2024-09-18T02:08:13.152140+0000","last_fullsized":"2024-09-18T02:08:13.152140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:13.151916+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:13.151916+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.151916+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:59.060752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.962855+0000","last_change":"2024-09-18T02:08:27.962920+0000","last_active":"2024-09-18T02:08:27.962855+0000","last_peered":"2024-09-18T02:08:27.962855+0000","last_clean":"2024-09-18T02:08:27.962855+0000","last_became_active":"2024-09-18T02:03:57.526774+0000","last_became_peered":"2024-09-18T02:03:57.526774+0000","last_unstale":"2024-09-18T02:08:27.962855+0000","last_undegraded":"2024-09-18T02:08:27.962855+0000","last_fullsized":"2024-09-18T02:08:27.962855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:27.962660+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:27.962660+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.962660+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:27:41.428177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.713808+0000","last_change":"2024-09-18T02:08:10.713808+0000","last_active":"2024-09-18T02:08:10.713808+0000","last_peered":"2024-09-18T02:08:10.713808+0000","last_clean":"2024-09-18T02:08:10.713808+0000","last_became_active":"2024-09-18T02:03:59.554672+0000","last_became_peered":"2024-09-18T02:03:59.554672+0000","last_unstale":"2024-09-18T02:08:10.713808+0000","last_undegraded":"2024-09-18T02:08:10.713808+0000","last_fullsized":"2024-09-18T02:08:10.713808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:10.713551+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:10.713551+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.713551+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:17.678935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.861273+0000","last_change":"2024-09-18T02:08:37.861335+0000","last_active":"2024-09-18T02:08:37.861273+0000","last_peered":"2024-09-18T02:08:37.861273+0000","last_clean":"2024-09-18T02:08:37.861273+0000","last_became_active":"2024-09-18T02:03:57.519691+0000","last_became_peered":"2024-09-18T02:03:57.519691+0000","last_unstale":"2024-09-18T02:08:37.861273+0000","last_undegraded":"2024-09-18T02:08:37.861273+0000","last_fullsized":"2024-09-18T02:08:37.861273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:37.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:37.861054+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:35.933748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'18","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.930784+0000","last_change":"2024-09-18T02:08:28.930829+0000","last_active":"2024-09-18T02:08:28.930784+0000","last_peered":"2024-09-18T02:08:28.930784+0000","last_clean":"2024-09-18T02:08:28.930784+0000","last_became_active":"2024-09-18T02:03:59.541059+0000","last_became_peered":"2024-09-18T02:03:59.541059+0000","last_unstale":"2024-09-18T02:08:28.930784+0000","last_undegraded":"2024-09-18T02:08:28.930784+0000","last_fullsized":"2024-09-18T02:08:28.930784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:28.930660+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:28.930660+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.930660+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:01:07.506129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.256733+0000","last_change":"2024-09-18T02:08:31.256796+0000","last_active":"2024-09-18T02:08:31.256733+0000","last_peered":"2024-09-18T02:08:31.256733+0000","last_clean":"2024-09-18T02:08:31.256733+0000","last_became_active":"2024-09-18T02:03:57.519272+0000","last_became_peered":"2024-09-18T02:03:57.519272+0000","last_unstale":"2024-09-18T02:08:31.256733+0000","last_undegraded":"2024-09-18T02:08:31.256733+0000","last_fullsized":"2024-09-18T02:08:31.256733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:31.256526+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:31.256526+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.256526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:21.919455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.742520+0000","last_change":"2024-09-18T02:08:28.742581+0000","last_active":"2024-09-18T02:08:28.742520+0000","last_peered":"2024-09-18T02:08:28.742520+0000","last_clean":"2024-09-18T02:08:28.742520+0000","last_became_active":"2024-09-18T02:03:59.539946+0000","last_became_peered":"2024-09-18T02:03:59.539946+0000","last_unstale":"2024-09-18T02:08:28.742520+0000","last_undegraded":"2024-09-18T02:08:28.742520+0000","last_fullsized":"2024-09-18T02:08:28.742520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:28.742331+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:28.742331+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.742331+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:31.368209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.052740+0000","last_change":"2024-09-18T02:08:26.052861+0000","last_active":"2024-09-18T02:08:26.052740+0000","last_peered":"2024-09-18T02:08:26.052740+0000","last_clean":"2024-09-18T02:08:26.052740+0000","last_became_active":"2024-09-18T02:03:57.527102+0000","last_became_peered":"2024-09-18T02:03:57.527102+0000","last_unstale":"2024-09-18T02:08:26.052740+0000","last_undegraded":"2024-09-18T02:08:26.052740+0000","last_fullsized":"2024-09-18T02:08:26.052740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:26.052497+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:26.052497+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.052497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:28.678375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.726496+0000","last_change":"2024-09-18T02:08:26.726496+0000","last_active":"2024-09-18T02:08:26.726496+0000","last_peered":"2024-09-18T02:08:26.726496+0000","last_clean":"2024-09-18T02:08:26.726496+0000","last_became_active":"2024-09-18T02:03:59.543160+0000","last_became_peered":"2024-09-18T02:03:59.543160+0000","last_unstale":"2024-09-18T02:08:26.726496+0000","last_undegraded":"2024-09-18T02:08:26.726496+0000","last_fullsized":"2024-09-18T02:08:26.726496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:26.726212+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:26.726212+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.726212+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:09:22.380181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996381+0000","last_change":"2024-09-18T02:03:57.525942+0000","last_active":"2024-09-18T02:07:47.996381+0000","last_peered":"2024-09-18T02:07:47.996381+0000","last_clean":"2024-09-18T02:07:47.996381+0000","last_became_active":"2024-09-18T02:03:57.524495+0000","last_became_peered":"2024-09-18T02:03:57.524495+0000","last_unstale":"2024-09-18T02:07:47.996381+0000","last_undegraded":"2024-09-18T02:07:47.996381+0000","last_fullsized":"2024-09-18T02:07:47.996381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:12.236886+0000","last_change":"2024-09-18T02:04:36.361845+0000","last_active":"2024-09-18T02:07:12.236886+0000","last_peered":"2024-09-18T02:07:12.236886+0000","last_clean":"2024-09-18T02:07:12.236886+0000","last_became_active":"2024-09-18T02:04:36.354749+0000","last_became_peered":"2024-09-18T02:04:36.354749+0000","last_unstale":"2024-09-18T02:07:12.236886+0000","last_undegraded":"2024-09-18T02:07:12.236886+0000","last_fullsized":"2024-09-18T02:07:12.236886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:58.500888+0000","last_clean_scrub_stamp":"2024-09-18T02:03:58.500888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.828448+0000","last_change":"2024-09-18T02:08:37.828503+0000","last_active":"2024-09-18T02:08:37.828448+0000","last_peered":"2024-09-18T02:08:37.828448+0000","last_clean":"2024-09-18T02:08:37.828448+0000","last_became_active":"2024-09-18T02:03:57.520623+0000","last_became_peered":"2024-09-18T02:03:57.520623+0000","last_unstale":"2024-09-18T02:08:37.828448+0000","last_undegraded":"2024-09-18T02:08:37.828448+0000","last_fullsized":"2024-09-18T02:08:37.828448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:37.828257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:37.828257+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.828257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:22.353047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'10","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.172727+0000","last_change":"2024-09-18T02:08:12.172727+0000","last_active":"2024-09-18T02:08:12.172727+0000","last_peered":"2024-09-18T02:08:12.172727+0000","last_clean":"2024-09-18T02:08:12.172727+0000","last_became_active":"2024-09-18T02:03:59.555178+0000","last_became_peered":"2024-09-18T02:03:59.555178+0000","last_unstale":"2024-09-18T02:08:12.172727+0000","last_undegraded":"2024-09-18T02:08:12.172727+0000","last_fullsized":"2024-09-18T02:08:12.172727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:12.172263+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:12.172263+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.172263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:09.572270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.897066+0000","last_change":"2024-09-18T02:08:36.897214+0000","last_active":"2024-09-18T02:08:36.897066+0000","last_peered":"2024-09-18T02:08:36.897066+0000","last_clean":"2024-09-18T02:08:36.897066+0000","last_became_active":"2024-09-18T02:03:57.519359+0000","last_became_peered":"2024-09-18T02:03:57.519359+0000","last_unstale":"2024-09-18T02:08:36.897066+0000","last_undegraded":"2024-09-18T02:08:36.897066+0000","last_fullsized":"2024-09-18T02:08:36.897066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:36.896796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:36.896796+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.896796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:55:49.141518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.642832+0000","last_change":"2024-09-18T02:08:18.642832+0000","last_active":"2024-09-18T02:08:18.642832+0000","last_peered":"2024-09-18T02:08:18.642832+0000","last_clean":"2024-09-18T02:08:18.642832+0000","last_became_active":"2024-09-18T02:03:59.540444+0000","last_became_peered":"2024-09-18T02:03:59.540444+0000","last_unstale":"2024-09-18T02:08:18.642832+0000","last_undegraded":"2024-09-18T02:08:18.642832+0000","last_fullsized":"2024-09-18T02:08:18.642832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:18.642438+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:18.642438+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.642438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:31.841957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.837033+0000","last_change":"2024-09-18T02:08:41.837091+0000","last_active":"2024-09-18T02:08:41.837033+0000","last_peered":"2024-09-18T02:08:41.837033+0000","last_clean":"2024-09-18T02:08:41.837033+0000","last_became_active":"2024-09-18T02:03:57.521148+0000","last_became_peered":"2024-09-18T02:03:57.521148+0000","last_unstale":"2024-09-18T02:08:41.837033+0000","last_undegraded":"2024-09-18T02:08:41.837033+0000","last_fullsized":"2024-09-18T02:08:41.837033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:41.836798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:41.836798+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.836798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:24:25.840593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.744876+0000","last_change":"2024-09-18T02:08:11.744876+0000","last_active":"2024-09-18T02:08:11.744876+0000","last_peered":"2024-09-18T02:08:11.744876+0000","last_clean":"2024-09-18T02:08:11.744876+0000","last_became_active":"2024-09-18T02:03:59.553528+0000","last_became_peered":"2024-09-18T02:03:59.553528+0000","last_unstale":"2024-09-18T02:08:11.744876+0000","last_undegraded":"2024-09-18T02:08:11.744876+0000","last_fullsized":"2024-09-18T02:08:11.744876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:11.744618+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:11.744618+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.744618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:21.919244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.531996+0000","last_change":"2024-09-18T02:08:43.532048+0000","last_active":"2024-09-18T02:08:43.531996+0000","last_peered":"2024-09-18T02:08:43.531996+0000","last_clean":"2024-09-18T02:08:43.531996+0000","last_became_active":"2024-09-18T02:03:57.526972+0000","last_became_peered":"2024-09-18T02:03:57.526972+0000","last_unstale":"2024-09-18T02:08:43.531996+0000","last_undegraded":"2024-09-18T02:08:43.531996+0000","last_fullsized":"2024-09-18T02:08:43.531996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:43.531805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:43.531805+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.531805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:26.237398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.813987+0000","last_change":"2024-09-18T02:08:30.813987+0000","last_active":"2024-09-18T02:08:30.813987+0000","last_peered":"2024-09-18T02:08:30.813987+0000","last_clean":"2024-09-18T02:08:30.813987+0000","last_became_active":"2024-09-18T02:03:59.545405+0000","last_became_peered":"2024-09-18T02:03:59.545405+0000","last_unstale":"2024-09-18T02:08:30.813987+0000","last_undegraded":"2024-09-18T02:08:30.813987+0000","last_fullsized":"2024-09-18T02:08:30.813987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:30.813647+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:30.813647+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.813647+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:50.485940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996607+0000","last_change":"2024-09-18T02:03:57.522221+0000","last_active":"2024-09-18T02:07:47.996607+0000","last_peered":"2024-09-18T02:07:47.996607+0000","last_clean":"2024-09-18T02:07:47.996607+0000","last_became_active":"2024-09-18T02:03:57.521800+0000","last_became_peered":"2024-09-18T02:03:57.521800+0000","last_unstale":"2024-09-18T02:07:47.996607+0000","last_undegraded":"2024-09-18T02:07:47.996607+0000","last_fullsized":"2024-09-18T02:07:47.996607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'12","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.155117+0000","last_change":"2024-09-18T02:08:44.155183+0000","last_active":"2024-09-18T02:08:44.155117+0000","last_peered":"2024-09-18T02:08:44.155117+0000","last_clean":"2024-09-18T02:08:44.155117+0000","last_became_active":"2024-09-18T02:04:36.357213+0000","last_became_peered":"2024-09-18T02:04:36.357213+0000","last_unstale":"2024-09-18T02:08:44.155117+0000","last_undegraded":"2024-09-18T02:08:44.155117+0000","last_fullsized":"2024-09-18T02:08:44.155117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:44.154928+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:44.154928+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.154928+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:00:07.986709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.272049+0000","last_change":"2024-09-18T02:08:18.272049+0000","last_active":"2024-09-18T02:08:18.272049+0000","last_peered":"2024-09-18T02:08:18.272049+0000","last_clean":"2024-09-18T02:08:18.272049+0000","last_became_active":"2024-09-18T02:03:57.528312+0000","last_became_peered":"2024-09-18T02:03:57.528312+0000","last_unstale":"2024-09-18T02:08:18.272049+0000","last_undegraded":"2024-09-18T02:08:18.272049+0000","last_fullsized":"2024-09-18T02:08:18.272049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:18.271805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:18.271805+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.271805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:25.237189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.845546+0000","last_change":"2024-09-18T02:08:32.845606+0000","last_active":"2024-09-18T02:08:32.845546+0000","last_peered":"2024-09-18T02:08:32.845546+0000","last_clean":"2024-09-18T02:08:32.845546+0000","last_became_active":"2024-09-18T02:03:59.540283+0000","last_became_peered":"2024-09-18T02:03:59.540283+0000","last_unstale":"2024-09-18T02:08:32.845546+0000","last_undegraded":"2024-09-18T02:08:32.845546+0000","last_fullsized":"2024-09-18T02:08:32.845546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:32.845351+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:32.845351+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.845351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:18:12.741887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.570775+0000","last_change":"2024-09-18T02:08:40.570775+0000","last_active":"2024-09-18T02:08:40.570775+0000","last_peered":"2024-09-18T02:08:40.570775+0000","last_clean":"2024-09-18T02:08:40.570775+0000","last_became_active":"2024-09-18T02:03:57.526363+0000","last_became_peered":"2024-09-18T02:03:57.526363+0000","last_unstale":"2024-09-18T02:08:40.570775+0000","last_undegraded":"2024-09-18T02:08:40.570775+0000","last_fullsized":"2024-09-18T02:08:40.570775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:40.570505+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:40.570505+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.570505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:18:35.760634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.996606+0000","last_change":"2024-09-18T02:03:57.516751+0000","last_active":"2024-09-18T02:07:47.996606+0000","last_peered":"2024-09-18T02:07:47.996606+0000","last_clean":"2024-09-18T02:07:47.996606+0000","last_became_active":"2024-09-18T02:03:57.516434+0000","last_became_peered":"2024-09-18T02:03:57.516434+0000","last_unstale":"2024-09-18T02:07:47.996606+0000","last_undegraded":"2024-09-18T02:07:47.996606+0000","last_fullsized":"2024-09-18T02:07:47.996606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:03:56.487377+0000","last_clean_scrub_stamp":"2024-09-18T02:03:56.487377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.112746+0000","last_change":"2024-09-18T02:08:14.112809+0000","last_active":"2024-09-18T02:08:14.112746+0000","last_peered":"2024-09-18T02:08:14.112746+0000","last_clean":"2024-09-18T02:08:14.112746+0000","last_became_active":"2024-09-18T02:03:59.550058+0000","last_became_peered":"2024-09-18T02:03:59.550058+0000","last_unstale":"2024-09-18T02:08:14.112746+0000","last_undegraded":"2024-09-18T02:08:14.112746+0000","last_fullsized":"2024-09-18T02:08:14.112746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:14.112520+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:14.112520+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.112520+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:44.465392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.072731+0000","last_change":"2024-09-18T02:08:20.072731+0000","last_active":"2024-09-18T02:08:20.072731+0000","last_peered":"2024-09-18T02:08:20.072731+0000","last_clean":"2024-09-18T02:08:20.072731+0000","last_became_active":"2024-09-18T02:03:57.533324+0000","last_became_peered":"2024-09-18T02:03:57.533324+0000","last_unstale":"2024-09-18T02:08:20.072731+0000","last_undegraded":"2024-09-18T02:08:20.072731+0000","last_fullsized":"2024-09-18T02:08:20.072731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.072475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.072475+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.072475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:41.736390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.753750+0000","last_change":"2024-09-18T02:08:24.753846+0000","last_active":"2024-09-18T02:08:24.753750+0000","last_peered":"2024-09-18T02:08:24.753750+0000","last_clean":"2024-09-18T02:08:24.753750+0000","last_became_active":"2024-09-18T02:03:59.542356+0000","last_became_peered":"2024-09-18T02:03:59.542356+0000","last_unstale":"2024-09-18T02:08:24.753750+0000","last_undegraded":"2024-09-18T02:08:24.753750+0000","last_fullsized":"2024-09-18T02:08:24.753750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:24.753484+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:24.753484+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.753484+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:15.416413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1754,"ondisk_log_size":1754,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1593,"num_read_kb":1483,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705728,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":138326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705729,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":983040,"data_stored":725968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705728,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":726892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":430080,"data_stored":137902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T02:08:49.577 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.577 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.578 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.578 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.578 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-18T02:04:00.515145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=0, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.578 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.579 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.579 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.579 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.579 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.580 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.580 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.580 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.580 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.581 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.581 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.581 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.581 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T02:03:47.257322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=47, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.581 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.581 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.582 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.582 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.582 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.582 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.583 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.583 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.583 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.583 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-18T02:03:58.500888+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=58, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.583 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.584 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T02:03:56.487377+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=3, tm_sec=56, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:08:49.584 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T02:09:09.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T02:09:09.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.720+0000 7fec2ad76640 1 Processor -- start 2024-09-18T02:09:09.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.720+0000 7fec2ad76640 1 -- start start 2024-09-18T02:09:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.720+0000 7fec2ad76640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec2406e1f0 0x7fec2406e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:09:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.720+0000 7fec2ad76640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec2406f750 con 0x7fec2406eb10 2024-09-18T02:09:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.720+0000 7fec2ad76640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fec24070c10 con 0x7fec2406e1f0 2024-09-18T02:09:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.720+0000 7fec28b12640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec2406e1f0 0x7fec2406e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:09:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.720+0000 7fec23fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fec2406eb10 0x7fec24096080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39478/0 (socket says 172.21.15.81:39478) 2024-09-18T02:09:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.720+0000 7fec23fff640 1 -- 172.21.15.81:0/1206158409 learned_addr learned my addr 172.21.15.81:0/1206158409 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:09:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.720+0000 7fec28b12640 1 -- 172.21.15.81:0/1206158409 >> v1:172.21.15.81:6789/0 conn(0x7fec2406eb10 legacy=0x7fec24096080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.720+0000 7fec28b12640 1 -- 172.21.15.81:0/1206158409 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec240703f0 con 0x7fec2406e1f0 2024-09-18T02:09:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec28b12640 1 --2- 172.21.15.81:0/1206158409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec2406e1f0 0x7fec2406e5d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fec14009740 tx=0x7fec1401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91191dafcbb0bec server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:09:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec237fe640 1 -- 172.21.15.81:0/1206158409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec140b0070 con 0x7fec2406e1f0 2024-09-18T02:09:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec237fe640 1 -- 172.21.15.81:0/1206158409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec140ab530 con 0x7fec2406e1f0 2024-09-18T02:09:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec237fe640 1 -- 172.21.15.81:0/1206158409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec140ab830 con 0x7fec2406e1f0 2024-09-18T02:09:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec2ad76640 1 -- 172.21.15.81:0/1206158409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec2406e1f0 msgr2=0x7fec2406e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec2ad76640 1 --2- 172.21.15.81:0/1206158409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec2406e1f0 0x7fec2406e5d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fec14009740 tx=0x7fec1401c370 comp rx=0 tx=0).stop 2024-09-18T02:09:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec2ad76640 1 -- 172.21.15.81:0/1206158409 shutdown_connections 2024-09-18T02:09:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec2ad76640 1 --2- 172.21.15.81:0/1206158409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec2406e1f0 0x7fec2406e5d0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:09:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec2ad76640 1 -- 172.21.15.81:0/1206158409 >> 172.21.15.81:0/1206158409 conn(0x7fec24099a50 msgr2=0x7fec240972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:09:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec2ad76640 1 -- 172.21.15.81:0/1206158409 shutdown_connections 2024-09-18T02:09:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec2ad76640 1 -- 172.21.15.81:0/1206158409 wait complete. 2024-09-18T02:09:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec2ad76640 1 Processor -- start 2024-09-18T02:09:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.724+0000 7fec2ad76640 1 -- start start 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec2ad76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec2406e1f0 0x7fec2412b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec2ad76640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec2406eef0 con 0x7fec2406e1f0 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec28b12640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec2406e1f0 0x7fec2412b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec28b12640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec2406e1f0 0x7fec2412b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56232/0 (socket says 172.21.15.81:56232) 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec28b12640 1 -- 172.21.15.81:0/3591063302 learned_addr learned my addr 172.21.15.81:0/3591063302 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec28b12640 1 -- 172.21.15.81:0/3591063302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2412c730 con 0x7fec2406e1f0 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec28b12640 1 --2- 172.21.15.81:0/3591063302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec2406e1f0 0x7fec2412b870 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fec140ae040 tx=0x7fec1401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec217fa640 1 -- 172.21.15.81:0/3591063302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec140b0050 con 0x7fec2406e1f0 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec217fa640 1 -- 172.21.15.81:0/3591063302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec140b1040 con 0x7fec2406e1f0 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec217fa640 1 -- 172.21.15.81:0/3591063302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec140b5780 con 0x7fec2406e1f0 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec2ad76640 1 -- 172.21.15.81:0/3591063302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2412a750 con 0x7fec2406e1f0 2024-09-18T02:09:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec2ad76640 1 -- 172.21.15.81:0/3591063302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2412bdb0 con 0x7fec2406e1f0 2024-09-18T02:09:09.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec217fa640 1 -- 172.21.15.81:0/3591063302 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec140be030 con 0x7fec2406e1f0 2024-09-18T02:09:09.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec2ad76640 1 -- 172.21.15.81:0/3591063302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec24128f30 con 0x7fec2406e1f0 2024-09-18T02:09:09.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec217fa640 1 --2- 172.21.15.81:0/3591063302 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec10035db0 0x7fec10038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:09:09.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec217fa640 1 -- 172.21.15.81:0/3591063302 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fec140bc070 con 0x7fec2406e1f0 2024-09-18T02:09:09.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec23fff640 1 --2- 172.21.15.81:0/3591063302 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec10035db0 0x7fec10038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:09:09.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.728+0000 7fec23fff640 1 --2- 172.21.15.81:0/3591063302 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec10035db0 0x7fec10038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec18001610 tx=0x7fec18007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:09:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.732+0000 7fec217fa640 1 -- 172.21.15.81:0/3591063302 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec140c5060 con 0x7fec2406e1f0 2024-09-18T02:09:09.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.888+0000 7fec2ad76640 1 -- 172.21.15.81:0/3591063302 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec2406e5d0 con 0x7fec10035db0 2024-09-18T02:09:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.932+0000 7fec217fa640 1 -- 172.21.15.81:0/3591063302 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665856 (secure 0 0 0) 0x7fec2406e5d0 con 0x7fec10035db0 2024-09-18T02:09:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:09:09.947 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T02:09:09.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.940+0000 7fec2ad76640 1 -- 172.21.15.81:0/3591063302 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec10035db0 msgr2=0x7fec10038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:09.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.940+0000 7fec2ad76640 1 --2- 172.21.15.81:0/3591063302 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec10035db0 0x7fec10038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec18001610 tx=0x7fec18007ad0 comp rx=0 tx=0).stop 2024-09-18T02:09:09.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.940+0000 7fec2ad76640 1 -- 172.21.15.81:0/3591063302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec2406e1f0 msgr2=0x7fec2412b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.940+0000 7fec2ad76640 1 --2- 172.21.15.81:0/3591063302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec2406e1f0 0x7fec2412b870 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fec140ae040 tx=0x7fec1401abb0 comp rx=0 tx=0).stop 2024-09-18T02:09:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.940+0000 7fec2ad76640 1 -- 172.21.15.81:0/3591063302 shutdown_connections 2024-09-18T02:09:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.940+0000 7fec2ad76640 1 --2- 172.21.15.81:0/3591063302 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fec10035db0 0x7fec10038270 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:09:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.940+0000 7fec2ad76640 1 --2- 172.21.15.81:0/3591063302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec2406e1f0 0x7fec2412b870 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:09:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.940+0000 7fec2ad76640 1 -- 172.21.15.81:0/3591063302 >> 172.21.15.81:0/3591063302 conn(0x7fec24099a50 msgr2=0x7fec2409afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:09:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.944+0000 7fec2ad76640 1 -- 172.21.15.81:0/3591063302 shutdown_connections 2024-09-18T02:09:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:09.944+0000 7fec2ad76640 1 -- 172.21.15.81:0/3591063302 wait complete. 2024-09-18T02:09:09.962 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-18T02:09:09.391015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5363,"num_read_kb":4916,"num_write":2373,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5020,"ondisk_log_size":5020,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160832,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326528,"statfs":{"total":386547056640,"available":386382364672,"internally_reserved":0,"allocated":2883584,"data_stored":1729088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006470"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.275817+0000","last_change":"2024-09-18T02:08:30.275886+0000","last_active":"2024-09-18T02:08:30.275817+0000","last_peered":"2024-09-18T02:08:30.275817+0000","last_clean":"2024-09-18T02:08:30.275817+0000","last_became_active":"2024-09-18T02:03:57.516420+0000","last_became_peered":"2024-09-18T02:03:57.516420+0000","last_unstale":"2024-09-18T02:08:30.275817+0000","last_undegraded":"2024-09-18T02:08:30.275817+0000","last_fullsized":"2024-09-18T02:08:30.275817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:30.275625+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:30.275625+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.275625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:51.939540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.725179+0000","last_change":"2024-09-18T02:08:15.725179+0000","last_active":"2024-09-18T02:08:15.725179+0000","last_peered":"2024-09-18T02:08:15.725179+0000","last_clean":"2024-09-18T02:08:15.725179+0000","last_became_active":"2024-09-18T02:03:59.545294+0000","last_became_peered":"2024-09-18T02:03:59.545294+0000","last_unstale":"2024-09-18T02:08:15.725179+0000","last_undegraded":"2024-09-18T02:08:15.725179+0000","last_fullsized":"2024-09-18T02:08:15.725179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:15.724888+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:15.724888+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.724888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:28.872984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.140060+0000","last_change":"2024-09-18T02:08:18.140213+0000","last_active":"2024-09-18T02:08:18.140060+0000","last_peered":"2024-09-18T02:08:18.140060+0000","last_clean":"2024-09-18T02:08:18.140060+0000","last_became_active":"2024-09-18T02:03:57.533332+0000","last_became_peered":"2024-09-18T02:03:57.533332+0000","last_unstale":"2024-09-18T02:08:18.140060+0000","last_undegraded":"2024-09-18T02:08:18.140060+0000","last_fullsized":"2024-09-18T02:08:18.140060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:18.139828+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:18.139828+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.139828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:54.394230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.270290+0000","last_change":"2024-09-18T02:08:26.270290+0000","last_active":"2024-09-18T02:08:26.270290+0000","last_peered":"2024-09-18T02:08:26.270290+0000","last_clean":"2024-09-18T02:08:26.270290+0000","last_became_active":"2024-09-18T02:03:59.553641+0000","last_became_peered":"2024-09-18T02:03:59.553641+0000","last_unstale":"2024-09-18T02:08:26.270290+0000","last_undegraded":"2024-09-18T02:08:26.270290+0000","last_fullsized":"2024-09-18T02:08:26.270290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:26.270034+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:26.270034+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.270034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:39.424938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:50.482706+0000","last_change":"2024-09-18T02:08:50.482760+0000","last_active":"2024-09-18T02:08:50.482706+0000","last_peered":"2024-09-18T02:08:50.482706+0000","last_clean":"2024-09-18T02:08:50.482706+0000","last_became_active":"2024-09-18T02:03:57.532561+0000","last_became_peered":"2024-09-18T02:03:57.532561+0000","last_unstale":"2024-09-18T02:08:50.482706+0000","last_undegraded":"2024-09-18T02:08:50.482706+0000","last_fullsized":"2024-09-18T02:08:50.482706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:50.482516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:50.482516+0000","last_clean_scrub_stamp":"2024-09-18T02:08:50.482516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:18.634089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.345485+0000","last_change":"2024-09-18T02:08:29.345485+0000","last_active":"2024-09-18T02:08:29.345485+0000","last_peered":"2024-09-18T02:08:29.345485+0000","last_clean":"2024-09-18T02:08:29.345485+0000","last_became_active":"2024-09-18T02:03:59.551661+0000","last_became_peered":"2024-09-18T02:03:59.551661+0000","last_unstale":"2024-09-18T02:08:29.345485+0000","last_undegraded":"2024-09-18T02:08:29.345485+0000","last_fullsized":"2024-09-18T02:08:29.345485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:29.345217+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:29.345217+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.345217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:26:41.381394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.294995+0000","last_change":"2024-09-18T02:08:35.295053+0000","last_active":"2024-09-18T02:08:35.294995+0000","last_peered":"2024-09-18T02:08:35.294995+0000","last_clean":"2024-09-18T02:08:35.294995+0000","last_became_active":"2024-09-18T02:03:57.522751+0000","last_became_peered":"2024-09-18T02:03:57.522751+0000","last_unstale":"2024-09-18T02:08:35.294995+0000","last_undegraded":"2024-09-18T02:08:35.294995+0000","last_fullsized":"2024-09-18T02:08:35.294995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:35.294810+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:35.294810+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.294810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:22:58.514611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.282221+0000","last_change":"2024-09-18T02:08:27.282221+0000","last_active":"2024-09-18T02:08:27.282221+0000","last_peered":"2024-09-18T02:08:27.282221+0000","last_clean":"2024-09-18T02:08:27.282221+0000","last_became_active":"2024-09-18T02:03:59.552797+0000","last_became_peered":"2024-09-18T02:03:59.552797+0000","last_unstale":"2024-09-18T02:08:27.282221+0000","last_undegraded":"2024-09-18T02:08:27.282221+0000","last_fullsized":"2024-09-18T02:08:27.282221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:27.281926+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:27.281926+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.281926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:00.885178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:51.496399+0000","last_change":"2024-09-18T02:08:51.496399+0000","last_active":"2024-09-18T02:08:51.496399+0000","last_peered":"2024-09-18T02:08:51.496399+0000","last_clean":"2024-09-18T02:08:51.496399+0000","last_became_active":"2024-09-18T02:03:57.524645+0000","last_became_peered":"2024-09-18T02:03:57.524645+0000","last_unstale":"2024-09-18T02:08:51.496399+0000","last_undegraded":"2024-09-18T02:08:51.496399+0000","last_fullsized":"2024-09-18T02:08:51.496399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:51.496139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:51.496139+0000","last_clean_scrub_stamp":"2024-09-18T02:08:51.496139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:20:00.406145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.702905+0000","last_change":"2024-09-18T02:08:20.702972+0000","last_active":"2024-09-18T02:08:20.702905+0000","last_peered":"2024-09-18T02:08:20.702905+0000","last_clean":"2024-09-18T02:08:20.702905+0000","last_became_active":"2024-09-18T02:03:59.542238+0000","last_became_peered":"2024-09-18T02:03:59.542238+0000","last_unstale":"2024-09-18T02:08:20.702905+0000","last_undegraded":"2024-09-18T02:08:20.702905+0000","last_fullsized":"2024-09-18T02:08:20.702905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:20.702716+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:20.702716+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.702716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:13:21.865480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.285404+0000","last_change":"2024-09-18T02:08:33.285404+0000","last_active":"2024-09-18T02:08:33.285404+0000","last_peered":"2024-09-18T02:08:33.285404+0000","last_clean":"2024-09-18T02:08:33.285404+0000","last_became_active":"2024-09-18T02:03:57.520647+0000","last_became_peered":"2024-09-18T02:03:57.520647+0000","last_unstale":"2024-09-18T02:08:33.285404+0000","last_undegraded":"2024-09-18T02:08:33.285404+0000","last_fullsized":"2024-09-18T02:08:33.285404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:33.285048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:33.285048+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.285048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:11.364401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.302996+0000","last_change":"2024-09-18T02:08:18.303055+0000","last_active":"2024-09-18T02:08:18.302996+0000","last_peered":"2024-09-18T02:08:18.302996+0000","last_clean":"2024-09-18T02:08:18.302996+0000","last_became_active":"2024-09-18T02:03:59.559273+0000","last_became_peered":"2024-09-18T02:03:59.559273+0000","last_unstale":"2024-09-18T02:08:18.302996+0000","last_undegraded":"2024-09-18T02:08:18.302996+0000","last_fullsized":"2024-09-18T02:08:18.302996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:18.302810+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:18.302810+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.302810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:28:54.454876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.547909+0000","last_change":"2024-09-18T02:08:38.547909+0000","last_active":"2024-09-18T02:08:38.547909+0000","last_peered":"2024-09-18T02:08:38.547909+0000","last_clean":"2024-09-18T02:08:38.547909+0000","last_became_active":"2024-09-18T02:03:57.526953+0000","last_became_peered":"2024-09-18T02:03:57.526953+0000","last_unstale":"2024-09-18T02:08:38.547909+0000","last_undegraded":"2024-09-18T02:08:38.547909+0000","last_fullsized":"2024-09-18T02:08:38.547909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:38.547507+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:38.547507+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.547507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:19:29.126969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.254769+0000","last_change":"2024-09-18T02:08:37.254900+0000","last_active":"2024-09-18T02:08:37.254769+0000","last_peered":"2024-09-18T02:08:37.254769+0000","last_clean":"2024-09-18T02:08:37.254769+0000","last_became_active":"2024-09-18T02:03:59.541086+0000","last_became_peered":"2024-09-18T02:03:59.541086+0000","last_unstale":"2024-09-18T02:08:37.254769+0000","last_undegraded":"2024-09-18T02:08:37.254769+0000","last_fullsized":"2024-09-18T02:08:37.254769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:37.254513+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:37.254513+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.254513+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:27:50.720030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.935552+0000","last_change":"2024-09-18T02:08:31.935552+0000","last_active":"2024-09-18T02:08:31.935552+0000","last_peered":"2024-09-18T02:08:31.935552+0000","last_clean":"2024-09-18T02:08:31.935552+0000","last_became_active":"2024-09-18T02:03:57.520343+0000","last_became_peered":"2024-09-18T02:03:57.520343+0000","last_unstale":"2024-09-18T02:08:31.935552+0000","last_undegraded":"2024-09-18T02:08:31.935552+0000","last_fullsized":"2024-09-18T02:08:31.935552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:31.935306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:31.935306+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.935306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:32.425276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'12","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.258142+0000","last_change":"2024-09-18T02:08:14.258205+0000","last_active":"2024-09-18T02:08:14.258142+0000","last_peered":"2024-09-18T02:08:14.258142+0000","last_clean":"2024-09-18T02:08:14.258142+0000","last_became_active":"2024-09-18T02:03:59.533956+0000","last_became_peered":"2024-09-18T02:03:59.533956+0000","last_unstale":"2024-09-18T02:08:14.258142+0000","last_undegraded":"2024-09-18T02:08:14.258142+0000","last_fullsized":"2024-09-18T02:08:14.258142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:14.257948+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:14.257948+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.257948+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:21:09.261976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.466803+0000","last_change":"2024-09-18T02:08:34.466803+0000","last_active":"2024-09-18T02:08:34.466803+0000","last_peered":"2024-09-18T02:08:34.466803+0000","last_clean":"2024-09-18T02:08:34.466803+0000","last_became_active":"2024-09-18T02:03:59.536739+0000","last_became_peered":"2024-09-18T02:03:59.536739+0000","last_unstale":"2024-09-18T02:08:34.466803+0000","last_undegraded":"2024-09-18T02:08:34.466803+0000","last_fullsized":"2024-09-18T02:08:34.466803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:34.466519+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:34.466519+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.466519+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:07:34.155518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.728454+0000","last_change":"2024-09-18T02:08:27.728454+0000","last_active":"2024-09-18T02:08:27.728454+0000","last_peered":"2024-09-18T02:08:27.728454+0000","last_clean":"2024-09-18T02:08:27.728454+0000","last_became_active":"2024-09-18T02:03:57.523437+0000","last_became_peered":"2024-09-18T02:03:57.523437+0000","last_unstale":"2024-09-18T02:08:27.728454+0000","last_undegraded":"2024-09-18T02:08:27.728454+0000","last_fullsized":"2024-09-18T02:08:27.728454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:27.728216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:27.728216+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.728216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:32.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.685100+0000","last_change":"2024-09-18T02:08:19.685100+0000","last_active":"2024-09-18T02:08:19.685100+0000","last_peered":"2024-09-18T02:08:19.685100+0000","last_clean":"2024-09-18T02:08:19.685100+0000","last_became_active":"2024-09-18T02:03:59.539778+0000","last_became_peered":"2024-09-18T02:03:59.539778+0000","last_unstale":"2024-09-18T02:08:19.685100+0000","last_undegraded":"2024-09-18T02:08:19.685100+0000","last_fullsized":"2024-09-18T02:08:19.685100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:19.684812+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:19.684812+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.684812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:00:25.843568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.246624+0000","last_change":"2024-09-18T02:08:24.246624+0000","last_active":"2024-09-18T02:08:24.246624+0000","last_peered":"2024-09-18T02:08:24.246624+0000","last_clean":"2024-09-18T02:08:24.246624+0000","last_became_active":"2024-09-18T02:03:57.524578+0000","last_became_peered":"2024-09-18T02:03:57.524578+0000","last_unstale":"2024-09-18T02:08:24.246624+0000","last_undegraded":"2024-09-18T02:08:24.246624+0000","last_fullsized":"2024-09-18T02:08:24.246624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:24.246331+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:24.246331+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.246331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:29.967247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.846043+0000","last_change":"2024-09-18T02:08:42.846110+0000","last_active":"2024-09-18T02:08:42.846043+0000","last_peered":"2024-09-18T02:08:42.846043+0000","last_clean":"2024-09-18T02:08:42.846043+0000","last_became_active":"2024-09-18T02:03:59.545902+0000","last_became_peered":"2024-09-18T02:03:59.545902+0000","last_unstale":"2024-09-18T02:08:42.846043+0000","last_undegraded":"2024-09-18T02:08:42.846043+0000","last_fullsized":"2024-09-18T02:08:42.846043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:42.845854+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:42.845854+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.845854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:16:59.719082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.823369+0000","last_change":"2024-09-18T02:08:31.823369+0000","last_active":"2024-09-18T02:08:31.823369+0000","last_peered":"2024-09-18T02:08:31.823369+0000","last_clean":"2024-09-18T02:08:31.823369+0000","last_became_active":"2024-09-18T02:03:57.523211+0000","last_became_peered":"2024-09-18T02:03:57.523211+0000","last_unstale":"2024-09-18T02:08:31.823369+0000","last_undegraded":"2024-09-18T02:08:31.823369+0000","last_fullsized":"2024-09-18T02:08:31.823369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:31.823114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:31.823114+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.823114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:30:58.488129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.051257+0000","last_change":"2024-09-18T02:08:25.051257+0000","last_active":"2024-09-18T02:08:25.051257+0000","last_peered":"2024-09-18T02:08:25.051257+0000","last_clean":"2024-09-18T02:08:25.051257+0000","last_became_active":"2024-09-18T02:03:59.539198+0000","last_became_peered":"2024-09-18T02:03:59.539198+0000","last_unstale":"2024-09-18T02:08:25.051257+0000","last_undegraded":"2024-09-18T02:08:25.051257+0000","last_fullsized":"2024-09-18T02:08:25.051257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:25.050963+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:25.050963+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.050963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:35:55.015533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.803078+0000","last_change":"2024-09-18T02:08:33.803078+0000","last_active":"2024-09-18T02:08:33.803078+0000","last_peered":"2024-09-18T02:08:33.803078+0000","last_clean":"2024-09-18T02:08:33.803078+0000","last_became_active":"2024-09-18T02:03:57.522924+0000","last_became_peered":"2024-09-18T02:03:57.522924+0000","last_unstale":"2024-09-18T02:08:33.803078+0000","last_undegraded":"2024-09-18T02:08:33.803078+0000","last_fullsized":"2024-09-18T02:08:33.803078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:33.802752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:33.802752+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.802752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:19.699701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.214261+0000","last_change":"2024-09-18T02:08:21.214261+0000","last_active":"2024-09-18T02:08:21.214261+0000","last_peered":"2024-09-18T02:08:21.214261+0000","last_clean":"2024-09-18T02:08:21.214261+0000","last_became_active":"2024-09-18T02:03:59.538126+0000","last_became_peered":"2024-09-18T02:03:59.538126+0000","last_unstale":"2024-09-18T02:08:21.214261+0000","last_undegraded":"2024-09-18T02:08:21.214261+0000","last_fullsized":"2024-09-18T02:08:21.214261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:21.213960+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:21.213960+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.213960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:52.543767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.975405+0000","last_change":"2024-09-18T02:08:29.975405+0000","last_active":"2024-09-18T02:08:29.975405+0000","last_peered":"2024-09-18T02:08:29.975405+0000","last_clean":"2024-09-18T02:08:29.975405+0000","last_became_active":"2024-09-18T02:03:57.521019+0000","last_became_peered":"2024-09-18T02:03:57.521019+0000","last_unstale":"2024-09-18T02:08:29.975405+0000","last_undegraded":"2024-09-18T02:08:29.975405+0000","last_fullsized":"2024-09-18T02:08:29.975405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:29.975122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:29.975122+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.975122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:53:14.709327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.739297+0000","last_change":"2024-09-18T02:08:22.739297+0000","last_active":"2024-09-18T02:08:22.739297+0000","last_peered":"2024-09-18T02:08:22.739297+0000","last_clean":"2024-09-18T02:08:22.739297+0000","last_became_active":"2024-09-18T02:03:59.540553+0000","last_became_peered":"2024-09-18T02:03:59.540553+0000","last_unstale":"2024-09-18T02:08:22.739297+0000","last_undegraded":"2024-09-18T02:08:22.739297+0000","last_fullsized":"2024-09-18T02:08:22.739297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:22.739006+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:22.739006+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.739006+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:49.648220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:45.543385+0000","last_change":"2024-09-18T02:08:45.543498+0000","last_active":"2024-09-18T02:08:45.543385+0000","last_peered":"2024-09-18T02:08:45.543385+0000","last_clean":"2024-09-18T02:08:45.543385+0000","last_became_active":"2024-09-18T02:03:57.526917+0000","last_became_peered":"2024-09-18T02:03:57.526917+0000","last_unstale":"2024-09-18T02:08:45.543385+0000","last_undegraded":"2024-09-18T02:08:45.543385+0000","last_fullsized":"2024-09-18T02:08:45.543385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:45.543171+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:45.543171+0000","last_clean_scrub_stamp":"2024-09-18T02:08:45.543171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:42:30.963088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:45.743048+0000","last_change":"2024-09-18T02:08:45.743048+0000","last_active":"2024-09-18T02:08:45.743048+0000","last_peered":"2024-09-18T02:08:45.743048+0000","last_clean":"2024-09-18T02:08:45.743048+0000","last_became_active":"2024-09-18T02:04:07.624037+0000","last_became_peered":"2024-09-18T02:04:07.624037+0000","last_unstale":"2024-09-18T02:08:45.743048+0000","last_undegraded":"2024-09-18T02:08:45.743048+0000","last_fullsized":"2024-09-18T02:08:45.743048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-18T02:08:45.742798+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-18T02:08:45.742798+0000","last_clean_scrub_stamp":"2024-09-18T02:08:45.742798+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:39.170365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.457336+0000","last_change":"2024-09-18T02:08:33.457336+0000","last_active":"2024-09-18T02:08:33.457336+0000","last_peered":"2024-09-18T02:08:33.457336+0000","last_clean":"2024-09-18T02:08:33.457336+0000","last_became_active":"2024-09-18T02:03:59.538409+0000","last_became_peered":"2024-09-18T02:03:59.538409+0000","last_unstale":"2024-09-18T02:08:33.457336+0000","last_undegraded":"2024-09-18T02:08:33.457336+0000","last_fullsized":"2024-09-18T02:08:33.457336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:33.456927+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:33.456927+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.456927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:01.095761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:52.528115+0000","last_change":"2024-09-18T02:08:52.528185+0000","last_active":"2024-09-18T02:08:52.528115+0000","last_peered":"2024-09-18T02:08:52.528115+0000","last_clean":"2024-09-18T02:08:52.528115+0000","last_became_active":"2024-09-18T02:03:57.532657+0000","last_became_peered":"2024-09-18T02:03:57.532657+0000","last_unstale":"2024-09-18T02:08:52.528115+0000","last_undegraded":"2024-09-18T02:08:52.528115+0000","last_fullsized":"2024-09-18T02:08:52.528115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:52.527868+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:52.527868+0000","last_clean_scrub_stamp":"2024-09-18T02:08:52.527868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:34:07.528687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.360784+0000","last_change":"2024-09-18T02:07:51.360784+0000","last_active":"2024-09-18T02:07:51.360784+0000","last_peered":"2024-09-18T02:07:51.360784+0000","last_clean":"2024-09-18T02:07:51.360784+0000","last_became_active":"2024-09-18T02:04:01.562058+0000","last_became_peered":"2024-09-18T02:04:01.562058+0000","last_unstale":"2024-09-18T02:07:51.360784+0000","last_undegraded":"2024-09-18T02:07:51.360784+0000","last_fullsized":"2024-09-18T02:07:51.360784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.360360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.360360+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.360360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:21:46.176795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'51","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.267100+0000","last_change":"2024-09-18T02:08:14.267100+0000","last_active":"2024-09-18T02:08:14.267100+0000","last_peered":"2024-09-18T02:08:14.267100+0000","last_clean":"2024-09-18T02:08:14.267100+0000","last_became_active":"2024-09-18T02:04:03.600467+0000","last_became_peered":"2024-09-18T02:04:03.600467+0000","last_unstale":"2024-09-18T02:08:14.267100+0000","last_undegraded":"2024-09-18T02:08:14.267100+0000","last_fullsized":"2024-09-18T02:08:14.267100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-18T02:08:14.266804+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-18T02:08:14.266804+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.266804+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:00.903374+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.892026+0000","last_change":"2024-09-18T02:08:00.892026+0000","last_active":"2024-09-18T02:08:00.892026+0000","last_peered":"2024-09-18T02:08:00.892026+0000","last_clean":"2024-09-18T02:08:00.892026+0000","last_became_active":"2024-09-18T02:04:05.592934+0000","last_became_peered":"2024-09-18T02:04:05.592934+0000","last_unstale":"2024-09-18T02:08:00.892026+0000","last_undegraded":"2024-09-18T02:08:00.892026+0000","last_fullsized":"2024-09-18T02:08:00.892026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:00.891781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:00.891781+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.891781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:40.385945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:47.743102+0000","last_change":"2024-09-18T02:08:47.743102+0000","last_active":"2024-09-18T02:08:47.743102+0000","last_peered":"2024-09-18T02:08:47.743102+0000","last_clean":"2024-09-18T02:08:47.743102+0000","last_became_active":"2024-09-18T02:04:07.624106+0000","last_became_peered":"2024-09-18T02:04:07.624106+0000","last_unstale":"2024-09-18T02:08:47.743102+0000","last_undegraded":"2024-09-18T02:08:47.743102+0000","last_fullsized":"2024-09-18T02:08:47.743102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:08:47.742847+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:08:47.742847+0000","last_clean_scrub_stamp":"2024-09-18T02:08:47.742847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:36.842142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.231205+0000","last_change":"2024-09-18T02:08:22.231205+0000","last_active":"2024-09-18T02:08:22.231205+0000","last_peered":"2024-09-18T02:08:22.231205+0000","last_clean":"2024-09-18T02:08:22.231205+0000","last_became_active":"2024-09-18T02:03:59.555956+0000","last_became_peered":"2024-09-18T02:03:59.555956+0000","last_unstale":"2024-09-18T02:08:22.231205+0000","last_undegraded":"2024-09-18T02:08:22.231205+0000","last_fullsized":"2024-09-18T02:08:22.231205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:22.230956+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:22.230956+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.230956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:14.581546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.259379+0000","last_change":"2024-09-18T02:08:34.259379+0000","last_active":"2024-09-18T02:08:34.259379+0000","last_peered":"2024-09-18T02:08:34.259379+0000","last_clean":"2024-09-18T02:08:34.259379+0000","last_became_active":"2024-09-18T02:03:57.523041+0000","last_became_peered":"2024-09-18T02:03:57.523041+0000","last_unstale":"2024-09-18T02:08:34.259379+0000","last_undegraded":"2024-09-18T02:08:34.259379+0000","last_fullsized":"2024-09-18T02:08:34.259379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:34.259136+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:34.259136+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.259136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:39.485007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:49.735149+0000","last_change":"2024-09-18T02:08:49.735207+0000","last_active":"2024-09-18T02:08:49.735149+0000","last_peered":"2024-09-18T02:08:49.735149+0000","last_clean":"2024-09-18T02:08:49.735149+0000","last_became_active":"2024-09-18T02:04:36.362592+0000","last_became_peered":"2024-09-18T02:04:36.362592+0000","last_unstale":"2024-09-18T02:08:49.735149+0000","last_undegraded":"2024-09-18T02:08:49.735149+0000","last_fullsized":"2024-09-18T02:08:49.735149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:49.734960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:49.734960+0000","last_clean_scrub_stamp":"2024-09-18T02:08:49.734960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:01.771136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'16","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.117106+0000","last_change":"2024-09-18T02:07:50.117106+0000","last_active":"2024-09-18T02:07:50.117106+0000","last_peered":"2024-09-18T02:07:50.117106+0000","last_clean":"2024-09-18T02:07:50.117106+0000","last_became_active":"2024-09-18T02:04:03.579442+0000","last_became_peered":"2024-09-18T02:04:03.579442+0000","last_unstale":"2024-09-18T02:07:50.117106+0000","last_undegraded":"2024-09-18T02:07:50.117106+0000","last_fullsized":"2024-09-18T02:07:50.117106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-18T02:07:50.116825+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-18T02:07:50.116825+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.116825+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:28.484106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.808508+0000","last_change":"2024-09-18T02:08:04.808508+0000","last_active":"2024-09-18T02:08:04.808508+0000","last_peered":"2024-09-18T02:08:04.808508+0000","last_clean":"2024-09-18T02:08:04.808508+0000","last_became_active":"2024-09-18T02:04:05.605774+0000","last_became_peered":"2024-09-18T02:04:05.605774+0000","last_unstale":"2024-09-18T02:08:04.808508+0000","last_undegraded":"2024-09-18T02:08:04.808508+0000","last_fullsized":"2024-09-18T02:08:04.808508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:04.808264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:04.808264+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.808264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:41:47.654931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.798511+0000","last_change":"2024-09-18T02:08:42.798632+0000","last_active":"2024-09-18T02:08:42.798511+0000","last_peered":"2024-09-18T02:08:42.798511+0000","last_clean":"2024-09-18T02:08:42.798511+0000","last_became_active":"2024-09-18T02:04:07.610120+0000","last_became_peered":"2024-09-18T02:04:07.610120+0000","last_unstale":"2024-09-18T02:08:42.798511+0000","last_undegraded":"2024-09-18T02:08:42.798511+0000","last_fullsized":"2024-09-18T02:08:42.798511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:42.798222+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:42.798222+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.798222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:46:56.329254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.108000+0000","last_change":"2024-09-18T02:08:43.108061+0000","last_active":"2024-09-18T02:08:43.108000+0000","last_peered":"2024-09-18T02:08:43.108000+0000","last_clean":"2024-09-18T02:08:43.108000+0000","last_became_active":"2024-09-18T02:04:36.359108+0000","last_became_peered":"2024-09-18T02:04:36.359108+0000","last_unstale":"2024-09-18T02:08:43.108000+0000","last_undegraded":"2024-09-18T02:08:43.108000+0000","last_fullsized":"2024-09-18T02:08:43.108000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:43.107809+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:43.107809+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.107809+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:37:36.817784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:02.494553+0000","last_change":"2024-09-18T02:09:02.494616+0000","last_active":"2024-09-18T02:09:02.494553+0000","last_peered":"2024-09-18T02:09:02.494553+0000","last_clean":"2024-09-18T02:09:02.494553+0000","last_became_active":"2024-09-18T02:03:57.533037+0000","last_became_peered":"2024-09-18T02:03:57.533037+0000","last_unstale":"2024-09-18T02:09:02.494553+0000","last_undegraded":"2024-09-18T02:09:02.494553+0000","last_fullsized":"2024-09-18T02:09:02.494553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:09:02.494360+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:09:02.494360+0000","last_clean_scrub_stamp":"2024-09-18T02:09:02.494360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:40.128077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.236244+0000","last_change":"2024-09-18T02:08:06.236244+0000","last_active":"2024-09-18T02:08:06.236244+0000","last_peered":"2024-09-18T02:08:06.236244+0000","last_clean":"2024-09-18T02:08:06.236244+0000","last_became_active":"2024-09-18T02:04:01.567287+0000","last_became_peered":"2024-09-18T02:04:01.567287+0000","last_unstale":"2024-09-18T02:08:06.236244+0000","last_undegraded":"2024-09-18T02:08:06.236244+0000","last_fullsized":"2024-09-18T02:08:06.236244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-18T02:08:06.235937+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-18T02:08:06.235937+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.235937+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:02.660438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'30","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.284486+0000","last_change":"2024-09-18T02:08:01.284486+0000","last_active":"2024-09-18T02:08:01.284486+0000","last_peered":"2024-09-18T02:08:01.284486+0000","last_clean":"2024-09-18T02:08:01.284486+0000","last_became_active":"2024-09-18T02:04:03.581092+0000","last_became_peered":"2024-09-18T02:04:03.581092+0000","last_unstale":"2024-09-18T02:08:01.284486+0000","last_undegraded":"2024-09-18T02:08:01.284486+0000","last_fullsized":"2024-09-18T02:08:01.284486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-09-18T02:08:01.284176+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-09-18T02:08:01.284176+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.284176+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:52.879851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.250165+0000","last_change":"2024-09-18T02:08:12.250165+0000","last_active":"2024-09-18T02:08:12.250165+0000","last_peered":"2024-09-18T02:08:12.250165+0000","last_clean":"2024-09-18T02:08:12.250165+0000","last_became_active":"2024-09-18T02:04:05.607733+0000","last_became_peered":"2024-09-18T02:04:05.607733+0000","last_unstale":"2024-09-18T02:08:12.250165+0000","last_undegraded":"2024-09-18T02:08:12.250165+0000","last_fullsized":"2024-09-18T02:08:12.250165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:08:12.249802+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:08:12.249802+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.249802+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:58.146750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.226098+0000","last_change":"2024-09-18T02:08:38.226162+0000","last_active":"2024-09-18T02:08:38.226098+0000","last_peered":"2024-09-18T02:08:38.226098+0000","last_clean":"2024-09-18T02:08:38.226098+0000","last_became_active":"2024-09-18T02:04:07.630721+0000","last_became_peered":"2024-09-18T02:04:07.630721+0000","last_unstale":"2024-09-18T02:08:38.226098+0000","last_undegraded":"2024-09-18T02:08:38.226098+0000","last_fullsized":"2024-09-18T02:08:38.226098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:38.225897+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:38.225897+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.225897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:01:16.801367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.853795+0000","last_change":"2024-09-18T02:08:40.853795+0000","last_active":"2024-09-18T02:08:40.853795+0000","last_peered":"2024-09-18T02:08:40.853795+0000","last_clean":"2024-09-18T02:08:40.853795+0000","last_became_active":"2024-09-18T02:03:59.548365+0000","last_became_peered":"2024-09-18T02:03:59.548365+0000","last_unstale":"2024-09-18T02:08:40.853795+0000","last_undegraded":"2024-09-18T02:08:40.853795+0000","last_fullsized":"2024-09-18T02:08:40.853795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:40.853546+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:40.853546+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.853546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:33.204136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.775867+0000","last_change":"2024-09-18T02:08:39.775867+0000","last_active":"2024-09-18T02:08:39.775867+0000","last_peered":"2024-09-18T02:08:39.775867+0000","last_clean":"2024-09-18T02:08:39.775867+0000","last_became_active":"2024-09-18T02:03:57.520706+0000","last_became_peered":"2024-09-18T02:03:57.520706+0000","last_unstale":"2024-09-18T02:08:39.775867+0000","last_undegraded":"2024-09-18T02:08:39.775867+0000","last_fullsized":"2024-09-18T02:08:39.775867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:39.775602+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:39.775602+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.775602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:24.300392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.277755+0000","last_change":"2024-09-18T02:07:53.277755+0000","last_active":"2024-09-18T02:07:53.277755+0000","last_peered":"2024-09-18T02:07:53.277755+0000","last_clean":"2024-09-18T02:07:53.277755+0000","last_became_active":"2024-09-18T02:04:01.559249+0000","last_became_peered":"2024-09-18T02:04:01.559249+0000","last_unstale":"2024-09-18T02:07:53.277755+0000","last_undegraded":"2024-09-18T02:07:53.277755+0000","last_fullsized":"2024-09-18T02:07:53.277755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:07:53.277506+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:07:53.277506+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.277506+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:50.677514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'43","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.342570+0000","last_change":"2024-09-18T02:08:04.342570+0000","last_active":"2024-09-18T02:08:04.342570+0000","last_peered":"2024-09-18T02:08:04.342570+0000","last_clean":"2024-09-18T02:08:04.342570+0000","last_became_active":"2024-09-18T02:04:03.580310+0000","last_became_peered":"2024-09-18T02:04:03.580310+0000","last_unstale":"2024-09-18T02:08:04.342570+0000","last_undegraded":"2024-09-18T02:08:04.342570+0000","last_fullsized":"2024-09-18T02:08:04.342570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:04.342294+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:04.342294+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.342294+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:25.901859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":449,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.219458+0000","last_change":"2024-09-18T02:08:07.219458+0000","last_active":"2024-09-18T02:08:07.219458+0000","last_peered":"2024-09-18T02:08:07.219458+0000","last_clean":"2024-09-18T02:08:07.219458+0000","last_became_active":"2024-09-18T02:04:05.611707+0000","last_became_peered":"2024-09-18T02:04:05.611707+0000","last_unstale":"2024-09-18T02:08:07.219458+0000","last_undegraded":"2024-09-18T02:08:07.219458+0000","last_fullsized":"2024-09-18T02:08:07.219458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:08:07.219074+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:08:07.219074+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.219074+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:05.918033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.227542+0000","last_change":"2024-09-18T02:08:05.227542+0000","last_active":"2024-09-18T02:08:05.227542+0000","last_peered":"2024-09-18T02:08:05.227542+0000","last_clean":"2024-09-18T02:08:05.227542+0000","last_became_active":"2024-09-18T02:03:59.559585+0000","last_became_peered":"2024-09-18T02:03:59.559585+0000","last_unstale":"2024-09-18T02:08:05.227542+0000","last_undegraded":"2024-09-18T02:08:05.227542+0000","last_fullsized":"2024-09-18T02:08:05.227542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:05.227308+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:05.227308+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.227308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:31.984980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.235058+0000","last_change":"2024-09-18T02:08:26.235058+0000","last_active":"2024-09-18T02:08:26.235058+0000","last_peered":"2024-09-18T02:08:26.235058+0000","last_clean":"2024-09-18T02:08:26.235058+0000","last_became_active":"2024-09-18T02:03:57.527575+0000","last_became_peered":"2024-09-18T02:03:57.527575+0000","last_unstale":"2024-09-18T02:08:26.235058+0000","last_undegraded":"2024-09-18T02:08:26.235058+0000","last_fullsized":"2024-09-18T02:08:26.235058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:26.234826+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:26.234826+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.234826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:39.434344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.936141+0000","last_change":"2024-09-18T02:07:58.936141+0000","last_active":"2024-09-18T02:07:58.936141+0000","last_peered":"2024-09-18T02:07:58.936141+0000","last_clean":"2024-09-18T02:07:58.936141+0000","last_became_active":"2024-09-18T02:04:01.569301+0000","last_became_peered":"2024-09-18T02:04:01.569301+0000","last_unstale":"2024-09-18T02:07:58.936141+0000","last_undegraded":"2024-09-18T02:07:58.936141+0000","last_fullsized":"2024-09-18T02:07:58.936141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:58.935889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:58.935889+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.935889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:18.769091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'58","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.362195+0000","last_change":"2024-09-18T02:07:56.362296+0000","last_active":"2024-09-18T02:07:56.362195+0000","last_peered":"2024-09-18T02:07:56.362195+0000","last_clean":"2024-09-18T02:07:56.362195+0000","last_became_active":"2024-09-18T02:04:03.591195+0000","last_became_peered":"2024-09-18T02:04:03.591195+0000","last_unstale":"2024-09-18T02:07:56.362195+0000","last_undegraded":"2024-09-18T02:07:56.362195+0000","last_fullsized":"2024-09-18T02:07:56.362195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'58","last_scrub_stamp":"2024-09-18T02:07:56.361976+0000","last_deep_scrub":"32'58","last_deep_scrub_stamp":"2024-09-18T02:07:56.361976+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.361976+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:50:55.705307+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.187610+0000","last_change":"2024-09-18T02:07:59.187610+0000","last_active":"2024-09-18T02:07:59.187610+0000","last_peered":"2024-09-18T02:07:59.187610+0000","last_clean":"2024-09-18T02:07:59.187610+0000","last_became_active":"2024-09-18T02:04:05.605611+0000","last_became_peered":"2024-09-18T02:04:05.605611+0000","last_unstale":"2024-09-18T02:07:59.187610+0000","last_undegraded":"2024-09-18T02:07:59.187610+0000","last_fullsized":"2024-09-18T02:07:59.187610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:59.187354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:59.187354+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.187354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:48.634059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.286144+0000","last_change":"2024-09-18T02:08:11.286144+0000","last_active":"2024-09-18T02:08:11.286144+0000","last_peered":"2024-09-18T02:08:11.286144+0000","last_clean":"2024-09-18T02:08:11.286144+0000","last_became_active":"2024-09-18T02:04:07.628247+0000","last_became_peered":"2024-09-18T02:04:07.628247+0000","last_unstale":"2024-09-18T02:08:11.286144+0000","last_undegraded":"2024-09-18T02:08:11.286144+0000","last_fullsized":"2024-09-18T02:08:11.286144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:08:11.285863+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:08:11.285863+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.285863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:35.920724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.703080+0000","last_change":"2024-09-18T02:08:21.703212+0000","last_active":"2024-09-18T02:08:21.703080+0000","last_peered":"2024-09-18T02:08:21.703080+0000","last_clean":"2024-09-18T02:08:21.703080+0000","last_became_active":"2024-09-18T02:03:59.535217+0000","last_became_peered":"2024-09-18T02:03:59.535217+0000","last_unstale":"2024-09-18T02:08:21.703080+0000","last_undegraded":"2024-09-18T02:08:21.703080+0000","last_fullsized":"2024-09-18T02:08:21.703080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:21.702848+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:21.702848+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.702848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:57.957250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.207623+0000","last_change":"2024-09-18T02:08:22.207623+0000","last_active":"2024-09-18T02:08:22.207623+0000","last_peered":"2024-09-18T02:08:22.207623+0000","last_clean":"2024-09-18T02:08:22.207623+0000","last_became_active":"2024-09-18T02:03:57.528006+0000","last_became_peered":"2024-09-18T02:03:57.528006+0000","last_unstale":"2024-09-18T02:08:22.207623+0000","last_undegraded":"2024-09-18T02:08:22.207623+0000","last_fullsized":"2024-09-18T02:08:22.207623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:22.207330+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:22.207330+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.207330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:56.517929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.198039+0000","last_change":"2024-09-18T02:08:40.198039+0000","last_active":"2024-09-18T02:08:40.198039+0000","last_peered":"2024-09-18T02:08:40.198039+0000","last_clean":"2024-09-18T02:08:40.198039+0000","last_became_active":"2024-09-18T02:04:36.357607+0000","last_became_peered":"2024-09-18T02:04:36.357607+0000","last_unstale":"2024-09-18T02:08:40.198039+0000","last_undegraded":"2024-09-18T02:08:40.198039+0000","last_fullsized":"2024-09-18T02:08:40.198039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:40.197796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:40.197796+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.197796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:26.094745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'43","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.242764+0000","last_change":"2024-09-18T02:08:10.242764+0000","last_active":"2024-09-18T02:08:10.242764+0000","last_peered":"2024-09-18T02:08:10.242764+0000","last_clean":"2024-09-18T02:08:10.242764+0000","last_became_active":"2024-09-18T02:04:03.601783+0000","last_became_peered":"2024-09-18T02:04:03.601783+0000","last_unstale":"2024-09-18T02:08:10.242764+0000","last_undegraded":"2024-09-18T02:08:10.242764+0000","last_fullsized":"2024-09-18T02:08:10.242764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:10.242501+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:10.242501+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.242501+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:48.817971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.235959+0000","last_change":"2024-09-18T02:07:54.235959+0000","last_active":"2024-09-18T02:07:54.235959+0000","last_peered":"2024-09-18T02:07:54.235959+0000","last_clean":"2024-09-18T02:07:54.235959+0000","last_became_active":"2024-09-18T02:04:05.577665+0000","last_became_peered":"2024-09-18T02:04:05.577665+0000","last_unstale":"2024-09-18T02:07:54.235959+0000","last_undegraded":"2024-09-18T02:07:54.235959+0000","last_fullsized":"2024-09-18T02:07:54.235959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.235697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.235697+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.235697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:59:25.686298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.704604+0000","last_change":"2024-09-18T02:08:16.704604+0000","last_active":"2024-09-18T02:08:16.704604+0000","last_peered":"2024-09-18T02:08:16.704604+0000","last_clean":"2024-09-18T02:08:16.704604+0000","last_became_active":"2024-09-18T02:04:07.619973+0000","last_became_peered":"2024-09-18T02:04:07.619973+0000","last_unstale":"2024-09-18T02:08:16.704604+0000","last_undegraded":"2024-09-18T02:08:16.704604+0000","last_fullsized":"2024-09-18T02:08:16.704604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:16.704356+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:16.704356+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.704356+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:22.425273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.283438+0000","last_change":"2024-09-18T02:08:25.283505+0000","last_active":"2024-09-18T02:08:25.283438+0000","last_peered":"2024-09-18T02:08:25.283438+0000","last_clean":"2024-09-18T02:08:25.283438+0000","last_became_active":"2024-09-18T02:03:59.539105+0000","last_became_peered":"2024-09-18T02:03:59.539105+0000","last_unstale":"2024-09-18T02:08:25.283438+0000","last_undegraded":"2024-09-18T02:08:25.283438+0000","last_fullsized":"2024-09-18T02:08:25.283438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:25.283204+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:25.283204+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.283204+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:35.826881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'3","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.563954+0000","last_change":"2024-09-18T02:08:42.564020+0000","last_active":"2024-09-18T02:08:42.563954+0000","last_peered":"2024-09-18T02:08:42.563954+0000","last_clean":"2024-09-18T02:08:42.563954+0000","last_became_active":"2024-09-18T02:03:57.526327+0000","last_became_peered":"2024-09-18T02:03:57.526327+0000","last_unstale":"2024-09-18T02:08:42.563954+0000","last_undegraded":"2024-09-18T02:08:42.563954+0000","last_fullsized":"2024-09-18T02:08:42.563954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:08:42.563748+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:08:42.563748+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.563748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:04:56.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.210456+0000","last_change":"2024-09-18T02:08:09.210456+0000","last_active":"2024-09-18T02:08:09.210456+0000","last_peered":"2024-09-18T02:08:09.210456+0000","last_clean":"2024-09-18T02:08:09.210456+0000","last_became_active":"2024-09-18T02:04:01.561279+0000","last_became_peered":"2024-09-18T02:04:01.561279+0000","last_unstale":"2024-09-18T02:08:09.210456+0000","last_undegraded":"2024-09-18T02:08:09.210456+0000","last_fullsized":"2024-09-18T02:08:09.210456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:09.210167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:09.210167+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.210167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:48:36.008753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'60","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.236436+0000","last_change":"2024-09-18T02:07:56.236436+0000","last_active":"2024-09-18T02:07:56.236436+0000","last_peered":"2024-09-18T02:07:56.236436+0000","last_clean":"2024-09-18T02:07:56.236436+0000","last_became_active":"2024-09-18T02:04:03.591705+0000","last_became_peered":"2024-09-18T02:04:03.591705+0000","last_unstale":"2024-09-18T02:07:56.236436+0000","last_undegraded":"2024-09-18T02:07:56.236436+0000","last_fullsized":"2024-09-18T02:07:56.236436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2024-09-18T02:07:56.236157+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2024-09-18T02:07:56.236157+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.236157+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:26.464832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":411,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.258507+0000","last_change":"2024-09-18T02:07:47.258507+0000","last_active":"2024-09-18T02:07:47.258507+0000","last_peered":"2024-09-18T02:07:47.258507+0000","last_clean":"2024-09-18T02:07:47.258507+0000","last_became_active":"2024-09-18T02:04:05.591652+0000","last_became_peered":"2024-09-18T02:04:05.591652+0000","last_unstale":"2024-09-18T02:07:47.258507+0000","last_undegraded":"2024-09-18T02:07:47.258507+0000","last_fullsized":"2024-09-18T02:07:47.258507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:47.258352+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:47.258352+0000","last_clean_scrub_stamp":"2024-09-18T02:07:47.258352+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:22.446528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.194435+0000","last_change":"2024-09-18T02:08:11.194435+0000","last_active":"2024-09-18T02:08:11.194435+0000","last_peered":"2024-09-18T02:08:11.194435+0000","last_clean":"2024-09-18T02:08:11.194435+0000","last_became_active":"2024-09-18T02:04:07.609050+0000","last_became_peered":"2024-09-18T02:04:07.609050+0000","last_unstale":"2024-09-18T02:08:11.194435+0000","last_undegraded":"2024-09-18T02:08:11.194435+0000","last_fullsized":"2024-09-18T02:08:11.194435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:11.194052+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:11.194052+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.194052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:45.504652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'14","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.282593+0000","last_change":"2024-09-18T02:08:16.282593+0000","last_active":"2024-09-18T02:08:16.282593+0000","last_peered":"2024-09-18T02:08:16.282593+0000","last_clean":"2024-09-18T02:08:16.282593+0000","last_became_active":"2024-09-18T02:03:59.531445+0000","last_became_peered":"2024-09-18T02:03:59.531445+0000","last_unstale":"2024-09-18T02:08:16.282593+0000","last_undegraded":"2024-09-18T02:08:16.282593+0000","last_fullsized":"2024-09-18T02:08:16.282593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:16.282341+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:16.282341+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.282341+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:03.360755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:53.570353+0000","last_change":"2024-09-18T02:08:53.570414+0000","last_active":"2024-09-18T02:08:53.570353+0000","last_peered":"2024-09-18T02:08:53.570353+0000","last_clean":"2024-09-18T02:08:53.570353+0000","last_became_active":"2024-09-18T02:03:57.521858+0000","last_became_peered":"2024-09-18T02:03:57.521858+0000","last_unstale":"2024-09-18T02:08:53.570353+0000","last_undegraded":"2024-09-18T02:08:53.570353+0000","last_fullsized":"2024-09-18T02:08:53.570353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:53.570137+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:53.570137+0000","last_clean_scrub_stamp":"2024-09-18T02:08:53.570137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:22.341695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.223261+0000","last_change":"2024-09-18T02:08:39.223261+0000","last_active":"2024-09-18T02:08:39.223261+0000","last_peered":"2024-09-18T02:08:39.223261+0000","last_clean":"2024-09-18T02:08:39.223261+0000","last_became_active":"2024-09-18T02:04:36.356453+0000","last_became_peered":"2024-09-18T02:04:36.356453+0000","last_unstale":"2024-09-18T02:08:39.223261+0000","last_undegraded":"2024-09-18T02:08:39.223261+0000","last_fullsized":"2024-09-18T02:08:39.223261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:39.223019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:39.223019+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.223019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:53:23.957224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'77","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.228384+0000","last_change":"2024-09-18T02:08:00.228384+0000","last_active":"2024-09-18T02:08:00.228384+0000","last_peered":"2024-09-18T02:08:00.228384+0000","last_clean":"2024-09-18T02:08:00.228384+0000","last_became_active":"2024-09-18T02:04:03.595618+0000","last_became_peered":"2024-09-18T02:04:03.595618+0000","last_unstale":"2024-09-18T02:08:00.228384+0000","last_undegraded":"2024-09-18T02:08:00.228384+0000","last_fullsized":"2024-09-18T02:08:00.228384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'77","last_scrub_stamp":"2024-09-18T02:08:00.228054+0000","last_deep_scrub":"32'77","last_deep_scrub_stamp":"2024-09-18T02:08:00.228054+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.228054+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:27.137267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.222718+0000","last_change":"2024-09-18T02:07:52.222718+0000","last_active":"2024-09-18T02:07:52.222718+0000","last_peered":"2024-09-18T02:07:52.222718+0000","last_clean":"2024-09-18T02:07:52.222718+0000","last_became_active":"2024-09-18T02:04:05.585272+0000","last_became_peered":"2024-09-18T02:04:05.585272+0000","last_unstale":"2024-09-18T02:07:52.222718+0000","last_undegraded":"2024-09-18T02:07:52.222718+0000","last_fullsized":"2024-09-18T02:07:52.222718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:52.222463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:52.222463+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.222463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:48.799896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.759993+0000","last_change":"2024-09-18T02:08:43.760169+0000","last_active":"2024-09-18T02:08:43.759993+0000","last_peered":"2024-09-18T02:08:43.759993+0000","last_clean":"2024-09-18T02:08:43.759993+0000","last_became_active":"2024-09-18T02:04:07.614232+0000","last_became_peered":"2024-09-18T02:04:07.614232+0000","last_unstale":"2024-09-18T02:08:43.759993+0000","last_undegraded":"2024-09-18T02:08:43.759993+0000","last_fullsized":"2024-09-18T02:08:43.759993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-18T02:08:43.759763+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-18T02:08:43.759763+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.759763+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:37.187330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.689240+0000","last_change":"2024-09-18T02:08:17.689240+0000","last_active":"2024-09-18T02:08:17.689240+0000","last_peered":"2024-09-18T02:08:17.689240+0000","last_clean":"2024-09-18T02:08:17.689240+0000","last_became_active":"2024-09-18T02:03:59.545956+0000","last_became_peered":"2024-09-18T02:03:59.545956+0000","last_unstale":"2024-09-18T02:08:17.689240+0000","last_undegraded":"2024-09-18T02:08:17.689240+0000","last_fullsized":"2024-09-18T02:08:17.689240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:17.688836+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:17.688836+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.688836+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:28.232512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.815803+0000","last_change":"2024-09-18T02:08:38.815930+0000","last_active":"2024-09-18T02:08:38.815803+0000","last_peered":"2024-09-18T02:08:38.815803+0000","last_clean":"2024-09-18T02:08:38.815803+0000","last_became_active":"2024-09-18T02:03:57.520036+0000","last_became_peered":"2024-09-18T02:03:57.520036+0000","last_unstale":"2024-09-18T02:08:38.815803+0000","last_undegraded":"2024-09-18T02:08:38.815803+0000","last_fullsized":"2024-09-18T02:08:38.815803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:38.815568+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:38.815568+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.815568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:46.560180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.295590+0000","last_change":"2024-09-18T02:08:05.295590+0000","last_active":"2024-09-18T02:08:05.295590+0000","last_peered":"2024-09-18T02:08:05.295590+0000","last_clean":"2024-09-18T02:08:05.295590+0000","last_became_active":"2024-09-18T02:04:01.573084+0000","last_became_peered":"2024-09-18T02:04:01.573084+0000","last_unstale":"2024-09-18T02:08:05.295590+0000","last_undegraded":"2024-09-18T02:08:05.295590+0000","last_fullsized":"2024-09-18T02:08:05.295590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:05.295326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:05.295326+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.295326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:26.816185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.074574+0000","last_change":"2024-09-18T02:07:54.074574+0000","last_active":"2024-09-18T02:07:54.074574+0000","last_peered":"2024-09-18T02:07:54.074574+0000","last_clean":"2024-09-18T02:07:54.074574+0000","last_became_active":"2024-09-18T02:04:03.565801+0000","last_became_peered":"2024-09-18T02:04:03.565801+0000","last_unstale":"2024-09-18T02:07:54.074574+0000","last_undegraded":"2024-09-18T02:07:54.074574+0000","last_fullsized":"2024-09-18T02:07:54.074574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-18T02:07:54.074277+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-18T02:07:54.074277+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.074277+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:23:20.641594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.263760+0000","last_change":"2024-09-18T02:08:24.263760+0000","last_active":"2024-09-18T02:08:24.263760+0000","last_peered":"2024-09-18T02:08:24.263760+0000","last_clean":"2024-09-18T02:08:24.263760+0000","last_became_active":"2024-09-18T02:04:05.612052+0000","last_became_peered":"2024-09-18T02:04:05.612052+0000","last_unstale":"2024-09-18T02:08:24.263760+0000","last_undegraded":"2024-09-18T02:08:24.263760+0000","last_fullsized":"2024-09-18T02:08:24.263760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:24.263524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:24.263524+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.263524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:46:37.794556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.998718+0000","last_change":"2024-09-18T02:04:07.622545+0000","last_active":"2024-09-18T02:07:47.998718+0000","last_peered":"2024-09-18T02:07:47.998718+0000","last_clean":"2024-09-18T02:07:47.998718+0000","last_became_active":"2024-09-18T02:04:07.622004+0000","last_became_peered":"2024-09-18T02:04:07.622004+0000","last_unstale":"2024-09-18T02:07:47.998718+0000","last_undegraded":"2024-09-18T02:07:47.998718+0000","last_fullsized":"2024-09-18T02:07:47.998718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.196851+0000","last_change":"2024-09-18T02:08:41.196851+0000","last_active":"2024-09-18T02:08:41.196851+0000","last_peered":"2024-09-18T02:08:41.196851+0000","last_clean":"2024-09-18T02:08:41.196851+0000","last_became_active":"2024-09-18T02:04:36.361748+0000","last_became_peered":"2024-09-18T02:04:36.361748+0000","last_unstale":"2024-09-18T02:08:41.196851+0000","last_undegraded":"2024-09-18T02:08:41.196851+0000","last_fullsized":"2024-09-18T02:08:41.196851+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:41.196483+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:41.196483+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.196483+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:41.686454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.566044+0000","last_change":"2024-09-18T02:08:44.566101+0000","last_active":"2024-09-18T02:08:44.566044+0000","last_peered":"2024-09-18T02:08:44.566044+0000","last_clean":"2024-09-18T02:08:44.566044+0000","last_became_active":"2024-09-18T02:03:57.526977+0000","last_became_peered":"2024-09-18T02:03:57.526977+0000","last_unstale":"2024-09-18T02:08:44.566044+0000","last_undegraded":"2024-09-18T02:08:44.566044+0000","last_fullsized":"2024-09-18T02:08:44.566044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:44.565851+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:44.565851+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.565851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:04:34.691043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.203249+0000","last_change":"2024-09-18T02:08:08.203249+0000","last_active":"2024-09-18T02:08:08.203249+0000","last_peered":"2024-09-18T02:08:08.203249+0000","last_clean":"2024-09-18T02:08:08.203249+0000","last_became_active":"2024-09-18T02:04:01.561913+0000","last_became_peered":"2024-09-18T02:04:01.561913+0000","last_unstale":"2024-09-18T02:08:08.203249+0000","last_undegraded":"2024-09-18T02:08:08.203249+0000","last_fullsized":"2024-09-18T02:08:08.203249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.203008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.203008+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.203008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:28.422827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.280212+0000","last_change":"2024-09-18T02:08:02.280212+0000","last_active":"2024-09-18T02:08:02.280212+0000","last_peered":"2024-09-18T02:08:02.280212+0000","last_clean":"2024-09-18T02:08:02.280212+0000","last_became_active":"2024-09-18T02:04:03.580395+0000","last_became_peered":"2024-09-18T02:04:03.580395+0000","last_unstale":"2024-09-18T02:08:02.280212+0000","last_undegraded":"2024-09-18T02:08:02.280212+0000","last_fullsized":"2024-09-18T02:08:02.280212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-09-18T02:08:02.279903+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-09-18T02:08:02.279903+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.279903+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:12:22.758998+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.264976+0000","last_change":"2024-09-18T02:07:49.264976+0000","last_active":"2024-09-18T02:07:49.264976+0000","last_peered":"2024-09-18T02:07:49.264976+0000","last_clean":"2024-09-18T02:07:49.264976+0000","last_became_active":"2024-09-18T02:04:05.603548+0000","last_became_peered":"2024-09-18T02:04:05.603548+0000","last_unstale":"2024-09-18T02:07:49.264976+0000","last_undegraded":"2024-09-18T02:07:49.264976+0000","last_fullsized":"2024-09-18T02:07:49.264976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:49.264681+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:49.264681+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.264681+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:45:54.246439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'15","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:45.785014+0000","last_change":"2024-09-18T02:08:45.785089+0000","last_active":"2024-09-18T02:08:45.785014+0000","last_peered":"2024-09-18T02:08:45.785014+0000","last_clean":"2024-09-18T02:08:45.785014+0000","last_became_active":"2024-09-18T02:04:07.620094+0000","last_became_peered":"2024-09-18T02:04:07.620094+0000","last_unstale":"2024-09-18T02:08:45.785014+0000","last_undegraded":"2024-09-18T02:08:45.785014+0000","last_fullsized":"2024-09-18T02:08:45.785014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-18T02:08:45.784817+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-18T02:08:45.784817+0000","last_clean_scrub_stamp":"2024-09-18T02:08:45.784817+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:19.388070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'14","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.261906+0000","last_change":"2024-09-18T02:08:13.261906+0000","last_active":"2024-09-18T02:08:13.261906+0000","last_peered":"2024-09-18T02:08:13.261906+0000","last_clean":"2024-09-18T02:08:13.261906+0000","last_became_active":"2024-09-18T02:03:59.534547+0000","last_became_peered":"2024-09-18T02:03:59.534547+0000","last_unstale":"2024-09-18T02:08:13.261906+0000","last_undegraded":"2024-09-18T02:08:13.261906+0000","last_fullsized":"2024-09-18T02:08:13.261906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:13.261662+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:13.261662+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.261662+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:13.293664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:47.510538+0000","last_change":"2024-09-18T02:08:47.510647+0000","last_active":"2024-09-18T02:08:47.510538+0000","last_peered":"2024-09-18T02:08:47.510538+0000","last_clean":"2024-09-18T02:08:47.510538+0000","last_became_active":"2024-09-18T02:03:57.525576+0000","last_became_peered":"2024-09-18T02:03:57.525576+0000","last_unstale":"2024-09-18T02:08:47.510538+0000","last_undegraded":"2024-09-18T02:08:47.510538+0000","last_fullsized":"2024-09-18T02:08:47.510538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:47.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:47.510286+0000","last_clean_scrub_stamp":"2024-09-18T02:08:47.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:29.268846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.936130+0000","last_change":"2024-09-18T02:07:59.936130+0000","last_active":"2024-09-18T02:07:59.936130+0000","last_peered":"2024-09-18T02:07:59.936130+0000","last_clean":"2024-09-18T02:07:59.936130+0000","last_became_active":"2024-09-18T02:04:01.564385+0000","last_became_peered":"2024-09-18T02:04:01.564385+0000","last_unstale":"2024-09-18T02:07:59.936130+0000","last_undegraded":"2024-09-18T02:07:59.936130+0000","last_fullsized":"2024-09-18T02:07:59.936130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-18T02:07:59.935730+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-18T02:07:59.935730+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.935730+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:04.466951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.305924+0000","last_change":"2024-09-18T02:08:15.305924+0000","last_active":"2024-09-18T02:08:15.305924+0000","last_peered":"2024-09-18T02:08:15.305924+0000","last_clean":"2024-09-18T02:08:15.305924+0000","last_became_active":"2024-09-18T02:04:03.600545+0000","last_became_peered":"2024-09-18T02:04:03.600545+0000","last_unstale":"2024-09-18T02:08:15.305924+0000","last_undegraded":"2024-09-18T02:08:15.305924+0000","last_fullsized":"2024-09-18T02:08:15.305924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-18T02:08:15.305656+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-18T02:08:15.305656+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.305656+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:37:09.015631+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":473,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.115885+0000","last_change":"2024-09-18T02:07:47.115885+0000","last_active":"2024-09-18T02:07:47.115885+0000","last_peered":"2024-09-18T02:07:47.115885+0000","last_clean":"2024-09-18T02:07:47.115885+0000","last_became_active":"2024-09-18T02:04:05.582127+0000","last_became_peered":"2024-09-18T02:04:05.582127+0000","last_unstale":"2024-09-18T02:07:47.115885+0000","last_undegraded":"2024-09-18T02:07:47.115885+0000","last_fullsized":"2024-09-18T02:07:47.115885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:47.115624+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:47.115624+0000","last_clean_scrub_stamp":"2024-09-18T02:07:47.115624+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:34:41.967979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.332802+0000","last_change":"2024-09-18T02:07:55.332802+0000","last_active":"2024-09-18T02:07:55.332802+0000","last_peered":"2024-09-18T02:07:55.332802+0000","last_clean":"2024-09-18T02:07:55.332802+0000","last_became_active":"2024-09-18T02:04:07.602985+0000","last_became_peered":"2024-09-18T02:04:07.602985+0000","last_unstale":"2024-09-18T02:07:55.332802+0000","last_undegraded":"2024-09-18T02:07:55.332802+0000","last_fullsized":"2024-09-18T02:07:55.332802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:07:55.332416+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:07:55.332416+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.332416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:19:15.933538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.726524+0000","last_change":"2024-09-18T02:08:09.726524+0000","last_active":"2024-09-18T02:08:09.726524+0000","last_peered":"2024-09-18T02:08:09.726524+0000","last_clean":"2024-09-18T02:08:09.726524+0000","last_became_active":"2024-09-18T02:03:59.554711+0000","last_became_peered":"2024-09-18T02:03:59.554711+0000","last_unstale":"2024-09-18T02:08:09.726524+0000","last_undegraded":"2024-09-18T02:08:09.726524+0000","last_fullsized":"2024-09-18T02:08:09.726524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:09.726257+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:09.726257+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.726257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:21:45.241040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:48.486735+0000","last_change":"2024-09-18T02:08:48.486861+0000","last_active":"2024-09-18T02:08:48.486735+0000","last_peered":"2024-09-18T02:08:48.486735+0000","last_clean":"2024-09-18T02:08:48.486735+0000","last_became_active":"2024-09-18T02:03:57.531156+0000","last_became_peered":"2024-09-18T02:03:57.531156+0000","last_unstale":"2024-09-18T02:08:48.486735+0000","last_undegraded":"2024-09-18T02:08:48.486735+0000","last_fullsized":"2024-09-18T02:08:48.486735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:48.486497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:48.486497+0000","last_clean_scrub_stamp":"2024-09-18T02:08:48.486497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:00:46.807265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.368784+0000","last_change":"2024-09-18T02:07:49.368784+0000","last_active":"2024-09-18T02:07:49.368784+0000","last_peered":"2024-09-18T02:07:49.368784+0000","last_clean":"2024-09-18T02:07:49.368784+0000","last_became_active":"2024-09-18T02:04:01.565999+0000","last_became_peered":"2024-09-18T02:04:01.565999+0000","last_unstale":"2024-09-18T02:07:49.368784+0000","last_undegraded":"2024-09-18T02:07:49.368784+0000","last_fullsized":"2024-09-18T02:07:49.368784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:49.368530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:49.368530+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.368530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:09.588349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'51","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.029622+0000","last_change":"2024-09-18T02:07:55.029622+0000","last_active":"2024-09-18T02:07:55.029622+0000","last_peered":"2024-09-18T02:07:55.029622+0000","last_clean":"2024-09-18T02:07:55.029622+0000","last_became_active":"2024-09-18T02:04:03.564021+0000","last_became_peered":"2024-09-18T02:04:03.564021+0000","last_unstale":"2024-09-18T02:07:55.029622+0000","last_undegraded":"2024-09-18T02:07:55.029622+0000","last_fullsized":"2024-09-18T02:07:55.029622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-18T02:07:55.029350+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-18T02:07:55.029350+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.029350+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:45.011710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.316073+0000","last_change":"2024-09-18T02:07:51.316073+0000","last_active":"2024-09-18T02:07:51.316073+0000","last_peered":"2024-09-18T02:07:51.316073+0000","last_clean":"2024-09-18T02:07:51.316073+0000","last_became_active":"2024-09-18T02:04:05.610024+0000","last_became_peered":"2024-09-18T02:04:05.610024+0000","last_unstale":"2024-09-18T02:07:51.316073+0000","last_undegraded":"2024-09-18T02:07:51.316073+0000","last_fullsized":"2024-09-18T02:07:51.316073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.315728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.315728+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.315728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:32.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.762277+0000","last_change":"2024-09-18T02:08:08.762277+0000","last_active":"2024-09-18T02:08:08.762277+0000","last_peered":"2024-09-18T02:08:08.762277+0000","last_clean":"2024-09-18T02:08:08.762277+0000","last_became_active":"2024-09-18T02:04:07.618153+0000","last_became_peered":"2024-09-18T02:04:07.618153+0000","last_unstale":"2024-09-18T02:08:08.762277+0000","last_undegraded":"2024-09-18T02:08:08.762277+0000","last_fullsized":"2024-09-18T02:08:08.762277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:08:08.762008+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:08:08.762008+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.762008+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:55.840421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.208888+0000","last_change":"2024-09-18T02:08:03.208888+0000","last_active":"2024-09-18T02:08:03.208888+0000","last_peered":"2024-09-18T02:08:03.208888+0000","last_clean":"2024-09-18T02:08:03.208888+0000","last_became_active":"2024-09-18T02:03:59.559592+0000","last_became_peered":"2024-09-18T02:03:59.559592+0000","last_unstale":"2024-09-18T02:08:03.208888+0000","last_undegraded":"2024-09-18T02:08:03.208888+0000","last_fullsized":"2024-09-18T02:08:03.208888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:03.208545+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:03.208545+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.208545+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:46:49.036536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":215,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.851810+0000","last_change":"2024-09-18T02:08:34.851896+0000","last_active":"2024-09-18T02:08:34.851810+0000","last_peered":"2024-09-18T02:08:34.851810+0000","last_clean":"2024-09-18T02:08:34.851810+0000","last_became_active":"2024-09-18T02:03:43.336731+0000","last_became_peered":"2024-09-18T02:03:43.336731+0000","last_unstale":"2024-09-18T02:08:34.851810+0000","last_undegraded":"2024-09-18T02:08:34.851810+0000","last_fullsized":"2024-09-18T02:08:34.851810+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-09-18T02:08:34.851600+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-09-18T02:08:34.851600+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.851600+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:35.341570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:54.540878+0000","last_change":"2024-09-18T02:08:54.540973+0000","last_active":"2024-09-18T02:08:54.540878+0000","last_peered":"2024-09-18T02:08:54.540878+0000","last_clean":"2024-09-18T02:08:54.540878+0000","last_became_active":"2024-09-18T02:03:48.273444+0000","last_became_peered":"2024-09-18T02:03:48.273444+0000","last_unstale":"2024-09-18T02:08:54.540878+0000","last_undegraded":"2024-09-18T02:08:54.540878+0000","last_fullsized":"2024-09-18T02:08:54.540878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:54.540682+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:54.540682+0000","last_clean_scrub_stamp":"2024-09-18T02:08:54.540682+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:31.148257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024299339999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.543032+0000","last_change":"2024-09-18T02:08:37.543094+0000","last_active":"2024-09-18T02:08:37.543032+0000","last_peered":"2024-09-18T02:08:37.543032+0000","last_clean":"2024-09-18T02:08:37.543032+0000","last_became_active":"2024-09-18T02:03:57.532844+0000","last_became_peered":"2024-09-18T02:03:57.532844+0000","last_unstale":"2024-09-18T02:08:37.543032+0000","last_undegraded":"2024-09-18T02:08:37.543032+0000","last_fullsized":"2024-09-18T02:08:37.543032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:37.542821+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:37.542821+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.542821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:32.720689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.878096+0000","last_change":"2024-09-18T02:08:01.878096+0000","last_active":"2024-09-18T02:08:01.878096+0000","last_peered":"2024-09-18T02:08:01.878096+0000","last_clean":"2024-09-18T02:08:01.878096+0000","last_became_active":"2024-09-18T02:04:01.563633+0000","last_became_peered":"2024-09-18T02:04:01.563633+0000","last_unstale":"2024-09-18T02:08:01.878096+0000","last_undegraded":"2024-09-18T02:08:01.878096+0000","last_fullsized":"2024-09-18T02:08:01.878096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:01.877846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:01.877846+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.877846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:32.131376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'97","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.212941+0000","last_change":"2024-09-18T02:08:09.212941+0000","last_active":"2024-09-18T02:08:09.212941+0000","last_peered":"2024-09-18T02:08:09.212941+0000","last_clean":"2024-09-18T02:08:09.212941+0000","last_became_active":"2024-09-18T02:04:03.606800+0000","last_became_peered":"2024-09-18T02:04:03.606800+0000","last_unstale":"2024-09-18T02:08:09.212941+0000","last_undegraded":"2024-09-18T02:08:09.212941+0000","last_fullsized":"2024-09-18T02:08:09.212941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-09-18T02:08:09.212628+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-09-18T02:08:09.212628+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.212628+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:27:22.678145+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.275953+0000","last_change":"2024-09-18T02:07:50.275953+0000","last_active":"2024-09-18T02:07:50.275953+0000","last_peered":"2024-09-18T02:07:50.275953+0000","last_clean":"2024-09-18T02:07:50.275953+0000","last_became_active":"2024-09-18T02:04:05.588568+0000","last_became_peered":"2024-09-18T02:04:05.588568+0000","last_unstale":"2024-09-18T02:07:50.275953+0000","last_undegraded":"2024-09-18T02:07:50.275953+0000","last_fullsized":"2024-09-18T02:07:50.275953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:50.275701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:50.275701+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.275701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:23:16.843019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.289795+0000","last_change":"2024-09-18T02:08:07.289795+0000","last_active":"2024-09-18T02:08:07.289795+0000","last_peered":"2024-09-18T02:08:07.289795+0000","last_clean":"2024-09-18T02:08:07.289795+0000","last_became_active":"2024-09-18T02:04:07.613914+0000","last_became_peered":"2024-09-18T02:04:07.613914+0000","last_unstale":"2024-09-18T02:08:07.289795+0000","last_undegraded":"2024-09-18T02:08:07.289795+0000","last_fullsized":"2024-09-18T02:08:07.289795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-09-18T02:08:07.289548+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-09-18T02:08:07.289548+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.289548+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:11.820769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.239750+0000","last_change":"2024-09-18T02:08:23.239813+0000","last_active":"2024-09-18T02:08:23.239750+0000","last_peered":"2024-09-18T02:08:23.239750+0000","last_clean":"2024-09-18T02:08:23.239750+0000","last_became_active":"2024-09-18T02:03:59.555801+0000","last_became_peered":"2024-09-18T02:03:59.555801+0000","last_unstale":"2024-09-18T02:08:23.239750+0000","last_undegraded":"2024-09-18T02:08:23.239750+0000","last_fullsized":"2024-09-18T02:08:23.239750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.239523+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.239523+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.239523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:59.785045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:55.502208+0000","last_change":"2024-09-18T02:08:55.502263+0000","last_active":"2024-09-18T02:08:55.502208+0000","last_peered":"2024-09-18T02:08:55.502208+0000","last_clean":"2024-09-18T02:08:55.502208+0000","last_became_active":"2024-09-18T02:03:48.275709+0000","last_became_peered":"2024-09-18T02:03:48.275709+0000","last_unstale":"2024-09-18T02:08:55.502208+0000","last_undegraded":"2024-09-18T02:08:55.502208+0000","last_fullsized":"2024-09-18T02:08:55.502208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:55.502017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:55.502017+0000","last_clean_scrub_stamp":"2024-09-18T02:08:55.502017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:22:23.151201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00047579399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.852392+0000","last_change":"2024-09-18T02:08:36.852449+0000","last_active":"2024-09-18T02:08:36.852392+0000","last_peered":"2024-09-18T02:08:36.852392+0000","last_clean":"2024-09-18T02:08:36.852392+0000","last_became_active":"2024-09-18T02:03:57.520559+0000","last_became_peered":"2024-09-18T02:03:57.520559+0000","last_unstale":"2024-09-18T02:08:36.852392+0000","last_undegraded":"2024-09-18T02:08:36.852392+0000","last_fullsized":"2024-09-18T02:08:36.852392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:36.852193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:36.852193+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.852193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:13.004259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.201427+0000","last_change":"2024-09-18T02:07:55.201427+0000","last_active":"2024-09-18T02:07:55.201427+0000","last_peered":"2024-09-18T02:07:55.201427+0000","last_clean":"2024-09-18T02:07:55.201427+0000","last_became_active":"2024-09-18T02:04:01.561194+0000","last_became_peered":"2024-09-18T02:04:01.561194+0000","last_unstale":"2024-09-18T02:07:55.201427+0000","last_undegraded":"2024-09-18T02:07:55.201427+0000","last_fullsized":"2024-09-18T02:07:55.201427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:55.201180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:55.201180+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.201180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:25.554052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'297","reported_seq":530,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.127133+0000","last_change":"2024-09-18T02:07:51.127133+0000","last_active":"2024-09-18T02:07:51.127133+0000","last_peered":"2024-09-18T02:07:51.127133+0000","last_clean":"2024-09-18T02:07:51.127133+0000","last_became_active":"2024-09-18T02:04:03.570288+0000","last_became_peered":"2024-09-18T02:04:03.570288+0000","last_unstale":"2024-09-18T02:07:51.127133+0000","last_undegraded":"2024-09-18T02:07:51.127133+0000","last_fullsized":"2024-09-18T02:07:51.127133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'297","last_scrub_stamp":"2024-09-18T02:07:51.126820+0000","last_deep_scrub":"32'297","last_deep_scrub_stamp":"2024-09-18T02:07:51.126820+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.126820+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:09:07.313670+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.342738+0000","last_change":"2024-09-18T02:08:16.342738+0000","last_active":"2024-09-18T02:08:16.342738+0000","last_peered":"2024-09-18T02:08:16.342738+0000","last_clean":"2024-09-18T02:08:16.342738+0000","last_became_active":"2024-09-18T02:04:05.608544+0000","last_became_peered":"2024-09-18T02:04:05.608544+0000","last_unstale":"2024-09-18T02:08:16.342738+0000","last_undegraded":"2024-09-18T02:08:16.342738+0000","last_fullsized":"2024-09-18T02:08:16.342738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:16.342502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:16.342502+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.342502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:40.174283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.759186+0000","last_change":"2024-09-18T02:08:44.759249+0000","last_active":"2024-09-18T02:08:44.759186+0000","last_peered":"2024-09-18T02:08:44.759186+0000","last_clean":"2024-09-18T02:08:44.759186+0000","last_became_active":"2024-09-18T02:04:07.622337+0000","last_became_peered":"2024-09-18T02:04:07.622337+0000","last_unstale":"2024-09-18T02:08:44.759186+0000","last_undegraded":"2024-09-18T02:08:44.759186+0000","last_fullsized":"2024-09-18T02:08:44.759186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:08:44.758988+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:08:44.758988+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.758988+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:09.132745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.960512+0000","last_change":"2024-09-18T02:08:30.960574+0000","last_active":"2024-09-18T02:08:30.960512+0000","last_peered":"2024-09-18T02:08:30.960512+0000","last_clean":"2024-09-18T02:08:30.960512+0000","last_became_active":"2024-09-18T02:03:59.548308+0000","last_became_peered":"2024-09-18T02:03:59.548308+0000","last_unstale":"2024-09-18T02:08:30.960512+0000","last_undegraded":"2024-09-18T02:08:30.960512+0000","last_fullsized":"2024-09-18T02:08:30.960512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:30.960318+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:30.960318+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.960318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:16.857267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.300930+0000","last_change":"2024-09-18T02:08:29.300994+0000","last_active":"2024-09-18T02:08:29.300930+0000","last_peered":"2024-09-18T02:08:29.300930+0000","last_clean":"2024-09-18T02:08:29.300930+0000","last_became_active":"2024-09-18T02:03:48.275609+0000","last_became_peered":"2024-09-18T02:03:48.275609+0000","last_unstale":"2024-09-18T02:08:29.300930+0000","last_undegraded":"2024-09-18T02:08:29.300930+0000","last_fullsized":"2024-09-18T02:08:29.300930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:29.300685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:29.300685+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.300685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:56.209898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067244799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.874727+0000","last_change":"2024-09-18T02:08:35.874800+0000","last_active":"2024-09-18T02:08:35.874727+0000","last_peered":"2024-09-18T02:08:35.874727+0000","last_clean":"2024-09-18T02:08:35.874727+0000","last_became_active":"2024-09-18T02:03:57.520103+0000","last_became_peered":"2024-09-18T02:03:57.520103+0000","last_unstale":"2024-09-18T02:08:35.874727+0000","last_undegraded":"2024-09-18T02:08:35.874727+0000","last_fullsized":"2024-09-18T02:08:35.874727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:35.874487+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:35.874487+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.874487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:33.947180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.304457+0000","last_change":"2024-09-18T02:08:12.304457+0000","last_active":"2024-09-18T02:08:12.304457+0000","last_peered":"2024-09-18T02:08:12.304457+0000","last_clean":"2024-09-18T02:08:12.304457+0000","last_became_active":"2024-09-18T02:04:01.560471+0000","last_became_peered":"2024-09-18T02:04:01.560471+0000","last_unstale":"2024-09-18T02:08:12.304457+0000","last_undegraded":"2024-09-18T02:08:12.304457+0000","last_fullsized":"2024-09-18T02:08:12.304457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:12.304176+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:12.304176+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.304176+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:41:55.150843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'24","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.320487+0000","last_change":"2024-09-18T02:07:57.320487+0000","last_active":"2024-09-18T02:07:57.320487+0000","last_peered":"2024-09-18T02:07:57.320487+0000","last_clean":"2024-09-18T02:07:57.320487+0000","last_became_active":"2024-09-18T02:04:03.588913+0000","last_became_peered":"2024-09-18T02:04:03.588913+0000","last_unstale":"2024-09-18T02:07:57.320487+0000","last_undegraded":"2024-09-18T02:07:57.320487+0000","last_fullsized":"2024-09-18T02:07:57.320487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-18T02:07:57.320158+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-18T02:07:57.320158+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.320158+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:35.687439+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.317671+0000","last_change":"2024-09-18T02:07:49.317671+0000","last_active":"2024-09-18T02:07:49.317671+0000","last_peered":"2024-09-18T02:07:49.317671+0000","last_clean":"2024-09-18T02:07:49.317671+0000","last_became_active":"2024-09-18T02:04:05.588457+0000","last_became_peered":"2024-09-18T02:04:05.588457+0000","last_unstale":"2024-09-18T02:07:49.317671+0000","last_undegraded":"2024-09-18T02:07:49.317671+0000","last_fullsized":"2024-09-18T02:07:49.317671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:49.317338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:49.317338+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.317338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:39.956466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.998699+0000","last_change":"2024-09-18T02:04:07.622460+0000","last_active":"2024-09-18T02:07:47.998699+0000","last_peered":"2024-09-18T02:07:47.998699+0000","last_clean":"2024-09-18T02:07:47.998699+0000","last_became_active":"2024-09-18T02:04:07.621651+0000","last_became_peered":"2024-09-18T02:04:07.621651+0000","last_unstale":"2024-09-18T02:07:47.998699+0000","last_undegraded":"2024-09-18T02:07:47.998699+0000","last_fullsized":"2024-09-18T02:07:47.998699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.115264+0000","last_change":"2024-09-18T02:08:19.115318+0000","last_active":"2024-09-18T02:08:19.115264+0000","last_peered":"2024-09-18T02:08:19.115264+0000","last_clean":"2024-09-18T02:08:19.115264+0000","last_became_active":"2024-09-18T02:03:59.535693+0000","last_became_peered":"2024-09-18T02:03:59.535693+0000","last_unstale":"2024-09-18T02:08:19.115264+0000","last_undegraded":"2024-09-18T02:08:19.115264+0000","last_fullsized":"2024-09-18T02:08:19.115264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:19.115076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:19.115076+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.115076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:46.024290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:56.487804+0000","last_change":"2024-09-18T02:08:56.487926+0000","last_active":"2024-09-18T02:08:56.487804+0000","last_peered":"2024-09-18T02:08:56.487804+0000","last_clean":"2024-09-18T02:08:56.487804+0000","last_became_active":"2024-09-18T02:03:48.276543+0000","last_became_peered":"2024-09-18T02:03:48.276543+0000","last_unstale":"2024-09-18T02:08:56.487804+0000","last_undegraded":"2024-09-18T02:08:56.487804+0000","last_fullsized":"2024-09-18T02:08:56.487804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:08:56.487504+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:08:56.487504+0000","last_clean_scrub_stamp":"2024-09-18T02:08:56.487504+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:40.398764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023330579999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.200087+0000","last_change":"2024-09-18T02:08:20.200139+0000","last_active":"2024-09-18T02:08:20.200087+0000","last_peered":"2024-09-18T02:08:20.200087+0000","last_clean":"2024-09-18T02:08:20.200087+0000","last_became_active":"2024-09-18T02:03:57.528828+0000","last_became_peered":"2024-09-18T02:03:57.528828+0000","last_unstale":"2024-09-18T02:08:20.200087+0000","last_undegraded":"2024-09-18T02:08:20.200087+0000","last_fullsized":"2024-09-18T02:08:20.200087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.199864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.199864+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.199864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:12.451245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.216748+0000","last_change":"2024-09-18T02:08:04.216748+0000","last_active":"2024-09-18T02:08:04.216748+0000","last_peered":"2024-09-18T02:08:04.216748+0000","last_clean":"2024-09-18T02:08:04.216748+0000","last_became_active":"2024-09-18T02:04:01.571608+0000","last_became_peered":"2024-09-18T02:04:01.571608+0000","last_unstale":"2024-09-18T02:08:04.216748+0000","last_undegraded":"2024-09-18T02:08:04.216748+0000","last_fullsized":"2024-09-18T02:08:04.216748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:04.216468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:04.216468+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.216468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:07:30.815787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.228198+0000","last_change":"2024-09-18T02:08:13.228198+0000","last_active":"2024-09-18T02:08:13.228198+0000","last_peered":"2024-09-18T02:08:13.228198+0000","last_clean":"2024-09-18T02:08:13.228198+0000","last_became_active":"2024-09-18T02:04:03.601140+0000","last_became_peered":"2024-09-18T02:04:03.601140+0000","last_unstale":"2024-09-18T02:08:13.228198+0000","last_undegraded":"2024-09-18T02:08:13.228198+0000","last_fullsized":"2024-09-18T02:08:13.228198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-18T02:08:13.227917+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-18T02:08:13.227917+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.227917+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:13.717888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.268741+0000","last_change":"2024-09-18T02:08:20.268741+0000","last_active":"2024-09-18T02:08:20.268741+0000","last_peered":"2024-09-18T02:08:20.268741+0000","last_clean":"2024-09-18T02:08:20.268741+0000","last_became_active":"2024-09-18T02:04:05.612007+0000","last_became_peered":"2024-09-18T02:04:05.612007+0000","last_unstale":"2024-09-18T02:08:20.268741+0000","last_undegraded":"2024-09-18T02:08:20.268741+0000","last_fullsized":"2024-09-18T02:08:20.268741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.268474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.268474+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.268474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:28.013086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.802920+0000","last_change":"2024-09-18T02:08:43.802986+0000","last_active":"2024-09-18T02:08:43.802920+0000","last_peered":"2024-09-18T02:08:43.802920+0000","last_clean":"2024-09-18T02:08:43.802920+0000","last_became_active":"2024-09-18T02:04:07.622247+0000","last_became_peered":"2024-09-18T02:04:07.622247+0000","last_unstale":"2024-09-18T02:08:43.802920+0000","last_undegraded":"2024-09-18T02:08:43.802920+0000","last_fullsized":"2024-09-18T02:08:43.802920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:43.802726+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:43.802726+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.802726+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:20.348248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.783157+0000","last_change":"2024-09-18T02:08:06.783157+0000","last_active":"2024-09-18T02:08:06.783157+0000","last_peered":"2024-09-18T02:08:06.783157+0000","last_clean":"2024-09-18T02:08:06.783157+0000","last_became_active":"2024-09-18T02:03:59.559749+0000","last_became_peered":"2024-09-18T02:03:59.559749+0000","last_unstale":"2024-09-18T02:08:06.783157+0000","last_undegraded":"2024-09-18T02:08:06.783157+0000","last_fullsized":"2024-09-18T02:08:06.783157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:06.782905+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:06.782905+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.782905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:21:01.786933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.329691+0000","last_change":"2024-09-18T02:08:28.329750+0000","last_active":"2024-09-18T02:08:28.329691+0000","last_peered":"2024-09-18T02:08:28.329691+0000","last_clean":"2024-09-18T02:08:28.329691+0000","last_became_active":"2024-09-18T02:03:57.519961+0000","last_became_peered":"2024-09-18T02:03:57.519961+0000","last_unstale":"2024-09-18T02:08:28.329691+0000","last_undegraded":"2024-09-18T02:08:28.329691+0000","last_fullsized":"2024-09-18T02:08:28.329691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:28.329487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:28.329487+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.329487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:04.583889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.904522+0000","last_change":"2024-09-18T02:08:33.904577+0000","last_active":"2024-09-18T02:08:33.904522+0000","last_peered":"2024-09-18T02:08:33.904522+0000","last_clean":"2024-09-18T02:08:33.904522+0000","last_became_active":"2024-09-18T02:03:48.274657+0000","last_became_peered":"2024-09-18T02:03:48.274657+0000","last_unstale":"2024-09-18T02:08:33.904522+0000","last_undegraded":"2024-09-18T02:08:33.904522+0000","last_fullsized":"2024-09-18T02:08:33.904522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:33.904329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:33.904329+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.904329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:37:27.614303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000970169,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.206497+0000","last_change":"2024-09-18T02:08:05.206497+0000","last_active":"2024-09-18T02:08:05.206497+0000","last_peered":"2024-09-18T02:08:05.206497+0000","last_clean":"2024-09-18T02:08:05.206497+0000","last_became_active":"2024-09-18T02:04:01.571443+0000","last_became_peered":"2024-09-18T02:04:01.571443+0000","last_unstale":"2024-09-18T02:08:05.206497+0000","last_undegraded":"2024-09-18T02:08:05.206497+0000","last_fullsized":"2024-09-18T02:08:05.206497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:05.206220+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:05.206220+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.206220+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:45:50.192588+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'90","reported_seq":179,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.219597+0000","last_change":"2024-09-18T02:08:02.219597+0000","last_active":"2024-09-18T02:08:02.219597+0000","last_peered":"2024-09-18T02:08:02.219597+0000","last_clean":"2024-09-18T02:08:02.219597+0000","last_became_active":"2024-09-18T02:04:03.569938+0000","last_became_peered":"2024-09-18T02:04:03.569938+0000","last_unstale":"2024-09-18T02:08:02.219597+0000","last_undegraded":"2024-09-18T02:08:02.219597+0000","last_fullsized":"2024-09-18T02:08:02.219597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-09-18T02:08:02.219300+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-09-18T02:08:02.219300+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.219300+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:38.149380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.352767+0000","last_change":"2024-09-18T02:07:52.352767+0000","last_active":"2024-09-18T02:07:52.352767+0000","last_peered":"2024-09-18T02:07:52.352767+0000","last_clean":"2024-09-18T02:07:52.352767+0000","last_became_active":"2024-09-18T02:04:05.597181+0000","last_became_peered":"2024-09-18T02:04:05.597181+0000","last_unstale":"2024-09-18T02:07:52.352767+0000","last_undegraded":"2024-09-18T02:07:52.352767+0000","last_fullsized":"2024-09-18T02:07:52.352767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:52.352475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:52.352475+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.352475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:51:22.983509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.732465+0000","last_change":"2024-09-18T02:08:44.732531+0000","last_active":"2024-09-18T02:08:44.732465+0000","last_peered":"2024-09-18T02:08:44.732465+0000","last_clean":"2024-09-18T02:08:44.732465+0000","last_became_active":"2024-09-18T02:04:07.618751+0000","last_became_peered":"2024-09-18T02:04:07.618751+0000","last_unstale":"2024-09-18T02:08:44.732465+0000","last_undegraded":"2024-09-18T02:08:44.732465+0000","last_fullsized":"2024-09-18T02:08:44.732465+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-18T02:08:44.732277+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-18T02:08:44.732277+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.732277+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:19:46.289450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.681556+0000","last_change":"2024-09-18T02:08:14.681691+0000","last_active":"2024-09-18T02:08:14.681556+0000","last_peered":"2024-09-18T02:08:14.681556+0000","last_clean":"2024-09-18T02:08:14.681556+0000","last_became_active":"2024-09-18T02:03:59.553619+0000","last_became_peered":"2024-09-18T02:03:59.553619+0000","last_unstale":"2024-09-18T02:08:14.681556+0000","last_undegraded":"2024-09-18T02:08:14.681556+0000","last_fullsized":"2024-09-18T02:08:14.681556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:14.681214+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:14.681214+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.681214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:48.991814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.895974+0000","last_change":"2024-09-18T02:08:34.896041+0000","last_active":"2024-09-18T02:08:34.895974+0000","last_peered":"2024-09-18T02:08:34.895974+0000","last_clean":"2024-09-18T02:08:34.895974+0000","last_became_active":"2024-09-18T02:03:57.518503+0000","last_became_peered":"2024-09-18T02:03:57.518503+0000","last_unstale":"2024-09-18T02:08:34.895974+0000","last_undegraded":"2024-09-18T02:08:34.895974+0000","last_fullsized":"2024-09-18T02:08:34.895974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:34.895751+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:34.895751+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.895751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:58.727532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:57.460347+0000","last_change":"2024-09-18T02:08:57.460492+0000","last_active":"2024-09-18T02:08:57.460347+0000","last_peered":"2024-09-18T02:08:57.460347+0000","last_clean":"2024-09-18T02:08:57.460347+0000","last_became_active":"2024-09-18T02:03:48.276300+0000","last_became_peered":"2024-09-18T02:03:48.276300+0000","last_unstale":"2024-09-18T02:08:57.460347+0000","last_undegraded":"2024-09-18T02:08:57.460347+0000","last_fullsized":"2024-09-18T02:08:57.460347+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:57.460094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:57.460094+0000","last_clean_scrub_stamp":"2024-09-18T02:08:57.460094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:05.068134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002788245,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.199897+0000","last_change":"2024-09-18T02:08:01.199897+0000","last_active":"2024-09-18T02:08:01.199897+0000","last_peered":"2024-09-18T02:08:01.199897+0000","last_clean":"2024-09-18T02:08:01.199897+0000","last_became_active":"2024-09-18T02:04:01.557570+0000","last_became_peered":"2024-09-18T02:04:01.557570+0000","last_unstale":"2024-09-18T02:08:01.199897+0000","last_undegraded":"2024-09-18T02:08:01.199897+0000","last_fullsized":"2024-09-18T02:08:01.199897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:01.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:01.199648+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:22.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'28","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.127859+0000","last_change":"2024-09-18T02:07:48.127859+0000","last_active":"2024-09-18T02:07:48.127859+0000","last_peered":"2024-09-18T02:07:48.127859+0000","last_clean":"2024-09-18T02:07:48.127859+0000","last_became_active":"2024-09-18T02:04:03.588539+0000","last_became_peered":"2024-09-18T02:04:03.588539+0000","last_unstale":"2024-09-18T02:07:48.127859+0000","last_undegraded":"2024-09-18T02:07:48.127859+0000","last_fullsized":"2024-09-18T02:07:48.127859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-09-18T02:07:48.127557+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-09-18T02:07:48.127557+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.127557+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:55:43.485970+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.149355+0000","last_change":"2024-09-18T02:07:49.149355+0000","last_active":"2024-09-18T02:07:49.149355+0000","last_peered":"2024-09-18T02:07:49.149355+0000","last_clean":"2024-09-18T02:07:49.149355+0000","last_became_active":"2024-09-18T02:04:05.582477+0000","last_became_peered":"2024-09-18T02:04:05.582477+0000","last_unstale":"2024-09-18T02:07:49.149355+0000","last_undegraded":"2024-09-18T02:07:49.149355+0000","last_fullsized":"2024-09-18T02:07:49.149355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:49.149087+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:49.149087+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.149087+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:13.463449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.295297+0000","last_change":"2024-09-18T02:08:28.295297+0000","last_active":"2024-09-18T02:08:28.295297+0000","last_peered":"2024-09-18T02:08:28.295297+0000","last_clean":"2024-09-18T02:08:28.295297+0000","last_became_active":"2024-09-18T02:04:07.605591+0000","last_became_peered":"2024-09-18T02:04:07.605591+0000","last_unstale":"2024-09-18T02:08:28.295297+0000","last_undegraded":"2024-09-18T02:08:28.295297+0000","last_fullsized":"2024-09-18T02:08:28.295297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:28.295047+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:28.295047+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.295047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:36:50.563195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.280299+0000","last_change":"2024-09-18T02:08:19.280466+0000","last_active":"2024-09-18T02:08:19.280299+0000","last_peered":"2024-09-18T02:08:19.280299+0000","last_clean":"2024-09-18T02:08:19.280299+0000","last_became_active":"2024-09-18T02:03:59.559044+0000","last_became_peered":"2024-09-18T02:03:59.559044+0000","last_unstale":"2024-09-18T02:08:19.280299+0000","last_undegraded":"2024-09-18T02:08:19.280299+0000","last_fullsized":"2024-09-18T02:08:19.280299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:19.280064+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:19.280064+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.280064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:03.804854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:00.502904+0000","last_change":"2024-09-18T02:09:00.502957+0000","last_active":"2024-09-18T02:09:00.502904+0000","last_peered":"2024-09-18T02:09:00.502904+0000","last_clean":"2024-09-18T02:09:00.502904+0000","last_became_active":"2024-09-18T02:03:57.521706+0000","last_became_peered":"2024-09-18T02:03:57.521706+0000","last_unstale":"2024-09-18T02:09:00.502904+0000","last_undegraded":"2024-09-18T02:09:00.502904+0000","last_fullsized":"2024-09-18T02:09:00.502904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:09:00.502706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:09:00.502706+0000","last_clean_scrub_stamp":"2024-09-18T02:09:00.502706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:07:55.664950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.924188+0000","last_change":"2024-09-18T02:08:32.924244+0000","last_active":"2024-09-18T02:08:32.924188+0000","last_peered":"2024-09-18T02:08:32.924188+0000","last_clean":"2024-09-18T02:08:32.924188+0000","last_became_active":"2024-09-18T02:03:48.274030+0000","last_became_peered":"2024-09-18T02:03:48.274030+0000","last_unstale":"2024-09-18T02:08:32.924188+0000","last_undegraded":"2024-09-18T02:08:32.924188+0000","last_fullsized":"2024-09-18T02:08:32.924188+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:32.923996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:32.923996+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.923996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:19.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011092910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.183292+0000","last_change":"2024-09-18T02:07:59.183292+0000","last_active":"2024-09-18T02:07:59.183292+0000","last_peered":"2024-09-18T02:07:59.183292+0000","last_clean":"2024-09-18T02:07:59.183292+0000","last_became_active":"2024-09-18T02:04:01.558915+0000","last_became_peered":"2024-09-18T02:04:01.558915+0000","last_unstale":"2024-09-18T02:07:59.183292+0000","last_undegraded":"2024-09-18T02:07:59.183292+0000","last_fullsized":"2024-09-18T02:07:59.183292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:59.183052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:59.183052+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.183052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:35.437454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.328507+0000","last_change":"2024-09-18T02:07:52.328507+0000","last_active":"2024-09-18T02:07:52.328507+0000","last_peered":"2024-09-18T02:07:52.328507+0000","last_clean":"2024-09-18T02:07:52.328507+0000","last_became_active":"2024-09-18T02:04:03.591378+0000","last_became_peered":"2024-09-18T02:04:03.591378+0000","last_unstale":"2024-09-18T02:07:52.328507+0000","last_undegraded":"2024-09-18T02:07:52.328507+0000","last_fullsized":"2024-09-18T02:07:52.328507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-18T02:07:52.328188+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-18T02:07:52.328188+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.328188+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:26.638787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.282096+0000","last_change":"2024-09-18T02:07:55.282096+0000","last_active":"2024-09-18T02:07:55.282096+0000","last_peered":"2024-09-18T02:07:55.282096+0000","last_clean":"2024-09-18T02:07:55.282096+0000","last_became_active":"2024-09-18T02:04:05.605265+0000","last_became_peered":"2024-09-18T02:04:05.605265+0000","last_unstale":"2024-09-18T02:07:55.282096+0000","last_undegraded":"2024-09-18T02:07:55.282096+0000","last_fullsized":"2024-09-18T02:07:55.282096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:55.281840+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:55.281840+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.281840+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:15.115042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:46.750170+0000","last_change":"2024-09-18T02:08:46.750236+0000","last_active":"2024-09-18T02:08:46.750170+0000","last_peered":"2024-09-18T02:08:46.750170+0000","last_clean":"2024-09-18T02:08:46.750170+0000","last_became_active":"2024-09-18T02:04:07.624085+0000","last_became_peered":"2024-09-18T02:04:07.624085+0000","last_unstale":"2024-09-18T02:08:46.750170+0000","last_undegraded":"2024-09-18T02:08:46.750170+0000","last_fullsized":"2024-09-18T02:08:46.750170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:08:46.749974+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:08:46.749974+0000","last_clean_scrub_stamp":"2024-09-18T02:08:46.749974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:19:48.307147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.250825+0000","last_change":"2024-09-18T02:08:15.250887+0000","last_active":"2024-09-18T02:08:15.250825+0000","last_peered":"2024-09-18T02:08:15.250825+0000","last_clean":"2024-09-18T02:08:15.250825+0000","last_became_active":"2024-09-18T02:03:59.535266+0000","last_became_peered":"2024-09-18T02:03:59.535266+0000","last_unstale":"2024-09-18T02:08:15.250825+0000","last_undegraded":"2024-09-18T02:08:15.250825+0000","last_fullsized":"2024-09-18T02:08:15.250825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:15.250637+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:15.250637+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.250637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:15.097705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.764764+0000","last_change":"2024-09-18T02:08:23.764827+0000","last_active":"2024-09-18T02:08:23.764764+0000","last_peered":"2024-09-18T02:08:23.764764+0000","last_clean":"2024-09-18T02:08:23.764764+0000","last_became_active":"2024-09-18T02:03:57.528676+0000","last_became_peered":"2024-09-18T02:03:57.528676+0000","last_unstale":"2024-09-18T02:08:23.764764+0000","last_undegraded":"2024-09-18T02:08:23.764764+0000","last_fullsized":"2024-09-18T02:08:23.764764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:23.764549+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:23.764549+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.764549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:45.428464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:58.462346+0000","last_change":"2024-09-18T02:08:58.462405+0000","last_active":"2024-09-18T02:08:58.462346+0000","last_peered":"2024-09-18T02:08:58.462346+0000","last_clean":"2024-09-18T02:08:58.462346+0000","last_became_active":"2024-09-18T02:03:48.396609+0000","last_became_peered":"2024-09-18T02:03:48.396609+0000","last_unstale":"2024-09-18T02:08:58.462346+0000","last_undegraded":"2024-09-18T02:08:58.462346+0000","last_fullsized":"2024-09-18T02:08:58.462346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:58.462158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:58.462158+0000","last_clean_scrub_stamp":"2024-09-18T02:08:58.462158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:00.953633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0025902970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.230746+0000","last_change":"2024-09-18T02:07:54.230746+0000","last_active":"2024-09-18T02:07:54.230746+0000","last_peered":"2024-09-18T02:07:54.230746+0000","last_clean":"2024-09-18T02:07:54.230746+0000","last_became_active":"2024-09-18T02:04:01.561488+0000","last_became_peered":"2024-09-18T02:04:01.561488+0000","last_unstale":"2024-09-18T02:07:54.230746+0000","last_undegraded":"2024-09-18T02:07:54.230746+0000","last_fullsized":"2024-09-18T02:07:54.230746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.230358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.230358+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.230358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:40.139193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'103","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.275633+0000","last_change":"2024-09-18T02:07:58.275633+0000","last_active":"2024-09-18T02:07:58.275633+0000","last_peered":"2024-09-18T02:07:58.275633+0000","last_clean":"2024-09-18T02:07:58.275633+0000","last_became_active":"2024-09-18T02:04:03.585879+0000","last_became_peered":"2024-09-18T02:04:03.585879+0000","last_unstale":"2024-09-18T02:07:58.275633+0000","last_undegraded":"2024-09-18T02:07:58.275633+0000","last_fullsized":"2024-09-18T02:07:58.275633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'103","last_scrub_stamp":"2024-09-18T02:07:58.275354+0000","last_deep_scrub":"32'103","last_deep_scrub_stamp":"2024-09-18T02:07:58.275354+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.275354+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:34:23.917223+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.300909+0000","last_change":"2024-09-18T02:07:48.300909+0000","last_active":"2024-09-18T02:07:48.300909+0000","last_peered":"2024-09-18T02:07:48.300909+0000","last_clean":"2024-09-18T02:07:48.300909+0000","last_became_active":"2024-09-18T02:04:05.588676+0000","last_became_peered":"2024-09-18T02:04:05.588676+0000","last_unstale":"2024-09-18T02:07:48.300909+0000","last_undegraded":"2024-09-18T02:07:48.300909+0000","last_fullsized":"2024-09-18T02:07:48.300909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.300757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.300757+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.300757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:52:41.278180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.274232+0000","last_change":"2024-09-18T02:07:59.274232+0000","last_active":"2024-09-18T02:07:59.274232+0000","last_peered":"2024-09-18T02:07:59.274232+0000","last_clean":"2024-09-18T02:07:59.274232+0000","last_became_active":"2024-09-18T02:04:07.619587+0000","last_became_peered":"2024-09-18T02:04:07.619587+0000","last_unstale":"2024-09-18T02:07:59.274232+0000","last_undegraded":"2024-09-18T02:07:59.274232+0000","last_fullsized":"2024-09-18T02:07:59.274232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:07:59.273974+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:07:59.273974+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.273974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:10.696295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.299098+0000","last_change":"2024-09-18T02:08:03.299098+0000","last_active":"2024-09-18T02:08:03.299098+0000","last_peered":"2024-09-18T02:08:03.299098+0000","last_clean":"2024-09-18T02:08:03.299098+0000","last_became_active":"2024-09-18T02:04:07.626396+0000","last_became_peered":"2024-09-18T02:04:07.626396+0000","last_unstale":"2024-09-18T02:08:03.299098+0000","last_undegraded":"2024-09-18T02:08:03.299098+0000","last_fullsized":"2024-09-18T02:08:03.299098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:03.298850+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:03.298850+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.298850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:43:53.827265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.214400+0000","last_change":"2024-09-18T02:08:23.214400+0000","last_active":"2024-09-18T02:08:23.214400+0000","last_peered":"2024-09-18T02:08:23.214400+0000","last_clean":"2024-09-18T02:08:23.214400+0000","last_became_active":"2024-09-18T02:03:59.538280+0000","last_became_peered":"2024-09-18T02:03:59.538280+0000","last_unstale":"2024-09-18T02:08:23.214400+0000","last_undegraded":"2024-09-18T02:08:23.214400+0000","last_fullsized":"2024-09-18T02:08:23.214400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.214126+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.214126+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.214126+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:36.362222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:46.544838+0000","last_change":"2024-09-18T02:08:46.544890+0000","last_active":"2024-09-18T02:08:46.544838+0000","last_peered":"2024-09-18T02:08:46.544838+0000","last_clean":"2024-09-18T02:08:46.544838+0000","last_became_active":"2024-09-18T02:03:57.530751+0000","last_became_peered":"2024-09-18T02:03:57.530751+0000","last_unstale":"2024-09-18T02:08:46.544838+0000","last_undegraded":"2024-09-18T02:08:46.544838+0000","last_fullsized":"2024-09-18T02:08:46.544838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:46.544649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:46.544649+0000","last_clean_scrub_stamp":"2024-09-18T02:08:46.544649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:07:24.141178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.781701+0000","last_change":"2024-09-18T02:08:05.781701+0000","last_active":"2024-09-18T02:08:05.781701+0000","last_peered":"2024-09-18T02:08:05.781701+0000","last_clean":"2024-09-18T02:08:05.781701+0000","last_became_active":"2024-09-18T02:04:01.561230+0000","last_became_peered":"2024-09-18T02:04:01.561230+0000","last_unstale":"2024-09-18T02:08:05.781701+0000","last_undegraded":"2024-09-18T02:08:05.781701+0000","last_fullsized":"2024-09-18T02:08:05.781701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:05.781451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:05.781451+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.781451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:05.813452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'47","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.175717+0000","last_change":"2024-09-18T02:07:58.175717+0000","last_active":"2024-09-18T02:07:58.175717+0000","last_peered":"2024-09-18T02:07:58.175717+0000","last_clean":"2024-09-18T02:07:58.175717+0000","last_became_active":"2024-09-18T02:04:03.595284+0000","last_became_peered":"2024-09-18T02:04:03.595284+0000","last_unstale":"2024-09-18T02:07:58.175717+0000","last_undegraded":"2024-09-18T02:07:58.175717+0000","last_fullsized":"2024-09-18T02:07:58.175717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-18T02:07:58.175442+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-18T02:07:58.175442+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.175442+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:34.582776+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.235985+0000","last_change":"2024-09-18T02:08:06.235985+0000","last_active":"2024-09-18T02:08:06.235985+0000","last_peered":"2024-09-18T02:08:06.235985+0000","last_clean":"2024-09-18T02:08:06.235985+0000","last_became_active":"2024-09-18T02:04:05.602528+0000","last_became_peered":"2024-09-18T02:04:05.602528+0000","last_unstale":"2024-09-18T02:08:06.235985+0000","last_undegraded":"2024-09-18T02:08:06.235985+0000","last_fullsized":"2024-09-18T02:08:06.235985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:06.235742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:06.235742+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.235742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:35:36.200312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:46.820783+0000","last_change":"2024-09-18T02:08:46.820906+0000","last_active":"2024-09-18T02:08:46.820783+0000","last_peered":"2024-09-18T02:08:46.820783+0000","last_clean":"2024-09-18T02:08:46.820783+0000","last_became_active":"2024-09-18T02:04:07.622753+0000","last_became_peered":"2024-09-18T02:04:07.622753+0000","last_unstale":"2024-09-18T02:08:46.820783+0000","last_undegraded":"2024-09-18T02:08:46.820783+0000","last_fullsized":"2024-09-18T02:08:46.820783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:08:46.820551+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:08:46.820551+0000","last_clean_scrub_stamp":"2024-09-18T02:08:46.820551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:21:14.133758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.791428+0000","last_change":"2024-09-18T02:08:07.791428+0000","last_active":"2024-09-18T02:08:07.791428+0000","last_peered":"2024-09-18T02:08:07.791428+0000","last_clean":"2024-09-18T02:08:07.791428+0000","last_became_active":"2024-09-18T02:03:59.554803+0000","last_became_peered":"2024-09-18T02:03:59.554803+0000","last_unstale":"2024-09-18T02:08:07.791428+0000","last_undegraded":"2024-09-18T02:08:07.791428+0000","last_fullsized":"2024-09-18T02:08:07.791428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:07.791070+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:07.791070+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.791070+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:07.638138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.306675+0000","last_change":"2024-09-18T02:08:32.306675+0000","last_active":"2024-09-18T02:08:32.306675+0000","last_peered":"2024-09-18T02:08:32.306675+0000","last_clean":"2024-09-18T02:08:32.306675+0000","last_became_active":"2024-09-18T02:03:57.519403+0000","last_became_peered":"2024-09-18T02:03:57.519403+0000","last_unstale":"2024-09-18T02:08:32.306675+0000","last_undegraded":"2024-09-18T02:08:32.306675+0000","last_fullsized":"2024-09-18T02:08:32.306675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:32.306349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:32.306349+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.306349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:18.134340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.195649+0000","last_change":"2024-09-18T02:07:57.195649+0000","last_active":"2024-09-18T02:07:57.195649+0000","last_peered":"2024-09-18T02:07:57.195649+0000","last_clean":"2024-09-18T02:07:57.195649+0000","last_became_active":"2024-09-18T02:04:01.558788+0000","last_became_peered":"2024-09-18T02:04:01.558788+0000","last_unstale":"2024-09-18T02:07:57.195649+0000","last_undegraded":"2024-09-18T02:07:57.195649+0000","last_fullsized":"2024-09-18T02:07:57.195649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:57.195366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:57.195366+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.195366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:25.351307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.260300+0000","last_change":"2024-09-18T02:07:57.260300+0000","last_active":"2024-09-18T02:07:57.260300+0000","last_peered":"2024-09-18T02:07:57.260300+0000","last_clean":"2024-09-18T02:07:57.260300+0000","last_became_active":"2024-09-18T02:04:03.581045+0000","last_became_peered":"2024-09-18T02:04:03.581045+0000","last_unstale":"2024-09-18T02:07:57.260300+0000","last_undegraded":"2024-09-18T02:07:57.260300+0000","last_fullsized":"2024-09-18T02:07:57.260300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:07:57.259885+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:07:57.259885+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.259885+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:36.754049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.344690+0000","last_change":"2024-09-18T02:07:53.344690+0000","last_active":"2024-09-18T02:07:53.344690+0000","last_peered":"2024-09-18T02:07:53.344690+0000","last_clean":"2024-09-18T02:07:53.344690+0000","last_became_active":"2024-09-18T02:04:05.599064+0000","last_became_peered":"2024-09-18T02:04:05.599064+0000","last_unstale":"2024-09-18T02:07:53.344690+0000","last_undegraded":"2024-09-18T02:07:53.344690+0000","last_fullsized":"2024-09-18T02:07:53.344690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.344462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.344462+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.344462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:17:03.855166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.828168+0000","last_change":"2024-09-18T02:08:41.828227+0000","last_active":"2024-09-18T02:08:41.828168+0000","last_peered":"2024-09-18T02:08:41.828168+0000","last_clean":"2024-09-18T02:08:41.828168+0000","last_became_active":"2024-09-18T02:04:07.609954+0000","last_became_peered":"2024-09-18T02:04:07.609954+0000","last_unstale":"2024-09-18T02:08:41.828168+0000","last_undegraded":"2024-09-18T02:08:41.828168+0000","last_fullsized":"2024-09-18T02:08:41.828168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:41.827965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:41.827965+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.827965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:18.373487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.117771+0000","last_change":"2024-09-18T02:08:16.117771+0000","last_active":"2024-09-18T02:08:16.117771+0000","last_peered":"2024-09-18T02:08:16.117771+0000","last_clean":"2024-09-18T02:08:16.117771+0000","last_became_active":"2024-09-18T02:03:59.549791+0000","last_became_peered":"2024-09-18T02:03:59.549791+0000","last_unstale":"2024-09-18T02:08:16.117771+0000","last_undegraded":"2024-09-18T02:08:16.117771+0000","last_fullsized":"2024-09-18T02:08:16.117771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:16.117501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:16.117501+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.117501+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:44.273442+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.148371+0000","last_change":"2024-09-18T02:08:42.148371+0000","last_active":"2024-09-18T02:08:42.148371+0000","last_peered":"2024-09-18T02:08:42.148371+0000","last_clean":"2024-09-18T02:08:42.148371+0000","last_became_active":"2024-09-18T02:04:36.370188+0000","last_became_peered":"2024-09-18T02:04:36.370188+0000","last_unstale":"2024-09-18T02:08:42.148371+0000","last_undegraded":"2024-09-18T02:08:42.148371+0000","last_fullsized":"2024-09-18T02:08:42.148371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:42.148035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:42.148035+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.148035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:28.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.309363+0000","last_change":"2024-09-18T02:08:10.309363+0000","last_active":"2024-09-18T02:08:10.309363+0000","last_peered":"2024-09-18T02:08:10.309363+0000","last_clean":"2024-09-18T02:08:10.309363+0000","last_became_active":"2024-09-18T02:04:01.562586+0000","last_became_peered":"2024-09-18T02:04:01.562586+0000","last_unstale":"2024-09-18T02:08:10.309363+0000","last_undegraded":"2024-09-18T02:08:10.309363+0000","last_fullsized":"2024-09-18T02:08:10.309363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:10.309081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:10.309081+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.309081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:18.629970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'50","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.231588+0000","last_change":"2024-09-18T02:07:58.231588+0000","last_active":"2024-09-18T02:07:58.231588+0000","last_peered":"2024-09-18T02:07:58.231588+0000","last_clean":"2024-09-18T02:07:58.231588+0000","last_became_active":"2024-09-18T02:04:03.578581+0000","last_became_peered":"2024-09-18T02:04:03.578581+0000","last_unstale":"2024-09-18T02:07:58.231588+0000","last_undegraded":"2024-09-18T02:07:58.231588+0000","last_fullsized":"2024-09-18T02:07:58.231588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'50","last_scrub_stamp":"2024-09-18T02:07:58.231292+0000","last_deep_scrub":"32'50","last_deep_scrub_stamp":"2024-09-18T02:07:58.231292+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.231292+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:28.484821+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.089343+0000","last_change":"2024-09-18T02:07:53.089343+0000","last_active":"2024-09-18T02:07:53.089343+0000","last_peered":"2024-09-18T02:07:53.089343+0000","last_clean":"2024-09-18T02:07:53.089343+0000","last_became_active":"2024-09-18T02:04:05.586978+0000","last_became_peered":"2024-09-18T02:04:05.586978+0000","last_unstale":"2024-09-18T02:07:53.089343+0000","last_undegraded":"2024-09-18T02:07:53.089343+0000","last_fullsized":"2024-09-18T02:07:53.089343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.089086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.089086+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.089086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:43.728215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.510661+0000","last_change":"2024-09-18T02:08:36.510782+0000","last_active":"2024-09-18T02:08:36.510661+0000","last_peered":"2024-09-18T02:08:36.510661+0000","last_clean":"2024-09-18T02:08:36.510661+0000","last_became_active":"2024-09-18T02:04:07.607227+0000","last_became_peered":"2024-09-18T02:04:07.607227+0000","last_unstale":"2024-09-18T02:08:36.510661+0000","last_undegraded":"2024-09-18T02:08:36.510661+0000","last_fullsized":"2024-09-18T02:08:36.510661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:36.510432+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:36.510432+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.510432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:05:18.157288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.418342+0000","last_change":"2024-09-18T02:08:31.418342+0000","last_active":"2024-09-18T02:08:31.418342+0000","last_peered":"2024-09-18T02:08:31.418342+0000","last_clean":"2024-09-18T02:08:31.418342+0000","last_became_active":"2024-09-18T02:03:59.550221+0000","last_became_peered":"2024-09-18T02:03:59.550221+0000","last_unstale":"2024-09-18T02:08:31.418342+0000","last_undegraded":"2024-09-18T02:08:31.418342+0000","last_fullsized":"2024-09-18T02:08:31.418342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:31.418082+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:31.418082+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.418082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:38.837680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.766183+0000","last_change":"2024-09-18T02:08:29.766183+0000","last_active":"2024-09-18T02:08:29.766183+0000","last_peered":"2024-09-18T02:08:29.766183+0000","last_clean":"2024-09-18T02:08:29.766183+0000","last_became_active":"2024-09-18T02:03:57.522590+0000","last_became_peered":"2024-09-18T02:03:57.522590+0000","last_unstale":"2024-09-18T02:08:29.766183+0000","last_undegraded":"2024-09-18T02:08:29.766183+0000","last_fullsized":"2024-09-18T02:08:29.766183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:29.765913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:29.765913+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.765913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:38.112707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.399749+0000","last_change":"2024-09-18T02:07:48.399749+0000","last_active":"2024-09-18T02:07:48.399749+0000","last_peered":"2024-09-18T02:07:48.399749+0000","last_clean":"2024-09-18T02:07:48.399749+0000","last_became_active":"2024-09-18T02:04:01.566205+0000","last_became_peered":"2024-09-18T02:04:01.566205+0000","last_unstale":"2024-09-18T02:07:48.399749+0000","last_undegraded":"2024-09-18T02:07:48.399749+0000","last_fullsized":"2024-09-18T02:07:48.399749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.399488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.399488+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.399488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:47.098447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.319259+0000","last_change":"2024-09-18T02:08:00.319259+0000","last_active":"2024-09-18T02:08:00.319259+0000","last_peered":"2024-09-18T02:08:00.319259+0000","last_clean":"2024-09-18T02:08:00.319259+0000","last_became_active":"2024-09-18T02:04:03.580770+0000","last_became_peered":"2024-09-18T02:04:03.580770+0000","last_unstale":"2024-09-18T02:08:00.319259+0000","last_undegraded":"2024-09-18T02:08:00.319259+0000","last_fullsized":"2024-09-18T02:08:00.319259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-18T02:08:00.318990+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-18T02:08:00.318990+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.318990+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:50.958119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.368006+0000","last_change":"2024-09-18T02:07:54.368006+0000","last_active":"2024-09-18T02:07:54.368006+0000","last_peered":"2024-09-18T02:07:54.368006+0000","last_clean":"2024-09-18T02:07:54.368006+0000","last_became_active":"2024-09-18T02:04:05.591514+0000","last_became_peered":"2024-09-18T02:04:05.591514+0000","last_unstale":"2024-09-18T02:07:54.368006+0000","last_undegraded":"2024-09-18T02:07:54.368006+0000","last_fullsized":"2024-09-18T02:07:54.368006+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.367760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.367760+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.367760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:57.231313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.224665+0000","last_change":"2024-09-18T02:08:25.224723+0000","last_active":"2024-09-18T02:08:25.224665+0000","last_peered":"2024-09-18T02:08:25.224665+0000","last_clean":"2024-09-18T02:08:25.224665+0000","last_became_active":"2024-09-18T02:03:59.553660+0000","last_became_peered":"2024-09-18T02:03:59.553660+0000","last_unstale":"2024-09-18T02:08:25.224665+0000","last_undegraded":"2024-09-18T02:08:25.224665+0000","last_fullsized":"2024-09-18T02:08:25.224665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:25.224477+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:25.224477+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.224477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:18.652044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.542257+0000","last_change":"2024-09-18T02:08:39.542257+0000","last_active":"2024-09-18T02:08:39.542257+0000","last_peered":"2024-09-18T02:08:39.542257+0000","last_clean":"2024-09-18T02:08:39.542257+0000","last_became_active":"2024-09-18T02:03:57.526941+0000","last_became_peered":"2024-09-18T02:03:57.526941+0000","last_unstale":"2024-09-18T02:08:39.542257+0000","last_undegraded":"2024-09-18T02:08:39.542257+0000","last_fullsized":"2024-09-18T02:08:39.542257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:39.541993+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:39.541993+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.541993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:31.678647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.188438+0000","last_change":"2024-09-18T02:08:10.188544+0000","last_active":"2024-09-18T02:08:10.188438+0000","last_peered":"2024-09-18T02:08:10.188438+0000","last_clean":"2024-09-18T02:08:10.188438+0000","last_became_active":"2024-09-18T02:04:01.559839+0000","last_became_peered":"2024-09-18T02:04:01.559839+0000","last_unstale":"2024-09-18T02:08:10.188438+0000","last_undegraded":"2024-09-18T02:08:10.188438+0000","last_fullsized":"2024-09-18T02:08:10.188438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:10.188213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:10.188213+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.188213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:22:05.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'71","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.245115+0000","last_change":"2024-09-18T02:07:56.245115+0000","last_active":"2024-09-18T02:07:56.245115+0000","last_peered":"2024-09-18T02:07:56.245115+0000","last_clean":"2024-09-18T02:07:56.245115+0000","last_became_active":"2024-09-18T02:04:03.581518+0000","last_became_peered":"2024-09-18T02:04:03.581518+0000","last_unstale":"2024-09-18T02:07:56.245115+0000","last_undegraded":"2024-09-18T02:07:56.245115+0000","last_fullsized":"2024-09-18T02:07:56.245115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'71","last_scrub_stamp":"2024-09-18T02:07:56.244855+0000","last_deep_scrub":"32'71","last_deep_scrub_stamp":"2024-09-18T02:07:56.244855+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.244855+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:40.886685+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.238697+0000","last_change":"2024-09-18T02:07:48.238697+0000","last_active":"2024-09-18T02:07:48.238697+0000","last_peered":"2024-09-18T02:07:48.238697+0000","last_clean":"2024-09-18T02:07:48.238697+0000","last_became_active":"2024-09-18T02:04:05.610007+0000","last_became_peered":"2024-09-18T02:04:05.610007+0000","last_unstale":"2024-09-18T02:07:48.238697+0000","last_undegraded":"2024-09-18T02:07:48.238697+0000","last_fullsized":"2024-09-18T02:07:48.238697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.238443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.238443+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.238443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:49:49.194989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'20","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.091700+0000","last_change":"2024-09-18T02:08:15.091700+0000","last_active":"2024-09-18T02:08:15.091700+0000","last_peered":"2024-09-18T02:08:15.091700+0000","last_clean":"2024-09-18T02:08:15.091700+0000","last_became_active":"2024-09-18T02:04:07.609058+0000","last_became_peered":"2024-09-18T02:04:07.609058+0000","last_unstale":"2024-09-18T02:08:15.091700+0000","last_undegraded":"2024-09-18T02:08:15.091700+0000","last_fullsized":"2024-09-18T02:08:15.091700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-18T02:08:15.091443+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-18T02:08:15.091443+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.091443+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:45.320119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.012222+0000","last_change":"2024-09-18T02:08:27.012287+0000","last_active":"2024-09-18T02:08:27.012222+0000","last_peered":"2024-09-18T02:08:27.012222+0000","last_clean":"2024-09-18T02:08:27.012222+0000","last_became_active":"2024-09-18T02:03:59.540971+0000","last_became_peered":"2024-09-18T02:03:59.540971+0000","last_unstale":"2024-09-18T02:08:27.012222+0000","last_undegraded":"2024-09-18T02:08:27.012222+0000","last_fullsized":"2024-09-18T02:08:27.012222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:27.012027+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:27.012027+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.012027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:07:36.140644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.865777+0000","last_change":"2024-09-18T02:08:35.865777+0000","last_active":"2024-09-18T02:08:35.865777+0000","last_peered":"2024-09-18T02:08:35.865777+0000","last_clean":"2024-09-18T02:08:35.865777+0000","last_became_active":"2024-09-18T02:03:57.518311+0000","last_became_peered":"2024-09-18T02:03:57.518311+0000","last_unstale":"2024-09-18T02:08:35.865777+0000","last_undegraded":"2024-09-18T02:08:35.865777+0000","last_fullsized":"2024-09-18T02:08:35.865777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:35.865415+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:35.865415+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.865415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:22.501985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.276033+0000","last_change":"2024-09-18T02:08:09.276033+0000","last_active":"2024-09-18T02:08:09.276033+0000","last_peered":"2024-09-18T02:08:09.276033+0000","last_clean":"2024-09-18T02:08:09.276033+0000","last_became_active":"2024-09-18T02:04:01.563285+0000","last_became_peered":"2024-09-18T02:04:01.563285+0000","last_unstale":"2024-09-18T02:08:09.276033+0000","last_undegraded":"2024-09-18T02:08:09.276033+0000","last_fullsized":"2024-09-18T02:08:09.276033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:09.275778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:09.275778+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.275778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:39.529307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'47","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.348431+0000","last_change":"2024-09-18T02:08:17.348431+0000","last_active":"2024-09-18T02:08:17.348431+0000","last_peered":"2024-09-18T02:08:17.348431+0000","last_clean":"2024-09-18T02:08:17.348431+0000","last_became_active":"2024-09-18T02:04:03.596605+0000","last_became_peered":"2024-09-18T02:04:03.596605+0000","last_unstale":"2024-09-18T02:08:17.348431+0000","last_undegraded":"2024-09-18T02:08:17.348431+0000","last_fullsized":"2024-09-18T02:08:17.348431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-18T02:08:17.348103+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-18T02:08:17.348103+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.348103+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:15.420796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.941998+0000","last_change":"2024-09-18T02:07:56.941998+0000","last_active":"2024-09-18T02:07:56.941998+0000","last_peered":"2024-09-18T02:07:56.941998+0000","last_clean":"2024-09-18T02:07:56.941998+0000","last_became_active":"2024-09-18T02:04:05.589023+0000","last_became_peered":"2024-09-18T02:04:05.589023+0000","last_unstale":"2024-09-18T02:07:56.941998+0000","last_undegraded":"2024-09-18T02:07:56.941998+0000","last_fullsized":"2024-09-18T02:07:56.941998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:56.941733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:56.941733+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.941733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:18.501298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.998917+0000","last_change":"2024-09-18T02:04:07.625988+0000","last_active":"2024-09-18T02:07:47.998917+0000","last_peered":"2024-09-18T02:07:47.998917+0000","last_clean":"2024-09-18T02:07:47.998917+0000","last_became_active":"2024-09-18T02:04:07.625440+0000","last_became_peered":"2024-09-18T02:04:07.625440+0000","last_unstale":"2024-09-18T02:07:47.998917+0000","last_undegraded":"2024-09-18T02:07:47.998917+0000","last_fullsized":"2024-09-18T02:07:47.998917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.216266+0000","last_change":"2024-09-18T02:08:02.216266+0000","last_active":"2024-09-18T02:08:02.216266+0000","last_peered":"2024-09-18T02:08:02.216266+0000","last_clean":"2024-09-18T02:08:02.216266+0000","last_became_active":"2024-09-18T02:03:59.561208+0000","last_became_peered":"2024-09-18T02:03:59.561208+0000","last_unstale":"2024-09-18T02:08:02.216266+0000","last_undegraded":"2024-09-18T02:08:02.216266+0000","last_fullsized":"2024-09-18T02:08:02.216266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:02.216020+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:02.216020+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.216020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:52.878948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.792480+0000","last_change":"2024-09-18T02:08:40.792480+0000","last_active":"2024-09-18T02:08:40.792480+0000","last_peered":"2024-09-18T02:08:40.792480+0000","last_clean":"2024-09-18T02:08:40.792480+0000","last_became_active":"2024-09-18T02:03:57.520569+0000","last_became_peered":"2024-09-18T02:03:57.520569+0000","last_unstale":"2024-09-18T02:08:40.792480+0000","last_undegraded":"2024-09-18T02:08:40.792480+0000","last_fullsized":"2024-09-18T02:08:40.792480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:40.792207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:40.792207+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.792207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:31.080041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.257373+0000","last_change":"2024-09-18T02:08:08.257373+0000","last_active":"2024-09-18T02:08:08.257373+0000","last_peered":"2024-09-18T02:08:08.257373+0000","last_clean":"2024-09-18T02:08:08.257373+0000","last_became_active":"2024-09-18T02:04:01.565499+0000","last_became_peered":"2024-09-18T02:04:01.565499+0000","last_unstale":"2024-09-18T02:08:08.257373+0000","last_undegraded":"2024-09-18T02:08:08.257373+0000","last_fullsized":"2024-09-18T02:08:08.257373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.257120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.257120+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.257120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:47.751284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.199509+0000","last_change":"2024-09-18T02:08:00.199509+0000","last_active":"2024-09-18T02:08:00.199509+0000","last_peered":"2024-09-18T02:08:00.199509+0000","last_clean":"2024-09-18T02:08:00.199509+0000","last_became_active":"2024-09-18T02:04:03.577841+0000","last_became_peered":"2024-09-18T02:04:03.577841+0000","last_unstale":"2024-09-18T02:08:00.199509+0000","last_undegraded":"2024-09-18T02:08:00.199509+0000","last_fullsized":"2024-09-18T02:08:00.199509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-18T02:08:00.199183+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-18T02:08:00.199183+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.199183+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:17.403960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.194433+0000","last_change":"2024-09-18T02:08:03.194433+0000","last_active":"2024-09-18T02:08:03.194433+0000","last_peered":"2024-09-18T02:08:03.194433+0000","last_clean":"2024-09-18T02:08:03.194433+0000","last_became_active":"2024-09-18T02:04:05.605718+0000","last_became_peered":"2024-09-18T02:04:05.605718+0000","last_unstale":"2024-09-18T02:08:03.194433+0000","last_undegraded":"2024-09-18T02:08:03.194433+0000","last_fullsized":"2024-09-18T02:08:03.194433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:03.194177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:03.194177+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.194177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:11.445570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:05.456160+0000","last_change":"2024-09-18T02:09:05.456220+0000","last_active":"2024-09-18T02:09:05.456160+0000","last_peered":"2024-09-18T02:09:05.456160+0000","last_clean":"2024-09-18T02:09:05.456160+0000","last_became_active":"2024-09-18T02:04:07.621224+0000","last_became_peered":"2024-09-18T02:04:07.621224+0000","last_unstale":"2024-09-18T02:09:05.456160+0000","last_undegraded":"2024-09-18T02:09:05.456160+0000","last_fullsized":"2024-09-18T02:09:05.456160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:09:05.455978+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:09:05.455978+0000","last_clean_scrub_stamp":"2024-09-18T02:09:05.455978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:28:29.972303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.086336+0000","last_change":"2024-09-18T02:08:23.086336+0000","last_active":"2024-09-18T02:08:23.086336+0000","last_peered":"2024-09-18T02:08:23.086336+0000","last_clean":"2024-09-18T02:08:23.086336+0000","last_became_active":"2024-09-18T02:03:59.536701+0000","last_became_peered":"2024-09-18T02:03:59.536701+0000","last_unstale":"2024-09-18T02:08:23.086336+0000","last_undegraded":"2024-09-18T02:08:23.086336+0000","last_fullsized":"2024-09-18T02:08:23.086336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.086080+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.086080+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.086080+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:18.513965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.578484+0000","last_change":"2024-09-18T02:08:41.578484+0000","last_active":"2024-09-18T02:08:41.578484+0000","last_peered":"2024-09-18T02:08:41.578484+0000","last_clean":"2024-09-18T02:08:41.578484+0000","last_became_active":"2024-09-18T02:03:57.527891+0000","last_became_peered":"2024-09-18T02:03:57.527891+0000","last_unstale":"2024-09-18T02:08:41.578484+0000","last_undegraded":"2024-09-18T02:08:41.578484+0000","last_fullsized":"2024-09-18T02:08:41.578484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:41.578103+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:41.578103+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.578103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:59.036359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.843858+0000","last_change":"2024-09-18T02:08:02.843858+0000","last_active":"2024-09-18T02:08:02.843858+0000","last_peered":"2024-09-18T02:08:02.843858+0000","last_clean":"2024-09-18T02:08:02.843858+0000","last_became_active":"2024-09-18T02:04:01.564187+0000","last_became_peered":"2024-09-18T02:04:01.564187+0000","last_unstale":"2024-09-18T02:08:02.843858+0000","last_undegraded":"2024-09-18T02:08:02.843858+0000","last_fullsized":"2024-09-18T02:08:02.843858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:02.843618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:02.843618+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.843618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:11.164508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.203666+0000","last_change":"2024-09-18T02:08:04.203666+0000","last_active":"2024-09-18T02:08:04.203666+0000","last_peered":"2024-09-18T02:08:04.203666+0000","last_clean":"2024-09-18T02:08:04.203666+0000","last_became_active":"2024-09-18T02:04:03.596273+0000","last_became_peered":"2024-09-18T02:04:03.596273+0000","last_unstale":"2024-09-18T02:08:04.203666+0000","last_undegraded":"2024-09-18T02:08:04.203666+0000","last_fullsized":"2024-09-18T02:08:04.203666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-18T02:08:04.203351+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-18T02:08:04.203351+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.203351+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:49:59.631236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":384,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.282688+0000","last_change":"2024-09-18T02:07:50.282688+0000","last_active":"2024-09-18T02:07:50.282688+0000","last_peered":"2024-09-18T02:07:50.282688+0000","last_clean":"2024-09-18T02:07:50.282688+0000","last_became_active":"2024-09-18T02:04:05.601182+0000","last_became_peered":"2024-09-18T02:04:05.601182+0000","last_unstale":"2024-09-18T02:07:50.282688+0000","last_undegraded":"2024-09-18T02:07:50.282688+0000","last_fullsized":"2024-09-18T02:07:50.282688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:50.282455+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:50.282455+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.282455+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:09:41.423906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.998722+0000","last_change":"2024-09-18T02:04:07.622167+0000","last_active":"2024-09-18T02:07:47.998722+0000","last_peered":"2024-09-18T02:07:47.998722+0000","last_clean":"2024-09-18T02:07:47.998722+0000","last_became_active":"2024-09-18T02:04:07.621240+0000","last_became_peered":"2024-09-18T02:04:07.621240+0000","last_unstale":"2024-09-18T02:07:47.998722+0000","last_undegraded":"2024-09-18T02:07:47.998722+0000","last_fullsized":"2024-09-18T02:07:47.998722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:04:06.562082+0000","last_clean_scrub_stamp":"2024-09-18T02:04:06.562082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.227333+0000","last_change":"2024-09-18T02:08:19.227333+0000","last_active":"2024-09-18T02:08:19.227333+0000","last_peered":"2024-09-18T02:08:19.227333+0000","last_clean":"2024-09-18T02:08:19.227333+0000","last_became_active":"2024-09-18T02:03:59.536486+0000","last_became_peered":"2024-09-18T02:03:59.536486+0000","last_unstale":"2024-09-18T02:08:19.227333+0000","last_undegraded":"2024-09-18T02:08:19.227333+0000","last_fullsized":"2024-09-18T02:08:19.227333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:19.227080+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:19.227080+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.227080+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:29.401705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.815282+0000","last_change":"2024-09-18T02:08:38.815282+0000","last_active":"2024-09-18T02:08:38.815282+0000","last_peered":"2024-09-18T02:08:38.815282+0000","last_clean":"2024-09-18T02:08:38.815282+0000","last_became_active":"2024-09-18T02:03:57.520452+0000","last_became_peered":"2024-09-18T02:03:57.520452+0000","last_unstale":"2024-09-18T02:08:38.815282+0000","last_undegraded":"2024-09-18T02:08:38.815282+0000","last_fullsized":"2024-09-18T02:08:38.815282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:38.815046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:38.815046+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.815046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:20:56.582184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.832649+0000","last_change":"2024-09-18T02:08:03.832649+0000","last_active":"2024-09-18T02:08:03.832649+0000","last_peered":"2024-09-18T02:08:03.832649+0000","last_clean":"2024-09-18T02:08:03.832649+0000","last_became_active":"2024-09-18T02:04:01.564165+0000","last_became_peered":"2024-09-18T02:04:01.564165+0000","last_unstale":"2024-09-18T02:08:03.832649+0000","last_undegraded":"2024-09-18T02:08:03.832649+0000","last_fullsized":"2024-09-18T02:08:03.832649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:03.832329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:03.832329+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.832329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:28.467191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'73","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.093377+0000","last_change":"2024-09-18T02:07:52.093377+0000","last_active":"2024-09-18T02:07:52.093377+0000","last_peered":"2024-09-18T02:07:52.093377+0000","last_clean":"2024-09-18T02:07:52.093377+0000","last_became_active":"2024-09-18T02:04:03.566714+0000","last_became_peered":"2024-09-18T02:04:03.566714+0000","last_unstale":"2024-09-18T02:07:52.093377+0000","last_undegraded":"2024-09-18T02:07:52.093377+0000","last_fullsized":"2024-09-18T02:07:52.093377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-09-18T02:07:52.093206+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-09-18T02:07:52.093206+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.093206+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:03.515528+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.213015+0000","last_change":"2024-09-18T02:07:53.213015+0000","last_active":"2024-09-18T02:07:53.213015+0000","last_peered":"2024-09-18T02:07:53.213015+0000","last_clean":"2024-09-18T02:07:53.213015+0000","last_became_active":"2024-09-18T02:04:05.578635+0000","last_became_peered":"2024-09-18T02:04:05.578635+0000","last_unstale":"2024-09-18T02:07:53.213015+0000","last_undegraded":"2024-09-18T02:07:53.213015+0000","last_fullsized":"2024-09-18T02:07:53.213015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.212658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.212658+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.212658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:04.833203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.712953+0000","last_change":"2024-09-18T02:08:12.712953+0000","last_active":"2024-09-18T02:08:12.712953+0000","last_peered":"2024-09-18T02:08:12.712953+0000","last_clean":"2024-09-18T02:08:12.712953+0000","last_became_active":"2024-09-18T02:04:07.618696+0000","last_became_peered":"2024-09-18T02:04:07.618696+0000","last_unstale":"2024-09-18T02:08:12.712953+0000","last_undegraded":"2024-09-18T02:08:12.712953+0000","last_fullsized":"2024-09-18T02:08:12.712953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:12.712689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:12.712689+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.712689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:04.964071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.284073+0000","last_change":"2024-09-18T02:08:27.284073+0000","last_active":"2024-09-18T02:08:27.284073+0000","last_peered":"2024-09-18T02:08:27.284073+0000","last_clean":"2024-09-18T02:08:27.284073+0000","last_became_active":"2024-09-18T02:03:59.536693+0000","last_became_peered":"2024-09-18T02:03:59.536693+0000","last_unstale":"2024-09-18T02:08:27.284073+0000","last_undegraded":"2024-09-18T02:08:27.284073+0000","last_fullsized":"2024-09-18T02:08:27.284073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:27.283820+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:27.283820+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.283820+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:03.691154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.511447+0000","last_change":"2024-09-18T02:08:35.511447+0000","last_active":"2024-09-18T02:08:35.511447+0000","last_peered":"2024-09-18T02:08:35.511447+0000","last_clean":"2024-09-18T02:08:35.511447+0000","last_became_active":"2024-09-18T02:03:57.532963+0000","last_became_peered":"2024-09-18T02:03:57.532963+0000","last_unstale":"2024-09-18T02:08:35.511447+0000","last_undegraded":"2024-09-18T02:08:35.511447+0000","last_fullsized":"2024-09-18T02:08:35.511447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:35.511195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:35.511195+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.511195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:52.073403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.290687+0000","last_change":"2024-09-18T02:08:06.290687+0000","last_active":"2024-09-18T02:08:06.290687+0000","last_peered":"2024-09-18T02:08:06.290687+0000","last_clean":"2024-09-18T02:08:06.290687+0000","last_became_active":"2024-09-18T02:04:01.572089+0000","last_became_peered":"2024-09-18T02:04:01.572089+0000","last_unstale":"2024-09-18T02:08:06.290687+0000","last_undegraded":"2024-09-18T02:08:06.290687+0000","last_fullsized":"2024-09-18T02:08:06.290687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:06.290419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:06.290419+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.290419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:26.123621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'43","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.233976+0000","last_change":"2024-09-18T02:08:01.233976+0000","last_active":"2024-09-18T02:08:01.233976+0000","last_peered":"2024-09-18T02:08:01.233976+0000","last_clean":"2024-09-18T02:08:01.233976+0000","last_became_active":"2024-09-18T02:04:03.569962+0000","last_became_peered":"2024-09-18T02:04:03.569962+0000","last_unstale":"2024-09-18T02:08:01.233976+0000","last_undegraded":"2024-09-18T02:08:01.233976+0000","last_fullsized":"2024-09-18T02:08:01.233976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:01.233724+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:01.233724+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.233724+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:11:25.741483+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.213922+0000","last_change":"2024-09-18T02:08:08.213922+0000","last_active":"2024-09-18T02:08:08.213922+0000","last_peered":"2024-09-18T02:08:08.213922+0000","last_clean":"2024-09-18T02:08:08.213922+0000","last_became_active":"2024-09-18T02:04:05.606608+0000","last_became_peered":"2024-09-18T02:04:05.606608+0000","last_unstale":"2024-09-18T02:08:08.213922+0000","last_undegraded":"2024-09-18T02:08:08.213922+0000","last_fullsized":"2024-09-18T02:08:08.213922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.213681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.213681+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.213681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:07:17.342298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"30'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.463401+0000","last_change":"2024-09-18T02:08:32.463401+0000","last_active":"2024-09-18T02:08:32.463401+0000","last_peered":"2024-09-18T02:08:32.463401+0000","last_clean":"2024-09-18T02:08:32.463401+0000","last_became_active":"2024-09-18T02:04:07.607839+0000","last_became_peered":"2024-09-18T02:04:07.607839+0000","last_unstale":"2024-09-18T02:08:32.463401+0000","last_undegraded":"2024-09-18T02:08:32.463401+0000","last_fullsized":"2024-09-18T02:08:32.463401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:32.463017+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:32.463017+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.463017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:46:03.555526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.392230+0000","last_change":"2024-09-18T02:08:30.392230+0000","last_active":"2024-09-18T02:08:30.392230+0000","last_peered":"2024-09-18T02:08:30.392230+0000","last_clean":"2024-09-18T02:08:30.392230+0000","last_became_active":"2024-09-18T02:03:59.547123+0000","last_became_peered":"2024-09-18T02:03:59.547123+0000","last_unstale":"2024-09-18T02:08:30.392230+0000","last_undegraded":"2024-09-18T02:08:30.392230+0000","last_fullsized":"2024-09-18T02:08:30.392230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:30.391969+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:30.391969+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.391969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:40.500818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.040922+0000","last_change":"2024-09-18T02:08:22.040978+0000","last_active":"2024-09-18T02:08:22.040922+0000","last_peered":"2024-09-18T02:08:22.040922+0000","last_clean":"2024-09-18T02:08:22.040922+0000","last_became_active":"2024-09-18T02:03:57.530001+0000","last_became_peered":"2024-09-18T02:03:57.530001+0000","last_unstale":"2024-09-18T02:08:22.040922+0000","last_undegraded":"2024-09-18T02:08:22.040922+0000","last_fullsized":"2024-09-18T02:08:22.040922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:22.040728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:22.040728+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.040728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:07.868719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.978327+0000","last_change":"2024-09-18T02:07:55.978327+0000","last_active":"2024-09-18T02:07:55.978327+0000","last_peered":"2024-09-18T02:07:55.978327+0000","last_clean":"2024-09-18T02:07:55.978327+0000","last_became_active":"2024-09-18T02:04:01.571263+0000","last_became_peered":"2024-09-18T02:04:01.571263+0000","last_unstale":"2024-09-18T02:07:55.978327+0000","last_undegraded":"2024-09-18T02:07:55.978327+0000","last_fullsized":"2024-09-18T02:07:55.978327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:55.978062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:55.978062+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.978062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:43:46.506478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'39","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.239265+0000","last_change":"2024-09-18T02:08:11.239265+0000","last_active":"2024-09-18T02:08:11.239265+0000","last_peered":"2024-09-18T02:08:11.239265+0000","last_clean":"2024-09-18T02:08:11.239265+0000","last_became_active":"2024-09-18T02:04:03.601392+0000","last_became_peered":"2024-09-18T02:04:03.601392+0000","last_unstale":"2024-09-18T02:08:11.239265+0000","last_undegraded":"2024-09-18T02:08:11.239265+0000","last_fullsized":"2024-09-18T02:08:11.239265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-18T02:08:11.238968+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-18T02:08:11.238968+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.238968+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:52:55.973173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.202713+0000","last_change":"2024-09-18T02:08:07.202713+0000","last_active":"2024-09-18T02:08:07.202713+0000","last_peered":"2024-09-18T02:08:07.202713+0000","last_clean":"2024-09-18T02:08:07.202713+0000","last_became_active":"2024-09-18T02:04:05.599964+0000","last_became_peered":"2024-09-18T02:04:05.599964+0000","last_unstale":"2024-09-18T02:08:07.202713+0000","last_undegraded":"2024-09-18T02:08:07.202713+0000","last_fullsized":"2024-09-18T02:08:07.202713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:07.202464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:07.202464+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.202464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:09.828342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:04.498327+0000","last_change":"2024-09-18T02:09:04.498389+0000","last_active":"2024-09-18T02:09:04.498327+0000","last_peered":"2024-09-18T02:09:04.498327+0000","last_clean":"2024-09-18T02:09:04.498327+0000","last_became_active":"2024-09-18T02:04:07.615007+0000","last_became_peered":"2024-09-18T02:04:07.615007+0000","last_unstale":"2024-09-18T02:09:04.498327+0000","last_undegraded":"2024-09-18T02:09:04.498327+0000","last_fullsized":"2024-09-18T02:09:04.498327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:09:04.498143+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:09:04.498143+0000","last_clean_scrub_stamp":"2024-09-18T02:09:04.498143+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:34:05.467839+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.310594+0000","last_change":"2024-09-18T02:08:17.310594+0000","last_active":"2024-09-18T02:08:17.310594+0000","last_peered":"2024-09-18T02:08:17.310594+0000","last_clean":"2024-09-18T02:08:17.310594+0000","last_became_active":"2024-09-18T02:03:59.536120+0000","last_became_peered":"2024-09-18T02:03:59.536120+0000","last_unstale":"2024-09-18T02:08:17.310594+0000","last_undegraded":"2024-09-18T02:08:17.310594+0000","last_fullsized":"2024-09-18T02:08:17.310594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:17.310348+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:17.310348+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.310348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:16.009307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.748348+0000","last_change":"2024-09-18T02:08:25.748413+0000","last_active":"2024-09-18T02:08:25.748348+0000","last_peered":"2024-09-18T02:08:25.748348+0000","last_clean":"2024-09-18T02:08:25.748348+0000","last_became_active":"2024-09-18T02:03:57.522831+0000","last_became_peered":"2024-09-18T02:03:57.522831+0000","last_unstale":"2024-09-18T02:08:25.748348+0000","last_undegraded":"2024-09-18T02:08:25.748348+0000","last_fullsized":"2024-09-18T02:08:25.748348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:25.748144+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:25.748144+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.748144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:26.585698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.904470+0000","last_change":"2024-09-18T02:07:57.904470+0000","last_active":"2024-09-18T02:07:57.904470+0000","last_peered":"2024-09-18T02:07:57.904470+0000","last_clean":"2024-09-18T02:07:57.904470+0000","last_became_active":"2024-09-18T02:04:01.569649+0000","last_became_peered":"2024-09-18T02:04:01.569649+0000","last_unstale":"2024-09-18T02:07:57.904470+0000","last_undegraded":"2024-09-18T02:07:57.904470+0000","last_fullsized":"2024-09-18T02:07:57.904470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:07:57.904196+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:07:57.904196+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.904196+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:19.425055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'55","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.404774+0000","last_change":"2024-09-18T02:07:50.404774+0000","last_active":"2024-09-18T02:07:50.404774+0000","last_peered":"2024-09-18T02:07:50.404774+0000","last_clean":"2024-09-18T02:07:50.404774+0000","last_became_active":"2024-09-18T02:04:03.591018+0000","last_became_peered":"2024-09-18T02:04:03.591018+0000","last_unstale":"2024-09-18T02:07:50.404774+0000","last_undegraded":"2024-09-18T02:07:50.404774+0000","last_fullsized":"2024-09-18T02:07:50.404774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'55","last_scrub_stamp":"2024-09-18T02:07:50.404668+0000","last_deep_scrub":"32'55","last_deep_scrub_stamp":"2024-09-18T02:07:50.404668+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.404668+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:48:17.203254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.262610+0000","last_change":"2024-09-18T02:07:51.262610+0000","last_active":"2024-09-18T02:07:51.262610+0000","last_peered":"2024-09-18T02:07:51.262610+0000","last_clean":"2024-09-18T02:07:51.262610+0000","last_became_active":"2024-09-18T02:04:05.595772+0000","last_became_peered":"2024-09-18T02:04:05.595772+0000","last_unstale":"2024-09-18T02:07:51.262610+0000","last_undegraded":"2024-09-18T02:07:51.262610+0000","last_fullsized":"2024-09-18T02:07:51.262610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.262332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.262332+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.262332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:41.244692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:03.489657+0000","last_change":"2024-09-18T02:09:03.489721+0000","last_active":"2024-09-18T02:09:03.489657+0000","last_peered":"2024-09-18T02:09:03.489657+0000","last_clean":"2024-09-18T02:09:03.489657+0000","last_became_active":"2024-09-18T02:04:07.612610+0000","last_became_peered":"2024-09-18T02:04:07.612610+0000","last_unstale":"2024-09-18T02:09:03.489657+0000","last_undegraded":"2024-09-18T02:09:03.489657+0000","last_fullsized":"2024-09-18T02:09:03.489657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:09:03.489466+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:09:03.489466+0000","last_clean_scrub_stamp":"2024-09-18T02:09:03.489466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:18:19.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.697508+0000","last_change":"2024-09-18T02:08:13.697508+0000","last_active":"2024-09-18T02:08:13.697508+0000","last_peered":"2024-09-18T02:08:13.697508+0000","last_clean":"2024-09-18T02:08:13.697508+0000","last_became_active":"2024-09-18T02:03:59.553864+0000","last_became_peered":"2024-09-18T02:03:59.553864+0000","last_unstale":"2024-09-18T02:08:13.697508+0000","last_undegraded":"2024-09-18T02:08:13.697508+0000","last_fullsized":"2024-09-18T02:08:13.697508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:13.697246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:13.697246+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.697246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:45.027054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.277121+0000","last_change":"2024-09-18T02:08:36.277174+0000","last_active":"2024-09-18T02:08:36.277121+0000","last_peered":"2024-09-18T02:08:36.277121+0000","last_clean":"2024-09-18T02:08:36.277121+0000","last_became_active":"2024-09-18T02:03:57.519843+0000","last_became_peered":"2024-09-18T02:03:57.519843+0000","last_unstale":"2024-09-18T02:08:36.277121+0000","last_undegraded":"2024-09-18T02:08:36.277121+0000","last_fullsized":"2024-09-18T02:08:36.277121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:36.276924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:36.276924+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.276924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:19.389568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.057689+0000","last_change":"2024-09-18T02:08:21.057689+0000","last_active":"2024-09-18T02:08:21.057689+0000","last_peered":"2024-09-18T02:08:21.057689+0000","last_clean":"2024-09-18T02:08:21.057689+0000","last_became_active":"2024-09-18T02:03:59.535992+0000","last_became_peered":"2024-09-18T02:03:59.535992+0000","last_unstale":"2024-09-18T02:08:21.057689+0000","last_undegraded":"2024-09-18T02:08:21.057689+0000","last_fullsized":"2024-09-18T02:08:21.057689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:21.057430+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:21.057430+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.057430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:11.720358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.091868+0000","last_change":"2024-09-18T02:08:24.091925+0000","last_active":"2024-09-18T02:08:24.091868+0000","last_peered":"2024-09-18T02:08:24.091868+0000","last_clean":"2024-09-18T02:08:24.091868+0000","last_became_active":"2024-09-18T02:03:57.527146+0000","last_became_peered":"2024-09-18T02:03:57.527146+0000","last_unstale":"2024-09-18T02:08:24.091868+0000","last_undegraded":"2024-09-18T02:08:24.091868+0000","last_fullsized":"2024-09-18T02:08:24.091868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:24.091664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:24.091664+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.091664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:50.849336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.229209+0000","last_change":"2024-09-18T02:08:21.229209+0000","last_active":"2024-09-18T02:08:21.229209+0000","last_peered":"2024-09-18T02:08:21.229209+0000","last_clean":"2024-09-18T02:08:21.229209+0000","last_became_active":"2024-09-18T02:03:59.556425+0000","last_became_peered":"2024-09-18T02:03:59.556425+0000","last_unstale":"2024-09-18T02:08:21.229209+0000","last_undegraded":"2024-09-18T02:08:21.229209+0000","last_fullsized":"2024-09-18T02:08:21.229209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:21.228959+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:21.228959+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.228959+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:54.629458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:48.722715+0000","last_change":"2024-09-18T02:08:48.722901+0000","last_active":"2024-09-18T02:08:48.722715+0000","last_peered":"2024-09-18T02:08:48.722715+0000","last_clean":"2024-09-18T02:08:48.722715+0000","last_became_active":"2024-09-18T02:04:36.350472+0000","last_became_peered":"2024-09-18T02:04:36.350472+0000","last_unstale":"2024-09-18T02:08:48.722715+0000","last_undegraded":"2024-09-18T02:08:48.722715+0000","last_fullsized":"2024-09-18T02:08:48.722715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:48.722482+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:48.722482+0000","last_clean_scrub_stamp":"2024-09-18T02:08:48.722482+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:48.513936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"32'18","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.102690+0000","last_change":"2024-09-18T02:08:17.102690+0000","last_active":"2024-09-18T02:08:17.102690+0000","last_peered":"2024-09-18T02:08:17.102690+0000","last_clean":"2024-09-18T02:08:17.102690+0000","last_became_active":"2024-09-18T02:03:59.534584+0000","last_became_peered":"2024-09-18T02:03:59.534584+0000","last_unstale":"2024-09-18T02:08:17.102690+0000","last_undegraded":"2024-09-18T02:08:17.102690+0000","last_fullsized":"2024-09-18T02:08:17.102690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:17.102427+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:17.102427+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.102427+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:53.509761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.863394+0000","last_change":"2024-09-18T02:08:39.863457+0000","last_active":"2024-09-18T02:08:39.863394+0000","last_peered":"2024-09-18T02:08:39.863394+0000","last_clean":"2024-09-18T02:08:39.863394+0000","last_became_active":"2024-09-18T02:03:57.521499+0000","last_became_peered":"2024-09-18T02:03:57.521499+0000","last_unstale":"2024-09-18T02:08:39.863394+0000","last_undegraded":"2024-09-18T02:08:39.863394+0000","last_fullsized":"2024-09-18T02:08:39.863394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:39.863198+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:39.863198+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.863198+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:05:13.263696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.152140+0000","last_change":"2024-09-18T02:08:13.152277+0000","last_active":"2024-09-18T02:08:13.152140+0000","last_peered":"2024-09-18T02:08:13.152140+0000","last_clean":"2024-09-18T02:08:13.152140+0000","last_became_active":"2024-09-18T02:03:59.554577+0000","last_became_peered":"2024-09-18T02:03:59.554577+0000","last_unstale":"2024-09-18T02:08:13.152140+0000","last_undegraded":"2024-09-18T02:08:13.152140+0000","last_fullsized":"2024-09-18T02:08:13.152140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:13.151916+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:13.151916+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.151916+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:59.060752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.962855+0000","last_change":"2024-09-18T02:08:27.962920+0000","last_active":"2024-09-18T02:08:27.962855+0000","last_peered":"2024-09-18T02:08:27.962855+0000","last_clean":"2024-09-18T02:08:27.962855+0000","last_became_active":"2024-09-18T02:03:57.526774+0000","last_became_peered":"2024-09-18T02:03:57.526774+0000","last_unstale":"2024-09-18T02:08:27.962855+0000","last_undegraded":"2024-09-18T02:08:27.962855+0000","last_fullsized":"2024-09-18T02:08:27.962855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:27.962660+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:27.962660+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.962660+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:27:41.428177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.713808+0000","last_change":"2024-09-18T02:08:10.713808+0000","last_active":"2024-09-18T02:08:10.713808+0000","last_peered":"2024-09-18T02:08:10.713808+0000","last_clean":"2024-09-18T02:08:10.713808+0000","last_became_active":"2024-09-18T02:03:59.554672+0000","last_became_peered":"2024-09-18T02:03:59.554672+0000","last_unstale":"2024-09-18T02:08:10.713808+0000","last_undegraded":"2024-09-18T02:08:10.713808+0000","last_fullsized":"2024-09-18T02:08:10.713808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:10.713551+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:10.713551+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.713551+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:17.678935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.861273+0000","last_change":"2024-09-18T02:08:37.861335+0000","last_active":"2024-09-18T02:08:37.861273+0000","last_peered":"2024-09-18T02:08:37.861273+0000","last_clean":"2024-09-18T02:08:37.861273+0000","last_became_active":"2024-09-18T02:03:57.519691+0000","last_became_peered":"2024-09-18T02:03:57.519691+0000","last_unstale":"2024-09-18T02:08:37.861273+0000","last_undegraded":"2024-09-18T02:08:37.861273+0000","last_fullsized":"2024-09-18T02:08:37.861273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:37.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:37.861054+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:35.933748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'18","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.930784+0000","last_change":"2024-09-18T02:08:28.930829+0000","last_active":"2024-09-18T02:08:28.930784+0000","last_peered":"2024-09-18T02:08:28.930784+0000","last_clean":"2024-09-18T02:08:28.930784+0000","last_became_active":"2024-09-18T02:03:59.541059+0000","last_became_peered":"2024-09-18T02:03:59.541059+0000","last_unstale":"2024-09-18T02:08:28.930784+0000","last_undegraded":"2024-09-18T02:08:28.930784+0000","last_fullsized":"2024-09-18T02:08:28.930784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:28.930660+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:28.930660+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.930660+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:01:07.506129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.256733+0000","last_change":"2024-09-18T02:08:31.256796+0000","last_active":"2024-09-18T02:08:31.256733+0000","last_peered":"2024-09-18T02:08:31.256733+0000","last_clean":"2024-09-18T02:08:31.256733+0000","last_became_active":"2024-09-18T02:03:57.519272+0000","last_became_peered":"2024-09-18T02:03:57.519272+0000","last_unstale":"2024-09-18T02:08:31.256733+0000","last_undegraded":"2024-09-18T02:08:31.256733+0000","last_fullsized":"2024-09-18T02:08:31.256733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:31.256526+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:31.256526+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.256526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:21.919455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.742520+0000","last_change":"2024-09-18T02:08:28.742581+0000","last_active":"2024-09-18T02:08:28.742520+0000","last_peered":"2024-09-18T02:08:28.742520+0000","last_clean":"2024-09-18T02:08:28.742520+0000","last_became_active":"2024-09-18T02:03:59.539946+0000","last_became_peered":"2024-09-18T02:03:59.539946+0000","last_unstale":"2024-09-18T02:08:28.742520+0000","last_undegraded":"2024-09-18T02:08:28.742520+0000","last_fullsized":"2024-09-18T02:08:28.742520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:28.742331+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:28.742331+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.742331+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:31.368209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.052740+0000","last_change":"2024-09-18T02:08:26.052861+0000","last_active":"2024-09-18T02:08:26.052740+0000","last_peered":"2024-09-18T02:08:26.052740+0000","last_clean":"2024-09-18T02:08:26.052740+0000","last_became_active":"2024-09-18T02:03:57.527102+0000","last_became_peered":"2024-09-18T02:03:57.527102+0000","last_unstale":"2024-09-18T02:08:26.052740+0000","last_undegraded":"2024-09-18T02:08:26.052740+0000","last_fullsized":"2024-09-18T02:08:26.052740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:26.052497+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:26.052497+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.052497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:28.678375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.726496+0000","last_change":"2024-09-18T02:08:26.726496+0000","last_active":"2024-09-18T02:08:26.726496+0000","last_peered":"2024-09-18T02:08:26.726496+0000","last_clean":"2024-09-18T02:08:26.726496+0000","last_became_active":"2024-09-18T02:03:59.543160+0000","last_became_peered":"2024-09-18T02:03:59.543160+0000","last_unstale":"2024-09-18T02:08:26.726496+0000","last_undegraded":"2024-09-18T02:08:26.726496+0000","last_fullsized":"2024-09-18T02:08:26.726496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:26.726212+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:26.726212+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.726212+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:09:22.380181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:49.524617+0000","last_change":"2024-09-18T02:08:49.524706+0000","last_active":"2024-09-18T02:08:49.524617+0000","last_peered":"2024-09-18T02:08:49.524617+0000","last_clean":"2024-09-18T02:08:49.524617+0000","last_became_active":"2024-09-18T02:03:57.524495+0000","last_became_peered":"2024-09-18T02:03:57.524495+0000","last_unstale":"2024-09-18T02:08:49.524617+0000","last_undegraded":"2024-09-18T02:08:49.524617+0000","last_fullsized":"2024-09-18T02:08:49.524617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:49.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:49.524398+0000","last_clean_scrub_stamp":"2024-09-18T02:08:49.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:04:32.752335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:47.852545+0000","last_change":"2024-09-18T02:08:47.852614+0000","last_active":"2024-09-18T02:08:47.852545+0000","last_peered":"2024-09-18T02:08:47.852545+0000","last_clean":"2024-09-18T02:08:47.852545+0000","last_became_active":"2024-09-18T02:04:36.354749+0000","last_became_peered":"2024-09-18T02:04:36.354749+0000","last_unstale":"2024-09-18T02:08:47.852545+0000","last_undegraded":"2024-09-18T02:08:47.852545+0000","last_fullsized":"2024-09-18T02:08:47.852545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:47.852346+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:47.852346+0000","last_clean_scrub_stamp":"2024-09-18T02:08:47.852346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:51:37.504826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.828448+0000","last_change":"2024-09-18T02:08:37.828503+0000","last_active":"2024-09-18T02:08:37.828448+0000","last_peered":"2024-09-18T02:08:37.828448+0000","last_clean":"2024-09-18T02:08:37.828448+0000","last_became_active":"2024-09-18T02:03:57.520623+0000","last_became_peered":"2024-09-18T02:03:57.520623+0000","last_unstale":"2024-09-18T02:08:37.828448+0000","last_undegraded":"2024-09-18T02:08:37.828448+0000","last_fullsized":"2024-09-18T02:08:37.828448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:37.828257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:37.828257+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.828257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:22.353047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'10","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.172727+0000","last_change":"2024-09-18T02:08:12.172727+0000","last_active":"2024-09-18T02:08:12.172727+0000","last_peered":"2024-09-18T02:08:12.172727+0000","last_clean":"2024-09-18T02:08:12.172727+0000","last_became_active":"2024-09-18T02:03:59.555178+0000","last_became_peered":"2024-09-18T02:03:59.555178+0000","last_unstale":"2024-09-18T02:08:12.172727+0000","last_undegraded":"2024-09-18T02:08:12.172727+0000","last_fullsized":"2024-09-18T02:08:12.172727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:12.172263+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:12.172263+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.172263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:09.572270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.897066+0000","last_change":"2024-09-18T02:08:36.897214+0000","last_active":"2024-09-18T02:08:36.897066+0000","last_peered":"2024-09-18T02:08:36.897066+0000","last_clean":"2024-09-18T02:08:36.897066+0000","last_became_active":"2024-09-18T02:03:57.519359+0000","last_became_peered":"2024-09-18T02:03:57.519359+0000","last_unstale":"2024-09-18T02:08:36.897066+0000","last_undegraded":"2024-09-18T02:08:36.897066+0000","last_fullsized":"2024-09-18T02:08:36.897066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:36.896796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:36.896796+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.896796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:55:49.141518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.642832+0000","last_change":"2024-09-18T02:08:18.642832+0000","last_active":"2024-09-18T02:08:18.642832+0000","last_peered":"2024-09-18T02:08:18.642832+0000","last_clean":"2024-09-18T02:08:18.642832+0000","last_became_active":"2024-09-18T02:03:59.540444+0000","last_became_peered":"2024-09-18T02:03:59.540444+0000","last_unstale":"2024-09-18T02:08:18.642832+0000","last_undegraded":"2024-09-18T02:08:18.642832+0000","last_fullsized":"2024-09-18T02:08:18.642832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:18.642438+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:18.642438+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.642438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:31.841957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.837033+0000","last_change":"2024-09-18T02:08:41.837091+0000","last_active":"2024-09-18T02:08:41.837033+0000","last_peered":"2024-09-18T02:08:41.837033+0000","last_clean":"2024-09-18T02:08:41.837033+0000","last_became_active":"2024-09-18T02:03:57.521148+0000","last_became_peered":"2024-09-18T02:03:57.521148+0000","last_unstale":"2024-09-18T02:08:41.837033+0000","last_undegraded":"2024-09-18T02:08:41.837033+0000","last_fullsized":"2024-09-18T02:08:41.837033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:41.836798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:41.836798+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.836798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:24:25.840593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.744876+0000","last_change":"2024-09-18T02:08:11.744876+0000","last_active":"2024-09-18T02:08:11.744876+0000","last_peered":"2024-09-18T02:08:11.744876+0000","last_clean":"2024-09-18T02:08:11.744876+0000","last_became_active":"2024-09-18T02:03:59.553528+0000","last_became_peered":"2024-09-18T02:03:59.553528+0000","last_unstale":"2024-09-18T02:08:11.744876+0000","last_undegraded":"2024-09-18T02:08:11.744876+0000","last_fullsized":"2024-09-18T02:08:11.744876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:11.744618+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:11.744618+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.744618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:21.919244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.531996+0000","last_change":"2024-09-18T02:08:43.532048+0000","last_active":"2024-09-18T02:08:43.531996+0000","last_peered":"2024-09-18T02:08:43.531996+0000","last_clean":"2024-09-18T02:08:43.531996+0000","last_became_active":"2024-09-18T02:03:57.526972+0000","last_became_peered":"2024-09-18T02:03:57.526972+0000","last_unstale":"2024-09-18T02:08:43.531996+0000","last_undegraded":"2024-09-18T02:08:43.531996+0000","last_fullsized":"2024-09-18T02:08:43.531996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:43.531805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:43.531805+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.531805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:26.237398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.813987+0000","last_change":"2024-09-18T02:08:30.813987+0000","last_active":"2024-09-18T02:08:30.813987+0000","last_peered":"2024-09-18T02:08:30.813987+0000","last_clean":"2024-09-18T02:08:30.813987+0000","last_became_active":"2024-09-18T02:03:59.545405+0000","last_became_peered":"2024-09-18T02:03:59.545405+0000","last_unstale":"2024-09-18T02:08:30.813987+0000","last_undegraded":"2024-09-18T02:08:30.813987+0000","last_fullsized":"2024-09-18T02:08:30.813987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:30.813647+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:30.813647+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.813647+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:50.485940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:01.522225+0000","last_change":"2024-09-18T02:09:01.522278+0000","last_active":"2024-09-18T02:09:01.522225+0000","last_peered":"2024-09-18T02:09:01.522225+0000","last_clean":"2024-09-18T02:09:01.522225+0000","last_became_active":"2024-09-18T02:03:57.521800+0000","last_became_peered":"2024-09-18T02:03:57.521800+0000","last_unstale":"2024-09-18T02:09:01.522225+0000","last_undegraded":"2024-09-18T02:09:01.522225+0000","last_fullsized":"2024-09-18T02:09:01.522225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:09:01.522024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:09:01.522024+0000","last_clean_scrub_stamp":"2024-09-18T02:09:01.522024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:35:45.923406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'12","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.155183+0000","last_change":"2024-09-18T02:08:44.155183+0000","last_active":"2024-09-18T02:08:44.155183+0000","last_peered":"2024-09-18T02:08:44.155183+0000","last_clean":"2024-09-18T02:08:44.155183+0000","last_became_active":"2024-09-18T02:04:36.357213+0000","last_became_peered":"2024-09-18T02:04:36.357213+0000","last_unstale":"2024-09-18T02:08:44.155183+0000","last_undegraded":"2024-09-18T02:08:44.155183+0000","last_fullsized":"2024-09-18T02:08:44.155183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:44.154928+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:44.154928+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.154928+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:00:07.986709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.272049+0000","last_change":"2024-09-18T02:08:18.272049+0000","last_active":"2024-09-18T02:08:18.272049+0000","last_peered":"2024-09-18T02:08:18.272049+0000","last_clean":"2024-09-18T02:08:18.272049+0000","last_became_active":"2024-09-18T02:03:57.528312+0000","last_became_peered":"2024-09-18T02:03:57.528312+0000","last_unstale":"2024-09-18T02:08:18.272049+0000","last_undegraded":"2024-09-18T02:08:18.272049+0000","last_fullsized":"2024-09-18T02:08:18.272049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:18.271805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:18.271805+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.271805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:25.237189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.845546+0000","last_change":"2024-09-18T02:08:32.845606+0000","last_active":"2024-09-18T02:08:32.845546+0000","last_peered":"2024-09-18T02:08:32.845546+0000","last_clean":"2024-09-18T02:08:32.845546+0000","last_became_active":"2024-09-18T02:03:59.540283+0000","last_became_peered":"2024-09-18T02:03:59.540283+0000","last_unstale":"2024-09-18T02:08:32.845546+0000","last_undegraded":"2024-09-18T02:08:32.845546+0000","last_fullsized":"2024-09-18T02:08:32.845546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:32.845351+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:32.845351+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.845351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:18:12.741887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.570775+0000","last_change":"2024-09-18T02:08:40.570775+0000","last_active":"2024-09-18T02:08:40.570775+0000","last_peered":"2024-09-18T02:08:40.570775+0000","last_clean":"2024-09-18T02:08:40.570775+0000","last_became_active":"2024-09-18T02:03:57.526363+0000","last_became_peered":"2024-09-18T02:03:57.526363+0000","last_unstale":"2024-09-18T02:08:40.570775+0000","last_undegraded":"2024-09-18T02:08:40.570775+0000","last_fullsized":"2024-09-18T02:08:40.570775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:40.570505+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:40.570505+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.570505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:18:35.760634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:59.509162+0000","last_change":"2024-09-18T02:08:59.509299+0000","last_active":"2024-09-18T02:08:59.509162+0000","last_peered":"2024-09-18T02:08:59.509162+0000","last_clean":"2024-09-18T02:08:59.509162+0000","last_became_active":"2024-09-18T02:03:57.516434+0000","last_became_peered":"2024-09-18T02:03:57.516434+0000","last_unstale":"2024-09-18T02:08:59.509162+0000","last_undegraded":"2024-09-18T02:08:59.509162+0000","last_fullsized":"2024-09-18T02:08:59.509162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:59.508937+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:59.508937+0000","last_clean_scrub_stamp":"2024-09-18T02:08:59.508937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:30.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.112809+0000","last_change":"2024-09-18T02:08:14.112809+0000","last_active":"2024-09-18T02:08:14.112809+0000","last_peered":"2024-09-18T02:08:14.112809+0000","last_clean":"2024-09-18T02:08:14.112809+0000","last_became_active":"2024-09-18T02:03:59.550058+0000","last_became_peered":"2024-09-18T02:03:59.550058+0000","last_unstale":"2024-09-18T02:08:14.112809+0000","last_undegraded":"2024-09-18T02:08:14.112809+0000","last_fullsized":"2024-09-18T02:08:14.112809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:14.112520+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:14.112520+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.112520+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:44.465392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.072731+0000","last_change":"2024-09-18T02:08:20.072731+0000","last_active":"2024-09-18T02:08:20.072731+0000","last_peered":"2024-09-18T02:08:20.072731+0000","last_clean":"2024-09-18T02:08:20.072731+0000","last_became_active":"2024-09-18T02:03:57.533324+0000","last_became_peered":"2024-09-18T02:03:57.533324+0000","last_unstale":"2024-09-18T02:08:20.072731+0000","last_undegraded":"2024-09-18T02:08:20.072731+0000","last_fullsized":"2024-09-18T02:08:20.072731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.072475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.072475+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.072475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:41.736390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.753846+0000","last_change":"2024-09-18T02:08:24.753846+0000","last_active":"2024-09-18T02:08:24.753846+0000","last_peered":"2024-09-18T02:08:24.753846+0000","last_clean":"2024-09-18T02:08:24.753846+0000","last_became_active":"2024-09-18T02:03:59.542356+0000","last_became_peered":"2024-09-18T02:03:59.542356+0000","last_unstale":"2024-09-18T02:08:24.753846+0000","last_undegraded":"2024-09-18T02:08:24.753846+0000","last_fullsized":"2024-09-18T02:08:24.753846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:24.753484+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:24.753484+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.753484+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:15.416413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1754,"ondisk_log_size":1754,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1593,"num_read_kb":1483,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705732,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":138326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705733,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":983040,"data_stored":725968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705732,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":726892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":430080,"data_stored":137902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T02:09:09.973 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:09:09.974 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:09:09.975 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:09:09.975 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T02:04:06.562082+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=4, tm_sec=6, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=2, tm_min=7, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T02:09:09.976 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T02:09:29.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T02:09:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.104+0000 7fb828d40640 1 Processor -- start 2024-09-18T02:09:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.104+0000 7fb828d40640 1 -- start start 2024-09-18T02:09:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.104+0000 7fb828d40640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb82406d0e0 0x7fb82406d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:09:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.104+0000 7fb828d40640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb824071c10 con 0x7fb82406da00 2024-09-18T02:09:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb828d40640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb824072230 con 0x7fb82406d0e0 2024-09-18T02:09:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb82259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb82406d0e0 0x7fb82406d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:09:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb821d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb82406da00 0x7fb82412ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36758/0 (socket says 172.21.15.81:36758) 2024-09-18T02:09:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb821d9b640 1 -- 172.21.15.81:0/822740373 learned_addr learned my addr 172.21.15.81:0/822740373 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-18T02:09:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb82259c640 1 -- 172.21.15.81:0/822740373 >> v1:172.21.15.81:6789/0 conn(0x7fb82406da00 legacy=0x7fb82412ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb82259c640 1 -- 172.21.15.81:0/822740373 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8240709e0 con 0x7fb82406d0e0 2024-09-18T02:09:30.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb82259c640 1 --2- 172.21.15.81:0/822740373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d0e0 0x7fb82406d4c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb818009740 tx=0x7fb81801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98a6ae996bbc337 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:09:30.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb82159a640 1 -- 172.21.15.81:0/822740373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8180b0070 con 0x7fb82406d0e0 2024-09-18T02:09:30.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb82159a640 1 -- 172.21.15.81:0/822740373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8180ab530 con 0x7fb82406d0e0 2024-09-18T02:09:30.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb82159a640 1 -- 172.21.15.81:0/822740373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8180ab830 con 0x7fb82406d0e0 2024-09-18T02:09:30.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb828d40640 1 -- 172.21.15.81:0/822740373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d0e0 msgr2=0x7fb82406d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:30.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb828d40640 1 --2- 172.21.15.81:0/822740373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d0e0 0x7fb82406d4c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb818009740 tx=0x7fb81801c370 comp rx=0 tx=0).stop 2024-09-18T02:09:30.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb828d40640 1 -- 172.21.15.81:0/822740373 shutdown_connections 2024-09-18T02:09:30.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb828d40640 1 --2- 172.21.15.81:0/822740373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d0e0 0x7fb82406d4c0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:09:30.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb828d40640 1 -- 172.21.15.81:0/822740373 >> 172.21.15.81:0/822740373 conn(0x7fb824099a50 msgr2=0x7fb8240972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:09:30.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb828d40640 1 -- 172.21.15.81:0/822740373 shutdown_connections 2024-09-18T02:09:30.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.108+0000 7fb828d40640 1 -- 172.21.15.81:0/822740373 wait complete. 2024-09-18T02:09:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb828d40640 1 Processor -- start 2024-09-18T02:09:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb828d40640 1 -- start start 2024-09-18T02:09:30.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb828d40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d0e0 0x7fb82412b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:09:30.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb828d40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb824134e80 con 0x7fb82406d0e0 2024-09-18T02:09:30.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb82259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d0e0 0x7fb82412b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:09:30.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb82259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d0e0 0x7fb82412b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46396/0 (socket says 172.21.15.81:46396) 2024-09-18T02:09:30.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb82259c640 1 -- 172.21.15.81:0/4011330866 learned_addr learned my addr 172.21.15.81:0/4011330866 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:09:30.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb82259c640 1 -- 172.21.15.81:0/4011330866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82412b900 con 0x7fb82406d0e0 2024-09-18T02:09:30.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb82259c640 1 --2- 172.21.15.81:0/4011330866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d0e0 0x7fb82412b3c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb8180ae040 tx=0x7fb81801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:09:30.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb812ffd640 1 -- 172.21.15.81:0/4011330866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8180b0050 con 0x7fb82406d0e0 2024-09-18T02:09:30.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb812ffd640 1 -- 172.21.15.81:0/4011330866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8180b1040 con 0x7fb82406d0e0 2024-09-18T02:09:30.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb828d40640 1 -- 172.21.15.81:0/4011330866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82412bad0 con 0x7fb82406d0e0 2024-09-18T02:09:30.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb812ffd640 1 -- 172.21.15.81:0/4011330866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8180b5780 con 0x7fb82406d0e0 2024-09-18T02:09:30.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb828d40640 1 -- 172.21.15.81:0/4011330866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82412bf90 con 0x7fb82406d0e0 2024-09-18T02:09:30.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb812ffd640 1 -- 172.21.15.81:0/4011330866 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8180be030 con 0x7fb82406d0e0 2024-09-18T02:09:30.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb828d40640 1 -- 172.21.15.81:0/4011330866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82406d4c0 con 0x7fb82406d0e0 2024-09-18T02:09:30.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb812ffd640 1 --2- 172.21.15.81:0/4011330866 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb804035db0 0x7fb804038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:09:30.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb812ffd640 1 -- 172.21.15.81:0/4011330866 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb8180bc070 con 0x7fb82406d0e0 2024-09-18T02:09:30.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.112+0000 7fb821d9b640 1 --2- 172.21.15.81:0/4011330866 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb804035db0 0x7fb804038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:09:30.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.116+0000 7fb821d9b640 1 --2- 172.21.15.81:0/4011330866 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb804035db0 0x7fb804038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb814001610 tx=0x7fb814007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:09:30.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.120+0000 7fb812ffd640 1 -- 172.21.15.81:0/4011330866 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb8180c5060 con 0x7fb82406d0e0 2024-09-18T02:09:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.268+0000 7fb828d40640 1 -- 172.21.15.81:0/4011330866 --> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb824072710 con 0x7fb804035db0 2024-09-18T02:09:30.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.312+0000 7fb812ffd640 1 -- 172.21.15.81:0/4011330866 <== mgr.4100 v2:172.21.15.167:6824/909474575 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666008 (secure 0 0 0) 0x7fb8140058c0 con 0x7fb804035db0 2024-09-18T02:09:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T02:09:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T02:09:30.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.320+0000 7fb828d40640 1 -- 172.21.15.81:0/4011330866 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb804035db0 msgr2=0x7fb804038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:30.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.320+0000 7fb828d40640 1 --2- 172.21.15.81:0/4011330866 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb804035db0 0x7fb804038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb814001610 tx=0x7fb814007ad0 comp rx=0 tx=0).stop 2024-09-18T02:09:30.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.320+0000 7fb828d40640 1 -- 172.21.15.81:0/4011330866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d0e0 msgr2=0x7fb82412b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:30.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.320+0000 7fb828d40640 1 --2- 172.21.15.81:0/4011330866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d0e0 0x7fb82412b3c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb8180ae040 tx=0x7fb81801abb0 comp rx=0 tx=0).stop 2024-09-18T02:09:30.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.320+0000 7fb828d40640 1 -- 172.21.15.81:0/4011330866 shutdown_connections 2024-09-18T02:09:30.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.320+0000 7fb828d40640 1 --2- 172.21.15.81:0/4011330866 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7fb804035db0 0x7fb804038270 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:09:30.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.320+0000 7fb828d40640 1 --2- 172.21.15.81:0/4011330866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82406d0e0 0x7fb82412b3c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:09:30.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.320+0000 7fb828d40640 1 -- 172.21.15.81:0/4011330866 >> 172.21.15.81:0/4011330866 conn(0x7fb824099a50 msgr2=0x7fb82409b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:09:30.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.320+0000 7fb828d40640 1 -- 172.21.15.81:0/4011330866 shutdown_connections 2024-09-18T02:09:30.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.320+0000 7fb828d40640 1 -- 172.21.15.81:0/4011330866 wait complete. 2024-09-18T02:09:30.340 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-18T02:09:29.400616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5363,"num_read_kb":4916,"num_write":2373,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5021,"ondisk_log_size":5021,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160832,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326528,"statfs":{"total":386547056640,"available":386382364672,"internally_reserved":0,"allocated":2883584,"data_stored":1729088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006323"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.275817+0000","last_change":"2024-09-18T02:08:30.275886+0000","last_active":"2024-09-18T02:08:30.275817+0000","last_peered":"2024-09-18T02:08:30.275817+0000","last_clean":"2024-09-18T02:08:30.275817+0000","last_became_active":"2024-09-18T02:03:57.516420+0000","last_became_peered":"2024-09-18T02:03:57.516420+0000","last_unstale":"2024-09-18T02:08:30.275817+0000","last_undegraded":"2024-09-18T02:08:30.275817+0000","last_fullsized":"2024-09-18T02:08:30.275817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:30.275625+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:30.275625+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.275625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:51.939540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.725179+0000","last_change":"2024-09-18T02:08:15.725179+0000","last_active":"2024-09-18T02:08:15.725179+0000","last_peered":"2024-09-18T02:08:15.725179+0000","last_clean":"2024-09-18T02:08:15.725179+0000","last_became_active":"2024-09-18T02:03:59.545294+0000","last_became_peered":"2024-09-18T02:03:59.545294+0000","last_unstale":"2024-09-18T02:08:15.725179+0000","last_undegraded":"2024-09-18T02:08:15.725179+0000","last_fullsized":"2024-09-18T02:08:15.725179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:15.724888+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:15.724888+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.724888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:28.872984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.140060+0000","last_change":"2024-09-18T02:08:18.140213+0000","last_active":"2024-09-18T02:08:18.140060+0000","last_peered":"2024-09-18T02:08:18.140060+0000","last_clean":"2024-09-18T02:08:18.140060+0000","last_became_active":"2024-09-18T02:03:57.533332+0000","last_became_peered":"2024-09-18T02:03:57.533332+0000","last_unstale":"2024-09-18T02:08:18.140060+0000","last_undegraded":"2024-09-18T02:08:18.140060+0000","last_fullsized":"2024-09-18T02:08:18.140060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:18.139828+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:18.139828+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.139828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:54.394230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.270290+0000","last_change":"2024-09-18T02:08:26.270290+0000","last_active":"2024-09-18T02:08:26.270290+0000","last_peered":"2024-09-18T02:08:26.270290+0000","last_clean":"2024-09-18T02:08:26.270290+0000","last_became_active":"2024-09-18T02:03:59.553641+0000","last_became_peered":"2024-09-18T02:03:59.553641+0000","last_unstale":"2024-09-18T02:08:26.270290+0000","last_undegraded":"2024-09-18T02:08:26.270290+0000","last_fullsized":"2024-09-18T02:08:26.270290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:26.270034+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:26.270034+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.270034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:39.424938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:50.482706+0000","last_change":"2024-09-18T02:08:50.482760+0000","last_active":"2024-09-18T02:08:50.482706+0000","last_peered":"2024-09-18T02:08:50.482706+0000","last_clean":"2024-09-18T02:08:50.482706+0000","last_became_active":"2024-09-18T02:03:57.532561+0000","last_became_peered":"2024-09-18T02:03:57.532561+0000","last_unstale":"2024-09-18T02:08:50.482706+0000","last_undegraded":"2024-09-18T02:08:50.482706+0000","last_fullsized":"2024-09-18T02:08:50.482706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:50.482516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:50.482516+0000","last_clean_scrub_stamp":"2024-09-18T02:08:50.482516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:18.634089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.345485+0000","last_change":"2024-09-18T02:08:29.345485+0000","last_active":"2024-09-18T02:08:29.345485+0000","last_peered":"2024-09-18T02:08:29.345485+0000","last_clean":"2024-09-18T02:08:29.345485+0000","last_became_active":"2024-09-18T02:03:59.551661+0000","last_became_peered":"2024-09-18T02:03:59.551661+0000","last_unstale":"2024-09-18T02:08:29.345485+0000","last_undegraded":"2024-09-18T02:08:29.345485+0000","last_fullsized":"2024-09-18T02:08:29.345485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:29.345217+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:29.345217+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.345217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:26:41.381394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.294995+0000","last_change":"2024-09-18T02:08:35.295053+0000","last_active":"2024-09-18T02:08:35.294995+0000","last_peered":"2024-09-18T02:08:35.294995+0000","last_clean":"2024-09-18T02:08:35.294995+0000","last_became_active":"2024-09-18T02:03:57.522751+0000","last_became_peered":"2024-09-18T02:03:57.522751+0000","last_unstale":"2024-09-18T02:08:35.294995+0000","last_undegraded":"2024-09-18T02:08:35.294995+0000","last_fullsized":"2024-09-18T02:08:35.294995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:35.294810+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:35.294810+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.294810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:22:58.514611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.282221+0000","last_change":"2024-09-18T02:08:27.282221+0000","last_active":"2024-09-18T02:08:27.282221+0000","last_peered":"2024-09-18T02:08:27.282221+0000","last_clean":"2024-09-18T02:08:27.282221+0000","last_became_active":"2024-09-18T02:03:59.552797+0000","last_became_peered":"2024-09-18T02:03:59.552797+0000","last_unstale":"2024-09-18T02:08:27.282221+0000","last_undegraded":"2024-09-18T02:08:27.282221+0000","last_fullsized":"2024-09-18T02:08:27.282221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:27.281926+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:27.281926+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.281926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:00.885178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:51.496399+0000","last_change":"2024-09-18T02:08:51.496399+0000","last_active":"2024-09-18T02:08:51.496399+0000","last_peered":"2024-09-18T02:08:51.496399+0000","last_clean":"2024-09-18T02:08:51.496399+0000","last_became_active":"2024-09-18T02:03:57.524645+0000","last_became_peered":"2024-09-18T02:03:57.524645+0000","last_unstale":"2024-09-18T02:08:51.496399+0000","last_undegraded":"2024-09-18T02:08:51.496399+0000","last_fullsized":"2024-09-18T02:08:51.496399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:51.496139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:51.496139+0000","last_clean_scrub_stamp":"2024-09-18T02:08:51.496139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:20:00.406145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.702905+0000","last_change":"2024-09-18T02:08:20.702972+0000","last_active":"2024-09-18T02:08:20.702905+0000","last_peered":"2024-09-18T02:08:20.702905+0000","last_clean":"2024-09-18T02:08:20.702905+0000","last_became_active":"2024-09-18T02:03:59.542238+0000","last_became_peered":"2024-09-18T02:03:59.542238+0000","last_unstale":"2024-09-18T02:08:20.702905+0000","last_undegraded":"2024-09-18T02:08:20.702905+0000","last_fullsized":"2024-09-18T02:08:20.702905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:20.702716+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:20.702716+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.702716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:13:21.865480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.285404+0000","last_change":"2024-09-18T02:08:33.285404+0000","last_active":"2024-09-18T02:08:33.285404+0000","last_peered":"2024-09-18T02:08:33.285404+0000","last_clean":"2024-09-18T02:08:33.285404+0000","last_became_active":"2024-09-18T02:03:57.520647+0000","last_became_peered":"2024-09-18T02:03:57.520647+0000","last_unstale":"2024-09-18T02:08:33.285404+0000","last_undegraded":"2024-09-18T02:08:33.285404+0000","last_fullsized":"2024-09-18T02:08:33.285404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:33.285048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:33.285048+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.285048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:11.364401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.302996+0000","last_change":"2024-09-18T02:08:18.303055+0000","last_active":"2024-09-18T02:08:18.302996+0000","last_peered":"2024-09-18T02:08:18.302996+0000","last_clean":"2024-09-18T02:08:18.302996+0000","last_became_active":"2024-09-18T02:03:59.559273+0000","last_became_peered":"2024-09-18T02:03:59.559273+0000","last_unstale":"2024-09-18T02:08:18.302996+0000","last_undegraded":"2024-09-18T02:08:18.302996+0000","last_fullsized":"2024-09-18T02:08:18.302996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:18.302810+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:18.302810+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.302810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:28:54.454876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.547909+0000","last_change":"2024-09-18T02:08:38.547909+0000","last_active":"2024-09-18T02:08:38.547909+0000","last_peered":"2024-09-18T02:08:38.547909+0000","last_clean":"2024-09-18T02:08:38.547909+0000","last_became_active":"2024-09-18T02:03:57.526953+0000","last_became_peered":"2024-09-18T02:03:57.526953+0000","last_unstale":"2024-09-18T02:08:38.547909+0000","last_undegraded":"2024-09-18T02:08:38.547909+0000","last_fullsized":"2024-09-18T02:08:38.547909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:38.547507+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:38.547507+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.547507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:19:29.126969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.254769+0000","last_change":"2024-09-18T02:08:37.254900+0000","last_active":"2024-09-18T02:08:37.254769+0000","last_peered":"2024-09-18T02:08:37.254769+0000","last_clean":"2024-09-18T02:08:37.254769+0000","last_became_active":"2024-09-18T02:03:59.541086+0000","last_became_peered":"2024-09-18T02:03:59.541086+0000","last_unstale":"2024-09-18T02:08:37.254769+0000","last_undegraded":"2024-09-18T02:08:37.254769+0000","last_fullsized":"2024-09-18T02:08:37.254769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:37.254513+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:37.254513+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.254513+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:27:50.720030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.935552+0000","last_change":"2024-09-18T02:08:31.935552+0000","last_active":"2024-09-18T02:08:31.935552+0000","last_peered":"2024-09-18T02:08:31.935552+0000","last_clean":"2024-09-18T02:08:31.935552+0000","last_became_active":"2024-09-18T02:03:57.520343+0000","last_became_peered":"2024-09-18T02:03:57.520343+0000","last_unstale":"2024-09-18T02:08:31.935552+0000","last_undegraded":"2024-09-18T02:08:31.935552+0000","last_fullsized":"2024-09-18T02:08:31.935552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:31.935306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:31.935306+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.935306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:32.425276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'12","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.258142+0000","last_change":"2024-09-18T02:08:14.258205+0000","last_active":"2024-09-18T02:08:14.258142+0000","last_peered":"2024-09-18T02:08:14.258142+0000","last_clean":"2024-09-18T02:08:14.258142+0000","last_became_active":"2024-09-18T02:03:59.533956+0000","last_became_peered":"2024-09-18T02:03:59.533956+0000","last_unstale":"2024-09-18T02:08:14.258142+0000","last_undegraded":"2024-09-18T02:08:14.258142+0000","last_fullsized":"2024-09-18T02:08:14.258142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:14.257948+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:14.257948+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.257948+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:21:09.261976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.466803+0000","last_change":"2024-09-18T02:08:34.466803+0000","last_active":"2024-09-18T02:08:34.466803+0000","last_peered":"2024-09-18T02:08:34.466803+0000","last_clean":"2024-09-18T02:08:34.466803+0000","last_became_active":"2024-09-18T02:03:59.536739+0000","last_became_peered":"2024-09-18T02:03:59.536739+0000","last_unstale":"2024-09-18T02:08:34.466803+0000","last_undegraded":"2024-09-18T02:08:34.466803+0000","last_fullsized":"2024-09-18T02:08:34.466803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:34.466519+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:34.466519+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.466519+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:07:34.155518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.728454+0000","last_change":"2024-09-18T02:08:27.728454+0000","last_active":"2024-09-18T02:08:27.728454+0000","last_peered":"2024-09-18T02:08:27.728454+0000","last_clean":"2024-09-18T02:08:27.728454+0000","last_became_active":"2024-09-18T02:03:57.523437+0000","last_became_peered":"2024-09-18T02:03:57.523437+0000","last_unstale":"2024-09-18T02:08:27.728454+0000","last_undegraded":"2024-09-18T02:08:27.728454+0000","last_fullsized":"2024-09-18T02:08:27.728454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:27.728216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:27.728216+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.728216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:32.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.685100+0000","last_change":"2024-09-18T02:08:19.685100+0000","last_active":"2024-09-18T02:08:19.685100+0000","last_peered":"2024-09-18T02:08:19.685100+0000","last_clean":"2024-09-18T02:08:19.685100+0000","last_became_active":"2024-09-18T02:03:59.539778+0000","last_became_peered":"2024-09-18T02:03:59.539778+0000","last_unstale":"2024-09-18T02:08:19.685100+0000","last_undegraded":"2024-09-18T02:08:19.685100+0000","last_fullsized":"2024-09-18T02:08:19.685100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:19.684812+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:19.684812+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.684812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:00:25.843568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.246624+0000","last_change":"2024-09-18T02:08:24.246624+0000","last_active":"2024-09-18T02:08:24.246624+0000","last_peered":"2024-09-18T02:08:24.246624+0000","last_clean":"2024-09-18T02:08:24.246624+0000","last_became_active":"2024-09-18T02:03:57.524578+0000","last_became_peered":"2024-09-18T02:03:57.524578+0000","last_unstale":"2024-09-18T02:08:24.246624+0000","last_undegraded":"2024-09-18T02:08:24.246624+0000","last_fullsized":"2024-09-18T02:08:24.246624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:24.246331+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:24.246331+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.246331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:29.967247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.846043+0000","last_change":"2024-09-18T02:08:42.846110+0000","last_active":"2024-09-18T02:08:42.846043+0000","last_peered":"2024-09-18T02:08:42.846043+0000","last_clean":"2024-09-18T02:08:42.846043+0000","last_became_active":"2024-09-18T02:03:59.545902+0000","last_became_peered":"2024-09-18T02:03:59.545902+0000","last_unstale":"2024-09-18T02:08:42.846043+0000","last_undegraded":"2024-09-18T02:08:42.846043+0000","last_fullsized":"2024-09-18T02:08:42.846043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:42.845854+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:42.845854+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.845854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:16:59.719082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.823369+0000","last_change":"2024-09-18T02:08:31.823369+0000","last_active":"2024-09-18T02:08:31.823369+0000","last_peered":"2024-09-18T02:08:31.823369+0000","last_clean":"2024-09-18T02:08:31.823369+0000","last_became_active":"2024-09-18T02:03:57.523211+0000","last_became_peered":"2024-09-18T02:03:57.523211+0000","last_unstale":"2024-09-18T02:08:31.823369+0000","last_undegraded":"2024-09-18T02:08:31.823369+0000","last_fullsized":"2024-09-18T02:08:31.823369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:31.823114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:31.823114+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.823114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:30:58.488129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.051257+0000","last_change":"2024-09-18T02:08:25.051257+0000","last_active":"2024-09-18T02:08:25.051257+0000","last_peered":"2024-09-18T02:08:25.051257+0000","last_clean":"2024-09-18T02:08:25.051257+0000","last_became_active":"2024-09-18T02:03:59.539198+0000","last_became_peered":"2024-09-18T02:03:59.539198+0000","last_unstale":"2024-09-18T02:08:25.051257+0000","last_undegraded":"2024-09-18T02:08:25.051257+0000","last_fullsized":"2024-09-18T02:08:25.051257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:25.050963+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:25.050963+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.050963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:35:55.015533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.803078+0000","last_change":"2024-09-18T02:08:33.803078+0000","last_active":"2024-09-18T02:08:33.803078+0000","last_peered":"2024-09-18T02:08:33.803078+0000","last_clean":"2024-09-18T02:08:33.803078+0000","last_became_active":"2024-09-18T02:03:57.522924+0000","last_became_peered":"2024-09-18T02:03:57.522924+0000","last_unstale":"2024-09-18T02:08:33.803078+0000","last_undegraded":"2024-09-18T02:08:33.803078+0000","last_fullsized":"2024-09-18T02:08:33.803078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:33.802752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:33.802752+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.802752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:19.699701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.214261+0000","last_change":"2024-09-18T02:08:21.214261+0000","last_active":"2024-09-18T02:08:21.214261+0000","last_peered":"2024-09-18T02:08:21.214261+0000","last_clean":"2024-09-18T02:08:21.214261+0000","last_became_active":"2024-09-18T02:03:59.538126+0000","last_became_peered":"2024-09-18T02:03:59.538126+0000","last_unstale":"2024-09-18T02:08:21.214261+0000","last_undegraded":"2024-09-18T02:08:21.214261+0000","last_fullsized":"2024-09-18T02:08:21.214261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:21.213960+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:21.213960+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.213960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:52.543767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.975405+0000","last_change":"2024-09-18T02:08:29.975405+0000","last_active":"2024-09-18T02:08:29.975405+0000","last_peered":"2024-09-18T02:08:29.975405+0000","last_clean":"2024-09-18T02:08:29.975405+0000","last_became_active":"2024-09-18T02:03:57.521019+0000","last_became_peered":"2024-09-18T02:03:57.521019+0000","last_unstale":"2024-09-18T02:08:29.975405+0000","last_undegraded":"2024-09-18T02:08:29.975405+0000","last_fullsized":"2024-09-18T02:08:29.975405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:29.975122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:29.975122+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.975122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:53:14.709327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.739297+0000","last_change":"2024-09-18T02:08:22.739297+0000","last_active":"2024-09-18T02:08:22.739297+0000","last_peered":"2024-09-18T02:08:22.739297+0000","last_clean":"2024-09-18T02:08:22.739297+0000","last_became_active":"2024-09-18T02:03:59.540553+0000","last_became_peered":"2024-09-18T02:03:59.540553+0000","last_unstale":"2024-09-18T02:08:22.739297+0000","last_undegraded":"2024-09-18T02:08:22.739297+0000","last_fullsized":"2024-09-18T02:08:22.739297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:22.739006+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:22.739006+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.739006+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:49.648220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:45.543385+0000","last_change":"2024-09-18T02:08:45.543498+0000","last_active":"2024-09-18T02:08:45.543385+0000","last_peered":"2024-09-18T02:08:45.543385+0000","last_clean":"2024-09-18T02:08:45.543385+0000","last_became_active":"2024-09-18T02:03:57.526917+0000","last_became_peered":"2024-09-18T02:03:57.526917+0000","last_unstale":"2024-09-18T02:08:45.543385+0000","last_undegraded":"2024-09-18T02:08:45.543385+0000","last_fullsized":"2024-09-18T02:08:45.543385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:45.543171+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:45.543171+0000","last_clean_scrub_stamp":"2024-09-18T02:08:45.543171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:42:30.963088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:45.743048+0000","last_change":"2024-09-18T02:08:45.743048+0000","last_active":"2024-09-18T02:08:45.743048+0000","last_peered":"2024-09-18T02:08:45.743048+0000","last_clean":"2024-09-18T02:08:45.743048+0000","last_became_active":"2024-09-18T02:04:07.624037+0000","last_became_peered":"2024-09-18T02:04:07.624037+0000","last_unstale":"2024-09-18T02:08:45.743048+0000","last_undegraded":"2024-09-18T02:08:45.743048+0000","last_fullsized":"2024-09-18T02:08:45.743048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-18T02:08:45.742798+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-18T02:08:45.742798+0000","last_clean_scrub_stamp":"2024-09-18T02:08:45.742798+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:39.170365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.457336+0000","last_change":"2024-09-18T02:08:33.457336+0000","last_active":"2024-09-18T02:08:33.457336+0000","last_peered":"2024-09-18T02:08:33.457336+0000","last_clean":"2024-09-18T02:08:33.457336+0000","last_became_active":"2024-09-18T02:03:59.538409+0000","last_became_peered":"2024-09-18T02:03:59.538409+0000","last_unstale":"2024-09-18T02:08:33.457336+0000","last_undegraded":"2024-09-18T02:08:33.457336+0000","last_fullsized":"2024-09-18T02:08:33.457336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:33.456927+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:33.456927+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.456927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:01.095761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:52.528115+0000","last_change":"2024-09-18T02:08:52.528185+0000","last_active":"2024-09-18T02:08:52.528115+0000","last_peered":"2024-09-18T02:08:52.528115+0000","last_clean":"2024-09-18T02:08:52.528115+0000","last_became_active":"2024-09-18T02:03:57.532657+0000","last_became_peered":"2024-09-18T02:03:57.532657+0000","last_unstale":"2024-09-18T02:08:52.528115+0000","last_undegraded":"2024-09-18T02:08:52.528115+0000","last_fullsized":"2024-09-18T02:08:52.528115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:52.527868+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:52.527868+0000","last_clean_scrub_stamp":"2024-09-18T02:08:52.527868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:34:07.528687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.360784+0000","last_change":"2024-09-18T02:07:51.360784+0000","last_active":"2024-09-18T02:07:51.360784+0000","last_peered":"2024-09-18T02:07:51.360784+0000","last_clean":"2024-09-18T02:07:51.360784+0000","last_became_active":"2024-09-18T02:04:01.562058+0000","last_became_peered":"2024-09-18T02:04:01.562058+0000","last_unstale":"2024-09-18T02:07:51.360784+0000","last_undegraded":"2024-09-18T02:07:51.360784+0000","last_fullsized":"2024-09-18T02:07:51.360784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.360360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.360360+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.360360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:21:46.176795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'51","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.267100+0000","last_change":"2024-09-18T02:08:14.267100+0000","last_active":"2024-09-18T02:08:14.267100+0000","last_peered":"2024-09-18T02:08:14.267100+0000","last_clean":"2024-09-18T02:08:14.267100+0000","last_became_active":"2024-09-18T02:04:03.600467+0000","last_became_peered":"2024-09-18T02:04:03.600467+0000","last_unstale":"2024-09-18T02:08:14.267100+0000","last_undegraded":"2024-09-18T02:08:14.267100+0000","last_fullsized":"2024-09-18T02:08:14.267100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-18T02:08:14.266804+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-18T02:08:14.266804+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.266804+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:00.903374+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.892026+0000","last_change":"2024-09-18T02:08:00.892026+0000","last_active":"2024-09-18T02:08:00.892026+0000","last_peered":"2024-09-18T02:08:00.892026+0000","last_clean":"2024-09-18T02:08:00.892026+0000","last_became_active":"2024-09-18T02:04:05.592934+0000","last_became_peered":"2024-09-18T02:04:05.592934+0000","last_unstale":"2024-09-18T02:08:00.892026+0000","last_undegraded":"2024-09-18T02:08:00.892026+0000","last_fullsized":"2024-09-18T02:08:00.892026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:00.891781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:00.891781+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.891781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:40.385945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:47.743102+0000","last_change":"2024-09-18T02:08:47.743102+0000","last_active":"2024-09-18T02:08:47.743102+0000","last_peered":"2024-09-18T02:08:47.743102+0000","last_clean":"2024-09-18T02:08:47.743102+0000","last_became_active":"2024-09-18T02:04:07.624106+0000","last_became_peered":"2024-09-18T02:04:07.624106+0000","last_unstale":"2024-09-18T02:08:47.743102+0000","last_undegraded":"2024-09-18T02:08:47.743102+0000","last_fullsized":"2024-09-18T02:08:47.743102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:08:47.742847+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:08:47.742847+0000","last_clean_scrub_stamp":"2024-09-18T02:08:47.742847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:36.842142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.231205+0000","last_change":"2024-09-18T02:08:22.231205+0000","last_active":"2024-09-18T02:08:22.231205+0000","last_peered":"2024-09-18T02:08:22.231205+0000","last_clean":"2024-09-18T02:08:22.231205+0000","last_became_active":"2024-09-18T02:03:59.555956+0000","last_became_peered":"2024-09-18T02:03:59.555956+0000","last_unstale":"2024-09-18T02:08:22.231205+0000","last_undegraded":"2024-09-18T02:08:22.231205+0000","last_fullsized":"2024-09-18T02:08:22.231205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:22.230956+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:22.230956+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.230956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:14.581546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.259379+0000","last_change":"2024-09-18T02:08:34.259379+0000","last_active":"2024-09-18T02:08:34.259379+0000","last_peered":"2024-09-18T02:08:34.259379+0000","last_clean":"2024-09-18T02:08:34.259379+0000","last_became_active":"2024-09-18T02:03:57.523041+0000","last_became_peered":"2024-09-18T02:03:57.523041+0000","last_unstale":"2024-09-18T02:08:34.259379+0000","last_undegraded":"2024-09-18T02:08:34.259379+0000","last_fullsized":"2024-09-18T02:08:34.259379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:34.259136+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:34.259136+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.259136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:39.485007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:49.735207+0000","last_change":"2024-09-18T02:08:49.735207+0000","last_active":"2024-09-18T02:08:49.735207+0000","last_peered":"2024-09-18T02:08:49.735207+0000","last_clean":"2024-09-18T02:08:49.735207+0000","last_became_active":"2024-09-18T02:04:36.362592+0000","last_became_peered":"2024-09-18T02:04:36.362592+0000","last_unstale":"2024-09-18T02:08:49.735207+0000","last_undegraded":"2024-09-18T02:08:49.735207+0000","last_fullsized":"2024-09-18T02:08:49.735207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:49.734960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:49.734960+0000","last_clean_scrub_stamp":"2024-09-18T02:08:49.734960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:27:01.771136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'16","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.117106+0000","last_change":"2024-09-18T02:07:50.117106+0000","last_active":"2024-09-18T02:07:50.117106+0000","last_peered":"2024-09-18T02:07:50.117106+0000","last_clean":"2024-09-18T02:07:50.117106+0000","last_became_active":"2024-09-18T02:04:03.579442+0000","last_became_peered":"2024-09-18T02:04:03.579442+0000","last_unstale":"2024-09-18T02:07:50.117106+0000","last_undegraded":"2024-09-18T02:07:50.117106+0000","last_fullsized":"2024-09-18T02:07:50.117106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-18T02:07:50.116825+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-18T02:07:50.116825+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.116825+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:28.484106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.808508+0000","last_change":"2024-09-18T02:08:04.808508+0000","last_active":"2024-09-18T02:08:04.808508+0000","last_peered":"2024-09-18T02:08:04.808508+0000","last_clean":"2024-09-18T02:08:04.808508+0000","last_became_active":"2024-09-18T02:04:05.605774+0000","last_became_peered":"2024-09-18T02:04:05.605774+0000","last_unstale":"2024-09-18T02:08:04.808508+0000","last_undegraded":"2024-09-18T02:08:04.808508+0000","last_fullsized":"2024-09-18T02:08:04.808508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:04.808264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:04.808264+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.808264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:41:47.654931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.798632+0000","last_change":"2024-09-18T02:08:42.798632+0000","last_active":"2024-09-18T02:08:42.798632+0000","last_peered":"2024-09-18T02:08:42.798632+0000","last_clean":"2024-09-18T02:08:42.798632+0000","last_became_active":"2024-09-18T02:04:07.610120+0000","last_became_peered":"2024-09-18T02:04:07.610120+0000","last_unstale":"2024-09-18T02:08:42.798632+0000","last_undegraded":"2024-09-18T02:08:42.798632+0000","last_fullsized":"2024-09-18T02:08:42.798632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:42.798222+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:42.798222+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.798222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:46:56.329254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'18","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.108061+0000","last_change":"2024-09-18T02:08:43.108061+0000","last_active":"2024-09-18T02:08:43.108061+0000","last_peered":"2024-09-18T02:08:43.108061+0000","last_clean":"2024-09-18T02:08:43.108061+0000","last_became_active":"2024-09-18T02:04:36.359108+0000","last_became_peered":"2024-09-18T02:04:36.359108+0000","last_unstale":"2024-09-18T02:08:43.108061+0000","last_undegraded":"2024-09-18T02:08:43.108061+0000","last_fullsized":"2024-09-18T02:08:43.108061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:43.107809+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:43.107809+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.107809+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:37:36.817784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:02.494553+0000","last_change":"2024-09-18T02:09:02.494616+0000","last_active":"2024-09-18T02:09:02.494553+0000","last_peered":"2024-09-18T02:09:02.494553+0000","last_clean":"2024-09-18T02:09:02.494553+0000","last_became_active":"2024-09-18T02:03:57.533037+0000","last_became_peered":"2024-09-18T02:03:57.533037+0000","last_unstale":"2024-09-18T02:09:02.494553+0000","last_undegraded":"2024-09-18T02:09:02.494553+0000","last_fullsized":"2024-09-18T02:09:02.494553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:09:02.494360+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:09:02.494360+0000","last_clean_scrub_stamp":"2024-09-18T02:09:02.494360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:40.128077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.236244+0000","last_change":"2024-09-18T02:08:06.236244+0000","last_active":"2024-09-18T02:08:06.236244+0000","last_peered":"2024-09-18T02:08:06.236244+0000","last_clean":"2024-09-18T02:08:06.236244+0000","last_became_active":"2024-09-18T02:04:01.567287+0000","last_became_peered":"2024-09-18T02:04:01.567287+0000","last_unstale":"2024-09-18T02:08:06.236244+0000","last_undegraded":"2024-09-18T02:08:06.236244+0000","last_fullsized":"2024-09-18T02:08:06.236244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-18T02:08:06.235937+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-18T02:08:06.235937+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.235937+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:02.660438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'30","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.284486+0000","last_change":"2024-09-18T02:08:01.284486+0000","last_active":"2024-09-18T02:08:01.284486+0000","last_peered":"2024-09-18T02:08:01.284486+0000","last_clean":"2024-09-18T02:08:01.284486+0000","last_became_active":"2024-09-18T02:04:03.581092+0000","last_became_peered":"2024-09-18T02:04:03.581092+0000","last_unstale":"2024-09-18T02:08:01.284486+0000","last_undegraded":"2024-09-18T02:08:01.284486+0000","last_fullsized":"2024-09-18T02:08:01.284486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-09-18T02:08:01.284176+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-09-18T02:08:01.284176+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.284176+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:52.879851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.250165+0000","last_change":"2024-09-18T02:08:12.250165+0000","last_active":"2024-09-18T02:08:12.250165+0000","last_peered":"2024-09-18T02:08:12.250165+0000","last_clean":"2024-09-18T02:08:12.250165+0000","last_became_active":"2024-09-18T02:04:05.607733+0000","last_became_peered":"2024-09-18T02:04:05.607733+0000","last_unstale":"2024-09-18T02:08:12.250165+0000","last_undegraded":"2024-09-18T02:08:12.250165+0000","last_fullsized":"2024-09-18T02:08:12.250165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:08:12.249802+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:08:12.249802+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.249802+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:58.146750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.226162+0000","last_change":"2024-09-18T02:08:38.226162+0000","last_active":"2024-09-18T02:08:38.226162+0000","last_peered":"2024-09-18T02:08:38.226162+0000","last_clean":"2024-09-18T02:08:38.226162+0000","last_became_active":"2024-09-18T02:04:07.630721+0000","last_became_peered":"2024-09-18T02:04:07.630721+0000","last_unstale":"2024-09-18T02:08:38.226162+0000","last_undegraded":"2024-09-18T02:08:38.226162+0000","last_fullsized":"2024-09-18T02:08:38.226162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:38.225897+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:38.225897+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.225897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:01:16.801367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.853795+0000","last_change":"2024-09-18T02:08:40.853795+0000","last_active":"2024-09-18T02:08:40.853795+0000","last_peered":"2024-09-18T02:08:40.853795+0000","last_clean":"2024-09-18T02:08:40.853795+0000","last_became_active":"2024-09-18T02:03:59.548365+0000","last_became_peered":"2024-09-18T02:03:59.548365+0000","last_unstale":"2024-09-18T02:08:40.853795+0000","last_undegraded":"2024-09-18T02:08:40.853795+0000","last_fullsized":"2024-09-18T02:08:40.853795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:40.853546+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:40.853546+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.853546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:33.204136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.775867+0000","last_change":"2024-09-18T02:08:39.775867+0000","last_active":"2024-09-18T02:08:39.775867+0000","last_peered":"2024-09-18T02:08:39.775867+0000","last_clean":"2024-09-18T02:08:39.775867+0000","last_became_active":"2024-09-18T02:03:57.520706+0000","last_became_peered":"2024-09-18T02:03:57.520706+0000","last_unstale":"2024-09-18T02:08:39.775867+0000","last_undegraded":"2024-09-18T02:08:39.775867+0000","last_fullsized":"2024-09-18T02:08:39.775867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:39.775602+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:39.775602+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.775602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:24.300392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.277755+0000","last_change":"2024-09-18T02:07:53.277755+0000","last_active":"2024-09-18T02:07:53.277755+0000","last_peered":"2024-09-18T02:07:53.277755+0000","last_clean":"2024-09-18T02:07:53.277755+0000","last_became_active":"2024-09-18T02:04:01.559249+0000","last_became_peered":"2024-09-18T02:04:01.559249+0000","last_unstale":"2024-09-18T02:07:53.277755+0000","last_undegraded":"2024-09-18T02:07:53.277755+0000","last_fullsized":"2024-09-18T02:07:53.277755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:07:53.277506+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:07:53.277506+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.277506+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:50.677514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'43","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.342570+0000","last_change":"2024-09-18T02:08:04.342570+0000","last_active":"2024-09-18T02:08:04.342570+0000","last_peered":"2024-09-18T02:08:04.342570+0000","last_clean":"2024-09-18T02:08:04.342570+0000","last_became_active":"2024-09-18T02:04:03.580310+0000","last_became_peered":"2024-09-18T02:04:03.580310+0000","last_unstale":"2024-09-18T02:08:04.342570+0000","last_undegraded":"2024-09-18T02:08:04.342570+0000","last_fullsized":"2024-09-18T02:08:04.342570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:04.342294+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:04.342294+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.342294+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:25.901859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":449,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.219458+0000","last_change":"2024-09-18T02:08:07.219458+0000","last_active":"2024-09-18T02:08:07.219458+0000","last_peered":"2024-09-18T02:08:07.219458+0000","last_clean":"2024-09-18T02:08:07.219458+0000","last_became_active":"2024-09-18T02:04:05.611707+0000","last_became_peered":"2024-09-18T02:04:05.611707+0000","last_unstale":"2024-09-18T02:08:07.219458+0000","last_undegraded":"2024-09-18T02:08:07.219458+0000","last_fullsized":"2024-09-18T02:08:07.219458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:08:07.219074+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:08:07.219074+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.219074+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:05.918033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.227542+0000","last_change":"2024-09-18T02:08:05.227542+0000","last_active":"2024-09-18T02:08:05.227542+0000","last_peered":"2024-09-18T02:08:05.227542+0000","last_clean":"2024-09-18T02:08:05.227542+0000","last_became_active":"2024-09-18T02:03:59.559585+0000","last_became_peered":"2024-09-18T02:03:59.559585+0000","last_unstale":"2024-09-18T02:08:05.227542+0000","last_undegraded":"2024-09-18T02:08:05.227542+0000","last_fullsized":"2024-09-18T02:08:05.227542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:05.227308+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:05.227308+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.227308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:31.984980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.235058+0000","last_change":"2024-09-18T02:08:26.235058+0000","last_active":"2024-09-18T02:08:26.235058+0000","last_peered":"2024-09-18T02:08:26.235058+0000","last_clean":"2024-09-18T02:08:26.235058+0000","last_became_active":"2024-09-18T02:03:57.527575+0000","last_became_peered":"2024-09-18T02:03:57.527575+0000","last_unstale":"2024-09-18T02:08:26.235058+0000","last_undegraded":"2024-09-18T02:08:26.235058+0000","last_fullsized":"2024-09-18T02:08:26.235058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:26.234826+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:26.234826+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.234826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:39.434344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.936141+0000","last_change":"2024-09-18T02:07:58.936141+0000","last_active":"2024-09-18T02:07:58.936141+0000","last_peered":"2024-09-18T02:07:58.936141+0000","last_clean":"2024-09-18T02:07:58.936141+0000","last_became_active":"2024-09-18T02:04:01.569301+0000","last_became_peered":"2024-09-18T02:04:01.569301+0000","last_unstale":"2024-09-18T02:07:58.936141+0000","last_undegraded":"2024-09-18T02:07:58.936141+0000","last_fullsized":"2024-09-18T02:07:58.936141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:58.935889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:58.935889+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.935889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:18.769091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'58","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.362195+0000","last_change":"2024-09-18T02:07:56.362296+0000","last_active":"2024-09-18T02:07:56.362195+0000","last_peered":"2024-09-18T02:07:56.362195+0000","last_clean":"2024-09-18T02:07:56.362195+0000","last_became_active":"2024-09-18T02:04:03.591195+0000","last_became_peered":"2024-09-18T02:04:03.591195+0000","last_unstale":"2024-09-18T02:07:56.362195+0000","last_undegraded":"2024-09-18T02:07:56.362195+0000","last_fullsized":"2024-09-18T02:07:56.362195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'58","last_scrub_stamp":"2024-09-18T02:07:56.361976+0000","last_deep_scrub":"32'58","last_deep_scrub_stamp":"2024-09-18T02:07:56.361976+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.361976+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:50:55.705307+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.187610+0000","last_change":"2024-09-18T02:07:59.187610+0000","last_active":"2024-09-18T02:07:59.187610+0000","last_peered":"2024-09-18T02:07:59.187610+0000","last_clean":"2024-09-18T02:07:59.187610+0000","last_became_active":"2024-09-18T02:04:05.605611+0000","last_became_peered":"2024-09-18T02:04:05.605611+0000","last_unstale":"2024-09-18T02:07:59.187610+0000","last_undegraded":"2024-09-18T02:07:59.187610+0000","last_fullsized":"2024-09-18T02:07:59.187610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:59.187354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:59.187354+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.187354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:20:48.634059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.286144+0000","last_change":"2024-09-18T02:08:11.286144+0000","last_active":"2024-09-18T02:08:11.286144+0000","last_peered":"2024-09-18T02:08:11.286144+0000","last_clean":"2024-09-18T02:08:11.286144+0000","last_became_active":"2024-09-18T02:04:07.628247+0000","last_became_peered":"2024-09-18T02:04:07.628247+0000","last_unstale":"2024-09-18T02:08:11.286144+0000","last_undegraded":"2024-09-18T02:08:11.286144+0000","last_fullsized":"2024-09-18T02:08:11.286144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:08:11.285863+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:08:11.285863+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.285863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:35.920724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.703080+0000","last_change":"2024-09-18T02:08:21.703212+0000","last_active":"2024-09-18T02:08:21.703080+0000","last_peered":"2024-09-18T02:08:21.703080+0000","last_clean":"2024-09-18T02:08:21.703080+0000","last_became_active":"2024-09-18T02:03:59.535217+0000","last_became_peered":"2024-09-18T02:03:59.535217+0000","last_unstale":"2024-09-18T02:08:21.703080+0000","last_undegraded":"2024-09-18T02:08:21.703080+0000","last_fullsized":"2024-09-18T02:08:21.703080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:21.702848+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:21.702848+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.702848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:57.957250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.207623+0000","last_change":"2024-09-18T02:08:22.207623+0000","last_active":"2024-09-18T02:08:22.207623+0000","last_peered":"2024-09-18T02:08:22.207623+0000","last_clean":"2024-09-18T02:08:22.207623+0000","last_became_active":"2024-09-18T02:03:57.528006+0000","last_became_peered":"2024-09-18T02:03:57.528006+0000","last_unstale":"2024-09-18T02:08:22.207623+0000","last_undegraded":"2024-09-18T02:08:22.207623+0000","last_fullsized":"2024-09-18T02:08:22.207623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:22.207330+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:22.207330+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.207330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:56.517929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.198039+0000","last_change":"2024-09-18T02:08:40.198039+0000","last_active":"2024-09-18T02:08:40.198039+0000","last_peered":"2024-09-18T02:08:40.198039+0000","last_clean":"2024-09-18T02:08:40.198039+0000","last_became_active":"2024-09-18T02:04:36.357607+0000","last_became_peered":"2024-09-18T02:04:36.357607+0000","last_unstale":"2024-09-18T02:08:40.198039+0000","last_undegraded":"2024-09-18T02:08:40.198039+0000","last_fullsized":"2024-09-18T02:08:40.198039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:40.197796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:40.197796+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.197796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:26.094745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'43","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.242764+0000","last_change":"2024-09-18T02:08:10.242764+0000","last_active":"2024-09-18T02:08:10.242764+0000","last_peered":"2024-09-18T02:08:10.242764+0000","last_clean":"2024-09-18T02:08:10.242764+0000","last_became_active":"2024-09-18T02:04:03.601783+0000","last_became_peered":"2024-09-18T02:04:03.601783+0000","last_unstale":"2024-09-18T02:08:10.242764+0000","last_undegraded":"2024-09-18T02:08:10.242764+0000","last_fullsized":"2024-09-18T02:08:10.242764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:10.242501+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:10.242501+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.242501+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:48.817971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.235959+0000","last_change":"2024-09-18T02:07:54.235959+0000","last_active":"2024-09-18T02:07:54.235959+0000","last_peered":"2024-09-18T02:07:54.235959+0000","last_clean":"2024-09-18T02:07:54.235959+0000","last_became_active":"2024-09-18T02:04:05.577665+0000","last_became_peered":"2024-09-18T02:04:05.577665+0000","last_unstale":"2024-09-18T02:07:54.235959+0000","last_undegraded":"2024-09-18T02:07:54.235959+0000","last_fullsized":"2024-09-18T02:07:54.235959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.235697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.235697+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.235697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:59:25.686298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.704604+0000","last_change":"2024-09-18T02:08:16.704604+0000","last_active":"2024-09-18T02:08:16.704604+0000","last_peered":"2024-09-18T02:08:16.704604+0000","last_clean":"2024-09-18T02:08:16.704604+0000","last_became_active":"2024-09-18T02:04:07.619973+0000","last_became_peered":"2024-09-18T02:04:07.619973+0000","last_unstale":"2024-09-18T02:08:16.704604+0000","last_undegraded":"2024-09-18T02:08:16.704604+0000","last_fullsized":"2024-09-18T02:08:16.704604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:16.704356+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:16.704356+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.704356+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:22.425273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.283438+0000","last_change":"2024-09-18T02:08:25.283505+0000","last_active":"2024-09-18T02:08:25.283438+0000","last_peered":"2024-09-18T02:08:25.283438+0000","last_clean":"2024-09-18T02:08:25.283438+0000","last_became_active":"2024-09-18T02:03:59.539105+0000","last_became_peered":"2024-09-18T02:03:59.539105+0000","last_unstale":"2024-09-18T02:08:25.283438+0000","last_undegraded":"2024-09-18T02:08:25.283438+0000","last_fullsized":"2024-09-18T02:08:25.283438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:25.283204+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:25.283204+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.283204+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:35.826881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'3","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.563954+0000","last_change":"2024-09-18T02:08:42.564020+0000","last_active":"2024-09-18T02:08:42.563954+0000","last_peered":"2024-09-18T02:08:42.563954+0000","last_clean":"2024-09-18T02:08:42.563954+0000","last_became_active":"2024-09-18T02:03:57.526327+0000","last_became_peered":"2024-09-18T02:03:57.526327+0000","last_unstale":"2024-09-18T02:08:42.563954+0000","last_undegraded":"2024-09-18T02:08:42.563954+0000","last_fullsized":"2024-09-18T02:08:42.563954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:08:42.563748+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:08:42.563748+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.563748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:04:56.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.210456+0000","last_change":"2024-09-18T02:08:09.210456+0000","last_active":"2024-09-18T02:08:09.210456+0000","last_peered":"2024-09-18T02:08:09.210456+0000","last_clean":"2024-09-18T02:08:09.210456+0000","last_became_active":"2024-09-18T02:04:01.561279+0000","last_became_peered":"2024-09-18T02:04:01.561279+0000","last_unstale":"2024-09-18T02:08:09.210456+0000","last_undegraded":"2024-09-18T02:08:09.210456+0000","last_fullsized":"2024-09-18T02:08:09.210456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:09.210167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:09.210167+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.210167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:48:36.008753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'60","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.236436+0000","last_change":"2024-09-18T02:07:56.236436+0000","last_active":"2024-09-18T02:07:56.236436+0000","last_peered":"2024-09-18T02:07:56.236436+0000","last_clean":"2024-09-18T02:07:56.236436+0000","last_became_active":"2024-09-18T02:04:03.591705+0000","last_became_peered":"2024-09-18T02:04:03.591705+0000","last_unstale":"2024-09-18T02:07:56.236436+0000","last_undegraded":"2024-09-18T02:07:56.236436+0000","last_fullsized":"2024-09-18T02:07:56.236436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2024-09-18T02:07:56.236157+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2024-09-18T02:07:56.236157+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.236157+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:26.464832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":411,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.258507+0000","last_change":"2024-09-18T02:07:47.258507+0000","last_active":"2024-09-18T02:07:47.258507+0000","last_peered":"2024-09-18T02:07:47.258507+0000","last_clean":"2024-09-18T02:07:47.258507+0000","last_became_active":"2024-09-18T02:04:05.591652+0000","last_became_peered":"2024-09-18T02:04:05.591652+0000","last_unstale":"2024-09-18T02:07:47.258507+0000","last_undegraded":"2024-09-18T02:07:47.258507+0000","last_fullsized":"2024-09-18T02:07:47.258507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:47.258352+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:47.258352+0000","last_clean_scrub_stamp":"2024-09-18T02:07:47.258352+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:22.446528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.194435+0000","last_change":"2024-09-18T02:08:11.194435+0000","last_active":"2024-09-18T02:08:11.194435+0000","last_peered":"2024-09-18T02:08:11.194435+0000","last_clean":"2024-09-18T02:08:11.194435+0000","last_became_active":"2024-09-18T02:04:07.609050+0000","last_became_peered":"2024-09-18T02:04:07.609050+0000","last_unstale":"2024-09-18T02:08:11.194435+0000","last_undegraded":"2024-09-18T02:08:11.194435+0000","last_fullsized":"2024-09-18T02:08:11.194435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:11.194052+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:11.194052+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.194052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:45.504652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'14","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.282593+0000","last_change":"2024-09-18T02:08:16.282593+0000","last_active":"2024-09-18T02:08:16.282593+0000","last_peered":"2024-09-18T02:08:16.282593+0000","last_clean":"2024-09-18T02:08:16.282593+0000","last_became_active":"2024-09-18T02:03:59.531445+0000","last_became_peered":"2024-09-18T02:03:59.531445+0000","last_unstale":"2024-09-18T02:08:16.282593+0000","last_undegraded":"2024-09-18T02:08:16.282593+0000","last_fullsized":"2024-09-18T02:08:16.282593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:16.282341+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:16.282341+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.282341+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:03.360755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:53.570353+0000","last_change":"2024-09-18T02:08:53.570414+0000","last_active":"2024-09-18T02:08:53.570353+0000","last_peered":"2024-09-18T02:08:53.570353+0000","last_clean":"2024-09-18T02:08:53.570353+0000","last_became_active":"2024-09-18T02:03:57.521858+0000","last_became_peered":"2024-09-18T02:03:57.521858+0000","last_unstale":"2024-09-18T02:08:53.570353+0000","last_undegraded":"2024-09-18T02:08:53.570353+0000","last_fullsized":"2024-09-18T02:08:53.570353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:53.570137+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:53.570137+0000","last_clean_scrub_stamp":"2024-09-18T02:08:53.570137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:22.341695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.223261+0000","last_change":"2024-09-18T02:08:39.223261+0000","last_active":"2024-09-18T02:08:39.223261+0000","last_peered":"2024-09-18T02:08:39.223261+0000","last_clean":"2024-09-18T02:08:39.223261+0000","last_became_active":"2024-09-18T02:04:36.356453+0000","last_became_peered":"2024-09-18T02:04:36.356453+0000","last_unstale":"2024-09-18T02:08:39.223261+0000","last_undegraded":"2024-09-18T02:08:39.223261+0000","last_fullsized":"2024-09-18T02:08:39.223261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:39.223019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:39.223019+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.223019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:53:23.957224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'77","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.228384+0000","last_change":"2024-09-18T02:08:00.228384+0000","last_active":"2024-09-18T02:08:00.228384+0000","last_peered":"2024-09-18T02:08:00.228384+0000","last_clean":"2024-09-18T02:08:00.228384+0000","last_became_active":"2024-09-18T02:04:03.595618+0000","last_became_peered":"2024-09-18T02:04:03.595618+0000","last_unstale":"2024-09-18T02:08:00.228384+0000","last_undegraded":"2024-09-18T02:08:00.228384+0000","last_fullsized":"2024-09-18T02:08:00.228384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'77","last_scrub_stamp":"2024-09-18T02:08:00.228054+0000","last_deep_scrub":"32'77","last_deep_scrub_stamp":"2024-09-18T02:08:00.228054+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.228054+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:27.137267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.222718+0000","last_change":"2024-09-18T02:07:52.222718+0000","last_active":"2024-09-18T02:07:52.222718+0000","last_peered":"2024-09-18T02:07:52.222718+0000","last_clean":"2024-09-18T02:07:52.222718+0000","last_became_active":"2024-09-18T02:04:05.585272+0000","last_became_peered":"2024-09-18T02:04:05.585272+0000","last_unstale":"2024-09-18T02:07:52.222718+0000","last_undegraded":"2024-09-18T02:07:52.222718+0000","last_fullsized":"2024-09-18T02:07:52.222718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:52.222463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:52.222463+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.222463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:48.799896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.759993+0000","last_change":"2024-09-18T02:08:43.760169+0000","last_active":"2024-09-18T02:08:43.759993+0000","last_peered":"2024-09-18T02:08:43.759993+0000","last_clean":"2024-09-18T02:08:43.759993+0000","last_became_active":"2024-09-18T02:04:07.614232+0000","last_became_peered":"2024-09-18T02:04:07.614232+0000","last_unstale":"2024-09-18T02:08:43.759993+0000","last_undegraded":"2024-09-18T02:08:43.759993+0000","last_fullsized":"2024-09-18T02:08:43.759993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-18T02:08:43.759763+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-18T02:08:43.759763+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.759763+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:37.187330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.689240+0000","last_change":"2024-09-18T02:08:17.689240+0000","last_active":"2024-09-18T02:08:17.689240+0000","last_peered":"2024-09-18T02:08:17.689240+0000","last_clean":"2024-09-18T02:08:17.689240+0000","last_became_active":"2024-09-18T02:03:59.545956+0000","last_became_peered":"2024-09-18T02:03:59.545956+0000","last_unstale":"2024-09-18T02:08:17.689240+0000","last_undegraded":"2024-09-18T02:08:17.689240+0000","last_fullsized":"2024-09-18T02:08:17.689240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:17.688836+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:17.688836+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.688836+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:25:28.232512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.815803+0000","last_change":"2024-09-18T02:08:38.815930+0000","last_active":"2024-09-18T02:08:38.815803+0000","last_peered":"2024-09-18T02:08:38.815803+0000","last_clean":"2024-09-18T02:08:38.815803+0000","last_became_active":"2024-09-18T02:03:57.520036+0000","last_became_peered":"2024-09-18T02:03:57.520036+0000","last_unstale":"2024-09-18T02:08:38.815803+0000","last_undegraded":"2024-09-18T02:08:38.815803+0000","last_fullsized":"2024-09-18T02:08:38.815803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:38.815568+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:38.815568+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.815568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:46.560180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.295590+0000","last_change":"2024-09-18T02:08:05.295590+0000","last_active":"2024-09-18T02:08:05.295590+0000","last_peered":"2024-09-18T02:08:05.295590+0000","last_clean":"2024-09-18T02:08:05.295590+0000","last_became_active":"2024-09-18T02:04:01.573084+0000","last_became_peered":"2024-09-18T02:04:01.573084+0000","last_unstale":"2024-09-18T02:08:05.295590+0000","last_undegraded":"2024-09-18T02:08:05.295590+0000","last_fullsized":"2024-09-18T02:08:05.295590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:05.295326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:05.295326+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.295326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:26.816185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.074574+0000","last_change":"2024-09-18T02:07:54.074574+0000","last_active":"2024-09-18T02:07:54.074574+0000","last_peered":"2024-09-18T02:07:54.074574+0000","last_clean":"2024-09-18T02:07:54.074574+0000","last_became_active":"2024-09-18T02:04:03.565801+0000","last_became_peered":"2024-09-18T02:04:03.565801+0000","last_unstale":"2024-09-18T02:07:54.074574+0000","last_undegraded":"2024-09-18T02:07:54.074574+0000","last_fullsized":"2024-09-18T02:07:54.074574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-18T02:07:54.074277+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-18T02:07:54.074277+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.074277+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:23:20.641594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.263760+0000","last_change":"2024-09-18T02:08:24.263760+0000","last_active":"2024-09-18T02:08:24.263760+0000","last_peered":"2024-09-18T02:08:24.263760+0000","last_clean":"2024-09-18T02:08:24.263760+0000","last_became_active":"2024-09-18T02:04:05.612052+0000","last_became_peered":"2024-09-18T02:04:05.612052+0000","last_unstale":"2024-09-18T02:08:24.263760+0000","last_undegraded":"2024-09-18T02:08:24.263760+0000","last_fullsized":"2024-09-18T02:08:24.263760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:24.263524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:24.263524+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.263524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:46:37.794556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:07.477065+0000","last_change":"2024-09-18T02:09:07.477135+0000","last_active":"2024-09-18T02:09:07.477065+0000","last_peered":"2024-09-18T02:09:07.477065+0000","last_clean":"2024-09-18T02:09:07.477065+0000","last_became_active":"2024-09-18T02:04:07.622004+0000","last_became_peered":"2024-09-18T02:04:07.622004+0000","last_unstale":"2024-09-18T02:09:07.477065+0000","last_undegraded":"2024-09-18T02:09:07.477065+0000","last_fullsized":"2024-09-18T02:09:07.477065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:09:07.476831+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:09:07.476831+0000","last_clean_scrub_stamp":"2024-09-18T02:09:07.476831+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:40:19.468420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.196851+0000","last_change":"2024-09-18T02:08:41.196851+0000","last_active":"2024-09-18T02:08:41.196851+0000","last_peered":"2024-09-18T02:08:41.196851+0000","last_clean":"2024-09-18T02:08:41.196851+0000","last_became_active":"2024-09-18T02:04:36.361748+0000","last_became_peered":"2024-09-18T02:04:36.361748+0000","last_unstale":"2024-09-18T02:08:41.196851+0000","last_undegraded":"2024-09-18T02:08:41.196851+0000","last_fullsized":"2024-09-18T02:08:41.196851+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:41.196483+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:41.196483+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.196483+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:41.686454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.566044+0000","last_change":"2024-09-18T02:08:44.566101+0000","last_active":"2024-09-18T02:08:44.566044+0000","last_peered":"2024-09-18T02:08:44.566044+0000","last_clean":"2024-09-18T02:08:44.566044+0000","last_became_active":"2024-09-18T02:03:57.526977+0000","last_became_peered":"2024-09-18T02:03:57.526977+0000","last_unstale":"2024-09-18T02:08:44.566044+0000","last_undegraded":"2024-09-18T02:08:44.566044+0000","last_fullsized":"2024-09-18T02:08:44.566044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:44.565851+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:44.565851+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.565851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:04:34.691043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.203249+0000","last_change":"2024-09-18T02:08:08.203249+0000","last_active":"2024-09-18T02:08:08.203249+0000","last_peered":"2024-09-18T02:08:08.203249+0000","last_clean":"2024-09-18T02:08:08.203249+0000","last_became_active":"2024-09-18T02:04:01.561913+0000","last_became_peered":"2024-09-18T02:04:01.561913+0000","last_unstale":"2024-09-18T02:08:08.203249+0000","last_undegraded":"2024-09-18T02:08:08.203249+0000","last_fullsized":"2024-09-18T02:08:08.203249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.203008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.203008+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.203008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:28.422827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.280212+0000","last_change":"2024-09-18T02:08:02.280212+0000","last_active":"2024-09-18T02:08:02.280212+0000","last_peered":"2024-09-18T02:08:02.280212+0000","last_clean":"2024-09-18T02:08:02.280212+0000","last_became_active":"2024-09-18T02:04:03.580395+0000","last_became_peered":"2024-09-18T02:04:03.580395+0000","last_unstale":"2024-09-18T02:08:02.280212+0000","last_undegraded":"2024-09-18T02:08:02.280212+0000","last_fullsized":"2024-09-18T02:08:02.280212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-09-18T02:08:02.279903+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-09-18T02:08:02.279903+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.279903+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:12:22.758998+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.264976+0000","last_change":"2024-09-18T02:07:49.264976+0000","last_active":"2024-09-18T02:07:49.264976+0000","last_peered":"2024-09-18T02:07:49.264976+0000","last_clean":"2024-09-18T02:07:49.264976+0000","last_became_active":"2024-09-18T02:04:05.603548+0000","last_became_peered":"2024-09-18T02:04:05.603548+0000","last_unstale":"2024-09-18T02:07:49.264976+0000","last_undegraded":"2024-09-18T02:07:49.264976+0000","last_fullsized":"2024-09-18T02:07:49.264976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:49.264681+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:49.264681+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.264681+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:45:54.246439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'15","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:45.785014+0000","last_change":"2024-09-18T02:08:45.785089+0000","last_active":"2024-09-18T02:08:45.785014+0000","last_peered":"2024-09-18T02:08:45.785014+0000","last_clean":"2024-09-18T02:08:45.785014+0000","last_became_active":"2024-09-18T02:04:07.620094+0000","last_became_peered":"2024-09-18T02:04:07.620094+0000","last_unstale":"2024-09-18T02:08:45.785014+0000","last_undegraded":"2024-09-18T02:08:45.785014+0000","last_fullsized":"2024-09-18T02:08:45.785014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-18T02:08:45.784817+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-18T02:08:45.784817+0000","last_clean_scrub_stamp":"2024-09-18T02:08:45.784817+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:19.388070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'14","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.261906+0000","last_change":"2024-09-18T02:08:13.261906+0000","last_active":"2024-09-18T02:08:13.261906+0000","last_peered":"2024-09-18T02:08:13.261906+0000","last_clean":"2024-09-18T02:08:13.261906+0000","last_became_active":"2024-09-18T02:03:59.534547+0000","last_became_peered":"2024-09-18T02:03:59.534547+0000","last_unstale":"2024-09-18T02:08:13.261906+0000","last_undegraded":"2024-09-18T02:08:13.261906+0000","last_fullsized":"2024-09-18T02:08:13.261906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:13.261662+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:13.261662+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.261662+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:13.293664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:47.510538+0000","last_change":"2024-09-18T02:08:47.510647+0000","last_active":"2024-09-18T02:08:47.510538+0000","last_peered":"2024-09-18T02:08:47.510538+0000","last_clean":"2024-09-18T02:08:47.510538+0000","last_became_active":"2024-09-18T02:03:57.525576+0000","last_became_peered":"2024-09-18T02:03:57.525576+0000","last_unstale":"2024-09-18T02:08:47.510538+0000","last_undegraded":"2024-09-18T02:08:47.510538+0000","last_fullsized":"2024-09-18T02:08:47.510538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:47.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:47.510286+0000","last_clean_scrub_stamp":"2024-09-18T02:08:47.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:29.268846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.936130+0000","last_change":"2024-09-18T02:07:59.936130+0000","last_active":"2024-09-18T02:07:59.936130+0000","last_peered":"2024-09-18T02:07:59.936130+0000","last_clean":"2024-09-18T02:07:59.936130+0000","last_became_active":"2024-09-18T02:04:01.564385+0000","last_became_peered":"2024-09-18T02:04:01.564385+0000","last_unstale":"2024-09-18T02:07:59.936130+0000","last_undegraded":"2024-09-18T02:07:59.936130+0000","last_fullsized":"2024-09-18T02:07:59.936130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-18T02:07:59.935730+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-18T02:07:59.935730+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.935730+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:04.466951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.305924+0000","last_change":"2024-09-18T02:08:15.305924+0000","last_active":"2024-09-18T02:08:15.305924+0000","last_peered":"2024-09-18T02:08:15.305924+0000","last_clean":"2024-09-18T02:08:15.305924+0000","last_became_active":"2024-09-18T02:04:03.600545+0000","last_became_peered":"2024-09-18T02:04:03.600545+0000","last_unstale":"2024-09-18T02:08:15.305924+0000","last_undegraded":"2024-09-18T02:08:15.305924+0000","last_fullsized":"2024-09-18T02:08:15.305924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-18T02:08:15.305656+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-18T02:08:15.305656+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.305656+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:37:09.015631+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":473,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:47.115885+0000","last_change":"2024-09-18T02:07:47.115885+0000","last_active":"2024-09-18T02:07:47.115885+0000","last_peered":"2024-09-18T02:07:47.115885+0000","last_clean":"2024-09-18T02:07:47.115885+0000","last_became_active":"2024-09-18T02:04:05.582127+0000","last_became_peered":"2024-09-18T02:04:05.582127+0000","last_unstale":"2024-09-18T02:07:47.115885+0000","last_undegraded":"2024-09-18T02:07:47.115885+0000","last_fullsized":"2024-09-18T02:07:47.115885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:47.115624+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:47.115624+0000","last_clean_scrub_stamp":"2024-09-18T02:07:47.115624+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:34:41.967979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.332802+0000","last_change":"2024-09-18T02:07:55.332802+0000","last_active":"2024-09-18T02:07:55.332802+0000","last_peered":"2024-09-18T02:07:55.332802+0000","last_clean":"2024-09-18T02:07:55.332802+0000","last_became_active":"2024-09-18T02:04:07.602985+0000","last_became_peered":"2024-09-18T02:04:07.602985+0000","last_unstale":"2024-09-18T02:07:55.332802+0000","last_undegraded":"2024-09-18T02:07:55.332802+0000","last_fullsized":"2024-09-18T02:07:55.332802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:07:55.332416+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:07:55.332416+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.332416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:19:15.933538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.726524+0000","last_change":"2024-09-18T02:08:09.726524+0000","last_active":"2024-09-18T02:08:09.726524+0000","last_peered":"2024-09-18T02:08:09.726524+0000","last_clean":"2024-09-18T02:08:09.726524+0000","last_became_active":"2024-09-18T02:03:59.554711+0000","last_became_peered":"2024-09-18T02:03:59.554711+0000","last_unstale":"2024-09-18T02:08:09.726524+0000","last_undegraded":"2024-09-18T02:08:09.726524+0000","last_fullsized":"2024-09-18T02:08:09.726524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:09.726257+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:09.726257+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.726257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:21:45.241040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:48.486735+0000","last_change":"2024-09-18T02:08:48.486861+0000","last_active":"2024-09-18T02:08:48.486735+0000","last_peered":"2024-09-18T02:08:48.486735+0000","last_clean":"2024-09-18T02:08:48.486735+0000","last_became_active":"2024-09-18T02:03:57.531156+0000","last_became_peered":"2024-09-18T02:03:57.531156+0000","last_unstale":"2024-09-18T02:08:48.486735+0000","last_undegraded":"2024-09-18T02:08:48.486735+0000","last_fullsized":"2024-09-18T02:08:48.486735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:48.486497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:48.486497+0000","last_clean_scrub_stamp":"2024-09-18T02:08:48.486497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:00:46.807265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.368784+0000","last_change":"2024-09-18T02:07:49.368784+0000","last_active":"2024-09-18T02:07:49.368784+0000","last_peered":"2024-09-18T02:07:49.368784+0000","last_clean":"2024-09-18T02:07:49.368784+0000","last_became_active":"2024-09-18T02:04:01.565999+0000","last_became_peered":"2024-09-18T02:04:01.565999+0000","last_unstale":"2024-09-18T02:07:49.368784+0000","last_undegraded":"2024-09-18T02:07:49.368784+0000","last_fullsized":"2024-09-18T02:07:49.368784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:49.368530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:49.368530+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.368530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:09.588349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'51","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.029622+0000","last_change":"2024-09-18T02:07:55.029622+0000","last_active":"2024-09-18T02:07:55.029622+0000","last_peered":"2024-09-18T02:07:55.029622+0000","last_clean":"2024-09-18T02:07:55.029622+0000","last_became_active":"2024-09-18T02:04:03.564021+0000","last_became_peered":"2024-09-18T02:04:03.564021+0000","last_unstale":"2024-09-18T02:07:55.029622+0000","last_undegraded":"2024-09-18T02:07:55.029622+0000","last_fullsized":"2024-09-18T02:07:55.029622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-18T02:07:55.029350+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-18T02:07:55.029350+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.029350+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:45.011710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.316073+0000","last_change":"2024-09-18T02:07:51.316073+0000","last_active":"2024-09-18T02:07:51.316073+0000","last_peered":"2024-09-18T02:07:51.316073+0000","last_clean":"2024-09-18T02:07:51.316073+0000","last_became_active":"2024-09-18T02:04:05.610024+0000","last_became_peered":"2024-09-18T02:04:05.610024+0000","last_unstale":"2024-09-18T02:07:51.316073+0000","last_undegraded":"2024-09-18T02:07:51.316073+0000","last_fullsized":"2024-09-18T02:07:51.316073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.315728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.315728+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.315728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:32.237933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.762277+0000","last_change":"2024-09-18T02:08:08.762277+0000","last_active":"2024-09-18T02:08:08.762277+0000","last_peered":"2024-09-18T02:08:08.762277+0000","last_clean":"2024-09-18T02:08:08.762277+0000","last_became_active":"2024-09-18T02:04:07.618153+0000","last_became_peered":"2024-09-18T02:04:07.618153+0000","last_unstale":"2024-09-18T02:08:08.762277+0000","last_undegraded":"2024-09-18T02:08:08.762277+0000","last_fullsized":"2024-09-18T02:08:08.762277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:08:08.762008+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:08:08.762008+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.762008+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:55.840421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.208888+0000","last_change":"2024-09-18T02:08:03.208888+0000","last_active":"2024-09-18T02:08:03.208888+0000","last_peered":"2024-09-18T02:08:03.208888+0000","last_clean":"2024-09-18T02:08:03.208888+0000","last_became_active":"2024-09-18T02:03:59.559592+0000","last_became_peered":"2024-09-18T02:03:59.559592+0000","last_unstale":"2024-09-18T02:08:03.208888+0000","last_undegraded":"2024-09-18T02:08:03.208888+0000","last_fullsized":"2024-09-18T02:08:03.208888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:03.208545+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:03.208545+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.208545+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:46:49.036536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":215,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.851810+0000","last_change":"2024-09-18T02:08:34.851896+0000","last_active":"2024-09-18T02:08:34.851810+0000","last_peered":"2024-09-18T02:08:34.851810+0000","last_clean":"2024-09-18T02:08:34.851810+0000","last_became_active":"2024-09-18T02:03:43.336731+0000","last_became_peered":"2024-09-18T02:03:43.336731+0000","last_unstale":"2024-09-18T02:08:34.851810+0000","last_undegraded":"2024-09-18T02:08:34.851810+0000","last_fullsized":"2024-09-18T02:08:34.851810+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-09-18T02:08:34.851600+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-09-18T02:08:34.851600+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.851600+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:35.341570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:54.540878+0000","last_change":"2024-09-18T02:08:54.540973+0000","last_active":"2024-09-18T02:08:54.540878+0000","last_peered":"2024-09-18T02:08:54.540878+0000","last_clean":"2024-09-18T02:08:54.540878+0000","last_became_active":"2024-09-18T02:03:48.273444+0000","last_became_peered":"2024-09-18T02:03:48.273444+0000","last_unstale":"2024-09-18T02:08:54.540878+0000","last_undegraded":"2024-09-18T02:08:54.540878+0000","last_fullsized":"2024-09-18T02:08:54.540878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:54.540682+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:54.540682+0000","last_clean_scrub_stamp":"2024-09-18T02:08:54.540682+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:31.148257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024299339999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.543032+0000","last_change":"2024-09-18T02:08:37.543094+0000","last_active":"2024-09-18T02:08:37.543032+0000","last_peered":"2024-09-18T02:08:37.543032+0000","last_clean":"2024-09-18T02:08:37.543032+0000","last_became_active":"2024-09-18T02:03:57.532844+0000","last_became_peered":"2024-09-18T02:03:57.532844+0000","last_unstale":"2024-09-18T02:08:37.543032+0000","last_undegraded":"2024-09-18T02:08:37.543032+0000","last_fullsized":"2024-09-18T02:08:37.543032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:37.542821+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:37.542821+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.542821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:43:32.720689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.878096+0000","last_change":"2024-09-18T02:08:01.878096+0000","last_active":"2024-09-18T02:08:01.878096+0000","last_peered":"2024-09-18T02:08:01.878096+0000","last_clean":"2024-09-18T02:08:01.878096+0000","last_became_active":"2024-09-18T02:04:01.563633+0000","last_became_peered":"2024-09-18T02:04:01.563633+0000","last_unstale":"2024-09-18T02:08:01.878096+0000","last_undegraded":"2024-09-18T02:08:01.878096+0000","last_fullsized":"2024-09-18T02:08:01.878096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:01.877846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:01.877846+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.877846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:32.131376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'97","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.212941+0000","last_change":"2024-09-18T02:08:09.212941+0000","last_active":"2024-09-18T02:08:09.212941+0000","last_peered":"2024-09-18T02:08:09.212941+0000","last_clean":"2024-09-18T02:08:09.212941+0000","last_became_active":"2024-09-18T02:04:03.606800+0000","last_became_peered":"2024-09-18T02:04:03.606800+0000","last_unstale":"2024-09-18T02:08:09.212941+0000","last_undegraded":"2024-09-18T02:08:09.212941+0000","last_fullsized":"2024-09-18T02:08:09.212941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-09-18T02:08:09.212628+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-09-18T02:08:09.212628+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.212628+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:27:22.678145+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.275953+0000","last_change":"2024-09-18T02:07:50.275953+0000","last_active":"2024-09-18T02:07:50.275953+0000","last_peered":"2024-09-18T02:07:50.275953+0000","last_clean":"2024-09-18T02:07:50.275953+0000","last_became_active":"2024-09-18T02:04:05.588568+0000","last_became_peered":"2024-09-18T02:04:05.588568+0000","last_unstale":"2024-09-18T02:07:50.275953+0000","last_undegraded":"2024-09-18T02:07:50.275953+0000","last_fullsized":"2024-09-18T02:07:50.275953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:50.275701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:50.275701+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.275701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:23:16.843019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.289795+0000","last_change":"2024-09-18T02:08:07.289795+0000","last_active":"2024-09-18T02:08:07.289795+0000","last_peered":"2024-09-18T02:08:07.289795+0000","last_clean":"2024-09-18T02:08:07.289795+0000","last_became_active":"2024-09-18T02:04:07.613914+0000","last_became_peered":"2024-09-18T02:04:07.613914+0000","last_unstale":"2024-09-18T02:08:07.289795+0000","last_undegraded":"2024-09-18T02:08:07.289795+0000","last_fullsized":"2024-09-18T02:08:07.289795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-09-18T02:08:07.289548+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-09-18T02:08:07.289548+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.289548+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:11.820769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.239750+0000","last_change":"2024-09-18T02:08:23.239813+0000","last_active":"2024-09-18T02:08:23.239750+0000","last_peered":"2024-09-18T02:08:23.239750+0000","last_clean":"2024-09-18T02:08:23.239750+0000","last_became_active":"2024-09-18T02:03:59.555801+0000","last_became_peered":"2024-09-18T02:03:59.555801+0000","last_unstale":"2024-09-18T02:08:23.239750+0000","last_undegraded":"2024-09-18T02:08:23.239750+0000","last_fullsized":"2024-09-18T02:08:23.239750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.239523+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.239523+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.239523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:59.785045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:55.502208+0000","last_change":"2024-09-18T02:08:55.502263+0000","last_active":"2024-09-18T02:08:55.502208+0000","last_peered":"2024-09-18T02:08:55.502208+0000","last_clean":"2024-09-18T02:08:55.502208+0000","last_became_active":"2024-09-18T02:03:48.275709+0000","last_became_peered":"2024-09-18T02:03:48.275709+0000","last_unstale":"2024-09-18T02:08:55.502208+0000","last_undegraded":"2024-09-18T02:08:55.502208+0000","last_fullsized":"2024-09-18T02:08:55.502208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:55.502017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:55.502017+0000","last_clean_scrub_stamp":"2024-09-18T02:08:55.502017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:22:23.151201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00047579399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.852392+0000","last_change":"2024-09-18T02:08:36.852449+0000","last_active":"2024-09-18T02:08:36.852392+0000","last_peered":"2024-09-18T02:08:36.852392+0000","last_clean":"2024-09-18T02:08:36.852392+0000","last_became_active":"2024-09-18T02:03:57.520559+0000","last_became_peered":"2024-09-18T02:03:57.520559+0000","last_unstale":"2024-09-18T02:08:36.852392+0000","last_undegraded":"2024-09-18T02:08:36.852392+0000","last_fullsized":"2024-09-18T02:08:36.852392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:36.852193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:36.852193+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.852193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:13.004259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.201427+0000","last_change":"2024-09-18T02:07:55.201427+0000","last_active":"2024-09-18T02:07:55.201427+0000","last_peered":"2024-09-18T02:07:55.201427+0000","last_clean":"2024-09-18T02:07:55.201427+0000","last_became_active":"2024-09-18T02:04:01.561194+0000","last_became_peered":"2024-09-18T02:04:01.561194+0000","last_unstale":"2024-09-18T02:07:55.201427+0000","last_undegraded":"2024-09-18T02:07:55.201427+0000","last_fullsized":"2024-09-18T02:07:55.201427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:55.201180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:55.201180+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.201180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:25.554052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'297","reported_seq":530,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.127133+0000","last_change":"2024-09-18T02:07:51.127133+0000","last_active":"2024-09-18T02:07:51.127133+0000","last_peered":"2024-09-18T02:07:51.127133+0000","last_clean":"2024-09-18T02:07:51.127133+0000","last_became_active":"2024-09-18T02:04:03.570288+0000","last_became_peered":"2024-09-18T02:04:03.570288+0000","last_unstale":"2024-09-18T02:07:51.127133+0000","last_undegraded":"2024-09-18T02:07:51.127133+0000","last_fullsized":"2024-09-18T02:07:51.127133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'297","last_scrub_stamp":"2024-09-18T02:07:51.126820+0000","last_deep_scrub":"32'297","last_deep_scrub_stamp":"2024-09-18T02:07:51.126820+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.126820+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:09:07.313670+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.342738+0000","last_change":"2024-09-18T02:08:16.342738+0000","last_active":"2024-09-18T02:08:16.342738+0000","last_peered":"2024-09-18T02:08:16.342738+0000","last_clean":"2024-09-18T02:08:16.342738+0000","last_became_active":"2024-09-18T02:04:05.608544+0000","last_became_peered":"2024-09-18T02:04:05.608544+0000","last_unstale":"2024-09-18T02:08:16.342738+0000","last_undegraded":"2024-09-18T02:08:16.342738+0000","last_fullsized":"2024-09-18T02:08:16.342738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:16.342502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:16.342502+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.342502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:40.174283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.759186+0000","last_change":"2024-09-18T02:08:44.759249+0000","last_active":"2024-09-18T02:08:44.759186+0000","last_peered":"2024-09-18T02:08:44.759186+0000","last_clean":"2024-09-18T02:08:44.759186+0000","last_became_active":"2024-09-18T02:04:07.622337+0000","last_became_peered":"2024-09-18T02:04:07.622337+0000","last_unstale":"2024-09-18T02:08:44.759186+0000","last_undegraded":"2024-09-18T02:08:44.759186+0000","last_fullsized":"2024-09-18T02:08:44.759186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:08:44.758988+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:08:44.758988+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.758988+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:09.132745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.960512+0000","last_change":"2024-09-18T02:08:30.960574+0000","last_active":"2024-09-18T02:08:30.960512+0000","last_peered":"2024-09-18T02:08:30.960512+0000","last_clean":"2024-09-18T02:08:30.960512+0000","last_became_active":"2024-09-18T02:03:59.548308+0000","last_became_peered":"2024-09-18T02:03:59.548308+0000","last_unstale":"2024-09-18T02:08:30.960512+0000","last_undegraded":"2024-09-18T02:08:30.960512+0000","last_fullsized":"2024-09-18T02:08:30.960512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:30.960318+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:30.960318+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.960318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:16.857267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.300930+0000","last_change":"2024-09-18T02:08:29.300994+0000","last_active":"2024-09-18T02:08:29.300930+0000","last_peered":"2024-09-18T02:08:29.300930+0000","last_clean":"2024-09-18T02:08:29.300930+0000","last_became_active":"2024-09-18T02:03:48.275609+0000","last_became_peered":"2024-09-18T02:03:48.275609+0000","last_unstale":"2024-09-18T02:08:29.300930+0000","last_undegraded":"2024-09-18T02:08:29.300930+0000","last_fullsized":"2024-09-18T02:08:29.300930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:29.300685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:29.300685+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.300685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:56.209898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067244799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.874727+0000","last_change":"2024-09-18T02:08:35.874800+0000","last_active":"2024-09-18T02:08:35.874727+0000","last_peered":"2024-09-18T02:08:35.874727+0000","last_clean":"2024-09-18T02:08:35.874727+0000","last_became_active":"2024-09-18T02:03:57.520103+0000","last_became_peered":"2024-09-18T02:03:57.520103+0000","last_unstale":"2024-09-18T02:08:35.874727+0000","last_undegraded":"2024-09-18T02:08:35.874727+0000","last_fullsized":"2024-09-18T02:08:35.874727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:35.874487+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:35.874487+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.874487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:33.947180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.304457+0000","last_change":"2024-09-18T02:08:12.304457+0000","last_active":"2024-09-18T02:08:12.304457+0000","last_peered":"2024-09-18T02:08:12.304457+0000","last_clean":"2024-09-18T02:08:12.304457+0000","last_became_active":"2024-09-18T02:04:01.560471+0000","last_became_peered":"2024-09-18T02:04:01.560471+0000","last_unstale":"2024-09-18T02:08:12.304457+0000","last_undegraded":"2024-09-18T02:08:12.304457+0000","last_fullsized":"2024-09-18T02:08:12.304457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:12.304176+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:12.304176+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.304176+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:41:55.150843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'24","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.320487+0000","last_change":"2024-09-18T02:07:57.320487+0000","last_active":"2024-09-18T02:07:57.320487+0000","last_peered":"2024-09-18T02:07:57.320487+0000","last_clean":"2024-09-18T02:07:57.320487+0000","last_became_active":"2024-09-18T02:04:03.588913+0000","last_became_peered":"2024-09-18T02:04:03.588913+0000","last_unstale":"2024-09-18T02:07:57.320487+0000","last_undegraded":"2024-09-18T02:07:57.320487+0000","last_fullsized":"2024-09-18T02:07:57.320487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-18T02:07:57.320158+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-18T02:07:57.320158+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.320158+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:35.687439+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.317671+0000","last_change":"2024-09-18T02:07:49.317671+0000","last_active":"2024-09-18T02:07:49.317671+0000","last_peered":"2024-09-18T02:07:49.317671+0000","last_clean":"2024-09-18T02:07:49.317671+0000","last_became_active":"2024-09-18T02:04:05.588457+0000","last_became_peered":"2024-09-18T02:04:05.588457+0000","last_unstale":"2024-09-18T02:07:49.317671+0000","last_undegraded":"2024-09-18T02:07:49.317671+0000","last_fullsized":"2024-09-18T02:07:49.317671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:49.317338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:49.317338+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.317338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:39.956466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:08.458710+0000","last_change":"2024-09-18T02:09:08.458767+0000","last_active":"2024-09-18T02:09:08.458710+0000","last_peered":"2024-09-18T02:09:08.458710+0000","last_clean":"2024-09-18T02:09:08.458710+0000","last_became_active":"2024-09-18T02:04:07.621651+0000","last_became_peered":"2024-09-18T02:04:07.621651+0000","last_unstale":"2024-09-18T02:09:08.458710+0000","last_undegraded":"2024-09-18T02:09:08.458710+0000","last_fullsized":"2024-09-18T02:09:08.458710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:09:08.458511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:09:08.458511+0000","last_clean_scrub_stamp":"2024-09-18T02:09:08.458511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:26.278266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.115264+0000","last_change":"2024-09-18T02:08:19.115318+0000","last_active":"2024-09-18T02:08:19.115264+0000","last_peered":"2024-09-18T02:08:19.115264+0000","last_clean":"2024-09-18T02:08:19.115264+0000","last_became_active":"2024-09-18T02:03:59.535693+0000","last_became_peered":"2024-09-18T02:03:59.535693+0000","last_unstale":"2024-09-18T02:08:19.115264+0000","last_undegraded":"2024-09-18T02:08:19.115264+0000","last_fullsized":"2024-09-18T02:08:19.115264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:19.115076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:19.115076+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.115076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:46.024290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:56.487804+0000","last_change":"2024-09-18T02:08:56.487926+0000","last_active":"2024-09-18T02:08:56.487804+0000","last_peered":"2024-09-18T02:08:56.487804+0000","last_clean":"2024-09-18T02:08:56.487804+0000","last_became_active":"2024-09-18T02:03:48.276543+0000","last_became_peered":"2024-09-18T02:03:48.276543+0000","last_unstale":"2024-09-18T02:08:56.487804+0000","last_undegraded":"2024-09-18T02:08:56.487804+0000","last_fullsized":"2024-09-18T02:08:56.487804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:08:56.487504+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:08:56.487504+0000","last_clean_scrub_stamp":"2024-09-18T02:08:56.487504+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:40.398764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023330579999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.200087+0000","last_change":"2024-09-18T02:08:20.200139+0000","last_active":"2024-09-18T02:08:20.200087+0000","last_peered":"2024-09-18T02:08:20.200087+0000","last_clean":"2024-09-18T02:08:20.200087+0000","last_became_active":"2024-09-18T02:03:57.528828+0000","last_became_peered":"2024-09-18T02:03:57.528828+0000","last_unstale":"2024-09-18T02:08:20.200087+0000","last_undegraded":"2024-09-18T02:08:20.200087+0000","last_fullsized":"2024-09-18T02:08:20.200087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.199864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.199864+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.199864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:12.451245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.216748+0000","last_change":"2024-09-18T02:08:04.216748+0000","last_active":"2024-09-18T02:08:04.216748+0000","last_peered":"2024-09-18T02:08:04.216748+0000","last_clean":"2024-09-18T02:08:04.216748+0000","last_became_active":"2024-09-18T02:04:01.571608+0000","last_became_peered":"2024-09-18T02:04:01.571608+0000","last_unstale":"2024-09-18T02:08:04.216748+0000","last_undegraded":"2024-09-18T02:08:04.216748+0000","last_fullsized":"2024-09-18T02:08:04.216748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:04.216468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:04.216468+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.216468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:07:30.815787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.228198+0000","last_change":"2024-09-18T02:08:13.228198+0000","last_active":"2024-09-18T02:08:13.228198+0000","last_peered":"2024-09-18T02:08:13.228198+0000","last_clean":"2024-09-18T02:08:13.228198+0000","last_became_active":"2024-09-18T02:04:03.601140+0000","last_became_peered":"2024-09-18T02:04:03.601140+0000","last_unstale":"2024-09-18T02:08:13.228198+0000","last_undegraded":"2024-09-18T02:08:13.228198+0000","last_fullsized":"2024-09-18T02:08:13.228198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-18T02:08:13.227917+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-18T02:08:13.227917+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.227917+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:13.717888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.268741+0000","last_change":"2024-09-18T02:08:20.268741+0000","last_active":"2024-09-18T02:08:20.268741+0000","last_peered":"2024-09-18T02:08:20.268741+0000","last_clean":"2024-09-18T02:08:20.268741+0000","last_became_active":"2024-09-18T02:04:05.612007+0000","last_became_peered":"2024-09-18T02:04:05.612007+0000","last_unstale":"2024-09-18T02:08:20.268741+0000","last_undegraded":"2024-09-18T02:08:20.268741+0000","last_fullsized":"2024-09-18T02:08:20.268741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.268474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.268474+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.268474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:17:28.013086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.802920+0000","last_change":"2024-09-18T02:08:43.802986+0000","last_active":"2024-09-18T02:08:43.802920+0000","last_peered":"2024-09-18T02:08:43.802920+0000","last_clean":"2024-09-18T02:08:43.802920+0000","last_became_active":"2024-09-18T02:04:07.622247+0000","last_became_peered":"2024-09-18T02:04:07.622247+0000","last_unstale":"2024-09-18T02:08:43.802920+0000","last_undegraded":"2024-09-18T02:08:43.802920+0000","last_fullsized":"2024-09-18T02:08:43.802920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:43.802726+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:43.802726+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.802726+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:20.348248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.783157+0000","last_change":"2024-09-18T02:08:06.783157+0000","last_active":"2024-09-18T02:08:06.783157+0000","last_peered":"2024-09-18T02:08:06.783157+0000","last_clean":"2024-09-18T02:08:06.783157+0000","last_became_active":"2024-09-18T02:03:59.559749+0000","last_became_peered":"2024-09-18T02:03:59.559749+0000","last_unstale":"2024-09-18T02:08:06.783157+0000","last_undegraded":"2024-09-18T02:08:06.783157+0000","last_fullsized":"2024-09-18T02:08:06.783157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:06.782905+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:06.782905+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.782905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:21:01.786933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.329691+0000","last_change":"2024-09-18T02:08:28.329750+0000","last_active":"2024-09-18T02:08:28.329691+0000","last_peered":"2024-09-18T02:08:28.329691+0000","last_clean":"2024-09-18T02:08:28.329691+0000","last_became_active":"2024-09-18T02:03:57.519961+0000","last_became_peered":"2024-09-18T02:03:57.519961+0000","last_unstale":"2024-09-18T02:08:28.329691+0000","last_undegraded":"2024-09-18T02:08:28.329691+0000","last_fullsized":"2024-09-18T02:08:28.329691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:28.329487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:28.329487+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.329487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:04.583889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:33.904522+0000","last_change":"2024-09-18T02:08:33.904577+0000","last_active":"2024-09-18T02:08:33.904522+0000","last_peered":"2024-09-18T02:08:33.904522+0000","last_clean":"2024-09-18T02:08:33.904522+0000","last_became_active":"2024-09-18T02:03:48.274657+0000","last_became_peered":"2024-09-18T02:03:48.274657+0000","last_unstale":"2024-09-18T02:08:33.904522+0000","last_undegraded":"2024-09-18T02:08:33.904522+0000","last_fullsized":"2024-09-18T02:08:33.904522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:33.904329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:33.904329+0000","last_clean_scrub_stamp":"2024-09-18T02:08:33.904329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:37:27.614303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000970169,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.206497+0000","last_change":"2024-09-18T02:08:05.206497+0000","last_active":"2024-09-18T02:08:05.206497+0000","last_peered":"2024-09-18T02:08:05.206497+0000","last_clean":"2024-09-18T02:08:05.206497+0000","last_became_active":"2024-09-18T02:04:01.571443+0000","last_became_peered":"2024-09-18T02:04:01.571443+0000","last_unstale":"2024-09-18T02:08:05.206497+0000","last_undegraded":"2024-09-18T02:08:05.206497+0000","last_fullsized":"2024-09-18T02:08:05.206497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:05.206220+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:05.206220+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.206220+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:45:50.192588+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'90","reported_seq":179,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.219597+0000","last_change":"2024-09-18T02:08:02.219597+0000","last_active":"2024-09-18T02:08:02.219597+0000","last_peered":"2024-09-18T02:08:02.219597+0000","last_clean":"2024-09-18T02:08:02.219597+0000","last_became_active":"2024-09-18T02:04:03.569938+0000","last_became_peered":"2024-09-18T02:04:03.569938+0000","last_unstale":"2024-09-18T02:08:02.219597+0000","last_undegraded":"2024-09-18T02:08:02.219597+0000","last_fullsized":"2024-09-18T02:08:02.219597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-09-18T02:08:02.219300+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-09-18T02:08:02.219300+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.219300+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:38.149380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.352767+0000","last_change":"2024-09-18T02:07:52.352767+0000","last_active":"2024-09-18T02:07:52.352767+0000","last_peered":"2024-09-18T02:07:52.352767+0000","last_clean":"2024-09-18T02:07:52.352767+0000","last_became_active":"2024-09-18T02:04:05.597181+0000","last_became_peered":"2024-09-18T02:04:05.597181+0000","last_unstale":"2024-09-18T02:07:52.352767+0000","last_undegraded":"2024-09-18T02:07:52.352767+0000","last_fullsized":"2024-09-18T02:07:52.352767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:52.352475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:52.352475+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.352475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:51:22.983509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.732465+0000","last_change":"2024-09-18T02:08:44.732531+0000","last_active":"2024-09-18T02:08:44.732465+0000","last_peered":"2024-09-18T02:08:44.732465+0000","last_clean":"2024-09-18T02:08:44.732465+0000","last_became_active":"2024-09-18T02:04:07.618751+0000","last_became_peered":"2024-09-18T02:04:07.618751+0000","last_unstale":"2024-09-18T02:08:44.732465+0000","last_undegraded":"2024-09-18T02:08:44.732465+0000","last_fullsized":"2024-09-18T02:08:44.732465+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-18T02:08:44.732277+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-18T02:08:44.732277+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.732277+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:19:46.289450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.681556+0000","last_change":"2024-09-18T02:08:14.681691+0000","last_active":"2024-09-18T02:08:14.681556+0000","last_peered":"2024-09-18T02:08:14.681556+0000","last_clean":"2024-09-18T02:08:14.681556+0000","last_became_active":"2024-09-18T02:03:59.553619+0000","last_became_peered":"2024-09-18T02:03:59.553619+0000","last_unstale":"2024-09-18T02:08:14.681556+0000","last_undegraded":"2024-09-18T02:08:14.681556+0000","last_fullsized":"2024-09-18T02:08:14.681556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:14.681214+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:14.681214+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.681214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:48.991814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:34.895974+0000","last_change":"2024-09-18T02:08:34.896041+0000","last_active":"2024-09-18T02:08:34.895974+0000","last_peered":"2024-09-18T02:08:34.895974+0000","last_clean":"2024-09-18T02:08:34.895974+0000","last_became_active":"2024-09-18T02:03:57.518503+0000","last_became_peered":"2024-09-18T02:03:57.518503+0000","last_unstale":"2024-09-18T02:08:34.895974+0000","last_undegraded":"2024-09-18T02:08:34.895974+0000","last_fullsized":"2024-09-18T02:08:34.895974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:34.895751+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:34.895751+0000","last_clean_scrub_stamp":"2024-09-18T02:08:34.895751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:59:58.727532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:57.460347+0000","last_change":"2024-09-18T02:08:57.460492+0000","last_active":"2024-09-18T02:08:57.460347+0000","last_peered":"2024-09-18T02:08:57.460347+0000","last_clean":"2024-09-18T02:08:57.460347+0000","last_became_active":"2024-09-18T02:03:48.276300+0000","last_became_peered":"2024-09-18T02:03:48.276300+0000","last_unstale":"2024-09-18T02:08:57.460347+0000","last_undegraded":"2024-09-18T02:08:57.460347+0000","last_fullsized":"2024-09-18T02:08:57.460347+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:57.460094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:57.460094+0000","last_clean_scrub_stamp":"2024-09-18T02:08:57.460094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:05.068134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002788245,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.199897+0000","last_change":"2024-09-18T02:08:01.199897+0000","last_active":"2024-09-18T02:08:01.199897+0000","last_peered":"2024-09-18T02:08:01.199897+0000","last_clean":"2024-09-18T02:08:01.199897+0000","last_became_active":"2024-09-18T02:04:01.557570+0000","last_became_peered":"2024-09-18T02:04:01.557570+0000","last_unstale":"2024-09-18T02:08:01.199897+0000","last_undegraded":"2024-09-18T02:08:01.199897+0000","last_fullsized":"2024-09-18T02:08:01.199897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:01.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:01.199648+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:22.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'28","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.127859+0000","last_change":"2024-09-18T02:07:48.127859+0000","last_active":"2024-09-18T02:07:48.127859+0000","last_peered":"2024-09-18T02:07:48.127859+0000","last_clean":"2024-09-18T02:07:48.127859+0000","last_became_active":"2024-09-18T02:04:03.588539+0000","last_became_peered":"2024-09-18T02:04:03.588539+0000","last_unstale":"2024-09-18T02:07:48.127859+0000","last_undegraded":"2024-09-18T02:07:48.127859+0000","last_fullsized":"2024-09-18T02:07:48.127859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-09-18T02:07:48.127557+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-09-18T02:07:48.127557+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.127557+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:55:43.485970+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:49.149355+0000","last_change":"2024-09-18T02:07:49.149355+0000","last_active":"2024-09-18T02:07:49.149355+0000","last_peered":"2024-09-18T02:07:49.149355+0000","last_clean":"2024-09-18T02:07:49.149355+0000","last_became_active":"2024-09-18T02:04:05.582477+0000","last_became_peered":"2024-09-18T02:04:05.582477+0000","last_unstale":"2024-09-18T02:07:49.149355+0000","last_undegraded":"2024-09-18T02:07:49.149355+0000","last_fullsized":"2024-09-18T02:07:49.149355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:49.149087+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:49.149087+0000","last_clean_scrub_stamp":"2024-09-18T02:07:49.149087+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:49:13.463449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.295297+0000","last_change":"2024-09-18T02:08:28.295297+0000","last_active":"2024-09-18T02:08:28.295297+0000","last_peered":"2024-09-18T02:08:28.295297+0000","last_clean":"2024-09-18T02:08:28.295297+0000","last_became_active":"2024-09-18T02:04:07.605591+0000","last_became_peered":"2024-09-18T02:04:07.605591+0000","last_unstale":"2024-09-18T02:08:28.295297+0000","last_undegraded":"2024-09-18T02:08:28.295297+0000","last_fullsized":"2024-09-18T02:08:28.295297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:28.295047+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:28.295047+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.295047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:36:50.563195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.280299+0000","last_change":"2024-09-18T02:08:19.280466+0000","last_active":"2024-09-18T02:08:19.280299+0000","last_peered":"2024-09-18T02:08:19.280299+0000","last_clean":"2024-09-18T02:08:19.280299+0000","last_became_active":"2024-09-18T02:03:59.559044+0000","last_became_peered":"2024-09-18T02:03:59.559044+0000","last_unstale":"2024-09-18T02:08:19.280299+0000","last_undegraded":"2024-09-18T02:08:19.280299+0000","last_fullsized":"2024-09-18T02:08:19.280299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:19.280064+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:19.280064+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.280064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:03.804854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:00.502904+0000","last_change":"2024-09-18T02:09:00.502957+0000","last_active":"2024-09-18T02:09:00.502904+0000","last_peered":"2024-09-18T02:09:00.502904+0000","last_clean":"2024-09-18T02:09:00.502904+0000","last_became_active":"2024-09-18T02:03:57.521706+0000","last_became_peered":"2024-09-18T02:03:57.521706+0000","last_unstale":"2024-09-18T02:09:00.502904+0000","last_undegraded":"2024-09-18T02:09:00.502904+0000","last_fullsized":"2024-09-18T02:09:00.502904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:09:00.502706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:09:00.502706+0000","last_clean_scrub_stamp":"2024-09-18T02:09:00.502706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:07:55.664950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.924188+0000","last_change":"2024-09-18T02:08:32.924244+0000","last_active":"2024-09-18T02:08:32.924188+0000","last_peered":"2024-09-18T02:08:32.924188+0000","last_clean":"2024-09-18T02:08:32.924188+0000","last_became_active":"2024-09-18T02:03:48.274030+0000","last_became_peered":"2024-09-18T02:03:48.274030+0000","last_unstale":"2024-09-18T02:08:32.924188+0000","last_undegraded":"2024-09-18T02:08:32.924188+0000","last_fullsized":"2024-09-18T02:08:32.924188+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:32.923996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:32.923996+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.923996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:19.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011092910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.183292+0000","last_change":"2024-09-18T02:07:59.183292+0000","last_active":"2024-09-18T02:07:59.183292+0000","last_peered":"2024-09-18T02:07:59.183292+0000","last_clean":"2024-09-18T02:07:59.183292+0000","last_became_active":"2024-09-18T02:04:01.558915+0000","last_became_peered":"2024-09-18T02:04:01.558915+0000","last_unstale":"2024-09-18T02:07:59.183292+0000","last_undegraded":"2024-09-18T02:07:59.183292+0000","last_fullsized":"2024-09-18T02:07:59.183292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:59.183052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:59.183052+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.183052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:25:35.437454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.328507+0000","last_change":"2024-09-18T02:07:52.328507+0000","last_active":"2024-09-18T02:07:52.328507+0000","last_peered":"2024-09-18T02:07:52.328507+0000","last_clean":"2024-09-18T02:07:52.328507+0000","last_became_active":"2024-09-18T02:04:03.591378+0000","last_became_peered":"2024-09-18T02:04:03.591378+0000","last_unstale":"2024-09-18T02:07:52.328507+0000","last_undegraded":"2024-09-18T02:07:52.328507+0000","last_fullsized":"2024-09-18T02:07:52.328507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-18T02:07:52.328188+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-18T02:07:52.328188+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.328188+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:26.638787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.282096+0000","last_change":"2024-09-18T02:07:55.282096+0000","last_active":"2024-09-18T02:07:55.282096+0000","last_peered":"2024-09-18T02:07:55.282096+0000","last_clean":"2024-09-18T02:07:55.282096+0000","last_became_active":"2024-09-18T02:04:05.605265+0000","last_became_peered":"2024-09-18T02:04:05.605265+0000","last_unstale":"2024-09-18T02:07:55.282096+0000","last_undegraded":"2024-09-18T02:07:55.282096+0000","last_fullsized":"2024-09-18T02:07:55.282096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:55.281840+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:55.281840+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.281840+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:15.115042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:46.750170+0000","last_change":"2024-09-18T02:08:46.750236+0000","last_active":"2024-09-18T02:08:46.750170+0000","last_peered":"2024-09-18T02:08:46.750170+0000","last_clean":"2024-09-18T02:08:46.750170+0000","last_became_active":"2024-09-18T02:04:07.624085+0000","last_became_peered":"2024-09-18T02:04:07.624085+0000","last_unstale":"2024-09-18T02:08:46.750170+0000","last_undegraded":"2024-09-18T02:08:46.750170+0000","last_fullsized":"2024-09-18T02:08:46.750170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:08:46.749974+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:08:46.749974+0000","last_clean_scrub_stamp":"2024-09-18T02:08:46.749974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:19:48.307147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.250825+0000","last_change":"2024-09-18T02:08:15.250887+0000","last_active":"2024-09-18T02:08:15.250825+0000","last_peered":"2024-09-18T02:08:15.250825+0000","last_clean":"2024-09-18T02:08:15.250825+0000","last_became_active":"2024-09-18T02:03:59.535266+0000","last_became_peered":"2024-09-18T02:03:59.535266+0000","last_unstale":"2024-09-18T02:08:15.250825+0000","last_undegraded":"2024-09-18T02:08:15.250825+0000","last_fullsized":"2024-09-18T02:08:15.250825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:15.250637+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:15.250637+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.250637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:15.097705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.764764+0000","last_change":"2024-09-18T02:08:23.764827+0000","last_active":"2024-09-18T02:08:23.764764+0000","last_peered":"2024-09-18T02:08:23.764764+0000","last_clean":"2024-09-18T02:08:23.764764+0000","last_became_active":"2024-09-18T02:03:57.528676+0000","last_became_peered":"2024-09-18T02:03:57.528676+0000","last_unstale":"2024-09-18T02:08:23.764764+0000","last_undegraded":"2024-09-18T02:08:23.764764+0000","last_fullsized":"2024-09-18T02:08:23.764764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:23.764549+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:23.764549+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.764549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:45.428464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:58.462346+0000","last_change":"2024-09-18T02:08:58.462405+0000","last_active":"2024-09-18T02:08:58.462346+0000","last_peered":"2024-09-18T02:08:58.462346+0000","last_clean":"2024-09-18T02:08:58.462346+0000","last_became_active":"2024-09-18T02:03:48.396609+0000","last_became_peered":"2024-09-18T02:03:48.396609+0000","last_unstale":"2024-09-18T02:08:58.462346+0000","last_undegraded":"2024-09-18T02:08:58.462346+0000","last_fullsized":"2024-09-18T02:08:58.462346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:58.462158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:58.462158+0000","last_clean_scrub_stamp":"2024-09-18T02:08:58.462158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:00.953633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0025902970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.230746+0000","last_change":"2024-09-18T02:07:54.230746+0000","last_active":"2024-09-18T02:07:54.230746+0000","last_peered":"2024-09-18T02:07:54.230746+0000","last_clean":"2024-09-18T02:07:54.230746+0000","last_became_active":"2024-09-18T02:04:01.561488+0000","last_became_peered":"2024-09-18T02:04:01.561488+0000","last_unstale":"2024-09-18T02:07:54.230746+0000","last_undegraded":"2024-09-18T02:07:54.230746+0000","last_fullsized":"2024-09-18T02:07:54.230746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.230358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.230358+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.230358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:40.139193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'103","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.275633+0000","last_change":"2024-09-18T02:07:58.275633+0000","last_active":"2024-09-18T02:07:58.275633+0000","last_peered":"2024-09-18T02:07:58.275633+0000","last_clean":"2024-09-18T02:07:58.275633+0000","last_became_active":"2024-09-18T02:04:03.585879+0000","last_became_peered":"2024-09-18T02:04:03.585879+0000","last_unstale":"2024-09-18T02:07:58.275633+0000","last_undegraded":"2024-09-18T02:07:58.275633+0000","last_fullsized":"2024-09-18T02:07:58.275633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'103","last_scrub_stamp":"2024-09-18T02:07:58.275354+0000","last_deep_scrub":"32'103","last_deep_scrub_stamp":"2024-09-18T02:07:58.275354+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.275354+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:34:23.917223+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.300909+0000","last_change":"2024-09-18T02:07:48.300909+0000","last_active":"2024-09-18T02:07:48.300909+0000","last_peered":"2024-09-18T02:07:48.300909+0000","last_clean":"2024-09-18T02:07:48.300909+0000","last_became_active":"2024-09-18T02:04:05.588676+0000","last_became_peered":"2024-09-18T02:04:05.588676+0000","last_unstale":"2024-09-18T02:07:48.300909+0000","last_undegraded":"2024-09-18T02:07:48.300909+0000","last_fullsized":"2024-09-18T02:07:48.300909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.300757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.300757+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.300757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:52:41.278180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:59.274232+0000","last_change":"2024-09-18T02:07:59.274232+0000","last_active":"2024-09-18T02:07:59.274232+0000","last_peered":"2024-09-18T02:07:59.274232+0000","last_clean":"2024-09-18T02:07:59.274232+0000","last_became_active":"2024-09-18T02:04:07.619587+0000","last_became_peered":"2024-09-18T02:04:07.619587+0000","last_unstale":"2024-09-18T02:07:59.274232+0000","last_undegraded":"2024-09-18T02:07:59.274232+0000","last_fullsized":"2024-09-18T02:07:59.274232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:07:59.273974+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:07:59.273974+0000","last_clean_scrub_stamp":"2024-09-18T02:07:59.273974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:10.696295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.299098+0000","last_change":"2024-09-18T02:08:03.299098+0000","last_active":"2024-09-18T02:08:03.299098+0000","last_peered":"2024-09-18T02:08:03.299098+0000","last_clean":"2024-09-18T02:08:03.299098+0000","last_became_active":"2024-09-18T02:04:07.626396+0000","last_became_peered":"2024-09-18T02:04:07.626396+0000","last_unstale":"2024-09-18T02:08:03.299098+0000","last_undegraded":"2024-09-18T02:08:03.299098+0000","last_fullsized":"2024-09-18T02:08:03.299098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:03.298850+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:03.298850+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.298850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:43:53.827265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.214400+0000","last_change":"2024-09-18T02:08:23.214400+0000","last_active":"2024-09-18T02:08:23.214400+0000","last_peered":"2024-09-18T02:08:23.214400+0000","last_clean":"2024-09-18T02:08:23.214400+0000","last_became_active":"2024-09-18T02:03:59.538280+0000","last_became_peered":"2024-09-18T02:03:59.538280+0000","last_unstale":"2024-09-18T02:08:23.214400+0000","last_undegraded":"2024-09-18T02:08:23.214400+0000","last_fullsized":"2024-09-18T02:08:23.214400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.214126+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.214126+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.214126+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:30:36.362222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:46.544838+0000","last_change":"2024-09-18T02:08:46.544890+0000","last_active":"2024-09-18T02:08:46.544838+0000","last_peered":"2024-09-18T02:08:46.544838+0000","last_clean":"2024-09-18T02:08:46.544838+0000","last_became_active":"2024-09-18T02:03:57.530751+0000","last_became_peered":"2024-09-18T02:03:57.530751+0000","last_unstale":"2024-09-18T02:08:46.544838+0000","last_undegraded":"2024-09-18T02:08:46.544838+0000","last_fullsized":"2024-09-18T02:08:46.544838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:46.544649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:46.544649+0000","last_clean_scrub_stamp":"2024-09-18T02:08:46.544649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:07:24.141178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:05.781701+0000","last_change":"2024-09-18T02:08:05.781701+0000","last_active":"2024-09-18T02:08:05.781701+0000","last_peered":"2024-09-18T02:08:05.781701+0000","last_clean":"2024-09-18T02:08:05.781701+0000","last_became_active":"2024-09-18T02:04:01.561230+0000","last_became_peered":"2024-09-18T02:04:01.561230+0000","last_unstale":"2024-09-18T02:08:05.781701+0000","last_undegraded":"2024-09-18T02:08:05.781701+0000","last_fullsized":"2024-09-18T02:08:05.781701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:05.781451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:05.781451+0000","last_clean_scrub_stamp":"2024-09-18T02:08:05.781451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:52:05.813452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'47","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.175717+0000","last_change":"2024-09-18T02:07:58.175717+0000","last_active":"2024-09-18T02:07:58.175717+0000","last_peered":"2024-09-18T02:07:58.175717+0000","last_clean":"2024-09-18T02:07:58.175717+0000","last_became_active":"2024-09-18T02:04:03.595284+0000","last_became_peered":"2024-09-18T02:04:03.595284+0000","last_unstale":"2024-09-18T02:07:58.175717+0000","last_undegraded":"2024-09-18T02:07:58.175717+0000","last_fullsized":"2024-09-18T02:07:58.175717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-18T02:07:58.175442+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-18T02:07:58.175442+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.175442+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:34.582776+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.235985+0000","last_change":"2024-09-18T02:08:06.235985+0000","last_active":"2024-09-18T02:08:06.235985+0000","last_peered":"2024-09-18T02:08:06.235985+0000","last_clean":"2024-09-18T02:08:06.235985+0000","last_became_active":"2024-09-18T02:04:05.602528+0000","last_became_peered":"2024-09-18T02:04:05.602528+0000","last_unstale":"2024-09-18T02:08:06.235985+0000","last_undegraded":"2024-09-18T02:08:06.235985+0000","last_fullsized":"2024-09-18T02:08:06.235985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:06.235742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:06.235742+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.235742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:35:36.200312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:46.820783+0000","last_change":"2024-09-18T02:08:46.820906+0000","last_active":"2024-09-18T02:08:46.820783+0000","last_peered":"2024-09-18T02:08:46.820783+0000","last_clean":"2024-09-18T02:08:46.820783+0000","last_became_active":"2024-09-18T02:04:07.622753+0000","last_became_peered":"2024-09-18T02:04:07.622753+0000","last_unstale":"2024-09-18T02:08:46.820783+0000","last_undegraded":"2024-09-18T02:08:46.820783+0000","last_fullsized":"2024-09-18T02:08:46.820783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:08:46.820551+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:08:46.820551+0000","last_clean_scrub_stamp":"2024-09-18T02:08:46.820551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:21:14.133758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.791428+0000","last_change":"2024-09-18T02:08:07.791428+0000","last_active":"2024-09-18T02:08:07.791428+0000","last_peered":"2024-09-18T02:08:07.791428+0000","last_clean":"2024-09-18T02:08:07.791428+0000","last_became_active":"2024-09-18T02:03:59.554803+0000","last_became_peered":"2024-09-18T02:03:59.554803+0000","last_unstale":"2024-09-18T02:08:07.791428+0000","last_undegraded":"2024-09-18T02:08:07.791428+0000","last_fullsized":"2024-09-18T02:08:07.791428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:07.791070+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:07.791070+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.791070+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:05:07.638138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.306675+0000","last_change":"2024-09-18T02:08:32.306675+0000","last_active":"2024-09-18T02:08:32.306675+0000","last_peered":"2024-09-18T02:08:32.306675+0000","last_clean":"2024-09-18T02:08:32.306675+0000","last_became_active":"2024-09-18T02:03:57.519403+0000","last_became_peered":"2024-09-18T02:03:57.519403+0000","last_unstale":"2024-09-18T02:08:32.306675+0000","last_undegraded":"2024-09-18T02:08:32.306675+0000","last_fullsized":"2024-09-18T02:08:32.306675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:32.306349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:32.306349+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.306349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:18.134340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.195649+0000","last_change":"2024-09-18T02:07:57.195649+0000","last_active":"2024-09-18T02:07:57.195649+0000","last_peered":"2024-09-18T02:07:57.195649+0000","last_clean":"2024-09-18T02:07:57.195649+0000","last_became_active":"2024-09-18T02:04:01.558788+0000","last_became_peered":"2024-09-18T02:04:01.558788+0000","last_unstale":"2024-09-18T02:07:57.195649+0000","last_undegraded":"2024-09-18T02:07:57.195649+0000","last_fullsized":"2024-09-18T02:07:57.195649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:57.195366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:57.195366+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.195366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:25.351307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.260300+0000","last_change":"2024-09-18T02:07:57.260300+0000","last_active":"2024-09-18T02:07:57.260300+0000","last_peered":"2024-09-18T02:07:57.260300+0000","last_clean":"2024-09-18T02:07:57.260300+0000","last_became_active":"2024-09-18T02:04:03.581045+0000","last_became_peered":"2024-09-18T02:04:03.581045+0000","last_unstale":"2024-09-18T02:07:57.260300+0000","last_undegraded":"2024-09-18T02:07:57.260300+0000","last_fullsized":"2024-09-18T02:07:57.260300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:07:57.259885+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:07:57.259885+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.259885+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:36.754049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.344690+0000","last_change":"2024-09-18T02:07:53.344690+0000","last_active":"2024-09-18T02:07:53.344690+0000","last_peered":"2024-09-18T02:07:53.344690+0000","last_clean":"2024-09-18T02:07:53.344690+0000","last_became_active":"2024-09-18T02:04:05.599064+0000","last_became_peered":"2024-09-18T02:04:05.599064+0000","last_unstale":"2024-09-18T02:07:53.344690+0000","last_undegraded":"2024-09-18T02:07:53.344690+0000","last_fullsized":"2024-09-18T02:07:53.344690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.344462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.344462+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.344462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:17:03.855166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.828227+0000","last_change":"2024-09-18T02:08:41.828227+0000","last_active":"2024-09-18T02:08:41.828227+0000","last_peered":"2024-09-18T02:08:41.828227+0000","last_clean":"2024-09-18T02:08:41.828227+0000","last_became_active":"2024-09-18T02:04:07.609954+0000","last_became_peered":"2024-09-18T02:04:07.609954+0000","last_unstale":"2024-09-18T02:08:41.828227+0000","last_undegraded":"2024-09-18T02:08:41.828227+0000","last_fullsized":"2024-09-18T02:08:41.828227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:41.827965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:41.827965+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.827965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:18.373487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:16.117771+0000","last_change":"2024-09-18T02:08:16.117771+0000","last_active":"2024-09-18T02:08:16.117771+0000","last_peered":"2024-09-18T02:08:16.117771+0000","last_clean":"2024-09-18T02:08:16.117771+0000","last_became_active":"2024-09-18T02:03:59.549791+0000","last_became_peered":"2024-09-18T02:03:59.549791+0000","last_unstale":"2024-09-18T02:08:16.117771+0000","last_undegraded":"2024-09-18T02:08:16.117771+0000","last_fullsized":"2024-09-18T02:08:16.117771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:16.117501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:16.117501+0000","last_clean_scrub_stamp":"2024-09-18T02:08:16.117501+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:42:44.273442+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:42.148371+0000","last_change":"2024-09-18T02:08:42.148371+0000","last_active":"2024-09-18T02:08:42.148371+0000","last_peered":"2024-09-18T02:08:42.148371+0000","last_clean":"2024-09-18T02:08:42.148371+0000","last_became_active":"2024-09-18T02:04:36.370188+0000","last_became_peered":"2024-09-18T02:04:36.370188+0000","last_unstale":"2024-09-18T02:08:42.148371+0000","last_undegraded":"2024-09-18T02:08:42.148371+0000","last_fullsized":"2024-09-18T02:08:42.148371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:42.148035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:42.148035+0000","last_clean_scrub_stamp":"2024-09-18T02:08:42.148035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:28.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.309363+0000","last_change":"2024-09-18T02:08:10.309363+0000","last_active":"2024-09-18T02:08:10.309363+0000","last_peered":"2024-09-18T02:08:10.309363+0000","last_clean":"2024-09-18T02:08:10.309363+0000","last_became_active":"2024-09-18T02:04:01.562586+0000","last_became_peered":"2024-09-18T02:04:01.562586+0000","last_unstale":"2024-09-18T02:08:10.309363+0000","last_undegraded":"2024-09-18T02:08:10.309363+0000","last_fullsized":"2024-09-18T02:08:10.309363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:10.309081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:10.309081+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.309081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:18.629970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'50","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:58.231588+0000","last_change":"2024-09-18T02:07:58.231588+0000","last_active":"2024-09-18T02:07:58.231588+0000","last_peered":"2024-09-18T02:07:58.231588+0000","last_clean":"2024-09-18T02:07:58.231588+0000","last_became_active":"2024-09-18T02:04:03.578581+0000","last_became_peered":"2024-09-18T02:04:03.578581+0000","last_unstale":"2024-09-18T02:07:58.231588+0000","last_undegraded":"2024-09-18T02:07:58.231588+0000","last_fullsized":"2024-09-18T02:07:58.231588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'50","last_scrub_stamp":"2024-09-18T02:07:58.231292+0000","last_deep_scrub":"32'50","last_deep_scrub_stamp":"2024-09-18T02:07:58.231292+0000","last_clean_scrub_stamp":"2024-09-18T02:07:58.231292+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:28.484821+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.089343+0000","last_change":"2024-09-18T02:07:53.089343+0000","last_active":"2024-09-18T02:07:53.089343+0000","last_peered":"2024-09-18T02:07:53.089343+0000","last_clean":"2024-09-18T02:07:53.089343+0000","last_became_active":"2024-09-18T02:04:05.586978+0000","last_became_peered":"2024-09-18T02:04:05.586978+0000","last_unstale":"2024-09-18T02:07:53.089343+0000","last_undegraded":"2024-09-18T02:07:53.089343+0000","last_fullsized":"2024-09-18T02:07:53.089343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.089086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.089086+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.089086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:43.728215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.510782+0000","last_change":"2024-09-18T02:08:36.510782+0000","last_active":"2024-09-18T02:08:36.510782+0000","last_peered":"2024-09-18T02:08:36.510782+0000","last_clean":"2024-09-18T02:08:36.510782+0000","last_became_active":"2024-09-18T02:04:07.607227+0000","last_became_peered":"2024-09-18T02:04:07.607227+0000","last_unstale":"2024-09-18T02:08:36.510782+0000","last_undegraded":"2024-09-18T02:08:36.510782+0000","last_fullsized":"2024-09-18T02:08:36.510782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:36.510432+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:36.510432+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.510432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:05:18.157288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.418342+0000","last_change":"2024-09-18T02:08:31.418342+0000","last_active":"2024-09-18T02:08:31.418342+0000","last_peered":"2024-09-18T02:08:31.418342+0000","last_clean":"2024-09-18T02:08:31.418342+0000","last_became_active":"2024-09-18T02:03:59.550221+0000","last_became_peered":"2024-09-18T02:03:59.550221+0000","last_unstale":"2024-09-18T02:08:31.418342+0000","last_undegraded":"2024-09-18T02:08:31.418342+0000","last_fullsized":"2024-09-18T02:08:31.418342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:31.418082+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:31.418082+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.418082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:38.837680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:29.766183+0000","last_change":"2024-09-18T02:08:29.766183+0000","last_active":"2024-09-18T02:08:29.766183+0000","last_peered":"2024-09-18T02:08:29.766183+0000","last_clean":"2024-09-18T02:08:29.766183+0000","last_became_active":"2024-09-18T02:03:57.522590+0000","last_became_peered":"2024-09-18T02:03:57.522590+0000","last_unstale":"2024-09-18T02:08:29.766183+0000","last_undegraded":"2024-09-18T02:08:29.766183+0000","last_fullsized":"2024-09-18T02:08:29.766183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:29.765913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:29.765913+0000","last_clean_scrub_stamp":"2024-09-18T02:08:29.765913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:38.112707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.399749+0000","last_change":"2024-09-18T02:07:48.399749+0000","last_active":"2024-09-18T02:07:48.399749+0000","last_peered":"2024-09-18T02:07:48.399749+0000","last_clean":"2024-09-18T02:07:48.399749+0000","last_became_active":"2024-09-18T02:04:01.566205+0000","last_became_peered":"2024-09-18T02:04:01.566205+0000","last_unstale":"2024-09-18T02:07:48.399749+0000","last_undegraded":"2024-09-18T02:07:48.399749+0000","last_fullsized":"2024-09-18T02:07:48.399749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.399488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.399488+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.399488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:17:47.098447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.319259+0000","last_change":"2024-09-18T02:08:00.319259+0000","last_active":"2024-09-18T02:08:00.319259+0000","last_peered":"2024-09-18T02:08:00.319259+0000","last_clean":"2024-09-18T02:08:00.319259+0000","last_became_active":"2024-09-18T02:04:03.580770+0000","last_became_peered":"2024-09-18T02:04:03.580770+0000","last_unstale":"2024-09-18T02:08:00.319259+0000","last_undegraded":"2024-09-18T02:08:00.319259+0000","last_fullsized":"2024-09-18T02:08:00.319259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-18T02:08:00.318990+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-18T02:08:00.318990+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.318990+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:50.958119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:54.368006+0000","last_change":"2024-09-18T02:07:54.368006+0000","last_active":"2024-09-18T02:07:54.368006+0000","last_peered":"2024-09-18T02:07:54.368006+0000","last_clean":"2024-09-18T02:07:54.368006+0000","last_became_active":"2024-09-18T02:04:05.591514+0000","last_became_peered":"2024-09-18T02:04:05.591514+0000","last_unstale":"2024-09-18T02:07:54.368006+0000","last_undegraded":"2024-09-18T02:07:54.368006+0000","last_fullsized":"2024-09-18T02:07:54.368006+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:54.367760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:54.367760+0000","last_clean_scrub_stamp":"2024-09-18T02:07:54.367760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:57.231313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.224665+0000","last_change":"2024-09-18T02:08:25.224723+0000","last_active":"2024-09-18T02:08:25.224665+0000","last_peered":"2024-09-18T02:08:25.224665+0000","last_clean":"2024-09-18T02:08:25.224665+0000","last_became_active":"2024-09-18T02:03:59.553660+0000","last_became_peered":"2024-09-18T02:03:59.553660+0000","last_unstale":"2024-09-18T02:08:25.224665+0000","last_undegraded":"2024-09-18T02:08:25.224665+0000","last_fullsized":"2024-09-18T02:08:25.224665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:25.224477+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:25.224477+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.224477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:18.652044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.542257+0000","last_change":"2024-09-18T02:08:39.542257+0000","last_active":"2024-09-18T02:08:39.542257+0000","last_peered":"2024-09-18T02:08:39.542257+0000","last_clean":"2024-09-18T02:08:39.542257+0000","last_became_active":"2024-09-18T02:03:57.526941+0000","last_became_peered":"2024-09-18T02:03:57.526941+0000","last_unstale":"2024-09-18T02:08:39.542257+0000","last_undegraded":"2024-09-18T02:08:39.542257+0000","last_fullsized":"2024-09-18T02:08:39.542257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:39.541993+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:39.541993+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.541993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:31.678647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.188438+0000","last_change":"2024-09-18T02:08:10.188544+0000","last_active":"2024-09-18T02:08:10.188438+0000","last_peered":"2024-09-18T02:08:10.188438+0000","last_clean":"2024-09-18T02:08:10.188438+0000","last_became_active":"2024-09-18T02:04:01.559839+0000","last_became_peered":"2024-09-18T02:04:01.559839+0000","last_unstale":"2024-09-18T02:08:10.188438+0000","last_undegraded":"2024-09-18T02:08:10.188438+0000","last_fullsized":"2024-09-18T02:08:10.188438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:10.188213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:10.188213+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.188213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:22:05.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'71","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.245115+0000","last_change":"2024-09-18T02:07:56.245115+0000","last_active":"2024-09-18T02:07:56.245115+0000","last_peered":"2024-09-18T02:07:56.245115+0000","last_clean":"2024-09-18T02:07:56.245115+0000","last_became_active":"2024-09-18T02:04:03.581518+0000","last_became_peered":"2024-09-18T02:04:03.581518+0000","last_unstale":"2024-09-18T02:07:56.245115+0000","last_undegraded":"2024-09-18T02:07:56.245115+0000","last_fullsized":"2024-09-18T02:07:56.245115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'71","last_scrub_stamp":"2024-09-18T02:07:56.244855+0000","last_deep_scrub":"32'71","last_deep_scrub_stamp":"2024-09-18T02:07:56.244855+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.244855+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:40.886685+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:48.238697+0000","last_change":"2024-09-18T02:07:48.238697+0000","last_active":"2024-09-18T02:07:48.238697+0000","last_peered":"2024-09-18T02:07:48.238697+0000","last_clean":"2024-09-18T02:07:48.238697+0000","last_became_active":"2024-09-18T02:04:05.610007+0000","last_became_peered":"2024-09-18T02:04:05.610007+0000","last_unstale":"2024-09-18T02:07:48.238697+0000","last_undegraded":"2024-09-18T02:07:48.238697+0000","last_fullsized":"2024-09-18T02:07:48.238697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:48.238443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:48.238443+0000","last_clean_scrub_stamp":"2024-09-18T02:07:48.238443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:49:49.194989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'20","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:15.091700+0000","last_change":"2024-09-18T02:08:15.091700+0000","last_active":"2024-09-18T02:08:15.091700+0000","last_peered":"2024-09-18T02:08:15.091700+0000","last_clean":"2024-09-18T02:08:15.091700+0000","last_became_active":"2024-09-18T02:04:07.609058+0000","last_became_peered":"2024-09-18T02:04:07.609058+0000","last_unstale":"2024-09-18T02:08:15.091700+0000","last_undegraded":"2024-09-18T02:08:15.091700+0000","last_fullsized":"2024-09-18T02:08:15.091700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-18T02:08:15.091443+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-18T02:08:15.091443+0000","last_clean_scrub_stamp":"2024-09-18T02:08:15.091443+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:45.320119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.012222+0000","last_change":"2024-09-18T02:08:27.012287+0000","last_active":"2024-09-18T02:08:27.012222+0000","last_peered":"2024-09-18T02:08:27.012222+0000","last_clean":"2024-09-18T02:08:27.012222+0000","last_became_active":"2024-09-18T02:03:59.540971+0000","last_became_peered":"2024-09-18T02:03:59.540971+0000","last_unstale":"2024-09-18T02:08:27.012222+0000","last_undegraded":"2024-09-18T02:08:27.012222+0000","last_fullsized":"2024-09-18T02:08:27.012222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:27.012027+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:27.012027+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.012027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:07:36.140644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.865777+0000","last_change":"2024-09-18T02:08:35.865777+0000","last_active":"2024-09-18T02:08:35.865777+0000","last_peered":"2024-09-18T02:08:35.865777+0000","last_clean":"2024-09-18T02:08:35.865777+0000","last_became_active":"2024-09-18T02:03:57.518311+0000","last_became_peered":"2024-09-18T02:03:57.518311+0000","last_unstale":"2024-09-18T02:08:35.865777+0000","last_undegraded":"2024-09-18T02:08:35.865777+0000","last_fullsized":"2024-09-18T02:08:35.865777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:35.865415+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:35.865415+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.865415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:55:22.501985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:09.276033+0000","last_change":"2024-09-18T02:08:09.276033+0000","last_active":"2024-09-18T02:08:09.276033+0000","last_peered":"2024-09-18T02:08:09.276033+0000","last_clean":"2024-09-18T02:08:09.276033+0000","last_became_active":"2024-09-18T02:04:01.563285+0000","last_became_peered":"2024-09-18T02:04:01.563285+0000","last_unstale":"2024-09-18T02:08:09.276033+0000","last_undegraded":"2024-09-18T02:08:09.276033+0000","last_fullsized":"2024-09-18T02:08:09.276033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:09.275778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:09.275778+0000","last_clean_scrub_stamp":"2024-09-18T02:08:09.275778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:33:39.529307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'47","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.348431+0000","last_change":"2024-09-18T02:08:17.348431+0000","last_active":"2024-09-18T02:08:17.348431+0000","last_peered":"2024-09-18T02:08:17.348431+0000","last_clean":"2024-09-18T02:08:17.348431+0000","last_became_active":"2024-09-18T02:04:03.596605+0000","last_became_peered":"2024-09-18T02:04:03.596605+0000","last_unstale":"2024-09-18T02:08:17.348431+0000","last_undegraded":"2024-09-18T02:08:17.348431+0000","last_fullsized":"2024-09-18T02:08:17.348431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-18T02:08:17.348103+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-18T02:08:17.348103+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.348103+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:15.420796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:56.941998+0000","last_change":"2024-09-18T02:07:56.941998+0000","last_active":"2024-09-18T02:07:56.941998+0000","last_peered":"2024-09-18T02:07:56.941998+0000","last_clean":"2024-09-18T02:07:56.941998+0000","last_became_active":"2024-09-18T02:04:05.589023+0000","last_became_peered":"2024-09-18T02:04:05.589023+0000","last_unstale":"2024-09-18T02:07:56.941998+0000","last_undegraded":"2024-09-18T02:07:56.941998+0000","last_fullsized":"2024-09-18T02:07:56.941998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:56.941733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:56.941733+0000","last_clean_scrub_stamp":"2024-09-18T02:07:56.941733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:37:18.501298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:09.437676+0000","last_change":"2024-09-18T02:09:09.437734+0000","last_active":"2024-09-18T02:09:09.437676+0000","last_peered":"2024-09-18T02:09:09.437676+0000","last_clean":"2024-09-18T02:09:09.437676+0000","last_became_active":"2024-09-18T02:04:07.625440+0000","last_became_peered":"2024-09-18T02:04:07.625440+0000","last_unstale":"2024-09-18T02:09:09.437676+0000","last_undegraded":"2024-09-18T02:09:09.437676+0000","last_fullsized":"2024-09-18T02:09:09.437676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:09:09.437464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:09:09.437464+0000","last_clean_scrub_stamp":"2024-09-18T02:09:09.437464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:41:20.424488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.216266+0000","last_change":"2024-09-18T02:08:02.216266+0000","last_active":"2024-09-18T02:08:02.216266+0000","last_peered":"2024-09-18T02:08:02.216266+0000","last_clean":"2024-09-18T02:08:02.216266+0000","last_became_active":"2024-09-18T02:03:59.561208+0000","last_became_peered":"2024-09-18T02:03:59.561208+0000","last_unstale":"2024-09-18T02:08:02.216266+0000","last_undegraded":"2024-09-18T02:08:02.216266+0000","last_fullsized":"2024-09-18T02:08:02.216266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:02.216020+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:02.216020+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.216020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:26:52.878948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.792480+0000","last_change":"2024-09-18T02:08:40.792480+0000","last_active":"2024-09-18T02:08:40.792480+0000","last_peered":"2024-09-18T02:08:40.792480+0000","last_clean":"2024-09-18T02:08:40.792480+0000","last_became_active":"2024-09-18T02:03:57.520569+0000","last_became_peered":"2024-09-18T02:03:57.520569+0000","last_unstale":"2024-09-18T02:08:40.792480+0000","last_undegraded":"2024-09-18T02:08:40.792480+0000","last_fullsized":"2024-09-18T02:08:40.792480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:40.792207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:40.792207+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.792207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:31.080041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.257373+0000","last_change":"2024-09-18T02:08:08.257373+0000","last_active":"2024-09-18T02:08:08.257373+0000","last_peered":"2024-09-18T02:08:08.257373+0000","last_clean":"2024-09-18T02:08:08.257373+0000","last_became_active":"2024-09-18T02:04:01.565499+0000","last_became_peered":"2024-09-18T02:04:01.565499+0000","last_unstale":"2024-09-18T02:08:08.257373+0000","last_undegraded":"2024-09-18T02:08:08.257373+0000","last_fullsized":"2024-09-18T02:08:08.257373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.257120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.257120+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.257120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:20:47.751284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:00.199509+0000","last_change":"2024-09-18T02:08:00.199509+0000","last_active":"2024-09-18T02:08:00.199509+0000","last_peered":"2024-09-18T02:08:00.199509+0000","last_clean":"2024-09-18T02:08:00.199509+0000","last_became_active":"2024-09-18T02:04:03.577841+0000","last_became_peered":"2024-09-18T02:04:03.577841+0000","last_unstale":"2024-09-18T02:08:00.199509+0000","last_undegraded":"2024-09-18T02:08:00.199509+0000","last_fullsized":"2024-09-18T02:08:00.199509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-18T02:08:00.199183+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-18T02:08:00.199183+0000","last_clean_scrub_stamp":"2024-09-18T02:08:00.199183+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:17.403960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.194433+0000","last_change":"2024-09-18T02:08:03.194433+0000","last_active":"2024-09-18T02:08:03.194433+0000","last_peered":"2024-09-18T02:08:03.194433+0000","last_clean":"2024-09-18T02:08:03.194433+0000","last_became_active":"2024-09-18T02:04:05.605718+0000","last_became_peered":"2024-09-18T02:04:05.605718+0000","last_unstale":"2024-09-18T02:08:03.194433+0000","last_undegraded":"2024-09-18T02:08:03.194433+0000","last_fullsized":"2024-09-18T02:08:03.194433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:03.194177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:03.194177+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.194177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:11.445570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:05.456160+0000","last_change":"2024-09-18T02:09:05.456220+0000","last_active":"2024-09-18T02:09:05.456160+0000","last_peered":"2024-09-18T02:09:05.456160+0000","last_clean":"2024-09-18T02:09:05.456160+0000","last_became_active":"2024-09-18T02:04:07.621224+0000","last_became_peered":"2024-09-18T02:04:07.621224+0000","last_unstale":"2024-09-18T02:09:05.456160+0000","last_undegraded":"2024-09-18T02:09:05.456160+0000","last_fullsized":"2024-09-18T02:09:05.456160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:09:05.455978+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:09:05.455978+0000","last_clean_scrub_stamp":"2024-09-18T02:09:05.455978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:28:29.972303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:23.086336+0000","last_change":"2024-09-18T02:08:23.086336+0000","last_active":"2024-09-18T02:08:23.086336+0000","last_peered":"2024-09-18T02:08:23.086336+0000","last_clean":"2024-09-18T02:08:23.086336+0000","last_became_active":"2024-09-18T02:03:59.536701+0000","last_became_peered":"2024-09-18T02:03:59.536701+0000","last_unstale":"2024-09-18T02:08:23.086336+0000","last_undegraded":"2024-09-18T02:08:23.086336+0000","last_fullsized":"2024-09-18T02:08:23.086336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:23.086080+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:23.086080+0000","last_clean_scrub_stamp":"2024-09-18T02:08:23.086080+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:18.513965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.578484+0000","last_change":"2024-09-18T02:08:41.578484+0000","last_active":"2024-09-18T02:08:41.578484+0000","last_peered":"2024-09-18T02:08:41.578484+0000","last_clean":"2024-09-18T02:08:41.578484+0000","last_became_active":"2024-09-18T02:03:57.527891+0000","last_became_peered":"2024-09-18T02:03:57.527891+0000","last_unstale":"2024-09-18T02:08:41.578484+0000","last_undegraded":"2024-09-18T02:08:41.578484+0000","last_fullsized":"2024-09-18T02:08:41.578484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:41.578103+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:41.578103+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.578103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:46:59.036359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:02.843858+0000","last_change":"2024-09-18T02:08:02.843858+0000","last_active":"2024-09-18T02:08:02.843858+0000","last_peered":"2024-09-18T02:08:02.843858+0000","last_clean":"2024-09-18T02:08:02.843858+0000","last_became_active":"2024-09-18T02:04:01.564187+0000","last_became_peered":"2024-09-18T02:04:01.564187+0000","last_unstale":"2024-09-18T02:08:02.843858+0000","last_undegraded":"2024-09-18T02:08:02.843858+0000","last_fullsized":"2024-09-18T02:08:02.843858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:02.843618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:02.843618+0000","last_clean_scrub_stamp":"2024-09-18T02:08:02.843618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:11.164508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:04.203666+0000","last_change":"2024-09-18T02:08:04.203666+0000","last_active":"2024-09-18T02:08:04.203666+0000","last_peered":"2024-09-18T02:08:04.203666+0000","last_clean":"2024-09-18T02:08:04.203666+0000","last_became_active":"2024-09-18T02:04:03.596273+0000","last_became_peered":"2024-09-18T02:04:03.596273+0000","last_unstale":"2024-09-18T02:08:04.203666+0000","last_undegraded":"2024-09-18T02:08:04.203666+0000","last_fullsized":"2024-09-18T02:08:04.203666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-18T02:08:04.203351+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-18T02:08:04.203351+0000","last_clean_scrub_stamp":"2024-09-18T02:08:04.203351+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:49:59.631236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":384,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.282688+0000","last_change":"2024-09-18T02:07:50.282688+0000","last_active":"2024-09-18T02:07:50.282688+0000","last_peered":"2024-09-18T02:07:50.282688+0000","last_clean":"2024-09-18T02:07:50.282688+0000","last_became_active":"2024-09-18T02:04:05.601182+0000","last_became_peered":"2024-09-18T02:04:05.601182+0000","last_unstale":"2024-09-18T02:07:50.282688+0000","last_undegraded":"2024-09-18T02:07:50.282688+0000","last_fullsized":"2024-09-18T02:07:50.282688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-18T02:07:50.282455+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-18T02:07:50.282455+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.282455+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:09:41.423906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:06.444650+0000","last_change":"2024-09-18T02:09:06.444771+0000","last_active":"2024-09-18T02:09:06.444650+0000","last_peered":"2024-09-18T02:09:06.444650+0000","last_clean":"2024-09-18T02:09:06.444650+0000","last_became_active":"2024-09-18T02:04:07.621240+0000","last_became_peered":"2024-09-18T02:04:07.621240+0000","last_unstale":"2024-09-18T02:09:06.444650+0000","last_undegraded":"2024-09-18T02:09:06.444650+0000","last_fullsized":"2024-09-18T02:09:06.444650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:09:06.444345+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:09:06.444345+0000","last_clean_scrub_stamp":"2024-09-18T02:09:06.444345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:03.196818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:19.227333+0000","last_change":"2024-09-18T02:08:19.227333+0000","last_active":"2024-09-18T02:08:19.227333+0000","last_peered":"2024-09-18T02:08:19.227333+0000","last_clean":"2024-09-18T02:08:19.227333+0000","last_became_active":"2024-09-18T02:03:59.536486+0000","last_became_peered":"2024-09-18T02:03:59.536486+0000","last_unstale":"2024-09-18T02:08:19.227333+0000","last_undegraded":"2024-09-18T02:08:19.227333+0000","last_fullsized":"2024-09-18T02:08:19.227333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:19.227080+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:19.227080+0000","last_clean_scrub_stamp":"2024-09-18T02:08:19.227080+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:29.401705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:38.815282+0000","last_change":"2024-09-18T02:08:38.815282+0000","last_active":"2024-09-18T02:08:38.815282+0000","last_peered":"2024-09-18T02:08:38.815282+0000","last_clean":"2024-09-18T02:08:38.815282+0000","last_became_active":"2024-09-18T02:03:57.520452+0000","last_became_peered":"2024-09-18T02:03:57.520452+0000","last_unstale":"2024-09-18T02:08:38.815282+0000","last_undegraded":"2024-09-18T02:08:38.815282+0000","last_fullsized":"2024-09-18T02:08:38.815282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:38.815046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:38.815046+0000","last_clean_scrub_stamp":"2024-09-18T02:08:38.815046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:20:56.582184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:03.832649+0000","last_change":"2024-09-18T02:08:03.832649+0000","last_active":"2024-09-18T02:08:03.832649+0000","last_peered":"2024-09-18T02:08:03.832649+0000","last_clean":"2024-09-18T02:08:03.832649+0000","last_became_active":"2024-09-18T02:04:01.564165+0000","last_became_peered":"2024-09-18T02:04:01.564165+0000","last_unstale":"2024-09-18T02:08:03.832649+0000","last_undegraded":"2024-09-18T02:08:03.832649+0000","last_fullsized":"2024-09-18T02:08:03.832649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:03.832329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:03.832329+0000","last_clean_scrub_stamp":"2024-09-18T02:08:03.832329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:28.467191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'73","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:52.093377+0000","last_change":"2024-09-18T02:07:52.093377+0000","last_active":"2024-09-18T02:07:52.093377+0000","last_peered":"2024-09-18T02:07:52.093377+0000","last_clean":"2024-09-18T02:07:52.093377+0000","last_became_active":"2024-09-18T02:04:03.566714+0000","last_became_peered":"2024-09-18T02:04:03.566714+0000","last_unstale":"2024-09-18T02:07:52.093377+0000","last_undegraded":"2024-09-18T02:07:52.093377+0000","last_fullsized":"2024-09-18T02:07:52.093377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-09-18T02:07:52.093206+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-09-18T02:07:52.093206+0000","last_clean_scrub_stamp":"2024-09-18T02:07:52.093206+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:32:03.515528+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:53.213015+0000","last_change":"2024-09-18T02:07:53.213015+0000","last_active":"2024-09-18T02:07:53.213015+0000","last_peered":"2024-09-18T02:07:53.213015+0000","last_clean":"2024-09-18T02:07:53.213015+0000","last_became_active":"2024-09-18T02:04:05.578635+0000","last_became_peered":"2024-09-18T02:04:05.578635+0000","last_unstale":"2024-09-18T02:07:53.213015+0000","last_undegraded":"2024-09-18T02:07:53.213015+0000","last_fullsized":"2024-09-18T02:07:53.213015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:53.212658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:53.212658+0000","last_clean_scrub_stamp":"2024-09-18T02:07:53.212658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:04.833203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.712953+0000","last_change":"2024-09-18T02:08:12.712953+0000","last_active":"2024-09-18T02:08:12.712953+0000","last_peered":"2024-09-18T02:08:12.712953+0000","last_clean":"2024-09-18T02:08:12.712953+0000","last_became_active":"2024-09-18T02:04:07.618696+0000","last_became_peered":"2024-09-18T02:04:07.618696+0000","last_unstale":"2024-09-18T02:08:12.712953+0000","last_undegraded":"2024-09-18T02:08:12.712953+0000","last_fullsized":"2024-09-18T02:08:12.712953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:12.712689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:12.712689+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.712689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:24:04.964071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.284073+0000","last_change":"2024-09-18T02:08:27.284073+0000","last_active":"2024-09-18T02:08:27.284073+0000","last_peered":"2024-09-18T02:08:27.284073+0000","last_clean":"2024-09-18T02:08:27.284073+0000","last_became_active":"2024-09-18T02:03:59.536693+0000","last_became_peered":"2024-09-18T02:03:59.536693+0000","last_unstale":"2024-09-18T02:08:27.284073+0000","last_undegraded":"2024-09-18T02:08:27.284073+0000","last_fullsized":"2024-09-18T02:08:27.284073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:27.283820+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:27.283820+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.283820+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:03.691154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:35.511447+0000","last_change":"2024-09-18T02:08:35.511447+0000","last_active":"2024-09-18T02:08:35.511447+0000","last_peered":"2024-09-18T02:08:35.511447+0000","last_clean":"2024-09-18T02:08:35.511447+0000","last_became_active":"2024-09-18T02:03:57.532963+0000","last_became_peered":"2024-09-18T02:03:57.532963+0000","last_unstale":"2024-09-18T02:08:35.511447+0000","last_undegraded":"2024-09-18T02:08:35.511447+0000","last_fullsized":"2024-09-18T02:08:35.511447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:35.511195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:35.511195+0000","last_clean_scrub_stamp":"2024-09-18T02:08:35.511195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:52.073403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:06.290687+0000","last_change":"2024-09-18T02:08:06.290687+0000","last_active":"2024-09-18T02:08:06.290687+0000","last_peered":"2024-09-18T02:08:06.290687+0000","last_clean":"2024-09-18T02:08:06.290687+0000","last_became_active":"2024-09-18T02:04:01.572089+0000","last_became_peered":"2024-09-18T02:04:01.572089+0000","last_unstale":"2024-09-18T02:08:06.290687+0000","last_undegraded":"2024-09-18T02:08:06.290687+0000","last_fullsized":"2024-09-18T02:08:06.290687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:06.290419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:06.290419+0000","last_clean_scrub_stamp":"2024-09-18T02:08:06.290419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:26.123621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'43","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:01.233976+0000","last_change":"2024-09-18T02:08:01.233976+0000","last_active":"2024-09-18T02:08:01.233976+0000","last_peered":"2024-09-18T02:08:01.233976+0000","last_clean":"2024-09-18T02:08:01.233976+0000","last_became_active":"2024-09-18T02:04:03.569962+0000","last_became_peered":"2024-09-18T02:04:03.569962+0000","last_unstale":"2024-09-18T02:08:01.233976+0000","last_undegraded":"2024-09-18T02:08:01.233976+0000","last_fullsized":"2024-09-18T02:08:01.233976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-09-18T02:08:01.233724+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-09-18T02:08:01.233724+0000","last_clean_scrub_stamp":"2024-09-18T02:08:01.233724+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:11:25.741483+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:08.213922+0000","last_change":"2024-09-18T02:08:08.213922+0000","last_active":"2024-09-18T02:08:08.213922+0000","last_peered":"2024-09-18T02:08:08.213922+0000","last_clean":"2024-09-18T02:08:08.213922+0000","last_became_active":"2024-09-18T02:04:05.606608+0000","last_became_peered":"2024-09-18T02:04:05.606608+0000","last_unstale":"2024-09-18T02:08:08.213922+0000","last_undegraded":"2024-09-18T02:08:08.213922+0000","last_fullsized":"2024-09-18T02:08:08.213922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:08.213681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:08.213681+0000","last_clean_scrub_stamp":"2024-09-18T02:08:08.213681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:07:17.342298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"30'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.463401+0000","last_change":"2024-09-18T02:08:32.463401+0000","last_active":"2024-09-18T02:08:32.463401+0000","last_peered":"2024-09-18T02:08:32.463401+0000","last_clean":"2024-09-18T02:08:32.463401+0000","last_became_active":"2024-09-18T02:04:07.607839+0000","last_became_peered":"2024-09-18T02:04:07.607839+0000","last_unstale":"2024-09-18T02:08:32.463401+0000","last_undegraded":"2024-09-18T02:08:32.463401+0000","last_fullsized":"2024-09-18T02:08:32.463401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:32.463017+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:32.463017+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.463017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:46:03.555526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.392230+0000","last_change":"2024-09-18T02:08:30.392230+0000","last_active":"2024-09-18T02:08:30.392230+0000","last_peered":"2024-09-18T02:08:30.392230+0000","last_clean":"2024-09-18T02:08:30.392230+0000","last_became_active":"2024-09-18T02:03:59.547123+0000","last_became_peered":"2024-09-18T02:03:59.547123+0000","last_unstale":"2024-09-18T02:08:30.392230+0000","last_undegraded":"2024-09-18T02:08:30.392230+0000","last_fullsized":"2024-09-18T02:08:30.392230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:30.391969+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:30.391969+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.391969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:40.500818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:22.040922+0000","last_change":"2024-09-18T02:08:22.040978+0000","last_active":"2024-09-18T02:08:22.040922+0000","last_peered":"2024-09-18T02:08:22.040922+0000","last_clean":"2024-09-18T02:08:22.040922+0000","last_became_active":"2024-09-18T02:03:57.530001+0000","last_became_peered":"2024-09-18T02:03:57.530001+0000","last_unstale":"2024-09-18T02:08:22.040922+0000","last_undegraded":"2024-09-18T02:08:22.040922+0000","last_fullsized":"2024-09-18T02:08:22.040922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:22.040728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:22.040728+0000","last_clean_scrub_stamp":"2024-09-18T02:08:22.040728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:47:07.868719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:55.978327+0000","last_change":"2024-09-18T02:07:55.978327+0000","last_active":"2024-09-18T02:07:55.978327+0000","last_peered":"2024-09-18T02:07:55.978327+0000","last_clean":"2024-09-18T02:07:55.978327+0000","last_became_active":"2024-09-18T02:04:01.571263+0000","last_became_peered":"2024-09-18T02:04:01.571263+0000","last_unstale":"2024-09-18T02:07:55.978327+0000","last_undegraded":"2024-09-18T02:07:55.978327+0000","last_fullsized":"2024-09-18T02:07:55.978327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:55.978062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:55.978062+0000","last_clean_scrub_stamp":"2024-09-18T02:07:55.978062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:43:46.506478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'39","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.239265+0000","last_change":"2024-09-18T02:08:11.239265+0000","last_active":"2024-09-18T02:08:11.239265+0000","last_peered":"2024-09-18T02:08:11.239265+0000","last_clean":"2024-09-18T02:08:11.239265+0000","last_became_active":"2024-09-18T02:04:03.601392+0000","last_became_peered":"2024-09-18T02:04:03.601392+0000","last_unstale":"2024-09-18T02:08:11.239265+0000","last_undegraded":"2024-09-18T02:08:11.239265+0000","last_fullsized":"2024-09-18T02:08:11.239265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-18T02:08:11.238968+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-18T02:08:11.238968+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.238968+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:52:55.973173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:07.202713+0000","last_change":"2024-09-18T02:08:07.202713+0000","last_active":"2024-09-18T02:08:07.202713+0000","last_peered":"2024-09-18T02:08:07.202713+0000","last_clean":"2024-09-18T02:08:07.202713+0000","last_became_active":"2024-09-18T02:04:05.599964+0000","last_became_peered":"2024-09-18T02:04:05.599964+0000","last_unstale":"2024-09-18T02:08:07.202713+0000","last_undegraded":"2024-09-18T02:08:07.202713+0000","last_fullsized":"2024-09-18T02:08:07.202713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:07.202464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:07.202464+0000","last_clean_scrub_stamp":"2024-09-18T02:08:07.202464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:09.828342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:04.498327+0000","last_change":"2024-09-18T02:09:04.498389+0000","last_active":"2024-09-18T02:09:04.498327+0000","last_peered":"2024-09-18T02:09:04.498327+0000","last_clean":"2024-09-18T02:09:04.498327+0000","last_became_active":"2024-09-18T02:04:07.615007+0000","last_became_peered":"2024-09-18T02:04:07.615007+0000","last_unstale":"2024-09-18T02:09:04.498327+0000","last_undegraded":"2024-09-18T02:09:04.498327+0000","last_fullsized":"2024-09-18T02:09:04.498327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-18T02:09:04.498143+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-18T02:09:04.498143+0000","last_clean_scrub_stamp":"2024-09-18T02:09:04.498143+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:34:05.467839+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.310594+0000","last_change":"2024-09-18T02:08:17.310594+0000","last_active":"2024-09-18T02:08:17.310594+0000","last_peered":"2024-09-18T02:08:17.310594+0000","last_clean":"2024-09-18T02:08:17.310594+0000","last_became_active":"2024-09-18T02:03:59.536120+0000","last_became_peered":"2024-09-18T02:03:59.536120+0000","last_unstale":"2024-09-18T02:08:17.310594+0000","last_undegraded":"2024-09-18T02:08:17.310594+0000","last_fullsized":"2024-09-18T02:08:17.310594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:17.310348+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:17.310348+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.310348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:16.009307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:25.748348+0000","last_change":"2024-09-18T02:08:25.748413+0000","last_active":"2024-09-18T02:08:25.748348+0000","last_peered":"2024-09-18T02:08:25.748348+0000","last_clean":"2024-09-18T02:08:25.748348+0000","last_became_active":"2024-09-18T02:03:57.522831+0000","last_became_peered":"2024-09-18T02:03:57.522831+0000","last_unstale":"2024-09-18T02:08:25.748348+0000","last_undegraded":"2024-09-18T02:08:25.748348+0000","last_fullsized":"2024-09-18T02:08:25.748348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:25.748144+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:25.748144+0000","last_clean_scrub_stamp":"2024-09-18T02:08:25.748144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:26.585698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:57.904470+0000","last_change":"2024-09-18T02:07:57.904470+0000","last_active":"2024-09-18T02:07:57.904470+0000","last_peered":"2024-09-18T02:07:57.904470+0000","last_clean":"2024-09-18T02:07:57.904470+0000","last_became_active":"2024-09-18T02:04:01.569649+0000","last_became_peered":"2024-09-18T02:04:01.569649+0000","last_unstale":"2024-09-18T02:07:57.904470+0000","last_undegraded":"2024-09-18T02:07:57.904470+0000","last_fullsized":"2024-09-18T02:07:57.904470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-18T02:07:57.904196+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-18T02:07:57.904196+0000","last_clean_scrub_stamp":"2024-09-18T02:07:57.904196+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:36:19.425055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'55","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:50.404774+0000","last_change":"2024-09-18T02:07:50.404774+0000","last_active":"2024-09-18T02:07:50.404774+0000","last_peered":"2024-09-18T02:07:50.404774+0000","last_clean":"2024-09-18T02:07:50.404774+0000","last_became_active":"2024-09-18T02:04:03.591018+0000","last_became_peered":"2024-09-18T02:04:03.591018+0000","last_unstale":"2024-09-18T02:07:50.404774+0000","last_undegraded":"2024-09-18T02:07:50.404774+0000","last_fullsized":"2024-09-18T02:07:50.404774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'55","last_scrub_stamp":"2024-09-18T02:07:50.404668+0000","last_deep_scrub":"32'55","last_deep_scrub_stamp":"2024-09-18T02:07:50.404668+0000","last_clean_scrub_stamp":"2024-09-18T02:07:50.404668+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:48:17.203254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:07:51.262610+0000","last_change":"2024-09-18T02:07:51.262610+0000","last_active":"2024-09-18T02:07:51.262610+0000","last_peered":"2024-09-18T02:07:51.262610+0000","last_clean":"2024-09-18T02:07:51.262610+0000","last_became_active":"2024-09-18T02:04:05.595772+0000","last_became_peered":"2024-09-18T02:04:05.595772+0000","last_unstale":"2024-09-18T02:07:51.262610+0000","last_undegraded":"2024-09-18T02:07:51.262610+0000","last_fullsized":"2024-09-18T02:07:51.262610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:07:51.262332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:07:51.262332+0000","last_clean_scrub_stamp":"2024-09-18T02:07:51.262332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:41.244692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:03.489657+0000","last_change":"2024-09-18T02:09:03.489721+0000","last_active":"2024-09-18T02:09:03.489657+0000","last_peered":"2024-09-18T02:09:03.489657+0000","last_clean":"2024-09-18T02:09:03.489657+0000","last_became_active":"2024-09-18T02:04:07.612610+0000","last_became_peered":"2024-09-18T02:04:07.612610+0000","last_unstale":"2024-09-18T02:09:03.489657+0000","last_undegraded":"2024-09-18T02:09:03.489657+0000","last_fullsized":"2024-09-18T02:09:03.489657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:09:03.489466+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:09:03.489466+0000","last_clean_scrub_stamp":"2024-09-18T02:09:03.489466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:18:19.558325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.697508+0000","last_change":"2024-09-18T02:08:13.697508+0000","last_active":"2024-09-18T02:08:13.697508+0000","last_peered":"2024-09-18T02:08:13.697508+0000","last_clean":"2024-09-18T02:08:13.697508+0000","last_became_active":"2024-09-18T02:03:59.553864+0000","last_became_peered":"2024-09-18T02:03:59.553864+0000","last_unstale":"2024-09-18T02:08:13.697508+0000","last_undegraded":"2024-09-18T02:08:13.697508+0000","last_fullsized":"2024-09-18T02:08:13.697508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:13.697246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:13.697246+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.697246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:08:45.027054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.277121+0000","last_change":"2024-09-18T02:08:36.277174+0000","last_active":"2024-09-18T02:08:36.277121+0000","last_peered":"2024-09-18T02:08:36.277121+0000","last_clean":"2024-09-18T02:08:36.277121+0000","last_became_active":"2024-09-18T02:03:57.519843+0000","last_became_peered":"2024-09-18T02:03:57.519843+0000","last_unstale":"2024-09-18T02:08:36.277121+0000","last_undegraded":"2024-09-18T02:08:36.277121+0000","last_fullsized":"2024-09-18T02:08:36.277121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:36.276924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:36.276924+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.276924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:19.389568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.057689+0000","last_change":"2024-09-18T02:08:21.057689+0000","last_active":"2024-09-18T02:08:21.057689+0000","last_peered":"2024-09-18T02:08:21.057689+0000","last_clean":"2024-09-18T02:08:21.057689+0000","last_became_active":"2024-09-18T02:03:59.535992+0000","last_became_peered":"2024-09-18T02:03:59.535992+0000","last_unstale":"2024-09-18T02:08:21.057689+0000","last_undegraded":"2024-09-18T02:08:21.057689+0000","last_fullsized":"2024-09-18T02:08:21.057689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:21.057430+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:21.057430+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.057430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:11.720358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.091868+0000","last_change":"2024-09-18T02:08:24.091925+0000","last_active":"2024-09-18T02:08:24.091868+0000","last_peered":"2024-09-18T02:08:24.091868+0000","last_clean":"2024-09-18T02:08:24.091868+0000","last_became_active":"2024-09-18T02:03:57.527146+0000","last_became_peered":"2024-09-18T02:03:57.527146+0000","last_unstale":"2024-09-18T02:08:24.091868+0000","last_undegraded":"2024-09-18T02:08:24.091868+0000","last_fullsized":"2024-09-18T02:08:24.091868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:24.091664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:24.091664+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.091664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:50.849336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:21.229209+0000","last_change":"2024-09-18T02:08:21.229209+0000","last_active":"2024-09-18T02:08:21.229209+0000","last_peered":"2024-09-18T02:08:21.229209+0000","last_clean":"2024-09-18T02:08:21.229209+0000","last_became_active":"2024-09-18T02:03:59.556425+0000","last_became_peered":"2024-09-18T02:03:59.556425+0000","last_unstale":"2024-09-18T02:08:21.229209+0000","last_undegraded":"2024-09-18T02:08:21.229209+0000","last_fullsized":"2024-09-18T02:08:21.229209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:21.228959+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:21.228959+0000","last_clean_scrub_stamp":"2024-09-18T02:08:21.228959+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:54.629458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:48.722715+0000","last_change":"2024-09-18T02:08:48.722901+0000","last_active":"2024-09-18T02:08:48.722715+0000","last_peered":"2024-09-18T02:08:48.722715+0000","last_clean":"2024-09-18T02:08:48.722715+0000","last_became_active":"2024-09-18T02:04:36.350472+0000","last_became_peered":"2024-09-18T02:04:36.350472+0000","last_unstale":"2024-09-18T02:08:48.722715+0000","last_undegraded":"2024-09-18T02:08:48.722715+0000","last_fullsized":"2024-09-18T02:08:48.722715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:48.722482+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:48.722482+0000","last_clean_scrub_stamp":"2024-09-18T02:08:48.722482+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:48.513936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"32'18","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:17.102690+0000","last_change":"2024-09-18T02:08:17.102690+0000","last_active":"2024-09-18T02:08:17.102690+0000","last_peered":"2024-09-18T02:08:17.102690+0000","last_clean":"2024-09-18T02:08:17.102690+0000","last_became_active":"2024-09-18T02:03:59.534584+0000","last_became_peered":"2024-09-18T02:03:59.534584+0000","last_unstale":"2024-09-18T02:08:17.102690+0000","last_undegraded":"2024-09-18T02:08:17.102690+0000","last_fullsized":"2024-09-18T02:08:17.102690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:17.102427+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:17.102427+0000","last_clean_scrub_stamp":"2024-09-18T02:08:17.102427+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:53.509761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:39.863394+0000","last_change":"2024-09-18T02:08:39.863457+0000","last_active":"2024-09-18T02:08:39.863394+0000","last_peered":"2024-09-18T02:08:39.863394+0000","last_clean":"2024-09-18T02:08:39.863394+0000","last_became_active":"2024-09-18T02:03:57.521499+0000","last_became_peered":"2024-09-18T02:03:57.521499+0000","last_unstale":"2024-09-18T02:08:39.863394+0000","last_undegraded":"2024-09-18T02:08:39.863394+0000","last_fullsized":"2024-09-18T02:08:39.863394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:39.863198+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:39.863198+0000","last_clean_scrub_stamp":"2024-09-18T02:08:39.863198+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:05:13.263696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:13.152140+0000","last_change":"2024-09-18T02:08:13.152277+0000","last_active":"2024-09-18T02:08:13.152140+0000","last_peered":"2024-09-18T02:08:13.152140+0000","last_clean":"2024-09-18T02:08:13.152140+0000","last_became_active":"2024-09-18T02:03:59.554577+0000","last_became_peered":"2024-09-18T02:03:59.554577+0000","last_unstale":"2024-09-18T02:08:13.152140+0000","last_undegraded":"2024-09-18T02:08:13.152140+0000","last_fullsized":"2024-09-18T02:08:13.152140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:13.151916+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:13.151916+0000","last_clean_scrub_stamp":"2024-09-18T02:08:13.151916+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:52:59.060752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:27.962855+0000","last_change":"2024-09-18T02:08:27.962920+0000","last_active":"2024-09-18T02:08:27.962855+0000","last_peered":"2024-09-18T02:08:27.962855+0000","last_clean":"2024-09-18T02:08:27.962855+0000","last_became_active":"2024-09-18T02:03:57.526774+0000","last_became_peered":"2024-09-18T02:03:57.526774+0000","last_unstale":"2024-09-18T02:08:27.962855+0000","last_undegraded":"2024-09-18T02:08:27.962855+0000","last_fullsized":"2024-09-18T02:08:27.962855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:27.962660+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:27.962660+0000","last_clean_scrub_stamp":"2024-09-18T02:08:27.962660+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:27:41.428177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:10.713808+0000","last_change":"2024-09-18T02:08:10.713808+0000","last_active":"2024-09-18T02:08:10.713808+0000","last_peered":"2024-09-18T02:08:10.713808+0000","last_clean":"2024-09-18T02:08:10.713808+0000","last_became_active":"2024-09-18T02:03:59.554672+0000","last_became_peered":"2024-09-18T02:03:59.554672+0000","last_unstale":"2024-09-18T02:08:10.713808+0000","last_undegraded":"2024-09-18T02:08:10.713808+0000","last_fullsized":"2024-09-18T02:08:10.713808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:10.713551+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:10.713551+0000","last_clean_scrub_stamp":"2024-09-18T02:08:10.713551+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:17.678935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.861273+0000","last_change":"2024-09-18T02:08:37.861335+0000","last_active":"2024-09-18T02:08:37.861273+0000","last_peered":"2024-09-18T02:08:37.861273+0000","last_clean":"2024-09-18T02:08:37.861273+0000","last_became_active":"2024-09-18T02:03:57.519691+0000","last_became_peered":"2024-09-18T02:03:57.519691+0000","last_unstale":"2024-09-18T02:08:37.861273+0000","last_undegraded":"2024-09-18T02:08:37.861273+0000","last_fullsized":"2024-09-18T02:08:37.861273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:37.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:37.861054+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:34:35.933748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'18","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.930784+0000","last_change":"2024-09-18T02:08:28.930829+0000","last_active":"2024-09-18T02:08:28.930784+0000","last_peered":"2024-09-18T02:08:28.930784+0000","last_clean":"2024-09-18T02:08:28.930784+0000","last_became_active":"2024-09-18T02:03:59.541059+0000","last_became_peered":"2024-09-18T02:03:59.541059+0000","last_unstale":"2024-09-18T02:08:28.930784+0000","last_undegraded":"2024-09-18T02:08:28.930784+0000","last_fullsized":"2024-09-18T02:08:28.930784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-18T02:08:28.930660+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-18T02:08:28.930660+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.930660+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:01:07.506129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:31.256733+0000","last_change":"2024-09-18T02:08:31.256796+0000","last_active":"2024-09-18T02:08:31.256733+0000","last_peered":"2024-09-18T02:08:31.256733+0000","last_clean":"2024-09-18T02:08:31.256733+0000","last_became_active":"2024-09-18T02:03:57.519272+0000","last_became_peered":"2024-09-18T02:03:57.519272+0000","last_unstale":"2024-09-18T02:08:31.256733+0000","last_undegraded":"2024-09-18T02:08:31.256733+0000","last_fullsized":"2024-09-18T02:08:31.256733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:31.256526+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:31.256526+0000","last_clean_scrub_stamp":"2024-09-18T02:08:31.256526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:21.919455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:28.742520+0000","last_change":"2024-09-18T02:08:28.742581+0000","last_active":"2024-09-18T02:08:28.742520+0000","last_peered":"2024-09-18T02:08:28.742520+0000","last_clean":"2024-09-18T02:08:28.742520+0000","last_became_active":"2024-09-18T02:03:59.539946+0000","last_became_peered":"2024-09-18T02:03:59.539946+0000","last_unstale":"2024-09-18T02:08:28.742520+0000","last_undegraded":"2024-09-18T02:08:28.742520+0000","last_fullsized":"2024-09-18T02:08:28.742520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:28.742331+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:28.742331+0000","last_clean_scrub_stamp":"2024-09-18T02:08:28.742331+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:31.368209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.052740+0000","last_change":"2024-09-18T02:08:26.052861+0000","last_active":"2024-09-18T02:08:26.052740+0000","last_peered":"2024-09-18T02:08:26.052740+0000","last_clean":"2024-09-18T02:08:26.052740+0000","last_became_active":"2024-09-18T02:03:57.527102+0000","last_became_peered":"2024-09-18T02:03:57.527102+0000","last_unstale":"2024-09-18T02:08:26.052740+0000","last_undegraded":"2024-09-18T02:08:26.052740+0000","last_fullsized":"2024-09-18T02:08:26.052740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-18T02:08:26.052497+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-18T02:08:26.052497+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.052497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:28.678375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:26.726496+0000","last_change":"2024-09-18T02:08:26.726496+0000","last_active":"2024-09-18T02:08:26.726496+0000","last_peered":"2024-09-18T02:08:26.726496+0000","last_clean":"2024-09-18T02:08:26.726496+0000","last_became_active":"2024-09-18T02:03:59.543160+0000","last_became_peered":"2024-09-18T02:03:59.543160+0000","last_unstale":"2024-09-18T02:08:26.726496+0000","last_undegraded":"2024-09-18T02:08:26.726496+0000","last_fullsized":"2024-09-18T02:08:26.726496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:26.726212+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:26.726212+0000","last_clean_scrub_stamp":"2024-09-18T02:08:26.726212+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:09:22.380181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:49.524617+0000","last_change":"2024-09-18T02:08:49.524706+0000","last_active":"2024-09-18T02:08:49.524617+0000","last_peered":"2024-09-18T02:08:49.524617+0000","last_clean":"2024-09-18T02:08:49.524617+0000","last_became_active":"2024-09-18T02:03:57.524495+0000","last_became_peered":"2024-09-18T02:03:57.524495+0000","last_unstale":"2024-09-18T02:08:49.524617+0000","last_undegraded":"2024-09-18T02:08:49.524617+0000","last_fullsized":"2024-09-18T02:08:49.524617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:49.524398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:49.524398+0000","last_clean_scrub_stamp":"2024-09-18T02:08:49.524398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:04:32.752335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:47.852614+0000","last_change":"2024-09-18T02:08:47.852614+0000","last_active":"2024-09-18T02:08:47.852614+0000","last_peered":"2024-09-18T02:08:47.852614+0000","last_clean":"2024-09-18T02:08:47.852614+0000","last_became_active":"2024-09-18T02:04:36.354749+0000","last_became_peered":"2024-09-18T02:04:36.354749+0000","last_unstale":"2024-09-18T02:08:47.852614+0000","last_undegraded":"2024-09-18T02:08:47.852614+0000","last_fullsized":"2024-09-18T02:08:47.852614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:47.852346+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:47.852346+0000","last_clean_scrub_stamp":"2024-09-18T02:08:47.852346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:51:37.504826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:37.828448+0000","last_change":"2024-09-18T02:08:37.828503+0000","last_active":"2024-09-18T02:08:37.828448+0000","last_peered":"2024-09-18T02:08:37.828448+0000","last_clean":"2024-09-18T02:08:37.828448+0000","last_became_active":"2024-09-18T02:03:57.520623+0000","last_became_peered":"2024-09-18T02:03:57.520623+0000","last_unstale":"2024-09-18T02:08:37.828448+0000","last_undegraded":"2024-09-18T02:08:37.828448+0000","last_fullsized":"2024-09-18T02:08:37.828448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:37.828257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:37.828257+0000","last_clean_scrub_stamp":"2024-09-18T02:08:37.828257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:03:22.353047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'10","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:12.172727+0000","last_change":"2024-09-18T02:08:12.172727+0000","last_active":"2024-09-18T02:08:12.172727+0000","last_peered":"2024-09-18T02:08:12.172727+0000","last_clean":"2024-09-18T02:08:12.172727+0000","last_became_active":"2024-09-18T02:03:59.555178+0000","last_became_peered":"2024-09-18T02:03:59.555178+0000","last_unstale":"2024-09-18T02:08:12.172727+0000","last_undegraded":"2024-09-18T02:08:12.172727+0000","last_fullsized":"2024-09-18T02:08:12.172727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-18T02:08:12.172263+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-18T02:08:12.172263+0000","last_clean_scrub_stamp":"2024-09-18T02:08:12.172263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:09.572270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:36.897066+0000","last_change":"2024-09-18T02:08:36.897214+0000","last_active":"2024-09-18T02:08:36.897066+0000","last_peered":"2024-09-18T02:08:36.897066+0000","last_clean":"2024-09-18T02:08:36.897066+0000","last_became_active":"2024-09-18T02:03:57.519359+0000","last_became_peered":"2024-09-18T02:03:57.519359+0000","last_unstale":"2024-09-18T02:08:36.897066+0000","last_undegraded":"2024-09-18T02:08:36.897066+0000","last_fullsized":"2024-09-18T02:08:36.897066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:36.896796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:36.896796+0000","last_clean_scrub_stamp":"2024-09-18T02:08:36.896796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:55:49.141518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.642832+0000","last_change":"2024-09-18T02:08:18.642832+0000","last_active":"2024-09-18T02:08:18.642832+0000","last_peered":"2024-09-18T02:08:18.642832+0000","last_clean":"2024-09-18T02:08:18.642832+0000","last_became_active":"2024-09-18T02:03:59.540444+0000","last_became_peered":"2024-09-18T02:03:59.540444+0000","last_unstale":"2024-09-18T02:08:18.642832+0000","last_undegraded":"2024-09-18T02:08:18.642832+0000","last_fullsized":"2024-09-18T02:08:18.642832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:18.642438+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:18.642438+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.642438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:31.841957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:41.837033+0000","last_change":"2024-09-18T02:08:41.837091+0000","last_active":"2024-09-18T02:08:41.837033+0000","last_peered":"2024-09-18T02:08:41.837033+0000","last_clean":"2024-09-18T02:08:41.837033+0000","last_became_active":"2024-09-18T02:03:57.521148+0000","last_became_peered":"2024-09-18T02:03:57.521148+0000","last_unstale":"2024-09-18T02:08:41.837033+0000","last_undegraded":"2024-09-18T02:08:41.837033+0000","last_fullsized":"2024-09-18T02:08:41.837033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:41.836798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:41.836798+0000","last_clean_scrub_stamp":"2024-09-18T02:08:41.836798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:24:25.840593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:11.744876+0000","last_change":"2024-09-18T02:08:11.744876+0000","last_active":"2024-09-18T02:08:11.744876+0000","last_peered":"2024-09-18T02:08:11.744876+0000","last_clean":"2024-09-18T02:08:11.744876+0000","last_became_active":"2024-09-18T02:03:59.553528+0000","last_became_peered":"2024-09-18T02:03:59.553528+0000","last_unstale":"2024-09-18T02:08:11.744876+0000","last_undegraded":"2024-09-18T02:08:11.744876+0000","last_fullsized":"2024-09-18T02:08:11.744876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-18T02:08:11.744618+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-18T02:08:11.744618+0000","last_clean_scrub_stamp":"2024-09-18T02:08:11.744618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:21.919244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:43.531996+0000","last_change":"2024-09-18T02:08:43.532048+0000","last_active":"2024-09-18T02:08:43.531996+0000","last_peered":"2024-09-18T02:08:43.531996+0000","last_clean":"2024-09-18T02:08:43.531996+0000","last_became_active":"2024-09-18T02:03:57.526972+0000","last_became_peered":"2024-09-18T02:03:57.526972+0000","last_unstale":"2024-09-18T02:08:43.531996+0000","last_undegraded":"2024-09-18T02:08:43.531996+0000","last_fullsized":"2024-09-18T02:08:43.531996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:43.531805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:43.531805+0000","last_clean_scrub_stamp":"2024-09-18T02:08:43.531805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:26.237398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:30.813987+0000","last_change":"2024-09-18T02:08:30.813987+0000","last_active":"2024-09-18T02:08:30.813987+0000","last_peered":"2024-09-18T02:08:30.813987+0000","last_clean":"2024-09-18T02:08:30.813987+0000","last_became_active":"2024-09-18T02:03:59.545405+0000","last_became_peered":"2024-09-18T02:03:59.545405+0000","last_unstale":"2024-09-18T02:08:30.813987+0000","last_undegraded":"2024-09-18T02:08:30.813987+0000","last_fullsized":"2024-09-18T02:08:30.813987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-18T02:08:30.813647+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-18T02:08:30.813647+0000","last_clean_scrub_stamp":"2024-09-18T02:08:30.813647+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:50.485940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:09:01.522225+0000","last_change":"2024-09-18T02:09:01.522278+0000","last_active":"2024-09-18T02:09:01.522225+0000","last_peered":"2024-09-18T02:09:01.522225+0000","last_clean":"2024-09-18T02:09:01.522225+0000","last_became_active":"2024-09-18T02:03:57.521800+0000","last_became_peered":"2024-09-18T02:03:57.521800+0000","last_unstale":"2024-09-18T02:09:01.522225+0000","last_undegraded":"2024-09-18T02:09:01.522225+0000","last_fullsized":"2024-09-18T02:09:01.522225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:09:01.522024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:09:01.522024+0000","last_clean_scrub_stamp":"2024-09-18T02:09:01.522024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:35:45.923406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'12","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:44.155183+0000","last_change":"2024-09-18T02:08:44.155183+0000","last_active":"2024-09-18T02:08:44.155183+0000","last_peered":"2024-09-18T02:08:44.155183+0000","last_clean":"2024-09-18T02:08:44.155183+0000","last_became_active":"2024-09-18T02:04:36.357213+0000","last_became_peered":"2024-09-18T02:04:36.357213+0000","last_unstale":"2024-09-18T02:08:44.155183+0000","last_undegraded":"2024-09-18T02:08:44.155183+0000","last_fullsized":"2024-09-18T02:08:44.155183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:44.154928+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:44.154928+0000","last_clean_scrub_stamp":"2024-09-18T02:08:44.154928+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:00:07.986709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:18.272049+0000","last_change":"2024-09-18T02:08:18.272049+0000","last_active":"2024-09-18T02:08:18.272049+0000","last_peered":"2024-09-18T02:08:18.272049+0000","last_clean":"2024-09-18T02:08:18.272049+0000","last_became_active":"2024-09-18T02:03:57.528312+0000","last_became_peered":"2024-09-18T02:03:57.528312+0000","last_unstale":"2024-09-18T02:08:18.272049+0000","last_undegraded":"2024-09-18T02:08:18.272049+0000","last_fullsized":"2024-09-18T02:08:18.272049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:18.271805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:18.271805+0000","last_clean_scrub_stamp":"2024-09-18T02:08:18.271805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:25.237189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:32.845546+0000","last_change":"2024-09-18T02:08:32.845606+0000","last_active":"2024-09-18T02:08:32.845546+0000","last_peered":"2024-09-18T02:08:32.845546+0000","last_clean":"2024-09-18T02:08:32.845546+0000","last_became_active":"2024-09-18T02:03:59.540283+0000","last_became_peered":"2024-09-18T02:03:59.540283+0000","last_unstale":"2024-09-18T02:08:32.845546+0000","last_undegraded":"2024-09-18T02:08:32.845546+0000","last_fullsized":"2024-09-18T02:08:32.845546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-18T02:08:32.845351+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-18T02:08:32.845351+0000","last_clean_scrub_stamp":"2024-09-18T02:08:32.845351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:18:12.741887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:40.570775+0000","last_change":"2024-09-18T02:08:40.570775+0000","last_active":"2024-09-18T02:08:40.570775+0000","last_peered":"2024-09-18T02:08:40.570775+0000","last_clean":"2024-09-18T02:08:40.570775+0000","last_became_active":"2024-09-18T02:03:57.526363+0000","last_became_peered":"2024-09-18T02:03:57.526363+0000","last_unstale":"2024-09-18T02:08:40.570775+0000","last_undegraded":"2024-09-18T02:08:40.570775+0000","last_fullsized":"2024-09-18T02:08:40.570775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-18T02:08:40.570505+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-18T02:08:40.570505+0000","last_clean_scrub_stamp":"2024-09-18T02:08:40.570505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:18:35.760634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:59.509162+0000","last_change":"2024-09-18T02:08:59.509299+0000","last_active":"2024-09-18T02:08:59.509162+0000","last_peered":"2024-09-18T02:08:59.509162+0000","last_clean":"2024-09-18T02:08:59.509162+0000","last_became_active":"2024-09-18T02:03:57.516434+0000","last_became_peered":"2024-09-18T02:03:57.516434+0000","last_unstale":"2024-09-18T02:08:59.509162+0000","last_undegraded":"2024-09-18T02:08:59.509162+0000","last_fullsized":"2024-09-18T02:08:59.509162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:59.508937+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:59.508937+0000","last_clean_scrub_stamp":"2024-09-18T02:08:59.508937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:50:30.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:14.112809+0000","last_change":"2024-09-18T02:08:14.112809+0000","last_active":"2024-09-18T02:08:14.112809+0000","last_peered":"2024-09-18T02:08:14.112809+0000","last_clean":"2024-09-18T02:08:14.112809+0000","last_became_active":"2024-09-18T02:03:59.550058+0000","last_became_peered":"2024-09-18T02:03:59.550058+0000","last_unstale":"2024-09-18T02:08:14.112809+0000","last_undegraded":"2024-09-18T02:08:14.112809+0000","last_fullsized":"2024-09-18T02:08:14.112809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-18T02:08:14.112520+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-18T02:08:14.112520+0000","last_clean_scrub_stamp":"2024-09-18T02:08:14.112520+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:44.465392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:20.072731+0000","last_change":"2024-09-18T02:08:20.072731+0000","last_active":"2024-09-18T02:08:20.072731+0000","last_peered":"2024-09-18T02:08:20.072731+0000","last_clean":"2024-09-18T02:08:20.072731+0000","last_became_active":"2024-09-18T02:03:57.533324+0000","last_became_peered":"2024-09-18T02:03:57.533324+0000","last_unstale":"2024-09-18T02:08:20.072731+0000","last_undegraded":"2024-09-18T02:08:20.072731+0000","last_fullsized":"2024-09-18T02:08:20.072731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T02:08:20.072475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T02:08:20.072475+0000","last_clean_scrub_stamp":"2024-09-18T02:08:20.072475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:04:41.736390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-18T02:08:24.753846+0000","last_change":"2024-09-18T02:08:24.753846+0000","last_active":"2024-09-18T02:08:24.753846+0000","last_peered":"2024-09-18T02:08:24.753846+0000","last_clean":"2024-09-18T02:08:24.753846+0000","last_became_active":"2024-09-18T02:03:59.542356+0000","last_became_peered":"2024-09-18T02:03:59.542356+0000","last_unstale":"2024-09-18T02:08:24.753846+0000","last_undegraded":"2024-09-18T02:08:24.753846+0000","last_fullsized":"2024-09-18T02:08:24.753846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-18T02:08:24.753484+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-18T02:08:24.753484+0000","last_clean_scrub_stamp":"2024-09-18T02:08:24.753484+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:27:15.416413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1754,"ondisk_log_size":1754,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1593,"num_read_kb":1483,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705736,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":138326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705737,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":983040,"data_stored":725968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705736,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":726892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705735,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":430080,"data_stored":137902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T02:09:30.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-18T02:09:30.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.504+0000 7f2ff6aff640 1 Processor -- start 2024-09-18T02:09:30.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.504+0000 7f2ff6aff640 1 -- start start 2024-09-18T02:09:30.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff6aff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ff01283a0 0x7f2ff0128780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:09:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff6aff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff0127f00 con 0x7f2ff00702c0 2024-09-18T02:09:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff6aff640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff0073360 con 0x7f2ff01283a0 2024-09-18T02:09:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff489b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ff01283a0 0x7f2ff0128780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:09:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff489b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ff01283a0 0x7f2ff0128780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46402/0 (socket says 172.21.15.81:46402) 2024-09-18T02:09:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff489b640 1 -- 172.21.15.81:0/1488307057 learned_addr learned my addr 172.21.15.81:0/1488307057 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:09:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2feffff640 1 --1- 172.21.15.81:0/1488307057 >> v1:172.21.15.81:6789/0 conn(0x7f2ff00702c0 0x7f2ff012b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36766/0 (socket says 172.21.15.81:36766) 2024-09-18T02:09:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff489b640 1 -- 172.21.15.81:0/1488307057 >> v1:172.21.15.81:6789/0 conn(0x7f2ff00702c0 legacy=0x7f2ff012b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff489b640 1 -- 172.21.15.81:0/1488307057 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff01281a0 con 0x7f2ff01283a0 2024-09-18T02:09:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2fef7fe640 1 -- 172.21.15.81:0/1488307057 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498502199 0 0) 0x7f2ff0127f00 con 0x7f2ff00702c0 2024-09-18T02:09:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff489b640 1 --2- 172.21.15.81:0/1488307057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ff01283a0 0x7f2ff0128780 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00097f0 tx=0x7f2fe001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b1190f9d0576f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:09:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2fef7fe640 1 -- 172.21.15.81:0/1488307057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fe00b0070 con 0x7f2ff01283a0 2024-09-18T02:09:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2fef7fe640 1 -- 172.21.15.81:0/1488307057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe00ab530 con 0x7f2ff01283a0 2024-09-18T02:09:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2fef7fe640 1 -- 172.21.15.81:0/1488307057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fe00ab830 con 0x7f2ff01283a0 2024-09-18T02:09:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff6aff640 1 -- 172.21.15.81:0/1488307057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ff01283a0 msgr2=0x7f2ff0128780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff6aff640 1 --2- 172.21.15.81:0/1488307057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ff01283a0 0x7f2ff0128780 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00097f0 tx=0x7f2fe001c3a0 comp rx=0 tx=0).stop 2024-09-18T02:09:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff6aff640 1 -- 172.21.15.81:0/1488307057 shutdown_connections 2024-09-18T02:09:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff6aff640 1 --2- 172.21.15.81:0/1488307057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ff01283a0 0x7f2ff0128780 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:09:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff6aff640 1 -- 172.21.15.81:0/1488307057 >> 172.21.15.81:0/1488307057 conn(0x7f2ff009a8a0 msgr2=0x7f2ff009acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:09:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff6aff640 1 -- 172.21.15.81:0/1488307057 shutdown_connections 2024-09-18T02:09:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.508+0000 7f2ff6aff640 1 -- 172.21.15.81:0/1488307057 wait complete. 2024-09-18T02:09:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff6aff640 1 Processor -- start 2024-09-18T02:09:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff6aff640 1 -- start start 2024-09-18T02:09:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff6aff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ff00702c0 0x7f2ff012da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:09:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff6aff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01339a0 con 0x7f2ff00702c0 2024-09-18T02:09:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff489b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ff00702c0 0x7f2ff012da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:09:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff489b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ff00702c0 0x7f2ff012da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46418/0 (socket says 172.21.15.81:46418) 2024-09-18T02:09:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff489b640 1 -- 172.21.15.81:0/4285404233 learned_addr learned my addr 172.21.15.81:0/4285404233 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-18T02:09:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff489b640 1 -- 172.21.15.81:0/4285404233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff0130a80 con 0x7f2ff00702c0 2024-09-18T02:09:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff489b640 1 --2- 172.21.15.81:0/4285404233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ff00702c0 0x7f2ff012da10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0019fd0 tx=0x7f2fe001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:09:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2fed7fa640 1 -- 172.21.15.81:0/4285404233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fe00ba020 con 0x7f2ff00702c0 2024-09-18T02:09:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2fed7fa640 1 -- 172.21.15.81:0/4285404233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe00b6420 con 0x7f2ff00702c0 2024-09-18T02:09:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2fed7fa640 1 -- 172.21.15.81:0/4285404233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fe00b0040 con 0x7f2ff00702c0 2024-09-18T02:09:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff6aff640 1 -- 172.21.15.81:0/4285404233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff0131050 con 0x7f2ff00702c0 2024-09-18T02:09:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff6aff640 1 -- 172.21.15.81:0/4285404233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff0130d40 con 0x7f2ff00702c0 2024-09-18T02:09:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2ff6aff640 1 -- 172.21.15.81:0/4285404233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff01300f0 con 0x7f2ff00702c0 2024-09-18T02:09:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2fed7fa640 1 -- 172.21.15.81:0/4285404233 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2fe00bd020 con 0x7f2ff00702c0 2024-09-18T02:09:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2fed7fa640 1 --2- 172.21.15.81:0/4285404233 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2fdc035db0 0x7f2fdc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T02:09:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2fed7fa640 1 -- 172.21.15.81:0/4285404233 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2fe00e3290 con 0x7f2ff00702c0 2024-09-18T02:09:30.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.512+0000 7f2feffff640 1 --2- 172.21.15.81:0/4285404233 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2fdc035db0 0x7f2fdc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T02:09:30.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.516+0000 7f2feffff640 1 --2- 172.21.15.81:0/4285404233 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2fdc035db0 0x7f2fdc038270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4007fd0 tx=0x7f2fe4007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T02:09:30.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.516+0000 7f2fed7fa640 1 -- 172.21.15.81:0/4285404233 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2fe00c4030 con 0x7f2ff00702c0 2024-09-18T02:09:30.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.700+0000 7f2ff6aff640 1 -- 172.21.15.81:0/4285404233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f2ff006bc50 con 0x7f2ff00702c0 2024-09-18T02:09:30.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.704+0000 7f2fed7fa640 1 -- 172.21.15.81:0/4285404233 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f2ff0130a80 con 0x7f2ff00702c0 2024-09-18T02:09:30.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.708+0000 7f2fed7fa640 1 -- 172.21.15.81:0/4285404233 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2fe00ab4c0 con 0x7f2ff00702c0 2024-09-18T02:09:30.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.708+0000 7f2ff6aff640 1 -- 172.21.15.81:0/4285404233 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2fdc035db0 msgr2=0x7f2fdc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:30.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.708+0000 7f2ff6aff640 1 --2- 172.21.15.81:0/4285404233 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2fdc035db0 0x7f2fdc038270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4007fd0 tx=0x7f2fe4007920 comp rx=0 tx=0).stop 2024-09-18T02:09:30.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.708+0000 7f2ff6aff640 1 -- 172.21.15.81:0/4285404233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ff00702c0 msgr2=0x7f2ff012da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T02:09:30.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.708+0000 7f2ff6aff640 1 --2- 172.21.15.81:0/4285404233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ff00702c0 0x7f2ff012da10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0019fd0 tx=0x7f2fe001abe0 comp rx=0 tx=0).stop 2024-09-18T02:09:30.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.708+0000 7f2ff6aff640 1 -- 172.21.15.81:0/4285404233 shutdown_connections 2024-09-18T02:09:30.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.708+0000 7f2ff6aff640 1 --2- 172.21.15.81:0/4285404233 >> [v2:172.21.15.167:6824/909474575,v1:172.21.15.167:6825/909474575] conn(0x7f2fdc035db0 0x7f2fdc038270 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:09:30.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.708+0000 7f2ff6aff640 1 --2- 172.21.15.81:0/4285404233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ff00702c0 0x7f2ff012da10 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T02:09:30.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.708+0000 7f2ff6aff640 1 -- 172.21.15.81:0/4285404233 >> 172.21.15.81:0/4285404233 conn(0x7f2ff009a8a0 msgr2=0x7f2ff00973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T02:09:30.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.708+0000 7f2ff6aff640 1 -- 172.21.15.81:0/4285404233 shutdown_connections 2024-09-18T02:09:30.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T02:09:30.708+0000 7f2ff6aff640 1 -- 172.21.15.81:0/4285404233 wait complete. 2024-09-18T02:09:30.724 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-18T02:09:30.724 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-18T02:09:30.725 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-18T02:09:30.725 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T02:09:30.816 INFO:tasks.ceph.osd.0:Stopped 2024-09-18T02:09:30.817 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-18T02:09:30.817 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T02:09:30.884 INFO:tasks.ceph.osd.1:Stopped 2024-09-18T02:09:30.884 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-18T02:09:30.885 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T02:09:30.976 INFO:tasks.ceph.osd.2:Stopped 2024-09-18T02:09:30.976 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-18T02:09:30.976 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T02:09:31.054 INFO:tasks.ceph.osd.3:Stopped 2024-09-18T02:09:31.054 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-18T02:09:31.054 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-18T02:09:31.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T02:09:31.093 INFO:tasks.ceph.mgr.x:Stopped 2024-09-18T02:09:31.093 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-18T02:09:31.093 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-18T02:09:31.093 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T02:09:31.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-18T02:09:31.118 INFO:tasks.ceph.mon.a:Stopped 2024-09-18T02:09:31.119 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-18T02:09:31.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-18T02:09:31.178 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T02:09:31.178 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-18T02:09:31.494 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T02:09:31.494 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-18T02:09:31.713 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T02:09:31.714 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-18T02:09:31.894 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T02:09:31.894 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-18T02:09:32.059 INFO:tasks.ceph:Archiving mon data... 2024-09-18T02:09:32.060 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909769/data/mon.a.tgz 2024-09-18T02:09:32.060 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-18T02:09:32.066 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.0NlPUack4F 2024-09-18T02:09:32.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0NlPUack4F 2024-09-18T02:09:32.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.0NlPUack4F 2024-09-18T02:09:32.254 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.0NlPUack4F is 270KB 2024-09-18T02:09:32.312 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.0NlPUack4F 2024-09-18T02:09:32.318 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-18T02:09:32.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T02:09:32.364 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T02:09:32.423 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-18T02:09:32.428 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-18T02:09:32.428 INFO:tasks.ceph:Archiving crash dumps... 2024-09-18T02:09:32.429 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909769/remote/smithi081/crash 2024-09-18T02:09:32.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T02:09:32.479 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909769/remote/smithi167/crash 2024-09-18T02:09:32.480 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T02:09:32.496 INFO:tasks.ceph:Compressing logs... 2024-09-18T02:09:32.497 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T02:09:32.524 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T02:09:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25577.log 2024-09-18T02:09:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25380.log 2024-09-18T02:09:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25811.log 2024-09-18T02:09:32.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25380.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25577.log.gz 2024-09-18T02:09:32.548 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-18T02:09:32.548 INFO:teuthology.orchestra.run.smithi081.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25380.log.gz 2024-09-18T02:09:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25071.log 2024-09-18T02:09:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25811.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25184.log 2024-09-18T02:09:32.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25942.log 2024-09-18T02:09:32.550 INFO:teuthology.orchestra.run.smithi081.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25811.log.gz 2024-09-18T02:09:32.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25184.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.25071.log.gz 2024-09-18T02:09:32.550 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose 86.8% -- /var/log/ceph/ceph-client.admin.25889.log -- replaced with /var/log/ceph/ceph-client.admin.25184.log.gz 2024-09-18T02:09:32.550 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-18T02:09:32.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26023.log 2024-09-18T02:09:32.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25889.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-18T02:09:32.552 INFO:teuthology.orchestra.run.smithi081.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25942.log.gz 2024-09-18T02:09:32.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.26023.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25889.log.gz 2024-09-18T02:09:32.552 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25915.log 2024-09-18T02:09:32.552 INFO:teuthology.orchestra.run.smithi081.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.26023.log.gz 2024-09-18T02:09:32.552 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24920.log 2024-09-18T02:09:32.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.25915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24990.log 2024-09-18T02:09:32.552 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4%/var/log/ceph/ceph-client.admin.24920.log: -- replaced with /var/log/ceph/ceph-client.admin.25915.log.gz 2024-09-18T02:09:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24945.log 2024-09-18T02:09:32.553 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24920.log.gz 2024-09-18T02:09:32.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22768.log 2024-09-18T02:09:32.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.24990.log: /var/log/ceph/ceph-client.admin.24945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25837.log 2024-09-18T02:09:32.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.22768.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24945.log.gz 2024-09-18T02:09:32.555 INFO:teuthology.orchestra.run.smithi081.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24990.log.gz 2024-09-18T02:09:32.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25655.log 2024-09-18T02:09:32.555 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.22768.log.gz 2024-09-18T02:09:32.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25175.log 2024-09-18T02:09:32.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25837.log: /var/log/ceph/ceph-client.admin.25655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24970.log 2024-09-18T02:09:32.555 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25655.log.gz 2024-09-18T02:09:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25175.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25837.log.gz 2024-09-18T02:09:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25276.log 2024-09-18T02:09:32.556 INFO:teuthology.orchestra.run.smithi081.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25175.log.gz 2024-09-18T02:09:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25016.log 2024-09-18T02:09:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.24970.log: /var/log/ceph/ceph-client.admin.25276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25288.log 2024-09-18T02:09:32.559 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25276.log.gz 2024-09-18T02:09:32.559 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24970.log.gz 2024-09-18T02:09:32.559 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25484.log 2024-09-18T02:09:32.559 INFO:teuthology.orchestra.run.smithi081.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25016.log.gz 2024-09-18T02:09:32.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25078.log 2024-09-18T02:09:32.559 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25288.log: /var/log/ceph/ceph-client.admin.25484.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25288.log.gz 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25707.log 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25484.log.gz 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22886.log 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25078.log: /var/log/ceph/ceph-client.admin.25707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25042.log 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25707.log.gz 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.22886.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.25078.log.gz 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25392.log 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.22886.log.gz 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25287.log 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25042.log: /var/log/ceph/ceph-client.admin.25392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25077.log 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25392.log.gz 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25287.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25042.log.gz 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25384.log 2024-09-18T02:09:32.560 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25287.log.gz 2024-09-18T02:09:32.561 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-18T02:09:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25077.log: /var/log/ceph/ceph-client.admin.25384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25785.log 2024-09-18T02:09:32.564 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.25077.log.gz 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25384.log.gz 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22838.log 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25536.log 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25785.log: /var/log/ceph/ceph-client.admin.22838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25733.log 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.25785.log.gz 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.22838.log.gz 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25182.log 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.25536.log.gz 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.25733.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25970.log 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.25733.log.gz 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25182.log.gz 2024-09-18T02:09:32.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25183.log 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23736.log 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25970.log: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25603.log 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25970.log.gz 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.23736.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.25183.log.gz 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25759.log 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23736.log.gz 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25681.log 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25603.log.gz 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25759.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21504.log 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25759.log.gz 2024-09-18T02:09:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25863.log 2024-09-18T02:09:32.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25681.log: /var/log/ceph/ceph.tmp-client.admin.21504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26047.log 2024-09-18T02:09:32.572 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21504.log.gz 2024-09-18T02:09:32.572 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25681.log.gz 2024-09-18T02:09:32.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25391.log 2024-09-18T02:09:32.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.26047.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25863.log.gz 2024-09-18T02:09:32.572 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25997.log 2024-09-18T02:09:32.572 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.26047.log.gz 2024-09-18T02:09:32.573 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25629.log 2024-09-18T02:09:32.573 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.25391.log.gz 2024-09-18T02:09:32.573 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25280.log 2024-09-18T02:09:32.573 INFO:teuthology.orchestra.run.smithi081.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25997.log.gz 2024-09-18T02:09:32.573 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25510.log 2024-09-18T02:09:32.573 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25629.log: /var/log/ceph/ceph-client.admin.25280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25080.log 2024-09-18T02:09:32.573 INFO:teuthology.orchestra.run.smithi081.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25629.log.gz 2024-09-18T02:09:32.573 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25280.log.gz 2024-09-18T02:09:32.573 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25510.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25510.log.gz 2024-09-18T02:09:32.573 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25080.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.25080.log.gz 2024-09-18T02:09:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80187.log 2024-09-18T02:09:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-18T02:09:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.80187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58974.log 2024-09-18T02:09:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60744.log 2024-09-18T02:09:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.58974.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80187.log.gz 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41864.log 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37144.log 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.60744.log: /var/log/ceph/ceph-client.0.41864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66054.log 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.37144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38914.log 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.66054.log: 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35374.log 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.0.58974.log.gz 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% 91.5% -- replaced with /var/log/ceph/ceph-client.0.41864.log.gz 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.0.60744.log.gz 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.38914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86677.log 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.37144.log.gz 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.35374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67827.log 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.86677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37734.log 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.66054.log.gz 2024-09-18T02:09:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84907.log 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.67827.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.35374.log.gz 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.37734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25084.log 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38914.log.gz 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71367.log 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86677.log.gz 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.84907.log: /var/log/ceph/ceph-client.admin.25084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25132.log 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.25084.log.gz 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.71367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30070.log 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37734.log.gz 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.25132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84317.log 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr: 91.9%/var/log/ceph/ceph-client.0.30070.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.25132.log.gz 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.0.67827.log.gz 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63104.log 2024-09-18T02:09:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.84317.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.84907.log.gz 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71367.log.gz 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.63104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74317.log 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81957.log 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.30070.log.gz 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.74317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49534.log 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84317.log.gz 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43634.log 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.81957.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.63104.log.gz 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.49534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73727.log 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29401.log 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.43634.log: /var/log/ceph/ceph-client.0.73727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40684.log 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.29401.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49534.log.gz 2024-09-18T02:09:32.583 INFO:teuthology.orchestra.run.smithi167.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29401.log.gz 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.43634.log.gz 91.7% -- replaced with /var/log/ceph/ceph-client.0.74317.log.gz 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81957.log.gz 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50124.log 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5/var/log/ceph/ceph-client.0.40684.log: --verbose -- /var/log/ceph/ceph-client.0.39504.log 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.50124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48944.log 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.39504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44814.log 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73727.log.gz 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87267.log 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.48944.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40684.log.gz 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.44814.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.50124.log.gz 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39504.log.gz 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77851.log 2024-09-18T02:09:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35964.log 2024-09-18T02:09:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.87267.log: /var/log/ceph/ceph-client.0.77851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44224.log 2024-09-18T02:09:32.585 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44814.log.gz 2024-09-18T02:09:32.585 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48944.log.gz 2024-09-18T02:09:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.35964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59564.log 2024-09-18T02:09:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.44224.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.77851.log.gz 2024-09-18T02:09:32.585 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.87267.log.gz 2024-09-18T02:09:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36554.log 2024-09-18T02:09:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.59564.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-18T02:09:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.36554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55434.log 2024-09-18T02:09:32.585 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.35964.log.gz 2024-09-18T02:09:32.591 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25108.log 2024-09-18T02:09:32.591 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44224.log.gz 2024-09-18T02:09:32.591 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50714.log 2024-09-18T02:09:32.591 INFO:teuthology.orchestra.run.smithi167.stderr: 92.0%/var/log/ceph/ceph-client.0.55434.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.59564.log.gz 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.0.36554.log.gz/var/log/ceph/ceph-client.admin.25108.log: 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53074.log 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25108.log.gz 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.50714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69007.log 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.53074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70187.log 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.69007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33604.log 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.55434.log.gz/var/log/ceph/ceph-client.0.70187.log: 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50714.log.gz 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87857.log 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6% 91.6% -- replaced with /var/log/ceph/ceph-client.0.53074.log.gz 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.33604.log: -- replaced with /var/log/ceph/ceph-client.0.69007.log.gz 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52484.log 2024-09-18T02:09:32.592 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70187.log.gz 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.87857.log: gzip -5/var/log/ceph/ceph-client.0.52484.log: --verbose -- /var/log/ceph/ceph-client.0.54844.log 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76087.log 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.33604.log.gz 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.54844.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87857.log.gz 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33020.log 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52484.log.gz 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.76087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53664.log 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.33020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45994.log 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.53664.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.33020.log.gz 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54844.log.gz 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30660.log 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.45994.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81367.log 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.0.53664.log.gz 2024-09-18T02:09:32.593 INFO:teuthology.orchestra.run.smithi167.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.76087.log.gz 2024-09-18T02:09:32.594 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.30660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48354.log 2024-09-18T02:09:32.594 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.81367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66644.log 2024-09-18T02:09:32.594 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.48354.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.45994.log.gz 2024-09-18T02:09:32.596 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81367.log.gz 91.6% -- replaced with /var/log/ceph/ceph-client.0.30660.log.gz 2024-09-18T02:09:32.596 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-18T02:09:32.596 INFO:teuthology.orchestra.run.smithi167.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48354.log.gz 2024-09-18T02:09:32.597 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69597.log 2024-09-18T02:09:32.597 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.66644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34194.log 2024-09-18T02:09:32.597 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.69597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56024.log 2024-09-18T02:09:32.597 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.34194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67237.log 2024-09-18T02:09:32.597 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.56024.log: 91.6% 91.5% -- replaced with /var/log/ceph/ceph-client.0.69597.log.gz 2024-09-18T02:09:32.597 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.0.66644.log.gz 2024-09-18T02:09:32.597 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41274.log 2024-09-18T02:09:32.597 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.34194.log.gz 2024-09-18T02:09:32.597 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.67237.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-18T02:09:32.597 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.41274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43044.log 2024-09-18T02:09:32.598 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.56024.log.gz 2024-09-18T02:09:32.598 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mgr.x.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.67237.log.gz 2024-09-18T02:09:32.599 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31840.log 2024-09-18T02:09:32.599 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41274.log.gz 2024-09-18T02:09:32.599 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73137.log 2024-09-18T02:09:32.599 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.43044.log: /var/log/ceph/ceph-client.0.31840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77267.log 2024-09-18T02:09:32.600 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.73137.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43044.log.gz 2024-09-18T02:09:32.600 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29329.log 2024-09-18T02:09:32.600 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.0.31840.log.gz 2024-09-18T02:09:32.600 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.77267.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.73137.log.gz 2024-09-18T02:09:32.601 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47174.log 2024-09-18T02:09:32.602 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.29329.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.77267.log.gz 2024-09-18T02:09:32.602 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42454.log 2024-09-18T02:09:32.602 INFO:teuthology.orchestra.run.smithi167.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29329.log.gz 2024-09-18T02:09:32.602 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.47174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80777.log 2024-09-18T02:09:32.602 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.42454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68417.log 2024-09-18T02:09:32.603 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.80777.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.47174.log.gz 2024-09-18T02:09:32.603 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.42454.log.gz 2024-09-18T02:09:32.604 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80777.log.gz 2024-09-18T02:09:32.604 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60154.log 2024-09-18T02:09:32.604 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.68417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86087.log 2024-09-18T02:09:32.605 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.60154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74907.log 2024-09-18T02:09:32.605 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.86087.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68417.log.gz 2024-09-18T02:09:32.606 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76677.log 2024-09-18T02:09:32.607 INFO:teuthology.orchestra.run.smithi167.stderr: 91.2%/var/log/ceph/ceph-client.0.74907.log: -- replaced with /var/log/ceph/ceph-client.0.60154.log.gz 2024-09-18T02:09:32.607 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.86087.log.gz 2024-09-18T02:09:32.608 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34784.log 2024-09-18T02:09:32.608 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.76677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61924.log 2024-09-18T02:09:32.608 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74907.log.gz 2024-09-18T02:09:32.608 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.34784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65464.log 2024-09-18T02:09:32.609 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.61924.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.76677.log.gz 2024-09-18T02:09:32.609 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34784.log.gz 2024-09-18T02:09:32.610 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58384.log 2024-09-18T02:09:32.610 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.65464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70777.log 2024-09-18T02:09:32.612 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.58384.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65464.log.gz 93.4% 2024-09-18T02:09:32.612 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.0.61924.log.gz 2024-09-18T02:09:32.613 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25060.log 2024-09-18T02:09:32.613 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58384.log.gz 2024-09-18T02:09:32.613 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.70777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88452.log 2024-09-18T02:09:32.613 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.25060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61334.log 2024-09-18T02:09:32.614 INFO:teuthology.orchestra.run.smithi167.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.25060.log.gz 2024-09-18T02:09:32.614 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.88452.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70777.log.gz 2024-09-18T02:09:32.615 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83137.log 2024-09-18T02:09:32.615 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-18T02:09:32.617 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.61334.log: /var/log/ceph/ceph-client.0.83137.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83137.log.gz 2024-09-18T02:09:32.617 INFO:teuthology.orchestra.run.smithi167.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.88452.log.gz 2024-09-18T02:09:32.617 INFO:teuthology.orchestra.run.smithi167.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.61334.log.gz 2024-09-18T02:09:32.619 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31250.log 2024-09-18T02:09:32.619 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46584.log 2024-09-18T02:09:32.619 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.0.31250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71957.log 2024-09-18T02:09:32.619 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.46584.log: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-18T02:09:32.620 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32430.log 2024-09-18T02:09:32.621 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.71957.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.31250.log.gz 91.6% 2024-09-18T02:09:32.621 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.0.46584.log.gz 2024-09-18T02:09:32.621 INFO:teuthology.orchestra.run.smithi167.stderr: 92.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-18T02:09:32.622 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79019.log 2024-09-18T02:09:32.623 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.71957.log.gz 2024-09-18T02:09:32.623 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.32430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62514.log 2024-09-18T02:09:32.623 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.79019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45404.log 2024-09-18T02:09:32.624 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.62514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79603.log 2024-09-18T02:09:32.624 INFO:teuthology.orchestra.run.smithi167.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.79019.log.gz 2024-09-18T02:09:32.624 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.45404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85497.log 2024-09-18T02:09:32.624 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.32430.log.gz 2024-09-18T02:09:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.79603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54254.log 2024-09-18T02:09:32.626 INFO:teuthology.orchestra.run.smithi167.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.79603.log.gz 2024-09-18T02:09:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.85497.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45404.log.gz 2024-09-18T02:09:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29353.log 2024-09-18T02:09:32.626 INFO:teuthology.orchestra.run.smithi167.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.62514.log.gz 2024-09-18T02:09:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.54254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51894.log 2024-09-18T02:09:32.628 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85497.log.gz 2024-09-18T02:09:32.628 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75497.log 2024-09-18T02:09:32.628 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.29353.log: /var/log/ceph/ceph-client.0.51894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38324.log 2024-09-18T02:09:32.628 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29353.log.gz 2024-09-18T02:09:32.628 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.0.54254.log.gz/var/log/ceph/ceph-client.0.75497.log: 2024-09-18T02:09:32.628 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72547.log 2024-09-18T02:09:32.629 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56614.log 2024-09-18T02:09:32.629 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.38324.log: /var/log/ceph/ceph-client.0.72547.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.51894.log.gz 2024-09-18T02:09:32.629 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.75497.log.gz 2024-09-18T02:09:32.630 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64874.log 2024-09-18T02:09:32.630 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.56614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64284.log 2024-09-18T02:09:32.630 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.38324.log.gz 2024-09-18T02:09:32.630 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72547.log.gz 2024-09-18T02:09:32.631 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.64874.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.56614.log.gz 2024-09-18T02:09:32.631 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29377.log 2024-09-18T02:09:32.632 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.64284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51304.log 2024-09-18T02:09:32.632 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.29377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47764.log 2024-09-18T02:09:32.633 INFO:teuthology.orchestra.run.smithi167.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29377.log.gz 2024-09-18T02:09:32.633 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.51304.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.64874.log.gz 2024-09-18T02:09:32.633 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64284.log.gz 2024-09-18T02:09:32.634 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82547.log 2024-09-18T02:09:32.634 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.47764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83727.log 2024-09-18T02:09:32.634 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3%/var/log/ceph/ceph-client.0.82547.log: -- replaced with /var/log/ceph/ceph-client.0.51304.log.gz 2024-09-18T02:09:32.634 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40094.log 2024-09-18T02:09:32.635 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.83727.log: 92.2% -- replaced with /var/log/ceph/ceph-client.0.47764.log.gz 2024-09-18T02:09:32.635 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78435.log 2024-09-18T02:09:32.636 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.40094.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57794.log 2024-09-18T02:09:32.636 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.0.82547.log.gz 2024-09-18T02:09:32.636 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83727.log.gz 2024-09-18T02:09:32.636 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.78435.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78435.log.gz 2024-09-18T02:09:32.637 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40094.log.gz 2024-09-18T02:09:32.637 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63694.log 2024-09-18T02:09:32.638 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.57794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57204.log 2024-09-18T02:09:32.639 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.0.63694.log: /var/log/ceph/ceph-client.0.57204.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63694.log.gz 2024-09-18T02:09:32.639 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57794.log.gz 2024-09-18T02:09:32.639 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57204.log.gz 2024-09-18T02:09:32.663 INFO:teuthology.orchestra.run.smithi167.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-18T02:09:32.751 INFO:teuthology.orchestra.run.smithi081.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-18T02:09:33.415 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-18T02:09:33.485 INFO:teuthology.orchestra.run.smithi081.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-18T02:09:33.486 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-18T02:09:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m0.961s 2024-09-18T02:09:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m1.163s 2024-09-18T02:09:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.059s 2024-09-18T02:09:33.560 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-18T02:09:33.567 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-18T02:09:33.568 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-18T02:09:33.568 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m1.023s 2024-09-18T02:09:33.568 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m3.030s 2024-09-18T02:09:33.569 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m0.186s 2024-09-18T02:09:33.569 INFO:tasks.ceph:Archiving logs... 2024-09-18T02:09:33.570 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909769/remote/smithi081/log 2024-09-18T02:09:33.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T02:09:33.794 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909769/remote/smithi167/log 2024-09-18T02:09:33.795 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T02:09:34.266 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T02:09:34.277 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T02:09:34.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T02:09:34.280 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T02:09:34.347 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T02:09:34.358 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T02:09:34.359 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T02:09:34.361 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T02:09:34.371 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-09-18T02:09:34.371 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-09-18T02:09:34.371 INFO:teuthology.orchestra.run.smithi081.stdout:+hv01.front.sepi 67.205.162.81 3 u 30 64 377 0.090 +0.894 1.971 2024-09-18T02:09:34.371 INFO:teuthology.orchestra.run.smithi081.stdout:*hv02.front.sepi 63.231.80.2 3 u 24 64 377 0.083 -1.972 2.787 2024-09-18T02:09:34.371 INFO:teuthology.orchestra.run.smithi081.stdout:+hv03.front.sepi 74.6.168.72 3 u 24 64 377 0.072 -3.497 1.587 2024-09-18T02:09:34.371 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T02:09:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: remote refid st t when poll reach delay offset jitter 2024-09-18T02:09:34.372 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================== 2024-09-18T02:09:34.373 INFO:teuthology.orchestra.run.smithi167.stdout:+hv01.front.sepi 67.205.162.81 3 u 21 64 377 0.084 +0.895 1.733 2024-09-18T02:09:34.373 INFO:teuthology.orchestra.run.smithi167.stdout:*hv02.front.sepi 63.231.80.2 3 u 29 64 377 0.099 -0.158 1.467 2024-09-18T02:09:34.373 INFO:teuthology.orchestra.run.smithi167.stdout:+hv03.front.sepi 74.6.168.72 3 u 23 64 377 0.089 -1.173 1.868 2024-09-18T02:09:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-18T02:09:34.374 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T02:09:34.397 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T02:09:34.397 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T02:09:34.447 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T02:09:34.497 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T02:09:34.551 INFO:teuthology.task.internal:Duration was 943.743536 seconds 2024-09-18T02:09:34.551 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T02:09:34.598 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T02:09:34.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T02:09:34.601 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T02:09:34.638 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T02:09:34.638 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T02:09:34.638 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T02:09:34.687 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T02:09:34.687 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T02:09:34.698 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T02:09:34.698 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T02:09:34.731 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T02:09:34.768 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T02:09:34.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T02:09:34.799 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T02:09:34.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T02:09:34.874 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T02:09:34.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T02:09:34.886 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T02:09:34.896 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T02:09:34.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T02:09:34.931 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T02:09:34.941 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-18T02:09:34.948 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-09-18T02:09:35.054 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T02:09:35.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T02:09:35.103 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T02:09:35.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T02:09:35.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T02:09:35.118 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T02:09:35.119 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909769/remote/smithi081 2024-09-18T02:09:35.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T02:09:35.167 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909769/remote/smithi167 2024-09-18T02:09:35.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T02:09:35.190 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T02:09:35.190 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T02:09:35.208 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T02:09:35.235 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T02:09:35.246 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T02:09:35.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T02:09:35.273 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T02:09:35.273 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T02:09:35.275 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T02:09:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 02:09 /home/ubuntu/cephtest 2024-09-18T02:09:35.283 INFO:teuthology.orchestra.run.smithi167.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 02:09 /home/ubuntu/cephtest 2024-09-18T02:09:35.284 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T02:09:35.324 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T02:09:35.400 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} duration: 943.7435357570648 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-18T02:09:35.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T02:09:35.468 INFO:teuthology.run:pass